US10356438B2 - Method and apparatus of error handling for video coding using intra block copy mode - Google Patents
Method and apparatus of error handling for video coding using intra block copy mode Download PDFInfo
- Publication number
- US10356438B2 US10356438B2 US15/578,191 US201615578191A US10356438B2 US 10356438 B2 US10356438 B2 US 10356438B2 US 201615578191 A US201615578191 A US 201615578191A US 10356438 B2 US10356438 B2 US 10356438B2
- Authority
- US
- United States
- Prior art keywords
- block
- pixels
- current
- current picture
- reference block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/563—Motion estimation with padding, i.e. with filling of non-object values in an arbitrarily shaped picture block or region for estimation purposes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
Definitions
- the present invention relates to video coding using Intra Block Copy (IntraBC) mode.
- the present invent relates to error handling for a coding system using the Intra block copy mode.
- IntraBC Intra Block Copy
- High Efficiency Video Coding is a new coding standard that has been developed in recent years.
- HEVC High Efficiency Video Coding
- a CU may begin with a largest CU (LCU), which is also referred as coded tree unit (CTU) in HEVC.
- CTU coded tree unit
- PU prediction unit
- HEVC High Efficiency Video Coding
- SCC screen content coding
- coding tools Due to specific characteristics of screen contents, coding tools have been developed and demonstrate significant gains in coding efficiency.
- the colour index coding (a.k.a. major colour based coding) techniques represent block of pixels using indices to the palette (major colours), and encode the palette and the indices by exploiting spatial redundancy. While the total number of possible colour combinations is huge, the number of colours in an area of picture is usually very limited for typical screen contents. Therefore, the colour index coding becomes very effective for screen content materials.
- Related key colour index coding techniques are briefly reviewed as follows.
- JCTVC-M0350 Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC 1/SC 29/WG11 13th Meeting: Incheon, KR, 18-26 Apr. 2013, Document: JCTVC-M0350).
- JCTVC-M0350 An example according to JCTVC-M0350 is shown in FIG.
- a current coding unit (CU, 110 ) is coded using Intra MC (motion compensation).
- the Intra MC is also named as Intra Block Copy (IntraBC).
- the prediction block ( 120 ) is located from the current CU and a displacement vector ( 112 ).
- the search area is limited to the current CTU (coding tree unit), the left CTU and the left-left CTU.
- the prediction block is obtained from the already reconstructed region.
- the displacement vector also named motion vector (MV) or block vector (BV), and residual for the current CU are coded.
- MV motion vector
- BV block vector
- residual for the current CU are coded.
- the HEVC adopts CTU and CU block structure as basic units for coding video data.
- Each picture is divided into CTUs and each CTU is reclusively divided into CUs.
- each CU may be divided into multiple blocks, named prediction units (PUs) for performing prediction process.
- PUs prediction units
- the IntraBC is different from the motion compensation used for Inter prediction in at least the following areas:
- JCTVC-M0350 Based on JCTVC-M0350, some modifications are disclosed by Pang, et al., in Non - RCE 3 : Intra Motion Compensation with 2- D MVs , Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Vienna, AT, 25 Jul.-2 Aug. 2013, Document: JCTVC-N0256 (hereinafter JCTVC-N0256).
- JCTVC-N0256 Joint Collaborative Team on Video Coding
- the IntraBC is extended to support 2-D MVs, so that both vertical and horizontal MV components can be non-zero at the same time. This provides more flexibility to IntraBC than the original approach, where the MV is restricted to be strictly horizontal or vertical.
- JCTVC-R0309 In JCTVC-R0309 (Pang, et al., “Non-SCCE1: Combination of JCTVC-R0185 and JCTVC-R0203”, JCTVC-R0309, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 18th Meeting: Sapporo, J P, July 2014), the neighbouring BVs and coded BVs are used as BV predictor (BVP).
- the BV predictor is derived similar to the AMVP (advanced motion vector prediction) scheme in HEVC.
- the predictor candidate list is constructed by first accessing in order the spatial neighbouring blocks a 1 ( 220 ) and b 1 ( 230 ) of a current block ( 210 ) as shown in FIG. 2 . If any of the spatial neighbours doesn't have a block vector, the last two coded BVs are used as substitute block vectors to fill the block vector candidate list so that the list contain two different entries.
- the substitute block vectors are initialized with ( ⁇ 2*CU_width, 0) and ( ⁇ CU_width, 0), where CU_width is the width of the CU. To avoid the line buffer, the above BV out of current CTU is considered unavailable.
- the last two coded BVs are reset to (0, 0) for each CTU to prevent the data dependency.
- Merge candidates are derived from spatial/temporal neighbour blocks for the current coded block in an Inter coded slice.
- a merge_flag is used to signal whether the current block is merged into one of its candidates. If yes, another index is used to signal which of the candidates is used for Merge mode. For example, if candidate block a 1 in FIG. 2 is signalled as the candidate to be used, then the current block will share the same motion vector and reference picture as those in block a 1 .
- any Merge candidate is not available (e.g. non-existing or not coded in Inter mode)
- additional candidates are inserted into the candidate list. If the Merge candidate list is still not full after inserting the additional candidates, zero motion vector with reference index (i.e., refldx) equal to 0 will be used to fill all the empty candidates.
- the type-2 additional candidates are inserted after the type-1 additional candidates.
- bi-predictive Merge candidates are generated by combining original Merge candidates.
- two original candidates which have mvL0 (the motion vector in list 0) and refldxL0 (the reference picture index in list 0), or mvL1 (the motion vector in list 1) and refIdxL1 (the reference picture index in list 1), are used to generate bi-predictive Merge candidates.
- zero-vector Merge/AMVP candidates are generated by combining zero vectors and reference index which can be referred. If zero-vector candidates are not duplicated, it is added to Merge/AMVP candidate set.
- BV block vector
- various methods are disclosed. According to one method, if the reference block overlaps with an unavailable area, the reference pixels in the unavailable area are generated for IntraBC prediction of the current block by padding from neighbouring available pixels.
- the padding can be done in the horizontal direction and then the vertical direction.
- the padding may also done in the vertical direction first and then horizontal direction.
- the reference pixels in the unavailable area are generated for IntraBC prediction of the current block by using previous decoded pixels in the unavailable area.
- all pixels in a storage area of the current picture are set to a pre-defined value before decoding the current picture and storing a previous decoded block in the storage area of the current picture.
- the reference block for the current block is fetched directly from the storage area of the current picture regardless whether the reference block is in the unavailable area or not. Accordingly, when previous decoded pixels are not available, the pre-defined value will be used.
- the pre-defined value can be equal to (1 ⁇ (bit_depth ⁇ 1)), where bit_depth corresponds to bit depth of the current picture.
- the reference pixels in the unavailable area are generated for IntraBC prediction of the current block by using a pre-defined value.
- the pre-defined value can be equal to (1 ⁇ (bit_depth ⁇ 1)), where bit_depth corresponds to bit depth of the current picture.
- bit_depth corresponds to bit depth of the current picture.
- the whole block is set to the pre-defined value.
- the pre-defined value can be signalled in a SPS (sequence parameter set), PPS (picture parameter set), or slice header.
- Another aspect of the present invention addresses the issue of determining whether to use integer motion vector.
- one or two previously coded slices, tiles or pictures are used to determine whether to use integer motion vector for the current slice, tile or picture.
- pixel-level ACT is used.
- pixel-level inverse CCP process and inverse ACT process can be applied in cascade by passing an inverse CCP processed pixel directly to the inverse ACT process.
- pixel-level inverse ACT process and pixel reconstruction process can be applied in cascade by passing an inverse ACT processed pixel directly to the pixel reconstruction process.
- FIG. 1 illustrates an example of Intra Block Copy (IntraBC), where the block vector is restricted to the horizontal direction.
- IntraBC Intra Block Copy
- FIG. 2 illustrates an example of constructing motion vector predictor candidate list based on motion vectors of spatial neighbouring blocks.
- FIG. 3 illustrates an example of a ladder shaped IntraBC search range according to existing HEVC SCC (high efficiency video coding-screen content coding) specification.
- FIG. 4 illustrates an example of using previous decoded pixels outside the ladder shape boundary according to an embodiment of the present invention.
- FIG. 5 illustrates a block diagram of a decoding system incorporating in-loop colour-space transform.
- FIG. 6 illustrates a flowchart of an exemplary decoding system incorporating error handling according to an embodiment of the present invention for the case that a decoded block vector pointing to a reference block overlapping with an unavailable area.
- the decoder might have a decoded BV that point to unavailable area.
- the decoded BV is resulted from a bitstream with transmission error.
- An encoder could also generate an incorrect BV. This could happen especially in multiple tile process and multiple slice process.
- the decoder behaviour regarding how to compensate the IntraBC block is undefined when the coded BV point to unavailable area.
- the textures in the unavailable are padded by using the neighbouring available pixels.
- the padded textures are used for IntraBC compensation.
- the padding can be performed individually in the horizontal direction and the vertical direction. For example, for the unavailable area, the horizontal padding can be applied first followed by the vertical padding. Alternatively, the vertical padding can be applied first followed by the horizontal padding for the unavailable area.
- IntraBC reference block is overlapped with the previously reconstructed, but unavailable area outside the ladder shape boundary, the decoded samples outside the ladder shape boundary are used even if they are considered as unavailable.
- FIG. 4 illustrates an example of using previous decoded pixels outside the ladder shape boundary.
- Coding tree units CTU-0, CTU-1 and CTU-2 correspond to the leading CTUs in respective CTU rows or slices that the current CTU CTU-3 can refer as IntraBC reference data.
- the cross-line filled ladder shape area corresponds to the IntraBC reference data that CTU-3 can use for IntraBC prediction.
- the slant-line filled area 410 corresponds to the area that has been reconstructed. However, in the conventional IntraBC process, this area outside the ladder shape boundary cannot be used as reference data for CTU-3.
- the reference block is overlapped with the slant-line filled area 410 , the previous decoded pixels in the slant-line filled area 410 are used as for IntraBC prediction.
- pixels in the unavailable area outside the ladder shape boundary may not be decoded yet.
- all samples in the current picture can be reset to a pre-defined value before decoding the current picture.
- the pre-defined value can be set to (1 ⁇ (bit_depth ⁇ 1)).
- the current picture decoding the current picture is updated.
- the reference block samples are directly fetched from the current picture regardless whether the samples are in the available area or not. Therefore, if the pixels in the unavailable area outside the ladder shape area have been previously decoded, the previous decoded pixels will be used for IntraBC prediction. Otherwise, if the pixels in the unavailable area are accessed, the accessed data correspond to the pre-defined data according to this arrangement.
- the predefined value can be defined in standard or signalled in the SPS (sequence parameter set), PPS (picture parameter set), or slice header.
- (xPb, yPb) specifies the top-left sample location of the current luma prediction block relative to the top-left luma sample of the current picture
- (xCb, yCb) sepecifies the the top-left luma sample location of the current luma coding block relative to the top-left luma sample of the current picture
- nPbSw and nPbSh are the PU width and PU height
- CtbSizeY is the CTU height.
- condition in eq. (1) it implies that the reference block is inside the ladder shape reference area. If the condition is false, it implies that the reference block is outside the ladder shape reference area and the embodiment mentioned above is applied.
- the IntraBC reference data only the previous decoded data in the available area is allowed to be used as the IntraBC reference data. If the IntraBC reference block is overlapped with the unavailable area, the textures in the unavailable are set to a predefined value, such as (1 ⁇ (bit_depth ⁇ 1)) or 128 according to this embodiment. Therefore, if the IntraBC reference block is overlapped with the unavailable area, the pre-defined pixel values can be used.
- the predefined value can be signalled in the SPS (sequence parameter set), PPS (picture parameter set), or slice header.
- the textures of the whole reference block are set to a predefined value, such as (1 ⁇ (bit_depth ⁇ 1)).
- the predefined value can be signalled in the SPS (sequence parameter set), PPS (picture parameter set), or slice header.
- a SPS-level syntax motion_vector_resolution_control_idc is signalled in the SPS to control the presence and inference of the use_integer_mv_flag that specifies the resolution of motion vectors for Inter prediction. If the motion_vector_resolution_control_idc is 2, the slice-level syntax use_integer_mv_flag is signalled. If the use_integer_mv_flag is 1, it implies that the MV resolution of this slice is integer pixel. Otherwise, the MV resolution of this slice is quarter pixel.
- only the previous coded slice/picture is used to determine the value of use_integer_mv_flag.
- two previous coded slices/pictures are selected to determine the value of use_integer_mv_flag.
- These two pictures can be two pictures that closed to the current picture.
- one picture e.g. picture-A
- the other picture is the first picture in List_0 of the first picture in List_0 of the current picture (i.e., the first picture in List_0 of the picture-A).
- the statistic of the current picture can be used to decide the use_integer_my_flag of the following pictures.
- the IntraBC search range for a current block (i.e., a CU) is the current CTU and left CTU.
- the pixels for IntraBC prediction and compensation are the un-filtered pixels, which are the pixels before deblocking and SAO.
- One method of the present invention increases the IntraBC search range to be larger than the current CTU and left CTU.
- the pixels for IntraBC prediction and compensation can be the un-filtered pixels or filtered pixels depending on the position of the pixels.
- the pixels for IntraBC prediction and compensation can be the un-filtered pixels for the pixels in current CTU and left CTU.
- Other pixels are using filtered pixels (i.e., after deblocking and SAO).
- the pixels for IntraBC prediction and compensation can be the un-filtered pixels for the pixels in current CTU, left CTU, and four above lines of the current CTU and left CTU. Other pixels are using filtered pixels.
- the pixels for IntraBC prediction and compensation can be the un-filtered pixels for the pixels in current CTU, four above lines of current CTU, and four left column of current CTU. Other pixels are using filtered.
- the pixels for IntraBC prediction and compensation can be the un-filtered pixels for the pixels above four pixel lines of current CTU row. Other pixels are using filtered.
- the pre-deblocking texture of current picture needs to be stored for IntraBC search and compensation.
- the texture after SAO process of current picture is also need to be stored as the reference frames for the following picture coding.
- the pre-deblocking texture of current picture and the texture difference between pre-deblocking texture and after SAO texture are stored.
- the after-SAO texture and the texture difference between pre-deblocking texture and after SAO texture are stored. Since the SAO and deblocking filter will not change the picture value by much, the bit-depth of the texture difference should be less than the bit-depth of the normal reconstructed texture.
- CCP In HEVC Range Extension (HEVC-RExt) and HEVC Screen Content Coding (HEVC-SCC), there is a coding tool called cross-component prediction (CCP).
- CCP uses luma/G residual to predict the chroma/B/R residual.
- an in-loop adaptive colour transform (ACT) has proposed to remove the redundancy among the colour components.
- SCM-2.0 the ACT is a CU-level process.
- SCM-3.0 the ACT is modified as a TU-level process.
- FIG. 5 An example of decoding system block diagram including the in-loop colour-space transform is shown in FIG. 5 .
- An additional module i.e., inverse colour-space transform ( 530 ) is included.
- Various modules are shown in FIG. 5 including entropy decoder ( 510 ), de-quantization ( 515 ), inverse transform ( 520 ), cross-component prediction (CCP, 525 ), motion compensation ( 535 ), Intra prediction ( 540 ), adder ( 545 ), deblocking filter ( 550 ), SAO (sample adaptive offset) filter ( 555 ) and DPB (decoded picture buffer, 560 ).
- the decoder also includes a first switch (S 1 ) select inverse colour-space transform (in the lower position) or bypass the inverse colour-space transform (in the upper position).
- the decoder also includes a second switch (S 2 ) select Inter prediction (in the upper position) or Intra prediction (in the lower position).
- S 1 select inverse colour-space transform
- S 2 select Inter prediction (in the upper position) or Intra prediction (in the lower position).
- All other modules are standard decoder modules used in conventional HEVC. When a block is coded with the colour-space transform enabled, the inverse colour-space transform is invoked to convert the residual domain back to the original domain for the output from the conventional inverse DCT/DST transform and CCP.
- the forward and the inverse colour-space transforms for lossy coding use the YCoCg transform matrices, which are defined as follows:
- the pixel-level process is disclosed.
- the YUV/YCbCr/RGB residual samples can be loaded and the ACT can be performed in cascade after pixel-level CCP process.
- the ACT will not need an additional processing stage.
- the pixel-level ACT is performed in the reconstruction stage when adding the residual with predictors.
- the inverse ACT for each residual sample is first applied and then the final residual sample is added with predictor.
- the ACT process in the block level is disclosed.
- the block size is M ⁇ N, where M and N are both positive integers and the block size can be predetermined or transmitted in the bitstream.
- the YUV/YCbCr/RGB residual samples can be loaded and the ACT can be cascaded performed after block-level CCP process.
- the inverse ACT process can be applied in cascade with the inverse transform if the CCP is turn off. If CCP is on, the inverse CCP process and inverse ACT process can be applied in cascade with the inverse transform.
- FIG. 6 illustrates a flowchart of an exemplary decoding system incorporating error handling according to an embodiment of the present invention for the case that a decoded block vector pointing to a reference block overlapping with an unavailable area.
- a decoded BV (block vector) for a current block in a current picture is determined in step 610 .
- a reference block in the current picture is determined in step 620 , where the reference block is pointed by the decoded BV from the current block. If the reference block overlaps with an unavailable area, reference pixels in the unavailable area are generated for IntraBC prediction of the current block by padding from neighbouring available pixels, by using previous decoded pixels in the unavailable area, or by using a pre-defined value in step 630 . Then, the current block in the IntraBC mode can be decoded using the reference block as shown in step 640 .
- Embodiment of the present invention as described above may be implemented in various hardware, software codes, or a combination of both.
- an embodiment of the present invention can be one or more circuit circuits integrated into a video compression chip or program code integrated into video compression software to perform the processing described herein.
- An embodiment of the present invention may also be program code to be executed on a Digital Signal Processor (DSP) to perform the processing described herein.
- DSP Digital Signal Processor
- the invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA). These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention.
- the software code or firmware code may be developed in different programming languages and different formats or styles.
- the software code may also be compiled for different target platforms.
- different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/578,191 US10356438B2 (en) | 2015-06-03 | 2016-06-03 | Method and apparatus of error handling for video coding using intra block copy mode |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201562170267P | 2015-06-03 | 2015-06-03 | |
US15/578,191 US10356438B2 (en) | 2015-06-03 | 2016-06-03 | Method and apparatus of error handling for video coding using intra block copy mode |
PCT/CN2016/084767 WO2016192677A1 (fr) | 2015-06-03 | 2016-06-03 | Procédé et appareil de traitement d'erreurs pour codage vidéo utilisant un mode de copie intra-bloc |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2016/084767 A-371-Of-International WO2016192677A1 (fr) | 2015-06-03 | 2016-06-03 | Procédé et appareil de traitement d'erreurs pour codage vidéo utilisant un mode de copie intra-bloc |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/431,062 Continuation US20190289320A1 (en) | 2015-06-03 | 2019-06-04 | Method and apparatus of error handling for video coding using intra block copy mode |
Publications (2)
Publication Number | Publication Date |
---|---|
US20180152727A1 US20180152727A1 (en) | 2018-05-31 |
US10356438B2 true US10356438B2 (en) | 2019-07-16 |
Family
ID=57440195
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/578,191 Active US10356438B2 (en) | 2015-06-03 | 2016-06-03 | Method and apparatus of error handling for video coding using intra block copy mode |
US16/431,062 Abandoned US20190289320A1 (en) | 2015-06-03 | 2019-06-04 | Method and apparatus of error handling for video coding using intra block copy mode |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/431,062 Abandoned US20190289320A1 (en) | 2015-06-03 | 2019-06-04 | Method and apparatus of error handling for video coding using intra block copy mode |
Country Status (5)
Country | Link |
---|---|
US (2) | US10356438B2 (fr) |
EP (1) | EP3304906A4 (fr) |
CN (1) | CN107852505A (fr) |
CA (1) | CA2986950C (fr) |
WO (1) | WO2016192677A1 (fr) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11159788B2 (en) | 2018-08-03 | 2021-10-26 | Mediatek Inc. | Method and apparatus of enhanced Intra Block Copying mode for video coding |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3297282A1 (fr) * | 2016-09-15 | 2018-03-21 | Thomson Licensing | Procédé et appareil pour codage vidéo avec écrêtage adaptatif |
US10694181B2 (en) * | 2017-01-27 | 2020-06-23 | Qualcomm Incorporated | Bilateral filters in video coding with reduced complexity |
US10462483B1 (en) * | 2018-04-26 | 2019-10-29 | Tencent America LLC | Method and apparatus for video coding |
SG11202104942TA (en) * | 2018-11-27 | 2021-06-29 | Op Solutions Llc | Adaptive block update of unavailable reference frames using explicit and implicit signaling |
WO2020108574A1 (fr) * | 2018-11-28 | 2020-06-04 | Beijing Bytedance Network Technology Co., Ltd. | Procédé d'amélioration de mode de dérivation de transformée ou de quantification |
WO2020156545A1 (fr) | 2019-02-02 | 2020-08-06 | Beijing Bytedance Network Technology Co., Ltd. | Prédiction au moyen d'échantillons intra-tampon pour copie intra-bloc dans un codage vidéo |
BR112021014484A2 (pt) * | 2019-02-02 | 2021-09-28 | Beijing Bytedance Network Technology Co., Ltd. | Gerenciamento de buffer para cópia de bloco intra em codificação de vídeo |
JP7405861B2 (ja) | 2019-03-01 | 2023-12-26 | 北京字節跳動網絡技術有限公司 | 映像符号化におけるイントラブロックコピーのための方向に基づく予測 |
JP7284284B2 (ja) | 2019-03-04 | 2023-05-30 | 北京字節跳動網絡技術有限公司 | 映像符号化におけるイントラブロックコピーの実装形態の態様 |
WO2020184990A1 (fr) * | 2019-03-11 | 2020-09-17 | 엘지전자 주식회사 | Procédé et appareil de codage/décodage d'images utilisant la prédiction ibc, et procédé de transmission d'un flux binaire |
KR20220147731A (ko) * | 2019-03-11 | 2022-11-03 | 엘지전자 주식회사 | Ibc 모드를 이용한 영상 부호화/복호화 방법, 장치 및 비트스트림을 전송하는 방법 |
WO2020185043A1 (fr) * | 2019-03-13 | 2020-09-17 | 엘지전자 주식회사 | Procédé et dispositif de codage/décodage d'image utilisant une prédiction de copie intra-bloc et procédé de transmission de flux binaire |
EP3981151A4 (fr) | 2019-07-06 | 2022-08-24 | Beijing Bytedance Network Technology Co., Ltd. | Tampon de prédiction virtuelle pour copie de bloc intra dans un codage vidéo |
KR102635519B1 (ko) * | 2019-07-10 | 2024-02-07 | 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 | 비디오 코딩에서 인트라 블록 카피를 위한 샘플 식별 |
CN114097221B (zh) | 2019-07-11 | 2024-01-12 | 北京字节跳动网络技术有限公司 | 用于视频编解码中的帧内块复制的比特流一致性约束 |
JP7359936B2 (ja) | 2019-07-20 | 2023-10-11 | 北京字節跳動網絡技術有限公司 | パレットモードの使用の指示の条件依存符号化 |
CN117221536A (zh) * | 2019-07-23 | 2023-12-12 | 北京字节跳动网络技术有限公司 | 调色板模式编解码的模式确定 |
CN115004707A (zh) | 2019-12-19 | 2022-09-02 | 抖音视界(北京)有限公司 | 自适应颜色变换和量化参数之间的相互作用 |
CN115176470A (zh) * | 2020-01-18 | 2022-10-11 | 抖音视界有限公司 | 图像/视频编解码中的自适应颜色变换 |
US20220345604A1 (en) * | 2021-04-27 | 2022-10-27 | Apple Inc. | Camera integration for portable electronic devices |
US20230075788A1 (en) * | 2021-09-01 | 2023-03-09 | Tencent America LLC | Template matching on ibc merge candidates |
US11789352B2 (en) * | 2021-11-01 | 2023-10-17 | GM Global Technology Operations LLC | Camera system laminated into glass using microsensor and lens |
CN113997868B (zh) * | 2021-11-15 | 2023-07-04 | 武汉华星光电技术有限公司 | 车载显示装置 |
US20230412907A1 (en) * | 2022-05-20 | 2023-12-21 | Sony Interactive Entertainment Inc. | Near infrared (nir) transparent organic light emitting diode (oled) display |
EP4304171A1 (fr) * | 2022-07-05 | 2024-01-10 | Beijing Xiaomi Mobile Software Co., Ltd. | Codage/décodage de données d'images vidéo |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030117416A1 (en) * | 2001-12-21 | 2003-06-26 | Motorola, Inc. | Video shape padding method |
US20080002772A1 (en) | 2006-06-28 | 2008-01-03 | Hong Kong Applied Science and Technology Research Institute Company Limited | Motion vector estimation method |
US20140301465A1 (en) | 2013-04-05 | 2014-10-09 | Texas Instruments Incorporated | Video Coding Using Intra Block Copy |
US20140301475A1 (en) | 2013-04-05 | 2014-10-09 | Qualcomm Incorporated | Determining palette indices in palette-based video coding |
US20140376634A1 (en) | 2013-06-21 | 2014-12-25 | Qualcomm Incorporated | Intra prediction from a predictive block |
US20150049813A1 (en) | 2013-08-16 | 2015-02-19 | Sony Corporation | Intra-block copying enhancements for hevc in-range-extension (rext) |
US20150071357A1 (en) * | 2013-09-12 | 2015-03-12 | Qualcomm Incorporated | Partial intra block copying for video coding |
WO2015054813A1 (fr) | 2013-10-14 | 2015-04-23 | Microsoft Technology Licensing, Llc | Options côté codeur pour mode d'intra-prédiction de copie de bloc pour codage vidéo et d'image |
US20150296213A1 (en) | 2014-04-14 | 2015-10-15 | Broadcom Corporation | Pipelined Video Decoder System |
US20170223379A1 (en) * | 2014-09-04 | 2017-08-03 | Mediatek Inc. | Method of Block Vector Clipping and Coding for Screen Content Coding and Video Coding |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9451285B2 (en) * | 2010-04-16 | 2016-09-20 | Sk Telecom Co., Ltd. | Inter-prediction method and video encoding/decoding method using the inter-prediction method |
AU2013228045A1 (en) * | 2013-09-13 | 2015-04-02 | Canon Kabushiki Kaisha | Method, apparatus and system for encoding and decoding video data |
US20150110181A1 (en) * | 2013-10-18 | 2015-04-23 | Samsung Electronics Co., Ltd. | Methods for palette prediction and intra block copy padding |
US9591325B2 (en) * | 2015-01-27 | 2017-03-07 | Microsoft Technology Licensing, Llc | Special case handling for merged chroma blocks in intra block copy prediction mode |
-
2016
- 2016-06-03 CA CA2986950A patent/CA2986950C/fr active Active
- 2016-06-03 CN CN201680031693.8A patent/CN107852505A/zh active Pending
- 2016-06-03 EP EP16802600.3A patent/EP3304906A4/fr active Pending
- 2016-06-03 US US15/578,191 patent/US10356438B2/en active Active
- 2016-06-03 WO PCT/CN2016/084767 patent/WO2016192677A1/fr active Application Filing
-
2019
- 2019-06-04 US US16/431,062 patent/US20190289320A1/en not_active Abandoned
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030117416A1 (en) * | 2001-12-21 | 2003-06-26 | Motorola, Inc. | Video shape padding method |
US20080002772A1 (en) | 2006-06-28 | 2008-01-03 | Hong Kong Applied Science and Technology Research Institute Company Limited | Motion vector estimation method |
US20140301465A1 (en) | 2013-04-05 | 2014-10-09 | Texas Instruments Incorporated | Video Coding Using Intra Block Copy |
US20140301475A1 (en) | 2013-04-05 | 2014-10-09 | Qualcomm Incorporated | Determining palette indices in palette-based video coding |
US20140376634A1 (en) | 2013-06-21 | 2014-12-25 | Qualcomm Incorporated | Intra prediction from a predictive block |
US20150049813A1 (en) | 2013-08-16 | 2015-02-19 | Sony Corporation | Intra-block copying enhancements for hevc in-range-extension (rext) |
US20150071357A1 (en) * | 2013-09-12 | 2015-03-12 | Qualcomm Incorporated | Partial intra block copying for video coding |
WO2015054813A1 (fr) | 2013-10-14 | 2015-04-23 | Microsoft Technology Licensing, Llc | Options côté codeur pour mode d'intra-prédiction de copie de bloc pour codage vidéo et d'image |
US20150296213A1 (en) | 2014-04-14 | 2015-10-15 | Broadcom Corporation | Pipelined Video Decoder System |
US20170223379A1 (en) * | 2014-09-04 | 2017-08-03 | Mediatek Inc. | Method of Block Vector Clipping and Coding for Screen Content Coding and Video Coding |
Non-Patent Citations (5)
Title |
---|
Budagavi Madhukar et al.; AHG8: Video coding using Intra motion compensation; Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Incheon, KR, Apr. 18-26, 2013; JCTVC-M0350-v2 (Apr. 26, 2013). |
International Search Report dated Aug. 24, 2016, issued in application No. PCT/CN2016/084767. |
Office Action dated Dec. 18, 2018, in related U.S. Appl. No. 15/578,184, reference AA cited therein. |
Office Action dated Dec. 20, 2018, in related U.S. Appl. No. 15/578,221, reference AA cited therein. |
Pang, Chao et al.; Non-RCE3: Intra Motion Compensation with 2-D MVs; Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Vienna, AT, Jul. 25-Aug. 2, 2013; JCTVC-N0256-v3 (Aug. 2, 2013). |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11159788B2 (en) | 2018-08-03 | 2021-10-26 | Mediatek Inc. | Method and apparatus of enhanced Intra Block Copying mode for video coding |
Also Published As
Publication number | Publication date |
---|---|
EP3304906A4 (fr) | 2019-04-17 |
CA2986950C (fr) | 2022-03-15 |
US20180152727A1 (en) | 2018-05-31 |
CN107852505A (zh) | 2018-03-27 |
WO2016192677A1 (fr) | 2016-12-08 |
EP3304906A1 (fr) | 2018-04-11 |
US20190289320A1 (en) | 2019-09-19 |
CA2986950A1 (fr) | 2016-12-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10356438B2 (en) | Method and apparatus of error handling for video coding using intra block copy mode | |
US11070820B2 (en) | Condition dependent inter prediction with geometric partitioning | |
US10880547B2 (en) | Method of adaptive motion vector resolution for video coding | |
US11889056B2 (en) | Method of encoding or decoding video blocks by current picture referencing coding | |
US10897631B2 (en) | Methods of constrained intra block copy for reducing worst case bandwidth in video coding | |
US10397588B2 (en) | Method and apparatus for resource sharing between intra block copy mode and inter prediction mode in video coding systems | |
US11146794B2 (en) | Method of system for video coding using intra block copy mode | |
US10362331B2 (en) | Method and apparatus for intraBC mode with fractional-pel block vector resolution in video coding | |
US20200120357A1 (en) | Method of video coding using prediction based on intra picture block copy | |
US10743034B2 (en) | Method of deblocking for intra block copy in video coding | |
US11109056B2 (en) | Method and apparatus of current picture referencing for video coding using adaptive motion vector resolution and sub-block prediction mode | |
CA3131286C (fr) | Contraintes sur un remodelage base sur un modele dans un traitement video | |
JP7322290B2 (ja) | ビデオビットストリームにおけるサブピクチャシグナリングのための構文 | |
CN112997496B (zh) | 仿射预测模式的改进 | |
CN114747217A (zh) | 调色板编解码模式 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: MEDIATEK INC., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHUANG, TZU-DER;CHENG, CHIA-YUN;CHOU, HAN-LIANG;AND OTHERS;SIGNING DATES FROM 20171110 TO 20171205;REEL/FRAME:044534/0827 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
CC | Certificate of correction | ||
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |