WO2022062880A1

WO2022062880A1 - Video decoding method and apparatus, computer readable medium, and electronic device

Info

Publication number: WO2022062880A1
Application number: PCT/CN2021/116451
Authority: WO
Inventors: 王力强
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2020-09-27
Filing date: 2021-09-03
Publication date: 2022-03-31
Also published as: CN112565751B; CN113824957A; CN113824957B; CN112565751A

Abstract

Embodiments of the present application provide a video decoding method and apparatus, a computer readable medium, and an electronic device. The video decoding method comprises: performing entropy decoding processing on a coded block of a video image frame to obtain a quantized coefficient block of residual data corresponding to the coded block; collecting statistics about quantized coefficients in at least one area in the quantized coefficient block to obtain a statistical result, and calculating a remainder of the statistical result with respect to a set value; selecting, according to corresponding relationships between remainders and transformation matrix combinations, a corresponding transformation matrix combination; performing inverse transformation processing, on the basis of the selected transformation matrix combination, on an inverse quantization result of the quantized coefficient block; and reconstructing the video image frame according to the processing result of the inverse transformation processing.

Description

Video decoding method, apparatus, computer readable medium and electronic device

This application claims the priority of the Chinese patent application filed on September 27, 2020 with the application number 2020110339900 and the application title is "video decoding method, device, computer readable medium and electronic equipment", the entire content of which is approved by Reference is incorporated in this application.

technical field

The present application relates to the field of computer and communication technologies, and in particular, to a video decoding method, an apparatus, a computer-readable medium, and an electronic device.

Background technique

In the video encoding process, the encoder usually needs to transform, quantize, and entropy the residual data between the original video data and the predicted video data before sending it to the decoder. Due to the diversity of residual data, a single DCT (Discrete Cosine Transform, discrete cosine transform) transform kernel cannot adapt to all residual characteristics, so it may be necessary to select multiple DCT transform kernels or DST (Discrete Sine Transform) for a residual block. , discrete sine transform) transformation kernel is used as a transformation matrix combination. In this case, although the adaptability of the transformation matrix combination to the residual block is improved, it is necessary to encode the transformation for each coding unit (Coding Unit, referred to as CU). The index of the kernel, thus resulting in lower coding efficiency.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a video decoding method, apparatus, computer-readable medium, and electronic device.

A video decoding method, executed by an electronic device, includes: performing entropy decoding processing on an encoded block of a video image frame to obtain a quantized coefficient block of residual data corresponding to the encoded block; The quantization coefficients in the area are counted to obtain a statistical result, and the remainder of the statistical result for the set value is calculated; according to the correspondence between the remainder and the transformation matrix combination, the corresponding transformation matrix combination is selected; based on the selected transformation matrix combination, the corresponding transformation matrix combination is selected. Perform inverse transformation processing on the inverse quantization result of the quantized coefficient block; reconstruct the video image frame according to the processing result of the inverse transformation processing.

A video decoding device, comprising: a decoding unit configured to perform entropy decoding processing on an encoded block of a video image frame to obtain a quantized coefficient block of residual data corresponding to the encoded block; a statistics unit configured to perform entropy decoding on the quantized coefficient The quantization coefficients in at least one area in the block are counted to obtain a statistical result, and the remainder of the statistical result for the set value is calculated; the selection unit is configured to select the corresponding transformation matrix according to the correspondence between the remainder and the combination of transformation matrices combination; a processing unit configured to perform inverse transform processing on the inverse quantization result of the quantized coefficient block based on the selected transform matrix combination; and a reconstruction unit configured to reconstruct the video image frame according to the processing result of the inverse transform processing.

An electronic device comprising a memory and one or more processors, the memory storing computer-readable instructions that, when executed by the one or more processors, cause the one or more processors The processor performs the steps of the video decoding method described above.

One or more non-volatile computer-readable storage media having computer-readable instructions stored thereon that, when executed by one or more processors, cause the one or multiple processors to perform the steps of the above-described video decoding method.

A computer program product or computer program comprising computer readable instructions stored in a computer readable storage medium from which a processor of a computer device readable storage The computer-readable instructions are read by the medium, and the computer-readable instructions are executed by the processor to cause the computer device to perform the steps of the above-described video decoding method.

The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below. Other features, objects and advantages of the present application will become apparent from the description, drawings and claims.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application. Obviously, the drawings in the following description are only some embodiments of the present application, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort. In the attached image:

FIG. 1 shows a schematic diagram of an exemplary system architecture to which the technical solutions of the embodiments of the present application can be applied;

FIG. 2 shows a schematic diagram of a placement manner of a video encoding device and a video decoding device in a streaming transmission system;

Fig. 3 shows the basic flow chart of a video encoder;

Fig. 4 shows the scanning area marked by SRCC technology;

Fig. 5 shows the sequence schematic diagram of scanning the marked scanning area;

6 shows a flowchart of a video decoding method according to an embodiment of the present application;

FIG. 7 shows a schematic diagram of a division manner of a designated area according to an embodiment of the present application;

FIG. 8 shows a schematic diagram of a division manner of a designated area according to an embodiment of the present application;

FIG. 9 shows a schematic diagram of a division manner of a designated area according to an embodiment of the present application;

10 shows a block diagram of a video decoding apparatus according to an embodiment of the present application;

FIG. 11 shows a schematic structural diagram of a computer system suitable for implementing the electronic device according to the embodiment of the present application.

detailed description

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments, however, can be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art.

Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of the embodiments of the present application. However, those skilled in the art will appreciate that the technical solutions of the present application may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be employed. In other instances, well-known methods, devices, implementations, or operations have not been shown or described in detail to avoid obscuring aspects of the present application.

The block diagrams shown in the figures are merely functional entities and do not necessarily necessarily correspond to physically separate entities. That is, these functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices entity.

The flowcharts shown in the figures are only exemplary illustrations and do not necessarily include all contents and operations/steps, nor do they have to be performed in the order described. For example, some operations/steps can be decomposed, and some operations/steps can be combined or partially combined, so the actual execution order may be changed according to the actual situation.

It should be noted that the "plurality" mentioned in this document refers to two or more. "And/or" describes the association relationship between associated objects, indicating that there can be three kinds of relationships, for example, A and/or B can indicate that A exists alone, A and B exist at the same time, and B exists alone. The character "/" generally indicates that the associated objects are an "or" relationship.

FIG. 1 shows a schematic diagram of an exemplary system architecture to which the technical solutions of the embodiments of the present application can be applied.

As shown in FIG. 1 , the system architecture 100 includes a plurality of end devices that can communicate with each other through, for example, a network 150 . For example, the system architecture 100 may include a first end device 110 and a second end device 120 interconnected by a network 150 . In the embodiment of FIG. 1, the first terminal device 110 and the second terminal device 120 perform unidirectional data transmission.

For example, the first terminal device 110 may encode video data (eg, a video picture stream captured by the terminal device 110 ) for transmission to the second terminal device 120 through the network 150, and the encoded video data may be encoded in one or more The second terminal device 120 may receive the encoded video data from the network 150, decode the encoded video data to restore the video data, and display video pictures according to the restored video data.

In one embodiment of the present application, the system architecture 100 may include a third end device 130 and a fourth end device 140 that perform bidirectional transmission of encoded video data, such as may occur during a video conference. For bidirectional data transmission, each of the third end device 130 and the fourth end device 140 may encode video data (eg, a stream of video pictures captured by the end device) for transmission to the third end device over the network 150 130 and the other terminal device of the fourth terminal device 140 . Each of the third terminal device 130 and the fourth terminal device 140 may also receive encoded video data transmitted by the other one of the third terminal device 130 and the fourth terminal device 140, and may The video data is decoded to recover the video data, and a video picture can be displayed on an accessible display device based on the recovered video data.

In the embodiment of FIG. 1 , the first terminal device 110 , the second terminal device 120 , the third terminal device 130 and the fourth terminal device 140 may be servers, personal computers and smart phones, but the principles disclosed in this application may not be limited thereto . Embodiments disclosed herein are applicable to laptop computers, tablet computers, media players, and/or dedicated videoconferencing equipment. Network 150 represents any number of networks, including, for example, wired and/or wireless communication networks, that communicate encoded video data between first end device 110, second end device 120, third end device 130, and fourth end device 140. Communication network 150 may exchange data in circuit-switched and/or packet-switched channels. The network may include a telecommunications network, a local area network, a wide area network, and/or the Internet. For the purposes of this application, unless explained below, the architecture and topology of network 150 may be immaterial to the operations disclosed herein.

In one embodiment of the present application, FIG. 2 illustrates the placement of a video encoding device and a video decoding device in a streaming environment. The subject matter disclosed herein is equally applicable to other video-enabled applications including, for example, videoconferencing, digital TV (television), storing compressed video on digital media including CDs, DVDs, memory sticks, and the like.

The streaming system may include a capture subsystem 213 , which may include a video source 201 such as a digital camera, and the video source creates an uncompressed video picture stream 202 . In an embodiment, the video picture stream 202 includes samples captured by a digital camera. Compared to the encoded video data 204 (or the encoded video code stream 204), the video picture stream 202 is depicted as a thick line to emphasize the high data volume of the video picture stream, which can be processed by the electronic device 220, and the electronic Device 220 includes video encoding device 203 coupled to video source 201 . Video encoding device 203 may include hardware, software, or a combination of hardware and software to implement or implement various aspects of the disclosed subject matter as described in greater detail below. Compared to the video picture stream 202, the encoded video data 204 (or encoded video code stream 204) is depicted as a thin line to emphasize the lower amount of encoded video data 204 (or encoded video code stream 204) 204), which can be stored on the streaming server 205 for future use. One or more streaming client subsystems, such as client subsystem 206 and client subsystem 208 in FIG. 2 , may access streaming server 205 to retrieve

copies

207 and 209 of encoded video data 204 . Client subsystem 206 may include, for example, video decoding device 210 in electronic device 230 . The video decoding device 210 decodes the incoming copy 207 of the encoded video data and produces an output video picture stream 211 that can be presented on a display 212 (eg, a display screen) or another presentation device. In some streaming systems, encoded video data 204, video data 207, and video data 209 (eg, video bitstreams) may be encoded according to certain video encoding/compression standards. Examples of these standards include ITU-T H.265. In an embodiment, the video coding standard under development is informally referred to as Versatile Video Coding (VVC), and this application may be used in the context of the VVC standard.

It should be noted that the electronic device 220 and the electronic device 230 may include other components not shown in the figures. For example, electronic device 220 may include a video decoding device, and electronic device 230 may also include a video encoding device.

In an embodiment of the present application, the international video coding standard HEVC (High Efficiency Video Coding, high efficiency video coding), VVC (Versatile Video Coding, multifunctional video coding), and the Chinese national video coding standard AVS (Audio Video coding) Standard, source coding standard) as an example, when a video frame image is input, the video frame image will be divided into several non-overlapping processing units according to a block size, and each processing unit will perform similar compression operations. This processing unit is called CTU (Coding Tree Unit, coding tree unit), or LCU (Largest Coding Unit, largest coding unit). The CTU can continue to be further divided into finer divisions to obtain one or more basic coding units CU, and CU is the most basic element in a coding link. The following introduces some concepts when encoding CUs:

Predictive Coding: Predictive coding includes intra-frame prediction and inter-frame prediction. After the original video signal is predicted by the selected reconstructed video signal, a residual video signal is obtained. The encoder needs to decide which predictive coding mode to select for the current CU and inform the decoder. Among them, intra-frame prediction means that the predicted signal comes from an area that has been coded and reconstructed in the same image; inter-frame prediction means that the predicted signal comes from another image that has been coded and different from the current image (called a reference image). ).

Transform & Quantization: After the residual video signal undergoes transform operations such as DFT (Discrete Fourier Transform), DCT, etc., the signal is converted into the transform domain, which is called transform coefficient. The transform coefficient is further subjected to a lossy quantization operation, which loses a certain amount of information, so that the quantized signal is beneficial to the compressed expression. In some video coding standards, there may be more than one transformation mode to choose from, so the encoder also needs to select one of the transformation modes for the current CU and inform the decoder. The fineness of quantization is usually determined by the Quantization Parameter (QP for short). If the value of QP is larger, the coefficients representing a larger value range will be quantized into the same output, which usually brings greater distortion and distortion. A lower code rate; on the contrary, if the QP value is smaller, the coefficients representing a smaller value range will be quantized into the same output, so it usually brings less distortion and corresponds to a higher code rate.

Entropy Coding or Statistical Coding: The quantized transform domain signal will undergo statistical compression coding according to the frequency of occurrence of each value, and finally output a binarized (0 or 1) compressed code stream. At the same time, other information generated by encoding, such as the selected encoding mode, motion vector data, etc., also needs to be entropy encoded to reduce the bit rate. Statistical coding is a lossless coding method that can effectively reduce the code rate required to express the same signal. Common statistical coding methods include Variable Length Coding (VLC) or context-based binary arithmetic coding ( Content Adaptive Binary Arithmetic Coding, referred to as CABAC).

Loop Filtering: The changed and quantized signal will obtain a reconstructed image through the operations of inverse quantization, inverse transformation and prediction compensation. Compared with the original image, the reconstructed image is different from the original image due to the influence of quantization, that is, the reconstructed image will produce distortion (Distortion). Therefore, filtering operations can be performed on the reconstructed image, such as deblocking filter (DB), SAO (Sample Adaptive Offset, adaptive pixel compensation) or ALF (Adaptive Loop Filter, adaptive loop filter) and other filters , which can effectively reduce the degree of distortion caused by quantization. Since these filtered reconstructed images will be used as references for subsequent encoded images to predict future image signals, the above filtering operation is also called in-loop filtering, ie, a filtering operation in an encoding loop.

In an embodiment of the present application, FIG. 3 shows a basic flowchart of a video encoder, and intra-frame prediction is used as an example for description in the flowchart. Among them, the original image signal _sk [x,y] and the predicted image signal

Do the difference operation to get the residual signal u _k [x,y], the residual signal u _k [x,y] is transformed and quantized to obtain quantized coefficients, on the one hand, the quantized coefficients are encoded by entropy coding to obtain the encoded bits On the other hand, the reconstructed residual signal u' _k [x, y] is obtained through inverse quantization and inverse transformation processing, and the predicted image signal

It is superimposed with the reconstructed residual signal u' _k [x, y] to generate an image signal

image signal

On the one hand, it is input to the _intra - _frame mode decision module and the intra-frame prediction module for intra-frame prediction processing; ] can be used as a reference image for the next frame for motion estimation and motion compensation prediction. Then based on the motion compensation prediction result s' _r [x+m _x ,y+m _y ] and the intra prediction result

Obtain the predicted image signal of the next frame, and continue to repeat the above process until the encoding is completed.

In addition, since the residual signal in the transformed and quantized quantized coefficient block has a high probability that the non-zero coefficients will be concentrated in the left and upper regions of the block, while the right and lower regions of the block are often 0, so the introduction of SRCC ( In Scan Region Coefficient Coding, scanning region coefficient coding) technology, the SRCC technology can mark the size of the upper left region of the non-zero coefficients contained in each quantized coefficient block (size W×H) SRx×SRy, where SRx is the quantization coefficient The abscissa of the rightmost non-zero coefficient in the coefficient block, SRy is the ordinate of the lowermost non-zero coefficient in the quantized coefficient block, and 1≤SRx≤W, 1≤SRy≤H, and the coefficients outside this area are 0. The SRCC technology uses (SRx, SRy) to determine the quantized coefficient area that needs to be scanned in a quantized coefficient block. As shown in Figure 4, only the quantized coefficients in the scanning area marked by (SRx, SRy) need to be coded. The scanning order of the coding is as follows As shown in Figure 5, it can be a reverse zigzag scan from the lower right corner to the upper left corner.

Based on the above encoding process, for each CU, the decoding end performs entropy decoding to obtain various mode information and quantization coefficients after obtaining the compressed code stream (ie, the bit stream). Then, the quantized coefficients undergo inverse quantization and inverse transformation to obtain residual signals. On the other hand, according to the known coding mode information, the predicted signal corresponding to the CU can be obtained, and then the reconstructed signal can be obtained by adding the residual signal and the predicted signal. The reconstructed signal is then subjected to loop filtering and other operations to generate the final output signal.

In the above encoding and decoding process, the transform processing of the residual signal makes the energy of the residual signal concentrate on less low-frequency coefficients, that is, most coefficients have smaller values. Then after the subsequent quantization module, the smaller coefficient value will become zero value, which greatly reduces the cost of coding the residual signal. However, due to the diversity of residual distribution, a single DCT transformation cannot adapt to all residual characteristics. Therefore, transformation kernels such as DST7 and DCT8 are introduced into the transformation process, and the horizontal transformation and vertical transformation of the residual signal are carried out. Direct transforms can use different transform kernels. Taking AMT (Adaptive multiple core transform) technology as an example, the possible transformation combinations for transform processing of a residual signal are as follows: (DCT2, DCT2), (DCT8, DCT8), (DCT8, DST7) ), (DST7, DCT8) and (DST7, DST7).

As for which transformation combination to choose for the residual signal, it is necessary to use RDO (Rate-Distortion Optimization) at the encoding end to make a decision. Although multiple transformation kernels are used to improve the adaptability of the transformation matrix combination to the residual block, but Since the index of the transform kernel needs to be coded for each coding unit, the coding efficiency is low.

In view of the above problems, the embodiments of the present application propose to implicitly indicate the transformation matrix combination corresponding to the coding block by using the quantization coefficients in the quantization coefficient block, thereby reducing the bits occupied by the transformation matrix index and effectively improving the video coding efficiency. Specifically, a statistical result is obtained by performing statistics on the quantized coefficients in at least one area in the quantized coefficient block, and then the remainder of the statistical result for the set value is calculated, so as to select the corresponding and perform inverse transformation processing on the inverse quantization result of the quantization coefficient block based on the selected transformation matrix combination, and reconstruct the video frame according to the processing result of the inverse transformation processing, so that the quantization coefficients in the quantization coefficient block can be used to implicitly indicate The transformation matrix combination corresponding to the encoding block does not require the encoding end to encode the index of the transformation matrix for each coding unit, which reduces the bits occupied by the transformation matrix index, thereby effectively improving the video encoding efficiency.

The implementation details of the technical solutions of the embodiments of the present application are described in detail below:

FIG. 6 shows a flowchart of a video decoding method according to an embodiment of the present application. The video decoding method can be executed by a device with a computing processing function, such as an electronic device, where the electronic device is a terminal device or server. Referring to FIG. 6 , the video decoding method at least includes steps S610 to S640, which are described in detail as follows:

In step S610, entropy decoding processing is performed on the coded block of the video image frame to obtain a quantized coefficient block of residual data corresponding to the coded block.

In one embodiment of the present application, the video image frame sequence includes a series of images, each image can be further divided into slices, and the slices can be further divided into a series of LCUs (or CTUs). The LCUs include There are several CUs. The video image frame is encoded in block units. In some new video encoding standards, such as the H.264 standard, there is a macroblock (MB), which can be further divided into multiple blocks that can be used for Prediction block (prediction) for predictive coding. In the HEVC standard, basic concepts such as coding unit CU, prediction unit (PU) and transform unit (TU) are used to functionally divide a variety of block units, and adopt a new tree-based structure for describe. For example, a CU can be divided into smaller CUs according to a quadtree, and the smaller CUs can be further divided to form a quadtree structure. The coding block in this embodiment of the present application may be a CU, or a block smaller than the CU, such as a smaller block obtained by dividing the CU.

In step S620, statistics are performed on the quantization coefficients in at least one area in the quantization coefficient block to obtain a statistical result, and the remainder of the statistical result with respect to the set value is calculated.

In an embodiment of the present application, it can be determined whether the target coding block in the corresponding coded data needs to select the corresponding transformation matrix combination according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding according to the value of the specified index identifier, The specified index identifier may include at least one of the following data: the sequence header of the first encoded data corresponding to the video image frame sequence, the image header of the second encoded data corresponding to the video image frame, and a bar of the video image frame. The slice header with the corresponding third encoded data and the LCU header of the fourth encoded data corresponding to one largest coding unit LCU of the video image frame. Details are as follows:

In an embodiment of the present application, whether the target coded block in the first coded data needs to be decoded according to entropy may be indicated by the value of the specified index identifier included in the sequence header of the first coded data corresponding to a sequence of video image frames The corresponding transformation matrix combination is selected for the quantization coefficients in the obtained quantization coefficient block. For example, the value of the specified index identifier in the sequence header of the first encoded data is 1, which means that the target encoding block in the first encoded data needs to be decoded according to entropy. The quantized coefficients in the obtained quantized coefficient block select the corresponding transformation matrix combination. The technical solution of this embodiment enables the indication of all target coding blocks corresponding to the entire video image frame sequence through an index identification in the sequence header of the first encoded data corresponding to the video image frame sequence, thereby effectively reducing the index identification The occupied bits improve the video coding efficiency. It should be noted that: the target coding block in the first coded data may be all coding blocks in the first coded data, or may be coding blocks in the first coded data using the intra-frame coding mode, or may also be the first coding block The coded block in the inter-frame coding mode in the data.

In an embodiment of the present application, whether the target coded block in the second coded data needs to be obtained according to entropy decoding may be indicated by the value of the specified index identifier included in the image header of the second coded data corresponding to one video image frame The corresponding transformation matrix combination is selected for the quantization coefficients in the quantized coefficient block of The quantization coefficients in the quantization coefficient block select the corresponding transformation matrix combination. The technical solution of this embodiment enables the indication of all target coding blocks corresponding to the entire video image frame through an index identifier in the image header of the second encoded data corresponding to the video image frame, and can also reduce the amount of time occupied by the index identifier. bits, which improves the video coding efficiency. It should be noted that: the target coding block in the second coded data may be all coding blocks in the second coded data, or may be coding blocks in the second coded data using the intra-frame coding mode, or may also be the second coding block The coded block in the inter-frame coding mode in the data.

In an embodiment of the present application, whether the target coding block in the third coded data needs to be indicated by the value of the specified index identifier included in the slice header of the third coded data corresponding to one slice of the video image frame can be used The corresponding transformation matrix combination is selected according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding. For example, the value of the specified index identifier in the slice header of the third coded data is 1, which means the target coding block in the third coded data. The corresponding transformation matrix combination needs to be selected according to the quantized coefficients in the quantized coefficient block obtained by entropy decoding. The technical solution of this embodiment enables the indication of all target coding blocks corresponding to the entire slice through an index identifier in the slice header of the third encoded data corresponding to one slice of the video image frame, and the index can also be reduced. The bits occupied by the identification improve the video coding efficiency. It should be noted that: the target coding blocks in the third coded data may be all coding blocks in the third coded data, or may be coding blocks in the third coded data using the intra-frame coding mode, or may also be the third coding block The coded block in the inter-frame coding mode in the data.

In an embodiment of the present application, whether the target coding block in the fourth coded data needs to be based on entropy can be indicated by the value of the specified index identifier included in the LCU header of the fourth coded data corresponding to one LCU of the video image frame The corresponding transformation matrix combination is selected for the quantization coefficients in the decoded quantization coefficient block. For example, the value of the specified index identifier in the LCU header of the fourth encoded data is 1, which means that the target encoding block in the fourth encoded data needs to be based on entropy. The quantized coefficients in the decoded quantized coefficient block select the corresponding transformation matrix combination. The technical solution of this embodiment makes it possible to realize the indication of all target coding blocks corresponding to the entire LCU through an index mark in the LCU header of the fourth coded data corresponding to one LCU of the video image frame, which can also reduce the occupation of the index mark. bits, which improves the video coding efficiency. It should be noted that the target coding blocks in the fourth coded data may be all coding blocks in the fourth coded data, or may be coding blocks in the fourth coded data using the intra-frame coding mode, or may be the fourth coding block The coded block in the inter-frame coding mode in the data.

In an embodiment of the present application, it is also possible to determine whether the encoding block needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding according to the relationship between the size of the encoding block and the preset threshold range . For example, if the size of the coding block is small (for example, smaller than a preset threshold), it can be determined that the coding block needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding; If the size of the block is relatively large (eg, larger than a certain preset threshold), it can be determined that the coding block does not need to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding. The technical solution of this embodiment can implicitly indicate whether it is necessary to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding according to the size of the coding block, without the need for additional bits, so the video coding efficiency can also be improved. .

In an embodiment of the present application, if the index identifier included in the sequence header of the first encoded data corresponding to a video image frame sequence is the first value (for example, it may be 0), the target encoding in the first encoded data is determined. The block does not need to select the corresponding transformation matrix combination according to the quantized coefficients in the quantized coefficient block obtained by entropy decoding. If the index identifier included in the sequence header is the second value (for example, it may be 1), at this time, it can be further determined according to the index identifier included in the image header of the second encoded data corresponding to the video image frame in the sequence of video image frames. make decisions. It should be noted that: the target coding block in the first coded data may be all coding blocks in the first coded data, or may be coding blocks in the first coded data using the intra-frame coding mode, or may also be the first coding block The coded block in the inter-frame coding mode in the data.

In an embodiment of the present application, if the index identifier included in the aforementioned sequence header is the second value (for example, it may be 1), and the index identifier included in the aforementioned image header is the first value (eg, it may be 0) , it can be determined that the target coding block in the second coded data does not need to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding. If the index identifier contained in the foregoing sequence header and the index identifier included in the foregoing image header are both second values (for example, may be 1), it can be determined that the target encoding block in the second encoded data needs to be obtained by entropy decoding. The quantization coefficients in the quantization coefficient block select the corresponding transformation matrix combination. In this case, the decision can no longer be made through the slice header, the LCU header and the size of the coding block. It should be noted that: the target coding block in the second coded data may be all coding blocks in the second coded data, or may be coding blocks in the second coded data using the intra-frame coding mode, or may also be the second coding block The coded block in the inter-frame coding mode in the data.

Of course, in an embodiment of the present application, if the index identifier included in the aforementioned sequence header and the index identifier included in the aforementioned image header are both the second value (for example, it may be 1), then the video image The decision is made according to the index identifier contained in the slice header of the third encoded data corresponding to the slice of the frame. For example, if the index identifier included in the preceding sequence header and the index identifier included in the preceding image header are both the second value, but the index identifier included in the slice header information of the third encoded data corresponding to one slice is the first value (for example, it can be 0), then it can be determined that the target coding block in the third coded data does not need to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding. If the index identifier included in the foregoing sequence header, the index identifier included in the foregoing image header, and the index identifier included in the foregoing slice header are all second values (for example, may be 1), it can be determined that the third encoded data contains The target coding block needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding. In this case, the decision can no longer be made according to the size of the LCU header and the coding block. It should be noted that: the target coding blocks in the third coded data may be all coding blocks in the third coded data, or may be coding blocks in the third coded data using the intra-frame coding mode, or may also be the third coding block The coded block in the inter-frame coding mode in the data.

Of course, in an embodiment of the present application, if the index identifier included in the foregoing sequence header, the index identifier included in the foregoing image header, and the index identifier included in the foregoing slice header are all second values (for example, it may be 1), then the decision may be further made according to the index identifier included in the LCU header of the fourth encoded data corresponding to the LCU in the slice. For example, if the index identifier included in the preceding sequence header, the index identifier included in the preceding image header, and the index identifier included in the preceding slice header are all second values, but the LCU header information of the fourth encoded data corresponding to one LCU If the included index identifier is the first value (for example, it may be 0), it can be determined that the target encoding block in the fourth encoded data does not need to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding. If the index identifier included in the aforementioned sequence header, the index identifier included in the aforementioned image header, the index identifier included in the aforementioned slice header, and the index identifier included in the aforementioned LCU header information are all second values (for example, it may be 1 ), then it can be determined that the target coding block in the fourth coded data needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding. In this case, the size of the coding block can no longer be determined. It should be noted that the target coding blocks in the fourth coded data may be all coding blocks in the fourth coded data, or may be coding blocks in the fourth coded data using the intra-frame coding mode, or may be the fourth coding block The coded block in the inter-frame coding mode in the data.

Of course, in an embodiment of the present application, if the index identifier included in the aforementioned sequence header, the index identifier included in the aforementioned image header, the index identifier included in the aforementioned slice header, and the index included in the aforementioned LCU header information If the flags are all second values (for example, it may be 1), then the decision may be further made according to the size of the coding block. For example, if the index identifier included in the aforementioned sequence header, the index identifier included in the aforementioned image header, the index identifier included in the aforementioned slice header, and the index identifier included in the aforementioned LCU header information are all second values, but one If the size of the coding block is small (for example, smaller than a certain preset threshold), it can be determined that the coding block needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding; on the contrary, if the size of the coding block is If it is larger (for example, greater than a certain preset threshold), it can be determined that the encoding block does not need to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding.

In an embodiment of the present application, an indication bit may also be used to indicate whether the quantization coefficient block obtained by entropy decoding is required to be respectively indicated to the coding block using the intra-frame coding mode and the coding block using the inter-frame coding mode in the coded data. The quantization coefficient selects the corresponding transformation matrix combination. in particular:

In an embodiment of the present application, according to the value of the first indicator bit and the value of the second indicator bit included in the sequence header of the first encoded data corresponding to a sequence of video image frames, it is possible to determine, respectively, the value of the first indicator bit and the value of the second indicator bit in the first encoded data. Whether it is necessary to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding for the coding block in the intra-frame coding mode and the coding block in the inter-frame coding mode. For example, when the value of the first indicator bit included in the sequence header of the first encoded data is 0, it indicates that the encoding block in the first encoded data that adopts the intra-frame encoding mode does not need the quantization coefficients in the quantization coefficient block obtained by entropy decoding Select the corresponding transformation matrix combination; when the value of the first indicator bit included in the sequence header of the first encoded data is 1, it indicates that the encoding block in the first encoded data that adopts the intra-frame encoding mode needs to be decoded according to the entropy. The obtained quantization coefficient block The quantization coefficient in selects the corresponding transformation matrix combination; when the value of the second indicator bit included in the sequence header of the first encoded data is 0, it indicates that the encoding block in the first encoded data using the inter-frame encoding mode does not need to be decoded according to entropy The quantization coefficient in the obtained quantization coefficient block is selected by the corresponding transformation matrix combination; when the value of the second indicator bit included in the sequence header of the first coded data is 1, it indicates that the first coded data adopts the coding block of the inter-frame coding mode The corresponding transformation matrix combination needs to be selected according to the quantized coefficients in the quantized coefficient block obtained by entropy decoding.

In an embodiment of the present application, according to the value of the first indicator bit and the value of the second indicator bit included in the image header of the second encoded data corresponding to a video image frame, the frame used in the second encoded data can be determined respectively. Whether it is necessary to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding for the coding block in the intra-coding mode and the coding block in the inter-coding mode. For example, when the value of the first indicator bit included in the image header of the second encoded data is 0, it indicates that the encoding block in the second encoded data that adopts the intra-frame encoding mode does not need the quantization coefficients in the quantization coefficient block obtained by entropy decoding Select the corresponding transformation matrix combination; when the value of the first indicator bit contained in the image header of the second encoded data is 1, it indicates that the encoding block using the intra-frame encoding mode in the second encoded data needs a quantization coefficient block obtained by entropy decoding The quantization coefficient in selects the corresponding transformation matrix combination; when the value of the second indicator bit included in the image header of the second encoded data is 0, it indicates that the encoding block in the second encoded data using the inter-frame encoding mode does not need to be decoded according to entropy The corresponding transformation matrix combination is selected for the quantization coefficients in the obtained quantization coefficient block; when the value of the second indicator bit included in the image header of the second coded data is 1, it indicates that the second coded data adopts the coding block of the inter-frame coding mode The corresponding transformation matrix combination needs to be selected according to the quantized coefficients in the quantized coefficient block obtained by entropy decoding.

In an embodiment of the present application, the third encoding is determined respectively according to the value of the first indicator bit and the value of the second indicator bit included in the slice header information of the third encoded data corresponding to one slice of the video image frame. Whether the coding block using the intra-frame coding mode and the coding block using the inter-frame coding mode in the data needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding. For example, when the value of the first indicator bit included in the slice header of the third encoded data is 0, it indicates that the encoding block in the third encoded data that adopts the intra-frame encoding mode does not need the quantization in the quantization coefficient block obtained by entropy decoding. The coefficient selects the corresponding transformation matrix combination; when the value of the first indicator bit included in the slice header of the third encoded data is 1, it indicates that the encoding block in the third encoded data that adopts the intra-frame encoding mode needs to be quantized according to entropy decoding. The quantization coefficient in the coefficient block selects the corresponding transformation matrix combination; when the value of the second indicator bit included in the slice header of the third encoded data is 0, it indicates that the encoding block in the inter-frame encoding mode in the third encoded data does not need to be The corresponding transformation matrix combination is selected according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding; when the value of the second indicator bit included in the slice header of the third encoded data is 1, it indicates that inter-frame encoding is used in the third encoded data The encoding block of the mode needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding.

In an embodiment of the present application, according to the value of the first indicator bit and the value of the second indicator bit included in the LCU header information of the fourth encoded data corresponding to one LCU of the video image frame, determine the value of the fourth encoded data respectively. Whether the coding block using the intra-frame coding mode and the coding block using the inter-frame coding mode needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding. For example, when the value of the first indicator bit included in the LCU header of the fourth encoded data is 0, it indicates that the encoding block in the fourth encoded data that adopts the intra-frame encoding mode does not need the quantization coefficients in the quantization coefficient block obtained by entropy decoding Select the corresponding transformation matrix combination; when the value of the first indicator bit included in the LCU header of the fourth encoded data is 1, it indicates that the encoding block using the intra-frame encoding mode in the fourth encoded data needs a quantization coefficient block obtained by entropy decoding The quantization coefficient in selects the corresponding transformation matrix combination; when the value of the second indicator bit included in the LCU header of the fourth encoded data is 0, it indicates that the encoding block using the inter-frame encoding mode in the fourth encoded data does not need to be decoded according to entropy The quantization coefficients in the obtained quantization coefficient block are selected corresponding to the transformation matrix combination; when the value of the second indicator bit included in the LCU header of the fourth encoded data is 1, it indicates that the encoding block in the inter-frame encoding mode is adopted in the fourth encoded data The corresponding transformation matrix combination needs to be selected according to the quantized coefficients in the quantized coefficient block obtained by entropy decoding.

It should be noted that: the coding block using the intra-frame coding mode and the coding block using the inter-frame coding mode in the coded data by indicating the bit pair respectively indicate whether the corresponding transform needs to be selected according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding. When matrices are combined, a scheme similar to that in the previous embodiment can also be adopted, and the decision is made jointly by the indicator bits in the sequence header and the image header, or by the indicator bits in the sequence header, the image header and the slice header. to co-decision, or by the indicator bits in the sequence header, picture header, slice header and LCU header, or by the sequence header, picture header, slice header, LCU header Indicates bits, and the size of the encoding block to make a joint decision.

To sum up, when determining whether it is necessary to select the transformation matrix combination corresponding to the coding block according to the quantization coefficients in the quantization coefficient block, there are the following methods:

1. It is only indicated by the index identifier in the aforementioned sequence header, and the decision is no longer made by the size of the picture header, slice header, LCU header and coding block. At this time, the index identifier in the sequence header is 1 (the value is only an example), which means that the target coding block in the first coded data corresponding to the video image frame sequence needs to be selected according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding. The corresponding transformation matrix combination. It should be noted that: the target coding block in the first coded data may be all coding blocks in the first coded data, or may be coding blocks in the first coded data using the intra-frame coding mode, or may also be the first coding block The coded block in the inter-frame coding mode in the data.

In addition, the coding block using the intra-frame coding mode and the coding block using the inter-frame coding mode in the first coded data corresponding to the video image frame sequence may also be respectively indicated by the indication bit in the sequence header. That is, the sequence header contains two indicator bits, and one indicator bit is used to indicate whether the encoding block using the intra-frame encoding mode in the first encoded data needs to select the corresponding transformation matrix combination according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding. , and another indication bit is used to indicate whether the coding block in the first coded data using the inter-frame coding mode needs to select the corresponding transformation matrix combination according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding.

2. It is only indicated by the index identifier in the aforementioned image header, and the decision is no longer made by the sequence header, slice header, LCU header and the size of the coding block. At this time, the index identifier in the image header is 1 (the value is only an example), which means that the target encoding block in the second encoded data corresponding to the video image frame needs to be selected according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding. combination of transformation matrices. It should be noted that: the target coding block in the second coded data may be all coding blocks in the second coded data, or may be coding blocks in the second coded data using the intra-frame coding mode, or may also be the second coding block The coded block in the inter-frame coding mode in the data.

In addition, only the indication bits in the image header may be used to separately indicate the coding blocks that use the intra-frame coding mode and the coding blocks that use the inter-frame coding mode in the second coded data corresponding to the video image frame. That is, the image header contains two indicator bits, and one indicator bit is used to indicate whether the encoding block using the intra-frame encoding mode in the second encoded data needs to select the corresponding transformation matrix combination according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding. , and another indicator bit is used to indicate whether the encoding block in the inter-frame encoding mode in the second encoded data needs to select a corresponding transformation matrix combination according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding.

3. It is only indicated by the index identifier in the aforementioned slice header, and the decision is no longer made by the sequence header, the picture header, the LCU header and the size of the coding block. At this time, the index identifier in the slice header is 1 (the value is only an example), which means that the target encoding block in the third encoded data corresponding to the slice needs to be selected according to the quantization coefficient block in the quantization coefficient block obtained by entropy decoding. combination of transformation matrices. It should be noted that: the target coding blocks in the third coded data may be all coding blocks in the third coded data, or may be coding blocks in the third coded data using the intra-frame coding mode, or may also be the third coding block The coded block in the inter-frame coding mode in the data.

In addition, only the indication bits in the slice header may be used to respectively indicate the coding blocks that use the intra-frame coding mode and the coding blocks that use the inter-frame coding mode in the third coded data corresponding to the slice. That is, the slice header contains two indicator bits, and one indicator bit is used to indicate whether the encoding block using the intra-frame encoding mode in the third encoded data needs to select the corresponding transformation matrix according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding. The other indicator bit is used to indicate whether the encoding block in the inter-frame encoding mode in the third encoded data needs to select the corresponding transformation matrix combination according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding.

4. It is only indicated by the index identifier in the aforementioned LCU header, and the decision is no longer made by the size of the sequence header, the picture header, the slice header and the coding block. At this time, the index identifier in the LCU header is 1 (the value is only an example), which means that the target coding block in the fourth coded data corresponding to the LCU needs to select the corresponding transform according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding matrix combination. It should be noted that the target coding blocks in the fourth coded data may be all coding blocks in the fourth coded data, or may be coding blocks in the fourth coded data using the intra-frame coding mode, or may be the fourth coding block The coded block in the inter-frame coding mode in the data.

In addition, only the indication bits in the LCU header may be used to separately indicate the coding blocks that use the intra-frame coding mode and the coding blocks that use the inter-frame coding mode in the fourth coded data corresponding to the LCU. That is, the LCU header contains two indicator bits, and one indicator bit is used to indicate whether the encoding block using the intra-frame encoding mode in the fourth encoded data needs to select the corresponding transformation matrix combination according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding. , and another indication bit is used to indicate whether the coding block in the fourth coded data that adopts the inter-coding mode needs to select the corresponding transformation matrix combination according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding.

5. Only implicitly indicated by the size of the coding block, and no longer through the sequence header, picture header, slice header and LCU header to make decisions. At this time, if the size of the coding block is small (for example, smaller than a certain preset threshold), it can be determined that the coding block needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding; on the contrary, if If the size of the coding block is relatively large (eg, larger than a certain preset threshold), it can be determined that the coding block does not need to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding.

6. It is indicated by the index identifier in the aforementioned sequence header and the index identifier in the image header, and the decision is no longer made by the slice header, the LCU header and the size of the coding block. At this time, if the index identifier in the sequence header and the index identifier in the image header are both 1 (the value is only an example), it means that the target encoding block in the second encoded data corresponding to the video image frame needs to be obtained by entropy decoding The quantization coefficients in the quantization coefficient block select the corresponding transformation matrix combination; if the index mark in the sequence header is 1, and the index mark in the image header is 0 (the value is only an example), it means that the video image frame corresponds to The target coding block in the second coded data does not need to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding. It should be noted that: the target coding block in the second coded data may be all coding blocks in the second coded data, or may be coding blocks in the second coded data using the intra-frame coding mode, or may also be the second coding block The coded block in the inter-frame coding mode in the data.

7. It is indicated by the index identifier in the sequence header, the index identifier in the image header, and the index identifier in the slice header, and the decision is no longer made by the LCU header and the size of the coding block. At this time, if the index identifier in the sequence header, the index identifier in the image header, and the index identifier in the slice header are all 1 (the value is only an example), it means that the target in the third encoded data corresponding to the slice is The coding block needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding; If it is 0 (the value is only an example), it means that the target coding block in the third coded data corresponding to the slice does not need to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding. It should be noted that: the target coding blocks in the third coded data may be all coding blocks in the third coded data, or may be coding blocks in the third coded data using the intra-frame coding mode, or may also be the third coding block The coded block in the inter-frame coding mode in the data.

8. It is indicated by the index identifier in the aforementioned sequence header, the index identifier in the image header, the index identifier in the slice header, and the index identifier in the LCU header, and the decision is no longer made based on the size of the coding block. At this time, if the index identifier in the sequence header, the index identifier in the image header, the index identifier in the slice header, and the index identifier in the LCU header are all 1 (the value is only an example), it means that the LCU corresponds to the The target coding block in the fourth coded data needs to select the corresponding transformation matrix combination according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding; if the index identifier in the sequence header, the index identifier in the image header and the slice header The index identification in the LCU is 1, and the index identification in the LCU header is 0 (the value is only an example), which means that the target encoding block in the fourth encoded data corresponding to the LCU does not need to be decoded according to entropy. The quantization coefficients of , select the corresponding transformation matrix combination. It should be noted that the target coding blocks in the fourth coded data may be all coding blocks in the fourth coded data, or may be coding blocks in the fourth coded data using the intra-frame coding mode, or may be the fourth coding block The coded block in the inter-frame coding mode in the data.

9. The decision is made based on the index identifier in the sequence header, the index identifier in the image header, the index identifier in the slice header, the index identifier in the LCU header, and the size of the coding block. At this time, if the index identifier in the sequence header, the index identifier in the image header, the index identifier in the slice header, and the index identifier in the LCU header are all 1 (the value is only an example), and the size of the encoding block is less than the set threshold, it means that the coding block needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding; The index mark in the section and the index mark in the LCU header are both 1, but the size of the coding block is greater than the set threshold, it means that the coding block does not need to select the corresponding transform according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding matrix combination.

Of course, there are also the following ways:

10. It is indicated by the index identifier in the image header and the index identifier in the slice header, and the decision is no longer made by the sequence header, the LCU header and the size of the coding block. At this time, if the index identifier in the image header and the index identifier in the slice header are both 1 (the value is only an example), it means that the target encoding block in the third encoded data corresponding to the slice needs to be decoded according to entropy. The quantization coefficient in the quantization coefficient block selects the corresponding transformation matrix combination; if the index mark in the image header is 1, and the index mark in the slice header is 0 (the value is only an example), it means that the slice corresponds to the The target coding block in the third coded data does not need to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding. It should be noted that: the target coding blocks in the third coded data may be all coding blocks in the third coded data, or may be coding blocks in the third coded data using the intra-frame coding mode, or may also be the third coding block The coded block in the inter-frame coding mode in the data.

11. It is indicated by the index identifier in the image header, the index identifier in the slice header, and the index identifier in the LCU header, and the decision is no longer made based on the sequence header and the size of the coding block. At this time, if the index identifier in the image header, the index identifier in the slice header, and the index identifier in the LCU header are all 1 (the numerical value is only an example), it means that the target encoding in the fourth encoded data corresponding to the LCU is The block needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding; if the index identification in the image header and the index identification in the slice header are 1, and the index identification in the LCU header is 0 (the value is only an example), it means that the target coding block in the fourth coded data corresponding to the LCU does not need to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding. It should be noted that the target coding blocks in the fourth coded data may be all coding blocks in the fourth coded data, or may be coding blocks in the fourth coded data using the intra-frame coding mode, or may be the fourth coding block The coded block in the inter-frame coding mode in the data.

12. The decision is made based on the index identifier in the image header, the index identifier in the slice header, the index identifier in the LCU header, and the size of the coding block, and the sequence header is no longer used for decision-making. At this time, if the index identifier in the image header, the index identifier in the slice header, and the index identifier in the LCU header are all 1 (the value is only an example), and the size of the encoding block is smaller than the set threshold, it means that the The coding block needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding; , but the size of the coding block is larger than the set threshold, it means that the coding block does not need to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding.

In addition, in the embodiments of the present application, there are other more indication manners, which will not be described in detail.

In an embodiment of the present application, when the quantization coefficients in at least one area in the quantization coefficient block are counted, the quantization coefficients in the at least one area are counted together, and finally a statistical result is obtained, specifically: The numerical sum of the quantization coefficients in the at least one area can be calculated, and the obtained sum is used as the statistical result; or the sum of the absolute values of the quantized coefficients in the at least one area can be calculated, and the obtained sum is used as the statistical result; Alternatively, the sum of the numerical values of the odd-numbered quantization coefficients in the at least one area may be calculated, and the obtained sum may be used as the statistical result; or the sum of the absolute values of the odd-numbered quantization coefficients in the at least one area may be calculated, and the result will be obtained. The sum value is used as the statistical result; or the sum of the numerical values of the quantization coefficients whose values are even or non-zero even in the at least one area can be calculated, and the obtained sum is used as the statistical result; or the at least one area can be calculated as an even number. Or the sum of the absolute values of non-zero even quantization coefficients, and the obtained sum will be used as the statistical result.

In an embodiment of the present application, when the quantization coefficients in at least one area in the quantization coefficient block are counted, the values of the quantization coefficients in the at least one area may be linearly mapped, and then the quantization coefficients in the at least one area may be calculated. The sum of the numerical or absolute values of the quantized coefficients after linear mapping, and the obtained sum is used as the statistical result.

In an embodiment of the present application, the above-mentioned linear mapping may be to convert the numerical value of the quantization coefficient whose value is an odd number in the at least one region into a first value, and convert the numerical value of the quantization coefficient whose value is an even number into a second value, Wherein, one of the first value and the second value is an odd number, and the other is an even number. For example, the value of the quantization coefficient with odd value in the at least one area is converted to 1, and the value of the quantization coefficient with even value is converted to 0; or the value of the quantization coefficient with odd value in the at least one area is converted into 0, convert the value of the quantization coefficient whose value is an even number to 1; or convert the value of the quantization coefficient whose value is an odd number in the at least one area to 3, and convert the value of the quantization coefficient whose value is an even number to 2; or In at least one area, the value of the odd-numbered quantization coefficient is converted to 2, and the value of the even-numbered quantization coefficient is converted to 3.

In an embodiment of the present application, the above-mentioned linear mapping may be to convert the value of the non-zero quantization coefficient in the at least one region into a third value, and convert the value of the quantization coefficient with a value of zero into a fourth value, wherein , one of the third value and the fourth value is odd and the other is even. For example, the value of the non-zero quantization coefficient in the at least one area is converted to 1, and the value of the quantization coefficient of zero value is converted to 0; or the value of the non-zero quantization coefficient in the at least one area is converted to 0, Convert the value of the quantization coefficient with a value of zero to 1; or convert the value of the non-zero quantization coefficient in the at least one area to 3, and convert the value of the quantization coefficient with a value of zero to 2; or the at least one area. The value of non-zero quantization coefficients within is converted to 2, and the value of quantization coefficients with a value of zero is converted to 3.

In an embodiment of the present application, the above-mentioned linear mapping may reduce the value of the quantization coefficient in the at least one region by a fifth value. For example, the values of the quantization coefficients in the at least one area are reduced by 1, or reduced by 2.

In an embodiment of the present application, the above-mentioned linear mapping may be to increase the value of the quantization coefficient in the at least one region by a value. For example, the values of the quantization coefficients in the at least one area are increased by 1, or increased by 2.

In an embodiment of the present application, the above-mentioned linear mapping may be a sixth non-zero value multiplied by the value of the quantization coefficient in the at least one region. For example, the values of the quantization coefficients in the at least one region are all multiplied by 1, or multiplied by 2. Optionally, the sixth numerical value may be a non-zero even number, such as 2, 4, 6, and so on.

In an embodiment of the present application, the above-mentioned linear mapping may be the value of the quantization coefficients in the at least one region divided by a non-zero value. For example, the values of the quantization coefficients in the at least one area are divided by 1, or divided by 2. Optionally, the value can be a non-zero even number, such as 2, 4, 6, and so on.

In an embodiment of the present application, the above-mentioned linear mapping may be to convert the numerical value of the quantization coefficient in the at least one region into an opposite number.

In an embodiment of the present application, after the quantization coefficients in at least one area in the quantization coefficient block are counted to obtain a statistical result, when calculating the remainder of the statistical result for a set value, the set value may be any non- A number of zero, such as 2, 3, 4, etc.

To sum up, the embodiments of the present application may perform statistics on the quantized coefficients in at least one region in the quantized coefficient block in the following manner:

1. Directly sum the values of the quantization coefficients in the at least one region;

2. Calculate the sum of the absolute values of the quantization coefficients in the at least one region;

3. Directly sum the values of the quantization coefficients whose values are odd in the at least one region;

4. Calculate the sum of the absolute values of the quantization coefficients whose values are odd in the at least one region;

5. Directly sum the values of the quantization coefficients whose values are even or non-zero even in the at least one region;

6. Calculate the sum of the absolute values of the quantization coefficients whose values are even or non-zero even in the at least one area;

7. First perform numerical conversion on odd numbers and even numbers according to the parity of the quantization coefficients in the at least one area, and then sum up all the converted values in the at least one area;

8. First perform numerical conversion on odd numbers and even numbers according to the parity of the quantization coefficients in the at least one area, and then sum the absolute values of all the converted numerical values in the at least one area;

9. First perform numerical conversion according to the non-zero quantization coefficients in the at least one area and the quantization coefficients with zero values, and then sum up all the converted values in the at least one area;

10. First perform numerical conversion according to the non-zero quantization coefficients in the at least one area and the quantization coefficients with zero values, and then sum the absolute values of all the converted values in the at least one area;

11. First perform numerical conversion operations such as increasing, decreasing, multiplying by a non-zero multiple, dividing by a non-zero multiple, or inverting all the quantization coefficients in the at least one area, and then converting all the values in the at least one area. to be reconciled;

12. First perform numerical conversion operations such as increasing, decreasing, multiplying by a non-zero multiple, dividing by a non-zero multiple, or inverting all the quantization coefficients in the at least one area, and then converting all the values in the at least one area. The absolute value of .

Of course, there may also be other methods, such as first performing numerical conversion on the quantized coefficients in the at least one region through the conversion methods in 7 to 12, and then only summing the converted odd or even numbers.

In an embodiment of the present application, the above-mentioned at least one area may be all areas in the quantized coefficient block.

In an embodiment of the present application, the above-mentioned at least one area may be at least one designated position in the quantized coefficient block.

In an embodiment of the present application, the above-mentioned at least one area may be at least one row specified in the quantized coefficient block. As shown in FIG. 7 , assuming that the quantized coefficient block is a 4×4 coefficient block, and each block represents a quantized coefficient, then as shown in (a) in FIG. 7 , one row of the gray area can be used as the at least one area; Alternatively, as shown in (b) of FIG. 7 , two lines of the gray area may be used as the at least one area. Optionally, the at least one row may be an upper row in the block of quantized coefficients.

In an embodiment of the present application, the above-mentioned at least one area may be at least one column specified in the quantized coefficient block. As shown in FIG. 7 , assuming that the quantized coefficient block is a 4×4 coefficient block, and each block represents a quantized coefficient, then as shown in (c) in FIG. 7 , one column of the gray area can be used as the at least one area; Alternatively, as shown in (d) of FIG. 7 , the two columns in the gray area may be used as the at least one area. Optionally, the at least one column may be the left column in the block of quantized coefficients.

In an embodiment of the present application, the above-mentioned at least one area may be at least one designated row and at least one designated column in the quantized coefficient block. As shown in FIG. 8 , assuming that the quantized coefficient block is a 4×4 coefficient block, and each block represents a quantized coefficient, then as shown in (a) of FIG. 8 , the lower row and the right column (that is, The gray area in it) is used as the at least one area; or as shown in (b) of FIG. 8 , the lower 2 rows and the right 2 columns (that is, the gray area) can be used as the at least one area; or as shown in the figure As shown in (c) of Figure 8, the upper row and the left column (that is, the gray area) are used as the at least one area; or as shown in Figure 8 (d), the upper 2 rows and the left 2 columns (that is, the gray area in it) as the at least one area.

In an embodiment of the present application, the above-mentioned at least one area may be a position on at least one oblique line in the quantized coefficient block. As shown in FIG. 9 , assuming that the quantized coefficient block is a 4×4 coefficient block, and each block represents a quantized coefficient, then as shown in (a) and (b) in 9, the position on a diagonal line can be used as The at least one area; or as shown in (c) and (d) in 9, the position on the two oblique lines is used as the at least one area.

In an embodiment of the present application, the above-mentioned at least one region may be an SRCC region in the quantized coefficient block. The SRCC area is the scanning area marked by the SRCC technology.

In an embodiment of the present application, the above-mentioned at least one area may be one location or multiple locations specified in the SRCC area. Optionally, the at least one position specified in the SRCC area may include: the first N positions in the scanning order or the N positions in the middle in the scanning order, of course, the last N positions in the scanning order, etc., N is a non-zero natural number.

In an embodiment of the present application, the above-mentioned at least one area may be at least one row specified in the SRCC area. As shown in FIG. 7 , assuming that the SRCC area is a 4×4 coefficient block, and each block represents a quantized coefficient, then as shown in (a) of FIG. 7 , one row of the gray area can be used as the at least one area; or As shown in FIG. 7( b ), two lines of the gray area may be used as the at least one area. Optionally, the at least one row may be an upper row in the block of quantized coefficients.

In an embodiment of the present application, the above-mentioned at least one area may be at least one column designated in the SRCC area. As shown in FIG. 7 , assuming that the SRCC area is a 4×4 coefficient block, and each block represents a quantized coefficient, then as shown in (c) in FIG. 7 , one column of the gray area can be used as the at least one area; or As shown in (d) of FIG. 7 , the two columns of the gray area can be used as the at least one area. Optionally, the at least one column may be the left column in the block of quantized coefficients.

In an embodiment of the present application, the above-mentioned at least one area may be at least one designated row and at least one designated column in the SRCC area. As shown in Figure 8, assuming that the SRCC area is a 4×4 coefficient block, and each block represents a quantized coefficient, then as shown in (a) of Figure 8, the lower row and the right column (that is, where the gray area) as the at least one area; or as shown in FIG. 8(b), the lower 2 rows and the right 2 columns (that is, the gray area) can be used as the at least one area; or as shown in FIG. 8 As shown in (c), the upper row and the left column (that is, the gray area) are used as the at least one area; or as shown in FIG. 8 (d), the upper two rows and the left 2 columns (that is, the gray area therein) serve as the at least one area.

In an embodiment of the present application, the above-mentioned at least one area may be a position on at least one oblique line in the SRCC area. As shown in Figure 9, assuming that the SRCC area is a 4×4 coefficient block, and each block represents a quantized coefficient, then as shown in (a) and (b) in 9, the position on a diagonal line can be used as the at least one area; or as shown in (c) and (d) in 9, the position on the two oblique lines is taken as the at least one area.

In other embodiments of the present application, at least one area division manner in the foregoing embodiments may also be combined, so that the combined area is used as the at least one area.

Continuing to refer to FIG. 6 , in step S630 , according to the correspondence between the remainder and the transformation matrix combination, the corresponding transformation matrix combination is selected.

In an embodiment of the present application, for example, when calculating the remainder, the set value is set to 3, then the three remainders (ie, 0, 1, and 2) may correspond to different transformation matrix combinations; If the value is set to 5, then the 5 remainders (ie, 0, 1, 2, 3, and 4) can correspond to different transformation matrix combinations, respectively. It can be seen that the technical solutions of the embodiments of the present application can realize the index indication of various transformation matrix combinations, and can effectively reduce the bits occupied by the transformation matrix indexes.

It should be noted that, in the embodiments of the present application, the transformation matrix combinations corresponding to different remainders may be different. Of course, the transformation matrix combinations corresponding to different remainders may also be the same, but the possible remainder results cannot all correspond to the same transformation matrix combination.

Optionally, the transformation kernel used in the transformation matrix combination may be any combination of known discrete transformation kernels (8 kinds of DCT transformation kernels and 8 kinds of DST transformation kernels). For example, the optional transform kernels may include: DCT2, DCT5, DCT8, DST1, DST7, and so on.

In an embodiment of the present application, the corresponding relationship between the remainder and the combination of transformation matrices may be preset based on the combination of the DCT transform kernel and/or the DST transform kernel according to the value of the remainder. Optionally, the transformation matrix combination includes any combination of at least one of DCT2, DCT5, DCT8, DST1, and DST7. More specifically, for example, if the aforementioned setting value is 5, the following correspondence can be set: when the remainder is 0, the corresponding transformation matrix combination can be (DCT2, DCT2); when the remainder is 1, the corresponding transformation matrix combination Can be (DCT8, DCT8); when the remainder is 2, the corresponding transformation matrix combination can be (DCT8, DST7); when the remainder is 3, the corresponding transformation matrix combination can be (DST7, DCT8); when the remainder is 4, the corresponding transformation matrix The combination can be (DST7, DST7).

In an embodiment of the present application, a certain value of the remainder may also be used to indicate that the coding block skips the transformation process. For example, the value of a certain remainder indicates that the corresponding transform matrix combination is a null value (or TS), and the null value (or TS) indicates that the coding block skips the transform process. For example, if the aforementioned setting value is 5, then the corresponding transformation matrix combination when the remainder is 0 can be (DCT2, DCT2); when the remainder is 1, the corresponding transformation matrix combination can be (DCT8, DCT8); when the remainder is 2 The corresponding transformation matrix combination can be (DCT8, DST7); when the remainder is 3, the corresponding transformation matrix combination can be (DST7, DCT8); when the remainder is 4, the corresponding transformation matrix combination can be null (or TS), with Indicates that the encoding block skips the transform process, in which case, the quantized coefficient block can be directly inverse quantized, and then the result of the inverse quantization process is used as the reconstructed residual data, without the need for the result of the inverse quantization process. Perform inverse transformation. It should be noted that the remainder indicating that the coding block skips the transformation process may be set according to actual needs, and 4 in this embodiment is only an example.

Continuing to refer to FIG. 6 , in step S640 , inverse transform processing is performed on the inverse quantization result of the quantized coefficient block based on the selected transform matrix combination. For this process, reference may be made to the relevant descriptions in the foregoing embodiments, and details are not repeated here.

In step S650, the video image frame is reconstructed according to the processing result of the inverse transformation processing.

For this process, reference may be made to the relevant descriptions in the foregoing embodiments, and details are not repeated here.

The technical solutions of the above embodiments of the present application enable the quantization coefficients in the quantization coefficient blocks to implicitly indicate the transformation matrix combination corresponding to the coding block, without the need for the coding end to encode the index of the transformation matrix for each coding unit, thereby reducing the transformation matrix index occupied bits, which can effectively improve the video coding efficiency.

The apparatus embodiments of the present application are described below, which can be used to execute the video decoding methods in the above-mentioned embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the above-mentioned embodiments of the video decoding method of the present application.

FIG. 10 shows a block diagram of a video decoding apparatus according to an embodiment of the present application. The video decoding apparatus may be set in a device with a computing processing function, such as a terminal device or a server.

Referring to FIG. 10 , a video decoding apparatus 1000 according to an embodiment of the present application includes: a decoding unit 1002 , a statistics unit 1004 , a selection unit 1006 , a processing unit 1008 and a reconstruction unit 1010 .

The decoding unit 1002 is configured to perform entropy decoding processing on the coding block of the video image frame to obtain a quantized coefficient block of residual data corresponding to the coding block; the statistics unit 1004 is configured to perform entropy decoding on at least one region in the quantized coefficient block. The quantization coefficients within are counted to obtain statistical results, and the remainder of the statistical results for the set value is calculated; the selection unit 1006 is configured to select the corresponding transformation matrix combination according to the correspondence between the remainder and the transformation matrix combination; the processing unit 1008 is configured In order to perform inverse transformation processing on the inverse quantization result of the quantized coefficient block based on the selected transformation matrix combination, the reconstruction unit 1010 is configured to reconstruct the video image frame according to the processing result of the inverse transformation processing.

In some embodiments of the present application, based on the foregoing solution, the video decoding apparatus 1000 further includes: a first determining unit, configured to determine, according to the value of the specified index identifier, the need for a target coding block in the corresponding coded data The corresponding transformation matrix combination is selected according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding, wherein the specified index identifier is included in at least one of the following: the sequence header of the first encoded data corresponding to the video image frame sequence, the video The image header of the second coded data corresponding to the image frame, the slice header of the third coded data corresponding to a slice of the video image frame, and the fourth coded data corresponding to an LCU (Largest Coding Unit, maximum coding unit) of the video image frame the LCU header.

In some embodiments of the present application, based on the foregoing solution, the first determination unit is configured to, when the value of the specified index identifier is the first value, determine that the target encoding block in the corresponding encoded data needs to be obtained by entropy decoding The quantization coefficients in the quantization coefficient block select the corresponding transformation matrix combination.

In some embodiments of the present application, based on the foregoing solution, the first determination unit is configured to be the first value when the specified index identifier included in the sequence header of the first encoded data corresponding to a sequence of video image frames is the first value , determining the target coding block in the first coded data requires selecting a corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding.

In some embodiments of the present application, based on the foregoing solution, the first determination unit is configured to, when the value of the specified index identifier included in the image header of the second encoded data corresponding to one video image frame is the first value, Determining the target encoding block in the second encoded data requires selecting a corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding.

In some embodiments of the present application, based on the foregoing solution, the first determination unit is configured to set the value of the specified index identifier included in the slice header information of the third encoded data corresponding to one slice of the video image frame to the value of When the value is the first, determining the target coding block in the third coded data requires selecting a corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding.

In some embodiments of the present application, based on the foregoing solution, the first determining unit is configured to set the value of the specified index identifier included in the LCU header information of the fourth encoded data corresponding to one LCU of the video image frame to the first When the value is determined, it is necessary to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding to determine the target coding block in the fourth coded data.

In some embodiments of the present application, based on the foregoing solution, the video decoding apparatus 1000 further includes: a second determining unit, configured to determine the Whether the encoding block needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding.

In some embodiments of the present application, based on the foregoing solution, the video decoding apparatus 1000 further includes: a third determining unit, configured as an index identifier included in a sequence header of the first encoded data corresponding to a sequence of video image frames When it is the first value, it is not necessary to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding to determine the target coding block in the first coded data.

In some embodiments of the present application, based on the foregoing solution, the third determining unit is further configured to indicate that the index included in the sequence header of the first encoded data is a second value, and the video image frame sequence is When the index identifier contained in the image header of the second encoded data corresponding to one video image frame is the first value, it is determined that the target encoding block in the second encoded data does not need to be decoded according to entropy. The quantization coefficient selects the corresponding transformation matrix combination.

In some embodiments of the present application, based on the foregoing solution, the third determining unit is further configured to include an index identifier included in the sequence header of the first encoded data as a second value, and the second encoded data When the index identifier included in the image header is the second value, it is determined that the target coding block in the second coded data needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding.

In some embodiments of the present application, based on the foregoing solution, the third determining unit is further configured to include an index in the sequence header of the first encoded data identified as a second value, an image of the second encoded data When the index identifier included in the header is the second value, and the index identifier included in the slice header information of the third encoded data corresponding to one slice of the video image frame is the first value, it is determined that the third encoded data is It is not necessary to select the corresponding transformation matrix combination according to the quantized coefficients in the quantized coefficient block obtained by entropy decoding for the target coding block in .

In some embodiments of the present application, based on the foregoing solution, the third determining unit is further configured to include an index in the sequence header of the first encoded data identified as a second value, an image of the second encoded data When the index identifier included in the header is the second value and the index identifier included in the slice header information of the third encoded data is the second value, it is determined that the target encoding block in the third encoded data needs to be obtained by entropy decoding. The quantization coefficients in the quantization coefficient block select the corresponding transformation matrix combination.

In some embodiments of the present application, based on the foregoing solution, the third determining unit is further configured to include an index in the sequence header of the first encoded data identified as a second value, an image of the second encoded data The index identifier included in the header is the second value, the index identifier included in the slice header information of the third encoded data is the second value, and the LCU header of the fourth encoded data corresponding to one LCU of the slice is identified as the second value. When the index identifier included in the information is the first value, it is determined that the target encoding block in the fourth encoded data does not need to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding.

In some embodiments of the present application, based on the foregoing solution, the third determining unit is further configured to include an index in the sequence header of the first encoded data identified as a second value, an image of the second encoded data The index identifier included in the header is the second value, the index identifier included in the slice header information of the third encoded data is the second value, and the index identifier included in the LCU header information of the fourth encoded data is the first value. When it is a binary value, it is necessary to select a corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding to determine the target coding block in the fourth coded data.

In some embodiments of the present application, based on the foregoing solution, the third determining unit is further configured to include an index in the sequence header of the first encoded data identified as a second value, an image of the second encoded data The index identifier included in the header is the second value, the index identifier included in the slice header information of the third encoded data is the second value, and the index identifier included in the LCU header information of the fourth encoded data is the second value. value, then according to the relationship between the size of each coding block in the fourth coded data and the preset threshold range, it is determined whether each coding block needs to be selected according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding. combination of transformation matrices.

In some embodiments of the present application, based on the foregoing solution, the target coding block is any one of the following: coding blocks in intra-frame coding mode, coding blocks in inter-frame coding mode, and all coding blocks in corresponding coded data.

In some embodiments of the present application, based on the foregoing solution, the video decoding apparatus further includes: a fourth determination unit, configured to be configured according to a first indication included in a sequence header of the first encoded data corresponding to a sequence of video image frames The value of the bit and the value of the second indicator bit respectively determine whether the encoding block using the intra-frame encoding mode and the encoding block using the inter-frame encoding mode in the first encoded data need quantization in the quantization coefficient block obtained by entropy decoding. The coefficient selects the corresponding transformation matrix combination; or

According to the value of the first indicator bit and the value of the second indicator bit included in the image header of the second encoded data corresponding to one video image frame, determine the encoding block in the second encoded data using the intra-frame encoding mode and the encoding block using the intra-frame encoding mode respectively. Whether the coding block in the inter-coding mode needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding; or

According to the value of the first indicator bit and the value of the second indicator bit included in the slice header information of the third encoded data corresponding to one slice of the video image frame, it is respectively determined that the third encoded data adopts the intra-frame encoding mode Whether it is necessary to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding and the coding block using the inter-coding mode; or

According to the value of the first indicator bit and the value of the second indicator bit included in the LCU header information of the fourth encoded data corresponding to one LCU of the video image frame, the encoding using the intra-frame encoding mode in the fourth encoded data is determined respectively. Whether it is necessary to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding for the block and the coding block using the inter coding mode.

In some embodiments of the present application, based on the foregoing solution, the statistics unit 1004 is configured to: calculate the sum of the numerical values of the quantization coefficients in the at least one region, and use the obtained sum as the statistical result; or

Calculate the sum of the absolute values of the quantization coefficients in the at least one region, and use the obtained sum as the statistical result; or

Calculate the numerical sum of odd-numbered quantization coefficients in the at least one region, and use the obtained sum as the statistical result; or

Calculate the sum of the absolute values of the odd-numbered quantization coefficients in the at least one region, and use the obtained sum as the statistical result; or

Calculate the sum of the numerical values of the quantization coefficients whose values are even or non-zero even in the at least one area, and use the obtained sum as the statistical result; or

Calculate the sum of the absolute values of the quantization coefficients whose values are even or non-zero even in the at least one area, and use the obtained sum as the statistical result.

In some embodiments of the present application, based on the foregoing solution, the statistics unit 1004 is configured to: perform linear mapping on the numerical values of the quantized coefficients in the at least one area, and calculate the value of the quantized coefficients in the at least one area after the linear mapping. The sum of numerical values or absolute values, and the obtained sum value is used as the statistical result, wherein the linear mapping includes:

Convert the numerical value of the quantization coefficient whose value is an odd number in the at least one area into a first numerical value, and convert the numerical value of the quantization coefficient whose value is an even number into a second numerical value, wherein the first numerical value and the second numerical value are one is odd and the other is even; or

Converting the value of the non-zero quantization coefficient in the at least one area into a third value, and converting the value of the quantization coefficient with a value of zero into a fourth value, wherein the third value and the fourth value are one is odd and the other is even; or

decreasing or increasing the numerical value of the quantization coefficients in the at least one region by a fifth numerical value; or

multiplying or dividing the value of the quantization coefficients within the at least one region by a sixth non-zero value; or

Multiplying or dividing the value of the quantized coefficients within the at least one region by a non-zero even number.

In some embodiments of the present application, based on the aforementioned solutions, the at least one region includes at least one of the following regions:

all regions in the block of quantized coefficients;

at least one location specified in the block of quantized coefficients;

at least one row specified in the block of quantized coefficients;

at least one column specified in the block of quantized coefficients;

at least one row specified and at least one column specified in the block of quantized coefficients;

a position on at least one oblique line in the quantized coefficient block;

the SRCC region in the quantized coefficient block;

at least one location specified in the SRCC area;

at least one row specified in the SRCC area;

at least one column specified in the SRCC area;

At least one row specified and at least one column specified in the SRCC area;

The SRCC area is located on at least one diagonal line.

In some embodiments of the present application, based on the foregoing solution, the at least one position specified in the SRCC area includes: the first N positions in the scanning order, the middle N positions in the scanning order, or the last N positions in the scanning order position, N is a non-zero natural number.

In some embodiments of the present application, based on the aforementioned scheme, the remainder whose value is a specified value is used to indicate that the coding block skips the transform processing process.

In some embodiments of the present application, based on the foregoing solution, the corresponding relationship between the remainder and the combination of transformation matrices is based on the value of the remainder, based on the discrete cosine transform DCT transform kernel and/or the discrete sine transform DST transform kernel The combination between is preset.

In some embodiments of the present application, based on the foregoing solution, the transformation matrix combination includes a combination of any at least one of DCT2, DCT5, DCT8, DST1, and DST7.

It should be noted that the computer system 1100 of the electronic device shown in FIG. 11 is only an example, and should not impose any limitations on the functions and scope of use of the embodiments of the present application.

As shown in FIG. 11 , the computer system 1100 includes a central processing unit (Central Processing Unit, CPU) 1101, which can be loaded into a random device according to a program stored in a read-only memory (Read-Only Memory, ROM) 1102 or from a storage part 1108 The programs in the memory (Random Access Memory, RAM) 1103 are accessed to perform various appropriate actions and processes, for example, the methods described in the above embodiments are performed. In the RAM 1103, various programs and data required for system operation are also stored. The CPU 1101, the ROM 1102, and the RAM 1103 are connected to each other through a bus 1104. An Input/Output (I/O) interface 1105 is also connected to the bus 1104 .

The following components are connected to the I/O interface 1105: an input section 1106 including a keyboard, a mouse, etc.; an output section 1107 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc. ; a storage part 1108 including a hard disk and the like; and a communication part 1109 including a network interface card such as a LAN (Local Area Network) card, a modem, and the like. The communication section 1109 performs communication processing via a network such as the Internet. Drivers 1110 are also connected to I/O interface 1105 as needed. Removable media 1111, such as magnetic disks, optical disks, magneto-optical disks, semiconductor memories, etc., are mounted on the drive 1110 as needed so that computer-readable instructions read therefrom are mounted into the storage section 1108 as needed.

In particular, according to embodiments of the present application, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising computer readable instructions carried on a computer readable medium, the computer readable instructions comprising computer readable instructions for performing the method illustrated in the flowchart. In such an embodiment, the computer readable instructions may be downloaded and installed from the network via the communication portion 1109 and/or installed from the removable media 1111. When the computer readable instructions are executed by the central processing unit (CPU) 1101, the various functions defined in the system of the present application are performed.

It should be noted that the computer-readable medium shown in the embodiments of the present application may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples of computer readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Erasable Programmable Read Only Memory (EPROM), flash memory, optical fiber, portable Compact Disc Read-Only Memory (CD-ROM), optical storage device, magnetic storage device, or any suitable of the above The combination. In this application, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this application, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable computer-readable instructions thereon. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device . Computer readable instructions embodied on a computer readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, etc., or any suitable combination of the foregoing.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. Wherein, each block in the flowchart or block diagram may represent a module, program segment, or part of code, and the above-mentioned module, program segment, or part of code contains one or more executables for realizing the specified logical function instruction. It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams or flowchart illustrations, and combinations of blocks in the block diagrams or flowchart illustrations, can be implemented in special purpose hardware-based systems that perform the specified functions or operations, or can be implemented using A combination of dedicated hardware and computer instructions is implemented.

The units involved in the embodiments of the present application may be implemented in software or hardware, and the described units may also be provided in a processor. Among them, the names of these units do not constitute a limitation on the unit itself under certain circumstances.

As another aspect, the present application also provides a computer-readable medium. The computer-readable medium may be included in the electronic device described in the above embodiments; it may also exist alone without being assembled into the electronic device. middle. The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by an electronic device, enables the electronic device to implement the methods described in the above-mentioned embodiments.

It should be noted that although several modules or units of the apparatus for action performance are mentioned in the above detailed description, this division is not mandatory. Indeed, according to embodiments of the present application, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above may be further divided into multiple modules or units to be embodied.

From the description of the above embodiments, those skilled in the art can easily understand that the exemplary embodiments described herein may be implemented by software, or may be implemented by software combined with necessary hardware. Therefore, the technical solutions according to the embodiments of the present application may be embodied in the form of software products, and the software products may be stored in a non-volatile storage medium (which may be CD-ROM, U disk, mobile hard disk, etc.) or on the network , which includes several instructions to cause a computing device (which may be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiments of the present application.

Other embodiments of the present application will readily occur to those skilled in the art upon consideration of the specification and practice of the embodiments disclosed herein. This application is intended to cover any variations, uses or adaptations of this application that follow the general principles of this application and include common knowledge or conventional techniques in the technical field not disclosed in this application .

It is to be understood that the present application is not limited to the precise structures described above and illustrated in the accompanying drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims

A video decoding method, characterized in that, executed by an electronic device, comprising:

Entropy decoding processing is performed on the coding block of the video image frame to obtain a quantized coefficient block of residual data corresponding to the coding block;

Perform statistics on the quantization coefficients in at least one area in the quantization coefficient block to obtain a statistical result, and calculate the remainder of the statistical result for a set value;

According to the correspondence between the remainder and the transformation matrix combination, select the corresponding transformation matrix combination;

Perform inverse transform processing on the inverse quantization result of the quantized coefficient block based on the selected transform matrix combination;

The video image frame is reconstructed according to the processing result of the inverse transform processing.
The video decoding method according to claim 1, further comprising:

According to the value of the specified index identifier, it is determined whether the target coding block in the corresponding encoded data needs to select the corresponding transformation matrix combination according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding, wherein the specified index identifier includes the following At least one of the data:

The sequence header of the first encoded data corresponding to the sequence of video image frames, the image header of the second encoded data corresponding to the video image frame, the slice header of the third encoded data corresponding to a slice of the video image frame, and a maximum of a video image frame. The LCU header of the fourth coded data corresponding to the coding unit LCU.
The video decoding method according to claim 2, wherein the target coding block is any one of the following: a coding block using an intra-frame coding mode, a coding block using an inter-frame coding mode, and a corresponding coded data block. All encoded blocks.
The video decoding method according to claim 2, wherein, according to the value of the specified index identifier, it is determined whether the target coding block in the corresponding coded data needs the quantization coefficient in the quantization coefficient block obtained by entropy decoding. Select the corresponding transformation matrix combination, including:

When the value of the specified index identifier is the first value, it is determined that the target coding block in the corresponding coded data needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding.
The video decoding method according to claim 2, wherein, according to the value of the specified index identifier, it is determined whether the target coding block in the corresponding coded data needs the quantization coefficient in the quantization coefficient block obtained by entropy decoding. Select the corresponding transformation matrix combination, including:

When the index identifier included in the sequence header of the first encoded data is the first value, it is determined that the target encoding block in the first encoded data does not need to select the corresponding quantization coefficient according to the quantization coefficient block obtained by entropy decoding. Transformation matrix combination.
The video decoding method according to claim 2, wherein, according to the value of the specified index identifier, it is determined whether the target coding block in the corresponding coded data needs the quantization coefficient in the quantization coefficient block obtained by entropy decoding. Select the corresponding transformation matrix combination, including:

When the index identifier included in the sequence header of the first encoded data is the second value, and the index identifier included in the image header of the second encoded data is the first value, it is determined that the index identifier in the second encoded data is The target coding block does not need to select the corresponding transformation matrix combination according to the quantized coefficients in the quantized coefficient block obtained by entropy decoding;

When the index identifier included in the sequence header of the first encoded data is the second value, and the index identifier included in the image header is the second value, determining the target encoding block in the second encoded data needs to be based on The quantized coefficients in the quantized coefficient block obtained by entropy decoding select the corresponding transformation matrix combination.
The video decoding method according to claim 2, wherein, according to the value of the specified index identifier, it is determined whether the target coding block in the corresponding coded data needs a quantization coefficient block obtained by entropy decoding. The quantization coefficients in select the corresponding transformation matrix combination, including:

The index identifier included in the sequence header of the first encoded data is the second value, the index identifier included in the image header of the second encoded data is the second value, and the slice header of the third encoded data When the index identifier contained in the partial information is the first value, it is determined that the target encoding block in the third encoded data does not need to select the corresponding transformation matrix combination according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding;

When the index identifier included in the sequence header is the second value, the index identifier included in the image header is the second value, and the index identifier included in the slice header information is the second value, determine the first value. The target coding block in the three-coded data needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding.
The video decoding method according to claim 2, wherein, according to the value of the specified index identifier, it is determined whether the target coding block in the corresponding coded data needs a quantization coefficient block obtained by entropy decoding. The quantization coefficients in select the corresponding transformation matrix combination, including:

The index identifier included in the sequence header of the first encoded data is the second value, the index identifier included in the image header of the second encoded data is the second value, and the slice header of the third encoded data When the index identifier included in the information is the second value, and the index identifier included in the LCU header information of the fourth encoded data is the first value, it is determined that the target encoding block in the fourth encoded data does not need to be obtained by entropy decoding The quantization coefficient in the quantization coefficient block selects the corresponding transformation matrix combination;

The index identifier included in the sequence header is the second value, the index identifier included in the image header is the second value, the index identifier included in the slice header information is the second value, and the LCU header When the index identifier contained in the partial information is the second value, it is determined that the target encoding block in the fourth encoded data needs to select the corresponding transformation matrix combination according to the quantization coefficient in the quantization coefficient block obtained by entropy decoding;

The index identifier included in the sequence header is the second value, the index identifier included in the image header is the second value, the index identifier included in the slice header information is the second value, and the LCU header The index identifier included in the information is the second value, then according to the relationship between the size of each encoding block in the fourth encoded data and the preset threshold range, it is determined whether each encoding block needs to be quantized according to entropy decoding. The quantized coefficients in the coefficient block select the corresponding transform matrix combination.
The video decoding method according to claim 1, further comprising:

According to the relationship between the size of the coding block and the preset threshold range, it is determined whether the coding block needs to select a corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding.
The video decoding method according to any one of claims 1 to 9, further comprising:

According to the value of the first indicator bit and the value of the second indicator bit included in the sequence header of the first encoded data, determine the encoding block using the intra-frame encoding mode and the encoding using the inter-frame encoding mode in the first encoded data, respectively. Whether the block needs to select a corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding, and the first encoded data is encoded data corresponding to a video image frame sequence; or

According to the value of the first indicator bit and the value of the second indicator bit contained in the image header of the second encoded data, determine the encoding block using the intra-frame encoding mode and the encoding using the inter-frame encoding mode in the second encoded data, respectively. Whether the block needs to select a corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding, and the second encoded data is encoded data corresponding to a video image frame; or

According to the value of the first indicator bit and the value of the second indicator bit included in the slice header information of the third encoded data, the encoding block in the third encoded data that adopts the intra-frame encoding mode and the encoding block that adopts the inter-frame encoding mode are respectively determined. Whether the encoding block needs to select the corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding, and the third encoded data is the encoded data corresponding to a slice of the video image frame; or

According to the value of the first indicator bit and the value of the second indicator bit included in the LCU header information of the fourth encoded data, respectively determine the encoding block in the fourth encoded data that adopts the intra-frame encoding mode and the encoding block that adopts the inter-frame encoding mode. Whether the encoding block needs to select a corresponding transformation matrix combination according to the quantization coefficients in the quantization coefficient block obtained by entropy decoding, and the fourth encoded data is encoded data corresponding to one LCU of the video image frame.
The video decoding method according to any one of claims 1 to 9, wherein the method for determining the statistical result comprises any one of the following methods:

Calculate the sum of the numerical values of the quantization coefficients in the at least one area, and use the obtained sum as the statistical result;

Calculate the sum of the absolute values of the quantization coefficients in the at least one area, and use the obtained sum as the statistical result;

Calculate the numerical sum of odd-numbered quantization coefficients in the at least one region, and use the obtained sum as the statistical result;

Calculate the sum of the absolute values of the odd-numbered quantization coefficients in the at least one area, and use the obtained sum as the statistical result;

Calculate the sum of the numerical values of the quantization coefficients whose values are even or non-zero even in the at least one area, and use the obtained sum as the statistical result;

Calculate the sum of the absolute values of the quantization coefficients whose values are even or non-zero even in the at least one area, and use the obtained sum as the statistical result.
The video decoding method according to any one of claims 1 to 9, wherein obtaining a statistical result by performing statistics on the quantization coefficients in at least one region in the quantization coefficient block comprises: quantifying the at least one region Perform linear mapping on the numerical values of the quantized coefficients in the at least one area, calculate the sum of the numerical values or absolute values of the quantized coefficients in the at least one region after the linear mapping, and use the obtained sum as the statistical result, wherein the linear mapping includes any of the following ways:

Convert the numerical value of the quantization coefficient whose value is an odd number in the at least one area into a first numerical value, and convert the numerical value of the quantization coefficient whose value is an even number into a second numerical value, wherein the first numerical value and the second numerical value are One is odd and the other is even;

Converting the value of the non-zero quantization coefficient in the at least one area into a third value, and converting the value of the quantization coefficient with a value of zero into a fourth value, wherein the third value and the fourth value are One is odd and the other is even;

reducing or increasing the numerical value of the quantization coefficients in the at least one region by a fifth numerical value;

multiplying or dividing the value of the quantized coefficients within the at least one region by a sixth non-zero value;

Multiplying or dividing the value of the quantized coefficients within the at least one region by a non-zero even number.
The video decoding method according to any one of claims 1 to 9, wherein the at least one area includes at least one of the following areas:

all regions in the block of quantized coefficients;

at least one location specified in the block of quantized coefficients;

at least one row specified in the block of quantized coefficients;

at least one column specified in the block of quantized coefficients;

at least one row specified and at least one column specified in the block of quantized coefficients;

a position on at least one oblique line in the quantized coefficient block;

the scanning region coefficients in the quantized coefficient block encode the SRCC region;

at least one location specified in the SRCC area;

at least one row specified in the SRCC area;

at least one column specified in the SRCC area;

At least one row specified and at least one column specified in the SRCC area;

The SRCC area is located on at least one diagonal line.
The video decoding method according to claim 13, wherein the at least one position specified in the SRCC area comprises: the first N positions in the scanning order, the middle N positions in the scanning order, or the N positions in the scanning order. The last N positions, N is a non-zero natural number.
The video decoding method according to any one of claims 1 to 9, wherein the remainder whose value is a specified value is used to indicate that the coding block skips a transformation process.
The video decoding method according to any one of claims 1 to 9, wherein the corresponding relationship between the remainder and the combination of transformation matrices is based on the value of the remainder, based on the discrete cosine transform (DCT) transform kernel and / or discrete sine transform and DST transform kernels are pre-set in combination.
The video decoding method according to any one of claims 1 to 9, wherein the transformation matrix combination comprises a combination of at least one of DCT2, DCT5, DCT8, DST1, and DST7.
A video decoding device, comprising:

a decoding unit, configured to perform entropy decoding processing on an encoded block of a video image frame to obtain a quantized coefficient block of residual data corresponding to the encoded block;

a statistics unit, configured to perform statistics on the quantization coefficients in at least one area in the quantization coefficient block to obtain a statistical result, and calculate the remainder of the statistical result for a set value;

a selection unit, configured to select a corresponding transformation matrix combination according to the correspondence between the remainder and the transformation matrix combination;

a processing unit, configured to perform inverse transformation processing on the inverse quantization result of the quantized coefficient block based on the selected transformation matrix combination;

The reconstruction unit is configured to reconstruct the video image frame according to the processing result of the inverse transformation processing.
One or more non-transitory computer-readable media storing computer-readable instructions on which computer-readable instructions are stored, characterized in that the computer-readable instructions, when executed by one or more processors, implement the following: The video decoding method of any one of claims 1 to 17.
An electronic device, comprising:

one or more processors;

storage means for storing computer readable instructions which, when executed by said one or more processors, cause said one or more processors to implement any one of claims 1 to 17 The video decoding method.