WO2024007144A1 - Encoding method, decoding method, code stream, encoders, decoders and storage medium - Google Patents

Encoding method, decoding method, code stream, encoders, decoders and storage medium Download PDF

Info

Publication number
WO2024007144A1
WO2024007144A1 PCT/CN2022/103817 CN2022103817W WO2024007144A1 WO 2024007144 A1 WO2024007144 A1 WO 2024007144A1 CN 2022103817 W CN2022103817 W CN 2022103817W WO 2024007144 A1 WO2024007144 A1 WO 2024007144A1
Authority
WO
WIPO (PCT)
Prior art keywords
value
absolute value
quantized residual
residual
attribute
Prior art date
Application number
PCT/CN2022/103817
Other languages
French (fr)
Chinese (zh)
Inventor
魏红莲
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Priority to PCT/CN2022/103817 priority Critical patent/WO2024007144A1/en
Publication of WO2024007144A1 publication Critical patent/WO2024007144A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124Quantisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Definitions

  • the embodiments of the present application relate to the field of point cloud compression technology, and in particular, to a coding and decoding method, a code stream, an encoder, a decoder, and a storage medium.
  • the geometric information and attribute information of the point cloud are encoded separately. After the geometric encoding is completed, the geometric information is reconstructed, and the encoding of attribute information will depend on the reconstructed geometric information.
  • attribute information encoding is mainly aimed at encoding color information, converting it into a YUV color space that is more in line with human visual characteristics, and then performing attribute encoding on the preprocessed attribute information, and finally generating a binary attribute code stream.
  • the obtained attribute residual value can be either positive or negative.
  • the sign identification information is encoded together with the attribute residual value; and the encoding of the sign identification information also requires the use of codewords, thus reducing the encoding and decoding efficiency.
  • Embodiments of the present application provide a coding and decoding method, a code stream, an encoder, a decoder, and a storage medium, which can reduce the number of codewords used when encoding attribute information, thereby improving coding and decoding efficiency.
  • embodiments of the present application provide a decoding method, which is applied to a decoder.
  • the method includes:
  • the attribute reconstruction value of the current point is determined.
  • inventions of the present application provide an encoding method, which is applied to an encoder.
  • the method includes:
  • embodiments of the present application provide a code stream.
  • the code stream is generated by bit encoding based on the information to be encoded.
  • the information to be encoded at least includes: the absolute value of the quantized residual of the current point, or the absolute value of the quantized residual of the current point.
  • the absolute value of the quantized residual and the corresponding symbol identification information are included in the code stream.
  • embodiments of the present application provide an encoder, which includes a first determination unit and a coding unit; wherein,
  • a first determination unit configured to determine the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point; and when the absolute value of the initial quantized residual satisfies the first preset condition, according to the sign and the initial Quantize the parity characteristics of the absolute value of the residual and determine the absolute value of the quantized residual at the current point;
  • the encoding unit is configured to encode the absolute value of the quantization residual and write the resulting encoded bits into the code stream.
  • embodiments of the present application provide an encoder, which includes a first memory and a first processor; wherein,
  • a first memory for storing a computer program capable of running on the first processor
  • the first processor is configured to perform the method described in the first aspect when running the computer program.
  • embodiments of the present application provide a decoder, which includes a decoding unit and a second determination unit; wherein,
  • the decoding unit is configured to parse the code stream and determine the absolute value of the quantized residual at the current point;
  • the second determination unit is configured to determine the sign of the quantized residual at the current point according to the parity characteristics of the absolute value of the quantized residual when the absolute value of the quantized residual satisfies the first preset condition; and based on the absolute value of the quantized residual and symbols, determine the attribute reconstruction value of the current point.
  • embodiments of the present application provide a decoder, which includes a second memory and a second processor; wherein,
  • a second memory for storing a computer program capable of running on the second processor
  • the second processor is configured to perform the method described in the second aspect when running the computer program.
  • embodiments of the present application provide a computer-readable storage medium that stores a computer program.
  • the computer program When the computer program is executed, the method as described in the first aspect, or the second aspect is implemented. methods described in this regard.
  • Embodiments of the present application provide a coding and decoding method, a code stream, an encoder, a decoder, and a storage medium.
  • the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point are determined;
  • the absolute value of the quantized residual at the current point is determined based on the sign and the parity characteristics of the initial quantized residual absolute value;
  • the absolute value of the quantized residual is encoded, and all The resulting coded bits are written into the code stream.
  • the code stream is parsed to determine the absolute value of the quantized residual at the current point; when the absolute value of the quantized residual meets the first preset condition, the quantized residual at the current point is determined based on the parity characteristics of the absolute value of the quantized residual. The sign of the difference; determine the attribute reconstruction value of the current point based on the absolute value and sign of the quantized residual.
  • the parity characteristics based on the absolute value of the quantized residual can hide some symbols of the values to be encoded, that is, there is no need to encode these symbols, so as to reduce the codewords used when encoding attribute information; while on the decoding side, The corresponding symbol can be directly determined based on the parity and even characteristics of the absolute value of the quantized residual obtained by decoding; thus, the use of codewords can be reduced, the encoding and decoding efficiency of point cloud attributes can be improved, and the encoding and decoding performance of point cloud attributes can be improved.
  • Figure 1A is a schematic diagram of a three-dimensional point cloud image provided by an embodiment of the present application.
  • Figure 1B is a partially enlarged schematic diagram of a three-dimensional point cloud image provided by an embodiment of the present application.
  • Figure 2A is a schematic diagram of point cloud images at different viewing angles provided by an embodiment of the present application.
  • Figure 2B is a schematic diagram of the data storage format corresponding to Figure 2A provided by an embodiment of the present application;
  • Figure 3 is a schematic diagram of a point cloud encoding and decoding network architecture provided by an embodiment of the present application
  • Figure 4 is a schematic structural diagram of a point cloud encoder provided by an embodiment of the present application.
  • Figure 5 is a schematic structural diagram of a point cloud decoder provided by an embodiment of the present application.
  • Figure 6 is a schematic flow chart of a decoding method provided by an embodiment of the present application.
  • Figure 7 is a detailed flow chart of a decoding method provided by an embodiment of the present application.
  • Figure 8 is a schematic flow chart of an encoding method provided by an embodiment of the present application.
  • Figure 9 is a detailed flow chart of an encoding method provided by an embodiment of the present application.
  • Figure 10 is a schematic structural diagram of an encoder provided by an embodiment of the present application.
  • Figure 11 is a schematic diagram of the specific hardware structure of an encoder provided by an embodiment of the present application.
  • Figure 12 is a schematic structural diagram of a decoder provided by an embodiment of the present application.
  • Figure 13 is a schematic diagram of the specific hardware structure of a decoder provided by an embodiment of the present application.
  • Figure 14 is a schematic structural diagram of a coding and decoding system provided by an embodiment of the present application.
  • first ⁇ second ⁇ third involved in the embodiments of this application are only used to distinguish similar objects and do not represent a specific ordering of objects. It is understandable that “first ⁇ second ⁇ The third "specific order or sequence may be interchanged where permitted, so that the embodiments of the application described herein can be implemented in an order other than that illustrated or described herein.
  • Point Cloud is a three-dimensional representation of the surface of an object.
  • collection equipment such as photoelectric radar, lidar, laser scanner, and multi-view camera, the point cloud (data) of the surface of the object can be collected.
  • Point cloud is a set of discrete points randomly distributed in space that expresses the spatial structure and surface properties of a three-dimensional object or scene.
  • Figure 1A shows a three-dimensional point cloud image
  • Figure 1B shows a partial enlargement of the three-dimensional point cloud image. It can be seen that the point cloud surface is composed of densely distributed points.
  • Two-dimensional images have information expressed in each pixel and are distributed regularly, so there is no need to record additional position information; however, the distribution of points in the point cloud in the three-dimensional space is random and irregular, so each point needs to be recorded Only the position of the point in space can completely express a point cloud.
  • each position in the collection process has corresponding attribute information, usually RGB color values, and the color values reflect the color of the object; for point clouds, the attribute information corresponding to each point is in addition to color information. , and the more common one is the reflectance value, which reflects the surface material of the object. Therefore, points in the point cloud can include point location information and point attribute information.
  • the position information of the point may be the three-dimensional coordinate information (x, y, z) of the point.
  • the position information of a point can also be called the geometric information of the point.
  • the attribute information of a point may include color information (three-dimensional color information) and/or reflectance (one-dimensional reflectance information r), and so on.
  • color information can be information on any color space.
  • the color information may be RGB information. Among them, R represents red (Red, R), G represents green (Green, G), and B represents blue (Blue, B).
  • the color information may be brightness and chrominance (YCbCr, YUV) information. Among them, Y represents brightness (Luma), Cb(U) represents blue color difference, and Cr(V) represents red color difference.
  • the points in the point cloud can include the three-dimensional coordinate information of the point and the reflectivity value of the point.
  • the points in the point cloud may include the three-dimensional coordinate information of the point and the three-dimensional color information of the point.
  • a point cloud is obtained by combining the principles of laser measurement and photogrammetry. The points in the point cloud may include the three-dimensional coordinate information of the point, the reflectivity value of the point, and the three-dimensional color information of the point.
  • Figure 2A and Figure 2B show a point cloud image and its corresponding data storage format.
  • Figure 2A provides six viewing angles of the point cloud image.
  • Figure 2B is composed of the file header information part and the data part.
  • the header information includes the data format, data representation type, total number of point cloud points, and the content represented by the point cloud. .
  • the point cloud is in ".ply" format and is represented by ASCII code.
  • the total number of points is 207242.
  • Each point has three-dimensional coordinate information (x, y, z) and three-dimensional color information (r, g, b).
  • Point clouds can be divided into:
  • Static point cloud that is, the object is stationary and the device that obtains the point cloud is also stationary;
  • Dynamic point cloud The object is moving, but the device that obtains the point cloud is stationary;
  • Dynamically acquire point clouds The device that acquires point clouds is in motion.
  • point clouds are divided into two categories according to their uses:
  • Category 1 Machine perception point cloud, which can be used in scenarios such as autonomous navigation systems, real-time inspection systems, geographic information systems, visual sorting robots, and rescue and disaster relief robots;
  • Category 2 Human eye perception point cloud, which can be used in point cloud application scenarios such as digital cultural heritage, free-viewpoint broadcasting, three-dimensional immersive communication, and three-dimensional immersive interaction.
  • Point clouds can flexibly and conveniently express the spatial structure and surface properties of three-dimensional objects or scenes, and because point clouds are obtained by directly sampling real objects, they can provide a strong sense of reality while ensuring accuracy, so they are widely used and their scope Including virtual reality games, computer-aided design, geographic information systems, automatic navigation systems, digital cultural heritage, free-viewpoint broadcasting, three-dimensional immersive telepresence, three-dimensional reconstruction of biological tissues and organs, etc.
  • Point cloud collection mainly has the following methods: computer generation, 3D laser scanning, 3D photogrammetry, etc.
  • Computers can generate point clouds of virtual three-dimensional objects and scenes; 3D laser scanning can obtain point clouds of static real-world three-dimensional objects or scenes, and can obtain millions of point clouds per second; 3D photogrammetry can obtain dynamic real-world three-dimensional objects or scenes Point clouds can obtain tens of millions of point clouds per second.
  • the number of points in each frame of the point cloud is 700,000, and each point has coordinate information xyz (float) and color information RGB (uchar)
  • the data volume of 1280 ⁇ 720 2D video at 24fps for 10s is about 1280 ⁇ 720 ⁇ 12bit ⁇ 24fps ⁇ 10s ⁇ 0.33GB
  • point cloud compression has become a key issue to promote the development of the point cloud industry.
  • the point cloud is a collection of massive points, storing the point cloud will not only consume a lot of memory, but is also not conducive to transmission. There is not such a large bandwidth to support the direct transmission of the point cloud at the network layer without compression. Therefore, , the point cloud needs to be compressed.
  • the point cloud coding framework that can compress point clouds can be the Geometry-based Point Cloud Compression (G-PCC) codec framework provided by the Moving Picture Experts Group (MPEG) Or the Video-based Point Cloud Compression (V-PCC) codec framework, or the AVS-PCC codec framework provided by AVS.
  • G-PCC Geometry-based Point Cloud Compression
  • MPEG Moving Picture Experts Group
  • V-PCC Video-based Point Cloud Compression
  • AVS-PCC codec framework provided by AVS.
  • the G-PCC encoding and decoding framework can be used to compress the first type of static point cloud and the third type of dynamic point cloud
  • the V-PCC encoding and decoding framework can be used to compress the second type of dynamic point cloud.
  • the G-PCC encoding and decoding framework is also called point cloud codec TMC13
  • the V-PCC encoding and decoding framework is also called point cloud codec TMC2.
  • FIG. 3 is a schematic diagram of the network architecture of a point cloud encoding and decoding system provided by an embodiment of the present application.
  • the network architecture includes one or more electronic devices 13 to 1N and a communication network 01 , wherein the electronic devices 13 to 1N can perform video interaction through the communication network 01 .
  • electronic devices may be various types of devices with point cloud encoding and decoding functions.
  • the electronic devices may include mobile phones, tablet computers, personal computers, personal digital assistants, navigators, digital phones, and video phones.
  • televisions, sensing equipment, servers, etc. are not limited by the embodiments of this application.
  • the decoder or encoder in the embodiment of the present application can be the above-mentioned electronic device.
  • the electronic device in the embodiment of the present application has a point cloud encoding and decoding function, and generally includes a point cloud encoder (ie, encoder) and a point cloud decoder (ie, decoder).
  • a point cloud encoder ie, encoder
  • a point cloud decoder ie, decoder
  • the following uses the AVS-PCC encoding and decoding framework as an example to illustrate the point cloud compression technology.
  • point cloud compression generally adopts the method of compressing point cloud geometric information and attribute information separately.
  • the point cloud geometric information is first encoded in the geometry encoder, and then the reconstructed geometric information is input into the attribute encoder as additional information.
  • the point cloud geometric information is first decoded in the geometry decoder, and then the decoded geometric information is input into the attribute decoder as additional information to assist in the compression of point cloud attributes.
  • the entire codec consists of pre-processing/post-processing, geometry encoding/decoding, and attribute encoding/decoding.
  • the embodiment of the present application provides a point cloud encoder.
  • Figure 4 shows the framework of the point cloud compression reference platform PCRM provided by AVS.
  • the point cloud encoder 11 includes a geometric encoder: a coordinate translation unit 111 and a coordinate quantization unit. 112. Octree construction unit 113, geometric entropy encoder 114, geometric reconstruction unit 115. Attribute encoder: attribute recoloring unit 116, color space transform unit 117, first attribute prediction unit 118, quantization unit 119 and attribute entropy encoder 1110.
  • the original geometric information is first preprocessed, the geometric origin is normalized to the minimum position in the point cloud space through the coordinate translation unit 111, and the geometric information is transferred from the float to the point cloud space through the coordinate quantization unit 112.
  • the points are converted into shapes to facilitate subsequent regularization processing; then the regularized geometric information is geometrically encoded, and the octree structure is used in the octree construction unit 113 to recursively divide the point cloud space, dividing the current point each time into eight sub-blocks of the same size, and determine the occupied codeword status of each sub-block.
  • the sub-block does not contain points, it is recorded as empty, otherwise it is recorded as non-empty.
  • the occupancy of all blocks is recorded at the last level of recursive division.
  • the codeword information is geometrically encoded; on the one hand, the geometric information expressed through the octree structure is input to the geometric entropy encoder 114 to form a geometric code stream; on the other hand, the geometric reconstruction process is performed in the geometric reconstruction unit 115. The reconstructed geometry The information is input to the attribute encoder as additional information.
  • the original attribute information is first preprocessed. Since the geometric information changes after the geometric encoding, the attribute value is reassigned to each point after the geometric encoding through the attribute recoloring unit 116 to realize the attribute Repaint.
  • the attribute information being processed is color information
  • the original color information needs to be transformed into a color space through the color space transformation unit 117 to convert it into a YUV color space that is more in line with the visual characteristics of the human eye; and then predicted through the first attribute Unit 118 performs attribute encoding on the preprocessed attribute information.
  • the point cloud needs to be reordered.
  • the reordering method is Morton code, so the traversal order of attribute encoding is Morton order.
  • the attribute prediction method in PCRM is a single point prediction based on Morton order, that is, going back one point from the current point to be encoded (current point) according to Morton order, and the node found is the prediction reference point of the current point to be encoded, and then The attribute reconstruction value of the prediction reference point is used as the attribute prediction value, and the attribute residual value is the difference between the attribute original value and the attribute prediction value of the current point to be encoded; finally, the attribute residual value is quantized through the quantization unit 119, and The quantized residual information is input to the attribute entropy encoder 1110 to form an attribute code stream.
  • the embodiment of the present application also provides a point cloud decoder.
  • Figure 5 shows the framework of the point cloud compression reference platform PCRM provided by AVS.
  • the point cloud decoder 12 includes a geometric decoder: a geometric entropy decoder 121, Octree reconstruction unit 122, coordinate inverse quantization unit 123, and coordinate inverse translation unit 124.
  • Attribute decoder attribute entropy decoder 125, inverse quantization unit 126, second attribute prediction unit 127 and color space inverse transform unit 128.
  • geometry and attributes are also decoded separately.
  • the geometry code stream is first entropy decoded through the geometric entropy decoder 121 to obtain the geometric information of each node, and then the octree structure is constructed through the octree reconstruction unit 122 in the same way as the geometry encoding, combined with
  • the decoded geometry reconstructs the geometric information expressed through the octree structure after coordinate transformation.
  • the information is coordinate inverse quantized through the coordinate inverse quantization unit 123 and inversely translated through the coordinate inverse translation unit 124 to obtain the decoded geometry information.
  • it is input to the attribute decoder as additional information.
  • the Morton order is constructed in the same way as the encoding end.
  • the attribute code stream is entropy decoded through the attribute entropy decoder 125 to obtain the quantized residual information; then inverse quantization is performed through the inverse quantization unit 126.
  • Obtain the attribute residual value similarly, in the same manner as attribute encoding, obtain the attribute prediction value of the current to-be-decoded point through the second attribute prediction unit 127, and then add the attribute prediction value and the attribute residual value to recover
  • the attribute reconstruction value of the current point to be decoded (for example, YUV attribute value); finally, the decoding attribute information is obtained through the inverse color space transformation of the color space inverse transformation unit 128 .
  • test conditions There are 4 types of test conditions:
  • Condition 1 The geometric position is limited and lossy, and the attributes are lossy;
  • Condition 3 The geometric position is lossless, and the attributes are limited and lossy
  • Condition 4 The geometric position is lossless and the attributes are lossless.
  • the universal test sequence includes five categories: Cat1A, Cat1B, Cat1C, Cat2-frame and Cat3. Among them, Cat1A and Cat2-frame point clouds only contain reflectance attribute information, Cat1B and Cat3 point clouds only contain color attribute information, and Cat1C point clouds contain both color and reflectance attribute information.
  • the points in the point cloud are processed in a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.).
  • the prediction algorithm is first used to obtain the attribute prediction value, and the attribute prediction value is obtained based on the attribute value and attribute prediction.
  • the attribute residuals are obtained from the values, and then the attribute residuals are quantized to generate quantized residuals, and finally the quantized residuals are encoded;
  • the points in the point cloud are processed in a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.).
  • the prediction algorithm is first used to obtain the attribute prediction value, and then the decoding is performed to obtain the quantized residual. , then perform inverse quantization on the quantized residual, and finally obtain the attribute reconstruction value based on the attribute prediction value and the inverse-quantized attribute residual.
  • Attribute compression uses methods based on intra-frame prediction and discrete cosine transform (Discrete Cosine Transform, DCT). At this time, there is a maximum number of points when encoding the quantized transform coefficients.
  • DCT discrete Cosine Transform
  • the points in the point cloud are processed in a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.), and the entire point cloud is first divided into parts with a maximum length of Y (for example, 2) Several small groups, and then combine these small groups into several large groups (the number of points in each large group does not exceed Difference, perform DCT transformation on the attribute residuals in small groups, generate transformation coefficients, then quantize the transformation coefficients, generate quantized transformation coefficients, and finally encode the quantized transformation coefficients in large groups;
  • Y for example, 2
  • the points in the point cloud are processed in a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.), and the entire point cloud is first divided into parts with a maximum length of Y (for example, 2) Several small groups, and then combine these small groups into several large groups (the number of points in each large group does not exceed The predicted value is then inversely quantized and inversely transformed on the quantized transformation coefficient in small groups. Finally, the attribute reconstruction value is obtained based on the attribute predicted value and the inversely quantized and inversely transformed coefficient.
  • a certain order for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.
  • Attribute compression uses methods based on intra-frame prediction and DCT transformation.
  • encoding the quantized transformation coefficients there is no limit to the maximum number of points X at this time, that is, all coefficients Coding together:
  • the points in the point cloud are processed in a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.), and the entire point cloud is first divided into parts with a maximum length of Y (for example, 2) Several groups are formed, and then the prediction algorithm is used to obtain the attribute prediction value, and the attribute residual is obtained based on the attribute value and the attribute prediction value.
  • the attribute residual is DCT transformed in groups as a unit to generate the transformation coefficient, and then the transformation coefficient is quantified to generate the quantization
  • the final transformation coefficients, and finally the quantized transformation coefficients of the entire point cloud are encoded;
  • the points in the point cloud are processed in a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.), and the entire point cloud is first divided into parts with a maximum length of Y (for example, 2) Several groups are formed, decode and obtain the quantized transformation coefficients of the entire point cloud, and then use the prediction algorithm to obtain the attribute prediction values. Then, the quantized transformation coefficients are inversely quantized and inversely transformed in groups as a unit, and finally the attribute prediction values and inverse transformations are performed. The coefficients after quantization and inverse transformation are used to obtain attribute reconstruction values.
  • a certain order for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.
  • multi-layer wavelet transform is performed on the entire point cloud to generate transform coefficients, then the transform coefficients are quantized, the quantized transform coefficients are generated, and finally the quantized transform coefficients of the entire point cloud are encoded;
  • decoding obtains the quantized transformation coefficients of the entire point cloud, and then performs inverse quantization and inverse transformation on the quantized transformation coefficients to obtain attribute reconstruction values.
  • the prediction branch processes the points in the point cloud according to a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.).
  • the embodiment of the present application provides a coding and decoding method.
  • the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point are determined; the absolute value of the initial quantized residual satisfies the first preset condition.
  • determine the quantized residual absolute value of the current point according to the parity characteristics of the symbol and the initial quantized residual absolute value, determine the quantized residual absolute value of the current point; encode the quantized residual absolute value, and write the resulting coded bits into the code stream.
  • the code stream is parsed to determine the absolute value of the quantized residual at the current point; when the absolute value of the quantized residual meets the first preset condition, the quantized value of the current point is determined based on the parity characteristics of the absolute value of the quantized residual.
  • the sign of the residual determine the attribute reconstruction value of the current point based on the absolute value and sign of the quantized residual.
  • the parity characteristics based on the absolute value of the quantized residual can hide some symbols of the values to be encoded, that is, there is no need to encode these symbols, so as to reduce the codewords used when encoding attribute information; while on the decoding side, The corresponding symbol can be directly determined based on the parity and even characteristics of the absolute value of the quantized residual obtained by decoding; thus, the use of codewords can be reduced, the encoding and decoding efficiency of point cloud attributes can be improved, and the encoding and decoding performance of point cloud attributes can be improved.
  • FIG. 6 shows a schematic flowchart of a decoding method provided by an embodiment of the present application. As shown in Figure 6, the method may include:
  • S601 Analyze the code stream and determine the absolute value of the quantized residual at the current point.
  • the decoding method described in the embodiment of the present application specifically refers to a point cloud decoding method, and more specifically a point cloud attribute decoding method based on symbol hiding, in order to further reduce the codewords used when encoding attribute information.
  • This method can be applied to point cloud decoders (also simply called “decoders").
  • the point cloud to be processed includes at least one point.
  • a point in the point cloud to be processed when decoding the point, it can be used as a point to be decoded in the point cloud to be processed, and there are multiple decoded points around the point.
  • the current point is the point to be decoded that currently needs to be decoded among the at least one point.
  • each point in the point cloud to be processed corresponds to a geometric information and an attribute information; wherein, the geometric information represents the spatial relationship of the point, and the attribute information represents the attribute information of the point. .
  • the attribute information may be a color component, or may be reflectance, refractive index, or other attributes, which are not specifically limited in the embodiments of this application.
  • the attribute information when it is a color component, it can specifically be color information in any color space.
  • the attribute information may be color information in the RGB space, color information in the YUV space, color information in the YCbCr space, etc., which are not specifically limited in the embodiments of the present application.
  • the color component may include at least one of the following: a first color component, a second color component, and a third color component.
  • a first color component a second color component
  • a third color component a third color component.
  • the color component conforms to the RGB color space, then it can be determined that the first color component, the second color component and the third color component are respectively one of them: R component, G component, B component; if the color component conforms to the YUV color space, Then it can be determined that the first color component, the second color component and the third color component are each one of them: Y component, U component, V component; if the color component conforms to the YCbCr color space, then it can be determined that the first color component, the second color component The color component and the third color component are each one of them: Y component, Cb component, Cr component.
  • the first color component may be the R component
  • the second color component may be the G component
  • the third color component may be the B component
  • the first color component may be the G component
  • the third color component may be the G component
  • the second color component may be the B component, and the third color component may be the R component; or, the first color component may be the B component, the second color component may be the G component, the third color component may be the R component, etc.
  • this application The examples are not specifically limited either.
  • the decoder can process each point in the point cloud to be processed according to a preset decoding order.
  • the preset decoding order may be: the original collection order of point clouds, Morton order or Hilbert order, etc., which is not specifically limited in the embodiments of this application.
  • the first preset condition may be a preset judgment standard for determining whether to hide the symbol corresponding to the current point. For example, whether the absolute value of the quantized residual satisfies the first preset condition may be determined based on a comparison result between the absolute value of the quantized residual and a preset threshold. Therefore, in some embodiments, the method may further include:
  • the absolute value of the quantized residual is greater than or equal to the preset threshold, it is determined that the absolute value of the quantized residual satisfies the first preset condition
  • the preset threshold here can also be regarded as a judgment criterion for determining whether to hide the symbol corresponding to the current point.
  • the preset threshold can be represented by signH, and the value of the preset threshold can be set to 4, 5, 6, 8, etc.
  • the value of the preset threshold is equal to 4, but this is not specifically limited.
  • determining the sign of the quantized residual based on the parity characteristics of the absolute value of the quantized residual may include:
  • the decoding end when the symbol of the quantized residual is determined to be hidden, can determine the symbol based on the parity characteristics of the absolute value of the quantized residual. For example, if the absolute value of the quantized residual is an odd number, then the sign can be determined to be a negative sign, that is, the signed quantized residual value is a negative odd number; and/or if the absolute value of the quantized residual is an even number, then the sign can be determined is a positive sign, that is, the signed quantized residual value is a positive even number.
  • determining the sign of the quantized residual at the current point based on the parity characteristics of the absolute value of the quantized residual may include:
  • the decoder when the symbol of the quantized residual is determined to be hidden, the decoder can still determine the symbol based on the parity characteristics of the absolute value of the quantized residual. For example, if the absolute value of the quantized residual is an odd number, then the sign can be determined to be positive, that is, the signed quantized residual value is a positive odd number; and/or if the absolute value of the quantized residual is an even number, then the sign can be determined is a negative sign, that is, the signed quantized residual value is a negative even number.
  • determining the parity characteristics of the absolute value of the quantized residual may include: calculating the parity characteristics of the absolute value of the quantized residual to obtain the parity value; if the parity value is equal to the third value, then The absolute value of the quantized residual is determined to be an odd number; and/or, if the odd-even value is equal to the fourth value, the absolute value of the quantized residual is determined to be an even number.
  • the value of the third value is equal to 1, and the value of the fourth value is equal to 0.
  • the absolute value of the quantized residual is represented by resQ
  • the parity value is represented by parity.
  • the signed quantized residual value is an odd number greater than zero, it means that the signed quantized residual value is a positive odd number; if the signed quantized residual value is greater than If it is an even number of zero, it means that the signed quantized residual value is a positive even number; if the signed quantized residual value is an odd number less than zero, it means that the signed quantized residual value is a negative odd number; if the signed quantized residual value is an odd number If the difference is an even number less than zero, it means that the signed quantized residual value is a negative even number.
  • the decoder can determine the sign of the quantized residual at the current point based on the parity characteristics of the absolute value of the quantized residual.
  • the method may also include: parsing the code stream when the absolute value of the quantized residual does not meet the first preset condition. , determine the sign of the quantized residual at the current point.
  • the preset threshold as an example, if the absolute value of the quantized residual is less than the preset threshold, that is, the absolute value of the quantized residual does not meet the first preset condition, it means that the symbol will be written into the code stream, so that the decoder can obtain the symbol of the quantized residual through decoding.
  • analyzing the code stream and determining the sign of the quantized residual at the current point may include:
  • the value of the symbol identification information is the first value, it is determined that the symbol is a positive sign
  • the value of the symbol identification information is the second value, it is determined that the symbol is a negative sign.
  • the first value may be 1 and the second value may be 0; or, the first value may be 0 and the second value may be 1, without any limitation here.
  • the encoding end writes the symbols into the code stream according to the value of the symbol identification information.
  • the decoding end can obtain the value of the symbol identification information by parsing the code stream; and then determine whether the symbol is a positive sign or a negative sign based on the value of the symbol identification information. For example, assuming that the first value is 1 and the second value is 0, then when the value of the symbol identification information obtained by decoding is 1, it can be determined that the symbol is a positive sign; when the value of the symbol identification information obtained by decoding is When 0, the sign can be determined to be negative.
  • S603 Determine the attribute reconstruction value of the current point based on the absolute value and sign of the quantized residual.
  • the method may also include: predicting the attribute information of the current point and determining the attribute prediction value of the current point.
  • a prediction algorithm is used to perform prediction processing on the attribute information of the current point, and the attribute prediction value of the current point can be obtained, which is represented by A j ′.
  • j indicates that the jth point in the point cloud to be processed is the current point
  • the prediction algorithm can also include an intra-frame prediction algorithm and an inter-frame prediction algorithm.
  • determining the attribute reconstruction value of the current point based on the absolute value and sign of the quantized residual may include:
  • the attribute reconstruction value of the current point is determined.
  • the absolute value of the quantized residual needs to be inversely quantized first to obtain the decoded residual value, which can be represented by InvQ (resQ); then the signed decoding is determined based on the decoded residual value and symbol.
  • the residual value can be represented by sign*InvQ(resQ); in this way, based on the attribute prediction value and the signed decoded residual value, the attribute reconstruction value of the current point can be determined. You can use express.
  • determining the attribute reconstruction value of the current point based on the attribute prediction value and the signed decoding residual value may include: performing an addition operation on the attribute prediction value and the signed decoding residual value. , get the attribute reconstruction value of the current point.
  • the attribute reconstruction value of the current point can be obtained.
  • the calculation formula is as follows,
  • the color component may include at least one of the following: a first color component, a second color component, and a third color component. Since there is a correlation between different color components, for the color components, the cross-component attribute prediction value can also be included, represented by residualPrevComponent. Therefore, in some embodiments, the method may further include: when the attribute information is a color component, determining a cross-component attribute prediction value of the current point.
  • attribute information is reflectivity, refractive index, etc.
  • the reflectance does not include multiple components
  • the refractive index does not include multiple components
  • determining the attribute reconstruction value of the current point based on the attribute prediction value and the signed decoding residual value may include: , the signed decoding residual value and the cross-component attribute prediction value are added to obtain the attribute reconstruction value of the current point.
  • the attribute reconstruction value of the current point can be obtained.
  • the calculation formula is as follows,
  • the parity characteristics according to the absolute value of the quantized residual can be introduced to hide part of the symbols to be encoded; so that at the decoding end, part of the symbols to be encoded are The encoded symbols do not need to be decoded from the code stream, thus reducing the use of code words.
  • Embodiments of the present application provide a decoding method that determines the absolute value of the quantized residual at the current point by parsing the code stream; when the absolute value of the quantized residual satisfies the first preset condition, the absolute value of the quantized residual is determined based on the parity of the absolute value of the quantized residual. Characteristics, determine the sign of the quantized residual of the current point; determine the attribute reconstruction value of the current point based on the absolute value and sign of the quantized residual.
  • the corresponding symbol can be directly determined based on the parity characteristics of the decoded absolute value of the quantized residual; thus, the use of codewords can be reduced and the encoding of point cloud attributes can be improved. Decoding efficiency, while improving the encoding and decoding performance of point cloud attributes.
  • FIG. 7 shows a detailed flowchart of a decoding method provided by the embodiment of the present application.
  • the detailed process may include:
  • S701 Analyze the code stream and determine the absolute value of the quantized residual at the current point.
  • S703 Analyze the code stream and determine the sign of the quantized residual at the current point.
  • S705 Perform inverse quantization processing on the absolute value of the quantized residual to obtain a decoded residual value; and determine a signed decoded residual value based on the decoded residual value and sign.
  • S706 Determine the attribute prediction value of the current point, and determine the attribute reconstruction value of the current point based on the attribute prediction value and the signed decoding residual value.
  • S704 after comparing the absolute value of the quantized residual with the preset threshold, if the absolute value of the quantized residual is greater than or equal to the preset threshold, then S704 needs to be executed,
  • the sign is determined according to the odd and even characteristics of the absolute value of the quantized residual. For example, if the absolute value of the quantized residual is an odd number, the sign is negative; if the absolute value of the quantized residual is an even number, the sign is positive; otherwise, if If the absolute value of the quantized residual is less than the preset threshold, then S703 needs to be executed.
  • the symbol is decoded from the code stream. For example, if the value of the symbol is the first value, it is determined that the symbol is a positive sign; if the value of the symbol is If the value is the second value, the sign is determined to be negative.
  • the decoding process shown in Figure 7 needs to be executed once for the first color component, the second color component and the third color component respectively, and after determining the current point
  • the attribute prediction value, the signed decoding residual value and the cross-component attribute prediction value are added to obtain the attributes of the current point.
  • Rebuild value for attribute information such as reflectivity or refractive index
  • the decoding process shown in Figure 7 is only executed once, and there is no need to obtain additional cross-component attribute prediction values.
  • the attribute prediction value and signed The decoded residual values are added to obtain the attribute reconstruction value of the current point.
  • the decoder first, if the attribute information is a color component, the following steps are performed once for the three color components; if the attribute information is reflectance, the following steps are performed once for the reflectance. .
  • the specific process is as follows:
  • Table 1 shows a test result under the C1 test condition provided by the embodiment of the present application.
  • the C1 test condition is limited-lossy geometry, lossy attributes (limit-lossy geometry, lossy attributes);
  • the general test sequence is Cat1A and Cat1C;
  • End-to-End BD-AttrRate indicates that the end-to-end attribute value is based on the attribute code Streaming BD-Rate.
  • BD-Rate reflects the difference in the Peak Signal to Noise Ratio (PSNR) curves obtained in two situations (with or without using the technical solution of the embodiment of the present application).
  • PSNR Peak Signal to Noise Ratio
  • this technical solution provides a point cloud attribute encoding and decoding method based on symbol hiding.
  • the codewords required to encode attribute information can introduce symbols that hide part of the value to be encoded based on parity, so that the decoder can determine the corresponding symbol based on the parity characteristics of the absolute value of the quantized residual obtained by decoding; thus reducing codewords Use to improve the encoding and decoding efficiency of point cloud attributes and improve the encoding and decoding performance of point cloud attributes.
  • FIG. 8 shows a schematic flowchart of an encoding method provided by an embodiment of the present application. As shown in Figure 8, the method may include:
  • S801 Determine the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point.
  • the encoding method described in the embodiment of the present application specifically refers to a point cloud encoding method, and more specifically, a point cloud attribute encoding method based on symbol hiding, in order to further reduce the number of codewords used when encoding attribute information.
  • This method can be applied to point cloud encoders (also simply called “encoders").
  • the point cloud to be processed includes at least one point.
  • a point in the point cloud to be processed when encoding the point, it can be used as a point to be encoded in the point cloud to be processed, and there are multiple encoded points around the point.
  • the current point is the point to be encoded that currently needs to be encoded among the at least one point.
  • each point in the point cloud to be processed corresponds to a geometric information and an attribute information; wherein, the geometric information represents the spatial relationship of the point, and the attribute information represents the attribute information of the point. .
  • the attribute information may be a color component, or may be reflectance, refractive index, or other attributes, which are not specifically limited in the embodiments of this application.
  • the attribute information when it is a color component, it can specifically be color information in any color space.
  • the attribute information may be color information in RGB space, color information in YUV space, color information in YCbCr space, etc., which are not specifically limited in the embodiments of the present application.
  • the color component may include at least one of the following: a first color component, a second color component, and a third color component.
  • a first color component a second color component
  • a third color component a third color component.
  • the color component conforms to the RGB color space, then it can be determined that the first color component, the second color component and the third color component are respectively one of them: R component, G component, B component; if the color component conforms to the YUV color space, Then it can be determined that the first color component, the second color component and the third color component are each one of them: Y component, U component, V component; if the color component conforms to the YCbCr color space, then it can be determined that the first color component, the second color component The color component and the third color component are each one of them: Y component, Cb component, Cr component.
  • the first color component may be the R component
  • the second color component may be the G component
  • the third color component may be the B component
  • the first color component may be the G component
  • the third color component may be the G component
  • the second color component may be the B component, and the third color component may be the R component; or, the first color component may be the B component, the second color component may be the G component, the third color component may be the R component, etc.
  • this application The examples are not specifically limited either.
  • the decoder can process each point in the point cloud to be processed according to a preset encoding order.
  • the preset coding order may be: the original collection order of point clouds, Morton order, Hilbert order, etc., which is not specifically limited in the embodiments of this application.
  • the attribute value ie, the original value
  • the symbol of the current point can be determined. Specifically, if the attribute value is greater than zero, then the sign can be stated to be positive; otherwise, if the attribute value is less than zero, then the sign can be stated to be negative. It should be noted that the attribute values here carry positive and negative signs.
  • determining the initial quantized residual absolute value of the current point may include:
  • a prediction algorithm is used to perform prediction processing on the attribute information of the current point, and the attribute prediction value of the current point can be obtained, which is represented by A j ′.
  • j indicates that the jth point in the point cloud to be processed is the current point
  • the prediction algorithm can also include an intra-frame prediction algorithm and an inter-frame prediction algorithm.
  • the attribute value of the current point is represented by A j
  • the attribute residual value of the current point is represented by res. Then for the determination of res, for example, the calculation formula is as follows,
  • the attribute residual value can be quantized and the absolute value can be obtained to obtain the initial quantized residual absolute value, which can be expressed by resQ.
  • the first preset condition may be a preset judgment standard for determining whether to hide the symbol corresponding to the current point. For example, whether the initial quantized residual absolute value satisfies the first preset condition may be determined based on a comparison result between the initial quantized residual absolute value and a preset threshold. Therefore, in some embodiments, the method may further include:
  • the preset threshold here can also be regarded as a judgment criterion for determining whether to hide the symbol corresponding to the current point.
  • the preset threshold can be represented by signH, and the value of the preset threshold can be set to 4, 5, 6, 8, etc.
  • the value of the preset threshold is equal to 4, but this is not specifically limited.
  • the method may further include:
  • the value of the symbol hidden identification information is set to the first value
  • the value of the symbol hidden identification information is set to the second value.
  • the first value may be 1 and the second value may be 0; or the first value may be 0 and the second value may be 1; or the first value may be true and the second value may be is false; or, the first value can be false, and the second value can be true; there is no specific limitation in the embodiment of this application.
  • the value of the symbol hiding identification information may be used to indicate whether the current point hides the symbol of the initial quantized residual. For example, assuming that the first value is true and the second value is false, then if the absolute value of the initial quantization residual is greater than or equal to the preset threshold, it means that the symbol needs to be hidden. At this time, the value of the symbol hiding identification information can be set. is true; if the absolute value of the initial quantization residual is less than the preset threshold, it means that there is no need to hide the symbol. At this time, the value of the symbol hidden identification information can be set to false.
  • the method may further include: when the value of the symbol hidden identification information is the first value, determining the parity characteristics of the absolute value of the initial quantization residual.
  • determining the parity characteristics of the absolute value of the initial quantized residual may include:
  • parity value is equal to the third value, it is determined that the absolute value of the initial quantization residual is an odd number
  • parity value is equal to the fourth value, it is determined that the absolute value of the initial quantization residual is an even number.
  • the third value is equal to 1, and the fourth value is equal to 0.
  • parity the parity value of the absolute value of the initial quantized residual.
  • determining the quantized residual absolute value of the current point according to the sign and the parity characteristics of the initial quantized residual absolute value may include :
  • the signed initial quantized residual satisfies the second preset condition, then determine the absolute value of the initial quantized residual as the absolute value of the quantized residual at the current point;
  • the absolute value of the quantized residual at the current point is determined based on the initial quantized residual absolute value and the preset constant value.
  • the signed initial quantized residual after obtaining the signed initial quantized residual, it is determined whether the signed initial quantized residual satisfies the second preset condition, for example, whether the signed initial quantized residual is negative. Odd numbers, positive even numbers, etc. If the signed initial quantized residual meets the second preset condition, then the absolute value of the initial quantized residual is the absolute value of the quantized residual at the current point.
  • the parity and even characteristics of the absolute value of the quantized residual it can Determine the sign; and/or, if the signed initial quantized residual does not meet the second preset condition, then the absolute value of the initial quantized residual needs to be calculated to determine the absolute value of the quantized residual at the current point, and then according to the quantized The sign can be determined by the odd-even characteristic of the absolute value of the residual.
  • determining whether the signed initial quantized residual satisfies the second preset condition based on the sign and the parity characteristics of the absolute value of the initial quantized residual may include:
  • the signed initial quantized residual is obtained
  • the signed initial quantized residual is an even number greater than zero or an odd number less than zero, it is determined that the signed initial quantized residual satisfies the second preset condition; and/or,
  • the signed initial quantized residual is an odd number greater than zero or an even number smaller than zero, it is determined that the signed initial quantized residual does not satisfy the second preset condition.
  • determining whether the signed initial quantized residual satisfies the second preset condition based on the sign and the parity characteristics of the absolute value of the initial quantized residual may include:
  • the signed initial quantized residual is obtained
  • the signed initial quantized residual is an odd number greater than zero or an even number less than zero, it is determined that the signed initial quantized residual satisfies the second preset condition; and/or,
  • the signed initial quantized residual is an even number greater than zero or an odd number smaller than zero, it is determined that the signed initial quantized residual does not satisfy the second preset condition.
  • the signed initial quantized residual is first determined at this time; then, if the signed initial quantized residual is a positive odd number (an odd number greater than zero) or a negative even number (an odd number less than zero) even), then it can be determined that the signed initial quantized residual satisfies the second preset condition.
  • the symbol does not need to be written into the code stream; for the decoder, if the absolute value of the quantized residual obtained by decoding is an even number, then the symbol can be determined to be a negative sign; if the absolute value of the quantized residual obtained by decoding is an odd number , then the sign can be determined to be positive.
  • the method may also include:
  • the signed initial quantized residual is determined to be an odd number greater than zero
  • the signed initial quantized residual is determined to be an odd number less than zero
  • the signed initial quantized residual is determined to be an even number greater than zero
  • the signed initial quantized residual is determined to be an even number less than zero.
  • the signed initial quantized residual is an odd number greater than zero, which can also be called a positive odd number.
  • the signed initial quantization residual is an odd number less than zero, which can also be called a negative odd number; If the sign is negative, and the absolute value of the initial quantization residual is an odd number, then it can be determined that the signed initial quantization residual is an odd number less than zero, which can also be called a negative odd number; if the sign is positive, and the initial quantization If the absolute value of the residual is an even number, then it can be determined that the signed initial quantized residual is an even number greater than zero, which can also be called a positive even number; if the sign is negative, and the absolute value of the initial quantized residual is an even number, then it can be determined The signed initial quantized residual is an even number less than zero, which can also be called a negative even number.
  • the current point is determined based on the absolute value of the initial quantized residual and the preset constant value.
  • the absolute value of the quantized residual can include:
  • the quantized residual absolute value of the current point is determined.
  • the value of the preset constant value may be 1, but it may also be other values, and is not specifically limited here.
  • the absolute value of the initial quantized residual and the preset constant value need to be calculated, for example, plus one calculation. , minus one calculation and so on.
  • two candidate values can be obtained: the first candidate quantization residual absolute value and the second candidate quantization residual absolute value.
  • the former can be calculated by adding one to the absolute value of the initial quantized residual, represented by resQ + ; the latter can be calculated by subtracting one from the absolute value of the initial quantized residual, represented by resQ - .
  • the absolute value of the quantized residual at the current point is then determined from resQ + and resQ- by performing a distortion cost calculation.
  • determining the absolute value of the quantized residual at the current point based on the first candidate quantized residual absolute value and the second candidate quantized residual absolute value may include:
  • the quantization residual absolute value of the current point is determined from the first candidate quantization residual absolute value and the second candidate quantization residual absolute value.
  • determining the first candidate attribute reconstruction value based on the first candidate quantized residual absolute value, sign and attribute prediction value may include:
  • the signed first candidate reconstruction residual is obtained
  • the first candidate attribute reconstruction value is obtained by adding the signed first candidate reconstruction residual and the attribute prediction value.
  • the first candidate quantized residual absolute value needs to be inversely quantized first to obtain the first candidate reconstructed residual absolute value, represented by InvQ(resQ + ); then according to the sign and the first candidate reconstructed residual absolute value value, at this time the signed first candidate reconstruction residual can be represented by sign*InvQ(resQ + ); finally, by adding the signed first candidate reconstruction residual and the attribute prediction value, the first candidate attribute can be obtained Rebuild value.
  • the calculation formula is as follows:
  • determining the second candidate attribute reconstruction value based on the second candidate quantized residual absolute value, sign, and attribute prediction value may include:
  • the signed second candidate reconstruction residual is obtained
  • An addition operation is performed on the signed second candidate reconstruction residual and the attribute prediction value to obtain the second candidate attribute reconstruction value.
  • the second candidate reconstruction residual On the encoding side, it is first necessary to perform inverse quantization processing on the absolute value of the second candidate quantization residual to obtain the absolute value of the second candidate reconstruction residual, represented by InvQ (resQ - ); then according to the sign and the second candidate reconstruction residual Absolute value, at this time, the signed second candidate reconstruction residual can be represented by sign*InvQ(resQ - ); finally, by adding the signed second candidate reconstruction residual and the attribute prediction value, the second candidate can be obtained Property reconstruction value.
  • the calculation formula is as follows:
  • the attribute information is a color component
  • the color component includes at least one of the following: a first color component, a second color component, and a third color component; since there is an association between different color components, then for the color component
  • cross-component attribute prediction values can also be included here, represented by residualPrevComponent. Therefore, in some embodiments, the method may further include: when the attribute information is a color component, determining a cross-component attribute prediction value of the current point.
  • attribute information is reflectivity, refractive index, etc.
  • the reflectance does not include multiple components
  • the refractive index does not include multiple components
  • performing residual calculation based on the attribute value and attribute predicted value to determine the attribute residual value of the current point may include: performing residual calculation based on the attribute value, attribute predicted value and cross-component attribute predicted value. Difference calculation to determine the attribute residual value of the current point.
  • the attribute value of the current point is represented by A j
  • the attribute prediction value of the current point is represented by A j ′
  • the cross-component attribute prediction value of the current point is represented by residualPrevComponent
  • the attribute residual value of the current point is still represented by res represents, then for the determination of res, for example, the calculation formula is as follows,
  • the attribute residual value can be quantized and the absolute value can be obtained, thereby obtaining the initial quantized residual absolute value; the initial quantized residual absolute value can be calculated by adding one and subtracting one. , the first candidate quantization residual absolute value (resQ + ) and the second candidate quantization residual absolute value (resQ - ) can be obtained.
  • determining the first candidate attribute reconstruction value based on the first candidate quantized residual absolute value, sign and attribute prediction value may include:
  • the signed first candidate reconstruction residual is obtained
  • the first candidate attribute reconstruction value is obtained by adding the signed first candidate reconstruction residual, the attribute prediction value, and the cross-component attribute prediction value.
  • the first candidate quantized residual absolute value needs to be inversely quantized first to obtain the first candidate reconstructed residual absolute value, represented by InvQ(resQ + ); then according to the sign and the first candidate reconstructed residual absolute value value, at this time the signed first candidate reconstruction residual can be represented by sign*InvQ(resQ + ); finally, by adding the signed first candidate reconstruction residual, attribute prediction value and cross-component attribute prediction value,
  • the first candidate attribute reconstruction value can be obtained.
  • the calculation formula is as follows:
  • determining the second candidate attribute reconstruction value based on the second candidate quantized residual absolute value, sign, and attribute prediction value may include:
  • the signed second candidate reconstruction residual is obtained
  • the second candidate attribute reconstruction value is obtained by adding the signed second candidate reconstruction residual, the attribute prediction value, and the cross-component attribute prediction value.
  • the second candidate reconstruction residual On the encoding side, it is first necessary to perform inverse quantization processing on the absolute value of the second candidate quantization residual to obtain the absolute value of the second candidate reconstruction residual, represented by InvQ (resQ - ); then according to the sign and the second candidate reconstruction residual Absolute value.
  • the signed second candidate reconstruction residual can be represented by sign*InvQ(resQ - ); finally, the signed second candidate reconstruction residual, attribute prediction value and cross-component attribute prediction value are added.
  • the second candidate attribute reconstruction value can be obtained.
  • the calculation formula is as follows:
  • the first-generation value and the second-generation value corresponding to these two candidate values can be calculated; then based on the first-generation value and the second-generation value , the final absolute value of the quantized residual is determined from resQ + and resQ - .
  • calculating the distortion cost of the first candidate attribute reconstruction value and the attribute value to obtain the first generation value may include: reconstructing the value according to the first candidate attribute Calculate the absolute value of the difference with the attribute value to obtain the first absolute value of the difference, and use the first absolute value of the difference as the first generation value.
  • calculating the distortion cost of the second candidate attribute reconstruction value and the attribute value to obtain the second generation value may include: calculating the absolute value of the difference based on the second candidate attribute reconstruction value and the attribute value. Calculate and obtain the absolute value of the second difference, and use the absolute value of the second difference as the second generation value.
  • the first-generation value can be expressed as cost +
  • the second-generation value can be expressed as cost - .
  • the calculation formula for the first-generation value can be as follows,
  • the calculation formula for the second generation value can be as follows,
  • abs(x) represents the absolute value of x.
  • calculating the distortion cost on the first candidate attribute reconstruction value and the attribute value to obtain the first generation value may include:
  • the first generation value is obtained by adding the first difference absolute value and the first candidate quantized residual absolute value.
  • the calculation of the distortion cost of the second candidate attribute reconstruction value and the attribute value to obtain the second generation value may include:
  • the second difference absolute value and the second candidate quantized residual absolute value are added to obtain the second generation value.
  • the first-generation value can be expressed as cost +
  • the second-generation value can be expressed as cost -
  • the calculation formula for the first generation value can also be as follows,
  • the calculation formula for the second generation value can also be as follows,
  • abs(x) represents the absolute value of x.
  • calculating the distortion cost on the first candidate attribute reconstruction value and the attribute value to obtain the first-generation value may include:
  • the first generation value is obtained by performing a weighted sum operation on the absolute value of the first difference and the absolute value of the first candidate quantization residual according to the first factor and the second factor.
  • the calculation of the distortion cost of the second candidate attribute reconstruction value and the attribute value to obtain the second generation value may include:
  • a weighted sum operation is performed on the absolute value of the second difference and the absolute value of the second candidate quantization residual according to the third factor and the fourth factor to obtain the second generation value.
  • the first factor can be expressed as ⁇ 1, the second factor can be expressed as ⁇ 1; the third factor can be expressed as ⁇ 2, and the fourth factor can be expressed as ⁇ 2.
  • the first-generation value can be expressed by cost +
  • the second-generation value can be expressed by cost - .
  • the calculation formula for the second generation value can also be as follows,
  • abs(x) represents the absolute value of x.
  • the method may further include: determining the absolute value of the first candidate quantization residual as the first-generation value.
  • the method may further include: determining the absolute value of the second candidate quantization residual as the second generation value.
  • the first generation value can be directly determined based on the absolute value of the first candidate quantization residual.
  • the distortion cost formula can also be as follows:
  • the value can be determined directly based on the absolute value of the second candidate quantization residual.
  • the distortion cost formula can also be as follows:
  • the calculation of the distortion cost may be to calculate the distortion cost between the candidate attribute reconstruction value and the original attribute value, or it may be to perform rate distortion on the candidate attribute reconstruction value and the original attribute value.
  • the cost calculation can either use the weighted sum of the candidate attribute reconstruction value and the original attribute value to calculate the distortion cost, or it can use resQ + and resQ - to calculate the distortion cost, or even other distortion cost methods, which are not discussed here.
  • the candidate attribute reconstruction value may be the first candidate attribute reconstruction value or the second candidate attribute reconstruction value.
  • the absolute value of the quantized residual at the current point can be determined based on the size of the cost value, and then the decoding end can The symbol is determined based on the parity characteristics of the absolute value of the quantized residual obtained by decoding.
  • determining the absolute value of the quantized residual at the current point from the first candidate quantized residual absolute value and the second candidate quantized residual absolute value according to the first generation value and the second generation value may include :
  • the second candidate quantized residual absolute value is determined as the quantized residual of the current point. absolute value
  • the first candidate quantization residual absolute value is determined as the quantization of the current point. The absolute value of the residual.
  • the third preset condition and the fourth preset condition are used to determine whether the absolute value of the quantized residual at the current point is set to the first candidate absolute value of the quantized residual or to the third candidate.
  • the absolute value of the two candidate quantized residuals may also include:
  • the second-generation value is greater than the first-generation value, it is determined that the first-generation value and the second-generation value do not meet the third preset condition.
  • whether the first-generation value and the second-generation value meet the third preset condition can be determined based on the comparison between the second-generation value and the first-generation value. For example, if the second generation value is less than or equal to the first generation value, then it can be determined that the first generation value and the second generation value meet the third preset condition; otherwise, if the second generation value is greater than the first generation value, then It can be determined that the first-generation value and the second-generation value do not satisfy the third preset condition.
  • the embodiments of this application will not specifically limit it.
  • the method may further include:
  • whether the second candidate quantization residual absolute value satisfies the fourth preset condition can be determined based on the comparison result of the second candidate quantization residual absolute value and the preset threshold. For example, if the absolute value of the second candidate quantization residual is greater than or equal to the preset threshold, it may be determined that the second candidate quantization residual absolute value satisfies the fourth preset condition; otherwise, if the second candidate quantization residual absolute value is less than If the threshold is preset, then it can be determined that the absolute value of the second candidate quantization residual does not satisfy the fourth preset condition.
  • the embodiment of this application does not specifically limit it.
  • determining the absolute value of the quantization residual at the current point from the first candidate quantization residual absolute value and the second candidate quantization residual absolute value may include:
  • the second candidate quantized residual absolute value is determined as the quantized residual absolute value of the current point
  • the first candidate quantized residual absolute value is determined as the quantized residual absolute value of the current point.
  • the first-generation value is represented by cost +
  • the second-generation value is represented by cost -
  • the absolute value of the second candidate quantized residual is represented by resQ -
  • the preset threshold is represented by signH.
  • cost - ⁇ cost + and resQ - ⁇ signH then the absolute value of the quantized residual can be set to resQ - , that is, the absolute value of the initial quantized residual is reduced by one; otherwise, if cost - > cost + or resQ - ⁇ signH , then the absolute value of the quantized residual can be set to resQ + , that is, the absolute value of the initial quantized residual plus one.
  • the cross-component attribute prediction value also needs to be considered in order to determine the new attribute residual value and the corresponding quantized residual absolute value.
  • the symbol when the absolute value of the initial quantized residual meets the first preset condition, it is determined that the symbol needs to be hidden; at this time, it is only necessary to encode the absolute value of the quantized residual at the current point and write the resulting coded bits. Input code stream. Subsequently, at the decoding end, after decoding to obtain the absolute value of the quantized residual, if the absolute value of the quantized residual satisfies the first preset condition, the symbol can be determined based on the parity characteristics of the absolute value of the quantized residual.
  • the method may further include:
  • the absolute value of the initial quantized residual is used as the absolute value of the quantized residual at the current point;
  • determining the value of symbol identification information may include:
  • the sign is a negative sign, it is determined that the value of the sign identification information is the second value.
  • the first value may be 1 and the second value may be 0; or, the first value may be 0 and the second value may be 1, which are not specifically limited here.
  • the encoding end can write the value of the symbol identification information into the code stream, so that the decoding end can parse the code stream. Determine whether the sign is positive or negative. For example, if 1 is used to represent that the symbol is positive and 0 is used to represent that the symbol is negative, then if the symbol is positive, the value of the symbol identification information can be set to 1; and/or, if the symbol is negative number, you can set the value of the symbol identification information to 0.
  • the absolute value of the initial quantization residual at the current point can be compared with the preset threshold, and then some hidden parts to be hidden according to the parity characteristics can be introduced. Encoded symbols; so that at the decoding end, some of the symbols to be encoded do not need to be decoded from the code stream, thereby reducing the use of codewords.
  • the embodiment of the present application provides a coding method by determining the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point; when the absolute value of the initial quantized residual satisfies the first preset condition, According to the parity characteristics of the symbol and the initial quantized residual absolute value, the quantized residual absolute value of the current point is determined; the quantized residual absolute value is encoded, and the resulting coded bits are written into the code stream.
  • the parity characteristics based on the absolute value of the quantized residual can hide the symbols of some of the values to be encoded, that is, there is no need to encode these symbols, so as to reduce the number of code words used when encoding attribute information; thus, the number of code words can be reduced Use to improve the encoding and decoding efficiency of point cloud attributes and improve the encoding and decoding performance of point cloud attributes.
  • FIG. 9 shows a detailed flowchart of an encoding method provided by the embodiment of the present application.
  • the detailed process may include:
  • S901 Determine the attribute prediction value of the current point.
  • S902 Determine the attribute residual value of the current point based on the attribute value and attribute prediction value of the current point.
  • S903 Quantify the attribute residual value and calculate the absolute value to obtain the initial quantized residual absolute value of the current point.
  • S904 Compare the absolute value of the initial quantization residual with the preset threshold.
  • S905 If the signed initial quantization residual does not meet the second preset condition, obtain two candidate values: the first candidate quantization residual absolute value and the second candidate quantization residual absolute value; where, the first candidate quantization residual absolute value The absolute value of the residual is calculated by adding one based on the absolute value of the initial quantized residual, and the absolute value of the second candidate quantized residual is calculated by subtracting one based on the absolute value of the initial quantized residual.
  • S906 Perform inverse quantization processing on the absolute value of the first candidate quantized residual and the absolute value of the second candidate quantized residual respectively, and determine the signed first candidate reconstruction residual and the signed second candidate reconstruction residual; and according to the band
  • the first candidate attribute reconstruction value is determined based on the signed first candidate reconstruction residual and the attribute prediction value
  • the second candidate attribute reconstruction value is determined based on the signed second candidate reconstruction residual and the attribute prediction value.
  • S907 Determine the first generation value corresponding to the first candidate attribute reconstruction value and the second generation value corresponding to the second candidate attribute reconstruction value based on the distortion cost method; based on the first generation value and the second generation value, quantify the residual value from the first candidate
  • the quantized residual absolute value of the current point is determined from the difference absolute value and the second candidate quantized residual absolute value.
  • S909 Encode the absolute value of the quantization residual, and write the resulting encoded bits into the code stream.
  • S910 Use the initial quantized residual absolute value as the quantized residual absolute value of the current point, encode the value of the symbol identification information and the quantized residual absolute value, and write the resulting coded bits into the code stream.
  • the signed initial quantized residual when the absolute value of the initial quantized residual is greater than or equal to the preset threshold, if the signed initial quantized residual does not meet the second preset condition (for example, signed The initial quantized residual is a positive odd number or a negative even number), then S905 to S909 can be executed; if the signed initial quantized residual meets the second preset condition (for example, the signed initial quantized residual is a negative odd number or a positive even number) ), then only S909 needs to be executed.
  • the absolute value of the quantized residual obtained by decoding is an odd number, the sign is negative; if the absolute value of the quantized residual obtained by decoding is an even number, the sign is positive.
  • the absolute value of the initial quantized residual is greater than or equal to the preset threshold
  • the signed initial quantized residual does not satisfy the second preset condition (for example, the signed initial quantized residual is a negative odd number or a positive even number )
  • S905 to S909 can also be executed; if the signed initial quantized residual meets the second preset condition (for example, the signed initial quantized residual is a positive odd number or a negative even number), then only S909 needs to be executed at this time .
  • the absolute value of the quantized residual obtained by decoding is an odd number, the sign is positive; if the absolute value of the quantized residual obtained by decoding is an even number, the sign is negative.
  • the encoding end may also be provided with symbolic hidden identification information.
  • the symbol hiding identification information can be set to true, but the value of the symbol hiding identification information does not need to be written into the code stream.
  • the distortion cost may be calculated between the candidate attribute reconstruction value and the original attribute value, or the candidate attribute reconstruction value and the original attribute value may be calculated based on the ratio.
  • Distortion cost calculation can either use the weighted sum of the candidate attribute reconstruction value and the original attribute value to calculate the distortion cost, or can use resQ + and resQ - to calculate the distortion cost, or even other distortion cost methods, which are not mentioned here. No specific limitation is made.
  • the candidate attribute reconstruction value may be the first candidate attribute reconstruction value or the second candidate attribute reconstruction value.
  • the encoding process shown in Figure 9 needs to be executed once for the first color component, the second color component and the third color component, and after determining the current point
  • additional cross-component attribute prediction values need to be obtained.
  • attribute information such as reflectivity or refractive index
  • the encoding process shown in Figure 9 is only executed once, and there is no need to obtain additional cross-component attribute prediction values.
  • the attribute information is a color component
  • the following steps are performed once for the three color components
  • the attribute information is reflectance
  • the following steps are performed once for the reflectance.
  • the attribute residual res can be obtained, as follows:
  • step e Compare the absolute value of the initial quantized residual with the preset threshold (represented by signH, for example, it can be set to 4). If the absolute value of the initial quantized residual is greater than or equal to the preset threshold, perform step e), otherwise perform step e).
  • the preset threshold represented by signH, for example, it can be set to 4.
  • step 4 If the signed initial quantized residual is a positive odd number or a negative even number, then perform step 4), otherwise jump to step f);
  • the absolute value of the quantized residual at the current point can be set to the absolute value of the initial quantized residual minus one, otherwise the absolute value of the quantized residual at the current point can be set to the initial quantized Add one to the absolute value of the residual (it should be noted that for the color component, the cross-component attribute prediction value needs to be considered), and then perform step f);
  • the signed quantized residual sign*resQ needs to be encoded, that is, the value of sign and the absolute value of the quantized residual
  • this technical solution provides a point cloud attribute encoding method based on symbol hiding.
  • the codewords required for attribute information can introduce symbols that hide part of the value to be encoded based on parity, so that the subsequent decoding end can determine the corresponding symbol based on the parity characteristics of the absolute value of the quantized residual obtained by decoding; thus, the number of codewords can be reduced Use to improve the encoding and decoding efficiency of point cloud attributes and improve the encoding and decoding performance of point cloud attributes.
  • the embodiment of the present application provides a code stream, which is generated by bit encoding based on the information to be encoded.
  • the information to be encoded at least includes: the absolute value of the quantized residual of the current point, or the absolute value of the quantized residual of the current point and the corresponding symbol identification information.
  • FIG. 10 shows a schematic structural diagram of an encoder provided by an embodiment of the present application.
  • the encoder 100 may include: a first determining unit 1001 and an encoding unit 1002; wherein,
  • the first determination unit 1001 is configured to determine the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point; and when the absolute value of the initial quantized residual satisfies the first preset condition, according to the sign and The parity characteristics of the initial quantized residual absolute value determine the quantized residual absolute value of the current point;
  • the encoding unit 1002 is configured to encode the absolute value of the quantization residual and write the resulting encoded bits into the code stream.
  • the first determination unit 1001 is further configured to use the initial quantized residual absolute value as the quantized residual absolute value of the current point when the initial quantized residual absolute value does not meet the first preset condition;
  • the encoding unit 1002 is also configured to determine the value of the symbol identification information, encode the value of the symbol identification information and the absolute value of the quantization residual, and write the resulting encoded bits into the code stream.
  • the first determining unit 1001 is also configured to determine that the absolute value of the initial quantized residual satisfies the first preset condition if the absolute value of the initial quantized residual is greater than or equal to the preset threshold; if the absolute value of the initial quantized residual is less than the preset threshold, it is determined that the absolute value of the initial quantized residual does not meet the first preset condition.
  • the "unit" may be part of a circuit, part of a processor, part of a program or software, etc., and of course may also be a module, or may be non-modular.
  • each component in this embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit.
  • the above integrated units can be implemented in the form of hardware or software function modules.
  • the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the technical solution of this embodiment is essentially either The part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product.
  • the computer software product is stored in a storage medium and includes a number of instructions to make a computer device (can It is a personal computer, server, or network device, etc.) or processor that executes all or part of the steps of the method described in this embodiment.
  • the aforementioned storage media include: U disk, mobile hard disk, Read Only Memory (ROM), Random Access Memory (RAM), magnetic disk or optical disk and other media that can store program code.
  • embodiments of the present application provide a computer-readable storage medium for use in the encoder 100.
  • the computer-readable storage medium stores a computer program.
  • the computer program is executed by the first processor, any of the foregoing embodiments can be implemented. method described in one item.
  • the encoder 100 may include: a first communication interface 1101 , a first memory 1102 and a first processor 1103 ; the various components are coupled together through a first bus system 1104 .
  • the first bus system 1104 is used to implement connection communication between these components.
  • the first bus system 1104 also includes a power bus, a control bus and a status signal bus.
  • various buses are labeled as the first bus system 1104 in FIG. 11 . in,
  • the first communication interface 1101 is used for receiving and sending signals during the process of sending and receiving information with other external network elements;
  • the first memory 1102 is used to store a computer program capable of running on the first processor 1103;
  • the first processor 1103 is configured to execute: when running the computer program:
  • the first memory 1102 in the embodiment of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories.
  • non-volatile memory can be read-only memory (Read-Only Memory, ROM), programmable read-only memory (Programmable ROM, PROM), erasable programmable read-only memory (Erasable PROM, EPROM), electrically removable memory. Erase programmable read-only memory (Electrically EPROM, EEPROM) or flash memory.
  • Volatile memory may be Random Access Memory (RAM), which is used as an external cache.
  • RAM static random access memory
  • DRAM dynamic random access memory
  • DRAM synchronous dynamic random access memory
  • SDRAM double data rate synchronous dynamic random access memory
  • Double Data Rate SDRAM DDRSDRAM
  • enhanced SDRAM ESDRAM
  • Synchlink DRAM SLDRAM
  • Direct Rambus RAM DRRAM
  • the first memory 1102 of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
  • the first processor 1103 may be an integrated circuit chip with signal processing capabilities. During the implementation process, each step of the above method can be completed by instructions in the form of hardware integrated logic circuits or software in the first processor 1103 .
  • the above-mentioned first processor 1103 can be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA). or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.
  • DSP Digital Signal Processor
  • ASIC Application Specific Integrated Circuit
  • FPGA Field Programmable Gate Array
  • a general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.
  • the steps of the method disclosed in conjunction with the embodiments of the present application can be directly implemented by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor.
  • the software module can be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other mature storage media in this field.
  • the storage medium is located in the first memory 1102.
  • the first processor 1103 reads the information in the first memory 1102 and completes the steps of the above method in combination with its hardware.
  • the embodiments described in this application can be implemented using hardware, software, firmware, middleware, microcode, or a combination thereof.
  • the processing unit can be implemented in one or more Application Specific Integrated Circuits (ASIC), Digital Signal Processing (DSP), Digital Signal Processing Device (DSP Device, DSPD), programmable Logic device (Programmable Logic Device, PLD), Field-Programmable Gate Array (FPGA), general-purpose processor, controller, microcontroller, microprocessor, and other devices used to perform the functions described in this application electronic unit or combination thereof.
  • ASIC Application Specific Integrated Circuits
  • DSP Digital Signal Processing
  • DSP Device Digital Signal Processing Device
  • DSPD Digital Signal Processing Device
  • PLD programmable Logic Device
  • FPGA Field-Programmable Gate Array
  • the technology described in this application can be implemented through modules (such as procedures, functions, etc.) that perform the functions described in this application.
  • Software code may be stored in memory and executed by a processor.
  • the memory can be implemented in the processor or external to the processor.
  • the first processor 1103 is further configured to perform the method described in any one of the preceding embodiments when running the computer program.
  • This embodiment provides an encoder in which the symbols of some values to be encoded can be hidden based on the parity characteristics of the absolute value of the quantized residual, that is, there is no need to encode these symbols, so as to reduce the time required for encoding attribute information.
  • the code words used thereby reducing the use of code words, improving the coding efficiency of point cloud attributes, and improving the coding performance of point cloud attributes.
  • FIG. 12 shows a schematic structural diagram of a decoder 120 provided by an embodiment of the present application.
  • the decoder 120 may include: a decoding unit 1201 and a second determination unit 1202; wherein,
  • the decoding unit 1201 is configured to parse the code stream and determine the absolute value of the quantization residual at the current point;
  • the second determination unit 1202 is configured to determine the sign of the quantized residual at the current point according to the parity characteristics of the absolute value of the quantized residual when the absolute value of the quantized residual satisfies the first preset condition; and based on the absolute value of the quantized residual Value and sign, determine the attribute reconstruction value of the current point.
  • the decoding unit 1201 is further configured to parse the code stream and determine the sign of the quantized residual at the current point when the absolute value of the quantized residual does not meet the first preset condition.
  • the decoding unit 1201 is also configured to parse the code stream and obtain the value of the symbol identification information
  • the second determining unit 1202 is further configured to determine that the symbol is a positive sign if the value of the symbol identification information is a first value; and to determine that the symbol is a positive sign if the value of the symbol identification information is a second value. The sign is negative.
  • the "unit" may be part of a circuit, part of a processor, part of a program or software, etc., and of course may also be a module, or may be non-modular.
  • each component in this embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit.
  • the above integrated units can be implemented in the form of hardware or software function modules.
  • the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • this embodiment provides a computer-readable storage medium for use in the decoder 120.
  • the computer-readable storage medium stores a computer program.
  • the computer program is executed by the second processor, the foregoing embodiments are implemented. any one of the methods.
  • the decoder 120 may include: a second communication interface 1301, a second memory 1302, and a second processor 1303; the various components are coupled together through a second bus system 1304.
  • the second bus system 1304 is used to implement connection communication between these components.
  • the second bus system 1304 also includes a power bus, a control bus and a status signal bus.
  • various buses are labeled as second bus system 1304 in FIG. 13 . in,
  • the second communication interface 1301 is used for receiving and sending signals during the process of sending and receiving information with other external network elements;
  • the second memory 1302 is used to store a computer program capable of running on the second processor 1303;
  • the second processor 1303 is configured to execute: when running the computer program:
  • the attribute reconstruction value of the current point is determined.
  • the second processor 1303 is further configured to perform the method described in any one of the preceding embodiments when running the computer program.
  • This embodiment provides a decoder, in which the parity and even characteristics of the absolute value of the quantized residual obtained by decoding are used to determine the corresponding symbol; thereby reducing the use of codewords and improving the encoding and decoding efficiency of point cloud attributes. , while improving the encoding and decoding performance of point cloud attributes.
  • FIG. 14 shows a schematic structural diagram of a coding and decoding system provided by an embodiment of the present application.
  • the encoding and decoding system 140 may include an encoder 1401 and a decoder 1402.
  • the encoder 1401 may be the encoder described in any of the preceding embodiments
  • the decoder 1402 may be the decoder described in any of the preceding embodiments.
  • the encoder 1401 in the encoder 1401, based on the parity characteristics of the absolute value of the quantized residual, some symbols of the values to be encoded can be hidden, that is, there is no need to encode these partial symbols to reduce the properties.
  • the code words used when encoding information; in the decoder 1402, the corresponding symbols can be directly determined based on the parity characteristics of the absolute value of the quantized residual obtained by decoding; thus, the use of code words can be reduced and the encoding and decoding of point cloud attributes can be improved. efficiency, while improving the encoding and decoding performance of point cloud attributes.
  • the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point are determined; when the absolute value of the initial quantized residual satisfies the first preset condition, according to the sign and the parity characteristics of the initial quantized residual absolute value, determine the quantized residual absolute value of the current point; encode the quantized residual absolute value, and write the resulting coded bits into the code stream.
  • the code stream is parsed to determine the absolute value of the quantized residual at the current point; when the absolute value of the quantized residual meets the first preset condition, the quantized residual at the current point is determined based on the parity characteristics of the absolute value of the quantized residual.
  • the sign of the difference determines the attribute reconstruction value of the current point based on the absolute value and sign of the quantized residual.
  • the parity characteristics based on the absolute value of the quantized residual can hide some symbols of the values to be encoded, that is, there is no need to encode these symbols, so as to reduce the codewords used when encoding attribute information; while on the decoding side, The corresponding symbol can be directly determined based on the parity and even characteristics of the absolute value of the quantized residual obtained by decoding; thus, the use of codewords can be reduced, the encoding and decoding efficiency of point cloud attributes can be improved, and the encoding and decoding performance of point cloud attributes can be improved.

Abstract

Disclosed in the embodiments of the present application are an encoding method, a decoding method, a code stream, encoders, decoders and a storage medium. The decoding method comprises: parsing a code stream, and determining the absolute value of a quantized residual of the current point; when the absolute value of the quantized residual meets a first preset condition, determining a sign of the quantized residual of the current point according to the parity characteristic of the absolute value of the quantized residual; and determining a reconstructed value of the attribute of the current point according to the absolute value of the quantized residual and the sign. Thus, a sign is hidden on the basis of the parity characteristic of an absolute value of a quantized residual, such that the number of codewords used when encoding attribute information can be reduced, and the encoding and decoding efficiency can be improved.

Description

编解码方法、码流、编码器、解码器以及存储介质Coding and decoding methods, code streams, encoders, decoders and storage media 技术领域Technical field
本申请实施例涉及点云压缩技术领域,尤其涉及一种编解码方法、码流、编码器、解码器以及存储介质。The embodiments of the present application relate to the field of point cloud compression technology, and in particular, to a coding and decoding method, a code stream, an encoder, a decoder, and a storage medium.
背景技术Background technique
在基于音视频编码标准提供的点云压缩(Audio Video Standard-Point Cloud Compression,AVS-PCC)编解码框架中,点云的几何信息和属性信息是分开进行编码的。几何编码完成后,对几何信息进行重建,而属性信息的编码将依赖于重建的几何信息。其中,属性信息编码主要针对颜色信息的编码,将其转变成更符合人眼视觉特性的YUV色彩空间,然后对预处理后属性信息进行属性编码,最终生成二进制的属性码流。In the point cloud compression (Audio Video Standard-Point Cloud Compression, AVS-PCC) encoding and decoding framework provided based on the audio and video coding standard, the geometric information and attribute information of the point cloud are encoded separately. After the geometric encoding is completed, the geometric information is reconstructed, and the encoding of attribute information will depend on the reconstructed geometric information. Among them, attribute information encoding is mainly aimed at encoding color information, converting it into a YUV color space that is more in line with human visual characteristics, and then performing attribute encoding on the preprocessed attribute information, and finally generating a binary attribute code stream.
目前,点云压缩参考平台(Point Cloud Reference Model,PCRM)在属性编码过程中,对于点云中的点,所得到的属性残差值可以为正值也可以为负值。在编码属性残差值的时候,正负号标识信息是和属性残差值一起进行编码的;而正负号标识信息的编码也需要使用码字,从而降低了编解码效率。Currently, in the attribute encoding process of the Point Cloud Compression Reference Platform (Point Cloud Reference Model, PCRM), for points in the point cloud, the obtained attribute residual value can be either positive or negative. When encoding the attribute residual value, the sign identification information is encoded together with the attribute residual value; and the encoding of the sign identification information also requires the use of codewords, thus reducing the encoding and decoding efficiency.
发明内容Contents of the invention
本申请实施例提供一种编解码方法、码流、编码器、解码器以及存储介质,可以降低属性信息编码时所使用的码字,从而能够提升编解码效率。Embodiments of the present application provide a coding and decoding method, a code stream, an encoder, a decoder, and a storage medium, which can reduce the number of codewords used when encoding attribute information, thereby improving coding and decoding efficiency.
本申请实施例的技术方案可以如下实现:The technical solutions of the embodiments of this application can be implemented as follows:
第一方面,本申请实施例提供了一种解码方法,应用于解码器,该方法包括:In the first aspect, embodiments of the present application provide a decoding method, which is applied to a decoder. The method includes:
解析码流,确定当前点的量化残差绝对值;Analyze the code stream and determine the absolute value of the quantized residual at the current point;
在量化残差绝对值满足第一预设条件的情况下,根据量化残差绝对值的奇偶特性,确定当前点的量化残差的符号;When the absolute value of the quantized residual satisfies the first preset condition, determine the sign of the quantized residual at the current point according to the parity characteristics of the absolute value of the quantized residual;
根据量化残差绝对值和符号,确定当前点的属性重建值。According to the absolute value and sign of the quantized residual, the attribute reconstruction value of the current point is determined.
第二方面,本申请实施例提供了一种编码方法,应用于编码器,该方法包括:In the second aspect, embodiments of the present application provide an encoding method, which is applied to an encoder. The method includes:
确定当前点的初始量化残差绝对值以及当前点的初始量化残差的符号;Determine the absolute value of the initial quantized residual at the current point and the sign of the initial quantized residual at the current point;
在初始量化残差绝对值满足第一预设条件的情况下,根据符号和初始量化残差绝对值的奇偶特性,确定当前点的量化残差绝对值;When the absolute value of the initial quantized residual satisfies the first preset condition, determine the absolute value of the quantized residual at the current point based on the sign and the parity characteristics of the absolute value of the initial quantized residual;
对量化残差绝对值进行编码,将所得到的编码比特写入码流。Encode the absolute value of the quantization residual and write the resulting coded bits into the code stream.
第三方面,本申请实施例提供了一种码流,码流是根据待编码信息进行比特编码生成的;其中,待编码信息至少包括:当前点的量化残差绝对值,或者,当前点的量化残差绝对值以及对应的符号标识信息。In the third aspect, embodiments of the present application provide a code stream. The code stream is generated by bit encoding based on the information to be encoded. The information to be encoded at least includes: the absolute value of the quantized residual of the current point, or the absolute value of the quantized residual of the current point. The absolute value of the quantized residual and the corresponding symbol identification information.
第四方面,本申请实施例提供了一种编码器,该编码器包括第一确定单元和编码单元;其中,In a fourth aspect, embodiments of the present application provide an encoder, which includes a first determination unit and a coding unit; wherein,
第一确定单元,配置为确定当前点的初始量化残差绝对值以及当前点的初始量化残差的符号;以及在初始量化残差绝对值满足第一预设条件的情况下,根据符号和初始量化残差绝对值的奇偶特性,确定当前点的量化残差绝对值;A first determination unit configured to determine the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point; and when the absolute value of the initial quantized residual satisfies the first preset condition, according to the sign and the initial Quantize the parity characteristics of the absolute value of the residual and determine the absolute value of the quantized residual at the current point;
编码单元,配置为对量化残差绝对值进行编码,将所得到的编码比特写入码流。The encoding unit is configured to encode the absolute value of the quantization residual and write the resulting encoded bits into the code stream.
第五方面,本申请实施例提供了一种编码器,该编码器包括第一存储器和第一处理器;其中,In a fifth aspect, embodiments of the present application provide an encoder, which includes a first memory and a first processor; wherein,
第一存储器,用于存储能够在第一处理器上运行的计算机程序;a first memory for storing a computer program capable of running on the first processor;
第一处理器,用于在运行所述计算机程序时,执行如第一方面所述的方法。The first processor is configured to perform the method described in the first aspect when running the computer program.
第六方面,本申请实施例提供了一种解码器,该解码器包括解码单元和第二确定单元;其中,In a sixth aspect, embodiments of the present application provide a decoder, which includes a decoding unit and a second determination unit; wherein,
解码单元,配置为解析码流,确定当前点的量化残差绝对值;The decoding unit is configured to parse the code stream and determine the absolute value of the quantized residual at the current point;
第二确定单元,配置为在量化残差绝对值满足第一预设条件的情况下,根据量化残差绝对值的奇偶特性,确定当前点的量化残差的符号;以及根据量化残差绝对值和符号,确定当前点的属性重建值。The second determination unit is configured to determine the sign of the quantized residual at the current point according to the parity characteristics of the absolute value of the quantized residual when the absolute value of the quantized residual satisfies the first preset condition; and based on the absolute value of the quantized residual and symbols, determine the attribute reconstruction value of the current point.
第七方面,本申请实施例提供了一种解码器,该解码器包括第二存储器和第二处理器;其中,In a seventh aspect, embodiments of the present application provide a decoder, which includes a second memory and a second processor; wherein,
第二存储器,用于存储能够在第二处理器上运行的计算机程序;a second memory for storing a computer program capable of running on the second processor;
第二处理器,用于在运行所述计算机程序时,执行如第二方面所述的方法。The second processor is configured to perform the method described in the second aspect when running the computer program.
第八方面,本申请实施例提供了一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,所述计算机程序被执行时实现如第一方面所述的方法、或者如第二方面所述的方法。In an eighth aspect, embodiments of the present application provide a computer-readable storage medium that stores a computer program. When the computer program is executed, the method as described in the first aspect, or the second aspect is implemented. methods described in this regard.
本申请实施例提供了一种编解码方法、码流、编码器、解码器以及存储介质,在编码端,确定当前点的初始量化残差绝对值以及当前点的初始量化残差的符号;在初始量化残差绝对值满足第一预设条件的情况下,根据符号和初始量化残差绝对值的奇偶特性,确定当前点的量化残差绝对值;对量化残差绝对值进行编码,将所得到的编码比特写入码流。在解码端,解析码流,确定当前点的量化残差绝对值;在量化残差绝对值满足第一预设条件的情况下,根据量化残差绝对值的奇偶特性,确定当前点的量化残差的符号;根据量化残差绝对值和符号,确定当前点的属性重建值。这样,在编码端,基于量化残差绝对值的奇偶特性可以隐藏部分待编码值的符号,即无需对该部分符号进行编码,以降低属性信息编码时所使用的码字;而在解码端,根据解码得到的量化残差绝对值的奇偶特性可以直接确定出对应的符号;从而能够减少码字使用,提升点云属性的编解码效率,同时提高点云属性的编解码性能。Embodiments of the present application provide a coding and decoding method, a code stream, an encoder, a decoder, and a storage medium. At the coding end, the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point are determined; When the absolute value of the initial quantized residual meets the first preset condition, the absolute value of the quantized residual at the current point is determined based on the sign and the parity characteristics of the initial quantized residual absolute value; the absolute value of the quantized residual is encoded, and all The resulting coded bits are written into the code stream. At the decoding end, the code stream is parsed to determine the absolute value of the quantized residual at the current point; when the absolute value of the quantized residual meets the first preset condition, the quantized residual at the current point is determined based on the parity characteristics of the absolute value of the quantized residual. The sign of the difference; determine the attribute reconstruction value of the current point based on the absolute value and sign of the quantized residual. In this way, on the encoding side, the parity characteristics based on the absolute value of the quantized residual can hide some symbols of the values to be encoded, that is, there is no need to encode these symbols, so as to reduce the codewords used when encoding attribute information; while on the decoding side, The corresponding symbol can be directly determined based on the parity and even characteristics of the absolute value of the quantized residual obtained by decoding; thus, the use of codewords can be reduced, the encoding and decoding efficiency of point cloud attributes can be improved, and the encoding and decoding performance of point cloud attributes can be improved.
附图说明Description of the drawings
图1A为本申请实施例提供的一种三维点云图像示意图;Figure 1A is a schematic diagram of a three-dimensional point cloud image provided by an embodiment of the present application;
图1B为本申请实施例提供的一种三维点云图像的局部放大示意图;Figure 1B is a partially enlarged schematic diagram of a three-dimensional point cloud image provided by an embodiment of the present application;
图2A为本申请实施例提供的一种不同观看角度下的点云图像示意图;Figure 2A is a schematic diagram of point cloud images at different viewing angles provided by an embodiment of the present application;
图2B为本申请实施例提供的一种图2A对应的数据存储格式示意图;Figure 2B is a schematic diagram of the data storage format corresponding to Figure 2A provided by an embodiment of the present application;
图3为本申请实施例提供的一种点云编解码的网络架构示意图;Figure 3 is a schematic diagram of a point cloud encoding and decoding network architecture provided by an embodiment of the present application;
图4为本申请实施例提供的一种点云编码器的组成结构示意图;Figure 4 is a schematic structural diagram of a point cloud encoder provided by an embodiment of the present application;
图5为本申请实施例提供的一种点云解码器的组成结构示意图;Figure 5 is a schematic structural diagram of a point cloud decoder provided by an embodiment of the present application;
图6为本申请实施例提供的一种解码方法的流程示意图;Figure 6 is a schematic flow chart of a decoding method provided by an embodiment of the present application;
图7为本申请实施例提供的一种解码方法的详细流程示意图;Figure 7 is a detailed flow chart of a decoding method provided by an embodiment of the present application;
图8为本申请实施例提供的一种编码方法的流程示意图;Figure 8 is a schematic flow chart of an encoding method provided by an embodiment of the present application;
图9为本申请实施例提供的一种编码方法的详细流程示意图;Figure 9 is a detailed flow chart of an encoding method provided by an embodiment of the present application;
图10为本申请实施例提供的一种编码器的组成结构示意图;Figure 10 is a schematic structural diagram of an encoder provided by an embodiment of the present application;
图11为本申请实施例提供的一种编码器的具体硬件结构示意图;Figure 11 is a schematic diagram of the specific hardware structure of an encoder provided by an embodiment of the present application;
图12为本申请实施例提供的一种解码器的组成结构示意图;Figure 12 is a schematic structural diagram of a decoder provided by an embodiment of the present application;
图13为本申请实施例提供的一种解码器的具体硬件结构示意图;Figure 13 is a schematic diagram of the specific hardware structure of a decoder provided by an embodiment of the present application;
图14为本申请实施例提供的一种编解码系统的组成结构示意图。Figure 14 is a schematic structural diagram of a coding and decoding system provided by an embodiment of the present application.
具体实施方式Detailed ways
为了能够更加详尽地了解本申请实施例的特点与技术内容,下面结合附图对本申请实施例的实现进行详细阐述,所附附图仅供参考说明之用,并非用来限定本申请实施例。In order to understand the characteristics and technical content of the embodiments of the present application in more detail, the implementation of the embodiments of the present application will be described in detail below with reference to the accompanying drawings. The attached drawings are for reference only and are not intended to limit the embodiments of the present application.
除非另有定义,本文所使用的所有的技术和科学术语与属于本申请的技术领域的技术人员通常理解的含义相同。本文中所使用的术语只是为了描述本申请实施例的目的,不是旨在限制本申请。Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of the present application and are not intended to limit the present application.
在以下的描述中,涉及到“一些实施例”,其描述了所有可能实施例的子集,但是可以理解,“一些实施例”可以是所有可能实施例的相同子集或不同子集,并且可以在不冲突的情况下相互结合。In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or a different subset of all possible embodiments, and Can be combined with each other without conflict.
还需要指出,本申请实施例所涉及的术语“第一\第二\第三”仅是用于区别类似的对象,不代表针对对象的特定排序,可以理解地,“第一\第二\第三”在允许的情况下可以互换特定的顺序或先后次序,以使这里描述的本申请实施例能够以除了在这里图示或描述的以外的顺序实施。It should also be pointed out that the terms "first\second\third" involved in the embodiments of this application are only used to distinguish similar objects and do not represent a specific ordering of objects. It is understandable that "first\second\ The third "specific order or sequence may be interchanged where permitted, so that the embodiments of the application described herein can be implemented in an order other than that illustrated or described herein.
点云(Point Cloud)是物体表面的三维表现形式,通过光电雷达、激光雷达、激光扫描仪、多视角相机等采集设备,可以采集得到物体表面的点云(数据)。Point Cloud is a three-dimensional representation of the surface of an object. Through collection equipment such as photoelectric radar, lidar, laser scanner, and multi-view camera, the point cloud (data) of the surface of the object can be collected.
点云是空间中一组无规则分布的、表达三维物体或场景的空间结构及表面属性的离散点集,图1A展示了三维点云图像和图1B展示了三维点云图像的局部放大图,可以看到点云表面是由分布稠密的点所组成的。Point cloud is a set of discrete points randomly distributed in space that expresses the spatial structure and surface properties of a three-dimensional object or scene. Figure 1A shows a three-dimensional point cloud image and Figure 1B shows a partial enlargement of the three-dimensional point cloud image. It can be seen that the point cloud surface is composed of densely distributed points.
二维图像在每一个像素点均有信息表达,分布规则,因此不需要额外记录其位置信息;然而点云中的点在三维空间中的分布具有随机性和不规则性,因此需要记录每一个点在空间中的位置,才能完整地表达一幅点云。与二维图像类似,采集过程中每一个位置均有对应的属性信息,通常为RGB颜色值,颜色值反映物体的色彩;对于点云来说,每一个点所对应的属性信息除了颜色信息以外,还有比较常见 的是反射率(reflectance)值,反射率值反映物体的表面材质。因此,点云中的点可以包括点的位置信息和点的属性信息。例如,点的位置信息可以是点的三维坐标信息(x,y,z)。点的位置信息也可称为点的几何信息。例如,点的属性信息可以包括颜色信息(三维颜色信息)和/或反射率(一维反射率信息r)等等。例如,颜色信息可以是任意一种色彩空间上的信息。例如,颜色信息可以是RGB信息。其中,R表示红色(Red,R),G表示绿色(Green,G),B表示蓝色(Blue,B)。再如,颜色信息可以是亮度色度(YCbCr,YUV)信息。其中,Y表示明亮度(Luma),Cb(U)表示蓝色色差,Cr(V)表示红色色差。Two-dimensional images have information expressed in each pixel and are distributed regularly, so there is no need to record additional position information; however, the distribution of points in the point cloud in the three-dimensional space is random and irregular, so each point needs to be recorded Only the position of the point in space can completely express a point cloud. Similar to two-dimensional images, each position in the collection process has corresponding attribute information, usually RGB color values, and the color values reflect the color of the object; for point clouds, the attribute information corresponding to each point is in addition to color information. , and the more common one is the reflectance value, which reflects the surface material of the object. Therefore, points in the point cloud can include point location information and point attribute information. For example, the position information of the point may be the three-dimensional coordinate information (x, y, z) of the point. The position information of a point can also be called the geometric information of the point. For example, the attribute information of a point may include color information (three-dimensional color information) and/or reflectance (one-dimensional reflectance information r), and so on. For example, color information can be information on any color space. For example, the color information may be RGB information. Among them, R represents red (Red, R), G represents green (Green, G), and B represents blue (Blue, B). For another example, the color information may be brightness and chrominance (YCbCr, YUV) information. Among them, Y represents brightness (Luma), Cb(U) represents blue color difference, and Cr(V) represents red color difference.
根据激光测量原理得到的点云,点云中的点可以包括点的三维坐标信息和点的反射率值。再如,根据摄影测量原理得到的点云,点云中的点可以可包括点的三维坐标信息和点的三维颜色信息。再如,结合激光测量和摄影测量原理得到点云,点云中的点可以可包括点的三维坐标信息、点的反射率值和点的三维颜色信息。According to the point cloud obtained based on the principle of laser measurement, the points in the point cloud can include the three-dimensional coordinate information of the point and the reflectivity value of the point. For another example, in a point cloud obtained according to the principle of photogrammetry, the points in the point cloud may include the three-dimensional coordinate information of the point and the three-dimensional color information of the point. For another example, a point cloud is obtained by combining the principles of laser measurement and photogrammetry. The points in the point cloud may include the three-dimensional coordinate information of the point, the reflectivity value of the point, and the three-dimensional color information of the point.
如图2A和图2B所示为一幅点云图像及其对应的数据存储格式。其中,图2A提供了点云图像的六个观看角度,图2B由文件头信息部分和数据部分组成,头信息包含了数据格式、数据表示类型、点云总点数、以及点云所表示的内容。例如,点云为“.ply”格式,由ASCII码表示,总点数为207242,每个点具有三维坐标信息(x,y,z)和三维颜色信息(r,g,b)。Figure 2A and Figure 2B show a point cloud image and its corresponding data storage format. Among them, Figure 2A provides six viewing angles of the point cloud image. Figure 2B is composed of the file header information part and the data part. The header information includes the data format, data representation type, total number of point cloud points, and the content represented by the point cloud. . For example, the point cloud is in ".ply" format and is represented by ASCII code. The total number of points is 207242. Each point has three-dimensional coordinate information (x, y, z) and three-dimensional color information (r, g, b).
点云可以按获取的途径分为:Point clouds can be divided into:
静态点云:即物体是静止的,获取点云的设备也是静止的;Static point cloud: that is, the object is stationary and the device that obtains the point cloud is also stationary;
动态点云:物体是运动的,但获取点云的设备是静止的;Dynamic point cloud: The object is moving, but the device that obtains the point cloud is stationary;
动态获取点云:获取点云的设备是运动的。Dynamically acquire point clouds: The device that acquires point clouds is in motion.
例如,按点云的用途分为两大类:For example, point clouds are divided into two categories according to their uses:
类别一:机器感知点云,其可以用于自主导航系统、实时巡检系统、地理信息系统、视觉分拣机器人、抢险救灾机器人等场景;Category 1: Machine perception point cloud, which can be used in scenarios such as autonomous navigation systems, real-time inspection systems, geographic information systems, visual sorting robots, and rescue and disaster relief robots;
类别二:人眼感知点云,其可以用于数字文化遗产、自由视点广播、三维沉浸通信、三维沉浸交互等点云应用场景。Category 2: Human eye perception point cloud, which can be used in point cloud application scenarios such as digital cultural heritage, free-viewpoint broadcasting, three-dimensional immersive communication, and three-dimensional immersive interaction.
点云可以灵活方便地表达三维物体或场景的空间结构及表面属性,并且由于点云通过直接对真实物体采样获得,在保证精度的前提下能提供极强的真实感,因而应用广泛,其范围包括虚拟现实游戏、计算机辅助设计、地理信息系统、自动导航系统、数字文化遗产、自由视点广播、三维沉浸远程呈现、生物组织器官三维重建等。Point clouds can flexibly and conveniently express the spatial structure and surface properties of three-dimensional objects or scenes, and because point clouds are obtained by directly sampling real objects, they can provide a strong sense of reality while ensuring accuracy, so they are widely used and their scope Including virtual reality games, computer-aided design, geographic information systems, automatic navigation systems, digital cultural heritage, free-viewpoint broadcasting, three-dimensional immersive telepresence, three-dimensional reconstruction of biological tissues and organs, etc.
点云的采集主要有以下途径:计算机生成、3D激光扫描、3D摄影测量等。计算机可以生成虚拟三维物体及场景的点云;3D激光扫描可以获得静态现实世界三维物体或场景的点云,每秒可以获取百万级点云;3D摄影测量可以获得动态现实世界三维物体或场景的点云,每秒可以获取千万级点云。这些技术降低了点云数据获取成本和时间周期,提高了数据的精度。点云数据获取方式的变革,使大量点云数据的获取成为可能,伴随着应用需求的增长,海量3D点云数据的处理遭遇存储空间和传输带宽限制的瓶颈。Point cloud collection mainly has the following methods: computer generation, 3D laser scanning, 3D photogrammetry, etc. Computers can generate point clouds of virtual three-dimensional objects and scenes; 3D laser scanning can obtain point clouds of static real-world three-dimensional objects or scenes, and can obtain millions of point clouds per second; 3D photogrammetry can obtain dynamic real-world three-dimensional objects or scenes Point clouds can obtain tens of millions of point clouds per second. These technologies reduce the cost and time period of point cloud data acquisition and improve the accuracy of the data. Changes in the way of obtaining point cloud data have made it possible to obtain large amounts of point cloud data. With the growth of application requirements, the processing of massive 3D point cloud data has encountered bottlenecks limited by storage space and transmission bandwidth.
示例性地,以帧率为30帧每秒(fps)的点云视频为例,每帧点云的点数为70万,每个点具有坐标信息xyz(float)和颜色信息RGB(uchar),则10s点云视频的数据量大约为0.7million×(4Byte×3+1Byte×3)×30fps×10s=3.15GB,其中,1Byte为10bit,而YUV采样格式为4:2:0,帧率为24fps的1280×720二维视频,其10s的数据量约为1280×720×12bit×24fps×10s≈0.33GB,10s的两视角三维视频的数据量约为0.33×2=0.66GB。由此可见,点云视频的数据量远超过相同时长的二维视频和三维视频的数据量。因此,为更好地实现数据管理,节省服务器存储空间,降低服务器与客户端之间的传输流量及传输时间,点云压缩成为促进点云产业发展的关键问题。For example, taking a point cloud video with a frame rate of 30 frames per second (fps), the number of points in each frame of the point cloud is 700,000, and each point has coordinate information xyz (float) and color information RGB (uchar), Then the data volume of 10s point cloud video is approximately 0.7 million×(4Byte×3+1Byte×3)×30fps×10s=3.15GB, where 1Byte is 10bit, and the YUV sampling format is 4:2:0, and the frame rate The data volume of 1280×720 2D video at 24fps for 10s is about 1280×720×12bit×24fps×10s≈0.33GB, and the data volume of two-view 3D video for 10s is about 0.33×2=0.66GB. It can be seen that the data volume of point cloud video far exceeds the data volume of 2D video and 3D video of the same length. Therefore, in order to better realize data management, save server storage space, and reduce transmission traffic and transmission time between the server and the client, point cloud compression has become a key issue to promote the development of the point cloud industry.
也就是说,由于点云是海量点的集合,存储点云不仅会消耗大量的内存,而且不利于传输,也没有这么大的带宽可以支持将点云不经过压缩直接在网络层进行传输,因此,需要对点云进行压缩。In other words, since the point cloud is a collection of massive points, storing the point cloud will not only consume a lot of memory, but is also not conducive to transmission. There is not such a large bandwidth to support the direct transmission of the point cloud at the network layer without compression. Therefore, , the point cloud needs to be compressed.
目前,可对点云进行压缩的点云编码框架可以是运动图像专家组(Moving Picture Experts Group,MPEG)提供的基于几何的点云压缩(Geometry-based Point Cloud Compression,G-PCC)编解码框架或基于视频的点云压缩(Video-based Point Cloud Compression,V-PCC)编解码框架,也可以是AVS提供的AVS-PCC编解码框架。G-PCC编解码框架可用于针对第一类静态点云和第三类动态获取点云进行压缩,V-PCC编解码框架可用于针对第二类动态点云进行压缩。G-PCC编解码框架也称为点云编解码器TMC13,V-PCC编解码框架也称为点云编解码器TMC2。Currently, the point cloud coding framework that can compress point clouds can be the Geometry-based Point Cloud Compression (G-PCC) codec framework provided by the Moving Picture Experts Group (MPEG) Or the Video-based Point Cloud Compression (V-PCC) codec framework, or the AVS-PCC codec framework provided by AVS. The G-PCC encoding and decoding framework can be used to compress the first type of static point cloud and the third type of dynamic point cloud, and the V-PCC encoding and decoding framework can be used to compress the second type of dynamic point cloud. The G-PCC encoding and decoding framework is also called point cloud codec TMC13, and the V-PCC encoding and decoding framework is also called point cloud codec TMC2.
本申请实施例提供了一种包含解码方法和编码方法的点云编解码系统的网络架构,图3为本申请实施例提供的一种点云编解码的网络架构示意图。如图3所示,该网络架构包括一个或多个电子设备13至1N和通信网络01,其中,电子设备13至1N可以通过通信网络01进行视频交互。电子设备在实施 的过程中可以为各种类型的具有点云编解码功能的设备,例如,所述电子设备可以包括手机、平板电脑、个人计算机、个人数字助理、导航仪、数字电话、视频电话、电视机、传感设备、服务器等,本申请实施例不作限制。其中,本申请实施例中的解码器或编码器就可以为上述电子设备。This embodiment of the present application provides a network architecture of a point cloud encoding and decoding system that includes a decoding method and an encoding method. Figure 3 is a schematic diagram of the network architecture of a point cloud encoding and decoding system provided by an embodiment of the present application. As shown in FIG. 3 , the network architecture includes one or more electronic devices 13 to 1N and a communication network 01 , wherein the electronic devices 13 to 1N can perform video interaction through the communication network 01 . During the implementation process, electronic devices may be various types of devices with point cloud encoding and decoding functions. For example, the electronic devices may include mobile phones, tablet computers, personal computers, personal digital assistants, navigators, digital phones, and video phones. , televisions, sensing equipment, servers, etc., are not limited by the embodiments of this application. Among them, the decoder or encoder in the embodiment of the present application can be the above-mentioned electronic device.
其中,本申请实施例中的电子设备具有点云编解码功能,一般包括点云编码器(即编码器)和点云解码器(即解码器)。Among them, the electronic device in the embodiment of the present application has a point cloud encoding and decoding function, and generally includes a point cloud encoder (ie, encoder) and a point cloud decoder (ie, decoder).
下面以AVS-PCC编解码框架为例进行点云压缩技术的说明。The following uses the AVS-PCC encoding and decoding framework as an example to illustrate the point cloud compression technology.
可以理解,点云压缩一般采用点云几何信息和属性信息分别压缩的方式,在编码端,首先在几何编码器中编码点云几何信息,然后将重建几何信息作为附加信息输入到属性编码器中,辅助点云属性的压缩;在解码端,首先在几何解码器中解码点云几何信息,然后将解码后的几何信息作为附加信息输入到属性解码器中,辅助点云属性的压缩。整个编解码器由预处理/后处理、几何编码/解码、属性编码/解码几部分组成。It can be understood that point cloud compression generally adopts the method of compressing point cloud geometric information and attribute information separately. On the encoding side, the point cloud geometric information is first encoded in the geometry encoder, and then the reconstructed geometric information is input into the attribute encoder as additional information. , assists in the compression of point cloud attributes; on the decoding end, the point cloud geometric information is first decoded in the geometry decoder, and then the decoded geometric information is input into the attribute decoder as additional information to assist in the compression of point cloud attributes. The entire codec consists of pre-processing/post-processing, geometry encoding/decoding, and attribute encoding/decoding.
本申请实施例提供一种点云编码器,如图4所示为AVS所提供的点云压缩参考平台PCRM的框架,该点云编码器11包括几何编码器:坐标平移单元111、坐标量化单元112、八叉树构建单元113、几何熵编码器114、几何重建单元115。属性编码器:属性重上色单元116、颜色空间变换单元117、第一属性预测单元118、量化单元119和属性熵编码器1110。The embodiment of the present application provides a point cloud encoder. Figure 4 shows the framework of the point cloud compression reference platform PCRM provided by AVS. The point cloud encoder 11 includes a geometric encoder: a coordinate translation unit 111 and a coordinate quantization unit. 112. Octree construction unit 113, geometric entropy encoder 114, geometric reconstruction unit 115. Attribute encoder: attribute recoloring unit 116, color space transform unit 117, first attribute prediction unit 118, quantization unit 119 and attribute entropy encoder 1110.
对于PCRM,在编码端的几何编码部分,首先对原始几何信息进行预处理,通过坐标平移单元111将几何原点归一化到点云空间中的最小值位置,通过坐标量化单元112将几何信息从浮点数转化为整形,便于后续的规则化处理;然后对规则化的几何信息进行几何编码,在八叉树构建单元113中采用八叉树结构对点云空间进行递归划分,每次将当前点划分成八个相同大小的子块,并判断每个子块的占有码字情况,当子块内不包含点时记为空,否则记为非空,在递归划分的最后一层记录所有块的占有码字信息,并进行几何编码;通过八叉树结构表达的几何信息一方面输入到几何熵编码器114中形成几何码流,另一方面在几何重建单元115进行几何重建处理,重建后的几何信息作为附加信息输入到属性编码器中。For PCRM, in the geometric encoding part of the coding end, the original geometric information is first preprocessed, the geometric origin is normalized to the minimum position in the point cloud space through the coordinate translation unit 111, and the geometric information is transferred from the float to the point cloud space through the coordinate quantization unit 112. The points are converted into shapes to facilitate subsequent regularization processing; then the regularized geometric information is geometrically encoded, and the octree structure is used in the octree construction unit 113 to recursively divide the point cloud space, dividing the current point each time into eight sub-blocks of the same size, and determine the occupied codeword status of each sub-block. When the sub-block does not contain points, it is recorded as empty, otherwise it is recorded as non-empty. The occupancy of all blocks is recorded at the last level of recursive division. The codeword information is geometrically encoded; on the one hand, the geometric information expressed through the octree structure is input to the geometric entropy encoder 114 to form a geometric code stream; on the other hand, the geometric reconstruction process is performed in the geometric reconstruction unit 115. The reconstructed geometry The information is input to the attribute encoder as additional information.
在属性编码部分,首先对原始的属性信息进行预处理,由于几何信息在几何编码之后有所异动,因此,通过属性重上色单元116为几何编码后的每一个点重新分配属性值,实现属性重上色。此外,如果处理的属性信息为颜色信息,还需要将原始的颜色信息通过颜色空间变换单元117进行颜色空间变换,将其转变成更符合人眼视觉特性的YUV色彩空间;然后通过第一属性预测单元118对预处理后属性信息进行属性编码,属性编码首先需要将点云进行重排序,重排序的方式是莫顿码,因此属性编码的遍历顺序为莫顿顺序。PCRM中的属性预测方法为基于莫顿顺序的单点预测,即按照莫顿顺序从当前待编码点(当前点)向前回溯一个点,找到的节点为当前待编码点的预测参考点,然后将预测参考点的属性重建值作为属性预测值,属性残差值为当前待编码点的属性原始值与属性预测值之间的差值;最后通过量化单元119对属性残差值进行量化,将量化后的残差信息输入到属性熵编码器1110中形成属性码流。In the attribute encoding part, the original attribute information is first preprocessed. Since the geometric information changes after the geometric encoding, the attribute value is reassigned to each point after the geometric encoding through the attribute recoloring unit 116 to realize the attribute Repaint. In addition, if the attribute information being processed is color information, the original color information needs to be transformed into a color space through the color space transformation unit 117 to convert it into a YUV color space that is more in line with the visual characteristics of the human eye; and then predicted through the first attribute Unit 118 performs attribute encoding on the preprocessed attribute information. At first, the point cloud needs to be reordered. The reordering method is Morton code, so the traversal order of attribute encoding is Morton order. The attribute prediction method in PCRM is a single point prediction based on Morton order, that is, going back one point from the current point to be encoded (current point) according to Morton order, and the node found is the prediction reference point of the current point to be encoded, and then The attribute reconstruction value of the prediction reference point is used as the attribute prediction value, and the attribute residual value is the difference between the attribute original value and the attribute prediction value of the current point to be encoded; finally, the attribute residual value is quantized through the quantization unit 119, and The quantized residual information is input to the attribute entropy encoder 1110 to form an attribute code stream.
本申请实施例还提供一种点云解码器,如图5所示为AVS所提供的点云压缩参考平台PCRM的框架,该点云解码器12包括几何解编码器:几何熵解码器121、八叉树重建单元122、坐标反量化单元123、坐标反平移单元124。属性解码器:属性熵解码器125、反量化单元126、第二属性预测单元127和颜色空间反变换单元128。The embodiment of the present application also provides a point cloud decoder. Figure 5 shows the framework of the point cloud compression reference platform PCRM provided by AVS. The point cloud decoder 12 includes a geometric decoder: a geometric entropy decoder 121, Octree reconstruction unit 122, coordinate inverse quantization unit 123, and coordinate inverse translation unit 124. Attribute decoder: attribute entropy decoder 125, inverse quantization unit 126, second attribute prediction unit 127 and color space inverse transform unit 128.
在解码端,同样采用几何和属性分别解码的方式。在几何解码部分,首先通过几何熵解码器121对几何码流进行熵解码,得到每个节点的几何信息,然后按照和几何编码相同的方式通过八叉树重建单元122构建八叉树结构,结合解码几何重建出坐标变换后的、通过八叉树结构表达的几何信息,一方面将该信息通过坐标反量化单元123进行坐标反量化和通过坐标反平移单元124进行反平移,得到解码几何信息。另一方面作为附加信息输入到属性解码器中。在属性解码部分,按照与编码端相同的方式构建莫顿顺序,先通过属性熵解码器125对属性码流进行熵解码,得到量化后的残差信息;然后通过反量化单元126进行反量化,得到属性残差值;类似的,按照与属性编码相同的方式,通过第二属性预测单元127获得当前待解码点的属性预测值,然后将属性预测值与属性残差值相加,可以恢复出当前待解码点的属性重建值(例如,YUV属性值);最后,经过颜色空间反变换单元128的颜色空间反变换得到解码属性信息。On the decoding end, geometry and attributes are also decoded separately. In the geometry decoding part, the geometry code stream is first entropy decoded through the geometric entropy decoder 121 to obtain the geometric information of each node, and then the octree structure is constructed through the octree reconstruction unit 122 in the same way as the geometry encoding, combined with The decoded geometry reconstructs the geometric information expressed through the octree structure after coordinate transformation. On the one hand, the information is coordinate inverse quantized through the coordinate inverse quantization unit 123 and inversely translated through the coordinate inverse translation unit 124 to obtain the decoded geometry information. On the other hand, it is input to the attribute decoder as additional information. In the attribute decoding part, the Morton order is constructed in the same way as the encoding end. First, the attribute code stream is entropy decoded through the attribute entropy decoder 125 to obtain the quantized residual information; then inverse quantization is performed through the inverse quantization unit 126. Obtain the attribute residual value; similarly, in the same manner as attribute encoding, obtain the attribute prediction value of the current to-be-decoded point through the second attribute prediction unit 127, and then add the attribute prediction value and the attribute residual value to recover The attribute reconstruction value of the current point to be decoded (for example, YUV attribute value); finally, the decoding attribute information is obtained through the inverse color space transformation of the color space inverse transformation unit 128 .
还可以理解,对于AVS-PCC编解码框架而言,通用测试条件如下:It can also be understood that for the AVS-PCC encoding and decoding framework, the general test conditions are as follows:
(1)测试条件共4种:(1) There are 4 types of test conditions:
条件1:几何位置有限度有损、属性有损;Condition 1: The geometric position is limited and lossy, and the attributes are lossy;
条件2:几何位置无损、属性有损;Condition 2: The geometric position is lossless and the attributes are lossy;
条件3:几何位置无损、属性有限度有损;Condition 3: The geometric position is lossless, and the attributes are limited and lossy;
条件4:几何位置无损、属性无损。Condition 4: The geometric position is lossless and the attributes are lossless.
(2)通用测试序列包括Cat1A,Cat1B,Cat1C,Cat2-frame和Cat3共五类。其中,Cat1A、Cat2-frame 点云只包含反射率属性信息,Cat1B、Cat3点云只包含颜色属性信息,Cat1C点云同时包含颜色和反射率属性信息。(2) The universal test sequence includes five categories: Cat1A, Cat1B, Cat1C, Cat2-frame and Cat3. Among them, Cat1A and Cat2-frame point clouds only contain reflectance attribute information, Cat1B and Cat3 point clouds only contain color attribute information, and Cat1C point clouds contain both color and reflectance attribute information.
(3)技术路线:共4种,以属性压缩所采用的算法进行区分。(3) Technical routes: 4 types in total, distinguished by the algorithm used for attribute compression.
技术路线1:预测分支,属性压缩采用基于帧内预测的方法:Technical route 1: Prediction branch, attribute compression uses a method based on intra-frame prediction:
在编码端,按照一定的顺序(例如,点云原始采集顺序、莫顿顺序、希尔伯特顺序等)处理点云中的点,先采用预测算法得到属性预测值,根据属性值和属性预测值得到属性残差,然后对属性残差进行量化,生成量化残差,最后对量化残差进行编码;On the encoding side, the points in the point cloud are processed in a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.). The prediction algorithm is first used to obtain the attribute prediction value, and the attribute prediction value is obtained based on the attribute value and attribute prediction. The attribute residuals are obtained from the values, and then the attribute residuals are quantized to generate quantized residuals, and finally the quantized residuals are encoded;
在解码端,按照一定的顺序(例如,点云原始采集顺序、莫顿顺序、希尔伯特顺序等)处理点云中的点,先采用预测算法得到属性预测值,然后解码获取量化残差,再对量化残差进行反量化,最后根据属性预测值和反量化后的属性残差,获得属性重建值。On the decoding end, the points in the point cloud are processed in a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.). The prediction algorithm is first used to obtain the attribute prediction value, and then the decoding is performed to obtain the quantized residual. , then perform inverse quantization on the quantized residual, and finally obtain the attribute reconstruction value based on the attribute prediction value and the inverse-quantized attribute residual.
技术路线2:预测变换分支----资源受限,属性压缩采用基于帧内预测和离散余弦变换(Discrete Cosine Transform,DCT)的方法,这时候在编码量化后的变换系数时,有最大点数X(如4096)的限制,即最多每X点为一组进行编码:Technical route 2: Predictive transformation branch - resources are limited. Attribute compression uses methods based on intra-frame prediction and discrete cosine transform (Discrete Cosine Transform, DCT). At this time, there is a maximum number of points when encoding the quantized transform coefficients. The restriction of X (such as 4096) means that at most every X point can be encoded as a group:
在编码端,按照一定的顺序(例如,点云原始采集顺序、莫顿顺序、希尔伯特顺序等)处理点云中的点,先将整个点云分成长度最大为Y(例如,2)的若干小组,然后将这若干小组组合成若干个大组(每个大组中的点数不超过X,如4096),然后采用预测算法得到属性预测值,根据属性值和属性预测值得到属性残差,以小组为单位对属性残差进行DCT变换,生成变换系数,再对变换系数进行量化,生成量化后的变换系数,最后以大组为单位对量化后的变换系数进行编码;On the encoding side, the points in the point cloud are processed in a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.), and the entire point cloud is first divided into parts with a maximum length of Y (for example, 2) Several small groups, and then combine these small groups into several large groups (the number of points in each large group does not exceed Difference, perform DCT transformation on the attribute residuals in small groups, generate transformation coefficients, then quantize the transformation coefficients, generate quantized transformation coefficients, and finally encode the quantized transformation coefficients in large groups;
在解码端,按照一定的顺序(例如,点云原始采集顺序、莫顿顺序、希尔伯特顺序等)处理点云中的点,先将整个点云分成长度最大为Y(例如,2)的若干小组,然后将这若干小组组合成若干个大组(每个大组中的点数不超过X,如4096),以大组为单位解码获取量化后的变换系数,然后采用预测算法得到属性预测值,再以小组为单位对量化后的变换系数进行反量化、反变换,最后根据属性预测值和反量化、反变换后的系数,获得属性重建值。On the decoding end, the points in the point cloud are processed in a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.), and the entire point cloud is first divided into parts with a maximum length of Y (for example, 2) Several small groups, and then combine these small groups into several large groups (the number of points in each large group does not exceed The predicted value is then inversely quantized and inversely transformed on the quantized transformation coefficient in small groups. Finally, the attribute reconstruction value is obtained based on the attribute predicted value and the inversely quantized and inversely transformed coefficient.
技术路线3:预测变换分支----资源不受限,属性压缩采用基于帧内预测和DCT变换的方法,在编码量化后的变换系数时,这时候没有最大点数X的限制,即所有系数一起进行编码:Technical route 3: Predictive transformation branch - resources are not limited. Attribute compression uses methods based on intra-frame prediction and DCT transformation. When encoding the quantized transformation coefficients, there is no limit to the maximum number of points X at this time, that is, all coefficients Coding together:
在编码端,按照一定的顺序(例如,点云原始采集顺序、莫顿顺序、希尔伯特顺序等)处理点云中的点,先将整个点云分成长度最大为Y(例如,2)的若干小组,然后采用预测算法得到属性预测值,根据属性值和属性预测值得到属性残差,以小组为单位对属性残差进行DCT变换,生成变换系数,再对变换系数进行量化,生成量化后的变换系数,最后对整个点云的量化后的变换系数进行编码;On the encoding side, the points in the point cloud are processed in a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.), and the entire point cloud is first divided into parts with a maximum length of Y (for example, 2) Several groups are formed, and then the prediction algorithm is used to obtain the attribute prediction value, and the attribute residual is obtained based on the attribute value and the attribute prediction value. The attribute residual is DCT transformed in groups as a unit to generate the transformation coefficient, and then the transformation coefficient is quantified to generate the quantization The final transformation coefficients, and finally the quantized transformation coefficients of the entire point cloud are encoded;
在解码端,按照一定的顺序(例如,点云原始采集顺序、莫顿顺序、希尔伯特顺序等)处理点云中的点,先将整个点云分成长度最大为Y(例如,2)的若干小组,解码获取整个点云的量化后的变换系数,然后采用预测算法得到属性预测值,再以小组为单位对量化后的变换系数进行反量化、反变换,最后根据属性预测值和反量化、反变换后的系数,获得属性重建值。On the decoding end, the points in the point cloud are processed in a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.), and the entire point cloud is first divided into parts with a maximum length of Y (for example, 2) Several groups are formed, decode and obtain the quantized transformation coefficients of the entire point cloud, and then use the prediction algorithm to obtain the attribute prediction values. Then, the quantized transformation coefficients are inversely quantized and inversely transformed in groups as a unit, and finally the attribute prediction values and inverse transformations are performed. The coefficients after quantization and inverse transformation are used to obtain attribute reconstruction values.
技术路线4:多层变换分支,属性压缩采用基于多层小波变换的方法:Technical route 4: Multi-layer transformation branch, attribute compression uses a method based on multi-layer wavelet transform:
在编码端,对整个点云进行多层小波变换,生成变换系数,然后对变换系数进行量化,生成量化后的变换系数,最后对整个点云的量化后的变换系数进行编码;At the encoding end, multi-layer wavelet transform is performed on the entire point cloud to generate transform coefficients, then the transform coefficients are quantized, the quantized transform coefficients are generated, and finally the quantized transform coefficients of the entire point cloud are encoded;
在解码端,解码获取整个点云的量化后的变换系数,然后对量化后的变换系数进行反量化、反变换,获得属性重建值。At the decoding end, decoding obtains the quantized transformation coefficients of the entire point cloud, and then performs inverse quantization and inverse transformation on the quantized transformation coefficients to obtain attribute reconstruction values.
在一种具体的实施例中,预测分支:按照一定的顺序(例如,点云原始采集顺序、莫顿顺序、希尔伯特顺序等)处理点云中的点。In a specific embodiment, the prediction branch: processes the points in the point cloud according to a certain order (for example, the original collection order of the point cloud, Morton order, Hilbert order, etc.).
在编码端,具体实施过程如下:On the coding side, the specific implementation process is as follows:
a)采用预测算法得到属性预测值Aj′;a) Use the prediction algorithm to obtain the attribute prediction value Aj′;
b)根据属性值Aj和属性预测值Aj′(以及跨分量属性预测值residualPrevComponent)计算属性残差,公式如下,b) Calculate the attribute residual according to the attribute value Aj and the attribute prediction value Aj′ (and the cross-component attribute prediction value residualPrevComponent). The formula is as follows,
res=A j-A j′(-residualPrevComponent)           (1) res=A j -A j ′(-residualPrevComponent) (1)
c)对属性残差绝对值进行量化,生成量化残差resQ;c) Quantify the absolute value of the attribute residual and generate the quantized residual resQ;
d)编码带符号的量化残差sign*resQ。d) Encode the signed quantized residual sign*resQ.
在解码端,具体实施过程如下:On the decoding side, the specific implementation process is as follows:
a)采用预测算法得到属性预测值Aj′;a) Use the prediction algorithm to obtain the attribute prediction value Aj′;
b)(获取跨分量属性预测值residualPrevComponent,)解码获取带符号的量化残差,再对量化残差进行反量化,得到解码残差值;b) (obtain the cross-component attribute prediction value residualPrevComponent,) decode to obtain the signed quantized residual, and then inverse quantize the quantized residual to obtain the decoded residual value;
c)根据属性预测值、跨分量属性预测值带符号的解码残差值sign*InvQ(resQ),获得属性重建值, 公式如下,c) Obtain the attribute reconstruction value based on the attribute prediction value and the signed decoding residual value sign*InvQ(resQ) of the cross-component attribute prediction value. The formula is as follows,
Figure PCTCN2022103817-appb-000001
Figure PCTCN2022103817-appb-000001
在相关技术中,在编码带符号的量化残差sign*resQ时,不仅需要编码量化残差resQ,而且还需要编码符号sign。由于对于符号sign的编码也需要使用码字,从而增加了编码属性信息时所需的码字,降低了编解码效率。In the related art, when encoding the signed quantized residual sign*resQ, not only the quantized residual resQ but also the symbol sign needs to be encoded. Since the encoding of the symbol sign also requires the use of codewords, the codewords required for encoding attribute information are increased and the encoding and decoding efficiency is reduced.
本申请实施例提供了一种编解码方法,在编码端,确定当前点的初始量化残差绝对值以及当前点的初始量化残差的符号;在初始量化残差绝对值满足第一预设条件的情况下,根据符号和初始量化残差绝对值的奇偶特性,确定当前点的量化残差绝对值;对量化残差绝对值进行编码,将所得到的编码比特写入码流。而在解码端,解析码流,确定当前点的量化残差绝对值;在量化残差绝对值满足第一预设条件的情况下,根据量化残差绝对值的奇偶特性,确定当前点的量化残差的符号;根据量化残差绝对值和符号,确定当前点的属性重建值。The embodiment of the present application provides a coding and decoding method. At the encoding end, the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point are determined; the absolute value of the initial quantized residual satisfies the first preset condition. In the case of , according to the parity characteristics of the symbol and the initial quantized residual absolute value, determine the quantized residual absolute value of the current point; encode the quantized residual absolute value, and write the resulting coded bits into the code stream. At the decoding end, the code stream is parsed to determine the absolute value of the quantized residual at the current point; when the absolute value of the quantized residual meets the first preset condition, the quantized value of the current point is determined based on the parity characteristics of the absolute value of the quantized residual. The sign of the residual; determine the attribute reconstruction value of the current point based on the absolute value and sign of the quantized residual.
这样,在编码端,基于量化残差绝对值的奇偶特性可以隐藏部分待编码值的符号,即无需对该部分符号进行编码,以降低属性信息编码时所使用的码字;而在解码端,根据解码得到的量化残差绝对值的奇偶特性可以直接确定出对应的符号;从而能够减少码字使用,提升点云属性的编解码效率,同时提高点云属性的编解码性能。In this way, on the encoding side, the parity characteristics based on the absolute value of the quantized residual can hide some symbols of the values to be encoded, that is, there is no need to encode these symbols, so as to reduce the codewords used when encoding attribute information; while on the decoding side, The corresponding symbol can be directly determined based on the parity and even characteristics of the absolute value of the quantized residual obtained by decoding; thus, the use of codewords can be reduced, the encoding and decoding efficiency of point cloud attributes can be improved, and the encoding and decoding performance of point cloud attributes can be improved.
下面将结合附图对本申请各实施例进行详细说明。Each embodiment of the present application will be described in detail below with reference to the accompanying drawings.
在本申请的一实施例中,参见图6,其示出了本申请实施例提供的一种解码方法的流程示意图。如图6所示,该方法可以包括:In an embodiment of the present application, see FIG. 6 , which shows a schematic flowchart of a decoding method provided by an embodiment of the present application. As shown in Figure 6, the method may include:
S601:解析码流,确定当前点的量化残差绝对值。S601: Analyze the code stream and determine the absolute value of the quantized residual at the current point.
需要说明的是,本申请实施例所述的解码方法具体是指点云解码方法,更具体地是一种基于符号隐藏的点云属性解码方法,为了进一步降低编码属性信息时所使用的码字。该方法可以应用于点云解码器(也可简称为“解码器”)。It should be noted that the decoding method described in the embodiment of the present application specifically refers to a point cloud decoding method, and more specifically a point cloud attribute decoding method based on symbol hiding, in order to further reduce the codewords used when encoding attribute information. This method can be applied to point cloud decoders (also simply called "decoders").
还需要说明的是,在本申请实施例中,待处理点云包括至少一个点。其中,对于待处理点云中的点,在对该点进行解码时,其可以作为待处理点云中的待解码点,而且该点的周围存在有多个已解码点。在这里,当前点即是这至少一个点中当前需要解码的待解码点。It should also be noted that in this embodiment of the present application, the point cloud to be processed includes at least one point. Among them, for a point in the point cloud to be processed, when decoding the point, it can be used as a point to be decoded in the point cloud to be processed, and there are multiple decoded points around the point. Here, the current point is the point to be decoded that currently needs to be decoded among the at least one point.
进一步地,在本申请实施例中,对于待处理点云中的每一个点,其对应一个几何信息和一个属性信息;其中,几何信息表征该点的空间关系,属性信息表征该点的属性信息。Further, in the embodiment of this application, for each point in the point cloud to be processed, it corresponds to a geometric information and an attribute information; wherein, the geometric information represents the spatial relationship of the point, and the attribute information represents the attribute information of the point. .
在这里,属性信息可以为颜色分量,也可以是反射率、折射率或者其它属性,本申请实施例不作具体限定。其中,当属性信息为颜色分量时,具体可以为任意颜色空间的颜色信息。示例性地,属性信息可以为RGB空间的颜色信息,也可以为YUV空间的颜色信息,还可以为YCbCr空间的颜色信息等等,本申请实施例也不作具体限定。Here, the attribute information may be a color component, or may be reflectance, refractive index, or other attributes, which are not specifically limited in the embodiments of this application. Wherein, when the attribute information is a color component, it can specifically be color information in any color space. For example, the attribute information may be color information in the RGB space, color information in the YUV space, color information in the YCbCr space, etc., which are not specifically limited in the embodiments of the present application.
在本申请实施例中,颜色分量可以包括下述至少之一:第一颜色分量、第二颜色分量和第三颜色分量。这样,如果颜色分量符合RGB颜色空间,那么可以确定第一颜色分量、第二颜色分量和第三颜色分量分别为其中之一:R分量、G分量、B分量;如果颜色分量符合YUV颜色空间,那么可以确定第一颜色分量、第二颜色分量和第三颜色分量分别为其中之一:Y分量、U分量、V分量;如果颜色分量符合YCbCr颜色空间,那么可以确定第一颜色分量、第二颜色分量和第三颜色分量分别为其中之一:Y分量、Cb分量、Cr分量。示例性地,对于RGB颜色空间而言,第一颜色分量可以为R分量,第二颜色分量可以为G分量,第三颜色分量可以为B分量;或者,第一颜色分量可以为G分量,第二颜色分量可以为B分量,第三颜色分量可以为R分量;或者,第一颜色分量可以为B分量,第二颜色分量可以为G分量,第三颜色分量可以为R分量等等,本申请实施例也不作具体限定。In the embodiment of the present application, the color component may include at least one of the following: a first color component, a second color component, and a third color component. In this way, if the color component conforms to the RGB color space, then it can be determined that the first color component, the second color component and the third color component are respectively one of them: R component, G component, B component; if the color component conforms to the YUV color space, Then it can be determined that the first color component, the second color component and the third color component are each one of them: Y component, U component, V component; if the color component conforms to the YCbCr color space, then it can be determined that the first color component, the second color component The color component and the third color component are each one of them: Y component, Cb component, Cr component. For example, for the RGB color space, the first color component may be the R component, the second color component may be the G component, and the third color component may be the B component; or, the first color component may be the G component, and the third color component may be the G component. The second color component may be the B component, and the third color component may be the R component; or, the first color component may be the B component, the second color component may be the G component, the third color component may be the R component, etc., this application The examples are not specifically limited either.
还需要说明的是,在本申请实施例中,解码器可以按照预设解码顺序来处理待处理点云中的每一个点。在一些实施例中,预设解码顺序可以为:点云原始采集顺序、莫顿顺序或者希尔伯特顺序等等,本申请实施例也不作具体限定。It should also be noted that in this embodiment of the present application, the decoder can process each point in the point cloud to be processed according to a preset decoding order. In some embodiments, the preset decoding order may be: the original collection order of point clouds, Morton order or Hilbert order, etc., which is not specifically limited in the embodiments of this application.
可以理解地,对于当前点而言,在解析码流时,可以直接获得当前点的量化残差绝对值。而对于是否需要通过解析码流来获得当前点对应的符号,还需要根据量化残差绝对值的大小进行判断。It can be understood that for the current point, when parsing the code stream, the absolute value of the quantization residual of the current point can be directly obtained. Whether it is necessary to parse the code stream to obtain the symbol corresponding to the current point also needs to be judged based on the absolute value of the quantization residual.
S602:在量化残差绝对值满足第一预设条件的情况下,根据量化残差绝对值的奇偶特性,确定当前点的量化残差的符号。S602: When the absolute value of the quantized residual satisfies the first preset condition, determine the sign of the quantized residual at the current point according to the parity characteristics of the absolute value of the quantized residual.
需要说明的是,在本申请实施例中,第一预设条件可以是预先设置的用于确定是否隐藏当前点对应符号的判断标准。示例性地,可以根据量化残差绝对值与预设阈值的比较结果来确定量化残差绝对值是否满足第一预设条件。因此,在一些实施例中,该方法还可以包括:It should be noted that, in this embodiment of the present application, the first preset condition may be a preset judgment standard for determining whether to hide the symbol corresponding to the current point. For example, whether the absolute value of the quantized residual satisfies the first preset condition may be determined based on a comparison result between the absolute value of the quantized residual and a preset threshold. Therefore, in some embodiments, the method may further include:
若量化残差绝对值大于或等于预设阈值,则确定量化残差绝对值满足第一预设条件;If the absolute value of the quantized residual is greater than or equal to the preset threshold, it is determined that the absolute value of the quantized residual satisfies the first preset condition;
若量化残差绝对值小于预设阈值,则确定量化残差绝对值不满足第一预设条件。If the absolute value of the quantized residual is less than the preset threshold, it is determined that the absolute value of the quantized residual does not meet the first preset condition.
在本申请实施例中,这里的预设阈值也可以看作是用于确定是否隐藏当前点对应符号的判断标准。在这里,预设阈值可以用signH表示,预设阈值的取值可以设置为4、5、6、8等。示例性地,预设阈值的取值等于4,但是并不作具体限定。另外,还需要注意的是,对于初始量化残差绝对值等于预设阈值的情况,可以是确定初始量化残差绝对值满足第一预设条件,或者也可以是确定初始量化残差绝对值不满足第一预设条件,这里不作具体限定。In the embodiment of the present application, the preset threshold here can also be regarded as a judgment criterion for determining whether to hide the symbol corresponding to the current point. Here, the preset threshold can be represented by signH, and the value of the preset threshold can be set to 4, 5, 6, 8, etc. For example, the value of the preset threshold is equal to 4, but this is not specifically limited. In addition, it should be noted that, for the situation where the absolute value of the initial quantized residual is equal to the preset threshold, it may be determined that the absolute value of the initial quantized residual satisfies the first preset condition, or it may be determined that the absolute value of the initial quantized residual does not The first preset condition is met, and there is no specific limitation here.
还需要说明的是,在量化残差绝对值满足第一预设条件的情况下,这时候隐藏了该量化残差的符号。在一种可能的实施例中,所述根据量化残差绝对值的奇偶特性,确定该量化残差的符号,可以包括:It should also be noted that when the absolute value of the quantized residual satisfies the first preset condition, the sign of the quantized residual is hidden at this time. In a possible embodiment, determining the sign of the quantized residual based on the parity characteristics of the absolute value of the quantized residual may include:
若量化残差绝对值为奇数,则确定符号为负号;If the absolute value of the quantized residual is an odd number, the sign is determined to be negative;
若量化残差绝对值为偶数,则确定符号为正号。If the absolute value of the quantized residual is an even number, the sign is determined to be positive.
在本申请实施例中,在确定隐藏该量化残差的符号的情况下,这时候解码端可以根据量化残差绝对值的奇偶特性来确定符号。示例性地,如果量化残差绝对值为奇数,那么可以确定符号为负号,即带符号的量化残差值为负奇数;和/或,如果量化残差绝对值为偶数,那么可以确定符号为正号,即带符号的量化残差值为正偶数。In the embodiment of the present application, when the symbol of the quantized residual is determined to be hidden, the decoding end can determine the symbol based on the parity characteristics of the absolute value of the quantized residual. For example, if the absolute value of the quantized residual is an odd number, then the sign can be determined to be a negative sign, that is, the signed quantized residual value is a negative odd number; and/or if the absolute value of the quantized residual is an even number, then the sign can be determined is a positive sign, that is, the signed quantized residual value is a positive even number.
在另一种可能的实施例中,所述根据量化残差绝对值的奇偶特性,确定当前点的量化残差的符号,可以包括:In another possible embodiment, determining the sign of the quantized residual at the current point based on the parity characteristics of the absolute value of the quantized residual may include:
若量化残差绝对值为奇数,则确定符号为正号;If the absolute value of the quantized residual is an odd number, the sign is determined to be positive;
若量化残差绝对值为偶数,则确定符号为负号。If the absolute value of the quantized residual is an even number, the sign is determined to be negative.
在本申请实施例中,在确定隐藏该量化残差的符号的情况下,这时候解码端仍可以根据量化残差绝对值的奇偶特性来确定符号。示例性地,如果量化残差绝对值为奇数,那么可以确定符号为正号,即带符号的量化残差值为正奇数;和/或,如果量化残差绝对值为偶数,那么可以确定符号为负号,即带符号的量化残差值为负偶数。In the embodiment of the present application, when the symbol of the quantized residual is determined to be hidden, the decoder can still determine the symbol based on the parity characteristics of the absolute value of the quantized residual. For example, if the absolute value of the quantized residual is an odd number, then the sign can be determined to be positive, that is, the signed quantized residual value is a positive odd number; and/or if the absolute value of the quantized residual is an even number, then the sign can be determined is a negative sign, that is, the signed quantized residual value is a negative even number.
还需要说明的是,在本申请实施例中,确定量化残差绝对值的奇偶特性,可以包括:对量化残差绝对值进行奇偶特性计算,得到奇偶值;若奇偶值等于第三值,则确定量化残差绝对值为奇数;和/或,若奇偶值等于第四值,则确定量化残差绝对值为偶数。It should also be noted that in the embodiment of the present application, determining the parity characteristics of the absolute value of the quantized residual may include: calculating the parity characteristics of the absolute value of the quantized residual to obtain the parity value; if the parity value is equal to the third value, then The absolute value of the quantized residual is determined to be an odd number; and/or, if the odd-even value is equal to the fourth value, the absolute value of the quantized residual is determined to be an even number.
在这里,第三值的取值等于1,第四值的取值等于0。示例性地,假定量化残差绝对值用resQ表示,奇偶值用parity表示。计算量化残差绝对值的奇偶值,parity=resQ%2。其中,如果parity=1,那么可以确定该量化残差绝对值为奇数;否则,如果parity=0,那么可以确定该量化残差绝对值为偶数。Here, the value of the third value is equal to 1, and the value of the fourth value is equal to 0. For example, it is assumed that the absolute value of the quantized residual is represented by resQ, and the parity value is represented by parity. Calculate the parity value of the absolute value of the quantized residual, parity=resQ%2. Among them, if parity=1, then it can be determined that the absolute value of the quantized residual is an odd number; otherwise, if parity=0, then it can be determined that the absolute value of the quantized residual is an even number.
还需要说明的是,在本申请实施例中,若带符号的量化残差值为大于零的奇数,则说明带符号的量化残差值为正奇数;若带符号的量化残差值为大于零的偶数,则说明带符号的量化残差值为正偶数;若带符号的量化残差值为小于零的奇数,则说明带符号的量化残差值为负奇数;若带符号的量化残差值为小于零的偶数,则说明带符号的量化残差值为负偶数。It should also be noted that in the embodiment of the present application, if the signed quantized residual value is an odd number greater than zero, it means that the signed quantized residual value is a positive odd number; if the signed quantized residual value is greater than If it is an even number of zero, it means that the signed quantized residual value is a positive even number; if the signed quantized residual value is an odd number less than zero, it means that the signed quantized residual value is a negative odd number; if the signed quantized residual value is an odd number If the difference is an even number less than zero, it means that the signed quantized residual value is a negative even number.
这样,对于量化残差绝对值满足第一预设条件的情况,解码端可以根据量化残差绝对值的奇偶特性来确定出当前点的量化残差的符号。然而,对于量化残差绝对值不满足第一预设条件的情况,在一些实施例中,该方法还可以包括:在量化残差绝对值不满足第一预设条件的情况下,解析码流,确定当前点的量化残差的符号。In this way, when the absolute value of the quantized residual satisfies the first preset condition, the decoder can determine the sign of the quantized residual at the current point based on the parity characteristics of the absolute value of the quantized residual. However, for the case where the absolute value of the quantized residual does not meet the first preset condition, in some embodiments, the method may also include: parsing the code stream when the absolute value of the quantized residual does not meet the first preset condition. , determine the sign of the quantized residual at the current point.
也就是说,在本申请实施例中,以预设阈值为例,如果量化残差绝对值小于预设阈值,即量化残差绝对值不满足第一预设条件,那么意味着该符号会写入码流,从而解码端可以通过解码获得该量化残差的符号。That is to say, in the embodiment of this application, taking the preset threshold as an example, if the absolute value of the quantized residual is less than the preset threshold, that is, the absolute value of the quantized residual does not meet the first preset condition, it means that the symbol will be written into the code stream, so that the decoder can obtain the symbol of the quantized residual through decoding.
在一种具体的实施例中,所述解析码流,确定当前点的量化残差的符号,可以包括:In a specific embodiment, analyzing the code stream and determining the sign of the quantized residual at the current point may include:
解析码流,获取符号标识信息的取值;Parse the code stream and obtain the value of the symbol identification information;
若符号标识信息的取值为第一值,则确定符号为正号;If the value of the symbol identification information is the first value, it is determined that the symbol is a positive sign;
若符号标识信息的取值为第二值,则确定符号为负号。If the value of the symbol identification information is the second value, it is determined that the symbol is a negative sign.
需要说明的是,在本申请实施例中,第一值可以为1,第二值可以为0;或者,第一值可以为0,第二值可以为1,这里不作任何限定。It should be noted that in this embodiment of the present application, the first value may be 1 and the second value may be 0; or, the first value may be 0 and the second value may be 1, without any limitation here.
还需要说明的是,在本申请实施例中,对于符号(正号或者负号)而言,编码端是按照符号标识信息的取值来写入码流中。这样,解码端通过解析码流,可以获得符号标识信息的取值;然后根据符号标识信息的取值来确定该符号是正号还是负号。示例性地,假定第一值为1,第二值为0,那么在解码获得符号标识信息的取值为1时,此时可以确定符号为正号;在解码获得符号标识信息的取值为0时,此时可以确定符号为负号。It should also be noted that in the embodiment of the present application, for symbols (positive signs or negative signs), the encoding end writes the symbols into the code stream according to the value of the symbol identification information. In this way, the decoding end can obtain the value of the symbol identification information by parsing the code stream; and then determine whether the symbol is a positive sign or a negative sign based on the value of the symbol identification information. For example, assuming that the first value is 1 and the second value is 0, then when the value of the symbol identification information obtained by decoding is 1, it can be determined that the symbol is a positive sign; when the value of the symbol identification information obtained by decoding is When 0, the sign can be determined to be negative.
S603:根据量化残差绝对值和符号,确定当前点的属性重建值。S603: Determine the attribute reconstruction value of the current point based on the absolute value and sign of the quantized residual.
需要说明的是,在确定当前点的属性重建值之前,该方法还可以包括:对当前点的属性信息进行预 测,确定当前点的属性预测值。It should be noted that before determining the attribute reconstruction value of the current point, the method may also include: predicting the attribute information of the current point and determining the attribute prediction value of the current point.
在本申请实施例中,使用预测算法对当前点的属性信息进行预测处理,可以得到当前点的属性预测值,用A j′表示。其中,j表示待处理点云中第j个点为当前点,预测算法也可以包括帧内预测算法和帧间预测算法。 In the embodiment of this application, a prediction algorithm is used to perform prediction processing on the attribute information of the current point, and the attribute prediction value of the current point can be obtained, which is represented by A j ′. Among them, j indicates that the jth point in the point cloud to be processed is the current point, and the prediction algorithm can also include an intra-frame prediction algorithm and an inter-frame prediction algorithm.
在一些实施例中,在得到当前点的属性预测值之后,所述根据量化残差绝对值和符号,确定当前点的属性重建值,可以包括:In some embodiments, after obtaining the attribute prediction value of the current point, determining the attribute reconstruction value of the current point based on the absolute value and sign of the quantized residual may include:
对量化残差绝对值进行反量化处理,得到解码残差值;Perform inverse quantization processing on the absolute value of the quantized residual to obtain the decoded residual value;
根据解码残差值和符号,确定带符号的解码残差值;Determine the signed decoding residual value based on the decoding residual value and sign;
根据属性预测值和带符号的解码残差值,确定当前点的属性重建值。Based on the attribute prediction value and the signed decoding residual value, the attribute reconstruction value of the current point is determined.
需要说明的是,在解码端,首先需要对量化残差绝对值进行反量化处理,得到解码残差值,可以用InvQ(resQ)表示;然后根据解码残差值和符号来确定带符号的解码残差值,可以用sign*InvQ(resQ)表示;这样,根据属性预测值和带符号的解码残差值,即可确定出当前点的属性重建值,可以用
Figure PCTCN2022103817-appb-000002
表示。
It should be noted that at the decoding end, the absolute value of the quantized residual needs to be inversely quantized first to obtain the decoded residual value, which can be represented by InvQ (resQ); then the signed decoding is determined based on the decoded residual value and symbol. The residual value can be represented by sign*InvQ(resQ); in this way, based on the attribute prediction value and the signed decoded residual value, the attribute reconstruction value of the current point can be determined. You can use
Figure PCTCN2022103817-appb-000002
express.
在一种可能的实施例中,所述根据属性预测值和带符号的解码残差值,确定当前点的属性重建值,可以包括:对属性预测值和带符号的解码残差值进行加法运算,得到当前点的属性重建值。In a possible embodiment, determining the attribute reconstruction value of the current point based on the attribute prediction value and the signed decoding residual value may include: performing an addition operation on the attribute prediction value and the signed decoding residual value. , get the attribute reconstruction value of the current point.
也就是说,通过对属性预测值和带符号的解码残差值进行加法运算,可以得到当前点的属性重建值。示例性地,计算公式如下,That is to say, by adding the attribute prediction value and the signed decoding residual value, the attribute reconstruction value of the current point can be obtained. For example, the calculation formula is as follows,
Figure PCTCN2022103817-appb-000003
Figure PCTCN2022103817-appb-000003
进一步地,如果属性信息为颜色分量,颜色分量可以包括下述至少之一:第一颜色分量、第二颜色分量和第三颜色分量。由于不同的颜色分量之间存在有关联关系,那么对于颜色分量而言,这里还可以包括跨分量属性预测值,用residualPrevComponent表示。因此,在一些实施例中,该方法还可以包括:在属性信息为颜色分量时,确定当前点的跨分量属性预测值。在这里,需要注意的是,如果属性信息为反射率、折射率等,由于反射率并没有包括多个分量,折射率也没有包括多个分量,那么对于反射率、折射率等属性信息,则不会存在跨分量属性预测值。Further, if the attribute information is a color component, the color component may include at least one of the following: a first color component, a second color component, and a third color component. Since there is a correlation between different color components, for the color components, the cross-component attribute prediction value can also be included, represented by residualPrevComponent. Therefore, in some embodiments, the method may further include: when the attribute information is a color component, determining a cross-component attribute prediction value of the current point. Here, it should be noted that if the attribute information is reflectivity, refractive index, etc., since the reflectance does not include multiple components, and the refractive index does not include multiple components, then for attribute information such as reflectivity, refractive index, etc., then There will be no cross-component attribute predictions.
在另一种可能的实施例中,在属性信息为颜色分量的情况下,所述根据属性预测值和带符号的解码残差值,确定当前点的属性重建值,可以包括:对属性预测值、带符号的解码残差值和跨分量属性预测值进行加法运算,得到当前点的属性重建值。In another possible embodiment, when the attribute information is a color component, determining the attribute reconstruction value of the current point based on the attribute prediction value and the signed decoding residual value may include: , the signed decoding residual value and the cross-component attribute prediction value are added to obtain the attribute reconstruction value of the current point.
也就是说,通过对属性预测值、跨分量属性预测值和带符号的解码残差值进行加法运算,可以得到当前点的属性重建值。示例性地,计算公式如下,That is to say, by adding the attribute prediction value, the cross-component attribute prediction value and the signed decoding residual value, the attribute reconstruction value of the current point can be obtained. For example, the calculation formula is as follows,
Figure PCTCN2022103817-appb-000004
Figure PCTCN2022103817-appb-000004
简单来说,在本申请实施例中,为了降低编码属性信息时所需的码字,可以引入根据量化残差绝对值的奇偶特性来隐藏部分待编码的符号;以使得在解码端,部分待编码的符号无需从码流中解码获得,从而减少了码字使用。To put it simply, in the embodiment of the present application, in order to reduce the number of codewords required when encoding attribute information, the parity characteristics according to the absolute value of the quantized residual can be introduced to hide part of the symbols to be encoded; so that at the decoding end, part of the symbols to be encoded are The encoded symbols do not need to be decoded from the code stream, thus reducing the use of code words.
本申请实施例提供了一种解码方法,通过解析码流,确定当前点的量化残差绝对值;在量化残差绝对值满足第一预设条件的情况下,根据量化残差绝对值的奇偶特性,确定当前点的量化残差的符号;根据量化残差绝对值和符号,确定当前点的属性重建值。这样,对于量化残差绝对值满足第一预设条件的情况,可以根据解码得到的量化残差绝对值的奇偶特性直接确定出对应的符号;从而能够减少码字使用,提升点云属性的编解码效率,同时提高点云属性的编解码性能。Embodiments of the present application provide a decoding method that determines the absolute value of the quantized residual at the current point by parsing the code stream; when the absolute value of the quantized residual satisfies the first preset condition, the absolute value of the quantized residual is determined based on the parity of the absolute value of the quantized residual. Characteristics, determine the sign of the quantized residual of the current point; determine the attribute reconstruction value of the current point based on the absolute value and sign of the quantized residual. In this way, for the situation where the absolute value of the quantized residual meets the first preset condition, the corresponding symbol can be directly determined based on the parity characteristics of the decoded absolute value of the quantized residual; thus, the use of codewords can be reduced and the encoding of point cloud attributes can be improved. Decoding efficiency, while improving the encoding and decoding performance of point cloud attributes.
在本申请的另一实施例中,基于前述实施例所述的解码方法,参见图7,其示出了本申请实施例提供的一种解码方法的详细流程示意图。如图7所示,以预设阈值为例,该详细流程可以包括:In another embodiment of the present application, based on the decoding method described in the previous embodiment, see FIG. 7 , which shows a detailed flowchart of a decoding method provided by the embodiment of the present application. As shown in Figure 7, taking the preset threshold as an example, the detailed process may include:
S701:解析码流,确定当前点的量化残差绝对值。S701: Analyze the code stream and determine the absolute value of the quantized residual at the current point.
S702:将量化残差绝对值与预设阈值进行比较。S702: Compare the absolute value of the quantized residual with the preset threshold.
S703:解析码流,确定当前点的量化残差的符号。S703: Analyze the code stream and determine the sign of the quantized residual at the current point.
S704:若量化残差绝对值为奇数,则符号为负号;和/或,若量化残差绝对值为偶数,则符号为正号。S704: If the absolute value of the quantized residual is an odd number, the sign is negative; and/or, if the absolute value of the quantized residual is an even number, the sign is positive.
S705:对量化残差绝对值进行反量化处理,得到解码残差值;以及根据解码残差值和符号确定带符号的解码残差值。S705: Perform inverse quantization processing on the absolute value of the quantized residual to obtain a decoded residual value; and determine a signed decoded residual value based on the decoded residual value and sign.
S706:确定当前点的属性预测值,根据属性预测值和带符号的解码残差值,确定当前点的属性重建值。S706: Determine the attribute prediction value of the current point, and determine the attribute reconstruction value of the current point based on the attribute prediction value and the signed decoding residual value.
需要说明的是,在本申请实施例中,对于S702来说,在将量化残差绝对值与预设阈值进行比较之后,如果量化残差绝对值大于或等于预设阈值,那么需要执行S704,根据量化残差绝对值的奇偶特性来确定符号,示例性地,若量化残差绝对值为奇数,则符号为负号;若量化残差绝对值为偶数,则符号 为正号;否则,如果量化残差绝对值小于预设阈值,那么需要执行S703,此时从码流中解码获得符号,示例性地,若符号的取值为第一值,则确定符号为正号;若符号的取值为第二值,则确定符号为负号。It should be noted that in this embodiment of the present application, for S702, after comparing the absolute value of the quantized residual with the preset threshold, if the absolute value of the quantized residual is greater than or equal to the preset threshold, then S704 needs to be executed, The sign is determined according to the odd and even characteristics of the absolute value of the quantized residual. For example, if the absolute value of the quantized residual is an odd number, the sign is negative; if the absolute value of the quantized residual is an even number, the sign is positive; otherwise, if If the absolute value of the quantized residual is less than the preset threshold, then S703 needs to be executed. At this time, the symbol is decoded from the code stream. For example, if the value of the symbol is the first value, it is determined that the symbol is a positive sign; if the value of the symbol is If the value is the second value, the sign is determined to be negative.
还需要说明的是,在本申请实施例中,对于颜色分量,需要针对第一颜色分量、第二颜色分量和第三颜色分量分别执行一次图7所示的解码流程,而且在确定当前点的属性重建值时,还需要额外获取跨分量属性预测值,对于S706来说,具体是对属性预测值、带符号的解码残差值和跨分量属性预测值进行加法运算,以得到当前点的属性重建值。在这里,对于反射率或者折射率等属性信息,则仅执行一次图7所示的解码流程,而且也无需额外获取跨分量属性预测值,对于S706来说,具体是属性预测值和带符号的解码残差值进行加法运算,以得到当前点的属性重建值。It should also be noted that in the embodiment of the present application, for the color components, the decoding process shown in Figure 7 needs to be executed once for the first color component, the second color component and the third color component respectively, and after determining the current point When reconstructing the attribute value, it is also necessary to obtain the cross-component attribute prediction value. For S706, specifically, the attribute prediction value, the signed decoding residual value and the cross-component attribute prediction value are added to obtain the attributes of the current point. Rebuild value. Here, for attribute information such as reflectivity or refractive index, the decoding process shown in Figure 7 is only executed once, and there is no need to obtain additional cross-component attribute prediction values. For S706, specifically the attribute prediction value and signed The decoded residual values are added to obtain the attribute reconstruction value of the current point.
还需要说明的是,在本申请实施例中,对于S704来说,除了若量化残差绝对值为奇数,则符号为负号;若量化残差绝对值为偶数,则符号为正号之外,还可以是:若量化残差绝对值为偶数,则符号为负号;若量化残差绝对值为奇数,则符号为正号。也就是说,对于如果根据量化残差绝对值的奇偶特性来确定符号,这里不作具体限定。It should also be noted that in the embodiment of the present application, for S704, in addition to if the absolute value of the quantized residual is an odd number, the sign is a negative sign; if the absolute value of the quantized residual is an even number, the sign is a positive sign. , it can also be: if the absolute value of the quantized residual is an even number, the sign is negative; if the absolute value of the quantized residual is an odd number, the sign is positive. In other words, if the sign is determined based on the parity characteristics of the absolute value of the quantized residual, there is no specific limit here.
在一种具体的实施例中,对于解码端,首先若属性信息为颜色分量,则对三个颜色分量分别执行一次下述步骤;若属性信息为反射率,则对反射率执行一次下述步骤。具体过程如下:In a specific embodiment, for the decoder, first, if the attribute information is a color component, the following steps are performed once for the three color components; if the attribute information is reflectance, the following steps are performed once for the reflectance. . The specific process is as follows:
a)采用预测算法得到属性预测值A j′; a) Use the prediction algorithm to obtain the attribute prediction value A j ′;
b)解码获取带符号的量化残差值,包括:b) Decode to obtain the signed quantized residual value, including:
1)先解析码流,获取量化残差绝对值;1) First parse the code stream and obtain the absolute value of the quantized residual;
2)将量化残差绝对值和预设阈值(用signH表示,如可设置为4)进行比较,若量化残差绝对值小于signH,则执行步骤3),否则执行步骤4);2) Compare the absolute value of the quantized residual with the preset threshold (represented by signH, for example, it can be set to 4). If the absolute value of the quantized residual is less than signH, proceed to step 3), otherwise proceed to step 4);
3)解析码流,获取该量化残差的符号sign;3) Parse the code stream and obtain the sign of the quantized residual;
4)若量化残差绝对值为奇数,则符号sign为负号;若量化残差绝对值为偶数,则符号sign为正号;4) If the absolute value of the quantized residual is an odd number, the sign sign is negative; if the absolute value of the quantized residual is an even number, the sign sign is positive;
c)对量化残差绝对值进行反量化,得到解码残差值InvQ(resQ);c) Inverse quantize the absolute value of the quantized residual to obtain the decoded residual value InvQ(resQ);
d)根据属性预测值、跨分量属性预测值、带符号的解码残差值sign*InvQ(resQ),获得属性重建值,如
Figure PCTCN2022103817-appb-000005
d) Obtain the attribute reconstruction value based on the attribute prediction value, the cross-component attribute prediction value, and the signed decoding residual value sign*InvQ(resQ), such as
Figure PCTCN2022103817-appb-000005
示例性地,以反射率的属性信息为例,表1为本申请实施例提供的一种在C1测试条件下的测试结果示意。其中,C1测试条件为几何有限度有损、属性有损(limit-lossy geometry,lossy attributes);通用测试序列为Cat1A和Cat1C;End-to-End BD-AttrRate表示端到端属性值针对属性码流的BD-Rate。BD-Rate反映的是两种情况(有无使用本申请实施例的技术方案)所得到峰值信噪比(Peak Signal to Noise Ratio,PSNR)曲线的差异,BD-Rate减少时,表示在PSNR相等的情况下,码率减少,性能提高;反之性能下降。即BD-Rate下降越多则压缩效果越好。由表1可以得到,BD-Rate为负值(即BD-Rate减少),那么意味着使用本申请实施例的技术方案后,可以减少码字,提高编解码性能。Illustratively, taking the attribute information of reflectivity as an example, Table 1 shows a test result under the C1 test condition provided by the embodiment of the present application. Among them, the C1 test condition is limited-lossy geometry, lossy attributes (limit-lossy geometry, lossy attributes); the general test sequence is Cat1A and Cat1C; End-to-End BD-AttrRate indicates that the end-to-end attribute value is based on the attribute code Streaming BD-Rate. BD-Rate reflects the difference in the Peak Signal to Noise Ratio (PSNR) curves obtained in two situations (with or without using the technical solution of the embodiment of the present application). When BD-Rate decreases, it means that the PSNR is equal In the case of , the code rate is reduced and the performance is improved; otherwise, the performance is reduced. That is, the more the BD-Rate decreases, the better the compression effect. It can be seen from Table 1 that the BD-Rate is a negative value (that is, the BD-Rate is reduced), which means that after using the technical solution of the embodiment of the present application, the codewords can be reduced and the encoding and decoding performance can be improved.
通过上述实施例,对前述实施例的具体实现进行详细阐述,根据前述实施例的技术方案,从中可以看出,本技术方案提供了一种基于符号隐藏的点云属性编解码方法,为了进一步降低编码属性信息所需的码字,可以引入根据奇偶性隐藏部分待编码值的符号,使得解码端根据解码得到的量化残差绝对值的奇偶特性即可确定出对应的符号;从而能够减少码字使用,提升点云属性的编解码效率,同时提高点云属性的编解码性能。Through the above embodiments, the specific implementation of the foregoing embodiments is elaborated in detail. According to the technical solutions of the foregoing embodiments, it can be seen that this technical solution provides a point cloud attribute encoding and decoding method based on symbol hiding. In order to further reduce The codewords required to encode attribute information can introduce symbols that hide part of the value to be encoded based on parity, so that the decoder can determine the corresponding symbol based on the parity characteristics of the absolute value of the quantized residual obtained by decoding; thus reducing codewords Use to improve the encoding and decoding efficiency of point cloud attributes and improve the encoding and decoding performance of point cloud attributes.
在本申请的又一实施例中,参见图8,其示出了本申请实施例提供的一种编码方法的流程示意图。如图8所示,该方法可以包括:In yet another embodiment of the present application, see FIG. 8 , which shows a schematic flowchart of an encoding method provided by an embodiment of the present application. As shown in Figure 8, the method may include:
S801:确定当前点的初始量化残差绝对值以及当前点的初始量化残差的符号。S801: Determine the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point.
需要说明的是,本申请实施例所述的编码方法具体是指点云编码方法,更具体地是一种基于符号隐藏的点云属性编码方法,为了进一步降低编码属性信息时所使用的码字。该方法可以应用于点云编码器(也可简称为“编码器”)。It should be noted that the encoding method described in the embodiment of the present application specifically refers to a point cloud encoding method, and more specifically, a point cloud attribute encoding method based on symbol hiding, in order to further reduce the number of codewords used when encoding attribute information. This method can be applied to point cloud encoders (also simply called "encoders").
还需要说明的是,在本申请实施例中,待处理点云包括至少一个点。其中,对于待处理点云中的点,在对该点进行编码时,其可以作为待处理点云中的待编码点,而且该点的周围存在有多个已编码点。在这里,当前点即是这至少一个点中当前需要编码的待编码点。It should also be noted that in this embodiment of the present application, the point cloud to be processed includes at least one point. Among them, for a point in the point cloud to be processed, when encoding the point, it can be used as a point to be encoded in the point cloud to be processed, and there are multiple encoded points around the point. Here, the current point is the point to be encoded that currently needs to be encoded among the at least one point.
进一步地,在本申请实施例中,对于待处理点云中的每一个点,其对应一个几何信息和一个属性信息;其中,几何信息表征该点的空间关系,属性信息表征该点的属性信息。Further, in the embodiment of the present application, for each point in the point cloud to be processed, it corresponds to a geometric information and an attribute information; wherein, the geometric information represents the spatial relationship of the point, and the attribute information represents the attribute information of the point. .
在这里,属性信息可以为颜色分量,也可以是反射率、折射率或者其它属性,本申请实施例不作具体限定。其中,当属性信息为颜色分量时,具体可以为任意颜色空间的颜色信息。示例性地,属性信息可以为RGB空间的颜色信息,也可以为YUV空间的颜色信息,还可以为YCbCr空间的颜色信息等等, 本申请实施例也不作具体限定。Here, the attribute information may be a color component, or may be reflectance, refractive index, or other attributes, which are not specifically limited in the embodiments of this application. Wherein, when the attribute information is a color component, it can specifically be color information in any color space. For example, the attribute information may be color information in RGB space, color information in YUV space, color information in YCbCr space, etc., which are not specifically limited in the embodiments of the present application.
在本申请实施例中,颜色分量可以包括下述至少之一:第一颜色分量、第二颜色分量和第三颜色分量。这样,如果颜色分量符合RGB颜色空间,那么可以确定第一颜色分量、第二颜色分量和第三颜色分量分别为其中之一:R分量、G分量、B分量;如果颜色分量符合YUV颜色空间,那么可以确定第一颜色分量、第二颜色分量和第三颜色分量分别为其中之一:Y分量、U分量、V分量;如果颜色分量符合YCbCr颜色空间,那么可以确定第一颜色分量、第二颜色分量和第三颜色分量分别为其中之一:Y分量、Cb分量、Cr分量。示例性地,对于RGB颜色空间而言,第一颜色分量可以为R分量,第二颜色分量可以为G分量,第三颜色分量可以为B分量;或者,第一颜色分量可以为G分量,第二颜色分量可以为B分量,第三颜色分量可以为R分量;或者,第一颜色分量可以为B分量,第二颜色分量可以为G分量,第三颜色分量可以为R分量等等,本申请实施例也不作具体限定。In the embodiment of the present application, the color component may include at least one of the following: a first color component, a second color component, and a third color component. In this way, if the color component conforms to the RGB color space, then it can be determined that the first color component, the second color component and the third color component are respectively one of them: R component, G component, B component; if the color component conforms to the YUV color space, Then it can be determined that the first color component, the second color component and the third color component are each one of them: Y component, U component, V component; if the color component conforms to the YCbCr color space, then it can be determined that the first color component, the second color component The color component and the third color component are each one of them: Y component, Cb component, Cr component. For example, for the RGB color space, the first color component may be the R component, the second color component may be the G component, and the third color component may be the B component; or, the first color component may be the G component, and the third color component may be the G component. The second color component may be the B component, and the third color component may be the R component; or, the first color component may be the B component, the second color component may be the G component, the third color component may be the R component, etc., this application The examples are not specifically limited either.
还需要说明的是,在本申请实施例中,解码器可以按照预设编码顺序来处理待处理点云中的每一个点。在一些实施例中,预设编码顺序可以为:点云原始采集顺序、莫顿顺序或者希尔伯特顺序等等,本申请实施例也不作具体限定。It should also be noted that in this embodiment of the present application, the decoder can process each point in the point cloud to be processed according to a preset encoding order. In some embodiments, the preset coding order may be: the original collection order of point clouds, Morton order, Hilbert order, etc., which is not specifically limited in the embodiments of this application.
可以理解地,对于当前点而言,可以获取到当前点的属性值(即原始值)。根据该属性值,可以确定出当前点的符号。具体地,如果该属性值大于零,那么可以说明符号为正号;否则,如果该属性值小于零,那么可以说明符号为负号。需要注意的是,这里的属性值是携带有正负号的。It can be understood that for the current point, the attribute value (ie, the original value) of the current point can be obtained. Based on this attribute value, the symbol of the current point can be determined. Specifically, if the attribute value is greater than zero, then the sign can be stated to be positive; otherwise, if the attribute value is less than zero, then the sign can be stated to be negative. It should be noted that the attribute values here carry positive and negative signs.
进一步地,对于当前点而言,需要先进行残差计算,以便确定出初始量化残差绝对值。在一些实施例中,所述确定当前点的初始量化残差绝对值,可以包括:Furthermore, for the current point, residual calculation needs to be performed first in order to determine the absolute value of the initial quantized residual. In some embodiments, determining the initial quantized residual absolute value of the current point may include:
对当前点的属性信息进行预测,确定当前点的属性预测值;Predict the attribute information of the current point and determine the attribute prediction value of the current point;
获取当前点的属性值,根据属性值和属性预测值进行残差计算,确定当前点的属性残差值;Obtain the attribute value of the current point, perform residual calculation based on the attribute value and attribute predicted value, and determine the attribute residual value of the current point;
对属性残差值进行量化处理并计算绝对值,得到当前点的初始量化残差绝对值。Quantify the attribute residual value and calculate the absolute value to obtain the initial quantized residual absolute value of the current point.
需要说明的是,在本申请实施例中,使用预测算法对当前点的属性信息进行预测处理,可以得到当前点的属性预测值,用A j′表示。其中,j表示待处理点云中第j个点为当前点,预测算法也可以包括帧内预测算法和帧间预测算法。 It should be noted that in this embodiment of the present application, a prediction algorithm is used to perform prediction processing on the attribute information of the current point, and the attribute prediction value of the current point can be obtained, which is represented by A j ′. Among them, j indicates that the jth point in the point cloud to be processed is the current point, and the prediction algorithm can also include an intra-frame prediction algorithm and an inter-frame prediction algorithm.
还需要说明的是,当前点的属性值用A j表示,当前点的属性残差值用res表示,那么对于res的确定,示例性地,计算公式如下, It should also be noted that the attribute value of the current point is represented by A j , and the attribute residual value of the current point is represented by res. Then for the determination of res, for example, the calculation formula is as follows,
res=A j-A j′         (5) res=A j -A j ′ (5)
这样,在得到属性残差值res之后,可以对属性残差值进行量化处理并求取绝对值,得到初始量化残差绝对值,可以用resQ表示。In this way, after obtaining the attribute residual value res, the attribute residual value can be quantized and the absolute value can be obtained to obtain the initial quantized residual absolute value, which can be expressed by resQ.
S802:在初始量化残差绝对值满足第一预设条件的情况下,根据符号和初始量化残差绝对值的奇偶特性,确定当前点的量化残差绝对值。S802: When the absolute value of the initial quantized residual meets the first preset condition, determine the absolute value of the quantized residual at the current point based on the sign and the parity characteristics of the initial quantized residual absolute value.
需要说明的是,在本申请实施例中,第一预设条件可以是预先设置的用于确定是否隐藏当前点对应符号的判断标准。示例性地,可以根据初始量化残差绝对值与预设阈值的比较结果来确定初始量化残差绝对值是否满足第一预设条件。因此,在一些实施例中,该方法还可以包括:It should be noted that, in this embodiment of the present application, the first preset condition may be a preset judgment standard for determining whether to hide the symbol corresponding to the current point. For example, whether the initial quantized residual absolute value satisfies the first preset condition may be determined based on a comparison result between the initial quantized residual absolute value and a preset threshold. Therefore, in some embodiments, the method may further include:
若初始量化残差绝对值大于或等于预设阈值,则确定初始量化残差绝对值满足第一预设条件;If the absolute value of the initial quantized residual is greater than or equal to the preset threshold, it is determined that the absolute value of the initial quantized residual satisfies the first preset condition;
若初始量化残差绝对值小于预设阈值,则确定初始量化残差绝对值不满足第一预设条件。If the absolute value of the initial quantized residual is less than the preset threshold, it is determined that the absolute value of the initial quantized residual does not meet the first preset condition.
在本申请实施例中,这里的预设阈值也可以看作是用于确定是否隐藏当前点对应符号的判断标准。在这里,预设阈值可以用signH表示,预设阈值的取值可以设置为4、5、6、8等。示例性地,预设阈值的取值等于4,但是并不作具体限定。另外,还需要注意的是,对于初始量化残差绝对值等于预设阈值的情况,可以是确定初始量化残差绝对值满足第一预设条件,或者也可以是确定初始量化残差绝对值不满足第一预设条件,这里不作具体限定。In the embodiment of the present application, the preset threshold here can also be regarded as a judgment criterion for determining whether to hide the symbol corresponding to the current point. Here, the preset threshold can be represented by signH, and the value of the preset threshold can be set to 4, 5, 6, 8, etc. For example, the value of the preset threshold is equal to 4, but this is not specifically limited. In addition, it should be noted that, for the situation where the absolute value of the initial quantized residual is equal to the preset threshold, it may be determined that the absolute value of the initial quantized residual satisfies the first preset condition, or it may be determined that the absolute value of the initial quantized residual does not The first preset condition is met, and there is no specific limitation here.
还需要说明的是,对于是否隐藏符号,编码端可以设置一个符号隐藏标识信息。因此,在一些实施例中,该方法还可以包括:It should also be noted that, regarding whether to hide symbols, the encoding end can set a symbol to hide identification information. Therefore, in some embodiments, the method may further include:
若初始量化残差绝对值大于或等于预设阈值,则设置符号隐藏标识信息的取值为第一值;If the absolute value of the initial quantized residual is greater than or equal to the preset threshold, then the value of the symbol hidden identification information is set to the first value;
若初始量化残差绝对值小于预设阈值,则设置符号隐藏标识信息的取值为第二值。If the absolute value of the initial quantized residual is less than the preset threshold, then the value of the symbol hidden identification information is set to the second value.
在本申请实施例中,第一值可以为1,第二值可以为0;或者,第一值可以为0,第二值可以为1;或者,第一值可以为true,第二值可以为false;或者,第一值可以为false,第二值可以为true;本申请实施例不作具体限定。In the embodiment of this application, the first value may be 1 and the second value may be 0; or the first value may be 0 and the second value may be 1; or the first value may be true and the second value may be is false; or, the first value can be false, and the second value can be true; there is no specific limitation in the embodiment of this application.
在本申请实施例中,符号隐藏标识信息的取值可以用于指示当前点是否隐藏该初始量化残差的符号。示例性地,假定第一值为true,第二值为false,那么若初始量化残差绝对值大于或等于预设阈值,则说明需要进行隐藏符号,这时候可以设置符号隐藏标识信息的取值为true;若初始量化残差绝对值小于预设阈值,则说明不需要进行隐藏符号,这时候可以设置符号隐藏标识信息的取值为false。In this embodiment of the present application, the value of the symbol hiding identification information may be used to indicate whether the current point hides the symbol of the initial quantized residual. For example, assuming that the first value is true and the second value is false, then if the absolute value of the initial quantization residual is greater than or equal to the preset threshold, it means that the symbol needs to be hidden. At this time, the value of the symbol hiding identification information can be set. is true; if the absolute value of the initial quantization residual is less than the preset threshold, it means that there is no need to hide the symbol. At this time, the value of the symbol hidden identification information can be set to false.
可以理解的是,在确定需要进行隐藏符号的情况下,这时候还需要确定初始量化残差绝对值的奇偶特性。因此,在一些实施例中,该方法还可以包括:在符号隐藏标识信息的取值为第一值时,确定初始量化残差绝对值的奇偶特性。It can be understood that when it is determined that symbols need to be hidden, it is also necessary to determine the parity characteristics of the absolute value of the initial quantization residual. Therefore, in some embodiments, the method may further include: when the value of the symbol hidden identification information is the first value, determining the parity characteristics of the absolute value of the initial quantization residual.
在一种具体的实施例中,所述确定初始量化残差绝对值的奇偶特性,可以包括:In a specific embodiment, determining the parity characteristics of the absolute value of the initial quantized residual may include:
对初始量化残差绝对值进行奇偶特性计算,得到奇偶值;Calculate the parity characteristics of the absolute value of the initial quantized residual to obtain the parity value;
若奇偶值等于第三值,则确定初始量化残差绝对值为奇数;If the parity value is equal to the third value, it is determined that the absolute value of the initial quantization residual is an odd number;
若奇偶值等于第四值,则确定初始量化残差绝对值为偶数。If the parity value is equal to the fourth value, it is determined that the absolute value of the initial quantization residual is an even number.
需要说明的是,在本申请实施例中,第三值的取值等于1,第四值的取值等于0。It should be noted that in this embodiment of the present application, the third value is equal to 1, and the fourth value is equal to 0.
示例性地,假定初始量化残差绝对值用resQ表示,奇偶值用parity表示。这时候,计算初始量化残差绝对值的奇偶值,parity=resQ%2。其中,如果parity=1,那么可以确定初始量化残差绝对值为奇数;否则,如果parity=0,那么可以确定初始量化残差绝对值为偶数。For example, it is assumed that the absolute value of the initial quantization residual is represented by resQ, and the parity value is represented by parity. At this time, calculate the parity value of the absolute value of the initial quantized residual, parity=resQ%2. Among them, if parity=1, then it can be determined that the absolute value of the initial quantized residual is an odd number; otherwise, if parity=0, then it can be determined that the absolute value of the initial quantized residual is an even number.
进一步地,在确定出初始量化残差绝对值的奇偶特性之后,在一些实施例中,所述根据符号和初始量化残差绝对值的奇偶特性,确定当前点的量化残差绝对值,可以包括:Further, after determining the parity characteristics of the initial quantized residual absolute value, in some embodiments, determining the quantized residual absolute value of the current point according to the sign and the parity characteristics of the initial quantized residual absolute value may include :
根据符号和初始量化残差绝对值的奇偶特性,确定带符号的初始量化残差是否满足第二预设条件;Determine whether the signed initial quantized residual satisfies the second preset condition according to the parity characteristics of the sign and the absolute value of the initial quantized residual;
若带符号的初始量化残差满足第二预设条件,则将初始量化残差绝对值确定为当前点的量化残差绝对值;If the signed initial quantized residual satisfies the second preset condition, then determine the absolute value of the initial quantized residual as the absolute value of the quantized residual at the current point;
若带符号的初始量化残差不满足第二预设条件,则根据初始量化残差绝对值和预设常数值,确定当前点的量化残差绝对值。If the signed initial quantized residual does not meet the second preset condition, then the absolute value of the quantized residual at the current point is determined based on the initial quantized residual absolute value and the preset constant value.
需要说明的是,在本申请实施例中,在得到带符号的初始量化残差之后,判断带符号的初始量化残差是否满足第二预设条件,例如带符号的初始量化残差是否为负奇数、正偶数等,如果带符号的初始量化残差满足第二预设条件,那么初始量化残差绝对值即为当前点的量化残差绝对值,根据量化残差绝对值的奇偶特性就可以确定出符号;和/或,如果带符号的初始量化残差不满足第二预设条件,那么需要对初始量化残差绝对值进行计算才能够确定当前点的量化残差绝对值,然后根据量化残差绝对值的奇偶特性就可以确定出符号。It should be noted that in the embodiment of the present application, after obtaining the signed initial quantized residual, it is determined whether the signed initial quantized residual satisfies the second preset condition, for example, whether the signed initial quantized residual is negative. Odd numbers, positive even numbers, etc. If the signed initial quantized residual meets the second preset condition, then the absolute value of the initial quantized residual is the absolute value of the quantized residual at the current point. According to the parity and even characteristics of the absolute value of the quantized residual, it can Determine the sign; and/or, if the signed initial quantized residual does not meet the second preset condition, then the absolute value of the initial quantized residual needs to be calculated to determine the absolute value of the quantized residual at the current point, and then according to the quantized The sign can be determined by the odd-even characteristic of the absolute value of the residual.
在一种可能的实施例中,所述根据符号和初始量化残差绝对值的奇偶特性,确定带符号的初始量化残差是否满足第二预设条件,可以包括:In a possible embodiment, determining whether the signed initial quantized residual satisfies the second preset condition based on the sign and the parity characteristics of the absolute value of the initial quantized residual may include:
根据符号和初始量化残差绝对值,得到带符号的初始量化残差;According to the sign and the absolute value of the initial quantized residual, the signed initial quantized residual is obtained;
若带符号的初始量化残差为大于零的偶数或者小于零的奇数,则确定带符号的初始量化残差满足第二预设条件;和/或,If the signed initial quantized residual is an even number greater than zero or an odd number less than zero, it is determined that the signed initial quantized residual satisfies the second preset condition; and/or,
若带符号的初始量化残差为大于零的奇数或者小于零的偶数,则确定带符号的初始量化残差不满足第二预设条件。If the signed initial quantized residual is an odd number greater than zero or an even number smaller than zero, it is determined that the signed initial quantized residual does not satisfy the second preset condition.
也就是说,在确定隐藏符号的情况下,这时候首先确定带符号的初始量化残差;然后,如果带符号的初始量化残差为正偶数(大于零的偶数)或者负奇数(小于零的奇数),那么可以确定带符号的初始量化残差满足第二预设条件。在这种情况下,符号无需写入码流中;对于解码端,如果解码获得的量化残差绝对值为偶数,那么可以确定符号为正号;如果解码获得的量化残差绝对值为奇数,那么可以确定符号为负号。That is to say, when the hidden symbol is determined, the signed initial quantized residual is first determined; then, if the signed initial quantized residual is a positive even number (an even number greater than zero) or a negative odd number (an even number less than zero) odd number), then it can be determined that the signed initial quantized residual satisfies the second preset condition. In this case, the symbol does not need to be written into the code stream; for the decoder, if the absolute value of the quantized residual obtained by decoding is an even number, then the symbol can be determined to be a positive sign; if the absolute value of the quantized residual obtained by decoding is an odd number, Then you can determine that the sign is negative.
在另一种可能的实施例中,所述根据符号和初始量化残差绝对值的奇偶特性,确定带符号的初始量化残差是否满足第二预设条件,可以包括:In another possible embodiment, determining whether the signed initial quantized residual satisfies the second preset condition based on the sign and the parity characteristics of the absolute value of the initial quantized residual may include:
根据符号和初始量化残差绝对值,得到带符号的初始量化残差;According to the sign and the absolute value of the initial quantized residual, the signed initial quantized residual is obtained;
若带符号的初始量化残差为大于零的奇数或者小于零的偶数,则确定带符号的初始量化残差满足第二预设条件;和/或,If the signed initial quantized residual is an odd number greater than zero or an even number less than zero, it is determined that the signed initial quantized residual satisfies the second preset condition; and/or,
若带符号的初始量化残差为大于零的偶数或者小于零的奇数,则确定带符号的初始量化残差不满足第二预设条件。If the signed initial quantized residual is an even number greater than zero or an odd number smaller than zero, it is determined that the signed initial quantized residual does not satisfy the second preset condition.
也就是说,在确定隐藏符号的情况下,这时候首先确定带符号的初始量化残差;然后,如果带符号的初始量化残差为正奇数(大于零的奇数)或者负偶数(小于零的偶数),那么可以确定带符号的初始量化残差满足第二预设条件。在这种情况下,符号也无需写入码流中;对于解码端,如果解码获得的量化残差绝对值为偶数,那么可以确定符号为负号;如果解码获得的量化残差绝对值为奇数,那么可以确定符号为正号。That is to say, when the hidden symbol is determined, the signed initial quantized residual is first determined at this time; then, if the signed initial quantized residual is a positive odd number (an odd number greater than zero) or a negative even number (an odd number less than zero) even), then it can be determined that the signed initial quantized residual satisfies the second preset condition. In this case, the symbol does not need to be written into the code stream; for the decoder, if the absolute value of the quantized residual obtained by decoding is an even number, then the symbol can be determined to be a negative sign; if the absolute value of the quantized residual obtained by decoding is an odd number , then the sign can be determined to be positive.
进一步地,在一些实施例中,该方法还可以包括:Further, in some embodiments, the method may also include:
若符号为正号,且初始量化残差绝对值为奇数,则确定带符号的初始量化残差为大于零的奇数;If the sign is positive and the absolute value of the initial quantized residual is an odd number, then the signed initial quantized residual is determined to be an odd number greater than zero;
若符号为负号,且初始量化残差绝对值为奇数,则确定带符号的初始量化残差为小于零的奇数;If the sign is negative and the absolute value of the initial quantized residual is an odd number, then the signed initial quantized residual is determined to be an odd number less than zero;
若符号为正号,且初始量化残差绝对值为偶数,则确定带符号的初始量化残差为大于零的偶数;If the sign is positive and the absolute value of the initial quantized residual is an even number, then the signed initial quantized residual is determined to be an even number greater than zero;
若符号为负号,且初始量化残差绝对值为偶数,则确定带符号的初始量化残差为小于零的偶数。If the sign is negative and the absolute value of the initial quantized residual is an even number, then the signed initial quantized residual is determined to be an even number less than zero.
也就是说,在本申请实施例中,如果符号为正号,且初始量化残差绝对值为奇数,那么可以确定带符号的初始量化残差为大于零的奇数,也可称之为正奇数;如果符号为负号,且初始量化残差绝对值为奇数,那么可以确定带符号的初始量化残差为小于零的奇数,也可称之为负奇数;如果符号为正号,且初始量化残差绝对值为偶数,那么可以确定带符号的初始量化残差为大于零的偶数,也可称之为正偶数;如果符号为负号,且初始量化残差绝对值为偶数,那么可以确定带符号的初始量化残差为小于零的偶数,也可称之为负偶数。That is to say, in the embodiment of the present application, if the sign is positive and the absolute value of the initial quantized residual is an odd number, then it can be determined that the signed initial quantized residual is an odd number greater than zero, which can also be called a positive odd number. ; If the sign is negative, and the absolute value of the initial quantization residual is an odd number, then it can be determined that the signed initial quantization residual is an odd number less than zero, which can also be called a negative odd number; if the sign is positive, and the initial quantization If the absolute value of the residual is an even number, then it can be determined that the signed initial quantized residual is an even number greater than zero, which can also be called a positive even number; if the sign is negative, and the absolute value of the initial quantized residual is an even number, then it can be determined The signed initial quantized residual is an even number less than zero, which can also be called a negative even number.
进一步地,在带符号的初始量化残差不满足第二预设条件的情况下,在一些实施例中,所述根据所述初始量化残差绝对值和预设常数值,确定所述当前点的量化残差绝对值,可以包括:Further, in the case where the signed initial quantized residual does not meet the second preset condition, in some embodiments, the current point is determined based on the absolute value of the initial quantized residual and the preset constant value. The absolute value of the quantized residual can include:
根据初始量化残差绝对值和预设常数值进行加法计算,得到第一候选量化残差绝对值;Perform an addition calculation based on the initial quantized residual absolute value and the preset constant value to obtain the first candidate quantized residual absolute value;
根据初始量化残差绝对值和预设常数值进行减法计算,得到第二候选量化残差绝对值;Perform subtraction calculation based on the initial quantized residual absolute value and the preset constant value to obtain the second candidate quantized residual absolute value;
基于第一候选量化残差绝对值和第二候选量化残差绝对值,确定当前点的量化残差绝对值。Based on the first candidate quantized residual absolute value and the second candidate quantized residual absolute value, the quantized residual absolute value of the current point is determined.
需要说明的是,在本申请实施例中,预设常数值的取值可以为1,但是也可以是其他数值,这里并不作具体限定。It should be noted that in the embodiment of the present application, the value of the preset constant value may be 1, but it may also be other values, and is not specifically limited here.
还需要说明的是,在本申请实施例中,如果带符号的初始量化残差不满足第二预设条件,那么需要对初始量化残差绝对值和预设常数值进行计算,例如加一计算、减一计算等等。这样,可以得到两个候选值:第一候选量化残差绝对值和第二候选量化残差绝对值。其中,前者可以是初始量化残差绝对值进行加一计算得到,用resQ +表示;后者可以是初始量化残差绝对值进行减一计算得到,用resQ -表示。然后通过进行失真代价计算,从resQ +和resQ -中确定当前点的量化残差绝对值。 It should also be noted that in the embodiment of the present application, if the signed initial quantized residual does not meet the second preset condition, then the absolute value of the initial quantized residual and the preset constant value need to be calculated, for example, plus one calculation. , minus one calculation and so on. In this way, two candidate values can be obtained: the first candidate quantization residual absolute value and the second candidate quantization residual absolute value. Among them, the former can be calculated by adding one to the absolute value of the initial quantized residual, represented by resQ + ; the latter can be calculated by subtracting one from the absolute value of the initial quantized residual, represented by resQ - . The absolute value of the quantized residual at the current point is then determined from resQ + and resQ- by performing a distortion cost calculation.
在一种具体的实施例中,所述基于第一候选量化残差绝对值和第二候选量化残差绝对值,确定当前点的量化残差绝对值,可以包括:In a specific embodiment, determining the absolute value of the quantized residual at the current point based on the first candidate quantized residual absolute value and the second candidate quantized residual absolute value may include:
根据第一候选量化残差绝对值、符号和属性预测值,确定第一候选属性重建值;以及对第一候选属性重建值和属性值进行失真代价计算,得到第一代价值;Determine the first candidate attribute reconstruction value according to the first candidate quantized residual absolute value, sign and attribute prediction value; and perform distortion cost calculation on the first candidate attribute reconstruction value and attribute value to obtain the first generation value;
根据第二候选量化残差绝对值、符号和属性预测值,确定第二候选属性重建值;以及对第二候选属性重建值和属性值进行失真代价计算,得到第二代价值;Determine the second candidate attribute reconstruction value according to the second candidate quantized residual absolute value, sign and attribute prediction value; and perform distortion cost calculation on the second candidate attribute reconstruction value and attribute value to obtain the second generation value;
根据第一代价值和第二代价值,从第一候选量化残差绝对值和第二候选量化残差绝对值中确定当前点的量化残差绝对值。Based on the first generation value and the second generation value, the quantization residual absolute value of the current point is determined from the first candidate quantization residual absolute value and the second candidate quantization residual absolute value.
在这里,首先需要使用预测算法确定出当前点的属性预测值;然后根据第一候选量化残差绝对值、符号和属性预测值,确定出第一候选属性重建值,以便根据第一候选属性重建值和属性值计算出第一代价值;以及根据第二候选量化残差绝对值、符号和属性预测值,确定出第二候选属性重建值,以便根据第二候选属性重建值和属性值计算出第二代价值。Here, you first need to use a prediction algorithm to determine the attribute prediction value of the current point; then determine the first candidate attribute reconstruction value based on the first candidate quantized residual absolute value, sign, and attribute prediction value, so as to reconstruct based on the first candidate attribute and attribute values; and determining a second candidate attribute reconstruction value based on the second candidate quantized residual absolute value, sign, and attribute prediction value, so that the second candidate attribute reconstruction value and the attribute value are calculated Second generation value.
在一种可能的实施例中,对于第一候选属性重建值(用
Figure PCTCN2022103817-appb-000006
表示)的确定,在一些实施例中,所述根据第一候选量化残差绝对值、符号和属性预测值,确定第一候选属性重建值,可以包括:
In one possible embodiment, for the first candidate attribute the value is reconstructed (using
Figure PCTCN2022103817-appb-000006
representation), in some embodiments, determining the first candidate attribute reconstruction value based on the first candidate quantized residual absolute value, sign and attribute prediction value may include:
对第一候选量化残差绝对值进行反量化处理,得到第一候选重建残差绝对值;Perform inverse quantization processing on the first candidate quantized residual absolute value to obtain the first candidate reconstructed residual absolute value;
根据符号和第一候选重建残差绝对值,得到带符号的第一候选重建残差;According to the sign and the absolute value of the first candidate reconstruction residual, the signed first candidate reconstruction residual is obtained;
对带符号的第一候选重建残差和属性预测值进行加法运算,得到第一候选属性重建值。The first candidate attribute reconstruction value is obtained by adding the signed first candidate reconstruction residual and the attribute prediction value.
在编码端,首先需要对第一候选量化残差绝对值进行反量化处理,以得到第一候选重建残差绝对值,用InvQ(resQ +)表示;然后根据符号和第一候选重建残差绝对值,这时候带符号的第一候选重建残差可以用sign*InvQ(resQ +)表示;最后通过对带符号的第一候选重建残差和属性预测值进行加法运算,可以得到第一候选属性重建值。示例性地,计算公式如下: On the encoding side, the first candidate quantized residual absolute value needs to be inversely quantized first to obtain the first candidate reconstructed residual absolute value, represented by InvQ(resQ + ); then according to the sign and the first candidate reconstructed residual absolute value value, at this time the signed first candidate reconstruction residual can be represented by sign*InvQ(resQ + ); finally, by adding the signed first candidate reconstruction residual and the attribute prediction value, the first candidate attribute can be obtained Rebuild value. For example, the calculation formula is as follows:
Figure PCTCN2022103817-appb-000007
Figure PCTCN2022103817-appb-000007
对于第二候选属性重建值(用
Figure PCTCN2022103817-appb-000008
表示)的确定,在一些实施例中,所述根据第二候选量化残差绝对值、符号和属性预测值,确定第二候选属性重建值,可以包括:
For the second candidate attribute reconstruction value (using
Figure PCTCN2022103817-appb-000008
representation), in some embodiments, determining the second candidate attribute reconstruction value based on the second candidate quantized residual absolute value, sign, and attribute prediction value may include:
对第二候选量化残差绝对值进行反量化处理,得到第二候选重建残差绝对值;Perform inverse quantization processing on the second candidate quantized residual absolute value to obtain the second candidate reconstructed residual absolute value;
根据符号和第二候选重建残差绝对值,得到带符号的第二候选重建残差;According to the sign and the absolute value of the second candidate reconstruction residual, the signed second candidate reconstruction residual is obtained;
对带符号的第二候选重建残差和属性预测值进行加法运算,得到第二候选属性重建值。An addition operation is performed on the signed second candidate reconstruction residual and the attribute prediction value to obtain the second candidate attribute reconstruction value.
在编码端,首先还需要对第二候选量化残差绝对值进行反量化处理,以得到第二候选重建残差绝对值,用InvQ(resQ -)表示;然后根据符号和第二候选重建残差绝对值,这时候带符号的第二候选重建残差可以用sign*InvQ(resQ -)表示;最后通过对带符号的第二候选重建残差和属性预测值进行加法运算,可以得到第二候选属性重建值。示例性地,计算公式如下: On the encoding side, it is first necessary to perform inverse quantization processing on the absolute value of the second candidate quantization residual to obtain the absolute value of the second candidate reconstruction residual, represented by InvQ (resQ - ); then according to the sign and the second candidate reconstruction residual Absolute value, at this time, the signed second candidate reconstruction residual can be represented by sign*InvQ(resQ - ); finally, by adding the signed second candidate reconstruction residual and the attribute prediction value, the second candidate can be obtained Property reconstruction value. For example, the calculation formula is as follows:
Figure PCTCN2022103817-appb-000009
Figure PCTCN2022103817-appb-000009
进一步地,如果属性信息为颜色分量,颜色分量包括下述至少之一:第一颜色分量、第二颜色分量和第三颜色分量;由于不同的颜色分量之间存在有关联关系,那么对于颜色分量而言,这里还可以包括跨分量属性预测值,用residualPrevComponent表示。因此,在一些实施例中,该方法还可以包括:在属性信息为颜色分量时,确定当前点的跨分量属性预测值。在这里,需要注意的是,如果属性信息为反射率、折射率等,由于反射率并没有包括多个分量,折射率也没有包括多个分量,那么对于反射率、折射率等属性信息,则不会存在跨分量属性预测值。Further, if the attribute information is a color component, the color component includes at least one of the following: a first color component, a second color component, and a third color component; since there is an association between different color components, then for the color component Specifically, cross-component attribute prediction values can also be included here, represented by residualPrevComponent. Therefore, in some embodiments, the method may further include: when the attribute information is a color component, determining a cross-component attribute prediction value of the current point. Here, it should be noted that if the attribute information is reflectivity, refractive index, etc., since the reflectance does not include multiple components, and the refractive index does not include multiple components, then for attribute information such as reflectivity, refractive index, etc., then There will be no cross-component attribute predictions.
还需要说明的是,如果属性信息为颜色分量,那么在确定当前点的属性残差值时还需要减去跨分量属性预测值,然后再进行量化处理并求取绝对值,以得到当前点的初始量化残差绝对值。相应地,在一些实施例中,所述根据属性值和属性预测值进行残差计算,确定当前点的属性残差值,可以包括:根据属性值、属性预测值和跨分量属性预测值进行残差计算,确定当前点的属性残差值。It should also be noted that if the attribute information is a color component, then when determining the attribute residual value of the current point, it is also necessary to subtract the cross-component attribute prediction value, and then perform quantization processing and obtain the absolute value to obtain the current point's The absolute value of the initial quantized residual. Correspondingly, in some embodiments, performing residual calculation based on the attribute value and attribute predicted value to determine the attribute residual value of the current point may include: performing residual calculation based on the attribute value, attribute predicted value and cross-component attribute predicted value. Difference calculation to determine the attribute residual value of the current point.
在本申请实施例中,当前点的属性值用A j表示,当前点的属性预测值用A j′表示,当前点的跨分量属性预测值用residualPrevComponent表示,当前点的属性残差值仍用res表示,那么对于res的确定,示例性地,计算公式如下, In the embodiment of this application, the attribute value of the current point is represented by A j , the attribute prediction value of the current point is represented by A j ′, the cross-component attribute prediction value of the current point is represented by residualPrevComponent, and the attribute residual value of the current point is still represented by res represents, then for the determination of res, for example, the calculation formula is as follows,
res=A j-A j′-residualPrevComponent        (8) res=A j -A j ′-residualPrevComponent (8)
这样,在得到属性残差值res之后,可以对属性残差值进行量化处理并求取绝对值,从而得到初始量化残差绝对值;通过对初始量化残差绝对值进行加一、减一计算,可以得到第一候选量化残差绝对值(resQ +)和第二候选量化残差绝对值(resQ -)。 In this way, after obtaining the attribute residual value res, the attribute residual value can be quantized and the absolute value can be obtained, thereby obtaining the initial quantized residual absolute value; the initial quantized residual absolute value can be calculated by adding one and subtracting one. , the first candidate quantization residual absolute value (resQ + ) and the second candidate quantization residual absolute value (resQ - ) can be obtained.
在另一种可能的实施例中,对于第一候选属性重建值(用
Figure PCTCN2022103817-appb-000010
表示)的确定,在一些实施例中,所述根据第一候选量化残差绝对值、符号和属性预测值,确定第一候选属性重建值,可以包括:
In another possible embodiment, for the first candidate attribute the value is reconstructed (using
Figure PCTCN2022103817-appb-000010
representation), in some embodiments, determining the first candidate attribute reconstruction value based on the first candidate quantized residual absolute value, sign and attribute prediction value may include:
对第一候选量化残差绝对值进行反量化处理,得到第一候选重建残差绝对值;Perform inverse quantization processing on the first candidate quantized residual absolute value to obtain the first candidate reconstructed residual absolute value;
根据符号和第一候选重建残差绝对值,得到带符号的第一候选重建残差;According to the sign and the absolute value of the first candidate reconstruction residual, the signed first candidate reconstruction residual is obtained;
对带符号的第一候选重建残差、属性预测值和跨分量属性预测值进行加法运算,得到第一候选属性重建值。The first candidate attribute reconstruction value is obtained by adding the signed first candidate reconstruction residual, the attribute prediction value, and the cross-component attribute prediction value.
在编码端,首先需要对第一候选量化残差绝对值进行反量化处理,以得到第一候选重建残差绝对值,用InvQ(resQ +)表示;然后根据符号和第一候选重建残差绝对值,这时候带符号的第一候选重建残差可以用sign*InvQ(resQ +)表示;最后通过对带符号的第一候选重建残差、属性预测值和跨分量属性预测值进行加法运算,可以得到第一候选属性重建值。示例性地,计算公式如下: On the encoding side, the first candidate quantized residual absolute value needs to be inversely quantized first to obtain the first candidate reconstructed residual absolute value, represented by InvQ(resQ + ); then according to the sign and the first candidate reconstructed residual absolute value value, at this time the signed first candidate reconstruction residual can be represented by sign*InvQ(resQ + ); finally, by adding the signed first candidate reconstruction residual, attribute prediction value and cross-component attribute prediction value, The first candidate attribute reconstruction value can be obtained. For example, the calculation formula is as follows:
Figure PCTCN2022103817-appb-000011
Figure PCTCN2022103817-appb-000011
对于第二候选属性重建值(用
Figure PCTCN2022103817-appb-000012
表示)的确定,在一些实施例中,所述根据第二候选量化残差绝对值、符号和属性预测值,确定第二候选属性重建值,可以包括:
For the second candidate attribute reconstruction value (using
Figure PCTCN2022103817-appb-000012
representation), in some embodiments, determining the second candidate attribute reconstruction value based on the second candidate quantized residual absolute value, sign, and attribute prediction value may include:
对第二候选量化残差绝对值进行反量化处理,得到第二候选重建残差绝对值;Perform inverse quantization processing on the second candidate quantized residual absolute value to obtain the second candidate reconstructed residual absolute value;
根据符号和第二候选重建残差绝对值,得到带符号的第二候选重建残差;According to the sign and the absolute value of the second candidate reconstruction residual, the signed second candidate reconstruction residual is obtained;
对带符号的第二候选重建残差、属性预测值和跨分量属性预测值进行加法运算,得到第二候选属性重建值。The second candidate attribute reconstruction value is obtained by adding the signed second candidate reconstruction residual, the attribute prediction value, and the cross-component attribute prediction value.
在编码端,首先还需要对第二候选量化残差绝对值进行反量化处理,以得到第二候选重建残差绝对值,用InvQ(resQ -)表示;然后根据符号和第二候选重建残差绝对值,这时候带符号的第二候选重建残差可以用sign*InvQ(resQ -)表示;最后通过对带符号的第二候选重建残差、属性预测值和跨分量属性预测值进行加法运算,可以得到第二候选属性重建值。示例性地,计算公式如下: On the encoding side, it is first necessary to perform inverse quantization processing on the absolute value of the second candidate quantization residual to obtain the absolute value of the second candidate reconstruction residual, represented by InvQ (resQ - ); then according to the sign and the second candidate reconstruction residual Absolute value. At this time, the signed second candidate reconstruction residual can be represented by sign*InvQ(resQ - ); finally, the signed second candidate reconstruction residual, attribute prediction value and cross-component attribute prediction value are added. , the second candidate attribute reconstruction value can be obtained. For example, the calculation formula is as follows:
Figure PCTCN2022103817-appb-000013
Figure PCTCN2022103817-appb-000013
这样,在得到第一候选属性重建值和第二候选属性重建值之后,可以计算这两个候选值分别对应的第一代价值和第二代价值;然后根据第一代价值和第二代价值,从resQ +和resQ -确定出最终的量化残差绝对值。 In this way, after obtaining the first candidate attribute reconstruction value and the second candidate attribute reconstruction value, the first-generation value and the second-generation value corresponding to these two candidate values can be calculated; then based on the first-generation value and the second-generation value , the final absolute value of the quantized residual is determined from resQ + and resQ - .
在一种可能的实施例中,对于第一代价值的确定,所述对第一候选属性重建值和属性值进行失真代价计算,得到第一代价值,可以包括:根据第一候选属性重建值和属性值进行差值的绝对值计算,得到第一差值绝对值,将第一差值绝对值作为第一代价值。In a possible embodiment, for determining the first generation value, calculating the distortion cost of the first candidate attribute reconstruction value and the attribute value to obtain the first generation value may include: reconstructing the value according to the first candidate attribute Calculate the absolute value of the difference with the attribute value to obtain the first absolute value of the difference, and use the first absolute value of the difference as the first generation value.
对于第二代价值的确定,所述对第二候选属性重建值和属性值进行失真代价计算,得到第二代价值,可以包括:根据第二候选属性重建值和属性值进行差值的绝对值计算,得到第二差值绝对值,将第二差值绝对值作为第二代价值。For the determination of the second generation value, calculating the distortion cost of the second candidate attribute reconstruction value and the attribute value to obtain the second generation value may include: calculating the absolute value of the difference based on the second candidate attribute reconstruction value and the attribute value. Calculate and obtain the absolute value of the second difference, and use the absolute value of the second difference as the second generation value.
需要说明的是,在本申请实施例中,第一代价值可以用cost +表示,第二代价值可以用cost -表示。以失真代价为例,对于第一代价值的计算公式可以如下, It should be noted that in the embodiment of the present application, the first-generation value can be expressed as cost + , and the second-generation value can be expressed as cost - . Taking the distortion cost as an example, the calculation formula for the first-generation value can be as follows,
Figure PCTCN2022103817-appb-000014
Figure PCTCN2022103817-appb-000014
对于第二代价值的计算公式可以如下,The calculation formula for the second generation value can be as follows,
Figure PCTCN2022103817-appb-000015
Figure PCTCN2022103817-appb-000015
其中,abs(x)表示x的绝对值。Among them, abs(x) represents the absolute value of x.
在另一种可能的实施例中,对于第一代价值的确定,所述对第一候选属性重建值和属性值进行失真代价计算,得到第一代价值,可以包括:In another possible embodiment, for determining the first generation value, calculating the distortion cost on the first candidate attribute reconstruction value and the attribute value to obtain the first generation value may include:
根据第一候选属性重建值和属性值进行差值的绝对值计算,得到第一差值绝对值;Calculate the absolute value of the difference based on the first candidate attribute reconstruction value and the attribute value to obtain the first absolute value of the difference;
对第一差值绝对值和第一候选量化残差绝对值进行加法运算,得到第一代价值。The first generation value is obtained by adding the first difference absolute value and the first candidate quantized residual absolute value.
对于第二代价值的确定,所述对第二候选属性重建值和属性值进行失真代价计算,得到第二代价值,可以包括:For the determination of the second generation value, the calculation of the distortion cost of the second candidate attribute reconstruction value and the attribute value to obtain the second generation value may include:
根据第二候选属性重建值和属性值进行差值的绝对值计算,得到第二差值绝对值;Calculate the absolute value of the difference based on the second candidate attribute reconstruction value and the attribute value to obtain the second absolute value of the difference;
对第二差值绝对值和第二候选量化残差绝对值进行加法运算,得到第二代价值。The second difference absolute value and the second candidate quantized residual absolute value are added to obtain the second generation value.
需要说明的是,在本申请实施例中,第一代价值可以用cost +表示,第二代价值可以用cost -表示。以率失真代价为例,对于第一代价值的计算公式还可以如下, It should be noted that in the embodiment of the present application, the first-generation value can be expressed as cost + , and the second-generation value can be expressed as cost - . Taking the rate distortion cost as an example, the calculation formula for the first generation value can also be as follows,
Figure PCTCN2022103817-appb-000016
Figure PCTCN2022103817-appb-000016
对于第二代价值的计算公式还可以如下,The calculation formula for the second generation value can also be as follows,
Figure PCTCN2022103817-appb-000017
Figure PCTCN2022103817-appb-000017
其中,abs(x)表示x的绝对值。Among them, abs(x) represents the absolute value of x.
在又一种可能的实施例中,对于第一代价值的确定,所述对第一候选属性重建值和属性值进行失真代价计算,得到第一代价值,可以包括:In yet another possible embodiment, for determining the first-generation value, calculating the distortion cost on the first candidate attribute reconstruction value and the attribute value to obtain the first-generation value may include:
根据第一候选属性重建值和属性值进行差值的绝对值计算,得到第一差值绝对值;Calculate the absolute value of the difference based on the first candidate attribute reconstruction value and the attribute value to obtain the first absolute value of the difference;
确定第一因子和第二因子;Determine the first factor and the second factor;
根据第一因子和第二因子对第一差值绝对值与第一候选量化残差绝对值进行加权和运算,得到第一代价值。The first generation value is obtained by performing a weighted sum operation on the absolute value of the first difference and the absolute value of the first candidate quantization residual according to the first factor and the second factor.
对于第二代价值的确定,所述对第二候选属性重建值和属性值进行失真代价计算,得到第二代价值,可以包括:For the determination of the second generation value, the calculation of the distortion cost of the second candidate attribute reconstruction value and the attribute value to obtain the second generation value may include:
根据第二候选属性重建值和属性值进行差值的绝对值计算,得到第二差值绝对值;Calculate the absolute value of the difference based on the second candidate attribute reconstruction value and the attribute value to obtain the second absolute value of the difference;
确定第三因子和第四因子;Determine the third and fourth factors;
根据第三因子和第四因子对第二差值绝对值与第二候选量化残差绝对值进行加权和运算,得到第二代价值。A weighted sum operation is performed on the absolute value of the second difference and the absolute value of the second candidate quantization residual according to the third factor and the fourth factor to obtain the second generation value.
需要说明的是,在本申请实施例中,第一因子可以用α1表示,第二因子可以用β1表示;第三因子可以用α2表示,第四因子可以用β2表示。其中,第一代价值可以用cost +表示,第二代价值可以用cost -表示。以加权和的方式进行失真代价计算为例,对于第一代价值的计算公式还可以如下, It should be noted that in the embodiment of the present application, the first factor can be expressed as α1, the second factor can be expressed as β1; the third factor can be expressed as α2, and the fourth factor can be expressed as β2. Among them, the first-generation value can be expressed by cost + , and the second-generation value can be expressed by cost - . Taking the weighted sum method as an example to calculate the distortion cost, the calculation formula for the first-generation value can also be as follows,
Figure PCTCN2022103817-appb-000018
Figure PCTCN2022103817-appb-000018
对于第二代价值的计算公式还可以如下,The calculation formula for the second generation value can also be as follows,
Figure PCTCN2022103817-appb-000019
Figure PCTCN2022103817-appb-000019
其中,abs(x)表示x的绝对值。Among them, abs(x) represents the absolute value of x.
在再一种可能的实施例中,对于第一代价值的确定,该方法还可以包括:将第一候选量化残差绝对值确定为第一代价值。In yet another possible embodiment, for determining the first-generation value, the method may further include: determining the absolute value of the first candidate quantization residual as the first-generation value.
对于第二代价值的确定,该方法还可以包括:将第二候选量化残差绝对值确定为第二代价值。For the determination of the second generation value, the method may further include: determining the absolute value of the second candidate quantization residual as the second generation value.
需要说明的是,在本申请实施例中,对于第一代价值可以根据第一候选量化残差绝对值直接确定,此时的失真代价公式还可以如下:It should be noted that in the embodiment of the present application, the first generation value can be directly determined based on the absolute value of the first candidate quantization residual. At this time, the distortion cost formula can also be as follows:
cost +=resQ +         (17) cost + =resQ + (17)
对于第二代价值可以根据第二候选量化残差绝对值直接确定,此时的失真代价公式还可以如下:For the second generation value, the value can be determined directly based on the absolute value of the second candidate quantization residual. At this time, the distortion cost formula can also be as follows:
cost -=resQ -        (18) cost - =resQ - (18)
也就是说,在本申请实施例中,对于失真代价的计算,可以是对候选属性重建值与原始的属性值进行失真代价计算,或者可以是对候选属性重建值与原始的属性值进行率失真代价计算,或者可以是利用候选属性重建值与原始的属性值的加权和进行失真代价计算,或者可以是利用resQ +和resQ -进行失真代价计算,甚至还可以是其它失真代价方式,这里并不作具体限定。另外,在这里,候选属性重建值可以是第一候选属性重建值或者第二候选属性重建值。 That is to say, in the embodiment of the present application, the calculation of the distortion cost may be to calculate the distortion cost between the candidate attribute reconstruction value and the original attribute value, or it may be to perform rate distortion on the candidate attribute reconstruction value and the original attribute value. The cost calculation can either use the weighted sum of the candidate attribute reconstruction value and the original attribute value to calculate the distortion cost, or it can use resQ + and resQ - to calculate the distortion cost, or even other distortion cost methods, which are not discussed here. Specific limitations. In addition, here, the candidate attribute reconstruction value may be the first candidate attribute reconstruction value or the second candidate attribute reconstruction value.
可以理解的是,在确定需要进行隐藏符号的情况下,确定出第一代价值和第二代价值之后,可以根据代价值的大小来确定出当前点的量化残差绝对值,然后解码端可以根据解码获得的量化残差绝对值的 奇偶特性确定出符号。It can be understood that when it is determined that symbols need to be hidden, after determining the first-generation value and the second-generation value, the absolute value of the quantized residual at the current point can be determined based on the size of the cost value, and then the decoding end can The symbol is determined based on the parity characteristics of the absolute value of the quantized residual obtained by decoding.
在一些实施例中,所述根据第一代价值和第二代价值,从第一候选量化残差绝对值和第二候选量化残差绝对值中确定当前点的量化残差绝对值,可以包括:In some embodiments, determining the absolute value of the quantized residual at the current point from the first candidate quantized residual absolute value and the second candidate quantized residual absolute value according to the first generation value and the second generation value may include :
若第一代价值和第二代价值满足第三预设条件且第二候选量化残差绝对值满足第四预设条件,则将第二候选量化残差绝对值确定为当前点的量化残差绝对值;If the first-generation value and the second-generation value satisfy the third preset condition and the second candidate quantized residual absolute value satisfies the fourth preset condition, then the second candidate quantized residual absolute value is determined as the quantized residual of the current point. absolute value;
若第一代价值和第二代价值不满足第三预设条件或者第二候选量化残差绝对值不满足第四预设条件,则将第一候选量化残差绝对值确定为当前点的量化残差绝对值。If the first generation value and the second generation value do not meet the third preset condition or the second candidate quantization residual absolute value does not meet the fourth preset condition, then the first candidate quantization residual absolute value is determined as the quantization of the current point. The absolute value of the residual.
需要说明的是,在本申请实施例中,第三预设条件和第四预设条件是用于确定当前点的量化残差绝对值是设置为第一候选量化残差绝对值还是设置为第二候选量化残差绝对值。其中,对于第一代价值和第二代价值是否满足第三预设条件,在一种具体的实施例中,该方法还可以包括:It should be noted that, in this embodiment of the present application, the third preset condition and the fourth preset condition are used to determine whether the absolute value of the quantized residual at the current point is set to the first candidate absolute value of the quantized residual or to the third candidate. The absolute value of the two candidate quantized residuals. Wherein, as to whether the first-generation value and the second-generation value meet the third preset condition, in a specific embodiment, the method may also include:
若第二代价值小于或等于第一代价值,则确定第一代价值和第二代价值满足第三预设条件;If the second-generation value is less than or equal to the first-generation value, it is determined that the first-generation value and the second-generation value meet the third preset condition;
若第二代价值大于第一代价值,则确定第一代价值和第二代价值不满足第三预设条件。If the second-generation value is greater than the first-generation value, it is determined that the first-generation value and the second-generation value do not meet the third preset condition.
也就是说,对于第一代价值和第二代价值是否满足第三预设条件,可以是根据第二代价值与第一代价值的比较结果来确定。示例性地,如果第二代价值小于或等于第一代价值,那么可以确定第一代价值和第二代价值满足第三预设条件;否则,如果第二代价值大于第一代价值,那么可以确定第一代价值和第二代价值不满足第三预设条件。需要注意的是,对于第二代价值等于第一代价值的情况,可以是确定第一代价值和第二代价值满足第三预设条件,也可以是确定第一代价值和第二代价值不满足第三预设条件,本申请实施例不作具体限定。That is to say, whether the first-generation value and the second-generation value meet the third preset condition can be determined based on the comparison between the second-generation value and the first-generation value. For example, if the second generation value is less than or equal to the first generation value, then it can be determined that the first generation value and the second generation value meet the third preset condition; otherwise, if the second generation value is greater than the first generation value, then It can be determined that the first-generation value and the second-generation value do not satisfy the third preset condition. It should be noted that for the situation where the second generation value is equal to the first generation value, it can be determined that the first generation value and the second generation value meet the third preset condition, or it can be determined that the first generation value and the second generation value If the third preset condition is not met, the embodiments of this application will not specifically limit it.
对于第二候选量化残差绝对值是否满足第四预设条件,在一种具体的实施例中,该方法还可以包括:Regarding whether the second candidate quantization residual absolute value satisfies the fourth preset condition, in a specific embodiment, the method may further include:
若第二候选量化残差绝对值大于或等于预设阈值,则确定第二候选量化残差绝对值满足第四预设条件;If the absolute value of the second candidate quantized residual is greater than or equal to the preset threshold, it is determined that the absolute value of the second candidate quantized residual satisfies the fourth preset condition;
若第二候选量化残差绝对值小于预设阈值,则确定第二候选量化残差绝对值不满足第四预设条件。If the absolute value of the second candidate quantized residual is less than the preset threshold, it is determined that the absolute value of the second candidate quantized residual does not meet the fourth preset condition.
也就是说,对于第二候选量化残差绝对值是否满足第四预设条件,可以根据第二候选量化残差绝对值与预设阈值的比较结果来确定。示例性地,如果第二候选量化残差绝对值大于或等于预设阈值,那么可以确定第二候选量化残差绝对值满足第四预设条件;否则,如果第二候选量化残差绝对值小于预设阈值,那么可以确定第二候选量化残差绝对值不满足第四预设条件。需要注意的是,对于第二候选量化残差绝对值等于预设阈值的情况,可以是确定第二候选量化残差绝对值满足第四预设条件,也可以是确定第二候选量化残差绝对值不满足第四预设条件,本申请实施例不作具体限定。That is to say, whether the second candidate quantization residual absolute value satisfies the fourth preset condition can be determined based on the comparison result of the second candidate quantization residual absolute value and the preset threshold. For example, if the absolute value of the second candidate quantization residual is greater than or equal to the preset threshold, it may be determined that the second candidate quantization residual absolute value satisfies the fourth preset condition; otherwise, if the second candidate quantization residual absolute value is less than If the threshold is preset, then it can be determined that the absolute value of the second candidate quantization residual does not satisfy the fourth preset condition. It should be noted that, for the situation where the absolute value of the second candidate quantization residual is equal to the preset threshold, it may be determined that the absolute value of the second candidate quantization residual satisfies the fourth preset condition, or it may be determined that the absolute value of the second candidate quantization residual is equal to the preset threshold. If the value does not meet the fourth preset condition, the embodiment of this application does not specifically limit it.
进一步地,在一种具体的实施例中,从第一候选量化残差绝对值和第二候选量化残差绝对值中确定当前点的量化残差绝对值,可以包括:Further, in a specific embodiment, determining the absolute value of the quantization residual at the current point from the first candidate quantization residual absolute value and the second candidate quantization residual absolute value may include:
若第二代价值小于或等于第一代价值、且第二候选量化残差绝对值大于或等于预设阈值,则将第二候选量化残差绝对值确定为当前点的量化残差绝对值;If the second generation value is less than or equal to the first generation value, and the second candidate quantized residual absolute value is greater than or equal to the preset threshold, then the second candidate quantized residual absolute value is determined as the quantized residual absolute value of the current point;
若第二代价值大于第一代价值、或者第二候选量化残差绝对值小于预设阈值,则将第一候选量化残差绝对值确定为当前点的量化残差绝对值。If the second generation value is greater than the first generation value, or the second candidate quantized residual absolute value is less than the preset threshold, then the first candidate quantized residual absolute value is determined as the quantized residual absolute value of the current point.
需要说明的是,在本申请实施例中,第一代价值用cost +表示,第二代价值用cost -表示,第二候选量化残差绝对值用resQ -表示,预设阈值用signH表示。这样,如果cost -≤cost +且resQ -≥signH,那么可以将量化残差绝对值置为resQ -,即初始量化残差绝对值减一;否则,如果cost ->cost +或者resQ -<signH,那么可以将量化残差绝对值置为resQ +,即初始量化残差绝对值加一。另外,需要注意的是,对于颜色分量,这里还需要考虑跨分量属性预测值,以便确定出新的属性残差值与对应的量化残差绝对值。 It should be noted that in the embodiment of this application, the first-generation value is represented by cost + , the second-generation value is represented by cost - , the absolute value of the second candidate quantized residual is represented by resQ - , and the preset threshold is represented by signH. In this way, if cost - ≤ cost + and resQ - ≥ signH, then the absolute value of the quantized residual can be set to resQ - , that is, the absolute value of the initial quantized residual is reduced by one; otherwise, if cost - > cost + or resQ - <signH , then the absolute value of the quantized residual can be set to resQ + , that is, the absolute value of the initial quantized residual plus one. In addition, it should be noted that for the color component, the cross-component attribute prediction value also needs to be considered in order to determine the new attribute residual value and the corresponding quantized residual absolute value.
S803:对量化残差绝对值进行编码,将所得到的编码比特写入码流。S803: Encode the absolute value of the quantization residual, and write the resulting encoded bits into the code stream.
需要说明的是,在初始量化残差绝对值满足第一预设条件的情况下,确定需要隐藏符号;这时候仅需要对当前点的量化残差绝对值进行编码,将所得到的编码比特写入码流。后续在解码端,解码获得量化残差绝对值之后,如果量化残差绝对值满足第一预设条件,那么可以根据量化残差绝对值的奇偶特性确定符号。It should be noted that when the absolute value of the initial quantized residual meets the first preset condition, it is determined that the symbol needs to be hidden; at this time, it is only necessary to encode the absolute value of the quantized residual at the current point and write the resulting coded bits. Input code stream. Subsequently, at the decoding end, after decoding to obtain the absolute value of the quantized residual, if the absolute value of the quantized residual satisfies the first preset condition, the symbol can be determined based on the parity characteristics of the absolute value of the quantized residual.
还需要说明的是,对于初始量化残差绝对值不满足第一预设条件的情况,这时候不需要隐藏符号,那么不仅需要将量化残差绝对值写入码流,还需要将符号标识信息写入码流。因此,在一些实施例中,该方法还可以包括:It should also be noted that for the case where the absolute value of the initial quantized residual does not meet the first preset condition, there is no need to hide the symbol at this time. Then not only the absolute value of the quantized residual needs to be written into the code stream, but also the symbol identification information needs to be written Write code stream. Therefore, in some embodiments, the method may further include:
在初始量化残差绝对值不满足第一预设条件的情况下,将初始量化残差绝对值作为当前点的量化残差绝对值;When the absolute value of the initial quantized residual does not meet the first preset condition, the absolute value of the initial quantized residual is used as the absolute value of the quantized residual at the current point;
确定符号标识信息的取值,对符号标识信息的取值和量化残差绝对值进行编码,将所得到的编码比特写入码流。Determine the value of the symbol identification information, encode the value of the symbol identification information and the absolute value of the quantization residual, and write the resulting coded bits into the code stream.
进一步地,由于对于符号的编码,可以是按照符号标识信息的取值(0或1)写入码流中的。因此,在一些实施例中,所述确定符号标识信息的取值,可以包括:Furthermore, due to the encoding of symbols, the symbol identification information may be written into the code stream according to the value (0 or 1). Therefore, in some embodiments, determining the value of symbol identification information may include:
若符号为正号,则确定符号标识信息的取值为第一值;If the symbol is a positive sign, it is determined that the value of the symbol identification information is the first value;
若符号为负号,则确定符号标识信息的取值为第二值。If the sign is a negative sign, it is determined that the value of the sign identification information is the second value.
需要说明的是,在本申请实施例中,第一值可以为1,第二值可以为0;或者,第一值可以为0,第二值可以为1,这里不作具体限定。It should be noted that in the embodiment of the present application, the first value may be 1 and the second value may be 0; or, the first value may be 0 and the second value may be 1, which are not specifically limited here.
还需要说明的是,在本申请实施例中,对于符号(正号或者负号)而言,编码端可以按照符号标识信息的取值写入码流中,以便解码端通过解析码流就可以确定符号是正号还是负号。示例性地,如果1用于表征符号为正号,0用于表征符号为负号,那么若符号为正号,则可以设置符号标识信息的取值为1;和/或,若符号为负号,则可以设置符号标识信息的取值为0。It should also be noted that in the embodiment of the present application, for symbols (positive or negative signs), the encoding end can write the value of the symbol identification information into the code stream, so that the decoding end can parse the code stream. Determine whether the sign is positive or negative. For example, if 1 is used to represent that the symbol is positive and 0 is used to represent that the symbol is negative, then if the symbol is positive, the value of the symbol identification information can be set to 1; and/or, if the symbol is negative number, you can set the value of the symbol identification information to 0.
简单来说,在本申请实施例中,为了降低编码属性信息时所需的码字,可以对当前点的初始量化残差绝对值与预设阈值进行比较,然后引入根据奇偶特性来隐藏部分待编码的符号;以使得在解码端,部分待编码的符号无需从码流中解码获得,从而减少了码字使用。To put it simply, in the embodiment of the present application, in order to reduce the number of codewords required when encoding attribute information, the absolute value of the initial quantization residual at the current point can be compared with the preset threshold, and then some hidden parts to be hidden according to the parity characteristics can be introduced. Encoded symbols; so that at the decoding end, some of the symbols to be encoded do not need to be decoded from the code stream, thereby reducing the use of codewords.
本申请实施例提供了一种编码方法,通过确定当前点的初始量化残差绝对值以及当前点的初始量化残差的符号;在初始量化残差绝对值满足第一预设条件的情况下,根据符号和初始量化残差绝对值的奇偶特性,确定当前点的量化残差绝对值;对量化残差绝对值进行编码,将所得到的编码比特写入码流。这样,在编码端,基于量化残差绝对值的奇偶特性可以隐藏部分待编码值的符号,即无需对该部分符号进行编码,以降低属性信息编码时所使用的码字;从而能够减少码字使用,提升点云属性的编解码效率,同时提高点云属性的编解码性能。The embodiment of the present application provides a coding method by determining the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point; when the absolute value of the initial quantized residual satisfies the first preset condition, According to the parity characteristics of the symbol and the initial quantized residual absolute value, the quantized residual absolute value of the current point is determined; the quantized residual absolute value is encoded, and the resulting coded bits are written into the code stream. In this way, on the encoding side, the parity characteristics based on the absolute value of the quantized residual can hide the symbols of some of the values to be encoded, that is, there is no need to encode these symbols, so as to reduce the number of code words used when encoding attribute information; thus, the number of code words can be reduced Use to improve the encoding and decoding efficiency of point cloud attributes and improve the encoding and decoding performance of point cloud attributes.
在本申请的再一实施例中,基于前述实施例所述的解码方法,参见图9,其示出了本申请实施例提供的一种编码方法的详细流程示意图。如图9所示,以预设阈值为例,该详细流程可以包括:In yet another embodiment of the present application, based on the decoding method described in the previous embodiment, see FIG. 9 , which shows a detailed flowchart of an encoding method provided by the embodiment of the present application. As shown in Figure 9, taking the preset threshold as an example, the detailed process may include:
S901:确定当前点的属性预测值。S901: Determine the attribute prediction value of the current point.
S902:根据当前点的属性值和属性预测值,确定当前点的属性残差值。S902: Determine the attribute residual value of the current point based on the attribute value and attribute prediction value of the current point.
S903:对属性残差值进行量化处理并计算绝对值,得到当前点的初始量化残差绝对值。S903: Quantify the attribute residual value and calculate the absolute value to obtain the initial quantized residual absolute value of the current point.
S904:将初始量化残差绝对值和预设阈值进行比较。S904: Compare the absolute value of the initial quantization residual with the preset threshold.
S905:若带符号的初始量化残差不满足第二预设条件,则获取两个待选值:第一候选量化残差绝对值和第二候选量化残差绝对值;其中,第一候选量化残差绝对值是基于初始量化残差绝对值进行加一计算得到的,第二候选量化残差绝对值是基于初始量化残差绝对值进行减一计算得到的。S905: If the signed initial quantization residual does not meet the second preset condition, obtain two candidate values: the first candidate quantization residual absolute value and the second candidate quantization residual absolute value; where, the first candidate quantization residual absolute value The absolute value of the residual is calculated by adding one based on the absolute value of the initial quantized residual, and the absolute value of the second candidate quantized residual is calculated by subtracting one based on the absolute value of the initial quantized residual.
S906:分别对第一候选量化残差绝对值和第二候选量化残差绝对值进行反量化处理,确定带符号的第一候选重建残差和带符号的第二候选重建残差;以及根据带符号的第一候选重建残差和属性预测值确定第一候选属性重建值,根据带符号的第二候选重建残差和属性预测值确定第二候选属性重建值。S906: Perform inverse quantization processing on the absolute value of the first candidate quantized residual and the absolute value of the second candidate quantized residual respectively, and determine the signed first candidate reconstruction residual and the signed second candidate reconstruction residual; and according to the band The first candidate attribute reconstruction value is determined based on the signed first candidate reconstruction residual and the attribute prediction value, and the second candidate attribute reconstruction value is determined based on the signed second candidate reconstruction residual and the attribute prediction value.
S907:基于失真代价方式确定第一候选属性重建值对应的第一代价值和第二候选属性重建值对应的第二代价值;根据第一代价值和第二代价值,从第一候选量化残差绝对值和第二候选量化残差绝对值中确定当前点的量化残差绝对值。S907: Determine the first generation value corresponding to the first candidate attribute reconstruction value and the second generation value corresponding to the second candidate attribute reconstruction value based on the distortion cost method; based on the first generation value and the second generation value, quantify the residual value from the first candidate The quantized residual absolute value of the current point is determined from the difference absolute value and the second candidate quantized residual absolute value.
S908:若带符号的初始量化残差满足第二预设条件,则将初始量化残差绝对值作为当前点的量化残差绝对值。S908: If the signed initial quantized residual meets the second preset condition, use the absolute value of the initial quantized residual as the absolute value of the quantized residual at the current point.
S909:对量化残差绝对值进行编码,将所得到的编码比特写入码流。S909: Encode the absolute value of the quantization residual, and write the resulting encoded bits into the code stream.
S910:将初始量化残差绝对值作为当前点的量化残差绝对值,对符号标识信息的取值和量化残差绝对值进行编码,将所得到的编码比特写入码流。S910: Use the initial quantized residual absolute value as the quantized residual absolute value of the current point, encode the value of the symbol identification information and the quantized residual absolute value, and write the resulting coded bits into the code stream.
需要说明的是,在本申请实施例中,对于S904来说,在将初始量化残差绝对值与预设阈值进行比较之后,如果初始量化残差绝对值大于或等于预设阈值,那么可以执行S905~S909,这时候不需要编码对应的符号,仅编码量化残差绝对值;如果初始量化残差绝对值小于预设阈值,那么可以执行S910,这时候不仅需要编码量化残差绝对值,还需要编码对应的符号。It should be noted that in this embodiment of the present application, for S904, after comparing the absolute value of the initial quantized residual with the preset threshold, if the absolute value of the initial quantized residual is greater than or equal to the preset threshold, then it can be executed S905~S909, at this time, there is no need to encode the corresponding symbols, only the absolute value of the quantized residual is encoded; if the absolute value of the initial quantized residual is less than the preset threshold, then S910 can be executed. At this time, not only the absolute value of the quantized residual needs to be encoded, but also the absolute value of the quantized residual is encoded. The corresponding symbols need to be encoded.
还需要说明的是,在本申请实施例中,在初始量化残差绝对值大于或等于预设阈值的情况下,如果带符号的初始量化残差不满足第二预设条件(例如,带符号的初始量化残差为正奇数或者负偶数),那么可以执行S905~S909;如果带符号的初始量化残差满足第二预设条件(例如,带符号的初始量化残差为负奇数或者正偶数),那么仅需要执行S909。在这种情况下,若解码获得的量化残差绝对值为奇数,则符号为负号;若解码获得的量化残差绝对值为偶数,则符号为正号。It should also be noted that in the embodiment of the present application, when the absolute value of the initial quantized residual is greater than or equal to the preset threshold, if the signed initial quantized residual does not meet the second preset condition (for example, signed The initial quantized residual is a positive odd number or a negative even number), then S905 to S909 can be executed; if the signed initial quantized residual meets the second preset condition (for example, the signed initial quantized residual is a negative odd number or a positive even number) ), then only S909 needs to be executed. In this case, if the absolute value of the quantized residual obtained by decoding is an odd number, the sign is negative; if the absolute value of the quantized residual obtained by decoding is an even number, the sign is positive.
此外,在初始量化残差绝对值大于或等于预设阈值的情况下,如果带符号的初始量化残差不满足第二预设条件(例如,带符号的初始量化残差为负奇数或者正偶数),那么也可以执行S905~S909;如果带符号的初始量化残差满足第二预设条件(例如,带符号的初始量化残差为正奇数或者负偶数),那么 此时也仅需要执行S909。在这种情况下,若解码获得的量化残差绝对值为奇数,则符号为正号;若解码获得的量化残差绝对值为偶数,则符号为负号。In addition, in the case where the absolute value of the initial quantized residual is greater than or equal to the preset threshold, if the signed initial quantized residual does not satisfy the second preset condition (for example, the signed initial quantized residual is a negative odd number or a positive even number ), then S905 to S909 can also be executed; if the signed initial quantized residual meets the second preset condition (for example, the signed initial quantized residual is a positive odd number or a negative even number), then only S909 needs to be executed at this time . In this case, if the absolute value of the quantized residual obtained by decoding is an odd number, the sign is positive; if the absolute value of the quantized residual obtained by decoding is an even number, the sign is negative.
进一步地,在本申请实施例中,编码端还可以设置有符号隐藏标识信息。在初始量化残差绝对值大于或等于预设阈值时,可以将符号隐藏标识信息置为true,但是符号隐藏标识信息的取值无需写入码流。另外,对于计算初始量化残差绝对值的奇偶值,可以使用parity=resQ%2。其中,如果parity=1,那么可以确定为奇数;否则,如果parity=0,那么可以确定为偶数。Furthermore, in this embodiment of the present application, the encoding end may also be provided with symbolic hidden identification information. When the absolute value of the initial quantization residual is greater than or equal to the preset threshold, the symbol hiding identification information can be set to true, but the value of the symbol hiding identification information does not need to be written into the code stream. In addition, for calculating the parity value of the initial quantized residual absolute value, parity=resQ%2 can be used. Among them, if parity=1, then it can be determined to be an odd number; otherwise, if parity=0, then it can be determined to be an even number.
还需要说明的是,在本申请实施例中,对于失真代价方式,可以是对候选属性重建值与原始的属性值进行失真代价计算,或者可以是对候选属性重建值与原始的属性值进行率失真代价计算,或者可以是利用候选属性重建值与原始的属性值的加权和进行失真代价计算,或者可以是利用resQ +和resQ -进行失真代价计算,甚至还可以是其它失真代价方式,这里并不作具体限定。另外,在这里,候选属性重建值可以是第一候选属性重建值或者第二候选属性重建值。 It should also be noted that in the embodiment of the present application, for the distortion cost method, the distortion cost may be calculated between the candidate attribute reconstruction value and the original attribute value, or the candidate attribute reconstruction value and the original attribute value may be calculated based on the ratio. Distortion cost calculation can either use the weighted sum of the candidate attribute reconstruction value and the original attribute value to calculate the distortion cost, or can use resQ + and resQ - to calculate the distortion cost, or even other distortion cost methods, which are not mentioned here. No specific limitation is made. In addition, here, the candidate attribute reconstruction value may be the first candidate attribute reconstruction value or the second candidate attribute reconstruction value.
还需要说明的是,在本申请实施例中,对于颜色分量,需要针对第一颜色分量、第二颜色分量和第三颜色分量分别执行一次图9所示的编码流程,而且在确定当前点的属性残差值、属性重建值时,还需要额外获取跨分量属性预测值。而对于反射率或者折射率等属性信息,则仅执行一次图9所示的编码流程,而且也无需额外获取跨分量属性预测值。It should also be noted that in the embodiment of the present application, for the color components, the encoding process shown in Figure 9 needs to be executed once for the first color component, the second color component and the third color component, and after determining the current point When obtaining attribute residual values and attribute reconstruction values, additional cross-component attribute prediction values need to be obtained. For attribute information such as reflectivity or refractive index, the encoding process shown in Figure 9 is only executed once, and there is no need to obtain additional cross-component attribute prediction values.
在一种具体的实施例中,对于编码端,首先若属性信息为颜色分量,则对三个颜色分量分别执行一次下述步骤;若属性信息为反射率,则对反射率执行一次下述步骤。具体过程如下:In a specific embodiment, for the encoding end, first, if the attribute information is a color component, the following steps are performed once for the three color components; if the attribute information is reflectance, the following steps are performed once for the reflectance. . The specific process is as follows:
a)采用预测算法得到属性预测值A j′; a) Use the prediction algorithm to obtain the attribute prediction value A j ′;
b)根据属性值A j和属性预测值A j′(以及跨分量属性预测值residualPrevComponent),可以得到属性残差res,具体如下: b) According to the attribute value A j and the attribute prediction value A j ′ (and the cross-component attribute prediction value residualPrevComponent), the attribute residual res can be obtained, as follows:
res=A j-A j′(-residualPrevComponent) res=A j -A j ′(-residualPrevComponent)
b)对属性残差绝对值进行量化,生成初始量化残差绝对值resQ;b) Quantify the absolute value of the attribute residual and generate the initial quantized residual absolute value resQ;
d)将初始量化残差绝对值和预设阈值(用signH表示,如可设置为4)进行比较,若初始量化残差绝对值大于或等于预设阈值,则执行步骤e),否则执行步骤g);d) Compare the absolute value of the initial quantized residual with the preset threshold (represented by signH, for example, it can be set to 4). If the absolute value of the initial quantized residual is greater than or equal to the preset threshold, perform step e), otherwise perform step e). g);
e)具体包括:e) Specifically includes:
1)将符号隐藏标识信息设置为true;1) Set the symbol hidden identification information to true;
2)计算初始量化残差绝对值的奇偶性,parity=resQ%2。其中,若初始量化残差绝对值为奇数,则parity=1;否则parity=0;2) Calculate the parity of the absolute value of the initial quantized residual, parity=resQ%2. Among them, if the absolute value of the initial quantized residual is an odd number, then parity=1; otherwise, parity=0;
3)如果带符号的初始量化残差为正奇数或负偶数,则执行步骤4),否则跳到步骤f);3) If the signed initial quantized residual is a positive odd number or a negative even number, then perform step 4), otherwise jump to step f);
4)获取两个待选值,包括:初始量化残差绝对值加一(用resQ +表示)和初始量化残差绝对值减一(用resQ -表示); 4) Obtain two candidate values, including: the absolute value of the initial quantized residual plus one (expressed by resQ + ) and the absolute value of the initial quantized residual minus one (expressed by resQ - );
5)分别对resQ -和resQ +进行反量化处理,得到重建残差值InvQ(resQ -)和InvQ(resQ +);根据重建残差值和符号(sign),得到带符号的重建残差值sign*InvQ(resQ -)和sign*InvQ(resQ +);然后根据带符号的重建残差值,计算候选属性重建值recA j -和recA j +,具体如下: 5) Perform inverse quantization processing on resQ - and resQ + respectively to obtain the reconstructed residual values InvQ (resQ - ) and InvQ (resQ + ); according to the reconstructed residual value and sign (sign), obtain the signed reconstructed residual value sign*InvQ(resQ - ) and sign*InvQ(resQ + ); then calculate the candidate attribute reconstruction values recA j - and recA j + based on the signed reconstruction residual value, as follows:
Figure PCTCN2022103817-appb-000020
Figure PCTCN2022103817-appb-000020
Figure PCTCN2022103817-appb-000021
Figure PCTCN2022103817-appb-000021
6)通过代价方程计算两个待选值的失真代价,具体如下:6) Calculate the distortion cost of the two candidate values through the cost equation, as follows:
Figure PCTCN2022103817-appb-000022
Figure PCTCN2022103817-appb-000022
Figure PCTCN2022103817-appb-000023
Figure PCTCN2022103817-appb-000023
7)如果cost -≤cost +且resQ -≥signH,那么可以将当前点的量化残差绝对值置为初始量化残差绝对值减一,否则将当前点的量化残差绝对值置为初始量化残差绝对值加一(需要注意的是,对于颜色分量,需要考虑跨分量属性预测值),然后执行步骤f); 7) If cost - ≤ cost + and resQ - ≥ signH, then the absolute value of the quantized residual at the current point can be set to the absolute value of the initial quantized residual minus one, otherwise the absolute value of the quantized residual at the current point can be set to the initial quantized Add one to the absolute value of the residual (it should be noted that for the color component, the cross-component attribute prediction value needs to be considered), and then perform step f);
f)仅编码量化残差绝对值|resQ|,编码结束。f) Only encode the absolute value of the quantization residual |resQ|, and the encoding ends.
g)需要编码带符号的量化残差sign*resQ,即按相关技术编码sign的取值和量化残差绝对值|resQ|,编码结束。g) The signed quantized residual sign*resQ needs to be encoded, that is, the value of sign and the absolute value of the quantized residual |resQ| are encoded according to the relevant technology, and the encoding is completed.
通过上述实施例,对前述实施例的具体实现进行详细阐述,根据前述实施例的技术方案,从中可以看出,本技术方案提供了一种基于符号隐藏的点云属性编码方法,为了进一步降低编码属性信息所需的码字,可以引入根据奇偶性隐藏部分待编码值的符号,使得后续解码端根据解码得到的量化残差绝对值的奇偶特性即可确定出对应的符号;从而能够减少码字使用,提升点云属性的编解码效率,同时提高点云属性的编解码性能。Through the above embodiments, the specific implementation of the foregoing embodiments is elaborated in detail. According to the technical solutions of the foregoing embodiments, it can be seen that this technical solution provides a point cloud attribute encoding method based on symbol hiding. In order to further reduce the encoding The codewords required for attribute information can introduce symbols that hide part of the value to be encoded based on parity, so that the subsequent decoding end can determine the corresponding symbol based on the parity characteristics of the absolute value of the quantized residual obtained by decoding; thus, the number of codewords can be reduced Use to improve the encoding and decoding efficiency of point cloud attributes and improve the encoding and decoding performance of point cloud attributes.
在本申请的再一实施例中,本申请实施例提供了一种码流,该码流是根据待编码信息进行比特编码生成的。其中,待编码信息至少包括:当前点的量化残差绝对值,或者,当前点的量化残差绝对值以及对应的符号标识信息。In yet another embodiment of the present application, the embodiment of the present application provides a code stream, which is generated by bit encoding based on the information to be encoded. The information to be encoded at least includes: the absolute value of the quantized residual of the current point, or the absolute value of the quantized residual of the current point and the corresponding symbol identification information.
在本申请的再一实施例中,基于前述实施例相同的发明构思,参见图10,其示出了本申请实施例提供的一种编码器的组成结构示意图。如图10所示,该编码器100可以包括:第一确定单元1001和编码单元1002;其中,In yet another embodiment of the present application, based on the same inventive concept of the previous embodiment, see FIG. 10 , which shows a schematic structural diagram of an encoder provided by an embodiment of the present application. As shown in Figure 10, the encoder 100 may include: a first determining unit 1001 and an encoding unit 1002; wherein,
第一确定单元1001,配置为确定当前点的初始量化残差绝对值以及当前点的初始量化残差的符号;以及在初始量化残差绝对值满足第一预设条件的情况下,根据符号和初始量化残差绝对值的奇偶特性,确定当前点的量化残差绝对值;The first determination unit 1001 is configured to determine the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point; and when the absolute value of the initial quantized residual satisfies the first preset condition, according to the sign and The parity characteristics of the initial quantized residual absolute value determine the quantized residual absolute value of the current point;
编码单元1002,配置为对量化残差绝对值进行编码,将所得到的编码比特写入码流。The encoding unit 1002 is configured to encode the absolute value of the quantization residual and write the resulting encoded bits into the code stream.
在一些实施例中,第一确定单元1001,还配置为在初始量化残差绝对值不满足第一预设条件的情况下,将初始量化残差绝对值作为当前点的量化残差绝对值;In some embodiments, the first determination unit 1001 is further configured to use the initial quantized residual absolute value as the quantized residual absolute value of the current point when the initial quantized residual absolute value does not meet the first preset condition;
编码单元1002,还配置为确定符号标识信息的取值,对符号标识信息的取值和量化残差绝对值进行编码,将所得到的编码比特写入码流。The encoding unit 1002 is also configured to determine the value of the symbol identification information, encode the value of the symbol identification information and the absolute value of the quantization residual, and write the resulting encoded bits into the code stream.
在一些实施例中,第一确定单元1001,还配置若初始量化残差绝对值大于或等于预设阈值,则确定初始量化残差绝对值满足第一预设条件;若初始量化残差绝对值小于预设阈值,则确定初始量化残差绝对值不满足第一预设条件。In some embodiments, the first determining unit 1001 is also configured to determine that the absolute value of the initial quantized residual satisfies the first preset condition if the absolute value of the initial quantized residual is greater than or equal to the preset threshold; if the absolute value of the initial quantized residual is less than the preset threshold, it is determined that the absolute value of the initial quantized residual does not meet the first preset condition.
可以理解地,在本申请实施例中,“单元”可以是部分电路、部分处理器、部分程序或软件等等,当然也可以是模块,还可以是非模块化的。而且在本实施例中的各组成部分可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。It can be understood that in the embodiments of the present application, the "unit" may be part of a circuit, part of a processor, part of a program or software, etc., and of course may also be a module, or may be non-modular. Moreover, each component in this embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software function modules.
所述集成的单元如果以软件功能模块的形式实现并非作为独立的产品进行销售或使用时,可以存储在一个计算机可读取存储介质中,基于这样的理解,本实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或processor(处理器)执行本实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially either The part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions to make a computer device (can It is a personal computer, server, or network device, etc.) or processor that executes all or part of the steps of the method described in this embodiment. The aforementioned storage media include: U disk, mobile hard disk, Read Only Memory (ROM), Random Access Memory (RAM), magnetic disk or optical disk and other media that can store program code.
因此,本申请实施例提供了一种计算机可读存储介质,应用于编码器100,该计算机可读存储介质存储有计算机程序,所述计算机程序被第一处理器执行时实现前述实施例中任一项所述的方法。Therefore, embodiments of the present application provide a computer-readable storage medium for use in the encoder 100. The computer-readable storage medium stores a computer program. When the computer program is executed by the first processor, any of the foregoing embodiments can be implemented. method described in one item.
基于上述编码器100的组成以及计算机可读存储介质,参见图11,其示出了本申请实施例提供的编码器100的具体硬件结构示意图。如图11所示,编码器100可以包括:第一通信接口1101、第一存储器1102和第一处理器1103;各个组件通过第一总线系统1104耦合在一起。可理解,第一总线系统1104用于实现这些组件之间的连接通信。第一总线系统1104除包括数据总线之外,还包括电源总线、控制总线和状态信号总线。但是为了清楚说明起见,在图11中将各种总线都标为第一总线系统1104。其中,Based on the above composition of the encoder 100 and the computer-readable storage medium, see FIG. 11 , which shows a schematic diagram of the specific hardware structure of the encoder 100 provided by the embodiment of the present application. As shown in FIG. 11 , the encoder 100 may include: a first communication interface 1101 , a first memory 1102 and a first processor 1103 ; the various components are coupled together through a first bus system 1104 . It can be understood that the first bus system 1104 is used to implement connection communication between these components. In addition to the data bus, the first bus system 1104 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity of explanation, various buses are labeled as the first bus system 1104 in FIG. 11 . in,
第一通信接口1101,用于在与其他外部网元之间进行收发信息过程中,信号的接收和发送;The first communication interface 1101 is used for receiving and sending signals during the process of sending and receiving information with other external network elements;
第一存储器1102,用于存储能够在第一处理器1103上运行的计算机程序;The first memory 1102 is used to store a computer program capable of running on the first processor 1103;
第一处理器1103,用于在运行所述计算机程序时,执行:The first processor 1103 is configured to execute: when running the computer program:
确定当前点的初始量化残差绝对值以及当前点的初始量化残差的符号;Determine the absolute value of the initial quantized residual at the current point and the sign of the initial quantized residual at the current point;
在初始量化残差绝对值满足第一预设条件的情况下,根据符号和初始量化残差绝对值的奇偶特性,确定当前点的量化残差绝对值;When the absolute value of the initial quantized residual satisfies the first preset condition, determine the absolute value of the quantized residual at the current point based on the sign and the parity characteristics of the absolute value of the initial quantized residual;
对量化残差绝对值进行编码,将所得到的编码比特写入码流。Encode the absolute value of the quantization residual and write the resulting coded bits into the code stream.
可以理解,本申请实施例中的第一存储器1102可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(Read-Only Memory,ROM)、可编程只读存储器(Programmable ROM,PROM)、可擦除可编程只读存储器(Erasable PROM,EPROM)、电可擦除可编程只读存储器(Electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory,RAM),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(Static RAM,SRAM)、动态随机存取存储器(Dynamic RAM,DRAM)、同步动态随机存取存储器(Synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM,DDRSDRAM)、增强型同步动态随机存取存储器(Enhanced  SDRAM,ESDRAM)、同步连接动态随机存取存储器(Synchlink DRAM,SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM,DRRAM)。本申请描述的系统和方法的第一存储器1102旨在包括但不限于这些和任意其它适合类型的存储器。It can be understood that the first memory 1102 in the embodiment of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, non-volatile memory can be read-only memory (Read-Only Memory, ROM), programmable read-only memory (Programmable ROM, PROM), erasable programmable read-only memory (Erasable PROM, EPROM), electrically removable memory. Erase programmable read-only memory (Electrically EPROM, EEPROM) or flash memory. Volatile memory may be Random Access Memory (RAM), which is used as an external cache. By way of illustration, but not limitation, many forms of RAM are available, such as static random access memory (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), synchronous dynamic random access memory (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDRSDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (Synchlink DRAM, SLDRAM) and Direct Rambus RAM (DRRAM). The first memory 1102 of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
而第一处理器1103可能是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过第一处理器1103中的硬件的集成逻辑电路或者软件形式的指令完成。上述的第一处理器1103可以是通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于第一存储器1102,第一处理器1103读取第一存储器1102中的信息,结合其硬件完成上述方法的步骤。The first processor 1103 may be an integrated circuit chip with signal processing capabilities. During the implementation process, each step of the above method can be completed by instructions in the form of hardware integrated logic circuits or software in the first processor 1103 . The above-mentioned first processor 1103 can be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA). or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. Each method, step and logical block diagram disclosed in the embodiment of this application can be implemented or executed. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly implemented by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software module can be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other mature storage media in this field. The storage medium is located in the first memory 1102. The first processor 1103 reads the information in the first memory 1102 and completes the steps of the above method in combination with its hardware.
可以理解的是,本申请描述的这些实施例可以用硬件、软件、固件、中间件、微码或其组合来实现。对于硬件实现,处理单元可以实现在一个或多个专用集成电路(Application Specific Integrated Circuits,ASIC)、数字信号处理器(Digital Signal Processing,DSP)、数字信号处理设备(DSP Device,DSPD)、可编程逻辑设备(Programmable Logic Device,PLD)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、通用处理器、控制器、微控制器、微处理器、用于执行本申请所述功能的其它电子单元或其组合中。对于软件实现,可通过执行本申请所述功能的模块(例如过程、函数等)来实现本申请所述的技术。软件代码可存储在存储器中并通过处理器执行。存储器可以在处理器中或在处理器外部实现。It will be understood that the embodiments described in this application can be implemented using hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more Application Specific Integrated Circuits (ASIC), Digital Signal Processing (DSP), Digital Signal Processing Device (DSP Device, DSPD), programmable Logic device (Programmable Logic Device, PLD), Field-Programmable Gate Array (FPGA), general-purpose processor, controller, microcontroller, microprocessor, and other devices used to perform the functions described in this application electronic unit or combination thereof. For software implementation, the technology described in this application can be implemented through modules (such as procedures, functions, etc.) that perform the functions described in this application. Software code may be stored in memory and executed by a processor. The memory can be implemented in the processor or external to the processor.
可选地,作为另一个实施例,第一处理器1103还配置为在运行所述计算机程序时,执行前述实施例中任一项所述的方法。Optionally, as another embodiment, the first processor 1103 is further configured to perform the method described in any one of the preceding embodiments when running the computer program.
本实施例提供了一种编码器,在该编码器中,基于量化残差绝对值的奇偶特性可以隐藏部分待编码值的符号,即无需对该部分符号进行编码,以降低属性信息编码时所使用的码字;从而能够减少码字使用,提升点云属性的编码效率,同时提高点云属性的编码性能。This embodiment provides an encoder in which the symbols of some values to be encoded can be hidden based on the parity characteristics of the absolute value of the quantized residual, that is, there is no need to encode these symbols, so as to reduce the time required for encoding attribute information. The code words used; thereby reducing the use of code words, improving the coding efficiency of point cloud attributes, and improving the coding performance of point cloud attributes.
基于前述实施例相同的发明构思,参见图12,其示出了本申请实施例提供的一种解码器120的组成结构示意图。如图12所示,该解码器120可以包括:解码单元1201和第二确定单元1202;其中,Based on the same inventive concept of the previous embodiment, see FIG. 12 , which shows a schematic structural diagram of a decoder 120 provided by an embodiment of the present application. As shown in Figure 12, the decoder 120 may include: a decoding unit 1201 and a second determination unit 1202; wherein,
解码单元1201,配置为解析码流,确定当前点的量化残差绝对值;The decoding unit 1201 is configured to parse the code stream and determine the absolute value of the quantization residual at the current point;
第二确定单元1202,配置为在量化残差绝对值满足第一预设条件的情况下,根据量化残差绝对值的奇偶特性,确定当前点的量化残差的符号;以及根据量化残差绝对值和符号,确定当前点的属性重建值。The second determination unit 1202 is configured to determine the sign of the quantized residual at the current point according to the parity characteristics of the absolute value of the quantized residual when the absolute value of the quantized residual satisfies the first preset condition; and based on the absolute value of the quantized residual Value and sign, determine the attribute reconstruction value of the current point.
在一些实施例中,解码单元1201,还配置为在量化残差绝对值不满足第一预设条件的情况下,解析码流,确定当前点的量化残差的符号。In some embodiments, the decoding unit 1201 is further configured to parse the code stream and determine the sign of the quantized residual at the current point when the absolute value of the quantized residual does not meet the first preset condition.
在一些实施例中,解码单元1201,还配置为解析码流,获取符号标识信息的取值;In some embodiments, the decoding unit 1201 is also configured to parse the code stream and obtain the value of the symbol identification information;
第二确定单元1202,还配置为若所述符号标识信息的取值为第一值,则确定所述符号为正号;若所述符号标识信息的取值为第二值,则确定所述符号为负号。The second determining unit 1202 is further configured to determine that the symbol is a positive sign if the value of the symbol identification information is a first value; and to determine that the symbol is a positive sign if the value of the symbol identification information is a second value. The sign is negative.
可以理解地,在本实施例中,“单元”可以是部分电路、部分处理器、部分程序或软件等等,当然也可以是模块,还可以是非模块化的。而且在本实施例中的各组成部分可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。It can be understood that in this embodiment, the "unit" may be part of a circuit, part of a processor, part of a program or software, etc., and of course may also be a module, or may be non-modular. Moreover, each component in this embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software function modules.
所述集成的单元如果以软件功能模块的形式实现并非作为独立的产品进行销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本实施例提供了一种计算机可读存储介质,应用于解码器120,该计算机可读存储介质存储有计算机程序,所述计算机程序被第二处理器执行时实现前述实施例中任一项所述的方法。If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, this embodiment provides a computer-readable storage medium for use in the decoder 120. The computer-readable storage medium stores a computer program. When the computer program is executed by the second processor, the foregoing embodiments are implemented. any one of the methods.
基于上述解码器120的组成以及计算机可读存储介质,参见图13,其示出了本申请实施例提供的解码器120的具体硬件结构示意图。如图13所示,解码器120可以包括:第二通信接口1301、第二存储器1302和第二处理器1303;各个组件通过第二总线系统1304耦合在一起。可理解,第二总线系统1304用于实现这些组件之间的连接通信。第二总线系统1304除包括数据总线之外,还包括电源总线、控制总线和状态信号总线。但是为了清楚说明起见,在图13中将各种总线都标为第二总线系统1304。其中,Based on the above composition of the decoder 120 and the computer-readable storage medium, see FIG. 13 , which shows a schematic diagram of the specific hardware structure of the decoder 120 provided by the embodiment of the present application. As shown in Figure 13, the decoder 120 may include: a second communication interface 1301, a second memory 1302, and a second processor 1303; the various components are coupled together through a second bus system 1304. It can be understood that the second bus system 1304 is used to implement connection communication between these components. In addition to the data bus, the second bus system 1304 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity of explanation, various buses are labeled as second bus system 1304 in FIG. 13 . in,
第二通信接口1301,用于在与其他外部网元之间进行收发信息过程中,信号的接收和发送;The second communication interface 1301 is used for receiving and sending signals during the process of sending and receiving information with other external network elements;
第二存储器1302,用于存储能够在第二处理器1303上运行的计算机程序;The second memory 1302 is used to store a computer program capable of running on the second processor 1303;
第二处理器1303,用于在运行所述计算机程序时,执行:The second processor 1303 is configured to execute: when running the computer program:
解析码流,确定当前点的量化残差绝对值;Analyze the code stream and determine the absolute value of the quantized residual at the current point;
在量化残差绝对值满足第一预设条件的情况下,根据量化残差绝对值的奇偶特性,确定当前点的量化残差的符号;When the absolute value of the quantized residual satisfies the first preset condition, determine the sign of the quantized residual at the current point according to the parity characteristics of the absolute value of the quantized residual;
根据量化残差绝对值和符号,确定当前点的属性重建值。According to the absolute value and sign of the quantized residual, the attribute reconstruction value of the current point is determined.
可选地,作为另一个实施例,第二处理器1303还配置为在运行所述计算机程序时,执行前述实施例中任一项所述的方法。Optionally, as another embodiment, the second processor 1303 is further configured to perform the method described in any one of the preceding embodiments when running the computer program.
可以理解,第二存储器1302与第一存储器1102的硬件功能类似,第二处理器1303与第一处理器1103的硬件功能类似;这里不再详述。It can be understood that the hardware functions of the second memory 1302 and the first memory 1102 are similar, and the hardware functions of the second processor 1303 and the first processor 1103 are similar; details will not be described here.
本实施例提供了一种解码器,在该解码器中,根据解码得到的量化残差绝对值的奇偶特性用来确定对应的符号;从而能够减少码字使用,提升点云属性的编解码效率,同时提高点云属性的编解码性能。This embodiment provides a decoder, in which the parity and even characteristics of the absolute value of the quantized residual obtained by decoding are used to determine the corresponding symbol; thereby reducing the use of codewords and improving the encoding and decoding efficiency of point cloud attributes. , while improving the encoding and decoding performance of point cloud attributes.
在本申请的再一实施例中,参见图14,其示出了本申请实施例提供的一种编解码系统的组成结构示意图。如图14所示,编解码系统140可以包括编码器1401和解码器1402。其中,编码器1401可以为前述实施例中任一项所述的编码器,解码器1402可以为前述实施例中任一项所述的解码器。In yet another embodiment of the present application, see FIG. 14 , which shows a schematic structural diagram of a coding and decoding system provided by an embodiment of the present application. As shown in Figure 14, the encoding and decoding system 140 may include an encoder 1401 and a decoder 1402. The encoder 1401 may be the encoder described in any of the preceding embodiments, and the decoder 1402 may be the decoder described in any of the preceding embodiments.
在本申请实施例中,该编解码系统140中,在编码器1401中,基于量化残差绝对值的奇偶特性可以隐藏部分待编码值的符号,即无需对该部分符号进行编码,以降低属性信息编码时所使用的码字;而在解码器1402中,根据解码得到的量化残差绝对值的奇偶特性可以直接确定出对应的符号;从而能够减少码字使用,提升点云属性的编解码效率,同时提高点云属性的编解码性能。In the embodiment of the present application, in the encoding and decoding system 140, in the encoder 1401, based on the parity characteristics of the absolute value of the quantized residual, some symbols of the values to be encoded can be hidden, that is, there is no need to encode these partial symbols to reduce the properties. The code words used when encoding information; in the decoder 1402, the corresponding symbols can be directly determined based on the parity characteristics of the absolute value of the quantized residual obtained by decoding; thus, the use of code words can be reduced and the encoding and decoding of point cloud attributes can be improved. efficiency, while improving the encoding and decoding performance of point cloud attributes.
需要说明的是,在本申请中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that in this application, the terms "comprising", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article or device that includes a series of elements not only includes those elements , but also includes other elements not expressly listed or inherent in such process, method, article or apparatus. Without further limitation, an element defined by the statement "comprises a..." does not exclude the presence of additional identical elements in a process, method, article or apparatus that includes that element.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The above serial numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments.
本申请所提供的几个方法实施例中所揭露的方法,在不冲突的情况下可以任意组合,得到新的方法实施例。The methods disclosed in several method embodiments provided in this application can be combined arbitrarily to obtain new method embodiments without conflict.
本申请所提供的几个产品实施例中所揭露的特征,在不冲突的情况下可以任意组合,得到新的产品实施例。The features disclosed in several product embodiments provided in this application can be combined arbitrarily without conflict to obtain new product embodiments.
本申请所提供的几个方法或设备实施例中所揭露的特征,在不冲突的情况下可以任意组合,得到新的方法实施例或设备实施例。The features disclosed in several method or device embodiments provided in this application can be combined arbitrarily without conflict to obtain new method embodiments or device embodiments.
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application. should be covered by the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.
工业实用性Industrial applicability
本申请实施例中,在编码端,确定当前点的初始量化残差绝对值以及当前点的初始量化残差的符号;在初始量化残差绝对值满足第一预设条件的情况下,根据符号和初始量化残差绝对值的奇偶特性,确定当前点的量化残差绝对值;对量化残差绝对值进行编码,将所得到的编码比特写入码流。在解码端,解析码流,确定当前点的量化残差绝对值;在量化残差绝对值满足第一预设条件的情况下,根据量化残差绝对值的奇偶特性,确定当前点的量化残差的符号;根据量化残差绝对值和符号,确定当前点的属性重建值。这样,在编码端,基于量化残差绝对值的奇偶特性可以隐藏部分待编码值的符号,即无需对该部分符号进行编码,以降低属性信息编码时所使用的码字;而在解码端,根据解码得到的量化残差绝对值的奇偶特性可以直接确定出对应的符号;从而能够减少码字使用,提升点云属性的编解码效率,同时提高点云属性的编解码性能。In the embodiment of the present application, at the encoding end, the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point are determined; when the absolute value of the initial quantized residual satisfies the first preset condition, according to the sign and the parity characteristics of the initial quantized residual absolute value, determine the quantized residual absolute value of the current point; encode the quantized residual absolute value, and write the resulting coded bits into the code stream. At the decoding end, the code stream is parsed to determine the absolute value of the quantized residual at the current point; when the absolute value of the quantized residual meets the first preset condition, the quantized residual at the current point is determined based on the parity characteristics of the absolute value of the quantized residual. The sign of the difference; determine the attribute reconstruction value of the current point based on the absolute value and sign of the quantized residual. In this way, on the encoding side, the parity characteristics based on the absolute value of the quantized residual can hide some symbols of the values to be encoded, that is, there is no need to encode these symbols, so as to reduce the codewords used when encoding attribute information; while on the decoding side, The corresponding symbol can be directly determined based on the parity and even characteristics of the absolute value of the quantized residual obtained by decoding; thus, the use of codewords can be reduced, the encoding and decoding efficiency of point cloud attributes can be improved, and the encoding and decoding performance of point cloud attributes can be improved.

Claims (38)

  1. 一种解码方法,所述方法包括:A decoding method, the method includes:
    解析码流,确定当前点的量化残差绝对值;Analyze the code stream and determine the absolute value of the quantized residual at the current point;
    在所述量化残差绝对值满足第一预设条件的情况下,根据所述量化残差绝对值的奇偶特性,确定所述当前点的量化残差的符号;When the absolute value of the quantized residual satisfies the first preset condition, determine the sign of the quantized residual at the current point according to the parity characteristics of the absolute value of the quantized residual;
    根据所述量化残差绝对值和所述符号,确定所述当前点的属性重建值。According to the absolute value of the quantized residual and the sign, the attribute reconstruction value of the current point is determined.
  2. 根据权利要求1所述的方法,其中,所述根据所述量化残差绝对值的奇偶特性,确定所述当前点的量化残差的符号,包括:The method according to claim 1, wherein determining the sign of the quantized residual of the current point according to the parity characteristics of the absolute value of the quantized residual includes:
    若所述量化残差绝对值为奇数,则确定所述符号为负号;If the absolute value of the quantized residual is an odd number, the sign is determined to be negative;
    若所述量化残差绝对值为偶数,则确定所述符号为正号;If the absolute value of the quantized residual is an even number, then the sign is determined to be positive;
    或者,or,
    若所述量化残差绝对值为奇数,则确定所述符号为正号;If the absolute value of the quantized residual is an odd number, the sign is determined to be positive;
    若所述量化残差绝对值为偶数,则确定所述符号为负号。If the absolute value of the quantized residual is an even number, the sign is determined to be negative.
  3. 根据权利要求1所述的方法,其中,所述方法还包括:The method of claim 1, further comprising:
    在所述量化残差绝对值不满足所述第一预设条件的情况下,解析码流,确定所述当前点的量化残差的符号。When the absolute value of the quantized residual does not satisfy the first preset condition, the code stream is parsed to determine the sign of the quantized residual at the current point.
  4. 根据权利要求3所述的方法,其中,所述解析码流,确定所述当前点的量化残差的符号,包括:The method according to claim 3, wherein the parsing the code stream and determining the sign of the quantized residual of the current point includes:
    解析码流,获取符号标识信息的取值;Parse the code stream and obtain the value of the symbol identification information;
    若所述符号标识信息的取值为第一值,则确定所述符号为正号;If the value of the symbol identification information is the first value, it is determined that the symbol is a positive sign;
    若所述符号标识信息的取值为第二值,则确定所述符号为负号。If the value of the symbol identification information is the second value, it is determined that the symbol is a negative sign.
  5. 根据权利要求3所述的方法,其中,所述方法还包括:The method of claim 3, further comprising:
    若所述量化残差绝对值大于或等于预设阈值,则确定所述量化残差绝对值满足第一预设条件;If the absolute value of the quantized residual is greater than or equal to the preset threshold, it is determined that the absolute value of the quantized residual satisfies the first preset condition;
    若所述量化残差绝对值小于预设阈值,则确定所述量化残差绝对值不满足所述第一预设条件。If the absolute value of the quantized residual is less than the preset threshold, it is determined that the absolute value of the quantized residual does not satisfy the first preset condition.
  6. 根据权利要求1至5任一项所述的方法,其中,所述方法还包括:The method according to any one of claims 1 to 5, wherein the method further includes:
    对所述当前点的属性信息进行预测,确定所述当前点的属性预测值;Predict the attribute information of the current point and determine the attribute prediction value of the current point;
    所述根据所述量化残差绝对值和所述符号,确定所述当前点的属性重建值,包括:Determining the attribute reconstruction value of the current point based on the absolute value of the quantized residual and the sign includes:
    对所述量化残差绝对值进行反量化处理,得到解码残差值;Perform inverse quantization processing on the absolute value of the quantized residual to obtain a decoded residual value;
    根据所述解码残差值和所述符号,确定带符号的解码残差值;determining a signed decoding residual value based on the decoding residual value and the symbol;
    根据所述属性预测值和所述带符号的解码残差值,确定所述当前点的属性重建值。According to the attribute prediction value and the signed decoding residual value, the attribute reconstruction value of the current point is determined.
  7. 根据权利要求6所述的方法,其中,所述根据所述属性预测值和所述带符号的解码残差值,确定所述当前点的属性重建值,包括:The method according to claim 6, wherein determining the attribute reconstruction value of the current point according to the attribute prediction value and the signed decoding residual value includes:
    对所述属性预测值和所述带符号的解码残差值进行加法运算,得到所述当前点的属性重建值。An addition operation is performed on the attribute prediction value and the signed decoding residual value to obtain the attribute reconstruction value of the current point.
  8. 根据权利要求6所述的方法,其中,所述方法还包括:The method of claim 6, further comprising:
    在所述属性信息为颜色分量时,确定所述当前点的跨分量属性预测值;When the attribute information is a color component, determine the cross-component attribute prediction value of the current point;
    所述根据所述属性预测值和所述带符号的解码残差值,确定所述当前点的属性重建值,包括:Determining the attribute reconstruction value of the current point based on the attribute prediction value and the signed decoding residual value includes:
    对所述属性预测值、所述带符号的解码残差值和所述跨分量属性预测值进行加法运算,得到所述当前点的属性重建值。The attribute prediction value, the signed decoding residual value and the cross-component attribute prediction value are added to obtain the attribute reconstruction value of the current point.
  9. 根据权利要求8所述的方法,其中,所述颜色分量包括下述至少之一:第一颜色分量、第二颜色分量和第三颜色分量;其中,The method of claim 8, wherein the color component includes at least one of the following: a first color component, a second color component, and a third color component; wherein,
    若所述颜色分量符合RGB颜色空间,则确定所述第一颜色分量、所述第二颜色分量和所述第三颜色分量分别为其中之一:R分量、G分量、B分量;If the color component conforms to the RGB color space, it is determined that the first color component, the second color component and the third color component are respectively one of: R component, G component, and B component;
    若所述颜色分量符合YUV颜色空间,则确定所述第一颜色分量、所述第二颜色分量和所述第三颜色分量分别为其中之一:Y分量、U分量、V分量。If the color component conforms to the YUV color space, it is determined that the first color component, the second color component and the third color component are respectively one of them: Y component, U component, or V component.
  10. 一种编码方法,所述方法包括:An encoding method, the method includes:
    确定当前点的初始量化残差绝对值以及所述当前点的初始量化残差的符号;Determine the absolute value of the initial quantized residual of the current point and the sign of the initial quantized residual of the current point;
    在所述初始量化残差绝对值满足第一预设条件的情况下,根据所述符号和所述初始量化残差绝对值的奇偶特性,确定所述当前点的量化残差绝对值;In the case where the initial quantized residual absolute value satisfies the first preset condition, determine the quantized residual absolute value of the current point according to the sign and the parity characteristics of the initial quantized residual absolute value;
    对所述量化残差绝对值进行编码,将所得到的编码比特写入码流。The absolute value of the quantization residual is encoded, and the resulting encoded bits are written into the code stream.
  11. 根据权利要求10所述的方法,其中,所述方法还包括:The method of claim 10, wherein the method further includes:
    在所述初始量化残差绝对值不满足所述第一预设条件的情况下,将所述初始量化残差绝对值作为所 述当前点的量化残差绝对值;In the case where the initial quantized residual absolute value does not meet the first preset condition, the initial quantized residual absolute value is used as the quantized residual absolute value of the current point;
    确定符号标识信息的取值,对所述符号标识信息的取值和所述量化残差绝对值进行编码,将所得到的编码比特写入码流。Determine the value of the symbol identification information, encode the value of the symbol identification information and the absolute value of the quantization residual, and write the resulting coded bits into the code stream.
  12. 根据权利要求11所述的方法,其中,所述确定符号标识信息的取值,包括:The method according to claim 11, wherein determining the value of symbol identification information includes:
    若所述符号为正号,则确定所述符号标识信息的取值为第一值;If the symbol is a positive sign, determine that the value of the symbol identification information is the first value;
    若所述符号为负号,则确定所述符号标识信息的取值为第二值。If the symbol is a negative sign, it is determined that the value of the symbol identification information is the second value.
  13. 根据权利要求11所述的方法,其中,所述方法还包括:The method of claim 11, wherein the method further includes:
    若所述初始量化残差绝对值大于或等于预设阈值,则确定所述初始量化残差绝对值满足第一预设条件;If the absolute value of the initial quantized residual is greater than or equal to the preset threshold, it is determined that the absolute value of the initial quantized residual satisfies the first preset condition;
    若所述初始量化残差绝对值小于所述预设阈值,则确定所述初始量化残差绝对值不满足所述第一预设条件。If the absolute value of the initial quantized residual is less than the preset threshold, it is determined that the absolute value of the initial quantized residual does not satisfy the first preset condition.
  14. 根据权利要求13所述的方法,其中,所述方法还包括:The method of claim 13, wherein the method further includes:
    若所述初始量化残差绝对值大于或等于所述预设阈值,则设置符号隐藏标识信息的取值为第一值;If the absolute value of the initial quantized residual is greater than or equal to the preset threshold, then set the value of the symbol hidden identification information to the first value;
    若所述初始量化残差绝对值小于所述预设阈值,则设置符号隐藏标识信息的取值为第二值。If the absolute value of the initial quantized residual is less than the preset threshold, then the value of the symbol hiding identification information is set to the second value.
  15. 根据权利要求14所述的方法,其中,所述方法还包括:The method of claim 14, wherein the method further includes:
    在所述符号隐藏标识信息的取值为第一值时,确定所述初始量化残差绝对值的奇偶特性;When the value of the symbol hidden identification information is a first value, determine the parity characteristics of the absolute value of the initial quantized residual;
    所述根据所述符号和所述初始量化残差绝对值的奇偶特性,确定所述当前点的量化残差绝对值,包括:Determining the absolute value of the quantized residual at the current point based on the parity characteristics of the symbol and the initial quantized residual absolute value includes:
    根据所述符号和所述初始量化残差绝对值的奇偶特性,确定带符号的初始量化残差是否满足第二预设条件;Determine whether the signed initial quantized residual satisfies a second preset condition according to the parity characteristics of the sign and the absolute value of the initial quantized residual;
    若所述带符号的初始量化残差满足所述第二预设条件,则将所述初始量化残差绝对值确定为所述当前点的量化残差绝对值;If the signed initial quantized residual satisfies the second preset condition, then determine the absolute value of the initial quantized residual as the absolute value of the quantized residual of the current point;
    若所述带符号的初始量化残差不满足所述第二预设条件,则根据所述初始量化残差绝对值和预设常数值,确定所述当前点的量化残差绝对值。If the signed initial quantized residual does not satisfy the second preset condition, then the absolute value of the quantized residual at the current point is determined based on the initial quantized residual absolute value and a preset constant value.
  16. 根据权利要求15所述的方法,其中,所述确定所述初始量化残差绝对值的奇偶特性,包括:The method of claim 15, wherein determining the parity characteristics of the absolute value of the initial quantized residual includes:
    对所述初始量化残差绝对值进行奇偶特性计算,得到奇偶值;Calculate parity characteristics on the absolute value of the initial quantized residual to obtain parity values;
    若所述奇偶值等于第三值,则确定所述初始量化残差绝对值为奇数;If the parity value is equal to the third value, it is determined that the absolute value of the initial quantized residual is an odd number;
    若所述奇偶值等于第四值,则确定所述初始量化残差绝对值为偶数。If the parity value is equal to the fourth value, it is determined that the absolute value of the initial quantized residual is an even number.
  17. 根据权利要求16所述的方法,其中,所述根据所述符号和所述初始量化残差绝对值的奇偶特性,确定带符号的初始量化残差是否满足第二预设条件,包括:The method of claim 16, wherein determining whether the signed initial quantized residual satisfies a second preset condition based on the sign and the parity characteristics of the initial quantized residual absolute value includes:
    根据所述符号和所述初始量化残差绝对值,得到所述带符号的初始量化残差;According to the sign and the absolute value of the initial quantized residual, the signed initial quantized residual is obtained;
    若所述带符号的初始量化残差为大于零的偶数或者小于零的奇数,则确定所述带符号的初始量化残差满足所述第二预设条件;If the signed initial quantized residual is an even number greater than zero or an odd number less than zero, then it is determined that the signed initial quantized residual satisfies the second preset condition;
    若所述带符号的初始量化残差为大于零的奇数或者小于零的偶数,则确定所述带符号的初始量化残差不满足所述第二预设条件;If the signed initial quantized residual is an odd number greater than zero or an even number smaller than zero, it is determined that the signed initial quantized residual does not satisfy the second preset condition;
    或者,or,
    若所述带符号的初始量化残差为大于零的奇数或者小于零的偶数,则确定所述带符号的初始量化残差满足所述第二预设条件;If the signed initial quantized residual is an odd number greater than zero or an even number smaller than zero, then it is determined that the signed initial quantized residual satisfies the second preset condition;
    若所述带符号的初始量化残差为大于零的偶数或者小于零的奇数,则确定所述带符号的初始量化残差不满足所述第二预设条件。If the signed initial quantized residual is an even number greater than zero or an odd number smaller than zero, it is determined that the signed initial quantized residual does not satisfy the second preset condition.
  18. 根据权利要求17所述的方法,其中,所述方法还包括:The method of claim 17, further comprising:
    若所述符号为正号,且所述初始量化残差绝对值为奇数,则确定所述带符号的初始量化残差为大于零的奇数;If the sign is positive and the absolute value of the initial quantized residual is an odd number, then it is determined that the signed initial quantized residual is an odd number greater than zero;
    若所述符号为负号,且所述初始量化残差绝对值为奇数,则确定所述带符号的初始量化残差为小于零的奇数;If the sign is a negative sign and the absolute value of the initial quantized residual is an odd number, then it is determined that the signed initial quantized residual is an odd number less than zero;
    若所述符号为正号,且所述初始量化残差绝对值为偶数,则确定所述带符号的初始量化残差为大于零的偶数;If the sign is positive and the absolute value of the initial quantized residual is an even number, then it is determined that the signed initial quantized residual is an even number greater than zero;
    若所述符号为负号,且所述初始量化残差绝对值为偶数,则确定所述带符号的初始量化残差为小于零的偶数。If the sign is a negative sign and the absolute value of the initial quantized residual is an even number, it is determined that the signed initial quantized residual is an even number less than zero.
  19. 根据权利要求15所述的方法,其中,所述确定当前点的初始量化残差绝对值,包括:The method according to claim 15, wherein determining the initial quantized residual absolute value of the current point includes:
    对所述当前点的属性信息进行预测,确定所述当前点的属性预测值;Predict the attribute information of the current point and determine the attribute prediction value of the current point;
    获取所述当前点的属性值,根据所述属性值和所述属性预测值进行残差计算,确定所述当前点的属 性残差值;Obtain the attribute value of the current point, perform residual calculation based on the attribute value and the attribute prediction value, and determine the attribute residual value of the current point;
    对所述属性残差值进行量化处理并计算绝对值,得到所述当前点的初始量化残差绝对值。The attribute residual value is quantized and the absolute value is calculated to obtain the initial quantized residual absolute value of the current point.
  20. 根据权利要求19所述的方法,其中,所述根据所述初始量化残差绝对值和预设常数值,确定所述当前点的量化残差绝对值,包括:The method according to claim 19, wherein determining the absolute value of the quantized residual of the current point based on the initial absolute value of the quantized residual and a preset constant value includes:
    根据所述初始量化残差绝对值和所述预设常数值进行加法计算,得到第一候选量化残差绝对值;Perform an addition calculation based on the initial quantized residual absolute value and the preset constant value to obtain a first candidate quantized residual absolute value;
    根据所述初始量化残差绝对值和所述预设常数值进行减法计算,得到第二候选量化残差绝对值;Perform subtraction calculation according to the initial quantized residual absolute value and the preset constant value to obtain a second candidate quantized residual absolute value;
    基于所述第一候选量化残差绝对值和所述第二候选量化残差绝对值,确定所述当前点的量化残差绝对值。A quantized residual absolute value of the current point is determined based on the first candidate quantized residual absolute value and the second candidate quantized residual absolute value.
  21. 根据权利要求20所述的方法,其中,所述基于所述第一候选量化残差绝对值和所述第二候选量化残差绝对值,确定所述当前点的量化残差绝对值,包括:The method of claim 20, wherein determining the absolute value of the quantized residual of the current point based on the first candidate quantized residual absolute value and the second candidate quantized residual absolute value includes:
    根据所述第一候选量化残差绝对值、所述符号和所述属性预测值,确定第一候选属性重建值;以及对所述第一候选属性重建值和所述属性值进行失真代价计算,得到第一代价值;Determine a first candidate attribute reconstruction value according to the first candidate quantized residual absolute value, the symbol and the attribute prediction value; and perform a distortion cost calculation on the first candidate attribute reconstruction value and the attribute value, Get the first generation value;
    根据所述第二候选量化残差绝对值、所述符号和所述属性预测值,确定第二候选属性重建值;以及对所述第二候选属性重建值和所述属性值进行失真代价计算,得到第二代价值;Determine a second candidate attribute reconstruction value according to the second candidate quantized residual absolute value, the symbol and the attribute prediction value; and perform a distortion cost calculation on the second candidate attribute reconstruction value and the attribute value, Get second generation value;
    根据所述第一代价值和所述第二代价值,从所述第一候选量化残差绝对值和所述第二候选量化残差绝对值中确定所述当前点的量化残差绝对值。The quantized residual absolute value of the current point is determined from the first candidate quantized residual absolute value and the second candidate quantized residual absolute value based on the first generation value and the second generation value.
  22. 根据权利要求21所述的方法,其中,所述根据所述第一代价值和所述第二代价值,从所述第一候选量化残差绝对值和所述第二候选量化残差绝对值中确定所述当前点的量化残差绝对值,包括:The method of claim 21 , wherein the first candidate quantized residual absolute value and the second candidate quantized residual absolute value are obtained based on the first generation value and the second generation value. Determine the absolute value of the quantized residual of the current point, including:
    若所述第一代价值和所述第二代价值满足第三预设条件且所述第二候选量化残差绝对值满足第四预设条件,则将所述第二候选量化残差绝对值确定为所述当前点的量化残差绝对值;If the first generation value and the second generation value satisfy the third preset condition and the second candidate quantization residual absolute value satisfies the fourth preset condition, then the second candidate quantization residual absolute value is Determine the absolute value of the quantized residual as the current point;
    若所述第一代价值和所述第二代价值不满足所述第三预设条件或者所述第二候选量化残差绝对值不满足所述第四预设条件,则将所述第一候选量化残差绝对值确定为所述当前点的量化残差绝对值。If the first-generation value and the second-generation value do not meet the third preset condition or the second candidate quantized residual absolute value does not meet the fourth preset condition, then the first The candidate quantized residual absolute value is determined as the quantized residual absolute value of the current point.
  23. 根据权利要求22所述的方法,其中,所述方法还包括:The method of claim 22, wherein the method further includes:
    若所述第二代价值小于或等于所述第一代价值,则确定所述第一代价值和所述第二代价值满足所述第三预设条件;If the second generation value is less than or equal to the first generation value, it is determined that the first generation value and the second generation value meet the third preset condition;
    若所述第二代价值大于所述第一代价值,则确定所述第一代价值和所述第二代价值不满足所述第三预设条件。If the second generation value is greater than the first generation value, it is determined that the first generation value and the second generation value do not meet the third preset condition.
  24. 根据权利要求22所述的方法,其中,所述方法还包括:The method of claim 22, wherein the method further includes:
    若所述第二候选量化残差绝对值大于或等于所述预设阈值,则确定所述第二候选量化残差绝对值满足所述第四预设条件;If the absolute value of the second candidate quantized residual is greater than or equal to the preset threshold, it is determined that the absolute value of the second candidate quantized residual satisfies the fourth preset condition;
    若所述第二候选量化残差绝对值小于所述预设阈值,则确定所述第二候选量化残差绝对值不满足所述第四预设条件。If the absolute value of the second candidate quantized residual is less than the preset threshold, it is determined that the absolute value of the second candidate quantized residual does not satisfy the fourth preset condition.
  25. 根据权利要求21所述的方法,其中,所述对所述第一候选属性重建值和所述属性值进行失真代价计算,得到第一代价值,包括:The method according to claim 21, wherein said performing distortion cost calculation on said first candidate attribute reconstruction value and said attribute value to obtain the first generation value includes:
    根据所述第一候选属性重建值和所述属性值进行差值的绝对值计算,得到第一差值绝对值,将所述第一差值绝对值作为所述第一代价值;Calculate the absolute value of the difference according to the first candidate attribute reconstruction value and the attribute value to obtain the first absolute value of the difference, and use the first absolute value of the difference as the first generation value;
    所述对所述第二候选属性重建值和所述属性值进行失真代价计算,得到第二代价值,包括:Calculating the distortion cost on the second candidate attribute reconstruction value and the attribute value to obtain the second generation value includes:
    根据所述第二候选属性重建值和所述属性值进行差值的绝对值计算,得到第二差值绝对值,将所述第二差值绝对值作为所述第二代价值。The absolute value of the difference is calculated based on the second candidate attribute reconstruction value and the attribute value to obtain a second absolute value of the difference, and the second absolute value of the difference is used as the second generation value.
  26. 根据权利要求21所述的方法,其中,所述对所述第一候选属性重建值和所述属性值进行失真代价计算,得到第一代价值,包括:The method according to claim 21, wherein said performing distortion cost calculation on said first candidate attribute reconstruction value and said attribute value to obtain the first generation value includes:
    根据所述第一候选属性重建值和所述属性值进行差值的绝对值计算,得到第一差值绝对值;Calculate the absolute value of the difference according to the first candidate attribute reconstruction value and the attribute value to obtain the first absolute value of the difference;
    对所述第一差值绝对值和所述第一候选量化残差绝对值进行加法运算,得到所述第一代价值;Add the first difference absolute value and the first candidate quantized residual absolute value to obtain the first generation value;
    所述对所述第二候选属性重建值和所述属性值进行失真代价计算,得到第二代价值,包括:Calculating the distortion cost on the second candidate attribute reconstruction value and the attribute value to obtain the second generation value includes:
    根据所述第二候选属性重建值和所述属性值进行差值的绝对值计算,得到第二差值绝对值;Calculate the absolute value of the difference according to the second candidate attribute reconstruction value and the attribute value to obtain a second absolute value of the difference;
    对所述第二差值绝对值和所述第二候选量化残差绝对值进行加法运算,得到所述第二代价值。The second generation value is obtained by adding the second difference absolute value and the second candidate quantization residual absolute value.
  27. 根据权利要求26所述的方法,其中,所述方法还包括:The method of claim 26, wherein the method further includes:
    确定第一因子和第二因子;Determine the first factor and the second factor;
    根据所述第一因子和所述第二因子对所述第一差值绝对值与所述第一候选量化残差绝对值进行加权和运算,得到所述第一代价值;Perform a weighted sum operation on the first difference absolute value and the first candidate quantization residual absolute value according to the first factor and the second factor to obtain the first generation value;
    所述方法还包括:The method also includes:
    确定第三因子和第四因子;Determine the third and fourth factors;
    根据所述第三因子和所述第四因子对所述第二差值绝对值与所述第二候选量化残差绝对值进行加权和运算,得到所述第二代价值。The second generation value is obtained by performing a weighted sum operation on the second difference absolute value and the second candidate quantization residual absolute value according to the third factor and the fourth factor.
  28. 根据权利要求21所述的方法,其中,所述方法还包括:The method of claim 21, wherein the method further includes:
    将所述第一候选量化残差绝对值确定为所述第一代价值;determining the first candidate quantized residual absolute value as the first generation value;
    将所述第二候选量化残差绝对值确定为所述第二代价值。The second candidate quantized residual absolute value is determined as the second generation value.
  29. 根据权利要求21所述的方法,其中,所述根据所述第一候选量化残差绝对值、所述符号和所述属性预测值,确定第一候选属性重建值,包括:The method of claim 21, wherein determining the first candidate attribute reconstruction value based on the first candidate quantized residual absolute value, the sign, and the attribute prediction value includes:
    对所述第一候选量化残差绝对值进行反量化处理,得到第一候选重建残差绝对值;Perform inverse quantization processing on the first candidate quantized residual absolute value to obtain the first candidate reconstructed residual absolute value;
    根据所述符号和所述第一候选重建残差绝对值,得到带符号的第一候选重建残差;Obtain a signed first candidate reconstruction residual according to the symbol and the absolute value of the first candidate reconstruction residual;
    对所述带符号的第一候选重建残差和所述属性预测值进行加法运算,得到所述第一候选属性重建值;Perform an addition operation on the signed first candidate reconstruction residual and the attribute prediction value to obtain the first candidate attribute reconstruction value;
    所述根据所述第二候选量化残差绝对值、所述符号和所述属性预测值,确定第二候选属性重建值,包括:Determining a second candidate attribute reconstruction value based on the second candidate quantized residual absolute value, the symbol, and the attribute prediction value includes:
    对所述第二候选量化残差绝对值进行反量化处理,得到第二候选重建残差绝对值;Perform inverse quantization processing on the second candidate quantized residual absolute value to obtain a second candidate reconstructed residual absolute value;
    根据所述符号和所述第二候选重建残差绝对值,得到带符号的第二候选重建残差;Obtain a signed second candidate reconstruction residual according to the symbol and the absolute value of the second candidate reconstruction residual;
    对所述带符号的第二候选重建残差和所述属性预测值进行加法运算,得到所述第二候选属性重建值。An addition operation is performed on the signed second candidate reconstruction residual and the attribute prediction value to obtain the second candidate attribute reconstruction value.
  30. 根据权利要求21所述的方法,其中,所述方法还包括:The method of claim 21, wherein the method further includes:
    在所述属性信息为颜色分量时,确定所述当前点的跨分量属性预测值;When the attribute information is a color component, determine the cross-component attribute prediction value of the current point;
    所述根据所述属性值和所述属性预测值进行残差计算,确定所述当前点的属性残差值,包括:根据所述属性值、所述属性预测值和所述跨分量属性预测值进行残差计算,确定所述当前点的属性残差值。The step of performing residual calculation based on the attribute value and the attribute predicted value and determining the attribute residual value of the current point includes: based on the attribute value, the attribute predicted value and the cross-component attribute predicted value. Perform residual calculation to determine the attribute residual value of the current point.
  31. 根据权利要求30所述的方法,其中,所述根据所述第一候选量化残差绝对值、所述符号和所述属性预测值,确定第一候选属性重建值,包括:The method of claim 30, wherein determining the first candidate attribute reconstruction value based on the first candidate quantized residual absolute value, the sign and the attribute prediction value includes:
    对所述第一候选量化残差绝对值进行反量化处理,得到第一候选重建残差绝对值;Perform inverse quantization processing on the first candidate quantized residual absolute value to obtain the first candidate reconstructed residual absolute value;
    根据所述符号和所述第一候选重建残差绝对值,得到带符号的第一候选重建残差;Obtain a signed first candidate reconstruction residual according to the symbol and the absolute value of the first candidate reconstruction residual;
    对所述带符号的第一候选重建残差、所述属性预测值和所述跨分量属性预测值进行加法运算,得到所述第一候选属性重建值;Perform an addition operation on the signed first candidate reconstruction residual, the attribute prediction value and the cross-component attribute prediction value to obtain the first candidate attribute reconstruction value;
    所述根据所述第二候选量化残差绝对值、所述符号和所述属性预测值,确定第二候选属性重建值,包括:Determining a second candidate attribute reconstruction value based on the second candidate quantized residual absolute value, the symbol, and the attribute prediction value includes:
    对所述第二候选量化残差绝对值进行反量化处理,得到第二候选重建残差绝对值;Perform inverse quantization processing on the second candidate quantized residual absolute value to obtain a second candidate reconstructed residual absolute value;
    根据所述符号和所述第二候选重建残差绝对值,得到带符号的第二候选重建残差;Obtain a signed second candidate reconstruction residual according to the symbol and the absolute value of the second candidate reconstruction residual;
    对所述带符号的第二候选重建残差、所述属性预测值和所述跨分量属性预测值进行加法运算,得到所述第二候选属性重建值。An addition operation is performed on the signed second candidate reconstruction residual, the attribute prediction value and the cross-component attribute prediction value to obtain the second candidate attribute reconstruction value.
  32. 根据权利要求30所述的方法,其中,所述颜色分量包括下述至少之一:第一颜色分量、第二颜色分量和第三颜色分量;其中,The method of claim 30, wherein the color component includes at least one of the following: a first color component, a second color component, and a third color component; wherein,
    若所述颜色分量符合RGB颜色空间,则确定所述第一颜色分量、所述第二颜色分量和所述第三颜色分量分别为其中之一:R分量、G分量、B分量;If the color component conforms to the RGB color space, it is determined that the first color component, the second color component and the third color component are respectively one of: R component, G component, and B component;
    若所述颜色分量符合YUV颜色空间,则确定所述第一颜色分量、所述第二颜色分量和所述第三颜色分量分别为其中之一:Y分量、U分量、V分量。If the color component conforms to the YUV color space, it is determined that the first color component, the second color component and the third color component are respectively one of them: Y component, U component, V component.
  33. 一种码流,所述码流是根据待编码信息进行比特编码生成的;其中,所述待编码信息至少包括:当前点的量化残差绝对值,或者,所述当前点的量化残差绝对值以及对应的符号标识信息。A code stream, the code stream is generated by bit encoding according to the information to be encoded; wherein the information to be encoded at least includes: the absolute value of the quantized residual of the current point, or the absolute value of the quantized residual of the current point. value and corresponding symbol identification information.
  34. 一种编码器,所述编码器包括第一确定单元和编码单元;其中,An encoder, the encoder includes a first determination unit and a coding unit; wherein,
    所述第一确定单元,配置为确定当前点的初始量化残差绝对值以及所述当前点的初始量化残差的符号;以及在所述初始量化残差绝对值满足第一预设条件的情况下,根据所述符号和所述初始量化残差绝对值的奇偶特性,确定所述当前点的量化残差绝对值;The first determination unit is configured to determine the initial quantized residual absolute value of the current point and the sign of the initial quantized residual of the current point; and when the initial quantized residual absolute value satisfies a first preset condition Next, determine the quantized residual absolute value of the current point according to the parity characteristics of the symbol and the initial quantized residual absolute value;
    所述编码单元,配置为对所述量化残差绝对值进行编码,将所得到的编码比特写入码流。The encoding unit is configured to encode the absolute value of the quantization residual and write the resulting encoded bits into a code stream.
  35. 一种编码器,所述编码器包括第一存储器和第一处理器;其中,An encoder, the encoder includes a first memory and a first processor; wherein,
    所述第一存储器,用于存储能够在所述第一处理器上运行的计算机程序;The first memory is used to store a computer program capable of running on the first processor;
    所述第一处理器,用于在运行所述计算机程序时,执行如权利要求10至32任一项所述的方法。The first processor is configured to execute the method according to any one of claims 10 to 32 when running the computer program.
  36. 一种解码器,所述解码器包括解码单元和第二确定单元;其中,A decoder, the decoder includes a decoding unit and a second determination unit; wherein,
    所述解码单元,配置为解析码流,确定当前点的量化残差绝对值;The decoding unit is configured to parse the code stream and determine the absolute value of the quantized residual at the current point;
    所述第二确定单元,配置为在所述量化残差绝对值满足第一预设条件的情况下,根据所述量化残差绝对值的奇偶特性,确定所述当前点的量化残差的符号;以及根据所述量化残差绝对值和所述符号,确定所述当前点的属性重建值。The second determination unit is configured to determine the sign of the quantized residual at the current point according to the parity characteristics of the absolute value of the quantized residual when the absolute value of the quantized residual satisfies the first preset condition. ; And determine the attribute reconstruction value of the current point according to the absolute value of the quantized residual and the sign.
  37. 一种解码器,所述解码器包括第二存储器和第二处理器;其中,A decoder, the decoder includes a second memory and a second processor; wherein,
    所述第二存储器,用于存储能够在所述第二处理器上运行的计算机程序;The second memory is used to store a computer program capable of running on the second processor;
    所述第二处理器,用于在运行所述计算机程序时,执行如权利要求1至9任一项所述的方法。The second processor is configured to execute the method according to any one of claims 1 to 9 when running the computer program.
  38. 一种计算机可读存储介质,其中,所述计算机可读存储介质存储有计算机程序,所述计算机程序被执行时实现如权利要求1至9任一项所述的方法、或者如权利要求10至32任一项所述的方法。A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program. When the computer program is executed, the method of any one of claims 1 to 9 is implemented, or the method of claims 10 to 9 is implemented. The method described in any one of 32.
PCT/CN2022/103817 2022-07-05 2022-07-05 Encoding method, decoding method, code stream, encoders, decoders and storage medium WO2024007144A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/103817 WO2024007144A1 (en) 2022-07-05 2022-07-05 Encoding method, decoding method, code stream, encoders, decoders and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/103817 WO2024007144A1 (en) 2022-07-05 2022-07-05 Encoding method, decoding method, code stream, encoders, decoders and storage medium

Publications (1)

Publication Number Publication Date
WO2024007144A1 true WO2024007144A1 (en) 2024-01-11

Family

ID=89454744

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/103817 WO2024007144A1 (en) 2022-07-05 2022-07-05 Encoding method, decoding method, code stream, encoders, decoders and storage medium

Country Status (1)

Country Link
WO (1) WO2024007144A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130272424A1 (en) * 2012-04-16 2013-10-17 Qualcomm Incorporated Sign hiding techniques for quantized transform coefficients in video coding
CN104380740A (en) * 2012-06-29 2015-02-25 索尼公司 Encoding device, encoding method, decoding device, and decoding method
US20190311500A1 (en) * 2018-04-10 2019-10-10 Apple Inc. Point cloud compression
CN112995662A (en) * 2021-03-12 2021-06-18 北京大学深圳研究生院 Method and device for attribute entropy coding and entropy decoding of point cloud
WO2022131948A1 (en) * 2020-12-14 2022-06-23 Huawei Technologies Co., Ltd. Devices and methods for sequential coding for point cloud compression

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130272424A1 (en) * 2012-04-16 2013-10-17 Qualcomm Incorporated Sign hiding techniques for quantized transform coefficients in video coding
CN104380740A (en) * 2012-06-29 2015-02-25 索尼公司 Encoding device, encoding method, decoding device, and decoding method
US20190311500A1 (en) * 2018-04-10 2019-10-10 Apple Inc. Point cloud compression
WO2022131948A1 (en) * 2020-12-14 2022-06-23 Huawei Technologies Co., Ltd. Devices and methods for sequential coding for point cloud compression
CN112995662A (en) * 2021-03-12 2021-06-18 北京大学深圳研究生院 Method and device for attribute entropy coding and entropy decoding of point cloud

Similar Documents

Publication Publication Date Title
JP6245888B2 (en) Encoder and encoding method
JP2016226001A (en) Decoder and decoding method
JP7213368B2 (en) Inter-channel prediction and transform techniques and apparatus for point cloud attribute coding
CN114424247A (en) Method and device for point cloud coding
CN105474642A (en) Re-encoding image sets using frequency-domain differences
WO2023130333A1 (en) Encoding and decoding method, encoder, decoder, and storage medium
US20220292730A1 (en) Method and apparatus for haar-based point cloud coding
CN112399165B (en) Decoding method and device, computer equipment and storage medium
CN114598883A (en) Point cloud attribute prediction method, encoder, decoder and storage medium
JP2015019364A (en) Image compression apparatus and method
CN112887713A (en) Picture compression and decompression method and device
WO2024007144A1 (en) Encoding method, decoding method, code stream, encoders, decoders and storage medium
Kavitha et al. A survey of image compression methods for low depth-of-field images and image sequences
JP2024505798A (en) Point cloud encoding/decoding method and system, point cloud encoder, and point cloud decoder
WO2023240662A1 (en) Encoding method, decoding method, encoder, decoder, and storage medium
WO2023173238A1 (en) Encoding method, decoding method, code stream, encoder, decoder, and storage medium
WO2023173237A1 (en) Encoding method, decoding method, bit stream, encoder, decoder, and storage medium
WO2023240660A1 (en) Decoding method, encoding method, decoder, and encoder
WO2023103565A1 (en) Point cloud attribute information encoding and decoding method and apparatus, device, and storage medium
WO2024060161A1 (en) Encoding method, decoding method, encoder, decoder and storage medium
WO2022217472A1 (en) Point cloud encoding and decoding methods, encoder, decoder, and computer readable storage medium
WO2023024842A1 (en) Point cloud encoding/decoding method, apparatus and device, and storage medium
WO2023123284A1 (en) Decoding method, encoding method, decoder, encoder, and storage medium
WO2022257145A1 (en) Point cloud attribute prediction method and apparatus, and codec
WO2024065406A1 (en) Encoding and decoding methods, bit stream, encoder, decoder, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22949733

Country of ref document: EP

Kind code of ref document: A1