WO2024251063A1 - 增益图编码方法、解码方法、装置、设备及介质 - Google Patents
增益图编码方法、解码方法、装置、设备及介质 Download PDFInfo
- Publication number
- WO2024251063A1 WO2024251063A1 PCT/CN2024/096983 CN2024096983W WO2024251063A1 WO 2024251063 A1 WO2024251063 A1 WO 2024251063A1 CN 2024096983 W CN2024096983 W CN 2024096983W WO 2024251063 A1 WO2024251063 A1 WO 2024251063A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image block
- gain map
- target image
- information
- encoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
- G06T9/001—Model-based coding, e.g. wire frame
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/167—Position within a video image, e.g. region of interest [ROI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/184—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/33—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/625—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N19/98—Adaptive-dynamic-range coding [ADRC]
Definitions
- the present application belongs to the field of communication technology, and specifically relates to a gain map encoding method, decoding method, device, equipment and medium.
- gain map as additional information will increase the storage space of the image.
- the storage space of gain map can be reduced by downsampling and then compressing and encoding for storage, the downsampling process will lose some information, affecting the quality of gain map image, and thus affecting the image quality of reconstructed image.
- the purpose of the embodiments of the present application is to provide a gain map encoding method, decoding method, device, equipment and medium, which can solve the problem that the existing gain map encoding method affects the image quality of the reconstructed image.
- the target image block identification information and the image block group are encoded to obtain encoding information of the gain map.
- an embodiment of the present application provides a gain map encoding device, including:
- a first acquisition module used to acquire at least one target image block in the gain map, wherein the brightness of pixels in the target image block is greater than a first threshold
- a first processing module configured to determine target image block identification information and an image block group of the gain map according to the at least one target image block;
- the second processing module is used to encode the target image block identification information and the image block group to obtain encoding information of the gain map.
- an embodiment of the present application provides a gain map decoding method, including:
- the gain map is reconstructed according to the image block group and the target image block identification information.
- an embodiment of the present application provides a gain map decoding device, including:
- a second acquisition module used to acquire encoding information of the gain map
- a decoding module used for decoding the coded information to obtain the image block group and target image block identification information
- a reconstruction module is used to reconstruct the gain map according to the image block group and the target image block identification information.
- an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect or the third aspect are implemented.
- an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored.
- the program or instruction is executed by a processor, the steps of the method described in the first aspect or the third aspect are implemented.
- an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the method described in the first aspect or the third aspect.
- an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect or the third aspect.
- an embodiment of the present application provides an electronic device, which is configured to execute the method described in the first aspect.
- the identification information of the at least one target image block and the image block group including the at least one target image block can be determined for the at least one target image block, so as to encode them and obtain the encoding information of the gain map.
- the effective image of the gain map is retained for encoding, which improves the encoding efficiency, reduces the storage space, and can also improve the image quality of the reconstructed image.
- Figure 1 is one of the schematic diagrams of gain map application
- Figure 2 is the second schematic diagram of gain map application
- FIG3 is a schematic diagram of a method flow chart of an embodiment of the present application.
- Figure 4 is one of the gain map division diagrams
- Figure 5 is the second schematic diagram of gain map division
- Figure 6 is the third schematic diagram of gain map division
- Figure 7 is the fourth schematic diagram of gain map division
- FIG8 is a schematic diagram of source image block index value allocation
- FIG9 is a schematic diagram of a target image block combination
- FIG10 is a schematic diagram of target image block identification information
- FIG11 is a schematic diagram of downsampling of image block groups
- FIG12 is a second schematic diagram of a method flow chart of an embodiment of the present application.
- FIG13 is a schematic diagram of a method application process according to an embodiment of the present application.
- FIG14 is a second schematic diagram of the method application process of an embodiment of the present application.
- FIG15 is a schematic diagram of decoding of a picture block group
- FIG16 is a third schematic diagram of the method application process of an embodiment of the present application.
- FIG17 is a fourth schematic diagram of the method application flow of an embodiment of the present application.
- FIG18 is a second schematic diagram of image block group decoding
- FIG19 is a schematic diagram of a module structure of a device according to an embodiment of the present application.
- FIG20 is a second schematic diagram of the module structure of the device according to an embodiment of the present application.
- FIG21 is a schematic diagram of the structure of an electronic device according to an embodiment of the present application.
- FIG. 22 is a schematic diagram of the structure of an electronic device according to another embodiment of the present application.
- first, second, etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first”, “second”, etc. are generally of one type, and the number of objects is not limited.
- the first object can be one or more.
- “and/or” in the specification and claims represents at least one of the connected objects, and the character “/" generally indicates that the objects associated with each other are in an "or” relationship.
- Gain map (also called gain map or enhancement map) is usually generated when capturing HDR images. As an additional information, it can be stored in a specific file format, such as stored in the format of the image or stored as additional information of a certain image format, and then encoded and transmitted. When displayed, the gain map is decoded. The gain map is generated based on the HDR image and its corresponding SDR image after tone mapping.
- the use of gain map can be SDR and Gain map to generate the corresponding HDR image, or HDR and Gain map to generate the corresponding SDR image, as shown in Figures 1 and 2. In both formats, the Gain map needs to be stored.
- the area in the HDR image that needs to be brightened by gain map is limited. This is mainly because: 1) If the brightened area is too large, the large area of brightened area will cause an uncomfortable visual experience to the human eye. Therefore, when generating the gain map, it is necessary to consider appropriately controlling the area of the brightened area. 2) If the brightened area is too large, the visual experience advantage brought by HDR will be reduced. 3) In the natural content captured, the highlighted area is usually limited.
- a gain map encoding method includes:
- Step 301 Obtain at least one target image block in a gain map, wherein the brightness of pixels in the target image block is greater than a first threshold.
- the first threshold is a preset brightness threshold.
- at least one target image block in the gain map including pixels (highlighted pixels) with brightness greater than the first threshold is selected through the first threshold, so that only the encoding information related to the at least one target image block is subsequently generated, and redundant image blocks in the gain map are eliminated.
- Step 302 Determine target image block identification information and an image block group of the gain map according to the at least one target image block.
- the target image block identification information is the identification information of the at least one target image block, and the image block group includes the at least one target image block. That is, in this step, after executing step 301, it will be possible to further determine the identification information of the target image block in the gain map, and the image block group including the target image block.
- Step 303 Encode the target image block identification information and the image block group to obtain encoding information of the gain map.
- the identification information of the at least one target image block and the image block group including the at least one target image block can be determined for the at least one target image block, so as to encode them and obtain the encoding information of the gain map.
- the effective image of the gain map is retained for encoding, which improves the encoding efficiency, reduces the storage space, and can also improve the image quality of the reconstructed image.
- the gain map is generated in the HDR image acquisition node.
- the original resolution of the gain map is W ⁇ H, so the image resolution A ⁇ B of the target image block is less than or equal to W ⁇ H.
- obtaining at least one target image block in the gain map includes:
- the first image resolution is preset.
- the size of the first image resolution is preset, that is, the size of the source image block.
- the size of the source image block By dividing the gain map according to the first image resolution, one or more source image blocks of the same size as the first image resolution can be obtained, as shown in Figures 4 and 5.
- a second threshold is also preset, that is, the threshold of the proportion of highlight pixels in the source image block.
- At least one target image block is identified in at least one source image block, that is, the proportion of highlighted pixels in the obtained target image block is greater than the second threshold.
- the first image resolution is less than or equal to W ⁇ H, such as 8 ⁇ 8, 16 ⁇ 16, 64 ⁇ 64, 64 ⁇ 32, 16 ⁇ 64, 128 ⁇ 128, 256 ⁇ 256, etc.
- the second threshold value may be 70% or 80%, etc.
- obtaining at least one target image block in the gain map includes:
- a source image block in which the brightness of pixels in the at least one source image block is greater than the first threshold and the proportion is greater than a third threshold is determined as the at least one target image block.
- the third threshold and the fourth threshold are similar to the above-mentioned second threshold, which are the thresholds of the proportion of highlighted pixels in the source image block.
- the first condition is pre-set through the restrictions of the third threshold and the fourth threshold, so that the second image resolution can ensure that the obtained source image block can be divided into two categories, one is the source image block with a larger proportion of highlighted pixels, and the other is the source image block with a smaller proportion of highlighted pixels.
- the applicable second image resolution can be determined in combination with the size of the target area (which can also be understood as the area) and the first condition.
- source image blocks in which the proportion of highlighted pixels is greater than the third threshold and source image blocks in which the proportion of highlighted pixels is less than the fourth threshold are obtained.
- the target image block is determined, that is, the source image block in which the proportion of highlighted pixels is greater than the third threshold.
- the process of determining the second image resolution is a process of adaptively adjusting the image resolution based on the size of the target area and the first condition. For example, after the image resolution A1 ⁇ B1 is first determined, the gain map is segmented based on the image resolution A1 ⁇ B1, and multiple image blocks as shown in Figure 6 are obtained. Since there are image blocks (dashed area in the figure) that do not meet the first condition, the image resolution needs to be further adjusted. After the gain map is segmented based on the image resolution A2 ⁇ B2 to obtain multiple image blocks that meet the first condition as shown in Figure 7, the image resolution A2 ⁇ B2 is determined as the second image resolution.
- the third threshold may be the same as or different from the second threshold.
- the value of the third threshold may be 90% or 95% or the like, and the value of the fourth threshold may be 10% or 5% or the like.
- the shape of the source image block may be a square, as shown in FIG. 4 ; or a rectangle, as shown in FIG. 5 .
- the identification of the target area and the target image block can be achieved based on artificial intelligence learning, which will not be elaborated here.
- the target image block identification information and the image block group of the gain map are determined according to the at least one target image block;
- the step of determining the target image block identification information and the image block group of the gain map according to the at least one target image block comprises:
- the at least one target image block is reorganized according to a first strategy to generate the image block group; wherein the first strategy indicates the way in which the at least one target image block is combined.
- the target image block identification information is used to indicate the position information of at least one target image block in the gain map. For example, after the gain map is segmented, the source image block index values are assigned from 0 in a predetermined order, such as from left to right (as shown in FIG8 ) or from top to bottom (not shown in the figure), so the target image block identification information can be generated based on the index value.
- the first strategy is pre-set and is used to indicate the way in which the target image blocks are combined.
- the target image blocks are combined horizontally in the order of index values, or vertically in the order of index values, or zig-zag in the order of index values.
- the combination is performed in the order of index values to facilitate decoding and reconstruction at the decoding end.
- target image block combination method can also be implemented in other ways, not limited to that shown in the figure.
- the target image block identification information is bit information, each bit of information corresponds to a source image block in the gain map, and indicates whether the source image block is the target image block.
- each bit information can be preset to indicate whether the source image block is the target image block. For example, when the bit information is "1”, it indicates that the source image block is the target image block, and when the bit information is "0", it indicates that the source image block is the target image block; or, when the bit information is "0", it indicates that the source image block is the target image block, and when the bit information is "1", it indicates that the source image block is the target image block.
- the gain map is divided into 16 source image blocks, and each source image block index value is assigned from left to right to 0 to 15.
- the target image block identification information (also called a brightened block identification) is 16-bit information "0000100000100000".
- the target image block identification information in addition to the brightened block identification, also needs to include the source image block index value to assist the decoding end in determining the position of the target image block for successful decoding.
- the encoding of the gain map can be achieved by encoding the target image block identification information and the image block group respectively.
- encoding the target image block identification information and the image block group to obtain encoding information of the gain map includes:
- the encoding information of the gain map is obtained according to the first information and the second information.
- the image block group is first downsampled to obtain the image to be coded, and then the obtained image to be coded is encoded, as shown in Figure 11.
- the image block group is downsampled, such as 1/4 downsampling or 1/16 downsampling.
- encoding the target image block identification information and the image block group to obtain encoding information of the gain map includes:
- the encoding information of the gain map is obtained according to the first information and the third information.
- the encoding information of the gain map includes the first information and the third information.
- the encoding of the target image block identification information can be processed by using encoding methods such as Run-Length Encoding or other encoding methods.
- the image block group can be encoded according to the encoding standards such as JPEG, AVIF, HEIF, etc.
- spatial redundant information is usually removed by spatial transformation such as Discrete Cosine Transform (DCT) or DCT-like transformation (such as DCT-like integer transformation in video and image compression standards). Due to the characteristics of DCT transformation, the redundancy removal efficiency of flat areas is high.
- DCT Discrete Cosine Transform
- DCT-like transformation such as DCT-like integer transformation in video and image compression standards Due to the characteristics of DCT transformation, the redundancy removal efficiency of flat areas is high.
- the encoding method adopted for the image block group or the image to be encoded may be lossless compression or lossy compression.
- the method further comprises:
- the encoding information and the auxiliary information are stored.
- the auxiliary information is target image block identification information and related information used for independent encoding of image block groups.
- the auxiliary information is stored together with the gain map encoding information, which can facilitate decoding of the gain map encoding information based on the auxiliary information.
- auxiliary information can also be understood as metadata (Meta data).
- the auxiliary information includes at least one of the following:
- the at least one target image block is reorganized using a strategy.
- the original resolution of the gain map is usually the same as the resolution of the HDR/SDR image, the original resolution of the gain map is not necessary in the auxiliary information.
- the index of at least one target image block is determined after allocating the index of the source image block, and can indicate the position of the target image block, such as the partition block index value shown in FIG. 10 .
- the auxiliary information can indicate whether the encoding information of the gain map includes the first information and the second information by including whether it is encoded for the target image block, so that the decoding end can achieve effective decoding.
- the encoding method is at least one of an encoding method of a target image block and an encoding method of identification information of the target image block.
- the down-sampling ratio is the ratio used for down-sampling the image block group after the image block group is determined, such as 1/4 or 1/16.
- the auxiliary information may also include other contents, which are not listed here one by one.
- the identification information of the at least one target image block and the image block group including the at least one target image block can be determined for the at least one target image block, so as to encode them and obtain the encoding information of the gain map.
- the effective image of the gain map is retained for encoding, which improves the encoding efficiency, reduces the storage space, and can also improve the image quality of the reconstructed image.
- a gain map decoding method includes:
- Step 1201 obtaining encoding information of a gain map
- Step 1202 decoding the coded information to obtain the image block group and target image block identification information
- Step 1203 reconstruct the gain map according to the image block group and the target image block identification information.
- the image block group and the target image block identification information are obtained by decoding it, and the gain map is further reconstructed according to the image block group and the target image block identification information.
- obtaining the encoding information of the gain map may be extracting the encoding information of the gain map from the storage space; if the decoding end is different from the encoding end, obtaining the encoding information of the gain map may be the encoding information of the gain map received by the decoding end from the encoding end.
- the gain map is needed, such as generating an SDR/HDR image
- the stored encoding information is decoded to obtain the image block group and the target image block identification information.
- the gain map is further reconstructed based on the decoded image block group and the target image block identification information.
- reconstructing the gain map according to the image block group and the target image block identification information includes:
- the first strategy indicates the manner in which the at least one target image block is combined.
- At least one target image block is first restored; and then the gain map is reconstructed based on the at least one target image block and the decoded target image block identification information.
- the target image block identification information is bit information, each bit of information corresponds to a source image block in the gain map, and indicates whether the source image block is the target image block.
- the encoding information of the gain map includes first information and second information
- decoding the encoding information to obtain the image block group and the target image block identification information includes:
- the decoded image is up-sampled to obtain the target image block group
- the first information is decoded to obtain the target image block identification information.
- the decoded image is upsampled to obtain a target image block group.
- the encoding information of the gain map includes first information and third information
- decoding the encoding information to obtain the image block group and target image block identification information includes:
- the first information is decoded to obtain the target image block identification information.
- the target image block group will be directly obtained after decoding the third information.
- the auxiliary information used in the encoding can also be combined to achieve effective decoding.
- the auxiliary information is extracted from the storage space together with the encoding information of the gain map, or is received together with the encoding information of the gain map.
- the method after reconstructing the gain map according to the image block group and the target image block identification information, the method further includes:
- An SDR image is reconstructed and generated according to the gain map and the HDR image.
- the required HDR image or SDR image is generated.
- this method is implemented in conjunction with the gain map encoding method of the above embodiment.
- the implementation of the above method embodiment is applicable to this method and can achieve the same technical effect.
- a gain map is generated during the HDR image acquisition phase.
- the gain map brightening area is identified, that is, the target area (brightening area) in the gain map whose pixel points are greater than the first threshold is identified.
- the gain map brightening area block is determined, that is, after determining the second image resolution based on the size of the brightening area and the first condition, the gain map is divided into at least one source image block based on the second image resolution, and at least one target image is determined therefrom.
- the gain map brightened area block is reorganized, that is, at least one target image block is reorganized according to the first strategy.
- the reorganized brightened area block is encoded.
- the encoding information of the gain map includes not only the encoding information of the reorganized brightened area block, but also the encoding information of the target image block identification information.
- the steps of generating the target image block identification information and encoding the target image block identification information are not shown in the figure.
- the saved image format is an SDR image and the corresponding gain map encoding information
- the gain map is reconstructed.
- the gain map of the original resolution is reconstructed based on the auxiliary information (such as the first image resolution, the second image resolution, the original image resolution of the gain map, the index of the target image block), and the decoded gain map image block group and target image block identification information, as shown in Figure 15.
- an HDR image is generated.
- the decoding end is also the encoding end, before decoding, it is only necessary to extract the encoding information and corresponding auxiliary information of the gain map to be decoded from the storage space, and then perform decoding; if the decoding end is different from the encoding end, before decoding, it is necessary to receive the encoding information and corresponding auxiliary information of the gain map to be decoded sent by the encoding end, and then perform decoding.
- a gain map is generated in the HDR image acquisition stage.
- the gain map brightening area recognition is performed, that is, the target area (brightening area) in the gain map whose pixel points are greater than the first threshold is identified.
- the gain map brightening area block is determined, that is, after determining the second image resolution based on the size of the brightening area and the first condition, the gain map is divided into at least one source image block based on the second image resolution, and at least one target image block (brightening area block) is determined therefrom.
- the gain map brightening area block is reorganized, that is, at least one target image block is reorganized according to the first strategy.
- the reorganized brightening area block is downsampled, that is, the reorganized brightening area block is downsampled according to 1/4 or 1/6.
- the downsampled reorganized brightening area block is encoded.
- the encoding information of the gain map includes not only the encoding information of the reorganized brightening area block, but also the encoding information of the target image block identification information. The steps of generating the target image block identification information and encoding the target image block identification information are not shown in the figure.
- the saved image format is an SDR image and the corresponding encoding information of the gain map
- the next step is to upsample the decoded reconstructed brightened area blocks.
- the next step is to reconstruct the gain map.
- the gain map of the original resolution is reconstructed based on the auxiliary information (such as the first image resolution, the second image resolution, the original image resolution of the gain map, the index of the target image block), and the image block group and target image block identification information of the upsampled gain map, as shown in Figure 18.
- the next step is to generate an HDR image based on the reconstructed gain map and the SDR image.
- the corresponding decoding process is similar to the above process, except that the generated SDR image is based on the decoded HDR image, as well as the encoded information and auxiliary information of the gain map.
- the gain map can be a single channel or multiple channels such as R/G/B.
- the gain map encoding method provided in the embodiment of the present application may be executed by a gain map encoding device.
- the gain map encoding method executed by the gain map encoding device is taken as an example to illustrate the gain map encoding device provided in the embodiment of the present application.
- a gain map encoding device 1900 includes:
- a first acquisition module 1910 is used to acquire at least one target image block in the gain map, wherein the brightness of pixels in the target image block is greater than a first threshold;
- a first processing module 1920 is configured to determine target image block identification information and an image block group of the gain map according to the at least one target image block;
- the second processing module 1930 is used to encode the target image block identification information and the image block group to obtain encoding information of the gain map.
- the first acquisition module includes:
- a third processing submodule configured to divide the gain map into at least one source image block based on the first image resolution
- a first identification submodule configured to determine, as the at least one target image block, a source image block in which the brightness of pixels in the at least one source image block is greater than the first threshold and the proportion is greater than a second threshold;
- the first image resolution is preset.
- the first acquisition module includes:
- a second identification submodule configured to identify a target area in the gain map based on the first threshold
- a fourth processing submodule configured to determine the resolution of the second image based on the size of the target area and a first condition, wherein the first condition includes that a proportion of pixels having a brightness greater than the first threshold in each image block after division is greater than a third threshold or less than a fourth threshold;
- a fifth processing submodule configured to divide the gain map into at least one source image block based on the second image resolution
- the sixth processing submodule is used to determine, as the at least one target image block, a source image block in which the brightness of pixels in the at least one source image block is greater than the first threshold and the proportion is greater than the third threshold.
- the first processing module includes:
- a first processing submodule configured to generate identification information of the target image block according to a position of the at least one target image block in the gain map
- the second processing submodule is used to reorganize the at least one target image block according to a first strategy to generate the image block group; wherein the first strategy indicates the way in which the at least one target image block is combined.
- the target image block identification information is bit information, each bit of information corresponds to a source image block in the gain map, and indicates whether the source image block is the target image block.
- the second processing module includes:
- a seventh processing submodule configured to encode the target image block identification information to obtain first information
- an eighth processing submodule configured to downsample the image block group to obtain an image to be encoded
- a ninth processing submodule configured to encode the image to be encoded to obtain second information
- a tenth processing submodule is used to obtain encoding information of the gain map according to the first information and the second information.
- the second processing module is further used for:
- the encoding information of the gain map is obtained according to the first information and the third information.
- the device further comprises:
- a fifth processing module configured to determine auxiliary information used for encoding the gain map
- a storage module is used to store the coding information and the auxiliary information.
- the auxiliary information includes at least one of the following:
- the at least one target image block is reorganized using a strategy.
- the device further comprises:
- a third processing module is used for, when the gain map needs to be used, decoding according to the encoding information to obtain the image block group and the target image block identification information;
- the fourth processing module is used to reconstruct the gain map according to the auxiliary information, the image block group and the target image block identification information.
- the device After obtaining at least one target image block in the gain map including pixels whose brightness is greater than the first threshold through the first threshold, the device can determine the identification information of the at least one target image block and the image block group including the at least one target image block for the at least one target image block, thereby encoding them to obtain the encoding information of the gain map. In this way, only the effective image of the gain map is retained for encoding, which improves the encoding efficiency, reduces the storage space, and can also improve the image quality of the reconstructed image.
- the gain map encoding device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip.
- the electronic device can be a terminal, or it can be other devices other than the terminal.
- the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application
- the gain map encoding device in the embodiment of the present application may be a device having an operating system.
- the operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
- the gain map encoding device provided in the embodiment of the present application can implement each process implemented by the method embodiments of Figures 2 to 18, and will not be described again here to avoid repetition.
- a gain map decoding device 2000 includes:
- the second acquisition module 2010 is used to acquire encoding information of the gain map
- a decoding module 220 configured to decode the coded information to obtain identification information of an image block group and a target image block;
- the reconstruction module 2030 is configured to reconstruct the gain map according to the image block group and the target image block identification information.
- the reconstruction module includes:
- a generating submodule configured to generate at least one target image block based on the first strategy and the image block group;
- a reconstruction submodule configured to reconstruct the gain map according to the at least one target image block and the target image block identification information
- the first strategy indicates the manner in which the at least one target image block is combined.
- the target image block identification information is bit information, each bit of information corresponds to a source image block in the gain map, and indicates whether the source image block is the target image block.
- the encoding information of the gain map includes first information and second information
- the decoding module is further used to:
- the decoded image is up-sampled to obtain the target image block group
- the first information is decoded to obtain the target image block identification information.
- the first information is decoded to obtain the target image block identification information.
- An SDR image is reconstructed and generated according to the gain map and the HDR image.
- the device After acquiring the encoding information of the encoded gain map, the device decodes the encoding information to obtain the image block group and the target image block identification information, and further reconstructs the gain map according to the image block group and the target image block identification information.
- the gain map decoding device in the embodiment of the present application may be a device having an operating system.
- the operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
- the gain map decoding device provided in the embodiment of the present application can implement each process implemented by the method embodiments of Figures 12 to 18, and will not be described again here to avoid repetition.
- an embodiment of the present application also provides an electronic device 2100, including a processor 2101 and a memory 2102, and the memory 2102 stores a program or instruction that can be executed on the processor 2101.
- the program or instruction is executed by the processor 2101, the various steps of the above-mentioned gain map encoding method or gain map decoding method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
- the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
- FIG. 22 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.
- the electronic device 2200 includes but is not limited to: a radio frequency unit 2201, a network module 2202, an audio output unit 2203, an input unit 2204, a sensor 2205, a display unit 2206, a user input unit 2207, an interface unit 2208, a memory 2209, and a processor 2210 and other components.
- the electronic device 2200 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 2210 through a power management system, so that the power management system can manage charging, discharging, and power consumption.
- a power source such as a battery
- the electronic device structure shown in FIG. 1 does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown, or combine certain components, or arrange components differently, which will not be described in detail here.
- processor 2210 is further configured to:
- the first image resolution is preset.
- processor 2210 is further configured to:
- the at least one target image block is reorganized according to a first strategy to generate the image block group; wherein the first strategy indicates the way in which the at least one target image block is combined.
- the target image block identification information is bit information, each bit of information corresponds to a source image block in the gain map, and indicates whether the source image block is the target image block.
- processor 2210 is further configured to:
- the encoding information of the gain map is obtained according to the first information and the second information.
- processor 2210 is further configured to:
- the encoding information and the auxiliary information are stored.
- the auxiliary information includes at least one of the following:
- the at least one target image block is reorganized using a strategy.
- processor 2210 is further configured to:
- the gain map is reconstructed according to the auxiliary information, the image block group and the target image block identification information.
- the input unit 2204 may include a graphics processing unit (GPU) 22041 and a microphone 22042.
- the graphics processor 22041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode.
- the display panel 22061 may be included, and the display panel 22061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc.
- the user input unit 2207 includes a touch panel 22071 and at least one of other input devices 22072.
- the touch panel 22071 is also called a touch screen.
- the touch panel 22071 may include two parts: a touch detection device and a touch controller.
- Other input devices 22072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
- the memory 2209 can be used to store software programs and various data.
- the memory 2209 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc.
- the memory 2209 may include a volatile memory or a non-volatile memory, or the memory 2209 may include both volatile and non-volatile memories.
- the processor 2210 may include one or more processing units; optionally, the processor 2210 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 2210.
- the electronic device shown in FIG. 22 can also apply the gain map decoding method shown in the above embodiment, which will not be described in detail here.
- An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored.
- a program or instruction is stored.
- each process of the above-mentioned gain map encoding method or gain map decoding method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
- the processor is the processor in the electronic device described in the above embodiment.
- the readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
- An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned gain map encoding method or gain map decoding method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
- the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
- An embodiment of the present application provides a computer program product, which is stored in a storage medium.
- the program product is executed by at least one processor to implement the various processes of the above-mentioned gain map encoding method or gain map decoding method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
- the technical solution of the present application can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
- a storage medium such as ROM/RAM, a disk, or an optical disk
- a terminal which can be a mobile phone, a computer, a server, or a network device, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Discrete Mathematics (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression Of Band Width Or Redundancy In Fax (AREA)
Abstract
Description
Claims (24)
- 一种增益图编码方法,包括:获取增益图中的至少一个目标图像块,所述目标图像块中像素点的亮度大于第一阈值;根据所述至少一个目标图像块,确定所述增益图的目标图像块标识信息和图像块组;对所述目标图像块标识信息和所述图像块组进行编码,得到所述增益图的编码信息。
- 根据权利要求1所述的方法,其中,所述获取增益图中的至少一个目标图像块,包括:基于第一图像分辨率,将所述增益图划分为至少一个源图像块;将所述至少一个源图像块中像素点亮度大于所述第一阈值、且占比大于第二阈值的源图像块确定为所述至少一个目标图像块;其中,所述第一图像分辨率是预先设定的。
- 根据权利要求1所述的方法,其中,所述获取增益图中的至少一个目标图像块,包括:基于所述第一阈值,识别出所述增益图中的目标区域;基于所述目标区域的大小和第一条件,确定第二图像分辨率,所述第一条件包括划分后每个图像块中亮度大于所述第一阈值的像素点占比大于第三阈值或小于第四阈值;基于所述第二图像分辨率,将所述增益图划分为至少一个源图像块;将所述至少一个源图像块中像素点亮度大于所述第一阈值、且占比大于第三阈值的源图像块确定为所述至少一个目标图像块。
- 根据权利要求1所述的方法,其中,所述根据所述至少一个目标图像块,确定所述增益图的目标图像块标识信息和图像块组,包括:根据所述至少一个目标图像块在所述增益图的位置,生成所述目标图像块标识信息;将所述至少一个目标图像块按照第一策略进行重组,生成所述图像块组;其中,所述第一策略指示所述至少一个目标图像块组合的方式。
- 根据权利要求4所述的方法,其中,所述目标图像块标识信息为比特信息,每个比特信息与所述增益图中的一个源图像块对应,并指示所述源图像块是否为所述目标图像块。
- 根据权利要求4所述的方法,其中,所述对所述目标图像块标识信息和所述图像块组进行编码,得到所述增益图的编码信息,包括:对所述目标图像块标识信息进行编码,得到第一信息;对所述图像块组进行下采样,得到待编码图像;对所述待编码图像进行编码,得到第二信息;根据所述第一信息和所述第二信息,得到所述增益图的编码信息。
- 根据权利要求4所述的方法,其中,所述对所述目标图像块标识信息和所述图像块组进行编码,得到所述增益图的编码信息,包括:对所述目标图像块标识信息进行编码,得到第一信息;对所述图像块组进行编码,得到第三信息;根据所述第一信息和所述第三信息,得到所述增益图的编码信息。
- 根据权利要求1所述的方法,其中,还包括:确定所述增益图编码使用的辅助信息;存储所述编码信息和所述辅助信息。
- 根据所述权利要求8所述的方法,其中,所述辅助信息包括以下至少一项:第一图像分辨率;第二图像分辨率;所述增益图的原始分辨率;所述至少一个目标图像块的索引;是否针对目标图像块编码;编码方式;下采样比例;所述至少一个目标图像块重组采用的策略。
- 一种增益图解码方法,包括:获取增益图的编码信息;对所述编码信息进行解码,得到图像块组和目标图像块标识信息;根据所述图像块组和所述目标图像块标识信息,重建所述增益图。
- 根据权利要求10所述的方法,其中,所述根据所述图像块组和所述目标图像块标识信息,重建所述增益图包括:基于第一策略和所述图像块组,生成至少一个目标图像块;根据所述至少一个目标图像块和所述目标图像块标识信息,重建所述增益图;其中,所述第一策略指示所述至少一个目标图像块组合的方式。
- 根据权利要求11所述的方法,其中,所述目标图像块标识信息为比特信息,每个比特信息与所述增益图中的一个源图像块对应,并指示所述源图像块是否为所述目标图像块。
- 根据权利要求11所述的方法,其中,所述增益图的编码信息包括第一信息和第二信息,所述对所述编码信息进行解码,得到图像块组和目标图像块标识信息包括:对所述第二信息进行解码,得到解码图像;所述解码图像进行上采样,得到所述目标图像块组;对所述第一信息进行解码,得到所述目标图像块标识信息。
- 根据权利要求11所述的方法,其中,所述增益图的编码信息包括第一信息和第三信息,所述对所述编码信息进行解码,得到图像块组和目标图像块标识信息包括:对所述第三信息进行解码,得到所述图像块组;对所述第一信息进行解码,得到所述目标图像块标识信息。
- 根据权利要求10-14中任一项所述方法,其中,所述根据所述图像块组和所述目标图像块标识信息,重建所述增益图之后,还包括:根据所述增益图和标准动态范围SDR图像,重建生成高动态范围HDR图像;或者,根据所述增益图和HDR图像,重建生成SDR图像。
- 一种增益图编码装置,包括:第一获取模块,用于获取增益图中的至少一个目标图像块,所述目标图像块中像素点的亮度大于第一阈值;第一处理模块,用于根据所述至少一个目标图像块,确定所述增益图的目标图像块标识信息和图像块组;第二处理模块,用于对所述目标图像块标识信息和所述图像块组进行编码,得到所述增益图的编码信息。
- 根据权利要求16所述的装置,其中,所述第一处理模块包括:第一处理子模块,用于根据所述至少一个目标图像块在所述增益图的位置,生成所述目标图像块标识信息;第二处理子模块,用于将所述至少一个目标图像块按照第一策略进行重组,生成所述图像块组;其中,所述第一策略指示所述至少一个目标图像块组合的方式。
- 一种增益图解码装置,包括:第二获取模块,用于获取增益图的编码信息;解码模块,用于对所述编码信息进行解码,得到图像块组和目标图像块标识信息;重建模块,用于根据所述图像块组和所述目标图像块标识信息,重建所述增益图。
- 根据权利要求18所述的装置,其中,所述重建模块包括:生成子模块,用于基于第一策略和所述图像块组,生成至少一个目标图像块;重建子模块,用于根据所述至少一个目标图像块和所述目标图像块标识信息,重建所述增益图;其中,所述第一策略指示所述至少一个目标图像块组合的方式。
- 一种电子设备,包括处理器和存储器,所述存储器存储可在所述处理器上运行的程序或指令,所述程序或指令被所述处理器执行时实现如权利要求1-9任一项所述的增益图编码方法,或者如权利要求10-15任一项所述的增益图解码方法的步骤。
- 一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如权利要求1-9任一项所述的增益图编码方法,或者如权利要求10-15任一项所述的增益图解码方法的步骤。
- 一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现如权利要求1-9任一项所述的增益图编码方法,或者如权利要求10-15任一项所述的增益图解码方法的步骤。
- 一种计算机程序产品,所述计算机程序产品被至少一个处理器执行以实现如权利要求1-9任一项所述的增益图编码方法,或者如权利要求10-15任一项所述的增益图解码方法的步骤。
- 一种电子设备,所述电子设备被配置成用于执行如权利要求1-9任一项所述的增益图编码方法,或者如权利要求10-15任一项所述的增益图解码方法的步骤。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP24818595.1A EP4727128A1 (en) | 2023-06-09 | 2024-06-03 | Gain map encoding method and apparatus, gain map decoding method and apparatus, device, and medium |
| US19/410,539 US20260105642A1 (en) | 2023-06-09 | 2025-12-05 | Gain map encoding method and apparatus, gain map decoding method and apparatus, device, and medium |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310688306.XA CN116744009A (zh) | 2023-06-09 | 2023-06-09 | 增益图编码方法、解码方法、装置、设备及介质 |
| CN202310688306.X | 2023-06-09 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US19/410,539 Continuation US20260105642A1 (en) | 2023-06-09 | 2025-12-05 | Gain map encoding method and apparatus, gain map decoding method and apparatus, device, and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024251063A1 true WO2024251063A1 (zh) | 2024-12-12 |
Family
ID=87903957
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2024/096983 Ceased WO2024251063A1 (zh) | 2023-06-09 | 2024-06-03 | 增益图编码方法、解码方法、装置、设备及介质 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20260105642A1 (zh) |
| EP (1) | EP4727128A1 (zh) |
| CN (1) | CN116744009A (zh) |
| WO (1) | WO2024251063A1 (zh) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116744009A (zh) * | 2023-06-09 | 2023-09-12 | 维沃移动通信有限公司 | 增益图编码方法、解码方法、装置、设备及介质 |
| CN121531092A (zh) * | 2024-08-12 | 2026-02-13 | 维沃移动通信有限公司 | 备用图生成方法、编码方法、装置及设备 |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030128970A1 (en) * | 2002-01-10 | 2003-07-10 | Koninklijke Philips Electronics N.V. | System and method for providing high definition material on a standard definition compatible medium |
| EP2579591A1 (en) * | 2011-10-04 | 2013-04-10 | Thomson Licensing | Method of and device for encoding an HDR image, method of and device for reconstructing an HDR image and non-transitory storage medium |
| CN112702602A (zh) * | 2020-12-04 | 2021-04-23 | 浙江智慧视频安防创新中心有限公司 | 一种视频编解码的方法及存储介质 |
| CN113691816A (zh) * | 2021-08-16 | 2021-11-23 | 维沃移动通信(杭州)有限公司 | 图像显示方法、装置、显示设备及存储介质 |
| US20220092749A1 (en) * | 2020-09-23 | 2022-03-24 | Apple Inc. | Backwards-Compatible High Dynamic Range (HDR) Images |
| CN116744009A (zh) * | 2023-06-09 | 2023-09-12 | 维沃移动通信有限公司 | 增益图编码方法、解码方法、装置、设备及介质 |
-
2023
- 2023-06-09 CN CN202310688306.XA patent/CN116744009A/zh active Pending
-
2024
- 2024-06-03 WO PCT/CN2024/096983 patent/WO2024251063A1/zh not_active Ceased
- 2024-06-03 EP EP24818595.1A patent/EP4727128A1/en active Pending
-
2025
- 2025-12-05 US US19/410,539 patent/US20260105642A1/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030128970A1 (en) * | 2002-01-10 | 2003-07-10 | Koninklijke Philips Electronics N.V. | System and method for providing high definition material on a standard definition compatible medium |
| EP2579591A1 (en) * | 2011-10-04 | 2013-04-10 | Thomson Licensing | Method of and device for encoding an HDR image, method of and device for reconstructing an HDR image and non-transitory storage medium |
| US20220092749A1 (en) * | 2020-09-23 | 2022-03-24 | Apple Inc. | Backwards-Compatible High Dynamic Range (HDR) Images |
| CN112702602A (zh) * | 2020-12-04 | 2021-04-23 | 浙江智慧视频安防创新中心有限公司 | 一种视频编解码的方法及存储介质 |
| CN113691816A (zh) * | 2021-08-16 | 2021-11-23 | 维沃移动通信(杭州)有限公司 | 图像显示方法、装置、显示设备及存储介质 |
| CN116744009A (zh) * | 2023-06-09 | 2023-09-12 | 维沃移动通信有限公司 | 增益图编码方法、解码方法、装置、设备及介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| US20260105642A1 (en) | 2026-04-16 |
| CN116744009A (zh) | 2023-09-12 |
| EP4727128A1 (en) | 2026-04-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112598579B (zh) | 面向监控场景的图像超分辨率方法、装置及存储介质 | |
| US11922599B2 (en) | Video super-resolution processing method and apparatus | |
| WO2024251063A1 (zh) | 增益图编码方法、解码方法、装置、设备及介质 | |
| WO2019134557A1 (zh) | 视频图像的处理方法及装置 | |
| CN112188209A (zh) | 视频流解码方法、装置、计算机设备和存储介质 | |
| CN115880381A (zh) | 图像处理方法、图像处理装置、模型训练方法 | |
| US20250386041A1 (en) | Picture coding and decoding methods and apparatuses, device, and storage medium | |
| CN115330633A (zh) | 图像色调映射方法及装置、电子设备、存储介质 | |
| WO2025016289A1 (zh) | 增益图编码方法、解码方法、装置、设备及介质 | |
| EP3223524A1 (en) | Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices | |
| WO2024067461A1 (zh) | 图像处理方法、装置、计算机设备和存储介质 | |
| WO2025011556A1 (zh) | 视频编码及解码方法、装置、电子设备及介质 | |
| CN118402234A (zh) | 用于点云压缩的混合框架 | |
| US12095981B2 (en) | Visual lossless image/video fixed-rate compression | |
| US20240331202A1 (en) | Fisheye image compression method, fisheye video stream compression method and panoramic video generation method | |
| CN114222092A (zh) | 多视角视频传输方法、装置、处理设备、显示设备和介质 | |
| EP4272168A1 (en) | Methods and systems for processing video streams with layer information | |
| CN114240750B (zh) | 视频分辨率提升方法及装置、存储介质及电子设备 | |
| CN118575194A (zh) | 用于点云压缩的可缩放框架 | |
| CN118302959A (zh) | 通过自适应点生成进行基于学习的点云压缩 | |
| CN116648904B (zh) | 视频编码的方法、视频解码的方法、装置及存储介质 | |
| CN120852165B (zh) | 数据处理方法、装置、设备、存储介质及计算机程序产品 | |
| CN113038267B (zh) | 视频处理方法及装置、计算机可读存储介质和电子设备 | |
| CN120583253A (zh) | 视频处理方法、装置及相关设备 | |
| CN117793458A (zh) | 一种视频处理方法、装置、计算机设备及存储介质 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 24818595 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2024818595 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2024818595 Country of ref document: EP Effective date: 20260109 |
|
| ENP | Entry into the national phase |
Ref document number: 2024818595 Country of ref document: EP Effective date: 20260109 |
|
| ENP | Entry into the national phase |
Ref document number: 2024818595 Country of ref document: EP Effective date: 20260109 |
|
| ENP | Entry into the national phase |
Ref document number: 2024818595 Country of ref document: EP Effective date: 20260109 |
|
| ENP | Entry into the national phase |
Ref document number: 2024818595 Country of ref document: EP Effective date: 20260109 |
|
| WWP | Wipo information: published in national office |
Ref document number: 2024818595 Country of ref document: EP |