WO2021064615A1 - Hierarchical histogram calculation with application to palette table derivation - Google Patents
Hierarchical histogram calculation with application to palette table derivation Download PDFInfo
- Publication number
- WO2021064615A1 WO2021064615A1 PCT/IB2020/059179 IB2020059179W WO2021064615A1 WO 2021064615 A1 WO2021064615 A1 WO 2021064615A1 IB 2020059179 W IB2020059179 W IB 2020059179W WO 2021064615 A1 WO2021064615 A1 WO 2021064615A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- bins
- histogram
- pixel component
- block
- bits
- Prior art date
Links
- 238000009795 derivation Methods 0.000 title abstract description 18
- 238000004364 calculation method Methods 0.000 title description 4
- 238000000034 method Methods 0.000 claims abstract description 63
- 230000015654 memory Effects 0.000 claims description 16
- 238000010586 diagram Methods 0.000 description 20
- 230000008569 process Effects 0.000 description 14
- 238000012545 processing Methods 0.000 description 5
- 239000003086 colorant Substances 0.000 description 3
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000000638 solvent extraction Methods 0.000 description 2
- 241000699670 Mus sp. Species 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/115—Selection of the code volume for a coding unit prior to coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/15—Data rate or code amount at the encoder output by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N19/93—Run-length coding
Definitions
- Palette coding is used in several video compression standards (e.g., high efficiency video coding (HEVC) standard, Alliance for Open Media video 1 (AVI) coding standard) to increase the compressibility of the video data.
- Palette coding involves calculating and sorting a histogram to determine the candidate palette levels. The size of storage needed for histogram calculation for palette table derivation increases exponentially with the pixel bit depth.
- the term “palette table” is defined as a data structure that stores a plurality of entries, with each entry storing an index which maps to a pixel component value. For 8-bit, 10-bit, and 12-bit video, the required number of histogram bins are 256, 1024, and 4096, respectively for traditional palette coding techniques.
- FIG. 1 is a block diagram of one implementation of a computing system.
- FIG. 2 is a diagram of an image and corresponding pixel distribution.
- FIG. 3 is a diagram of a computer-generated screen content image and corresponding pixel distribution.
- FIG. 4 is a block diagram of one implementation of an encoder coupled to a memory.
- FIG. 5 illustrates a sample histogram for a given block in accordance with one implementation.
- FIG. 6 illustrates a decimated sample histogram for a given block after a first pass in accordance with one implementation.
- FIG. 7 illustrates a selection of the top decimated candidate bins in accordance with one implementation.
- FIG. 8 illustrates a second pass histogram in accordance with one implementation.
- FIG. 9 is a diagram of one implementation of the bits of a pixel component.
- FIG. 10 is a block diagram of one implementation of a process for generating dual pass histograms for palette table derivation.
- FIG. 11 is a generalized flow diagram illustrating one implementation of a method for generating multi-pass histograms for palette table derivation.
- FIG. 12 is a generalized flow diagram illustrating one implementation of a method for generating multiple histogram passes as part of palette table derivation.
- FIG. 13 is a generalized flow diagram illustrating one implementation of a method for generating multiple histogram passes for palette table derivation.
- FIG. 14 is a generalized flow diagram illustrating one implementation of a method for calculating multi-pass histograms for palette table derivation.
- FIG. 15 is a generalized flow diagram illustrating one implementation of a method for encoding a video/image block using a palette table.
- an encoder calculates a first pass histogram for a first portion of most significant bits (MSBs) of pixel component values (i.e., color values) of a video frame. Then, the encoder selects a given number of the highest pixel count bins from the first pass histogram.
- MSBs most significant bits
- bins are defined as an interval which specifies one or more values. Bins are typically specified as consecutive, non overlapping intervals of a variable. In this case, the variable is the pixel component value, and each bin specifies a range of values, with the size of the range determined by how many pixel component value bits fall outside the first portion of MSBs.
- the encoder After selecting the given number of the highest pixel count bins from the first pass histogram, the encoder then increases the granularity of these selected highest pixel count bins by evaluating one or more additional bits from the pixel component values. A second pass histogram is then calculated for the concatenation of the original first portion of MSBs of the pixel component values and the one or more additional bits, and the highest pixel count bins are selected from the second pass histogram. A palette table is derived based on these highest pixel count bins from the second pass histogram, and the video frame is encoded using the palette table. By using the multi-pass histogram approach, the memory requirements are reduced as compared to traditional palette table derivation techniques.
- the pixel bits are divided into several groups for hierarchical operation, starting with “m” most significant bits (MSBs) and expanding to the rest of the bits by adding “nl” bits, “n2 bits”, and so on.
- a first histogram is calculated for the “m” MSBs, and then the top bins from this first histogram are selected. These top bins are expanded to include “nl” bits, and then a second histogram is calculated for these expanded bins. The top bins from the second histogram are selected, and these bins are expanded to include “n2” bits. In one implementation, this process continues until all of the pixel component value bits have been evaluated.
- m”, “nl”, and “n2” are positive integers. It is noted that the values of “m”, “nl”, and “n2”, the number of top bins that are selected, and the number of passes that are performed are flexible and can vary with the implementation. These values are adjusted based on a tradeoff between a simple hardware implementation and performance.
- computing system 100 includes at least encoder 105, processor(s) 110, input/output (I/O) interfaces 120, bus 125, and memory device(s) 130.
- computing system 100 can include other components and/or computing system 100 can be arranged differently.
- encoder 105 includes logic for implementing a video codec. The video codec encodes uncompressed video streams and/or decodes compressed video streams. In one implementation, the video codec operates in accordance with one or more video compression standards.
- encoder and “video codec” can refer to a video/image decoder, a video/image encoder, or a video codec.
- Encoder 105 is representative of any suitable combination of hardware and/or software. Although encoder 105 is shown as a separate unit distinct from processor(s) 110, it should be understood that a portion or the entirety of encoder 105 can execute or be implemented on processor(s) 110.
- Processors(s) 110 are representative of any number and type of processing units (e.g., central processing unit (CPU), graphics processing unit (GPU), digital signal processor (DSP), field programmable gate array (FPGA), application specific integrated circuit (ASIC)). In one implementation, some of the processing associated with encoder 105 is performed by processor(s) 110.
- Memory device(s) 130 are representative of any number and type of memory devices. For example, the type of memory in memory device(s) 130 can include Dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), NAND Flash memory, NOR flash memory, Ferroelectric Random Access Memory (FeRAM), or others. Memory device(s) 130 are accessible by encoder 105 and processor(s) 110.
- DRAM Dynamic Random Access Memory
- SRAM Static Random Access Memory
- NAND Flash memory NOR flash memory
- FeRAM Ferroelectric Random Access Memory
- I/O interfaces 120 are representative of any number and type of I/O interfaces (e.g., peripheral component interconnect (PCI) bus, PCI-Extended (PCI-X), PCIE (PCI Express) bus, gigabit Ethernet (GBE) bus, universal serial bus (USB)).
- PCI peripheral component interconnect
- PCI-X PCI-Extended
- PCIE PCI Express
- GEE gigabit Ethernet
- USB universal serial bus
- peripheral devices include (but are not limited to) displays, keyboards, mice, printers, scanners, joysticks or other types of game controllers, media recording devices, external storage devices, network interface cards, and so forth.
- computing system 100 is a computer, laptop, mobile device, game console, server, streaming device, wearable device, or any of various other types of computing systems or devices. It is noted that the number of components of computing system 100 varies from implementation to implementation. For example, in other implementations, there are more or fewer of each component than the number shown in FIG. 1. It is also noted that in other implementations, computing system 100 includes other components not shown in FIG. 1. Additionally, in other implementations, computing system 100 is structured in other ways than shown in FIG. 1.
- FIG. 2 a diagram of an image 205 and corresponding pixel distribution 210 is shown.
- the image 205 shown in FIG. 2 is the well-known Fena image which is widely used as a test image in image processing.
- the pixel distribution 210 for this 64x64 Lena image 205 is shown at the bottom of FIG. 2.
- the pixel distribution 210 illustrates how the pixels in image 205 are distributed across the different pixel values. Having a continuous color tone as shown in pixel distribution 210 is common for natural images or video frames captured by a camera.
- Image 305 is one example of a computer generated screenshot
- the pixel distribution 310 shows how there is a narrow distribution of pixels across a relatively small number of pixel component values.
- image 305 includes a limited few distinct colors. This is a common type of distribution for computer-generated screen content, and for these types of computer-generated images, palette coding is an efficient way of encoding these images to achieve a high compression ratio. Other types of images besides computer-generated screenshots can also benefit from palette coding.
- encoder 405 includes control logic 410 with binning controller 415, selection unit 420, and palette table generation unit 425.
- encoder 405 is implemented by a processor executing program instructions, and in this implementation, binning controller 415, selection unit 420, and palette table generation unit 425 are implemented by program instructions rather than with control logic.
- binning controller 415, selection unit 420, and palette table generation unit 425 are implemented using a combination of hardware and software.
- Encoder 405 is coupled to memory 430, which is representative of any number and type of memory devices.
- memory 430 stores a video frame which will be encoded by encoder 405.
- Video block 435 is representative of one of the blocks of this video frame.
- the techniques used for encoding video block 435 can be used for the other blocks of the video frame, and for other video frames in the video sequence.
- video block 435 can be a single block of an image.
- video block 435 is stored as a plurality of pixel component values in memory 430.
- binning controller 415 creates first pass histogram 440A from the pixel component values of video block 435.
- binning controller 415 creates a separate first pass histogram 440A for each separate pixel component (e.g., red, green, blue).
- first pass histogram 440A the first step performed by binning controller 415 is to divide the entire range of pixel component values into a series of intervals. This first step is also referred to as “binning” the range of values, with each interval referred to as a “bin”. The bins are typically specified as consecutive, non-overlapping intervals of the range of values.
- binning controller 415 counts how many pixel component values from video block 435 fall into each interval.
- binning controller 415 retrieves the pixel component values of video block 435, and then binning controller 415 allocates each pixel component value to its corresponding bin.
- each bin is implemented using a counter which is incremented each time that a pixel is allocated to the respective bin.
- each bin of first pass histogram 440A represents a range of pixel component values corresponding to a given number of MSBs.
- the given number of MSBs can vary according to the implementation.
- each bin of first pass histogram 440A represents a range corresponding to six MSBs out of a total of eight bits per pixel component value.
- the storage requirements for storing first pass histogram 440A in memory 430 are reduced. For example, if six MSBs out of eight bits are used to generate first pass histogram 440A, then only 64 bins are created as compared to 256 bins if all eight bits were used.
- each pixel component value is allocated to its respective bin by binning controller 415 based on the value’s 6 MSBs.
- larger amounts of storage savings can be attained for higher bit-depth video (e.g., 12 bits per sample, 16 bits per sample) and/or if more pixel component value bits are excluded from the bin classification.
- first pass histogram 440A is generated and stored in memory 430
- the bins of first pass histogram 440A are sorted by selection unit 420. For example, the bins are sorted from highest to lowest based on how many pixel values fall into each bin. Then, selection unit 420 selects a given number of the bins that have the most pixel values. For example, in one implementation, selection unit 420 selects the eight bins that have the most pixel values. In other implementations, selection unit 420 selects other numbers of bins that have the highest pixel count (i.e., highest number of pixel values) among all of the bins in first pass histogram 440A.
- second pass histogram 440B is generated for the expanded bins. For example, if the top eight bins are selected by selection unit 420, and these bins are expanded by two bits, then second pass histogram 440B will have a total of 32 bins. These bins are then sorted according to how many pixel values fall into each bin. Then, the top bins are selected according to the pixel value count. The number of top bins that are selected varies according to the implementation.
- the top bins that are selected from second pass histogram 440B are used by palette table generation unit 425 to derive the palette table 450 that is used for encoding video block 435 to create encoded block 455.
- one or more additional passes can be performed to generate more histograms by expanding the number of bits that are evaluated for the pixel component values.
- encoder 405 will decide not to use palette mode encoding for video block 435 if the distribution of pixel values are spread across a large number of bins as is commonly found in natural (i.e., non-computer-generated) video frames.
- the decision not to use palette mode encoding is made after first pass histogram 440A is generated. An analysis of first pass histogram 440A can determine whether palette mode encoding is suitable for video block 435. In cases where palette mode encoding is not used, any of various other types of conventional encoding techniques can be used to encode video block 435.
- control logic 410 into binning controller 415, selection unit 420, and palette table generation unit 425 is merely indicative of one implementation.
- a single control unit can perform the functions of binning controller 415, selection unit 420, and palette table generation unit 425.
- other ways of partitioning control logic 410 into separate units can be deployed.
- encoded block 455 includes an encoded version of palette table 450 and a color index map with index values that map pixels of video block 435 to palette table 450.
- Palette table 450 is representative of any number of palette tables for encoding the pixel components of video block 435.
- palette table 450 includes a first table for the red component, a second table for the green component, and a third table for the blue component.
- palette table 450 is a single table that represents a combination of the different pixel components.
- the color index map that is generated can be encoded using any suitable encoding technique.
- the individual index values are encoded using a run-length encoding technique in one implementation. Other ways of encoding the individual index values are possible and are contemplated.
- Histogram 500 is one example of a histogram with 64 different bins corresponding to 64 possible pixel levels.
- the term “histogram” is defined as an occurrence frequency of each pixel component value for a given block of an image/frame.
- a block can be referred to more generally as a “coding unit”, with the size of the coding unit varying according to the implementation.
- a coding unit is an 8x8 block of pixels.
- a coding unit is the entirety of the image/frame.
- a coding unit can be other sizes and/or arrangements of pixels.
- the example distribution of histogram 500 is shown for illustrative purposes only.
- the Y-axis measures the number of pixels in the given block which have the corresponding pixel level. It is assumed for the purposes of this discussion that the given block has a plurality of pixels and each pixel has a numerical value for each of one or more channels (e.g., red, green, blue).
- FIG. 6 a diagram of one implementation of a decimated sample histogram 600 for a given block after a first pass is shown.
- the discussion of FIG. 6 is a continuation of the discussion of histogram 500 from FIG. 5.
- Histogram 600 includes the same distribution of pixels across pixel component levels as was shown in histogram 500, except that now each bin encompasses a plurality of pixel component levels. Accordingly, histogram 600 has a reduced number of bins by evaluating only a subset of the bits of each pixel.
- each rectangle is an intermediate bin which is the congregation of four bins.
- histogram 600 evaluates the four most significant bits (MSBs) of the pixel component values. Using only four MSBs corresponds to a total of 16 bins. This helps to reduce the storage requirements of 64 bins (for histogram 500 of FIG. 5) to 16 bins for histogram 600. In other implementations, a first pass histogram can evaluate other numbers of MSBs.
- FIG. 7 a diagram of one implementation of a selection of the top decimated candidate bins from a sample histogram is shown. The discussion of FIG. 7 is a continuation of the discussion of histogram 600 from FIG. 6.
- the top four candidate bins with the highest pixel counts are selected. These four selected decimated candidate bins 705A-D are shown as the vertical rectangles in histogram 700. It should be understood that the selection of the top four decimated candidate bins 705A-D is merely indicative of one implementation. In other implementations, another number (e.g., 2, 8) of the top decimated candidate bins can be selected from the decimated histogram.
- FIG. 8 a diagram of one implementation of a second pass histogram 800 is shown.
- the discussion of FIG. 8 is a continuation of the discussion of histogram 700 from FIG. 7.
- histogram 800 is refined by adding two additional bits to the pixel component bits being evaluated. This increases the number of bins from four to 16.
- the multi-pass histogram process will stop at this point and the palette table will be derived from the top 8 bins of these 16 bins.
- the process will continue with another pass by choosing the top candidate bins and then expanding these bins by an additional two bits.
- the number of candidate bits that are selected can vary according to the implementation.
- Pixel component 900 is representative of any number of bits for storing one of the different color values for the particular color space of the source image or video frame.
- three separate instances of pixel component 900 are used to encode the red, green, and blue color values for each pixel for an image in the red, green, and blue (RGB) color space.
- three separate instances of pixel component 900 encode the luminance and chrominance values for each pixel in the (YUV) color space.
- pixel component 900 can store each pixel component of the pixels in other types of color spaces. More generally, pixel component 900 can be referred to as an index into a color space.
- a first pass histogram is calculated for a block of an image/frame using the “m” group 1 bits of pixel component 900 while excluding the other least significant bits (LSBs) of pixel component 900.
- “m” is equal to six, but it should be understood this is merely indicative of one implementation.
- the top “pi” candidate bins are chosen from the candidate bins for this first pass histogram, with the value of “pi” varying according to the implementation.
- a second pass histogram is calculated for these “pi” candidate bins by expanding the “pi” candidate bins to include the “nl” group 2 bits in the histogram calculation.
- nl is equal to two, but it should be understood this is merely indicative of one implementation.
- the top “p2” candidate bins are chosen from the second pass histogram, with the value of “p2” varying according to the implementation. Additional passes can be performed for the “n2” group 3 bits and the “n3” group 4 bits. In one implementation, after all of the bits of pixel component 900 have been evaluated, the palette table is derived using the top bins from the final set of bins.
- FIG. 10 a block diagram of one implementation of a process 1000 for generating dual-pass histograms for palette table derivation is shown.
- the first step in the process 1000 is to reduce the number of bits that are evaluated when generating the first histogram. This increases the number of pixel component values that fall into each bin. For example, if two bits are excluded, then four potential pixel component values will fall into each bin. This is the example shown at the top of process 1000.
- the histogram has only 64 bins (B0-B63) corresponding to the six MSBs.
- the top 16 bins (T0-T15) are selected from bins B0-B63.
- the top 16 bins are the bins with the most pixel component values from the block being processed.
- each bin is expanded into four bins by evaluating an additional two LSBs from the pixel component values for the second scan. These bins are shown as B’(0,0), B’(0,1), B’(0,2), and B’(0,3) for TO.
- the bins are B’(1,0), B’(l,l), B’(l,2), and B’(l,3) for the second scan.
- the other bins of the second scan follow the same pattern for the other top bins T2-T15 from the first scan.
- the top 16 bins are expanded into 64 bins.
- top 8 bins (T’O-T’7) are selected. It is noted that the specific number of top bins that are selected from the second scan is merely indicative of one implementation. Likewise, the other values used for process 1000 are merely indicative of one particular implementation. Other implementations can use other values.
- FIG. 11 one implementation of a method 1100 for generating multi pass histograms for palette table derivation is shown.
- the steps in this implementation and those of FIG. 12-15 are shown in sequential order.
- one or more of the elements described are performed concurrently, in a different order than shown, or are omitted entirely.
- Other additional elements are also performed as desired.
- Any of the various systems or apparatuses described herein are configured to implement method 1100. It is noted that method 1100 is intended to correspond to the process 1000 (of FIG. 10).
- an encoder uses the top 6 MSBs of each pixel component value (block 1105). Next, the encoder collects a histogram with 64 bins for the top 6 MSBs of the pixel component values (block 1110). Then, the encoder sorts the 64 bins in descending order and selects the top 16 bins from these 64 bins (block 1115). Next, the encoder expands the top 16 bins into 64 bins by combining the 6 MSBs with 2 LSBs and then the encoder collects a histogram with those 64 bins (block 1120). The encoder sorts the 64 bins in descending order and selects the top 8 bins from the 64 bins (block 1125). After block 1125, method 1100 ends. These selected 8 bins are then used by the encoder for the palette table derivation when encoding the corresponding block.
- An encoder receives N-bit pixel component values of a given pixel component of a block of an image (block 1205).
- the block can be referred to more generally as a “coding unit” and that the image can be a video frame.
- the size of the coding unit (e.g., 8x8 block) can vary according to the implementation.
- the coding unit is the entirety of an image or video frame.
- the coding unit is any of various other portions of the image, or the coding unit can correspond to multiple images (e.g., video frames of a video sequence).
- N is a positive integer.
- the value of N can vary according to the implementation.
- 8-bit, 10-bit, and 12-bit pixel components are commonly used values in various implementations. Other numbers of bits per pixel component are also possible.
- the given pixel component is one of red, green, or blue for the RGB color space.
- the given pixel component represents the luminance or chrominance values for a YUV or YCbCr color space. Other types of pixel components can be used in other implementations.
- the encoder groups the pixel component values into a first plurality of bins based on a first portion of the N pixel component value bits (block 1210).
- the first plurality of bins collectively represent a histogram of pixel values for the block.
- Each bin includes those pixel component values which match the first portion of bits assigned to the bin.
- N is eight and the first portion is six bits, and a first bin is assigned bits “111111”, a second bin is assigned bits “111110”, and so on.
- Pixel component values of “11111111”, “11111110”, “11111101”, and “11111100” are assigned to the first bin
- pixel component values of “11111011”, “11111010”, “11111001”, and “11111000” are assigned to the second bin, and so on.
- N is other numbers and/or the first portion includes another number of bits.
- the encoder selects a first set of bins which have the highest pixel counts among the first plurality of bins (block 1215). For example, in one implementation, the encoder selects the eight bins with the highest pixel counts in block 1215. In another implementation, the encoder selects the 16 bins that have the highest pixel counts in block 1215. In other implementations, the encoder selects some other number of bins with the highest pixel counts. [0049] Next, the encoder groups pixel component values from the first set of bins into a second plurality of bins based on a second portion of pixel component value bits, where the second portion is greater than the first portion (block 1220).
- the encoder expands the first set of bins into the second plurality of bins by increasing the number of bits that are used to sort pixel component values into bins.
- the second plurality of bins are all contained within the first set of bins, so the increase in the number of bits only applies to those pixel component values that were grouped into the first set of bins.
- the second portion is greater than the first portion by two bits. In other implementations, the second portion is greater than the first portion by other numbers of bits.
- the encoder selects a second set of bins which have the highest pixel counts among the second plurality of bins (block 1225). The number of bins that are in the second set of bins varies according to the implementation.
- the encoder derives a palette table from the pixel component values that are assigned to the second set of bins (block 1230). Then, the encoder encodes the given pixel component of the pixels of the block based on the palette table (block 1235). After block 1235, method 1200 ends. By using method 1200, the storage requirements for generating histograms for palette table encoding are reduced since a smaller number of bins are calculated than would otherwise be calculated if traditional techniques were used.
- method 1200 can be performed for each pixel component of the block. Subsequent blocks of the image can be encoded in a similar matter, or the palette table can be reused for other blocks.
- An encoder generates a first histogram for a first group of bins, where each bin of the first group corresponds to a plurality of potential pixel values (block 1305). It is noted that the number of potential pixel values per bin depends on how many bits were not evaluated for the first histogram.
- the video frame has 12 bits per pixel, and only six MSBs were evaluated in the first histogram, then six LSBs are left over, meaning there are 64 potential pixel values per bin.
- Other implementations will have other numbers of potential pixel values per bin after the first histogram.
- the encoder selects a first given number of bins which have the highest pixel counts from the first group of bins (block 1310).
- the first given number can vary according to the implementation.
- the encoder determines if another histogram should be generated (conditional block 1315). For example, in one implementation, if there are more bits in the pixel component values that have not yet been evaluated, then the encoder can decide to generate another histogram.
- the encoder determines that another histogram should be generated (conditional block 1315, “yes” leg), then the encoder expands a number of bits of pixel values that are evaluated from the (N-l)th group of bins to create an Nth group of bins (block 1320).
- the Nth group refers to the second group, third group, fourth group, and so on, depending on how many histograms have already been generated.
- the encoder determines that another histogram should not be generated (conditional block 1315, “no” leg)
- the encoder derives, based on the selected number of bins, a palette table for encoding a given block of the video frame (block 1335).
- the encoder After block 1320, the encoder generates another (i.e., Nth) histogram for the Nth group of bins (block 1325). Then, the encoder selects a given number of bins which have the highest pixel counts from the Nth group of bins (block 1330). The given number can vary according to the implementation and/or according to the specific hierarchical level of the histogram being generated. After block 1330, method 1300 returns to conditional block 1315.
- FIG. 14 another implementation of a method 1400 for calculating multi-pass histograms for palette table derivation is shown.
- An encoder calculates a histogram of the six most significant bits (MSBs) of pixel component values (block 1405). It is noted that the histogram includes a plurality of bins, with each bin including a count of the number of pixels that have a pixel component value with the same six MSBs corresponding to the bin.
- the encoder determines if there are any remaining bits in the pixel component values (conditional block 1410). For example, after block 1405, if the pixel component values have eight bits, then there are two more bits left after the six MSBs, and so conditional block 1410 would evaluate to “Yes”.
- the encoder chooses the top 16 bins of the plurality of bins from the histogram (block 1415). In other implementations, the encoder chooses some other number of bins which have the most pixels. Otherwise, if there are no remaining bits in the pixel component values (conditional block 1410, “no” leg), then the encoder chooses the top 8 bins of the plurality of bins from the histogram (block 1420). These top 8 bins correspond to the most prominent colors in the block. After block 1420, the top 8 bins are used for the palette table derivation (block 1430), and then method 1400 ends.
- the encoder calculates the histogram by adding two more bits (block 1425). After block 1425, method 1400 returns to conditional block 1410. It is noted that the specified numbers of bits and numbers of bins specified in method 1400 are indicative of one particular implementation. In other implementations, these numbers can vary.
- FIG. 15 one implementation of a method 1500 for encoding a video/image block using a palette table is shown.
- An encoder identifies a given number of most frequently occurring pixel component values in a block using a multi-level hierarchical histogram generation process (block 1505).
- a multi-level hierarchical histogram generation process to identify a given number of most frequently occurring pixel component values (i.e., the most prominent colors) in a block are described in methods 1100, 1200, 1300 and 1400 (of FIG. 11-14). Any of these methods, or other similar methods, can be used to implement block 1505.
- the given number can be any suitable integer value (e.g., 8, 16, 32), with the value varying according to the implementation.
- the encoder selects a palette table based on the given number of most frequently occurring pixel component values (block 1510).
- the palette table includes the seven most frequently occurring pixel component values, allowing the index into the table to be encoded with three bits, with the eighth index used for escape pixels which do not map to any values in the palette table.
- the palette table has other numbers of entries for other numbers of the most frequently occurring pixel component values.
- each pixel component e.g., luminance, chrominance
- a single palette table is created as a representative combination of the separate pixel components.
- the palette table is selected for a single pixel component (e.g., red) and then shared and/or modified to be used with the other pixel components (e.g., blue, green).
- a single pixel component e.g., red
- the other pixel components e.g., blue, green
- a color index map is created with index values that map pixels of the block to entries in the palette table (block 1515). For example, each pixel in the block is converted to an index into the palette table, with the color index map including an index for each pixel in the block. If the pixel has a value that is not included within the palette table, then the pixel can be encoded as an escape pixel, and the actual value of the pixel can be included in the color index map or in a separate structure.
- the palette table and color index map are encoded as a representation of the block (block 1520). Any of various encoding techniques for encoding the palette table and for encoding the color index map can be used.
- method 1500 ends. It should be understood that method 1500 can also be used to encode the entirety of an image or video frame rather than just a block of the image/frame.
- the receiver will include a decoder that will reverse the above steps to recreate the block from the encoded palette table and color index map.
- the recreated block can then be driven to a display.
- this process can be repeated for the blocks of each video frame of a video sequence.
- the encoded palette table can be sent for the entirety of a first video frame, and then some number of subsequent video frames can reuse this palette table. For the subsequent video frames, only the color index map for the video frame is sent to the receiver.
- an encoded palette table generated for a block of a frame is reused for other blocks of the frame and/or blocks of other frames.
- a palette table for a given block is derived from the palette table corresponding to another block.
- a delta palette table i.e., difference palette table
- a delta palette table is applied to the palette table of a neighboring block to generate the palette table for a given block.
- Other ways of deriving a new palette table from a previously used palette table are possible and are contemplated.
- program instructions of a software application are used to implement the methods and/or mechanisms described herein.
- program instructions executable by a general or special purpose processor are contemplated.
- such program instructions are represented by a high level programming language.
- the program instructions are compiled fro a high level programming language to a binary, intermediate, or other form.
- program instructions are written that describe the behavior or design of hardware.
- Such program instructions are represented by a high-level programming language, such as C.
- a hardware design language (HDL) such as Verilog is used.
- the program instructions are stored on any of a variety of non-transitory computer readable storage mediums. The storage medium is accessible by a computing system during use to provide the program instructions to the computing system for program execution.
- a computing system includes at least one or more memories and one or more processors configured to execute program instructions.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression Of Band Width Or Redundancy In Fax (AREA)
- Facsimile Image Signal Circuits (AREA)
- Image Processing (AREA)
Abstract
Description
Claims
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310784301.7A CN117082251A (en) | 2019-09-30 | 2020-09-30 | Hierarchical histogram calculation for palette table derivation |
JP2022515817A JP7335427B2 (en) | 2019-09-30 | 2020-09-30 | Parallel Histogram Computation by Application to Palette Table Derivation |
EP20872274.4A EP4038878A4 (en) | 2019-09-30 | 2020-09-30 | Hierarchical histogram calculation with application to palette table derivation |
CN202080068541.1A CN114450952B (en) | 2019-09-30 | 2020-09-30 | Hierarchical histogram calculation for palette table derivation |
KR1020237040480A KR20230167141A (en) | 2019-09-30 | 2020-09-30 | Hierarchical histogram calculation with application to palette table derivation |
KR1020227011453A KR102608814B1 (en) | 2019-09-30 | 2020-09-30 | Hierarchical histogram computation applied to palette table derivation. |
JP2023132810A JP2023156452A (en) | 2019-09-30 | 2023-08-17 | Parallel histogram calculation by application to palette table derivation |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/588,772 | 2019-09-30 | ||
US16/588,772 US11076151B2 (en) | 2019-09-30 | 2019-09-30 | Hierarchical histogram calculation with application to palette table derivation |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021064615A1 true WO2021064615A1 (en) | 2021-04-08 |
Family
ID=75162692
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2020/059179 WO2021064615A1 (en) | 2019-09-30 | 2020-09-30 | Hierarchical histogram calculation with application to palette table derivation |
Country Status (6)
Country | Link |
---|---|
US (2) | US11076151B2 (en) |
EP (1) | EP4038878A4 (en) |
JP (2) | JP7335427B2 (en) |
KR (2) | KR102608814B1 (en) |
CN (2) | CN114450952B (en) |
WO (1) | WO2021064615A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11076151B2 (en) | 2019-09-30 | 2021-07-27 | Ati Technologies Ulc | Hierarchical histogram calculation with application to palette table derivation |
EP3873096A1 (en) * | 2020-02-25 | 2021-09-01 | Koninklijke Philips N.V. | Improved hdr color processing for saturated colors |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6518981B2 (en) * | 1997-11-12 | 2003-02-11 | Canon Kabushiki Kaisha | Generating and using a color palette |
CA2931386A1 (en) * | 2013-11-22 | 2015-05-28 | Huawei Technologies Co., Ltd. | Advanced screen content coding solution |
CA2930174A1 (en) * | 2014-01-02 | 2015-07-09 | Qualcomm Incorporated | Quantization of the escape pixels of a video block in palette coding mode |
US9910897B2 (en) * | 2014-05-06 | 2018-03-06 | Shutterstock, Inc. | Systems and methods for color palette suggestions |
Family Cites Families (69)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5274754A (en) | 1986-04-14 | 1993-12-28 | Advanced Micro Devices, Inc. | Method and apparatus for generating anti-aliased vectors, arcs and circles on a video display |
US5818456A (en) | 1996-04-30 | 1998-10-06 | Evans & Sutherland Computer Corporation | Computer graphics system with adaptive pixel multisampler |
US6525723B1 (en) | 1998-02-17 | 2003-02-25 | Sun Microsystems, Inc. | Graphics system which renders samples into a sample buffer and generates pixels in response to stored samples at different rates |
US6339426B1 (en) | 1999-04-29 | 2002-01-15 | Microsoft Corporation | Methods, apparatus and data structures for overscaling or oversampling character feature information in a system for rendering text on horizontally striped displays |
US6924816B2 (en) | 2000-03-17 | 2005-08-02 | Sun Microsystems, Inc. | Compensating for the chromatic distortion of displayed images |
US6781600B2 (en) | 2000-04-14 | 2004-08-24 | Picsel Technologies Limited | Shape processor |
US6775420B2 (en) | 2000-06-12 | 2004-08-10 | Sharp Laboratories Of America, Inc. | Methods and systems for improving display resolution using sub-pixel sampling and visual error compensation |
US6999619B2 (en) * | 2000-07-12 | 2006-02-14 | Canon Kabushiki Kaisha | Processing for accurate reproduction of symbols and other high-frequency areas in a color image |
US7133565B2 (en) * | 2000-08-25 | 2006-11-07 | Canon Kabushiki Kaisha | Image processing apparatus and method |
US7061507B1 (en) | 2000-11-12 | 2006-06-13 | Bitboys, Inc. | Antialiasing method and apparatus for video applications |
US6636232B2 (en) | 2001-01-12 | 2003-10-21 | Hewlett-Packard Development Company, L.P. | Polygon anti-aliasing with any number of samples on an irregular sample grid using a hierarchical tiler |
US7123277B2 (en) | 2001-05-09 | 2006-10-17 | Clairvoyante, Inc. | Conversion of a sub-pixel format data to another sub-pixel data format |
US7145577B2 (en) | 2001-08-31 | 2006-12-05 | Micron Technology, Inc. | System and method for multi-sampling primitives to reduce aliasing |
US6985159B2 (en) | 2002-05-08 | 2006-01-10 | Intel Corporation | Arrangements for antialiasing coverage computation |
JP3910120B2 (en) | 2002-08-23 | 2007-04-25 | 株式会社リコー | Image processing apparatus, method, program for executing the method, and recording medium |
KR100580624B1 (en) | 2003-09-19 | 2006-05-16 | 삼성전자주식회사 | Method and apparatus for displaying image, and computer-readable recording media for storing computer program |
JP4515832B2 (en) * | 2004-06-14 | 2010-08-04 | オリンパス株式会社 | Image compression apparatus and image restoration apparatus |
US7348996B2 (en) | 2004-09-20 | 2008-03-25 | Telefonaktiebolaget Lm Ericsson (Publ) | Method of and system for pixel sampling |
US8744184B2 (en) | 2004-10-22 | 2014-06-03 | Autodesk, Inc. | Graphics processing method and system |
GB0426170D0 (en) | 2004-11-29 | 2004-12-29 | Falanx Microsystems As | Processing of computer graphics |
US8577184B2 (en) | 2005-01-19 | 2013-11-05 | The United States Of America As Represented By The Secretary Of The Army | System and method for super-resolution imaging from a sequence of color filter array (CFA) low-resolution images |
US8666196B2 (en) | 2005-01-19 | 2014-03-04 | The United States Of America As Represented By The Secretary Of The Army | System and method for super-resolution imaging from a sequence of color filter array (CFA) low-resolution images |
US7456846B1 (en) | 2005-06-03 | 2008-11-25 | Nvidia Corporation | Graphical processing system, graphical pipeline and method for implementing subpixel shifting to anti-alias texture |
US8269788B2 (en) | 2005-11-15 | 2012-09-18 | Advanced Micro Devices Inc. | Vector graphics anti-aliasing |
US7684641B1 (en) | 2005-12-13 | 2010-03-23 | Nvidia Corporation | Inside testing for paths using a derivative mask |
US7612783B2 (en) | 2006-05-08 | 2009-11-03 | Ati Technologies Inc. | Advanced anti-aliasing with multiple graphics processing units |
US8806321B2 (en) * | 2007-06-26 | 2014-08-12 | Oracle International Corporation | Interactive controls and information visualization using histogram equalization |
US7916155B1 (en) | 2007-11-02 | 2011-03-29 | Nvidia Corporation | Complementary anti-aliasing sample patterns |
JP5305641B2 (en) | 2007-11-21 | 2013-10-02 | 株式会社ニューフレアテクノロジー | Pattern inspection apparatus and pattern inspection method |
US8396129B2 (en) | 2007-12-28 | 2013-03-12 | Ati Technologies Ulc | Apparatus and method for single-pass, gradient-based motion compensated image rate conversion |
US8044971B2 (en) | 2008-01-31 | 2011-10-25 | Arm Norway As | Methods of and apparatus for processing computer graphics |
CN102016916B (en) | 2008-04-04 | 2014-08-13 | 先进微装置公司 | Filtering method and apparatus for anti-aliasing |
US8605087B2 (en) | 2008-07-03 | 2013-12-10 | Nvidia Corporation | Hybrid multisample/supersample antialiasing |
WO2010063881A1 (en) | 2008-12-03 | 2010-06-10 | Nokia Corporation | Flexible interpolation filter structures for video coding |
JP4883223B2 (en) | 2009-01-09 | 2012-02-22 | コニカミノルタホールディングス株式会社 | Motion vector generation apparatus and motion vector generation method |
US8773448B2 (en) | 2010-04-09 | 2014-07-08 | Intel Corporation | List texture |
US8368774B2 (en) | 2010-11-22 | 2013-02-05 | The Aerospace Corporation | Imaging geometries for scanning optical detectors with overlapping fields of regard and methods for providing and utilizing same |
US9165526B2 (en) | 2012-02-28 | 2015-10-20 | Shenzhen Yunyinggu Technology Co., Ltd. | Subpixel arrangements of displays and method for rendering the same |
US8928690B2 (en) | 2012-03-20 | 2015-01-06 | Advanced Micro Devices, Inc. | Methods and systems for enhanced quality anti-aliasing |
US8941676B2 (en) | 2012-10-26 | 2015-01-27 | Nvidia Corporation | On-chip anti-alias resolve in a cache tiling architecture |
US9235926B2 (en) | 2012-12-24 | 2016-01-12 | Intel Corporation | Techniques for improving MSAA rendering efficiency |
US9478066B2 (en) | 2013-03-14 | 2016-10-25 | Nvidia Corporation | Consistent vertex snapping for variable resolution rendering |
US9299125B2 (en) | 2013-05-03 | 2016-03-29 | Advanced Micro Devices Inc. | Variable acuity rendering using multisample anti-aliasing |
US9230363B2 (en) | 2013-09-11 | 2016-01-05 | Nvidia Corporation | System, method, and computer program product for using compression with programmable sample locations |
CA2935559C (en) * | 2014-01-02 | 2018-11-20 | Vid Scale, Inc. | Two-dimensional palette coding for screen content coding |
US9501860B2 (en) | 2014-01-03 | 2016-11-22 | Intel Corporation | Sparse rasterization |
CN106105229B (en) * | 2014-03-14 | 2019-03-15 | 寰发股份有限公司 | Carry out the method and device of the block of encoded video data using palette coding |
US9654806B2 (en) * | 2014-03-26 | 2017-05-16 | Qualcomm Incorporated | Determining palette size, palette entries and filtering of palette coded blocks in video coding |
JP6369799B2 (en) | 2014-04-23 | 2018-08-08 | Tianma Japan株式会社 | Pixel array, electro-optical device, and electric apparatus |
US9208534B2 (en) * | 2014-05-07 | 2015-12-08 | Cisco Technology Inc. | System and method for embedding data |
US10091512B2 (en) * | 2014-05-23 | 2018-10-02 | Futurewei Technologies, Inc. | Advanced screen content coding with improved palette table and index map coding methods |
WO2015192779A1 (en) * | 2014-06-20 | 2015-12-23 | Mediatek Inc. | Method and apparatus of binarization and context-adaptive coding for syntax in video coding |
US11223832B2 (en) * | 2014-07-24 | 2022-01-11 | Qualcomm Incorporated | Methods and apparatus for encoding video data using block palettes and sub-block and pixel scanning orders |
US9978171B2 (en) | 2014-07-29 | 2018-05-22 | Nvidia Corporation | Control of a sample mask from a fragment shader program |
US10412387B2 (en) | 2014-08-22 | 2019-09-10 | Qualcomm Incorporated | Unified intra-block copy and inter-prediction |
TW201626798A (en) * | 2014-10-06 | 2016-07-16 | Vid Scale Inc | Improved palette coding for screen content coding |
GB2531005A (en) * | 2014-10-06 | 2016-04-13 | Canon Kk | Improved encoding process using a palette mode |
US9363421B1 (en) * | 2015-01-12 | 2016-06-07 | Google Inc. | Correcting for artifacts in an encoder and decoder |
US9536282B2 (en) | 2015-01-14 | 2017-01-03 | Lucidlogix Technologies Ltd. | Method and apparatus for controlling spatial resolution in a computer system |
US9426362B2 (en) | 2015-01-16 | 2016-08-23 | Mems Drive, Inc. | Three-axis OIS for super-resolution imaging |
JP6122516B2 (en) * | 2015-01-28 | 2017-04-26 | 財團法人工業技術研究院Industrial Technology Research Institute | Encoding method and encoder |
US10007967B2 (en) | 2015-06-12 | 2018-06-26 | Gopro, Inc. | Temporal and spatial video noise reduction |
US9659402B2 (en) | 2015-06-26 | 2017-05-23 | Intel Corporation | Filtering multi-sample surfaces |
US20170132833A1 (en) | 2015-11-10 | 2017-05-11 | Intel Corporation | Programmable per pixel sample placement using conservative rasterization |
US10152772B2 (en) | 2016-01-18 | 2018-12-11 | Advanced Micro Devices, Inc. | Techniques for sampling sub-pixels of an image |
EP3319318B1 (en) * | 2016-11-03 | 2019-08-14 | Deutsche Telekom AG | Intra compression of screen content based on soft context formation |
US10282889B2 (en) * | 2016-11-29 | 2019-05-07 | Samsung Electronics Co., Ltd. | Vertex attribute compression and decompression in hardware |
US10848787B2 (en) * | 2018-08-28 | 2020-11-24 | Google Llc | Lossy image compression using palettization of locally mixed colors |
US11076151B2 (en) | 2019-09-30 | 2021-07-27 | Ati Technologies Ulc | Hierarchical histogram calculation with application to palette table derivation |
-
2019
- 2019-09-30 US US16/588,772 patent/US11076151B2/en active Active
-
2020
- 2020-09-30 JP JP2022515817A patent/JP7335427B2/en active Active
- 2020-09-30 EP EP20872274.4A patent/EP4038878A4/en active Pending
- 2020-09-30 CN CN202080068541.1A patent/CN114450952B/en active Active
- 2020-09-30 KR KR1020227011453A patent/KR102608814B1/en active IP Right Grant
- 2020-09-30 WO PCT/IB2020/059179 patent/WO2021064615A1/en unknown
- 2020-09-30 KR KR1020237040480A patent/KR20230167141A/en active Application Filing
- 2020-09-30 CN CN202310784301.7A patent/CN117082251A/en active Pending
-
2021
- 2021-07-26 US US17/385,030 patent/US12047565B2/en active Active
-
2023
- 2023-08-17 JP JP2023132810A patent/JP2023156452A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6518981B2 (en) * | 1997-11-12 | 2003-02-11 | Canon Kabushiki Kaisha | Generating and using a color palette |
CA2931386A1 (en) * | 2013-11-22 | 2015-05-28 | Huawei Technologies Co., Ltd. | Advanced screen content coding solution |
CA2930174A1 (en) * | 2014-01-02 | 2015-07-09 | Qualcomm Incorporated | Quantization of the escape pixels of a video block in palette coding mode |
US9910897B2 (en) * | 2014-05-06 | 2018-03-06 | Shutterstock, Inc. | Systems and methods for color palette suggestions |
Also Published As
Publication number | Publication date |
---|---|
CN114450952B (en) | 2023-07-21 |
US11076151B2 (en) | 2021-07-27 |
EP4038878A1 (en) | 2022-08-10 |
CN114450952A (en) | 2022-05-06 |
KR102608814B1 (en) | 2023-12-04 |
US20210099699A1 (en) | 2021-04-01 |
KR20220070454A (en) | 2022-05-31 |
JP2022548838A (en) | 2022-11-22 |
EP4038878A4 (en) | 2023-07-26 |
CN117082251A (en) | 2023-11-17 |
KR20230167141A (en) | 2023-12-07 |
JP7335427B2 (en) | 2023-08-29 |
JP2023156452A (en) | 2023-10-24 |
US20210352282A1 (en) | 2021-11-11 |
US12047565B2 (en) | 2024-07-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US12075065B2 (en) | Parallel histogram calculation with application to palette table derivation | |
US12047565B2 (en) | Hierarchical histogram calculation with application to palette table derivation | |
Wan et al. | A novel framework for optimal RGB to grayscale image conversion | |
US11240502B2 (en) | Video encoding | |
JP2014053654A (en) | Image encoding device, and image encoding method | |
US11961267B2 (en) | Color conversion between color spaces using reduced dimension embeddings | |
JP2017041701A (en) | Encoding device, decoding device, and image processing device | |
US11153578B2 (en) | Gradient texturing compression codec | |
JP2012222453A5 (en) | ||
CN105992003A (en) | Method and device for image compression of palette color number based on order or frequency | |
US12056902B2 (en) | Parent-child cluster compression | |
JP6219648B2 (en) | Image compression apparatus, image compression method, program, and recording medium | |
US20220094951A1 (en) | Palette mode video encoding utilizing hierarchical palette table generation | |
US20240144426A1 (en) | Super resolution image generation circuit | |
US20230412814A1 (en) | Recursive image compression | |
US8983212B2 (en) | Method for image data compression of image block | |
JP2009206907A (en) | Image compression apparatus and image decompression apparatus | |
CN113422955A (en) | HEIF image encoding method and decoding method, and encoding device and decoding device | |
Sae-Tang et al. | Non-separable weighted median-cut quantization for images with sparse color histogram | |
JPH0595481A (en) | Two-dimension contour shape coding system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20872274 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2022515817 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 20227011453 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2020872274 Country of ref document: EP Effective date: 20220502 |