GB2608965A - Lossy compression techniques - Google Patents

Lossy compression techniques Download PDF

Info

Publication number
GB2608965A
GB2608965A GB2215649.1A GB202215649A GB2608965A GB 2608965 A GB2608965 A GB 2608965A GB 202215649 A GB202215649 A GB 202215649A GB 2608965 A GB2608965 A GB 2608965A
Authority
GB
United Kingdom
Prior art keywords
bits
component
pixels
block
values
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
GB2215649.1A
Other versions
GB202215649D0 (en
Inventor
J Bergland Tyson
Ramani Karthik
Lachowsky Stephan
A Hensley Justin
A Jamshidi Davoud
P Delaurier Anthony
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/855,540 external-priority patent/US11664816B2/en
Priority claimed from US16/855,459 external-priority patent/US11405622B2/en
Application filed by Apple Inc filed Critical Apple Inc
Publication of GB202215649D0 publication Critical patent/GB202215649D0/en
Publication of GB2608965A publication Critical patent/GB2608965A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03MCODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/3059Digital compression and data reduction techniques where the original information is represented by a subset or similar information, e.g. lossy compression
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03MCODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/3082Vector coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124Quantisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques

Abstract

Techniques are disclosed relating to compression of pixel data using different quantization for different regions of a block of pixels being compressed. In some embodiments, compression circuitry is configured to determine, for multiple components included in pixels of the block of pixels being compressed, respective smallest and greatest component values in respective regions of the block of pixels. The compression circuitry may determine, based on the determined smallest and greatest component values, to use a first number of bits to represent delta values relative to a base value for a first component in a first region and a second, different number of bits to represent delta values relative to a base value for a second component in the first region. The compression circuitry may then quantize delta values for the first and second components of pixels in the first region of the block of pixels using the determined first and second numbers of bits. In some embodiments, the compression circuitry determines whether to provide cross-component bit sharing within a region.

Claims (20)

WHAT IS CLAIMED IS:
1. An apparatus, comprising: compression circuitry configured to: access pixel data for a block of pixels being compressed; determine, for multiple components included in pixels of the block of pixels, respective smallest and greatest component values in respective different regions of the block of pixels; determine, based on the determined smallest and greatest component values, to use a first number of bits to represent delta values relative to a base value for a first component in a first region and a second, different number of bits to represent delta values relative to a base value for a second component in the first region; quantize delta values for the first and second components of pixels in the first region of the block of pixels using the determined first and second numbers of bits; and store a compressed version of the block of pixels using the quantized deltas.
2. The apparatus of claim 1, wherein, to determine to use the first and second numbers of bits, the compression circuitry is configured to: determine a first initial number of bits to represent delta values in the first region for the first component; determine a second initial number of bits to represent delta values in the first region for the second component; and select the first and second numbers of bits in response to determining to reduce the first initial number of bits to share delta bits with the second component.
3. The apparatus of claim 2, wherein the compression circuitry is configured to: determine a compression mode for the first component based on a difference between smallest and greatest component values in the first region for the first component; and determine to reduce the first initial number of bits to share delta bits with the second component based on the determined compression mode, wherein the compression mode indicates an initial number of base bits, an initial number of delta bits, a free level value that indicates a number of levels that can be given to another component without subtracting from the componentâ s base or delta bits, and a protected base value that indicates whether the componentâ s base bits can be decremented when giving one or more levels to another component.
4. The apparatus of claim 1, wherein the compression circuitry is further configured to quantize deltas values for the first component of pixels in a second region of the block of pixels using a third, different determined number of bits.
5. The apparatus of claim 1, wherein the compression circuitry is further configured to select and apply direct quantization of pixel component values for a second region of the block of pixels.
6. The apparatus of claim 5, wherein the compression circuitry is configured to apply direct quantization of pixel component values for the second region in response to determining that: a level of quantization used for delta values for the second region creates quantization errors that exceed direct quantization of the input pixel data; or a floating point value of a component in the second region is included in a set of special floating point values.
7. The apparatus of claim 5, wherein the compression circuitry is configured to generate metadata for the compressed block of pixels that indicates: that the block of pixels was compressed using lossy compression, wherein the apparatus is configured to imply that the compressed block of pixels has a size that matches a target compression output size based on the use of lossy compression; and whether direct quantization of pixel component values was used for the respective ones of the regions.
8. The apparatus of claim 1, wherein the compression circuitry is further configured to, prior to determining the respective smallest and greatest values, apply a bias to one or more component values represented in a signed format.
9. A method, comprising: accessing, by compression circuitry, pixel data for a block of pixels being compressed; determining, by the compression circuitry, for multiple components included in pixels of the block of pixels, respective smallest and greatest component values in different respective regions of the block of pixels; determining, by the compression circuitry based on the determined smallest and greatest component values, to use a first number of bits to represent delta values relative to a base value for a first component in a first region and a second, different number of bits to represent delta values relative to a base value for a second component in the first region; quantizing, by the compression circuitry, delta values for the first and second components of pixels in the first region of the block of pixels using the determined first and second numbers of bits; and storing, by the compression circuitry, a compressed version of the block of pixels using the quantized deltas.
10. The method of claim 9, wherein the determining the first and second numbers of bits includes: determining, by the compression circuitry, a first initial number of bits to represent delta values in the first region for the first component based on a difference between corresponding smallest and greatest component values; determining, by the compression circuitry, a second initial number of bits to represent delta values in the first region for the second component based on a difference between corresponding smallest and greatest component values; and selecting, by the compression circuitry, the first and second numbers of bits in response to determining to reduce the first initial number of bits to share delta bits with the second component.
11. The method of claim 10, further comprising: determining a compression mode for the first component based on a difference between smallest and greatest component values in the first region for the first component; and determining to reduce the first initial number of bits to share delta bits with the second component based on the determined compression mode, wherein the compression mode indicates an initial number of base bits, an initial number of delta bits, a compression level, and a free level value that indicates a number of levels that can be given to another component without subtracting from the componentâ s base or delta bits.
12. The method of claim 9, further comprising applying direct quantization of pixel component values for a second region of the block of pixels.
13. The method of claim 9, further comprising: generating metadata for the compressed block of pixels that indicates that the block of pixels was compressed using lossy compression, wherein decompression circuitry implies that the compressed block of pixels has a size that matches a target compression output size based on the use of lossy compression.
14. A non-transitory computer readable storage medium having stored thereon design information that specifies a design of at least a portion of a hardware integrated circuit in a format recognized by a semiconductor fabrication system that is configured to use the design information to produce the circuit according to the design, wherein the design information specifies that the circuit includes: compression circuitry configured to: access pixel data for a block of pixels being compressed; determine, for multiple components included in pixels of the block of pixels, respective smallest and greatest component values in different respective regions of the block of pixels; determine, based on the determined smallest and greatest component values, to use a first number of bits to represent delta values relative to a base value for a first component in a first region and a second, different number of bits to represent delta values relative to a base value for a second component in the first region; quantize delta values for the first and second components of pixels in the first region of the block of pixels using the determined first and second numbers of bits; and store a compressed version of the block of pixels using the quantized deltas.
15. The non-transitory computer readable storage medium of claim 14, wherein, to determine to use the first and second numbers of bits, the compression circuitry is configured to: determine a first initial number of bits to represent delta values in the first region for the first component; determine a second initial number of bits to represent delta values in the first region for the second component; and select the first and second numbers of bits in response to determining to reduce the first initial number of bits to share delta bits with the second component.
16. The non-transitory computer readable storage medium of claim 15, wherein the compression circuitry is configured to: determine a compression mode for the first component based on a difference between smallest and greatest component values in the first region for the first component; and determine to reduce the first initial number of bits to share delta bits with the second component based on the determined compression mode, wherein the compression mode indicates an initial number of base bits, an initial number of delta bits, a compression level, and a free level value that indicates a number of levels that can be given to another component without subtracting from the componentâ s base or delta bits.
17. The non-transitory computer readable storage medium of claim 14, wherein the compression circuitry is further configured to quantize deltas values for the first component of pixels in a second region of the block of pixels using a third, different determined number of bits.
18. The non-transitory computer readable storage medium of claim 14, wherein the compression circuitry is further configured to select and apply direct quantization of pixel component values for a second region of the block of pixels.
19. The non-transitory computer readable storage medium of claim 18, wherein the compression circuitry is configured to generate metadata for the compressed block of pixels that indicates: that the block of pixels was compressed using lossy compression, wherein the circuit is configured to imply that the compressed block of pixels has a size that matches a target compression output size based on the use of lossy compression; and whether direct quantization of pixel component values was used for the respective ones of the regions.
20. The non-transitory computer readable storage medium of claim 14, wherein the compression circuitry is further configured to, prior to determining the respective smallest and greatest values, apply a bias to one or more component values represented in a signed format.
GB2215649.1A 2020-04-22 2021-04-16 Lossy compression techniques Pending GB2608965A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/855,540 US11664816B2 (en) 2020-04-22 2020-04-22 Lossy compression techniques
US16/855,459 US11405622B2 (en) 2020-04-22 2020-04-22 Lossless compression techniques
PCT/US2021/027623 WO2021216361A1 (en) 2020-04-22 2021-04-16 Lossy compression techniques

Publications (2)

Publication Number Publication Date
GB202215649D0 GB202215649D0 (en) 2022-12-07
GB2608965A true GB2608965A (en) 2023-01-18

Family

ID=75914572

Family Applications (1)

Application Number Title Priority Date Filing Date
GB2215649.1A Pending GB2608965A (en) 2020-04-22 2021-04-16 Lossy compression techniques

Country Status (5)

Country Link
KR (1) KR20220157467A (en)
CN (1) CN115516769A (en)
DE (1) DE112021002484T5 (en)
GB (1) GB2608965A (en)
WO (1) WO2021216361A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0424060A2 (en) * 1989-10-14 1991-04-24 Sony Corporation Method of coding video signals and transmission system thereof
EP0840510A1 (en) * 1996-05-17 1998-05-06 Matsushita Electric Industrial Co., Ltd. Picture encoder, picture decoder, picture encoding method, picture decoding method, picture encoding program recording medium, and picture decoding program recording medium
US6058217A (en) * 1996-07-17 2000-05-02 Sony Corporation Image coding apparatus for coding an image of a component signal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0424060A2 (en) * 1989-10-14 1991-04-24 Sony Corporation Method of coding video signals and transmission system thereof
EP0840510A1 (en) * 1996-05-17 1998-05-06 Matsushita Electric Industrial Co., Ltd. Picture encoder, picture decoder, picture encoding method, picture decoding method, picture encoding program recording medium, and picture decoding program recording medium
US6058217A (en) * 1996-07-17 2000-05-02 Sony Corporation Image coding apparatus for coding an image of a component signal

Also Published As

Publication number Publication date
WO2021216361A1 (en) 2021-10-28
CN115516769A (en) 2022-12-23
GB202215649D0 (en) 2022-12-07
DE112021002484T5 (en) 2023-04-06
KR20220157467A (en) 2022-11-29

Similar Documents

Publication Publication Date Title
US9906817B2 (en) Indexed color values in image coding
EP2961164B1 (en) Data processing apparatus for organic light emitting display device
TWI488054B (en) Method and apparatus for finding data quantisation error
GB2593327A (en) Colour conversion within a hierarchical coding scheme
JP2001136535A (en) Image-encoding device and quantization characteristic determining device
AU2004309912A1 (en) Method and device for transcoding N-bit words into M-bit words with M smaller N
US7379500B2 (en) Low-complexity 2-power transform for image/video compression
KR20200093404A (en) Neural network accelerator and operating method thereof
CN114612996A (en) Method for operating neural network model, medium, program product, and electronic device
GB2608965A (en) Lossy compression techniques
US20210004679A1 (en) Asymmetric quantization for compression and for acceleration of inference for neural networks
Nasrabadi et al. A multilayer address vector quantization technique
US11475285B2 (en) Neural network accelerator and operating method thereof
KR20210070767A (en) Quantization method of latent vector for audio encoding and computing device for performing the method
CN112712164A (en) Non-uniform quantization method of neural network
Mese et al. Optimal histogram modification with MSE metric
US20030021473A1 (en) Fast gamma correction method for image reading apparatus
US11960986B2 (en) Neural network accelerator and operating method thereof
KR102068657B1 (en) Method and apparatus for processing image data
US7324598B2 (en) Apparatus and method to reduce quantization error
KR20210021892A (en) Method and apparatus for processing image data
KR20220043254A (en) Binary data compression method and appratus thereof
US7626517B2 (en) Data retrieving method, data retrieving apparatus, data compression method and data compression apparatus
US10931948B2 (en) Enhanced image compression with clustering and lookup procedures
CN110875744B (en) Coding method and device