US20020048320A1 - Automatic bit-rate controlled encoding and decoding of digital images - Google Patents
Automatic bit-rate controlled encoding and decoding of digital images Download PDFInfo
- Publication number
- US20020048320A1 US20020048320A1 US09/426,407 US42640799A US2002048320A1 US 20020048320 A1 US20020048320 A1 US 20020048320A1 US 42640799 A US42640799 A US 42640799A US 2002048320 A1 US2002048320 A1 US 2002048320A1
- Authority
- US
- United States
- Prior art keywords
- blocks
- digital image
- quantized
- frequency blocks
- bit stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
- G06T9/007—Transform coding, e.g. discrete cosine transform
Definitions
- the present invention relates to the field of image processing. More specifically, the present invention relates to a method and apparatus for automatically adjusting the rate at which a bit stream is processed.
- image compression standards include video compression standards, such as the digital video standards specified by the Motion Picture Experts Group (the MPEG standards), by the Join Photographic Experts Group (the Motion JPEG standard), and by the Digital VCR Conference (the “Blue Book” or DV standard), all of which standards are included herein by reference.
- MPEG Motion Picture Experts Group
- Motion JPEG Join Photographic Experts Group
- DV Digital VCR Conference
- the MPEG, JPEG, and DV standards are distinct compression formats based on discrete cosine transform (DCT) technology.
- the MPEG (in particular, MPEG2) standard is currently popular as a distribution format for satellite, cable, terrestrial broadcasting and digital video disc (DVD).
- the MPEG format uses a compression algorithm that utilizes both intraframe and interframe compression.
- the JPEG standard is most popularly used as a format for still images, but it may also be applied to video (Motion JPEG).
- the JPEG format uses only intraframe compression.
- the DV standard is currently gaining popularity as acquisition format for consumer digital camcorders, as well as professional digital cameras and post-production editing systems. Like the JPEG format, the DV format uses only intraframe compression.
- FIG. 1 is a flow diagram showing a conventional digital image encoding process ( 100 ).
- the encoder constructs N ⁇ N (typically 8 ⁇ 8) blocks from a digital image input into the encoder.
- a forward transform typically a cosine related transform
- the encoder divides the matrix of transformed blocks I(k 1 , k 2 ) by a predetermined, fixed quantization table or matrix Q(k 1 , k 2 ), and subsequently quantizes the result to produce a quantized transformed matrix S(k 1 , k 2 ) which comprises a matrix of symbols.
- the encoder applies symbol encoding to transform the matrix of symbols S(k 1 , k 2 ) to an output bit stream.
- FIG. 3 is a flow diagram showing a conventional digital image decoding process ( 300 ).
- the decoder receives an input bit stream and applies symbol decoding to regenerate the symbol matrix representing the quantized transformed matrix S(k 1 , k 2 ).
- the decoder multiplies the symbol matrix S(k 1 , k 2 ) by the same predetermined, fixed quantization matrix Q(k 1 , k 2 ) to produce a transformed matric I′(k 1 , k 2 ).
- This transformed matrix I′(k 1 , k 2 ) is an approximation of the original transformed matrix I(k 1 , k 2 ), some fidelity having been permanently lost due to the quantization step ( 106 ) of the encoding process ( 100 ).
- an inverse transform is applied to generate an image block matrix i′(n 1 , n 2 ).
- the image block matrix i′(n 1 , n 2 ) is an approximation of the original image block matrix i(n 1 , n 2 ).
- the blocks are merged to form an output digital image which is an approximation of the original image.
- the present invention provides new and improved apparatus and methods for encoding and decoding of a series of digital images.
- the throughput bit rate of conventional systems varies depending upon the complexity of the images.
- Applying apparatus and methods of the present invention, encoding and decoding of a series of digital images may be adjusted in an automated manner to achieve a constant throughput bit rate.
- FIG. 1 is a flow diagram showing a conventional digital image encoding process ( 100 ).
- FIG. 2 is a flow diagram showing a digital image encoding process ( 200 ) in accordance with a preferred embodiment of the present invention.
- FIG. 3 is a flow diagram showing a conventional digital image decoding process ( 300 ).
- FIG. 4 is a flow diagram showing a digital image decoding process ( 400 ) in accordance with a preferred embodiment of the present invention.
- FIG. 2 is a flow diagram showing a digital image encoding process ( 200 ) in accordance with a preferred embodiment of the present invention.
- the process ( 200 ) is similar to the conventional encoding process ( 100 ) in that the first two steps ( 102 and 104 ) are the same. However, thereafter the processes differ substantially.
- the third step ( 202 ) involves receiving a current quantization matrix or table (k 1 , k 2 ).
- the current quantization matrix Q (k 1 , k 2 ) is not predetermined and fixed, as it is in the conventional process ( 100 ).
- the current quantization matrix Q(k 1 , k 2 ) is used to divide the transformed matrix I(k 1 , k 2 ), and the result is quantized to generate the quantized transformed matrix of symbols S(k 1 , k 2 ).
- a fourth step ( 204 ) symbol encoding is applied to generate an output bit stream.
- the current quantization factor q f is also output with the bitstream.
- the current bit rate for the bit stream is fed back to the encoder.
- a fifth step ( 206 ) the encoder utilizes the fed back bit rate to determine the next quantization factor q f by adjustment to the current quantization factor.
- this next quantization factor q f is used to determine the next quantization table or matrix Q(k 1 , k 2 ).
- This next quantization matrix Q(k 1 , k 2 ) becomes the current quantization matrix when it is fed into the third step ( 202 ) and used to divide the next transformed matrix I(k 1 , k 2 ).
- next quantization factor q f is determined using the following equation.
- R target is the target compression ratio set for the automated process
- R previous is the previous compression ratio
- q previous is the previous quantization factor
- Compression ratios are reciprocals of bit rates.
- next quantization matrix Q(k 1 , k 2 ) is determined using the following equations.
- Q fixed (k 1 , k 2 ) may be, for example, a standard quantization table from the JPEG specification.
- FIG. 4 is a flow diagram showing a digital image decoding process ( 400 ) in accordance with a preferred embodiment of the present invention.
- the process ( 400 ) is similar to the conventional decoding process ( 300 ) in that the basic steps are the same. However, the processes differ is important aspects.
- a first step ( 302 ) symbol decoding is applied to an input bit stream to generate a matrix of symbols S(k 1 , k 2 ).
- the symbol matrix is multiplied by a current quantization table Q(k 1 , k 2 ) rather than a predetermined, fixed quantization table.
- the current quantization table Q(k 1 , k 2 ) is derived as follows.
- a quantization factor q f is extracted from the input bit stream.
- the quantization factor q f having been output along with the rest of the bit stream in the fourth step ( 204 ) of the encoding process in FIG. 2.
- this quantization factor q f is used to determine the current quantization table Q(k 1 , k 2 ) for application in the second step ( 406 ) discussed above.
Abstract
Description
- This application claims priority from U.S. Provisional Patent Application No. 60/077,076, filed Mar. 6, 1998, the full disclosure of which is incorporated herein by reference. This application also claims priority from U.S. patent application Ser. No. 09/263,589, filed Mar. 5, 1999, the full disclosure of which is incorporated herein by reference.
- 1. Field of the Invention
- The present invention relates to the field of image processing. More specifically, the present invention relates to a method and apparatus for automatically adjusting the rate at which a bit stream is processed.
- 2. Description of the Related Art
- This technique is suitable for widely-used image compression standards that integrate various algorithms into a compression system. Such image compression standards include video compression standards, such as the digital video standards specified by the Motion Picture Experts Group (the MPEG standards), by the Join Photographic Experts Group (the Motion JPEG standard), and by the Digital VCR Conference (the “Blue Book” or DV standard), all of which standards are included herein by reference.
- The MPEG, JPEG, and DV standards are distinct compression formats based on discrete cosine transform (DCT) technology. The MPEG (in particular, MPEG2) standard is currently popular as a distribution format for satellite, cable, terrestrial broadcasting and digital video disc (DVD). The MPEG format uses a compression algorithm that utilizes both intraframe and interframe compression. The JPEG standard is most popularly used as a format for still images, but it may also be applied to video (Motion JPEG). The JPEG format uses only intraframe compression. The DV standard is currently gaining popularity as acquisition format for consumer digital camcorders, as well as professional digital cameras and post-production editing systems. Like the JPEG format, the DV format uses only intraframe compression.
- The intraframe compression or encoding process in accordance with the above standards typically proceeds according to the process shown in FIG. 1. FIG. 1 is a flow diagram showing a conventional digital image encoding process (100). In a first step (102), the encoder constructs N×N (typically 8×8) blocks from a digital image input into the encoder. The result is a matrix of image blocks i(n1, n2), where n1=1, 2, 3, . . . , N1; n2=1, 2, 3, . . . , N2; N1 =the number of rows; and N 2=the number of columns. In a second step (104), the encoder applies a forward transform (typically a cosine related transform) to the matrix of image blocks to generate a matrix of transformed blocks I(k1, k2). In a third step (106), the encoder divides the matrix of transformed blocks I(k1, k2) by a predetermined, fixed quantization table or matrix Q(k1, k2), and subsequently quantizes the result to produce a quantized transformed matrix S(k1, k2) which comprises a matrix of symbols. Finally, in a fourth step (108), the encoder applies symbol encoding to transform the matrix of symbols S(k1, k2) to an output bit stream.
- FIG. 3 is a flow diagram showing a conventional digital image decoding process (300). In a first step (302), the decoder receives an input bit stream and applies symbol decoding to regenerate the symbol matrix representing the quantized transformed matrix S(k1, k2). In a second step (304), the decoder multiplies the symbol matrix S(k1, k2) by the same predetermined, fixed quantization matrix Q(k1, k2) to produce a transformed matric I′(k1, k2). This transformed matrix I′(k1, k2) is an approximation of the original transformed matrix I(k1, k2), some fidelity having been permanently lost due to the quantization step (106) of the encoding process (100). In a third step (306), an inverse transform is applied to generate an image block matrix i′(n1, n2). The image block matrix i′(n1, n2) is an approximation of the original image block matrix i(n1, n2). Finally, in a fourth step (308), the blocks are merged to form an output digital image which is an approximation of the original image.
- The present invention provides new and improved apparatus and methods for encoding and decoding of a series of digital images. The throughput bit rate of conventional systems varies depending upon the complexity of the images. Applying apparatus and methods of the present invention, encoding and decoding of a series of digital images may be adjusted in an automated manner to achieve a constant throughput bit rate.
- For further understanding of the nature and advantages of the present invention, together with other embodiments, reference should be made to the ensuing detailed description taken in conjunction with the accompanying drawings.
- FIG. 1 is a flow diagram showing a conventional digital image encoding process (100).
- FIG. 2 is a flow diagram showing a digital image encoding process (200) in accordance with a preferred embodiment of the present invention.
- FIG. 3 is a flow diagram showing a conventional digital image decoding process (300).
- FIG. 4 is a flow diagram showing a digital image decoding process (400) in accordance with a preferred embodiment of the present invention.
- FIG. 2 is a flow diagram showing a digital image encoding process (200) in accordance with a preferred embodiment of the present invention. The process (200) is similar to the conventional encoding process (100) in that the first two steps (102 and 104) are the same. However, thereafter the processes differ substantially.
- In accordance with a preferred embodiment of the present invention, the third step (202) involves receiving a current quantization matrix or table (k1, k2). The current quantization matrix Q (k1, k2) is not predetermined and fixed, as it is in the conventional process (100). The current quantization matrix Q(k1, k2) is used to divide the transformed matrix I(k1, k2), and the result is quantized to generate the quantized transformed matrix of symbols S(k1, k2).
- In a fourth step (204), symbol encoding is applied to generate an output bit stream. However, in addition to outputting the bit stream, the current quantization factor qf is also output with the bitstream. Furthermore, the current bit rate for the bit stream is fed back to the encoder.
- In a fifth step (206), the encoder utilizes the fed back bit rate to determine the next quantization factor qf by adjustment to the current quantization factor. In a sixth step (208), this next quantization factor qf is used to determine the next quantization table or matrix Q(k1, k2). This next quantization matrix Q(k1, k2) becomes the current quantization matrix when it is fed into the third step (202) and used to divide the next transformed matrix I(k1, k2).
- In a preferred embodiment of the present invention, the next quantization factor qf is determined using the following equation.
- q f =R target *R previous*(b+q previous)−b
- where Rtarget is the target compression ratio set for the automated process, Rprevious is the previous compression ratio, qprevious is the previous quantization factor, and b=1/a=1/0.234=4.27. Compression ratios are reciprocals of bit rates.
- In a preferred embodiment of the present invention, the next quantization matrix Q(k1, k2) is determined using the following equations.
- Q(k 1 , k 2)=[Q fixed(k 1, k2)*qf]/64+0.5
- where Qfixed(k1, k2) may be, for example, a standard quantization table from the JPEG specification.
- FIG. 4 is a flow diagram showing a digital image decoding process (400) in accordance with a preferred embodiment of the present invention. The process (400) is similar to the conventional decoding process (300) in that the basic steps are the same. However, the processes differ is important aspects.
- Like the conventional process (200), in a first step (302) symbol decoding is applied to an input bit stream to generate a matrix of symbols S(k1, k2). However, here, in a second step (406) the symbol matrix is multiplied by a current quantization table Q(k1, k2) rather than a predetermined, fixed quantization table. The current quantization table Q(k1, k2) is derived as follows.
- First, in parallel to the first step (302), in a first additional step (402), a quantization factor qf is extracted from the input bit stream. The quantization factor qf having been output along with the rest of the bit stream in the fourth step (204) of the encoding process in FIG. 2. In a second additional step (404), this quantization factor qf is used to determine the current quantization table Q(k1, k2) for application in the second step (406) discussed above.
- As will be understood by those with ordinary skill in the art, the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.
Claims (9)
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/426,407 US6442299B1 (en) | 1998-03-06 | 1999-10-25 | Automatic bit-rate controlled encoding and decoding of digital images |
PCT/US2000/029378 WO2001031569A1 (en) | 1999-10-25 | 2000-10-25 | Automatic bit-rate controlled encoding and decoding of digital images |
AU13432/01A AU1343201A (en) | 1999-10-25 | 2000-10-25 | Automatic bit-rate controlled encoding and decoding of digital images |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US7707698P | 1998-03-06 | 1998-03-06 | |
US26358999A | 1999-03-05 | 1999-03-05 | |
US09/426,407 US6442299B1 (en) | 1998-03-06 | 1999-10-25 | Automatic bit-rate controlled encoding and decoding of digital images |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US26358999A Continuation-In-Part | 1998-03-06 | 1999-03-05 |
Publications (2)
Publication Number | Publication Date |
---|---|
US20020048320A1 true US20020048320A1 (en) | 2002-04-25 |
US6442299B1 US6442299B1 (en) | 2002-08-27 |
Family
ID=23690686
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/426,407 Expired - Fee Related US6442299B1 (en) | 1998-03-06 | 1999-10-25 | Automatic bit-rate controlled encoding and decoding of digital images |
Country Status (3)
Country | Link |
---|---|
US (1) | US6442299B1 (en) |
AU (1) | AU1343201A (en) |
WO (1) | WO2001031569A1 (en) |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4302775A (en) | 1978-12-15 | 1981-11-24 | Compression Labs, Inc. | Digital video compression system and methods utilizing scene adaptive coding with rate buffer feedback |
US5341318A (en) | 1990-03-14 | 1994-08-23 | C-Cube Microsystems, Inc. | System for compression and decompression of video data using discrete cosine transform and coding techniques |
EP0514663A3 (en) * | 1991-05-24 | 1993-07-14 | International Business Machines Corporation | An apparatus and method for motion video encoding employing an adaptive quantizer |
KR0176448B1 (en) * | 1991-07-19 | 1999-05-01 | 강진구 | Image coding method and apparatus |
BR9405508A (en) * | 1993-07-12 | 1999-09-08 | Sony Corp | Image decoder and encoder process and apparatus. |
EP0735772A3 (en) | 1995-03-27 | 1998-04-01 | Hewlett-Packard Company | Method for selecting JPEG quantization tables for low bandwidth applications |
-
1999
- 1999-10-25 US US09/426,407 patent/US6442299B1/en not_active Expired - Fee Related
-
2000
- 2000-10-25 WO PCT/US2000/029378 patent/WO2001031569A1/en active Application Filing
- 2000-10-25 AU AU13432/01A patent/AU1343201A/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
US6442299B1 (en) | 2002-08-27 |
WO2001031569A1 (en) | 2001-05-03 |
AU1343201A (en) | 2001-05-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US5881180A (en) | Method and apparatus for the reduction of blocking effects in images | |
KR100253931B1 (en) | Approximate mpeg decoder with compressed reference frames | |
US6058141A (en) | Varied frame rate video | |
US8411741B2 (en) | Picture processing apparatus, picture processing method, picture processing program and recording medium | |
US20050276325A1 (en) | Code quantity control apparatus, code quantity control method and picture information transformation method | |
EP0671102B1 (en) | Picture-in-picture tv with insertion of a mean only frame into a full size frame | |
US20050129130A1 (en) | Color space coding framework | |
US6185253B1 (en) | Perceptual compression and robust bit-rate control system | |
US20050078748A1 (en) | Non-compensated transcoding of a video stream | |
US6865229B1 (en) | Method and apparatus for reducing the “blocky picture” effect in MPEG decoded images | |
EP0995316A2 (en) | Method and device for modifying data in an encoded data stream | |
WO1998026604A1 (en) | Video coding | |
US6633673B1 (en) | Fast fade operation on MPEG video or other compressed data | |
JPH08289294A (en) | Animation image compression system by adaptive quantization | |
US10972767B2 (en) | Device and method of handling multiple formats of a video sequence | |
US5353060A (en) | Process and device for the transformation of image data | |
US6442299B1 (en) | Automatic bit-rate controlled encoding and decoding of digital images | |
Strachan et al. | Video compression | |
US20050129111A1 (en) | Transform-domain video editing | |
JP3469866B2 (en) | Method for changing the bit rate of a data stream of an encoded video picture | |
EP1110408B1 (en) | Compression and decompression system for digital video signals | |
Irvin et al. | A new generation of MPEG-2 video encoder ASIC and its application to new technology markets | |
KR100338725B1 (en) | Pictures coding method approximating coding bits to target coding bits and apparatus therefor | |
KR100335435B1 (en) | Compression coder and / or decoder of video signal and method thereof | |
KR100820019B1 (en) | Apparatus and method of image compression in media oriented system transport |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: DIVIO, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WANG, JOHNNY K.;REEL/FRAME:010343/0859 Effective date: 19991014 |
|
AS | Assignment |
Owner name: ESS TECHNOLOGIES INTERNATIONAL, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DIVIO, INC.;REEL/FRAME:015541/0116 Effective date: 20040625 |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
AS | Assignment |
Owner name: THE PRIVATE BANK OF THE PENINSULA, CALIFORNIA Free format text: SECURITY AGREEMENT;ASSIGNOR:ESS TECHNOLOGY, INC.;REEL/FRAME:021212/0413 Effective date: 20080703 Owner name: THE PRIVATE BANK OF THE PENINSULA,CALIFORNIA Free format text: SECURITY AGREEMENT;ASSIGNOR:ESS TECHNOLOGY, INC.;REEL/FRAME:021212/0413 Effective date: 20080703 |
|
REMI | Maintenance fee reminder mailed | ||
LAPS | Lapse for failure to pay maintenance fees | ||
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20100827 |