US20060280245A1 - MPEG video storage address generation apparatuses and methods for uniformly fetching and storing video data - Google Patents
MPEG video storage address generation apparatuses and methods for uniformly fetching and storing video data Download PDFInfo
- Publication number
- US20060280245A1 US20060280245A1 US11/507,962 US50796206A US2006280245A1 US 20060280245 A1 US20060280245 A1 US 20060280245A1 US 50796206 A US50796206 A US 50796206A US 2006280245 A1 US2006280245 A1 US 2006280245A1
- Authority
- US
- United States
- Prior art keywords
- distinct
- address
- bit
- data
- counter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 230000002123 temporal effect Effects 0.000 claims description 30
- 230000007246 mechanism Effects 0.000 claims description 9
- 238000013507 mapping Methods 0.000 claims 9
- 238000010586 diagram Methods 0.000 description 41
- 239000011159 matrix material Substances 0.000 description 16
- 239000013598 vector Substances 0.000 description 13
- 238000007906 compression Methods 0.000 description 8
- 230000006835 compression Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 5
- 238000013459 approach Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000013178 mathematical model Methods 0.000 description 3
- 238000013144 data compression Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 101100328886 Caenorhabditis elegans col-2 gene Proteins 0.000 description 1
- 101100328884 Caenorhabditis elegans sqt-3 gene Proteins 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/43—Hardware specially adapted for motion estimation or compensation
- H04N19/433—Hardware specially adapted for motion estimation or compensation characterised by techniques for memory access
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
Definitions
- This invention relates to MPEG video technology and, more specifically, to decoding Motion Picture Experts Group (MPEG) video bitstream.
- MPEG Motion Picture Experts Group
- the compressed digital system signal, or bitstream which includes a video portion, an audio portion, and other informational portions, is transmitted to a receiver. Transmission may be over existing television channels, cable television channels, satellite communication channels, and the like.
- a decoder is provided at the receiver to de-multiplex, decompress and decode the received system signal in accordance with a given compression algorithm.
- the decoded video and audio information is then output to a display device such as a television monitor for presentation to the user.
- Video and audio compression and encoding is performed by suitable encoders which implement a selected data compression algorithm that conforms to a recognized standard or specification agreed to among the senders and receivers of digital video signals.
- Highly efficient compression standards have been developed by the Moving Pictures Experts Group (MPEG), including MPEG-1 and MPEG-2.
- MPEG standards enable several VCR-like viewing options such as Normal Forward, Play, Slow Forward, Fast Forward, Fast Reverse, and Freeze.
- a video sequence includes a sequence header, one or more groups of pictures, and an end-of-sequence code.
- a group of pictures is a series of one or more pictures intended to allow random access into the sequence.
- a picture is the primary coding unit of a video sequence.
- a picture consists of three rectangular matrices representing luminance (Y) and two chrominance (Cb, Cr) values.
- the Y matrix has an even number of rows and columns.
- the Cb and Cr matrices are one-half the size of the Y matrix in each direction (horizontal and vertical). Thus, for every four luminance values, there are two associated chrominance values (one Cb value and one Cr value).
- a slice is one or more contiguous macroblocks. Slices are important in the handling of errors. If the bitstream contains an error, the decoder can skip to the start of the next slice.
- a macroblock is a 16 ⁇ 16 line section of luminance components and the corresponding chrominance components.
- a block is an 8 ⁇ 8 set of values of a luminance or chrominance component.
- the MPEG standard defines three main types of video pictures:
- I-pictures Intracoded pictures which are coded without reference to any other pictures.
- P-pictures which are coded using motion-compensated forward prediction from a previous I or P reference picture.
- B-pictures Bidirectional predictive-coded pictures which are coded using interpolated motion compensation from a previous and a future I or P picture.
- I pictures are coded using only the Discrete Cosine Transform (DCT) which converts time and space domain into frequency and amplitude domain for the purpose of achieving data compression.
- DCT Discrete Cosine Transform
- the macroblock is the basic motion compensation unit for P and B pictures. Each macroblock is coded by computing a motion compensation vector which defines the displacement between the macroblock, and the corresponding macroblock in the reference I or P picture(s) from which it is being predicted. If there is little or no motion, the motion compensation vector will not be transmitted.
- a comparison macroblock is then generated by displacing the reference macroblock by the amount indicated by the motion compensation vector, which is then subtracted from the macroblock of the P or B picture that is being coded to produce an error signal which corresponds to the difference therebetween.
- the error signal is then coded using DCT (similar to an intracoded picture) and transmitted with the motion vector. If, however, the error signal is small or zero, no error component is transmitted.
- a predictive coded macroblock can consist of only a motion compensation component, only a transform (DCT) coded component, or both.
- the macroblock is quantized, and Variable Length Coded (VLC) to further compress the data bitstream.
- VLC Variable Length Coded
- the macroblocks are then assembled into slices, pictures, groups of pictures and video sequences, multiplexed with associated audio data, and transmitted to a user for decoding and presentation.
- MPEG video compression The basic idea behind MPEG video compression is to remove spatial redundancy within a video frame and temporal redundancy between video frames.
- DCT-based Discrete Cosine Transform
- Motion-compensation is used to exploit temporal redundancy. The images in a video stream usually do not change much within small time intervals.
- the idea of motion-compensation is to encode a video frame based on other video frames temporally close to it.
- a video stream is a sequence of video frames. Each frame is a still image. A video player displays one frame after another, usually at a rate close to 30 frames per second (23.976, 24, 25, 29.97, 30).
- Frames are digitized in a standard RGB format, 24 bits per pixel (8 bits each for Red, Green, and Blue).
- MPEG-1 is designed to produce bit rates of 1.5 Mb/s or less, and is intended to be used with images of size 352 ⁇ 288 at 24-30 frames per second. This results in data rates of 55.7-69.6 Mb/s.
- Frames are divided into 16 ⁇ 16 pixel macroblocks. Each macroblock consists of four 8 ⁇ 8 luminance blocks and two 8 ⁇ 8 chrominance blocks(1 U and 1 V). Macroblocks are the units for motion-compensated compression. Blocks are used for DCT compression. Frames can be encoded in three types: intra-frames (I-frames), forward predicted frames (P-frames), and bi-directional predicted frames (B-frames).
- I-frames intra-frames
- P-frames forward predicted frames
- B-frames bi-directional predicted frames
- An MPEG-1 video sequence is an ordered stream of bits, with a special bit pattern sequences marking the beginning and ending of a logical section.
- VLD Variable Length Decoding
- IZZ Inverse Zig-Zag Scan
- IQ Inverse Quantization
- IDCT Inverse Discrete Cosine Transform
- MC Motion Compensation
- MS Merge and Store
- ASICs application specific integrated circuits
- the MPEG bitstream that is to be decoded is stored in a DRAM buffer in a decoder system.
- the MPEG bitstream that is to be decoded is herein referred to as “bitstream”.
- FIG. 1 is a simplified block diagram that illustrates some components of a typical MPEG-2 video bitstream decoder core.
- reconstructed data 102 is the bitstream that is to be decoded and is shown as an input into the dynamic random access memory (DRAM) interface 104 .
- DRAM interface 104 is communicatively coupled to DRAM buffer 106 , MC module 108 , VLD/IZZ/Q module 114 and MS module 112 .
- MC module 108 is communicatively coupled to MC buffer 110 , which in turn is communicatively coupled to MS module 112 .
- VLD/IZZ/IQ module 114 is communicatively coupled to IDCT module 116 , which in turn is communicatively coupled to IDCT buffer 118 .
- the data and data paths referred to herein are associated with reconstructed data 102 .
- the spatial data path goes through the VLD/IZZ/IQ module 114 and IDCT module 116 , and the resulting data is written into IDCT buffer 118 .
- the temporal data path which comprises MC module 108 , gets reference data from previously reconstructed data stored in memory. The resulting data coming out of MC module 108 is written to MC buffer 110 .
- MS module 112 performs the following: 1) reads in spatial data from the IDCT buffer and reads in temporal data from the MC buffer, 2) adds the data that is read from the MC buffer to the data that is read from the IDCT buffer to produce a combined data set of reconstructed data, and 3) writes the combined data set to DRAM buffer 106 where the reconstructed data is stored.
- the spatial data path is block based or 8 ⁇ 8 based
- the temporal data path is macroblock based or 16 ⁇ 16 based or 16 ⁇ 8 based.
- the MS module handles both block based and macroblock based addressing schemes when adding spatial and temporal data together.
- there are many flags in the bitstream which make the IDCT/MC buffer accessing mechanism quite complicated.
- the ASIC implementation of MPEG video decoding such as the decoding performed by VLD/IZZ/IQ, IDCT, MC and MS modules, is designed using a pipeline architecture.
- the IDCT buffer and the MC buffer require different read/write address pattern sequences.
- each buffer has its own associated address generator in order to simultaneously facilitate data access.
- the drawback of pipeline architecture is more hardware consumption, which in turn consumes more power.
- decoders require a large amount of hardware in terms of gate count and power consumption. Because of the higher level of logic complexity, the effort required to test and debug a decoder is also large. Also, the different addressing schemes of each data path in the decoding process require different types address generators.
- an n-bit counter is used to generate up to n factorial (n!) number of distinct bit pattern sequences.
- One or more of the distinct n! number of bit sequences are selected to create corresponding one or more addressing schemes.
- the data that is associated with the video signals are fetched and stored using the one or more addressing schemes.
- the one or more addressing schemes are based on corresponding one or more flags and condition that are associated with data.
- the n-bit counter is used to produce a first sequence of 2 n sequential numbers, wherein each of the 2 n sequential numbers is associated with a distinct binary value comprising n bits.
- An mth pair of bits in each binary value is swapped to produce a (m+1)th sequence of 2 n number of non-sequential numbers, wherein m equals (n! ⁇ 1).
- one or more multiplexers are used to select the one or more n! number of distinct bit pattern sequences.
- a pre-determined combinational logic is applied to the swapped bits.
- the logic of an address generator is simplified by using an n-bit counter, which is the simplest sequence generator, and by swapping bits.
- n-bit counter which is the simplest sequence generator
- FIG. 1 is a simplified block diagram that illustrates some components of a typical MPEG-2 video bitstream decoder core
- FIG. 2 is a simplified block diagram that illustrates some key components that replace the IDCT module and IDCT buffer of FIG. 1 ;
- FIG. 3 is a simplified block diagram that illustrates some key components that replace the MC module and MC buffer of FIG. 1 ;
- FIG. 4 is a simplified block diagram that illustrates some key components that replace the MS module of FIG. 1 ;
- FIG. 5 is a block diagram of an address generator used in certain embodiments of the invention.
- FIG. 6 is a block diagram of another variation of an address generator according to certain embodiments of the invention.
- FIG. 7 is a block diagram that illustrates the data format in memory
- FIG. 8 is a block diagram that illustrates three different chrominance formats for a macroblock
- FIG. 9 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format
- FIG. 10 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format
- FIG. 11 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format
- FIG. 12 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format
- FIG. 13 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format
- FIG. 14 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format
- FIG. 15 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format
- FIG. 16 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format
- FIG. 17 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format
- FIG. 18 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format
- FIG. 19 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format.
- FIG. 20 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format.
- DRAM buffer is partitioned for constructed (bitstream) data and reconstructed (decoded data) data.
- Constructed data 102 is stored in the DRAM buffer 106 through DRAM interface 104 and is fed to VLD/IZZ/IQ module 114 and IDCT module 116 through DRAM interface 104 for decoding.
- the IDCT module 116 processes macroblock data that is associated with constructed data 102 .
- IDCT module 116 After processing, IDCT module 116 writes the macroblock data to IDCT buffer 118 based on coded block pattern. Any current non-coded block in the IDCT buffer will maintain the value of the previous coded block value. Reconstructed data from DRAM buffer 106 are also fed to MC module 108 . If motion compensation exists in the macroblock data that is associated with constructed data 102 , then MC module 108 retrieves reference data, which is previously reconstructed data that is stored in DRAM buffer 106 . MC module 108 processes the macroblock data and writes the macroblock data to MC buffer 110 .
- MS module 112 reads the macroblock data from IDCT buffer 118 and from MC buffer 110 and adds the macroblock data together before sending the resulting macroblock data back to DRAM buffer 106 .
- the decoding process performed by IDCT buffer 118 , MC buffer 110 and MS module 112 involve multiple read/write events.
- Each read/write event is associated with a distinct bit pattern sequence based on the different motion compensation modes and residue modes present in the constructed data.
- the read/write events are also based on the conditions and/or flags that are associated with the constructed data that is to be decoded. Such conditions and flags are decoded before reconstructing each macroblock of data. Examples of typical motion compensation modes are: 1) frame, 2) field, 3) 8 ⁇ 16, and 4) dual prime.
- Typical residue modes are: 1) frame, and 2) field.
- Different read/write address pattern sequences are associated with each mode.
- a single unified mechanism is provided to perform the different read/write sequences as performed by IDCT buffer 118 , MC buffer 1110 and MS module 112 .
- the unified mechanism for performing the different read/write address pattern sequences is based on using the same type of address generator in the IDCT, MC and MS modules.
- the address generators use a bit swapping technique for generating the different read/write address pattern sequences and are further described in greater detail herein.
- FIG. 2 is a simplified block diagram that illustrates some key components that replace IDCT module 116 and IDCT buffer 118 of FIG. 1 .
- data 202 from VLD/IZZ/IQ module feeds into IDCT controller 204 .
- IDCT controller 204 is a controller that is associated with the IDCT address generator 206 and is thus communicatively coupled with IDCT address generator 206 .
- IDCT address generator 206 is communicatively coupled to the IDCT buffer 208 .
- the IDCT buffer receives a bit pattern sequence 212 from an MS module (not shown in FIG. 2 ) and sends data 210 to the MS module.
- the function of IDCT address generator 206 is further described in greater detail herein under the section ADDRESS GENERATORS.
- FIG. 3 is a simplified block diagram that illustrates some key components that replace MC module 108 and MC buffer 110 of FIG. 1 .
- MC controller 302 is a controller that is associated with the MC address generator 304 and is thus communicatively coupled with MC address generator 304 .
- MC address generator 304 is communicatively coupled to the MC buffer 306 .
- MC buffer 306 receives a bit pattern sequence 310 from the MS module (not shown in FIG. 2 ) and sends data 308 to the MS module.
- the function of MC address generator 304 is further described in greater detail herein under the section ADDRESS GENERATOR.
- FIG. 4 is a simplified block diagram that illustrates some key components that replace MS module 112 of FIG. 1 .
- MS module 402 comprises MS controller 404 that is communicatively coupled to MS address generator 406 .
- MS controller 404 controls MS address generator 406 .
- the MS address generator 406 sends a bit pattern sequence 410 to the MC buffer (not shown in FIG. 4 ).
- MS address generator 406 sends bit pattern sequence 412 to the IDCT buffer (not shown in FIG. 4 ).
- the function of MS address generator 406 is further described in greater detail herein under the section ADDRESS GENERATOR.
- MS module 402 receives data 408 from the MC buffer based on the MS bit pattern sequence 410 and data 416 from the IDCT buffer based on the MS bit pattern sequence 412 . Because the MC buffer and the IDCT buffer send data that has bit pattern sequences that are generated by MS address generators that has the same timing, albeit different bit patterns, the MS module only needs one counter to handle data from each buffer. Based on the counter and the conditions (e.g. different modes) and flags decoded from the bitstream, the MS address generator swaps the bits to generate different patterns for both the IDCT buffer and the MC buffer. Thus, MS module 402 needs only one MS address generator to handle data from both the MC buffer and the IDCT buffer.
- MS module 402 adds data 408 and 416 together to produce data 414 , which is sent to the DRAM buffer for storage (DRAM buffer is not shown in FIG. 4 ).
- FIG. 5 is a block diagram of an address generator used in certain embodiments of the invention.
- the address generator as shown in FIG. 5 comprises an n-bit counter 502 , and a multiplexer 504 .
- the n-bit counter 502 can generate up to 2 n numbers that are sequential, for example from 0 to 2 n ⁇ 1 with an increment of 1.
- the 2 n numbers can be represented as binary values comprising bits. Each bit has a value of either zero or one. Bits can be swapped to produce up to n! number of bit pattern sequences. Different bit pattern sequences can be used as address pattern sequences that are needed for either IDCT buffer or MC buffer.
- 2 n number of bit pattern sequences are indicated by pattern_ 1 508 , pattern_ 2 510 , up to pattern_ 2 n 512 as shown in FIG. 5 .
- multiplexer 504 which is controlled by an associated controller (not shown in FIG. 5 )
- one of the 2 n number of pattern sequences in FIG. 5 is selected as output 506 .
- Such a selection is based upon the conditions and/or flag information that are carried in the reconstructed data, and which are associated with the video signals.
- output 506 is the one of the bit pattern sequences from pattern_ 1 508 to pattern_ 2 n 512 .
- the counter's value controls the multiplexer 504 for selecting one of the bit pattern sequences from pattern_ 1 508 to pattern_ 2 n 512 as output 506 .
- the output is composed of different ranges of two or more bit pattern sequences from pattern_ 1 508 to pattern_ 2 n 512 .
- bit swapping obviates the need for separate dedicated hardware for producing different bit pattern sequences that can be used in addressing schemes needed for either IDCT buffer or MC buffer.
- FIG. 6 is a block diagram of another variation of an address generator according to certain embodiments.
- the address generator as shown in FIG. 6 comprises an n-bit counter 602 , and two multiplexers 604 , and 606 .
- the n-bit counter 602 can generate up to 2 n numbers that are sequential, for example from 0 to 2 n ⁇ 1 with an increment of 1. Bits can be swapped to produce up to n! number of bit pattern sequences.
- Six bit pattern sequences are shown in FIG. 6 and are indicated by pattern 1 612 , pattern 2 614 , pattern 3 616 , pattern 1 ′ 618 , pattern 2 ′ 620 , and pattern 3 ′ 622 .
- Through multiplexer 604 which is controlled by an associated controller (not shown in FIG.
- one pattern sequence is selected as output 608 from among pattern 1 612 , pattern 2 614 , pattern 3 616 .
- one bit pattern sequence is selected as output 610 from among pattern 1 ′ 618 , pattern 2 ′ 620 , and pattern 3 ′ 622 . Such a selection is based upon the conditions and/or flag information carried in the reconstructed data.
- the address generator of FIG. 6 can produce, using one counter, two output bit pattern sequences simultaneously for use in different addressing schemes for decoding video signals
- the address generator in FIG. 6 is an example of an MS address generator.
- output 608 is a bit pattern sequence associated with the IDCT addressing scheme
- output 610 is a bit pattern sequence that is associated with the MC addressing scheme.
- n-bit counter can generate a sequence of sequential numbers that are expressed as n-bit binary values.
- the n-bit counter can generate up to 2 n memory addresses.
- m b ( m, n ⁇ 1) ⁇ 2 n ⁇ 1 +b ( m, n ⁇ 2) ⁇ 2 n ⁇ 2 + . . . +b ( m , 1) ⁇ 2 1 +b ( m ,0) ⁇ 2 0 EQ-1
- n is the number of bits in the counter
- k is the bit position index in the counter ⁇ 0, 1, 2, . . . n ⁇ 1 ⁇
- i is memory word index ⁇ 0, 1, 2 . . . N ⁇ 1 ⁇
- C ⁇ [ b ⁇ ( 0 , n - 1 ) b ⁇ ( 0 , n - 2 ) ... b ⁇ ( 0 , 1 ) b ⁇ ( 0 , 0 ) b ⁇ ( 1 , n - 1 ) b ⁇ ( 1 , n - 2 ) ... b ⁇ ( 1 , 1 ) b ⁇ ( 1 , n - 2 ) ... b ⁇ ( 1 , 1 ) b ⁇ ( 1 , 0 ) ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... b b ⁇ ( N - 2 , 1 b ⁇ ( N - 2 , 1 ) b ⁇ ( N - 2 , 0 ) b ⁇ ( N - 1 , n - 1 ) b
- ⁇ overscore (B) ⁇ is a matrix of the bit values that correspond to the n sequential numbers.
- ⁇ overscore (B) ⁇ is an N ⁇ n matrix.
- the bit values are binary and therefore comprise either zeros or ones.
- Each column of the ⁇ overscore (B) ⁇ matrix contains N/2 zeroes and N/2 ones.
- the swapping of columns in the ⁇ overscore (B) ⁇ matrix is equivalent to swapping bits in the n-bit counter.
- C ⁇ - C ⁇ 2 s ⁇ [ b ⁇ ( 0 , s ) b ⁇ ( 1 , s ) ... b ⁇ ( N - 2 , s ) b ⁇ ( N - 1 , s ) ] N ⁇ 1 + 2 t ⁇ [ b ⁇ ( 0 , t ) b ⁇ ( 1 , t ) ... b ⁇ ( N - 2 , t ) b ⁇ ( N - 1 , t ) ] N ⁇ 1 - ( 2 s ⁇ [ b ⁇ ( 0 , t ) b ⁇ ( 1 , t ) ... b ⁇ ( N - 2 , t ) b ⁇ ( N - 1 , t ) ] N ⁇ 1 + 2 t ⁇ [ b ⁇ ( 0 , s ) b ⁇ ( 1 , s ) ...
- each rows of ⁇ overscore (C) ⁇ overscore (C) ⁇ ⁇ 0, (2 s ⁇ 2 1 ), ⁇ (2 s ⁇ ⁇ 2 1 ) ⁇ .
- the rows having 0's means that after swapping column s and column t, the rows maintain same values; the rows having (2 s ⁇ 2 1 ) means that after swapping columns, the rows' values added with (2 s ⁇ 2 1 ); the rows having ⁇ (2 s ⁇ 2 1 ) means that after swapping columns, the rows subtracted with ⁇ (2 s ⁇ 2 1 ).
- the pattern of rows being changed is: in the first 2 s rows, skip first 2 1 rows, every other 2 1 rows have negative offset (2 s ⁇ 2 1 ); this pattern mirrors to the second 2 s but the rows had negative offset now have positive offset; this pattern mirrors to the third 2 s rows, in other words, the third 2 s rows are same to the first 2 s rows. It continues until to the last rows.
- FIG. 7 is a block diagram that illustrates the data format in memory. Specifically, the format shown in FIG. 7 is a 4:2:0 chrominance format.
- blocks 704 a , 704 b , 704 c , and 704 d represent the luminance blocks, Y 0 , Y 1 , Y 2 , Y 3 .
- Blocks 704 e , and 704 f represent the chrominance blocks Cb and Cr.
- Blocks 704 a , 704 b , 704 c , 704 d , 704 e , and 704 f make up one macroblock. In each block, each word holds one line or 8 pixels. Each block comprises 8 words.
- bit position display 714 shows the 6 bits of the 6-bit counter.
- the most significant bit (MSB) 3 bits indicate the bits associated with the block_index and the least significant bit (LSB) 3 bits indicate the bits associated with the word_index.
- the block index takes the value of the counter's 3 MSB, i.e., counter [5:3].
- the block index takes the value of the counter's 4 MSB, i.e., counter [6:3]. It is depicted in FIG. 7 in both position and Maroblock/block position as well.
- Word index takes the value of counter's 3 LSB, i.e., counter [2:0]. It is depicted in FIG. 7 in both position and Maroblock/block position as well.
- the description of the block index and word index are similar with respect to all the figures from FIG. 8 to FIG. 20 . Furthermore, the description of the block index and word index are similar with respect to all non-sequential sequences that are generated from the swapped counter bits. For convenience, the description of the block index and word index are not repeated in all the figures.
- FIG. 8 is a block diagram that illustrates three different chrominance formats for a macroblock.
- the format 802 is a 4:2:0 chrominance format
- format 810 is a 4:2:2 chrominance format
- format 820 is a 4:4:4 chrominance format.
- blocks 804 are the luminance blocks and blocks 806 are the chrominance blocks.
- blocks 812 are the luminance blocks and blocks 814 are the chrominance blocks.
- blocks 822 are the luminance blocks and blocks 824 are the chrominance blocks.
- FIG. 9 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format.
- Blocks 906 are the luminance blocks and blocks 908 are the chrominance blocks.
- FIG. 9 also shows the counter bits 902 , which six bits, from bit position [ 5 ] to bit position [ 0 ], are swapped to generate address pattern sequence 904 .
- the six counter bits 902 are rearranged as [ 5 ], [ 4 ], [ 0 ], [ 3 ], [ 2 ], [ 1 ] to generate address pattern sequence 904 .
- Block 910 illustrates the block index and word index of sequence 904 in decimal numbers. Further, FIG.
- FIG. 10 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format.
- Blocks 1006 are the luminance blocks and blocks 1008 are the chrominance blocks.
- FIG. 10 also shows the counter bits 1002 , which six bits, from bit position [ 5 ] to bit position [ 0 ], are swapped to generate address pattern sequence 1004 .
- the six counter bits 1002 are rearranged as [ 5 ], [ 4 ], [ 0 ], [ 3 ], [ 2 ], [ 1 ] to generate address pattern sequence 1004 .
- Block 1010 illustrates the block index and word index of sequence 1004 in decimal numbers.
- FIG. 10 illustrates the block index and word index of sequence 1004 in decimal numbers.
- FIG. 11 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format.
- Blocks 1106 are the luminance blocks and blocks 1108 are the chrominance blocks.
- FIG. 11 also shows the counter bits 1102 , which seven bits, from bit position [ 6 ] to bit position [ 0 ], are swapped to generate address pattern sequence 1104 .
- the seven counter bits 1102 are rearranged as [ 6 ], [ 5 ], [ 4 ], [ 0 ], [ 3 ], [ 2 ], [ 1 ] to generate address pattern sequence 1104 .
- Block 1110 illustrates the block index and word index of sequence 1104 in decimal numbers.
- FIG. 11 illustrates the block index and word index of sequence 1104 in decimal numbers.
- a combination of different bit swap patterns can apply to a sequence in a different data range to create a new non-sequential sequence.
- the data range originally generated by a counter is called data index in the video decoding application.
- FIG. 12 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format.
- Blocks 1206 are the luminance blocks and blocks 1208 are the chrominance blocks.
- FIG. 12 also shows the counter bits 1202 , which bits are swapped to generate address pattern sequence 1204 .
- the following combinational logic is applied to the six counter bits 1202 : [ 4 ], NOT [ 3 ], [ 0 ], [ 2 ], [ 1 ], [ 5 ] to generate address pattern sequence 1204 .
- the following combinational logic is applied to the six counter bits 1202 : NOT [ 4 ], NOT [ 3 ], [ 0 ], [ 2 ], [ 1 ], [ 5 ] to generate address pattern sequence 1204 .
- the six counter bits 1202 are rearranged as: [ 4 ], [ 3 ], [ 0 ], [ 2 ], [ 1 ], [ 5 ] to generate address pattern sequence 1204 .
- Block 1210 illustrates the block index and word index of sequence 1204 in decimal numbers.
- FIG. 13 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format.
- Blocks 1306 are the luminance blocks and blocks 1308 are the chrominance blocks.
- FIG. 13 also shows the counter bits 1302 , which six bits, from bit position [ 5 ] to bit position [ 0 ], are swapped to generate address pattern sequence 1304 .
- the six counter bits 1302 are rearranged as [ 4 ], [ 3 ], [ 0 ], [ 2 ], [ 1 ], [ 5 ], to generate address pattern sequence 1304 .
- Block 1310 illustrates the block index and word index of sequence 1304 in decimal numbers.
- FIG. 13 illustrates the block index and word index of sequence 1304 in decimal numbers.
- FIG. 14 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format.
- Blocks 1406 are the luminance blocks and blocks 1408 are the chrominance blocks.
- FIG. 14 also shows the counter bits 1402 , which seven bits, from bit position [ 6 ] to bit position [ 0 ], are swapped to generate address pattern sequence 1304 .
- the seven counter bits 1402 are rearranged as [ 5 ], [ 4 ], [ 3 ], [ 0 ], [ 2 ], [ 1 ], [ 6 ] to generate address pattern sequence 1404 .
- Block 1410 illustrates the block index and word index of sequence 1404 in decimal numbers.
- FIG. 15 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format.
- Blocks 1506 are the luminance blocks and blocks 1508 are the chrominance blocks.
- FIG. 15 also shows the counter bits 1502 , which bits are swapped to generate address pattern sequence 1504 .
- the six counter bits 1502 are rearranged as: [ 4 ], [ 5 ], [ 0 ], [ 3 ], [ 2 ], [ 1 ] to generate address pattern sequence 1504 .
- the following combinational logic is applied to the six counter bits 1502 : [ 5 ], [ 4 ], [ 0 ], NOT[ 3 ], [ 2 ], [ 1 ] to generate address pattern sequence 1504 .
- the six counter bits 1502 are rearranged as: [ 5 ], [ 4 ], [ 0 ], [ 3 ], [ 2 ], [ 1 ] to generate address pattern sequence 1504 .
- Block 1510 illustrates the block index and word index of sequence 1504 in decimal numbers.
- FIG. 16 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format.
- Blocks 1606 are the luminance blocks and blocks 1608 are the chrominance blocks.
- FIG. 16 also shows the counter bits 1602 , which six bits, from bit position [ 5 ] to bit position [ 0 ], are swapped to generate address pattern sequence 1604 .
- the six counter bits 1602 are rearranged as [ 4 ], [ 5 ], [ 0 ], [ 3 ], [ 2 ], [ 1 ] to generate address pattern sequence 1604 .
- Block 1610 illustrates the block index and word index of sequence 1604 in decimal numbers.
- FIG. 17 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format.
- Blocks 1706 are the luminance blocks and blocks 1708 are the chrominance blocks.
- FIG. 17 also shows the counter bits 1702 , which bits are swapped to generate address pattern sequence 1704 .
- the seven counter bits 1702 are rearranged as: [ 6 ], [ 5 ], [ 4 ], [ 0 ], [ 3 ], [ 2 ], [ 1 ] to generate address pattern sequence 1704 .
- the seven counter bits 1702 are rearranged as: [ 5 ], [ 4 ], [ 6 ], [ 0 ], [ 3 ], [ 2 ], [ 1 ] to generate address pattern sequence 1704 .
- Block 1710 illustrates the block index and word index of sequence 1704 in decimal numbers.
- FIG. 18 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format.
- Blocks 1806 are the luminance blocks and blocks 1808 are the chrominance blocks.
- FIG. 18 also shows the counter bits 1802 , which bits are swapped to generate address pattern sequence 1804 .
- the six counter bits 1802 are rearranged as: [ 5 ], [ 3 ], [ 0 ], [ 2 ], [ 1 ], [ 4 ] to generate address pattern sequence 1804 .
- the six counter bits 1802 are rearranged as: [ 5 ], [ 4 ], [ 0 ], [ 3 ], [ 2 ], [ 1 ] to generate address pattern sequence 1804 .
- Block 1810 illustrates the block index and word index of sequence 1804 in decimal numbers.
- FIG. 19 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format.
- Blocks 1906 are the luminance blocks and blocks 1908 are the chrominance blocks.
- FIG. 19 also shows the counter bits 1902 , which six bits, from bit position [ 5 ] to bit position [ 0 ], are swapped to generate address pattern sequence 1904 .
- the six counter bits 1902 are rearranged as [ 5 ], [ 3 ], [ 0 ], [ 2 ], [ 1 ], [ 4 ] to generate address pattern sequence 1904 .
- Block 1910 illustrates the block index and word index of sequence 1604 in decimal numbers.
- FIG. 19 illustrates the block index and word index of sequence 1604 in decimal numbers.
- FIG. 20 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format.
- Blocks 2006 are the luminance blocks and blocks 2008 are the chrominance blocks.
- FIG. 20 also shows the counter bits 2002 , which seven bits, from bit position [ 6 ] to bit position [ 0 ], are swapped to generate address pattern sequence 2004 .
- the seven counter bits 2002 are rearranged as [ 6 ], [ 5 ], [ 3 ], [ 0 ], [ 2 ], [ 1 ], [ 4 ] to generate address pattern sequence 2004 .
- Block 2010 illustrates the block index and word index of sequence 2004 in decimal numbers.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Image Processing (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
A method and apparatus is provided for generating various binary addresses for use in decoding MPEG video data. One or more n-bit counters and mutiplexers are used to generate such binary addresses. Different binary addresses can be generated by the same n-bit counter by swapping the bits of the n-bit counter. The number of different binary addresses that an n-bit counter can generate is n factorial.
Description
- This application is a continuation of application Ser. No. 10/242,320, filed Sep. 11, 2002 and incorporated herein by reference.
- This invention relates to MPEG video technology and, more specifically, to decoding Motion Picture Experts Group (MPEG) video bitstream.
- In MPEG technology, the compressed digital system signal, or bitstream, which includes a video portion, an audio portion, and other informational portions, is transmitted to a receiver. Transmission may be over existing television channels, cable television channels, satellite communication channels, and the like.
- A decoder is provided at the receiver to de-multiplex, decompress and decode the received system signal in accordance with a given compression algorithm. The decoded video and audio information is then output to a display device such as a television monitor for presentation to the user.
- Video and audio compression and encoding is performed by suitable encoders which implement a selected data compression algorithm that conforms to a recognized standard or specification agreed to among the senders and receivers of digital video signals. Highly efficient compression standards have been developed by the Moving Pictures Experts Group (MPEG), including MPEG-1 and MPEG-2. The MPEG standards enable several VCR-like viewing options such as Normal Forward, Play, Slow Forward, Fast Forward, Fast Reverse, and Freeze.
- The MPEG specification defines a hierarchical data structure in the video portion of the bitstream. A video sequence includes a sequence header, one or more groups of pictures, and an end-of-sequence code. A group of pictures is a series of one or more pictures intended to allow random access into the sequence.
- A picture is the primary coding unit of a video sequence. A picture consists of three rectangular matrices representing luminance (Y) and two chrominance (Cb, Cr) values. The Y matrix has an even number of rows and columns. The Cb and Cr matrices are one-half the size of the Y matrix in each direction (horizontal and vertical). Thus, for every four luminance values, there are two associated chrominance values (one Cb value and one Cr value).
- A slice is one or more contiguous macroblocks. Slices are important in the handling of errors. If the bitstream contains an error, the decoder can skip to the start of the next slice.
- A macroblock is a 16×16 line section of luminance components and the corresponding chrominance components. A block is an 8×8 set of values of a luminance or chrominance component.
- The MPEG standard defines three main types of video pictures:
- 1. Intracoded pictures (I-pictures) which are coded without reference to any other pictures.
- 2. Predictive-coded pictures (P-pictures) which are coded using motion-compensated forward prediction from a previous I or P reference picture.
- 3. Bidirectional predictive-coded pictures (B-pictures) which are coded using interpolated motion compensation from a previous and a future I or P picture.
- I pictures are coded using only the Discrete Cosine Transform (DCT) which converts time and space domain into frequency and amplitude domain for the purpose of achieving data compression.
- The macroblock is the basic motion compensation unit for P and B pictures. Each macroblock is coded by computing a motion compensation vector which defines the displacement between the macroblock, and the corresponding macroblock in the reference I or P picture(s) from which it is being predicted. If there is little or no motion, the motion compensation vector will not be transmitted.
- A comparison macroblock is then generated by displacing the reference macroblock by the amount indicated by the motion compensation vector, which is then subtracted from the macroblock of the P or B picture that is being coded to produce an error signal which corresponds to the difference therebetween. The error signal is then coded using DCT (similar to an intracoded picture) and transmitted with the motion vector. If, however, the error signal is small or zero, no error component is transmitted.
- Thus, a predictive coded macroblock (P or B) can consist of only a motion compensation component, only a transform (DCT) coded component, or both.
- After motion compensation and DCT coding are performed, the macroblock is quantized, and Variable Length Coded (VLC) to further compress the data bitstream. The macroblocks are then assembled into slices, pictures, groups of pictures and video sequences, multiplexed with associated audio data, and transmitted to a user for decoding and presentation.
- The basic idea behind MPEG video compression is to remove spatial redundancy within a video frame and temporal redundancy between video frames. As in JPEG, the standard for still image compression, DCT-based (Discrete Cosine Transform) compression is used to reduce spatial redundancy. Motion-compensation is used to exploit temporal redundancy. The images in a video stream usually do not change much within small time intervals. The idea of motion-compensation is to encode a video frame based on other video frames temporally close to it.
- A video stream is a sequence of video frames. Each frame is a still image. A video player displays one frame after another, usually at a rate close to 30 frames per second (23.976, 24, 25, 29.97, 30).
- Frames are digitized in a standard RGB format, 24 bits per pixel (8 bits each for Red, Green, and Blue). MPEG-1 is designed to produce bit rates of 1.5 Mb/s or less, and is intended to be used with images of size 352×288 at 24-30 frames per second. This results in data rates of 55.7-69.6 Mb/s.
- Frames are divided into 16×16 pixel macroblocks. Each macroblock consists of four 8×8 luminance blocks and two 8×8 chrominance blocks(1 U and 1 V). Macroblocks are the units for motion-compensated compression. Blocks are used for DCT compression. Frames can be encoded in three types: intra-frames (I-frames), forward predicted frames (P-frames), and bi-directional predicted frames (B-frames).
- An MPEG-1 video sequence is an ordered stream of bits, with a special bit pattern sequences marking the beginning and ending of a logical section.
- Typically, in real-time MPEG video decoders, which are used in today's set-top boxes or DVD players, a decoding algorithm in application-specific integrated circuits (ASIC's) is implemented. In such cases, key functional operations such as Variable Length Decoding (VLD), Inverse Zig-Zag Scan (IZZ), Inverse Quantization (IQ), Inverse Discrete Cosine Transform (IDCT), Motion Compensation (MC) and Merge and Store (MS) are mapped to dedicated hardware, herein referred to as application specific integrated circuits (ASICs). In one approach, the MPEG bitstream that is to be decoded is stored in a DRAM buffer in a decoder system. The MPEG bitstream that is to be decoded is herein referred to as “bitstream”.
-
FIG. 1 is a simplified block diagram that illustrates some components of a typical MPEG-2 video bitstream decoder core. InFIG. 1 , reconstructeddata 102 is the bitstream that is to be decoded and is shown as an input into the dynamic random access memory (DRAM)interface 104.DRAM interface 104 is communicatively coupled toDRAM buffer 106,MC module 108, VLD/IZZ/Q module 114 andMS module 112. In addition,MC module 108 is communicatively coupled toMC buffer 110, which in turn is communicatively coupled toMS module 112. VLD/IZZ/IQ module 114 is communicatively coupled toIDCT module 116, which in turn is communicatively coupled toIDCT buffer 118. - The data and data paths referred to herein are associated with
reconstructed data 102. There are two main data paths for decoding reconstructed data 102: 1) one data path is for spatial data reconstruction, and 2) one data path is for temporal data reconstruction. The spatial data path goes through the VLD/IZZ/IQ module 114 andIDCT module 116, and the resulting data is written intoIDCT buffer 118. The temporal data path, which comprisesMC module 108, gets reference data from previously reconstructed data stored in memory. The resulting data coming out ofMC module 108 is written toMC buffer 110. - In the final steps of data reconstruction,
MS module 112 performs the following: 1) reads in spatial data from the IDCT buffer and reads in temporal data from the MC buffer, 2) adds the data that is read from the MC buffer to the data that is read from the IDCT buffer to produce a combined data set of reconstructed data, and 3) writes the combined data set toDRAM buffer 106 where the reconstructed data is stored. - All the above operations involve data fetch and store in different addressing schemes. The spatial data path is block based or 8×8 based, while the temporal data path is macroblock based or 16×16 based or 16×8 based. Thus, the MS module handles both block based and macroblock based addressing schemes when adding spatial and temporal data together. In addition, there are many flags in the bitstream which make the IDCT/MC buffer accessing mechanism quite complicated.
- In one approach, the ASIC implementation of MPEG video decoding, such as the decoding performed by VLD/IZZ/IQ, IDCT, MC and MS modules, is designed using a pipeline architecture. In a pipeline architecture, the IDCT buffer and the MC buffer require different read/write address pattern sequences. Traditionally, each buffer has its own associated address generator in order to simultaneously facilitate data access. The drawback of pipeline architecture is more hardware consumption, which in turn consumes more power.
- Therefore, in past approaches, decoders require a large amount of hardware in terms of gate count and power consumption. Because of the higher level of logic complexity, the effort required to test and debug a decoder is also large. Also, the different addressing schemes of each data path in the decoding process require different types address generators.
- Based on the foregoing, there is a need for a method or mechanism for unifying addressing schemes used in MPEG decoding.
- A mechanism is provided for decoding video signals. According to one aspect of the invention, an n-bit counter is used to generate up to n factorial (n!) number of distinct bit pattern sequences. One or more of the distinct n! number of bit sequences are selected to create corresponding one or more addressing schemes. The data that is associated with the video signals are fetched and stored using the one or more addressing schemes. The one or more addressing schemes are based on corresponding one or more flags and condition that are associated with data.
- According to one feature of the invention, the n-bit counter is used to produce a first sequence of 2n sequential numbers, wherein each of the 2n sequential numbers is associated with a distinct binary value comprising n bits. An mth pair of bits in each binary value is swapped to produce a (m+1)th sequence of 2n number of non-sequential numbers, wherein m equals (n!−1). According to another feature, one or more multiplexers are used to select the one or more n! number of distinct bit pattern sequences.
- According to another feature of the invention, when the mth pair of bits in each binary value is swapped, a pre-determined combinational logic is applied to the swapped bits.
- According to one feature of the invention, the logic of an address generator is simplified by using an n-bit counter, which is the simplest sequence generator, and by swapping bits. Thus, hardware cost is reduced.
- The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements and in which:
-
FIG. 1 is a simplified block diagram that illustrates some components of a typical MPEG-2 video bitstream decoder core; -
FIG. 2 is a simplified block diagram that illustrates some key components that replace the IDCT module and IDCT buffer ofFIG. 1 ; -
FIG. 3 is a simplified block diagram that illustrates some key components that replace the MC module and MC buffer ofFIG. 1 ; -
FIG. 4 is a simplified block diagram that illustrates some key components that replace the MS module ofFIG. 1 ; -
FIG. 5 is a block diagram of an address generator used in certain embodiments of the invention; -
FIG. 6 is a block diagram of another variation of an address generator according to certain embodiments of the invention; -
FIG. 7 is a block diagram that illustrates the data format in memory; -
FIG. 8 is a block diagram that illustrates three different chrominance formats for a macroblock; -
FIG. 9 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format; -
FIG. 10 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format; -
FIG. 11 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format; -
FIG. 12 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format; -
FIG. 13 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format; -
FIG. 14 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format; -
FIG. 15 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format; -
FIG. 16 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format; -
FIG. 17 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format; -
FIG. 18 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format; -
FIG. 19 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format; and -
FIG. 20 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format. - A method and system are described for decoding MPEG video bitstream. In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the present invention.
- The decoding process as performed by the
IDCT module 116,IDCT buffer 118,MC module 108,MC buffer 110 andMS module 112 are described herein with reference toFIG. 1 ,FIG. 2 ,FIG. 3 andFIG. 4 . Referring toFIG. 1 , DRAM buffer is partitioned for constructed (bitstream) data and reconstructed (decoded data) data. Constructeddata 102 is stored in theDRAM buffer 106 throughDRAM interface 104 and is fed to VLD/IZZ/IQ module 114 andIDCT module 116 throughDRAM interface 104 for decoding. TheIDCT module 116 processes macroblock data that is associated with constructeddata 102. After processing,IDCT module 116 writes the macroblock data toIDCT buffer 118 based on coded block pattern. Any current non-coded block in the IDCT buffer will maintain the value of the previous coded block value. Reconstructed data fromDRAM buffer 106 are also fed toMC module 108. If motion compensation exists in the macroblock data that is associated with constructeddata 102, thenMC module 108 retrieves reference data, which is previously reconstructed data that is stored inDRAM buffer 106.MC module 108 processes the macroblock data and writes the macroblock data toMC buffer 110. -
MS module 112 reads the macroblock data fromIDCT buffer 118 and fromMC buffer 110 and adds the macroblock data together before sending the resulting macroblock data back toDRAM buffer 106. - The decoding process performed by
IDCT buffer 118,MC buffer 110 andMS module 112 involve multiple read/write events. Each read/write event is associated with a distinct bit pattern sequence based on the different motion compensation modes and residue modes present in the constructed data. In addition, the read/write events are also based on the conditions and/or flags that are associated with the constructed data that is to be decoded. Such conditions and flags are decoded before reconstructing each macroblock of data. Examples of typical motion compensation modes are: 1) frame, 2) field, 3) 8×16, and 4) dual prime. Typical residue modes are: 1) frame, and 2) field. Different read/write address pattern sequences are associated with each mode. - According to certain embodiments of the invention, rather than using several mechanisms to perform the different read/write address pattern sequences associated with each mode, a single unified mechanism is provided to perform the different read/write sequences as performed by
IDCT buffer 118,MC buffer 1110 andMS module 112. - Some of the important details of the unified mechanism for performing the different read/write sequences, according to certain embodiments of the invention, are described herein with reference to
FIG. 2 ,FIG. 3 andFIG. 4 . According to certain embodiments, the unified mechanism for performing the different read/write address pattern sequences is based on using the same type of address generator in the IDCT, MC and MS modules. The address generators use a bit swapping technique for generating the different read/write address pattern sequences and are further described in greater detail herein. -
FIG. 2 is a simplified block diagram that illustrates some key components that replaceIDCT module 116 andIDCT buffer 118 ofFIG. 1 . InFIG. 2 ,data 202 from VLD/IZZ/IQ module feeds intoIDCT controller 204.IDCT controller 204 is a controller that is associated with theIDCT address generator 206 and is thus communicatively coupled withIDCT address generator 206.IDCT address generator 206 is communicatively coupled to theIDCT buffer 208. The IDCT buffer receives abit pattern sequence 212 from an MS module (not shown inFIG. 2 ) and sendsdata 210 to the MS module. The function ofIDCT address generator 206 is further described in greater detail herein under the section ADDRESS GENERATORS. -
FIG. 3 is a simplified block diagram that illustrates some key components that replaceMC module 108 andMC buffer 110 ofFIG. 1 . InFIG. 3 , reconstructeddata 102 from DRAM buffer feeds intoMC controller 302.MC controller 302 is a controller that is associated with theMC address generator 304 and is thus communicatively coupled withMC address generator 304.MC address generator 304 is communicatively coupled to theMC buffer 306.MC buffer 306 receives abit pattern sequence 310 from the MS module (not shown inFIG. 2 ) and sendsdata 308 to the MS module. The function ofMC address generator 304 is further described in greater detail herein under the section ADDRESS GENERATOR. -
FIG. 4 is a simplified block diagram that illustrates some key components that replaceMS module 112 ofFIG. 1 . InFIG. 4 ,MS module 402 comprisesMS controller 404 that is communicatively coupled toMS address generator 406.MS controller 404 controlsMS address generator 406. TheMS address generator 406 sends abit pattern sequence 410 to the MC buffer (not shown inFIG. 4 ). Also,MS address generator 406 sendsbit pattern sequence 412 to the IDCT buffer (not shown inFIG. 4 ). The function ofMS address generator 406 is further described in greater detail herein under the section ADDRESS GENERATOR. - Further,
MS module 402 receivesdata 408 from the MC buffer based on the MSbit pattern sequence 410 anddata 416 from the IDCT buffer based on the MSbit pattern sequence 412. Because the MC buffer and the IDCT buffer send data that has bit pattern sequences that are generated by MS address generators that has the same timing, albeit different bit patterns, the MS module only needs one counter to handle data from each buffer. Based on the counter and the conditions (e.g. different modes) and flags decoded from the bitstream, the MS address generator swaps the bits to generate different patterns for both the IDCT buffer and the MC buffer. Thus,MS module 402 needs only one MS address generator to handle data from both the MC buffer and the IDCT buffer. - As shown in
FIG. 4 ,MS module 402 addsdata data 414, which is sent to the DRAM buffer for storage (DRAM buffer is not shown inFIG. 4 ). - Address Generator
-
FIG. 5 is a block diagram of an address generator used in certain embodiments of the invention. The address generator as shown inFIG. 5 comprises an n-bit counter 502, and amultiplexer 504. The n-bit counter 502 can generate up to 2n numbers that are sequential, for example from 0 to 2n −1 with an increment of 1. The 2n numbers can be represented as binary values comprising bits. Each bit has a value of either zero or one. Bits can be swapped to produce up to n! number of bit pattern sequences. Different bit pattern sequences can be used as address pattern sequences that are needed for either IDCT buffer or MC buffer. - In
FIG. 5 , 2n number of bit pattern sequences are indicated bypattern_1 508,pattern_2 510, up topattern_2 n 512 as shown inFIG. 5 . Throughmultiplexer 504, which is controlled by an associated controller (not shown inFIG. 5 ), one of the 2n number of pattern sequences inFIG. 5 is selected asoutput 506. Such a selection is based upon the conditions and/or flag information that are carried in the reconstructed data, and which are associated with the video signals. In such a case,output 506 is the one of the bit pattern sequences frompattern_1 508 topattern_2 n 512. Further, the counter's value controls themultiplexer 504 for selecting one of the bit pattern sequences frompattern_1 508 to pattern_2 n 512 asoutput 506. In such case, the output is composed of different ranges of two or more bit pattern sequences frompattern_1 508 topattern_2 n 512. - When bits are swapped, the resulting output will no longer remain sequential. Each time the bits are swapped, a new bit pattern sequence is generated. Since n-
bit counter 502 has n bits and each bit can be in any position, the total number of possible bit pattern sequences is n! bit pattern sequences. Thus, bit swapping obviates the need for separate dedicated hardware for producing different bit pattern sequences that can be used in addressing schemes needed for either IDCT buffer or MC buffer. - To illustrate, for a 4:2:0 chrominance mode, there are 48 words (6 blocks×8 words=48, each word=8 pixels) in one macroblock. A 6-bit counter is needed to generate 48 bits with sequential values from 0 to 47. The different bit pattern sequences can be generated through the multiplexer by swapping the bits.
-
FIG. 6 is a block diagram of another variation of an address generator according to certain embodiments. The address generator as shown inFIG. 6 comprises an n-bit counter 602, and twomultiplexers bit counter 602 can generate up to 2n numbers that are sequential, for example from 0 to 2n −1 with an increment of 1. Bits can be swapped to produce up to n! number of bit pattern sequences. Six bit pattern sequences are shown inFIG. 6 and are indicated bypattern1 612,pattern2 614,pattern3 616, pattern1′ 618, pattern2′ 620, and pattern3′ 622. Throughmultiplexer 604, which is controlled by an associated controller (not shown inFIG. 6 ), one pattern sequence is selected asoutput 608 from amongpattern1 612,pattern2 614,pattern3 616. Similarly, throughmultiplexer 606, one bit pattern sequence is selected asoutput 610 from among pattern1′ 618, pattern2′ 620, and pattern3′ 622. Such a selection is based upon the conditions and/or flag information carried in the reconstructed data. - Thus, because the address generator of
FIG. 6 can produce, using one counter, two output bit pattern sequences simultaneously for use in different addressing schemes for decoding video signals, the address generator inFIG. 6 is an example of an MS address generator. InFIG. 6 ,output 608 is a bit pattern sequence associated with the IDCT addressing scheme andoutput 610 is a bit pattern sequence that is associated with the MC addressing scheme. - The use of an n-bit counter to produce up to n! pattern sequences is based on the mathematical model as described herein. An n-bit counter can generate a sequence of sequential numbers that are expressed as n-bit binary values. The n-bit counter can generate up to 2n memory addresses.
- If mth sequential number produced by the counter may be expressed by the following equation,
m=b(m, n−1)·2n−1 +b(m, n−2)·2n−2 + . . . +b(m, 1)·21 +b(m,0)·20 EQ-1 - where,
- n is the number of bits in the counter
- N=2n is the number memory addresses that the counter can generate
- k is the bit position index in the counter {0, 1, 2, . . . n−1}
- i is memory word index {0, 1, 2 . . . N−1}
- b(i, k), where k={0, 1, 2, . . . n−1}, i={0, 1, 2 . . . , N−1}, represents the set of coefficients in an equation (similar to EQ-1) that represents the ith sequential number produced by the counter
- The mth sequential number produced by the counter may also be expressed as vector as follows,
- Thus, the set of sequential numbers that can be generated by a n-bit counter may be expressed as the vector, {overscore (C)}, as follows:
- In EQ-4, {overscore (B)} is a matrix of the bit values that correspond to the n sequential numbers. Thus, {overscore (B)} is an N×n matrix. The bit values are binary and therefore comprise either zeros or ones. Each column of the {overscore (B)} matrix contains N/2 zeroes and N/2 ones. Thus, by swapping of one column with another within the {overscore (B)} matrix will produce a non-repeating sequence of numbers when {overscore (B)}·{overscore (E)}. The swapping of columns in the {overscore (B)} matrix is equivalent to swapping bits in the n-bit counter.
- The mathematical expression that is associated with bit swapping is further detailed by the following equations:
- Similar with vector {overscore (C)}, here is the expression of vector {overscore (C)},
- The relationship between the original sequence of sequential numbers generated by the n-bit counter and the subsequent sequence of numbers that is generated by swapping bits is as follows:
From EQ-8 and EQ-10, there are three vectors {overscore (C)}1, {overscore (C)}3, {overscore (C)}5 in both {overscore (C)} and {overscore (C)}. To compare the difference of these two vectors, we do the followings,
Let's stop here and have a more close look at each column of {overscore (B)}. For the column k (k is the column index), value transition(0-1-0) is every each 2k rows. It is known the total rows are 2n . If the consecutive 0's or 1's are called group, then the number of groups G in one column has the following equations,
G·2k=2n EQ-13
G=2n−k EQ-14
The smaller column index, the more groups in one column.
For the column s and column t(s>t), their total rows are equal, so the group ratio can be get from following equations,
In other words, in each zero group or one group of column s, there are 2s−1 zero group and one group in column t, the number of zero group, and the number of one group are same, each is 2s−t−1. From EQ-12, inside the matrix is that column t is subtracted from column s. The results are either 0, −1 or 1. So each rows of {overscore (C)}−{overscore (C)}={0, (2s−21), −(2s−−21)}. The rows having 0's means that after swapping column s and column t, the rows maintain same values; the rows having (2s−21) means that after swapping columns, the rows' values added with (2s−21); the rows having −(2s−21) means that after swapping columns, the rows subtracted with −(2s−21).
Let's take a more close look at column s and column t. - Based above analysis of column s and column t, continuously derive equation EQ-12 as following in EQ-17,
From EQ-17, the number of −1's and 1's are same, equal
the number of 0's are
−1's, 1's and 0's add together to make N. Corresponding to those rows of 0's, the rows maintain same after swapping columns s and t; corresponding to those rows of −1's, offset (2s−21) will be taken and compensated to those rows of 1's. Overall are balanced. All the value of rows still in the range from 0 toN− 1.
Based on above proof of this mathematical model, the conclusion can be made: for the matrix
{overscore (C)}={overscore (B)}·{overscore (E)}
swapping any two columns s and t of matrix {overscore (B)}, the result of matrix {overscore (C)} have this character: N/2 of its columns remain same, N/4 of its columns offset −(2s−21), and (2s−21) compensate to the another N/4 rows. The pattern of rows being changed is: in the first 2s rows, skip first 21 rows, every other 21 rows have negative offset (2s−21); this pattern mirrors to the second 2s but the rows had negative offset now have positive offset; this pattern mirrors to the third 2s rows, in other words, the third 2s rows are same to the first 2s rows. It continues until to the last rows. Here
It can be seen from above, if swap any columns of {overscore (B)}, another new vector of {overscore (C)} can be generated with above mentioned characters. So to generate a new vector {overscore (C)} the maximum patterns are n!, since there are n! ways of positioning each columns of {overscore (B)}.
Bit Swappping - For the purpose of explanation, assume a 4-bit counter. The {overscore (B)} matrix for a 4-bit counter is of size 16×4 and appears as follows:
col0 col1 col2 col3
If {overscore (C)} represents the sequential numbers that can be produced by the 4-bit counter, then {overscore (C)}=0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15. The swapping of column 0 (col0)and column 3 (col3) in matrix {overscore (B)} is equivalent to swapping bits in the 4-bit counter as previously explained herein. By swapping ofcolumn 0 andcolumn 3 in matrix {overscore (B)}, a new sequence of numbers is produced. If {overscore (C)}′ represents the new sequence of numbers, then {overscore (C)}′=0, 8, 2, 10, 4, 12, 6, 14, 1, 9, 3, 11, 5, 13, 7, 15.
Thus, {overscore (C)}={overscore (B)}·{overscore (E)} appears as follows: - If {overscore (B)}′ represents the matrix {overscore (B)} after swapping
column 0 andcolumn 3 in matrix {overscore (B)}, then {overscore (C)}′={overscore (B)}′·{overscore (E)} appears as follows:
Memory Content and Address Pattern Sequences -
FIG. 7 is a block diagram that illustrates the data format in memory. Specifically, the format shown inFIG. 7 is a 4:2:0 chrominance format. InFIG. 7 , blocks 704 a, 704 b, 704 c, and 704 d represent the luminance blocks, Y0, Y1, Y2, Y3.Blocks Blocks FIG. 7 needs a 6-bit counter in order to generate 48 addresses (a 6-bit counter can generate up to 26 addresses). Further, inFIG. 7 ,bit position display 714 shows the 6 bits of the 6-bit counter. Inbit position display 714, the most significant bit (MSB) 3 bits indicate the bits associated with the block_index and the least significant bit (LSB) 3 bits indicate the bits associated with the word_index. - The block index takes the value of the counter's 3 MSB, i.e., counter [5:3]. In the 4:4:4 format, the block index takes the value of the counter's 4 MSB, i.e., counter [6:3]. It is depicted in
FIG. 7 in both position and Maroblock/block position as well. - Word index takes the value of counter's 3 LSB, i.e., counter [2:0]. It is depicted in
FIG. 7 in both position and Maroblock/block position as well. - The description of the block index and word index are similar with respect to all the figures from
FIG. 8 toFIG. 20 . Furthermore, the description of the block index and word index are similar with respect to all non-sequential sequences that are generated from the swapped counter bits. For convenience, the description of the block index and word index are not repeated in all the figures. -
FIG. 8 is a block diagram that illustrates three different chrominance formats for a macroblock. InFIG. 8 , theformat 802 is a 4:2:0 chrominance format,format 810 is a 4:2:2 chrominance format, andformat 820 is a 4:4:4 chrominance format. In the 4:2:0 chrominance format, blocks 804 are the luminance blocks and blocks 806 are the chrominance blocks. In the 4:2:2 chrominance format, blocks 812 are the luminance blocks and blocks 814 are the chrominance blocks. Similarly, in the 4:4:4 chrominance format, blocks 822 are the luminance blocks and blocks 824 are the chrominance blocks. -
FIG. 9 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format.Blocks 906 are the luminance blocks and blocks 908 are the chrominance blocks.FIG. 9 also shows thecounter bits 902, which six bits, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 904. Thus, the sixcounter bits 902 are rearranged as [5], [4], [0], [3], [2], [1] to generateaddress pattern sequence 904.Block 910 illustrates the block index and word index ofsequence 904 in decimal numbers. Further,FIG. 9 shows the following:address[5] <= counter[5]; address[4] <= counter[4]; address[3] <= counter[0]; address[2] <= counter[3]; address[1] <= counter[2]; address[0] <= counter[1]. -
FIG. 10 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format.Blocks 1006 are the luminance blocks and blocks 1008 are the chrominance blocks.FIG. 10 also shows thecounter bits 1002, which six bits, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 1004. Thus, the sixcounter bits 1002 are rearranged as [5], [4], [0], [3], [2], [1] to generateaddress pattern sequence 1004.Block 1010 illustrates the block index and word index ofsequence 1004 in decimal numbers. Thus,FIG. 10 shows the following:address[5] <= counter[5]; address[4] <= counter[4]; address[3] <= counter[0]; address[2] <= counter[3]; address[1] <= counter[2]; address[0] <= counter[1]. -
FIG. 11 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format.Blocks 1106 are the luminance blocks and blocks 1108 are the chrominance blocks.FIG. 11 also shows thecounter bits 1102, which seven bits, from bit position [6] to bit position [0], are swapped to generateaddress pattern sequence 1104. Thus, the sevencounter bits 1102 are rearranged as [6], [5], [4], [0], [3], [2], [1] to generateaddress pattern sequence 1104.Block 1110 illustrates the block index and word index ofsequence 1104 in decimal numbers. Thus,FIG. 11 shows the following:address[6] <= counter[6]; address[5] <= counter[5]; address[4] <= counter[4]; address[3] <= counter[0]; address[2] <= counter[3]; address[1] <= counter[2]; address[0] <= counter[1]. - A combination of different bit swap patterns can apply to a sequence in a different data range to create a new non-sequential sequence. In the
FIG. 12 ,FIG. 15 andFIG. 17 , the data range originally generated by a counter is called data index in the video decoding application. -
FIG. 12 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format.Blocks 1206 are the luminance blocks and blocks 1208 are the chrominance blocks.FIG. 12 also shows thecounter bits 1202, which bits are swapped to generateaddress pattern sequence 1204. InFIG. 12 , four different bit swap patterns apply to four ranges of sequential sequences generated by a counter. The four ranges are block_index=3, block_index=4, block_index=5 and the remaining, block_index=1, 2, 6. - When
counter bits 1202 are in the block_index=3, the sixcounter bits 1202, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 1204. The following combinational logic is applied to the six counter bits 1202: NOT [4], NOT [3], [0], [2], [1], NOT [5] to generateaddress pattern sequence 1204. - When
counter bits 1202 are in the block_index=4, the sixcounter bits 1202, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 1204. The following combinational logic is applied to the six counter bits 1202: [4], NOT [3], [0], [2], [1], [5] to generateaddress pattern sequence 1204. - When
counter bits 1202 are in the block_index=5, the sixcounter bits 1202, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 1204. The following combinational logic is applied to the six counter bits 1202: NOT [4], NOT [3], [0], [2], [1], [5] to generateaddress pattern sequence 1204. - When
counter bits 1202 are in the block_index=1, 2, 6, the sixcounter bits 1202, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 1204. The sixcounter bits 1202 are rearranged as: [4], [3], [0], [2], [1], [5] to generateaddress pattern sequence 1204. -
Block 1210 illustrates the block index and word index ofsequence 1204 in decimal numbers. - Thus, with respect to
FIG. 12 , the following combinational logic applies:if (counter[5:3]=“011”) // block_index=3 address[5] <= not counter[4]; address[4] <= not counter[3]; address[3] <= counter[0]; address[2] <= counter[2]; address[1] <= counter[1]; address[0] <= not counter[5]; else if (counter[5:3]=“100”) // block_index=4 address[5] <= counter[4]; address[4] <= not counter[3]; address[3] <= counter[0]; address[2] <= counter[2]; address[1] <= counter[1]; address[0] <= counter[5]; else if (counter[5:3]=“101”) // block_index=5 address[5] <= not counter[4]; address[4] <= not counter[3]; address[3] <= counter[0]; address[2] <= counter[2]; address[1] <= counter[1]; address[0] <= counter[5]; else address[5] <= counter[4]; address[4] <= counter[3]; address[3] <= counter[0]; address[2] <= counter[2]; address[1] <= counter[1]; address[0] <= counter[5]; -
FIG. 13 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format.Blocks 1306 are the luminance blocks and blocks 1308 are the chrominance blocks.FIG. 13 also shows thecounter bits 1302, which six bits, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 1304. Thus, the sixcounter bits 1302 are rearranged as [4], [3], [0], [2], [1], [5], to generateaddress pattern sequence 1304.Block 1310 illustrates the block index and word index ofsequence 1304 in decimal numbers. Thus,FIG. 13 shows the following:address[5] <= counter[4]; address[4] <= counter[3]; address[3] <= counter[0]; address[2] <= counter[2]; address[1] <= counter[1]; address[0] <= counter[5]. -
FIG. 14 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format.Blocks 1406 are the luminance blocks and blocks 1408 are the chrominance blocks.FIG. 14 also shows thecounter bits 1402, which seven bits, from bit position [6] to bit position [0], are swapped to generateaddress pattern sequence 1304. Thus, the sevencounter bits 1402 are rearranged as [5], [4], [3], [0], [2], [1], [6] to generateaddress pattern sequence 1404.Block 1410 illustrates the block index and word index ofsequence 1404 in decimal numbers. Thus,FIG. 14 shows the following:address[6] <= counter[5]; address[5] <= counter[4]; address[4] <= counter[3]; address[3] <= counter[0]; address[2] <= counter[2]; address[1] <= counter[1]; address[0] <= counter[6]. -
FIG. 15 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format.Blocks 1506 are the luminance blocks and blocks 1508 are the chrominance blocks.FIG. 15 also shows thecounter bits 1502, which bits are swapped to generateaddress pattern sequence 1504. InFIG. 15 , three different bit swap patterns apply to three ranges of sequential sequences generated by a counter. The three ranges are block_index=2, block_index=3, 4, and the remaining, block_index=1, 5, 6. - When
counter bits 1502 are in the block_index=2, the sixcounter bits 1502, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 1504. The sixcounter bits 1502 are rearranged as: [4], [5], [0], [3], [2], [1] to generateaddress pattern sequence 1504. - When
counter bits 1502 are in the block_index=3, 4, the sixcounter bits 1502, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 1504. The following combinational logic is applied to the six counter bits 1502: [5], [4], [0], NOT[3], [2], [1] to generateaddress pattern sequence 1504. - When
counter bits 1502 are in the block_index=1, 5, 6, the sixcounter bits 1502, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 1504. The sixcounter bits 1502 are rearranged as: [5], [4], [0], [3], [2], [1] to generateaddress pattern sequence 1504. -
Block 1510 illustrates the block index and word index ofsequence 1504 in decimal numbers. - Thus, with respect to
FIG. 15 , the following logic applies:if (counter[5:3]=“010”) // block_index=2 address[5] <= counter[4]; address[4] <= counter[5]; address[3] <= counter[0]; address[2] <= counter[3]; address[1] <= counter[2]; address[0] <= counter[1]; else if (counter[5:3]=“011” or counter[5:3]=“100”) // block_index=3,4 address[5] <= counter[5]; address[4] <= counter[4]; address[3] <= counter[0]; address[2] <= not counter[3]; address[1] <= counter[2]; address[0] <= counter[1]; else // block_index=1,5,6 address[5] <= counter[5]; address[4] <= counter[4]; address[3] <= counter[0]; address[2] <= counter[3]; address[1] <= counter[2]; address[0] <= counter[1]. -
FIG. 16 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format.Blocks 1606 are the luminance blocks and blocks 1608 are the chrominance blocks.FIG. 16 also shows thecounter bits 1602, which six bits, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 1604. Thus, the sixcounter bits 1602 are rearranged as [4], [5], [0], [3], [2], [1] to generateaddress pattern sequence 1604.Block 1610 illustrates the block index and word index ofsequence 1604 in decimal numbers. Thus,FIG. 16 shows the following:address[5] <= counter[4]; address[4] <= counter[5]; address[3] <= counter[0]; address[2] <= counter[3]; address[1] <= counter[2]; address[0] <= counter[1]. -
FIG. 17 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format.Blocks 1706 are the luminance blocks and blocks 1708 are the chrominance blocks.FIG. 17 also shows thecounter bits 1702, which bits are swapped to generateaddress pattern sequence 1704. InFIG. 17 , three different bit swap patterns apply to three ranges of sequential sequence generated by a counter. The three ranges are block_index=6, 7, 8, 9, block-index=10, 11, and the remaining, block-index=1, 2, 3, 4, 5. - When
counter bits 1702 are in the block_index=6, 7, 8, 9, the sevencounter bits 1702, from bit position [6] to bit position [0], are swapped to generateaddress pattern sequence 1704. The following combinational logic is applied to the seven counter bits 1702: NOT[6], NOT[5], NOT[4], [0], [3], [2], [1] to generateaddress pattern sequence 1704. - When
counter bits 1702 are in the block_index=10, 11, the sevencounter bits 1702, from bit position [6] to bit position [0], are swapped to generateaddress pattern sequence 1704. The sevencounter bits 1702 are rearranged as: [6], [5], [4], [0], [3], [2], [1] to generateaddress pattern sequence 1704. - When
counter bits 1702 are in the block_index=1, 2, 3, 4, 5, the sevencounter bits 1702, from bit position [6] to bit position [0], are swapped to generateaddress pattern sequence 1704. The sevencounter bits 1702 are rearranged as: [5], [4], [6], [0], [3], [2], [1] to generateaddress pattern sequence 1704. -
Block 1710 illustrates the block index and word index ofsequence 1704 in decimal numbers. - Thus, with respect to
FIG. 17 , the following logic applies:if (counter[6:4]=“011” or counter[6:4]=“100”) // block_index=6,7,8,9 address[6] <= not counter[6]; address[5] <= not counter[5]; address[4] <= not counter[4]; address[3] <= counter[0]; address[2] <= counter[3]; address[1] <= counter[2]; address[0] <= counter[1]; else if (counter[5:3]=“101”) // block_index=10,11 address[6] <= counter[6]; address[5] <= counter[5]; address[4] <= counter[4]; address[3] <= counter[0]; address[2] <= counter[3]; address[1] <= counter[2]; address[0] <= counter[1]; else // block_index=1,2,3,4,5 address[6] <= counter[5]; address[5] <= counter[4]; address[4] <= counter[6]; address[3] <= counter[0]; address[2] <= counter[3]; address[1] <= counter[2]; address[0] <= counter[1]; -
FIG. 18 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:0 chrominance format.Blocks 1806 are the luminance blocks and blocks 1808 are the chrominance blocks.FIG. 18 also shows thecounter bits 1802, which bits are swapped to generateaddress pattern sequence 1804. InFIG. 18 , two different bit swap patterns apply to two ranges of sequential sequences generated by a counter. The two ranges are block_index=0, 1, 2, 3, and the remaining, block_index=5, 6. - When
counter bits 1802 are in the block_index=0, 1, 2, 3, the sixcounter bits 1802, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 1804. The sixcounter bits 1802 are rearranged as: [5], [3], [0], [2], [1], [4] to generateaddress pattern sequence 1804. - When
counter bits 1802 are in the block_index=5, 6, the sixcounter bits 1802, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 1804. The sixcounter bits 1802 are rearranged as: [5], [4], [0], [3], [2], [1] to generateaddress pattern sequence 1804. -
Block 1810 illustrates the block index and word index ofsequence 1804 in decimal numbers. - Thus, with respect to
FIG. 18 , the following logic applies:if (counter[5]=“0”) // block_index=0,1,2,3 address[5] <= counter[5]; address[4] <= counter[3]; address[3] <= counter[0]; address[2] <= counter[2]; address[1] <= counter[1]; address[0] <= counter[4]; else // block_index=5,6 address[5] <= counter[5]; address[4] <= counter[4]; address[3] <= counter[0]; address[2] <= counter[3]; address[1] <= counter[2]; address[0] <= counter[1]. -
FIG. 19 is a block diagram that illustrates one address pattern sequence that can be used for a 4:2:2 chrominance format.Blocks 1906 are the luminance blocks and blocks 1908 are the chrominance blocks.FIG. 19 also shows thecounter bits 1902, which six bits, from bit position [5] to bit position [0], are swapped to generateaddress pattern sequence 1904. Thus, the sixcounter bits 1902 are rearranged as [5], [3], [0], [2], [1], [4] to generateaddress pattern sequence 1904.Block 1910 illustrates the block index and word index ofsequence 1604 in decimal numbers. Thus,FIG. 19 shows the following:address[5] <= counter[5]; address[4] <= counter[3]; address[3] <= counter[0]; address[2] <= counter[2]; address[1] <= counter[1]; address[0] <= counter[4]. -
FIG. 20 is a block diagram that illustrates one address pattern sequence that can be used for a 4:4:4 chrominance format.Blocks 2006 are the luminance blocks and blocks 2008 are the chrominance blocks.FIG. 20 also shows thecounter bits 2002, which seven bits, from bit position [6] to bit position [0], are swapped to generateaddress pattern sequence 2004. Thus, the sevencounter bits 2002 are rearranged as [6], [5], [3], [0], [2], [1], [4] to generateaddress pattern sequence 2004.Block 2010 illustrates the block index and word index ofsequence 2004 in decimal numbers. Thus,FIG. 20 shows the following:address[6] <= counter[6]; address[5] <= counter[5]; address[4] <= counter[3]; address[3] <= counter[0]; address[2] <= counter[2]; address[1] <= counter[1]; address[0] <= counter[4]. - In the foregoing specification, the invention has been described with reference to specific embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
Claims (20)
1. A method for fetching and storing spatial data, temporal data, and combined data representing a plurality of digital MPEG video frames, the method comprising:
first storing the spatial data;
second storing the temporal data;
third storing the combined data, wherein the combined data comprises the spatial data and the temporal data;
first generating a first non-sequential and distinct digit pattern address sequence to be associated with the spatial data, as well as a first mapping from the spatial data to a distinct first address associated with the first non-sequential and distinct digit pattern address sequence and with a location for the first storing;
second generating a second non-sequential and distinct digit pattern address sequence to be associated with the temporal data, as well as a second mapping from the temporal data to a distinct second address associated with the second non-sequential and distinct digit pattern address sequence and with a location for the second storing; and
third generating a third non-sequential and distinct digit pattern address sequence to be associated with the combined data, as well as a third mapping from the combined data to a distinct third address associated with the third non-sequential and distinct digit pattern address sequence and with a location for the third storing;
wherein:
the first generating, the second generating, and the third generating are accomplished in part by following a unified scheme, which unified scheme comprises counting with n digits and swapping two or more of the n digits, wherein n is a positive integer.
2. The method of claim 1 ,
wherein:
the first generating and the second generating are synonymous in the counting and the swapping of the unified scheme; and
the first generating and the second generating are distinct in the multiplexing of the unified scheme.
3. The method of claim 1 ,
wherein:
the first storing further comprises storing the spatial data to an intracoded direct cosine transform (IDCT) buffer comprised in an intracoded direct cosine unit;
the second storing further comprises storing the temporal data to an MC buffer comprised in a motion compensation unit; and
the third storing further comprises storing the combined data to a DRAM buffer associated with a merge-and-store unit.
4. The method of claim 1 ,
wherein:
each digit comprises a bit;
each non-sequential and distinct digit pattern address sequences comprises a non-sequential and distinct bit pattern address sequence;
the counting further comprises generating up to 2n number of distinct bit pattern address sequences;
the swapping further comprises swapping a pair of bits in each of 2n respectively associated distinct binary values comprising n bits, which swapping the pairs of bits generates up to n factorial number of non-sequential and distinct bit pattern address sequences from the 2n number of distinct bit pattern address sequences;
the unified scheme further comprises multiplexing in association with the counting, which multiplexing comprises selecting one or more of the n factorial number of non-sequential and distinct bit pattern address sequences to create one or more corresponding addressing schemes associated with the plurality of video frames;
the unified scheme is implemented in part by a unified hardware architecture comprising an n-bit counter for the counting, bit-swapping circuitry for the swapping, and a multiplexer for the multiplexing.
5. The method of claim 4 , wherein:
the first non-sequential and distinct digit pattern address sequence constitutes a first addressing scheme in accordance with the unified scheme;
the second non-sequential and distinct digit pattern address sequence constitutes a second addressing scheme in accordance with the unified scheme;
the third non-sequential and distinct digit pattern address sequence constitutes a third addressing scheme in accordance with the unified scheme;
the fetching and the storing of the spatial data use the first addressing scheme;
the fetching and the storing of the temporal data use the second addressing scheme; and
the fetching and the storing of the combined data use the third addressing scheme.
6. The method of claim 4 , wherein:
the counting comprised in the unified scheme and generating the up to 2n number of distinct bit pattern address sequences further comprises producing a first sequence of 2n number of sequential numbers, wherein each of the 2n sequential numbers is associated with one of the distinct binary values comprising n bits;
the pair of bits in each of the 2n distinct binary values associated with one of the up to 2n number of distinct bit pattern address sequences comprises an mth pair of bits, wherein m is an integer that ranges in value from 1 to (n!−1); and
the swapping of the pair of bits in each of the 2n distinct binary values further comprises swapping the mth pair of bits in each of the 2n distinct binary values to produce an (m+1)th sequence of 2n number of non-sequential numbers.
7. The method of claim 4 , wherein
the third generating is accomplished in part by twice following the swapping and the multiplexing of the unified scheme.
8. A computer-readable medium carrying one or more sequences of instructions for fetching and storing spatial data, temporal data, and combined data representing compressed digital video, wherein execution of the one or more sequences of instructions by one or more processors causes the one or more processors to perform a method, the method comprising:
generating distinct address sequences to be associated with spatial data, temporal data, and combined data representing compressed digital video by counting up to 2n numbers, wherein n is a number of digits, and by swapping a pair of the n digits.
9. The method of claim 8 , wherein the compressed digital video comprises a plurality of digital MPEG video frames.
10. The method of claim 8 , wherein the generating distinct address sequences is further achieved by selecting for association respectively with each of the spatial data, the temporal data, and the combined data a distinct address sequence from the up to n factorial number of distinct address sequences obtained by the counting and the swapping.
11. The method of claim 10 , wherein the respective distinct address sequences associated with the spatial data, the temporal data, and the combined data are further associated with respective locations on computer-readable mediums for the fetching and the storing of the spatial data, the temporal data, and the combined data.
12. The method of claim 10 , wherein the counting, the swapping, and the selecting comprise a unified scheme by which the generating is accomplished in part.
13. The method of claim 12 , wherein the generating comprises:
first generating a first distinct address sequence to be associated with the spatial data,
as well as a first mapping from the spatial data to a location on a computer-readable medium associated with the storing and the fetching of the spatial data;
second generating a second distinct address sequence to be associated with the temporal data,
as well as a second mapping from the temporal data to a location on a computer-readable medium associated with the storing and the fetching of the temporal data; and
third generating a third distinct address sequence to be associated with the combined data,
as well as a third mapping for the combined data to a location on a computer-readable medium associated with the storing and the fetching of the combined data;
wherein the spatial data, the temporal data, and the combined data represent the compressed digital video, which compressed digital video comprises a plurality of digital MPEG video frames.
14. An apparatus for fetching and storing spatial data, temporal data, and combined data representing a plurality of digital MPEG video frames, the apparatus comprising:
a first computer-readable medium for storing the spatial data;
a second computer-readable medium for storing the temporal data;
a third computer-readable medium for storing the combined data, wherein the combined data comprises the spatial data and the temporal data;
a first address generator for generating a first non-sequential and distinct bit pattern address sequence to be associated with the spatial data and for mapping the spatial data to a distinct first address associated with the first non-sequential and distinct pattern address sequence and with a first location, wherein the first location is associated with the first computer-readable medium, which first address generator comprises a first n-bit counter and a first bit-swapping circuit;
a second address generator for generating a second non-sequential and distinct bit pattern address sequence to be associated with the temporal data and for mapping the temporal data to a distinct second address associated with the second non-sequential and distinct bit pattern address sequence and with a second location, wherein the second location is associated with the second computer-readable medium, which second address generator comprises a second n-bit counter and a second bit-swapping circuit;
a third address generator for generating a third non-sequential and distinct bit pattern address sequence to be associated with the combined data and for mapping the combined data to a distinct third address associated with the third non-sequential and distinct bit pattern address sequence and with a third location, wherein the third location is associated with the third computer-readable medium, which third address generator comprises a third n-bit counter and a third bit-swapping circuit;
wherein:
the first address generator, the second address generator, and the third address generator are of a unified mechanism type, which unified mechanism type requires a unified hardware architecture comprising an n-bit counter and a bit-swapping circuit.
15. The apparatus of claim 14 , wherein:
the first computer-readable medium comprises an intracoded direct cosine unit comprising an IDCT buffer storing the spatial data;
the second computer-readable medium comprises a motion compensation unit comprising an MC buffer storing the temporal data; and
the third computer-readable medium comprises a merge-and-store unit associated with a DRAM buffer.
16. The apparatus of claim 14 , wherein:
the first address generator is merged with the second address generator;
the first n-bit counter and the second n-bit counter are synonymous; and
the first bit-swapping circuit and the second bit-swapping circuit are synonymous.
17. The apparatus of claim 14 , wherein:
the n-bit counter comprised in the unified hardware architecture generates up to 2n number of distinct bit pattern address sequences, wherein n is a positive integer;
the bit-swapping circuit comprised in the unified hardware architecture generates up to n factorial number of non-sequential and distinct bit pattern address sequences from the 2n number of distinct bit pattern address sequences by swapping a pair of bits in each of 2n respectively associated distinct binary values comprising n bits;
the unified hardware architecture further comprises a multiplexer corresponding to the n-bit counter comprised in the unified hardware architecture, wherein the multiplexer selects one or more of the n factorial number of non-sequential and distinct bit pattern address sequences to create one or more corresponding addressing schemes associated with the plurality of video frames;
the first n-bit counter, the second n-bit counter, and the third n-bit counter are structured and operated in accordance with the n-bit counter comprised in the unified hardware architecture;
the first bit-swapping circuit, the second bit-swapping circuit, and the third bit-swapping circuit are structured and operated in accordance with the bit-swapping circuit comprised in the unified hardware architecture; and
the first address generator, the second address generator, and the third address generator respectively and further comprise a first multiplexer, a second multiplexer, and a third multiplexer, which multiplexers are structured and operated in accordance with the unified hardware architecture.
18. The apparatus of claim 17 , wherein:
the n-bit counter comprised in the unified hardware architecture and generating the up to 2n number of distinct bit pattern address sequences further produces a first sequence of 2n number of sequential numbers, wherein each of the 2n sequential numbers is associated with one of the distinct binary values comprising n bits;
the pair of bits in each of the 2n distinct binary values associated with one of the up to 2n number of distinct bit pattern address sequences comprises an mth pair of bits, wherein m is an integer that ranges in value from 1 to (n!−1); and
the swapping of the pair of bits in each of the 2n distinct binary values further comprises swapping the mth pair of bits in each of the 2n distinct binary values to produce an (m+1)th sequence of 2n number of non-sequential numbers.
19. The apparatus of claim 17 , wherein:
the first non-sequential and distinct bit pattern address sequence constitutes a first addressing scheme in accordance with the unified hardware architecture;
the second non-sequential and distinct bit pattern address sequence constitutes a second addressing scheme in accordance with the unified hardware architecture;
the third non-sequential and distinct bit pattern address sequence constitutes a third addressing scheme in accordance with the unified hardware architecture;
the fetching and the storing of the spatial data uses the first addressing scheme;
the fetching and the storing of the temporal data uses the second addressing scheme; and
the fetching and the storing of the combined data uses the third addressing scheme.
20. The apparatus of claim 17 , wherein the third address generator further comprises:
a fourth bit-swapping circuit structured and operated in accordance with the unified hardware architecture; and
a fourth multiplexer structured and operated in accordance with the unified hardware architecture.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/507,962 US20060280245A1 (en) | 2002-09-11 | 2006-08-21 | MPEG video storage address generation apparatuses and methods for uniformly fetching and storing video data |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/242,320 US7116718B2 (en) | 2002-09-11 | 2002-09-11 | Unified memory address generation system and method for fetching and storing MPEG video data |
US11/507,962 US20060280245A1 (en) | 2002-09-11 | 2006-08-21 | MPEG video storage address generation apparatuses and methods for uniformly fetching and storing video data |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/242,320 Continuation US7116718B2 (en) | 2002-09-11 | 2002-09-11 | Unified memory address generation system and method for fetching and storing MPEG video data |
Publications (1)
Publication Number | Publication Date |
---|---|
US20060280245A1 true US20060280245A1 (en) | 2006-12-14 |
Family
ID=31991385
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/242,320 Expired - Fee Related US7116718B2 (en) | 2002-09-11 | 2002-09-11 | Unified memory address generation system and method for fetching and storing MPEG video data |
US11/507,962 Abandoned US20060280245A1 (en) | 2002-09-11 | 2006-08-21 | MPEG video storage address generation apparatuses and methods for uniformly fetching and storing video data |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/242,320 Expired - Fee Related US7116718B2 (en) | 2002-09-11 | 2002-09-11 | Unified memory address generation system and method for fetching and storing MPEG video data |
Country Status (4)
Country | Link |
---|---|
US (2) | US7116718B2 (en) |
JP (1) | JP4440776B2 (en) |
AU (1) | AU2003270387A1 (en) |
WO (1) | WO2004025944A2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090110316A1 (en) * | 2007-10-26 | 2009-04-30 | Industrial Technology Research Institute | Apparatus and method for performing video decoding processes in parallel |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7532765B2 (en) * | 2002-12-30 | 2009-05-12 | Intel Corporation | Run length encoded digital image |
US7627039B2 (en) * | 2003-09-05 | 2009-12-01 | Realnetworks, Inc. | Parallel video decoding |
US7873107B2 (en) * | 2004-07-30 | 2011-01-18 | Broadcom Corporation | Tertiary content addressable memory based motion estimator |
US8599841B1 (en) * | 2006-03-28 | 2013-12-03 | Nvidia Corporation | Multi-format bitstream decoding engine |
US8593469B2 (en) * | 2006-03-29 | 2013-11-26 | Nvidia Corporation | Method and circuit for efficient caching of reference video data |
US7884742B2 (en) * | 2006-06-08 | 2011-02-08 | Nvidia Corporation | System and method for efficient compression of digital data |
FR2902906A1 (en) * | 2006-06-21 | 2007-12-28 | St Microelectronics Sa | Digital video image data e.g. chrominance data, managing method for image processing system, involves determining reference pixel coordinates and address of pixel to be processed by applying bijective and inverse bijective functions |
US20080049693A1 (en) * | 2006-08-25 | 2008-02-28 | Motorola, Inc. | Method and apparatus for facilitating a conveyance of informational content using wireless addresses |
US20110158310A1 (en) * | 2009-12-30 | 2011-06-30 | Nvidia Corporation | Decoding data using lookup tables |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6111615A (en) * | 1995-12-29 | 2000-08-29 | Samsung Electronics Co., Ltd. | Address generating and mapping device of video capture system |
US20030014616A1 (en) * | 2001-07-02 | 2003-01-16 | Thavatchai Makphaibulchoke | Method and apparatus for pre-processing a data collection for use by a big-endian operating system |
US20030174549A1 (en) * | 2000-03-31 | 2003-09-18 | Yoshitaka Yaguchi | Recording format, recording device and reproducing device |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5412719A (en) * | 1992-01-17 | 1995-05-02 | Hitachi, Ltd. | Radio paging system with voice transfer function and radio pager |
US5940874A (en) * | 1996-08-16 | 1999-08-17 | Hughes Electronics Corporation | Memory device speed tester |
US6647518B1 (en) * | 2000-04-28 | 2003-11-11 | Conexant Systems, Inc. | Methods and apparatus for estimating a bit error rate for a communication system |
US6442085B1 (en) * | 2000-10-02 | 2002-08-27 | International Business Machines Corporation | Self-Test pattern to detect stuck open faults |
-
2002
- 2002-09-11 US US10/242,320 patent/US7116718B2/en not_active Expired - Fee Related
-
2003
- 2003-09-08 JP JP2004536136A patent/JP4440776B2/en not_active Expired - Fee Related
- 2003-09-08 WO PCT/US2003/028030 patent/WO2004025944A2/en active Search and Examination
- 2003-09-08 AU AU2003270387A patent/AU2003270387A1/en not_active Abandoned
-
2006
- 2006-08-21 US US11/507,962 patent/US20060280245A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6111615A (en) * | 1995-12-29 | 2000-08-29 | Samsung Electronics Co., Ltd. | Address generating and mapping device of video capture system |
US20030174549A1 (en) * | 2000-03-31 | 2003-09-18 | Yoshitaka Yaguchi | Recording format, recording device and reproducing device |
US20030014616A1 (en) * | 2001-07-02 | 2003-01-16 | Thavatchai Makphaibulchoke | Method and apparatus for pre-processing a data collection for use by a big-endian operating system |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090110316A1 (en) * | 2007-10-26 | 2009-04-30 | Industrial Technology Research Institute | Apparatus and method for performing video decoding processes in parallel |
US8165198B2 (en) * | 2007-10-26 | 2012-04-24 | Industrial Technology Research Institute | Apparatus and method for performing video decoding processes in parallel |
Also Published As
Publication number | Publication date |
---|---|
AU2003270387A1 (en) | 2004-04-30 |
WO2004025944A2 (en) | 2004-03-25 |
JP4440776B2 (en) | 2010-03-24 |
US20040057522A1 (en) | 2004-03-25 |
JP2005538648A (en) | 2005-12-15 |
WO2004025944A3 (en) | 2004-06-17 |
US7116718B2 (en) | 2006-10-03 |
AU2003270387A8 (en) | 2004-04-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20060280245A1 (en) | MPEG video storage address generation apparatuses and methods for uniformly fetching and storing video data | |
US5576765A (en) | Video decoder | |
US5982936A (en) | Performance of video decompression by using block oriented data structures | |
US6301304B1 (en) | Architecture and method for inverse quantization of discrete cosine transform coefficients in MPEG decoders | |
RO115926B1 (en) | Method and apparatus for preventing rounding errors when conversion factors representing a signal are inversely transformed | |
US5739862A (en) | Reverse playback of MPEG video | |
US9288487B2 (en) | Methods and electronic devices for quantization and de-quantization | |
US6020924A (en) | Reduced memory size set top box which stores frames and associated motion vectors which indicate which block or blocks are to be retrieved from memory | |
US5991445A (en) | Image processing apparatus | |
KR100192696B1 (en) | Method and apparatus for reproducing picture data | |
US6205181B1 (en) | Interleaved strip data storage system for video processing | |
US6552749B1 (en) | Method and apparatus for video motion compensation, reduction and color formatting | |
US20060104351A1 (en) | Video/image processing devices and methods | |
JPH06178283A (en) | Motion picture decoder | |
US6928115B2 (en) | Compression-encoded data decoding apparatus cross-reference to related applications | |
EP1479246A1 (en) | Memory-bandwidth efficient fine granular scalability (fgs) encoder | |
US6377627B1 (en) | Method and apparatus for decoding MPEG video data | |
KR100264639B1 (en) | Color control for on-screen display in digital video | |
US7589788B1 (en) | Method and apparatus for video motion compensation, reduction and color formatting | |
US7269288B2 (en) | Apparatus for parallel calculation of prediction bits in a spatially predicted coded block pattern and method thereof | |
US5774590A (en) | Image data reproducing apparatus | |
JP2824024B2 (en) | Image decoding method and apparatus | |
US5715007A (en) | Image decoder with block image shifting device | |
KR100242832B1 (en) | Apparatus for generating quantization step value | |
JPH11308620A (en) | Image decoder |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |