USRE49727E1 - System and method for decoding using parallel processing - Google Patents

System and method for decoding using parallel processing Download PDF

Info

Publication number
USRE49727E1
USRE49727E1 US17/200,761 US202117200761A USRE49727E US RE49727 E1 USRE49727 E1 US RE49727E1 US 202117200761 A US202117200761 A US 202117200761A US RE49727 E USRE49727 E US RE49727E
Authority
US
United States
Prior art keywords
partition
blocks
sequence
decoding
partitions
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US17/200,761
Inventor
Yaowu Xu
Paul Wilkins
James Bankoski
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google LLC filed Critical Google LLC
Priority to US17/200,761 priority Critical patent/USRE49727E1/en
Assigned to GOOGLE INC. reassignment GOOGLE INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ON2 TECHNOLOGIES, LLC
Assigned to ON2 TECHNOLOGIES, LLC reassignment ON2 TECHNOLOGIES, LLC MERGER (SEE DOCUMENT FOR DETAILS). Assignors: ON2 TECHNOLOGIES, INC.
Assigned to ON2 TECHNOLOGIES, INC. reassignment ON2 TECHNOLOGIES, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BANKOSKI, JAMES, XU, YAOWU, WILKINS, PAUL
Priority to US18/500,144 priority patent/US20240080482A1/en
Application granted granted Critical
Publication of USRE49727E1 publication Critical patent/USRE49727E1/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/24Systems for the transmission of television signals using pulse code modulation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/436Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/91Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Definitions

  • the present invention relates in general to video decoding using multiple processors.
  • VPx promulgated by On2 Technologies, Inc. of Clifton Park, N.Y.
  • H.264 standard promulgated by ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG), including present and future versions thereof.
  • VCEG Video Coding Experts Group
  • MPEG Moving Picture Experts Group
  • H.264 is also known as MPEG-4 Part 10 or MPEG-4 AVC (formally, ISO/IEC 14496-10).
  • Video encoding schemes that allow video data to be compressed and recovered.
  • the H.264 standard offers more efficient methods of video coding by incorporating entropy coding methods such as Context-based Adaptive Variable Length Coding (CAVLC) and Context-based Adaptive Binary Arithmetic Coding (CABAC).
  • CAVLC Context-based Adaptive Variable Length Coding
  • CABAC Context-based Adaptive Binary Arithmetic Coding
  • some modem decompression systems have adopted the use of a multi-core processor or multiprocessors to increase overall video decoding speed.
  • An embodiment of the invention is disclosed as a method for decoding a stream of encoded video data including a plurality of partitions that have been compressed using at least a first encoding scheme.
  • the method includes selecting at least a first one of the partitions that includes at least one row of blocks that has been encoded using at least a second encoding scheme.
  • a second partition is selected that includes at least one row of blocks encoded using the second encoding scheme.
  • the first partition is decoded by a first processor, and the second partition is decoded by a second processor.
  • the decoding of the second partition is offset by a specified number of blocks so that at least a portion of the output from the decoding of the first partition is used as input in decoding the second partition.
  • the decoding of the first partition is offset by a specified number of blocks so that at least a portion of the output from the decoding of the second partition is used as input in decoding the first partition.
  • FIG. 1 is a diagram of the hierarchy of layers in a compressed video bitstream in accordance with one embodiment of the present invention.
  • FIG. 2 is a block diagram of a video compression system in accordance with one embodiment of the present invention.
  • FIG. 3 is a block diagram of a video decompression system in accordance with one embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a frame and its corresponding partitions outputted from the video compression system of FIG. 2 .
  • FIG. 5 is a schematic diagram of an encoded video frame in a bitstream outputted from the video compression system of FIG. 2 and sent to the video decompression system of FIG. 3 .
  • FIGS. 6 A- 6 B arc timing diagrams illustrating the staging and synchronization of cores on a multi-core processor used in the video decompression system of FIG. 3 .
  • FIG. 7 A is a schematic diagram showing data-dependent macroblocks and an offset calculation based used in the video compression and decompression systems of FIGS. 2 and 3 .
  • FIG. 7 B is a schematic diagram showing data-dependent macroblocks and an alternative offset calculation used in the video compression and decompression systems of FIGS. 2 and 3 .
  • video coding standards such as H.264, provide a defined hierarchy of layers 10 for a video stream 11 .
  • the highest level in the layer can be a video sequence 13 .
  • video sequence 13 consists of a number of adjacent frames 15 .
  • Number of adjacent frames 15 can be further subdivided into a single frame 17 .
  • frame 17 can be composed of a series of fix-sized macroblocks 20 , which contain compressed data corresponding to, for example, a 16 ⁇ 16 block of displayed pixels in frame 17 .
  • Each macroblock contains luminance and chrominance data for the corresponding pixels.
  • Macroblocks 20 can also be of any other suitable size such as 16 ⁇ 8 pixel groups or 8 ⁇ 16 pixel groups.
  • Macroblocks 20 are further subdivided into blocks.
  • a block for example, can be a 4 ⁇ 4 pixel group that can further describe the luminance and chrominance data for the corresponding pixels.
  • Blocks can also be of any other suitable size such as 16 ⁇ 16, 16 ⁇ 8, 8 ⁇ 16, 8 ⁇ 8, 8 ⁇ 4, 4 ⁇ 8 and 4 ⁇ 4 pixels groups.
  • embodiments are described in the context of the VP8 video coding format, alternative embodiments of the present invention can be implemented in the context of other video coding formats. Further, the embodiments are not limited to any specific video coding standard or format.
  • an encoder 14 performs the following functions in a forward path (shown by the solid connection lines) to produce an encoded bitstream 26 : intra/inter prediction 18 , transform 19 , quantization 22 and entropy encoding 24 .
  • Encoder 14 also includes a reconstruction path (shown by the dotted connection lines) to reconstruct a frame for encoding of further macroblocks.
  • Encoder 14 performs the following functions in the reconstruction path: dequantization 28 , inverse transformation 30 , reconstruction 32 and loop filtering 34 .
  • Other structural variations of encoder 14 can be used to encode bitstream 26 .
  • each frame 17 within input video stream 16 can be processed in units of macroblocks.
  • each macroblock can be encoded using either intra prediction or inter prediction mode.
  • intra-prediction a prediction macroblock can be formed from samples in the current frame that have been previously encoded and reconstructed.
  • a prediction macroblock can be formed from one or more reference frames that have already been encoded and reconstructed.
  • the prediction macroblock can be subtracted from the current macroblock to produce a residual macroblock (residual).
  • Transform stage 19 transform codes the residual signal to coefficients and quantization stage 22 quantizes the coefficients to provide a set of quantized transformed coefficients.
  • the quantized transformed coefficients are then entropy coded by entropy encoding stage 24 .
  • the entropy-coded coefficients, together with the information required to decode the macroblock, such as the type of prediction mode used, motion vectors and quantizer value, are output to compressed bitstream 26 .
  • the reconstruction path in FIG. 2 can be present to permit that both the encoder and the decoder use the same reference frames required to decode the macroblocks.
  • the reconstruction path similar to functions that take place during the decoding process, which arc discussed in more detail below, includes dequantizing the transformed coefficients by dequantization stage 28 and inverse transforming the coefficients by inverse transform stage 30 to produce a derivative residual macroblock (derivative residual).
  • the prediction macroblock can be added to the derivative residual to create a reconstructed macroblock.
  • a loop filter 34 can he applied to the reconstructed macroblock to reduce distortion.
  • a decoder 21 similar to the reconstruction path of encoder 14 discussed previously, performs the following functions to produce an output video stream 35 : entropy decoding 25 , dequantization 27 , inverse transformation 29 , intra/inter prediction 23 , reconstruction 31 , loop filter 34 and deblocking filtering 33 .
  • Other structural variations of decoder 21 can be used to decode compressed bitstream 26 .
  • the data elements can be decoded by entropy decoding stage 25 to produce a set of quantized coefficients.
  • Dequantization stage 27 dequantizes and inverse transform stage 29 inverse transforms the coefficients to produce a derivative residual that is identical to that created by the reconstruction stage in encoder 14 .
  • decoder 21 uses the type of prediction mode and/or motion vector information decoded from the compressed bitstream 26 , at intra/inter prediction stage 23 , decoder 21 creates the same prediction macroblock as was created in encoder 14 .
  • the prediction macroblock can be added to the derivative residual to create a reconstructed macroblock.
  • the loop filter 34 can be applied to the reconstructed macroblock to reduce blocking artifacts.
  • a deblocking filter 33 can be applied to video image frames to further reduce blocking distortion and the result can he outputted to output video stream 35 .
  • CABAC Context-based Adaptive Arithmetic Coding
  • embodiments of the present invention can also be implemented with other suitable computer systems, such as a device containing multiple processors.
  • encoder 14 divides the compressed bitstream into partitions 36 rather than a single stream of serialized data.
  • the compressed bitstream can be divided into four partitions, which are designated as Data Partitions 1 - 4 .
  • Other numbers of partitions are also suitable. Since each partition can be the subject of a separate decoding process when they are decoded by decoder 21 , the serialized dependency can be broken up in the compressed data without losing coding efficiency.
  • Macroblock rows 38 consist of individual macroblocks 20 .
  • every Nth macroblock row 38 can be grouped into one of partitions 36 (where N is the total number of partitions).
  • there are four partitions and macroblock rows 0 , 4 , 8 , 12 , etc. are grouped into partition 1 .
  • Macroblock rows 1 , 5 , 9 and 13 , etc. are grouped into partition 2 .
  • Macroblock rows 2 , 6 , 10 , 14 , etc. are grouped into partition 3 .
  • Macroblock rows 3 , 7 , 11 , 15 , etc. are grouped into partition 4 .
  • each partition 36 includes contiguous macroblocks, but in this instance, each partition 36 does not contain contiguous macroblock rows 38 .
  • macroblock rows of blocks in the first partition and macroblock rows in the second partition can be derived from two adjacent macroblock rows in a frame.
  • Other grouping mechanisms arc also available and arc not limited to separating regions by macroblock row or grouping every Nth macroblock row into a partition.
  • macroblock rows that are contiguous may also be grouped into the same partition 36 .
  • An alternative grouping mechanism may include, for example, grouping a row of blocks from a first frame and a corresponding row of blocks in a second frame.
  • the row of blocks from the first frame can be packed in the first partition and the corresponding row of blocks in the second frame can be packed in the second partition.
  • a first processor can decode the row of blocks from the first frame and a second processor can decode the row of blocks from the second frame. In this manner, the decoder can decode at least one block in the second partition using information from a block that is already decoded by the first processor.
  • the first encoding scheme can be lossless encoding using, for example, context-based arithmetic coding like CABAC. Other lossless encoding techniques may also be used.
  • the first encoding scheme may be realized by, for example, entropy encoding stage 24 .
  • the second encoding scheme which can take place before the first encoding scheme, may be realized by at least one of intra/inter prediction stage 18 , transform stage 19 , and quantization 22 .
  • the second encoding scheme can encode blocks in each of the partitions 36 by using information contained in other partitions. For example, if a frame is divided into two partitions, the second encoding scheme can encode the second partition using information contained in the macroblock rows of the first partition.
  • Encoded video frame 39 from compressed bitstream 26 is shown. For simplicity, only parts of the bitstream that are pertinent to embodiments of the invention are shown.
  • Encoded video frame 39 contains a video frame header 44 which contains bits for a number of partitions 40 and bits for offsets of each partition 42 .
  • Encoded video frame 39 also includes the encoded data from data partitions 36 illustrated as P 1 -P N where, as discussed previously, N is the total number of partitions in video frame 17 .
  • encoder 14 writes data into video frame header 44 to indicate number of partitions 40 and offsets of each partition 42 .
  • Number of partitions 40 and offsets of each partition 42 can be represented in frame 17 by a bit, a byte or any other record that can relay the specific information to decoder 21 .
  • Decoder 21 reads the number of data partitions 40 from video frame header 44 in order to decode the compressed data.
  • two bits may be used to represent the number of partitions.
  • One or more bits can be used to indicate the number of data partitions (or partition count).
  • Other coding schemes can also be used to code the number of partitions into the bitstream. The following list indicates how two bits can represent the number of partitions:
  • decoder 21 also needs information about the positions of the data partitions 36 within the compressed bitstream 26 .
  • the offsets of each partition 42 (also referred to as partition location offsets) enable direct access to each partition during decoding.
  • offset of each partition 42 can be relative to the beginning of the bitstream and can be encoded and written into the bitstream 26 .
  • the offset for each data partition can be encoded and written into the bitstream except for the first partition since the first partition implicitly begins in the bitstream 26 after the offsets of each partition 42 .
  • suitable data structures, flags or records such words and bytes, can be used to transmit partition count and partition location offset information.
  • each frame 17 would have a different number of partitions 40 .
  • the number of bits that are used to represent the number of partitions may also differ from frame to frame. Accordingly, each frame 17 could be divided into varying numbers of partitions.
  • decoder 21 can decode the data partitions 36 on a multi-core processor in parallel.
  • each processor core may be responsible for decoding one of the data partitions 36 . Since multi-core processors typically have more than one processing core and shared memory space, the workload can be allocated between each core as evenly as possible. Each core can use the shared memory space as an efficient way of sharing data between each core decoding each data partition 36 .
  • the first processor will begin decoding the first partition.
  • the second processor can then decode macroblocks of the second partition and can use information received from the first processor, which has begun decoding macroblocks of the first partition.
  • the first processor can continue decoding macroblocks of the first partition and can use information received from the second processor. Accordingly, both the first and second processors can have the information necessary to properly decode macroblocks in their respective partitions.
  • a macroblock that is currently being processed in the second partition is offset by a specified number of macroblocks. In this manner, at least a portion of the output of the decoding of the first partition can be used as input in the decoding of the macroblock that is currently being processed in the second partition.
  • a macroblock that is currently being processed in the first partition is offset by a specified number of macroblocks so that at least a portion of the output of the decoding of the second partition can be used as input in the decoding of the macroblock that is currently being processed in the first partition.
  • decoder 21 determines the number of threads needed to decode the data, which can be based on the number of partitions 40 in each encoded frame 39 . For example, if number of partitions 40 indicates that there are four partitions in encoded frame 39 , decoder 21 creates four threads with each thread decoding one of the data partitions. Referring to FIG. 4 , as an example, decoder 21 can determine that four data partitions have been created. Hence, if decoder 21 is using a multi-core processor, it can create four separate threads to decode the data from that specific frame.
  • macroblocks 20 within each frame use context data from neighboring macroblocks when being encoded.
  • the decoder will need the same context data in order to decode the macroblocks properly.
  • the context data can be available only after the neighboring macroblocks have already been decoded by the current thread or other threads.
  • the decoder includes a staging and synchronization mechanism for managing the decoding of the multiple threads.
  • FIGS. 6 A and 6 B a time diagram shows the staging and synchronization mechanism to decode partitions 36 on threads of a multi-core processor in accordance with an embodiment of the present invention.
  • FIGS. 6 A and 6 B illustrate an exemplary partial image frame 45 at various stages of the decoding process.
  • the example is simplified for purposes of this disclosure and the number of partitions 36 is limited to three.
  • Each partition 36 can be assigned to one of the three threads 46 , 48 and 50 .
  • each partition 36 includes contiguous macroblocks.
  • each of threads 46 , 48 and 50 are capable of performing decoding in parallel with each other.
  • Each of the three threads 46 , 48 and 50 processes one partition in a serial manner while all three partitions 40 are processed in parallel with each other.
  • FIGS. 6 A and 6 B contain an arrow that illustrates which macroblock is currently being decoded in each macroblock row, which macroblocks have been decoded in each macroblock row, and which macroblocks have yet to be decoded in each macroblock row. If the arrow is pointing to a specific macroblock, that macroblock is currently being decoded. Any macroblock to the left of the arrow (if any) has already been decoded in that row. Any macroblock to the right of the arrow has yet to be decoded.
  • the macroblocks illustrated in FIGS. 6 A and 6 B all have similar sizes, the techniques of this disclosure are not limited in this respect. Other block sizes, as discussed previously, can also be used with embodiments of the present invention.
  • thread 46 has initiated decoding of a first macroblock row 52 .
  • Thread 46 is currently processing macroblock j in first macroblock row 52 as shown by arrow 58 .
  • Macroblocks 0 to j ⁇ 1 have already been decoded in first macroblock row 52 .
  • Macroblocks j+1 to the end of first macroblock row 52 have yet to be decoded in first macroblock row 52 .
  • Thread 48 has also initiated decoding of a second macroblock row 54 .
  • Thread 48 is currently processing macroblock 0 in second macroblock row 54 as shown by arrow 60 .
  • Macroblocks 1 to the end of second macroblock row 54 have been decoded in second macroblock row 54 .
  • Thread 50 has not begun decoding of a third macroblock row 56 . No macroblocks have been decoded or are currently being decoded in third macroblock row 56 .
  • thread 46 has continued decoding of first macroblock row 52 .
  • Thread 46 is currently processing macroblock j*2 in first macroblock row 52 as shown by arrow 62 .
  • Macroblocks 0 to j*2-1 have already been decoded in first macroblock row 52 .
  • Macroblocks j*2+1 to the end of first macroblock row 52 have yet to be decoded in first macroblock row 52 .
  • Thread 48 has also continued decoding of second macroblock row 54 .
  • Thread 48 is currently processing macroblock j in second macroblock row 54 as shown by arrow 64 .
  • Macroblocks 0 to j ⁇ 1 have already been decoded in second macroblock row 54 .
  • Macroblocks j+1 to the end of second macroblock row 54 have yet to be decoded in second macroblock row 54 .
  • Thread 50 has also initiated decoding of a third macroblock row 56 .
  • Thread 50 is currently processing macroblock 0 in third macroblock row 56 as shown by arrow 66 .
  • Macroblocks 1 to the end of third macroblock row 56 have yet to be decoded in third macroblock row 56 .
  • Previous decoding mechanisms were unable to efficiently use a multi-core processor to decode a compressed bitstream because processing of a macroblock row could not be initiated until the upper adjacent macroblock row had been completely decoded.
  • the difficulty of previous decoding mechanisms stems from the encoding phase.
  • spatial dependencies within macroblocks imply a specific order of processing of the macroblocks.
  • a specific macroblock row cannot be discerned until the row has been completely decoded.
  • video coding methods incorporating entropy coding methods such as CABAC created serialized dependencies which were passed to the decoder.
  • decoding schemes had limited efficiency because information for each computer processing system (e.g. threads 46 , 48 and 50 ) was not available until the decoding process has been completed on that macroblock row.
  • each partition 36 can be subject to a separate decoding process, interdependencies between partitions can be managed by embodiments of the staging and synchronization scheme discussed previously in connection with FIGS. 6 A and 6 B .
  • each thread 46 , 48 and 50 that decodes an assigned partition can exploit context data from neighboring macroblocks.
  • decoder 21 can decode macroblocks that contain context data necessary to decode a current macroblock before the preceding macroblock row has been completely decoded.
  • offset j can be determined by examining the size of the context data used in the preceding macroblock row (e.g. measured in a number of macroblocks) during the encoding process. Offset j can be represented in frame 17 by a bit, a byte or any other record that can relay the size of the context data to decoder 21 .
  • FIGS. 7 A and 7 B illustrate two alternatives for the size of offset j.
  • current macroblock 68 is currently being processed.
  • Current macroblock 68 uses context data from the left, top-left, top and top-right macroblocks during encoding. In other words, current macroblock 68 uses information from macroblocks: (r+1, c ⁇ 1), (r, c ⁇ 1), (r, c) and (r, c+1).
  • macroblocks (r+1, c ⁇ 1), (r, c ⁇ 1), (r, c) and (r, c+1) should be decoded before current macroblock 68 .
  • macroblock (r+1, c ⁇ 1) can be decoded before current macroblock 68 .
  • the decoder can use (r, c+1) as the rightmost macroblock during decoding as well.
  • offset j can be determined by subtracting the column row position of rightmost macroblock of the preceding row used during encoding of the current macroblock from the column row position of the current macroblock being processed.
  • offset j would be determined by subtracting the column row position of macroblock (r, c+1) from the column position of current macroblock 68 (i.e. (r+1, c)), or c+1 ⁇ c, giving rise to an offset of 1.
  • current macroblock 68 ′ is currently being processed.
  • Current macroblock 68 ′ uses information from macroblocks: (r+1, c ⁇ 1), (r, c ⁇ 1), (r, c), (r, c+1), (r, c+2), and (r, c+3).
  • macroblocks (r+1, c ⁇ 1), (r, c ⁇ 1), (r, c) (r, c+1), (r, c+2) and (r, c+3) should be decoded before current macroblock 68 ′.
  • macroblock (r+1, c ⁇ 1) can be decoded before current macroblock 68 ′.
  • macroblock row r since the encoding process uses (r, c+3) as the rightmost macroblock, the decoder can use (r, c+3) as the rightmost macroblock during decoding as well.
  • offset j can be determined by subtracting the column row position of rightmost macroblock of the preceding row used during encoding of the current macroblock from the column row position of the current macroblock being processed.
  • offset j would be calculated by subtracting the column row position of macroblock (r, c+3) from the column position of current macroblock 68 ′ (i.e. (r+1, c)), or c+3 ⁇ c, giving rise to an offset of 3.
  • the offset can be determined by the specific requirements of the codec. In alternative embodiments, the offset can be specified in the bitstream.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

An apparatus for decoding frames of a compressed video data stream having at least one frame divided into partitions, includes a memory and a processor configured to execute instructions stored in the memory to read partition data information indicative of a partition location for at least one of the partitions, decode a first partition of the partitions that includes a first sequence of blocks, decode a second partition of the partitions that includes a second sequence of blocks identified from the partition data information using decoded information of the first partition.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
This application is a continuation of U.S. nonprovisional patent application Ser. No. 13/565,364, filed Aug. 2, 2012, now U.S. Pat. No. 9,357,223, which is a divisional of U.S. nonprovisional patent application Ser. No. 12/329,248, filed Dec. 5, 2008, which claims priority to U.S. provisional patent application No. 61/096,223, filed Sep. 11, 2008, which are incorporated herein in entirety by reference.
TECHNICAL FIELD
The present invention relates in general to video decoding using multiple processors.
BACKGROUND
An increasing number of applications today make use of digital video for various purposes including, for example, remote business meetings via video conferencing, high definition video entertainment, video advertisements, and sharing of user-generated videos. As technology is evolving, people have higher expectations for video quality and expect high resolution video with smooth playback at a high frame rate.
There can be many factors to consider when selecting a video coder for encoding, storing and transmitting digital video. Some applications may require excellent video quality where others may need to comply with various constraints including, for example, bandwidth or storage requirements. To permit higher quality transmission of video while limiting bandwidth consumption, a number of video compression schemes are noted including proprietary formats such as VPx (promulgated by On2 Technologies, Inc. of Clifton Park, N.Y., H.264 standard promulgated by ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG), including present and future versions thereof. H.264 is also known as MPEG-4 Part 10 or MPEG-4 AVC (formally, ISO/IEC 14496-10).
There are many types of video encoding schemes that allow video data to be compressed and recovered. The H.264 standard, for example, offers more efficient methods of video coding by incorporating entropy coding methods such as Context-based Adaptive Variable Length Coding (CAVLC) and Context-based Adaptive Binary Arithmetic Coding (CABAC). For video data that is encoded using CAVLC, some modem decompression systems have adopted the use of a multi-core processor or multiprocessors to increase overall video decoding speed.
SUMMARY
An embodiment of the invention is disclosed as a method for decoding a stream of encoded video data including a plurality of partitions that have been compressed using at least a first encoding scheme. The method includes selecting at least a first one of the partitions that includes at least one row of blocks that has been encoded using at least a second encoding scheme. A second partition is selected that includes at least one row of blocks encoded using the second encoding scheme. The first partition is decoded by a first processor, and the second partition is decoded by a second processor. The decoding of the second partition is offset by a specified number of blocks so that at least a portion of the output from the decoding of the first partition is used as input in decoding the second partition. Further, the decoding of the first partition is offset by a specified number of blocks so that at least a portion of the output from the decoding of the second partition is used as input in decoding the first partition.
BRIEF DESCRIPTION OF THE DRAWINGS
The description herein makes reference to the accompanying drawings wherein like reference numerals refer to like parts throughout the several views, and wherein:
FIG. 1 is a diagram of the hierarchy of layers in a compressed video bitstream in accordance with one embodiment of the present invention.
FIG. 2 is a block diagram of a video compression system in accordance with one embodiment of the present invention.
FIG. 3 is a block diagram of a video decompression system in accordance with one embodiment of the present invention.
FIG. 4 is a schematic diagram of a frame and its corresponding partitions outputted from the video compression system of FIG. 2 .
FIG. 5 is a schematic diagram of an encoded video frame in a bitstream outputted from the video compression system of FIG. 2 and sent to the video decompression system of FIG. 3 .
FIGS. 6A-6B arc timing diagrams illustrating the staging and synchronization of cores on a multi-core processor used in the video decompression system of FIG. 3 .
FIG. 7A is a schematic diagram showing data-dependent macroblocks and an offset calculation based used in the video compression and decompression systems of FIGS. 2 and 3 .
FIG. 7B is a schematic diagram showing data-dependent macroblocks and an alternative offset calculation used in the video compression and decompression systems of FIGS. 2 and 3 .
DETAILED DESCRIPTION
Referring to FIG. 1 , video coding standards, such as H.264, provide a defined hierarchy of layers 10 for a video stream 11. The highest level in the layer can be a video sequence 13. At the next level, video sequence 13 consists of a number of adjacent frames 15. Number of adjacent frames 15 can be further subdivided into a single frame 17. At the next level, frame 17 can be composed of a series of fix-sized macroblocks 20, which contain compressed data corresponding to, for example, a 16×16 block of displayed pixels in frame 17. Each macroblock contains luminance and chrominance data for the corresponding pixels. Macroblocks 20 can also be of any other suitable size such as 16×8 pixel groups or 8×16 pixel groups. Macroblocks 20 are further subdivided into blocks. A block, for example, can be a 4×4 pixel group that can further describe the luminance and chrominance data for the corresponding pixels. Blocks can also be of any other suitable size such as 16×16, 16×8, 8×16, 8×8, 8×4, 4×8 and 4×4 pixels groups.
Although the description of embodiments are described in the context of the VP8 video coding format, alternative embodiments of the present invention can be implemented in the context of other video coding formats. Further, the embodiments are not limited to any specific video coding standard or format.
Referring to FIG. 2 , in accordance with one embodiment, to encode an input video stream 16, an encoder 14 performs the following functions in a forward path (shown by the solid connection lines) to produce an encoded bitstream 26: intra/inter prediction 18, transform 19, quantization 22 and entropy encoding 24. Encoder 14 also includes a reconstruction path (shown by the dotted connection lines) to reconstruct a frame for encoding of further macroblocks. Encoder 14 performs the following functions in the reconstruction path: dequantization 28, inverse transformation 30, reconstruction 32 and loop filtering 34. Other structural variations of encoder 14 can be used to encode bitstream 26.
When input video stream 16 is presented for encoding, each frame 17 within input video stream 16 can be processed in units of macroblocks. At intra/inter prediction stage 18, each macroblock can be encoded using either intra prediction or inter prediction mode. In the case of intra-prediction, a prediction macroblock can be formed from samples in the current frame that have been previously encoded and reconstructed. In the case of inter-prediction, a prediction macroblock can be formed from one or more reference frames that have already been encoded and reconstructed.
Next, still referring to FIG. 2 , the prediction macroblock can be subtracted from the current macroblock to produce a residual macroblock (residual). Transform stage 19 transform codes the residual signal to coefficients and quantization stage 22 quantizes the coefficients to provide a set of quantized transformed coefficients. The quantized transformed coefficients are then entropy coded by entropy encoding stage 24. The entropy-coded coefficients, together with the information required to decode the macroblock, such as the type of prediction mode used, motion vectors and quantizer value, are output to compressed bitstream 26.
The reconstruction path in FIG. 2 , can be present to permit that both the encoder and the decoder use the same reference frames required to decode the macroblocks. The reconstruction path, similar to functions that take place during the decoding process, which arc discussed in more detail below, includes dequantizing the transformed coefficients by dequantization stage 28 and inverse transforming the coefficients by inverse transform stage 30 to produce a derivative residual macroblock (derivative residual). At the reconstruction stage 32, the prediction macroblock can be added to the derivative residual to create a reconstructed macroblock. A loop filter 34 can he applied to the reconstructed macroblock to reduce distortion.
Referring to FIG. 3 , in accordance with one embodiment, to decode compressed bitstream 26, a decoder 21, similar to the reconstruction path of encoder 14 discussed previously, performs the following functions to produce an output video stream 35: entropy decoding 25, dequantization 27, inverse transformation 29, intra/inter prediction 23, reconstruction 31, loop filter 34 and deblocking filtering 33. Other structural variations of decoder 21 can be used to decode compressed bitstream 26.
When compressed bitstream 26 is presented for decoding, the data elements can be decoded by entropy decoding stage 25 to produce a set of quantized coefficients. Dequantization stage 27 dequantizes and inverse transform stage 29 inverse transforms the coefficients to produce a derivative residual that is identical to that created by the reconstruction stage in encoder 14. Using the type of prediction mode and/or motion vector information decoded from the compressed bitstream 26, at intra/inter prediction stage 23, decoder 21 creates the same prediction macroblock as was created in encoder 14. At the reconstruction stage 33, the prediction macroblock can be added to the derivative residual to create a reconstructed macroblock. The loop filter 34 can be applied to the reconstructed macroblock to reduce blocking artifacts. A deblocking filter 33 can be applied to video image frames to further reduce blocking distortion and the result can he outputted to output video stream 35.
Current context-based entropy coding methods, such as Context-based Adaptive Arithmetic Coding (CABAC), are limited by dependencies that exploit spatial locality by requiring macroblocks to reference neighboring macroblocks and that exploit temporal localities by requiring macroblocks to reference macroblocks from another frame. Because of these dependencies and the adaptivity, encoder 14 codes the bitstream in a sequential order using context data from neighboring macroblocks. Such sequential dependency created by encoder 14 causes the compressed bitstream 26 to be decoded in a sequential fashion by decoder 21. Such sequential decoding can be adequate when decoding using a single-core processor. On the other hand, if a multi-core processor or a multi-processor system is used during decoding, the computing power of the multi-core processor or the multi-processor system would not be effectively utilized.
Although the disclosure has and will continue to describe embodiments of the present invention with reference to a multi-core processor and the creation of threads on the multi-core processor, embodiments of the present invention can also be implemented with other suitable computer systems, such as a device containing multiple processors.
According to one embodiment, encoder 14 divides the compressed bitstream into partitions 36 rather than a single stream of serialized data. With reference to FIG. 4 and by way of example only, the compressed bitstream can be divided into four partitions, which are designated as Data Partitions 1-4. Other numbers of partitions are also suitable. Since each partition can be the subject of a separate decoding process when they are decoded by decoder 21, the serialized dependency can be broken up in the compressed data without losing coding efficiency.
Referring to FIG. 4 , frame 17 is shown with divided macroblock rows 38. Macroblock rows 38 consist of individual macroblocks 20. Continuing with the example, every Nth macroblock row 38 can be grouped into one of partitions 36 (where N is the total number of partitions). In this example, there are four partitions and macroblock rows 0, 4, 8, 12, etc. are grouped into partition 1. Macroblock rows 1, 5, 9 and 13, etc. are grouped into partition 2. Macroblock rows 2, 6, 10, 14, etc. are grouped into partition 3. Macroblock rows 3, 7, 11, 15, etc. are grouped into partition 4. As a result, each partition 36 includes contiguous macroblocks, but in this instance, each partition 36 does not contain contiguous macroblock rows 38. In other words, macroblock rows of blocks in the first partition and macroblock rows in the second partition can be derived from two adjacent macroblock rows in a frame. Other grouping mechanisms arc also available and arc not limited to separating regions by macroblock row or grouping every Nth macroblock row into a partition. Depending on the grouping mechanism, in another example, macroblock rows that are contiguous may also be grouped into the same partition 36.
An alternative grouping mechanism may include, for example, grouping a row of blocks from a first frame and a corresponding row of blocks in a second frame. The row of blocks from the first frame can be packed in the first partition and the corresponding row of blocks in the second frame can be packed in the second partition. A first processor can decode the row of blocks from the first frame and a second processor can decode the row of blocks from the second frame. In this manner, the decoder can decode at least one block in the second partition using information from a block that is already decoded by the first processor.
Each of the partitions 36 can be compressed using two separate encoding schemes. The first encoding scheme can be lossless encoding using, for example, context-based arithmetic coding like CABAC. Other lossless encoding techniques may also be used. Referring back to FIG. 1 , the first encoding scheme may be realized by, for example, entropy encoding stage 24.
Still referring to FIG. 1 , the second encoding scheme, which can take place before the first encoding scheme, may be realized by at least one of intra/inter prediction stage 18, transform stage 19, and quantization 22. The second encoding scheme can encode blocks in each of the partitions 36 by using information contained in other partitions. For example, if a frame is divided into two partitions, the second encoding scheme can encode the second partition using information contained in the macroblock rows of the first partition.
Referring to FIG. 5 , an encoded video frame 39 from compressed bitstream 26 is shown. For simplicity, only parts of the bitstream that are pertinent to embodiments of the invention are shown. Encoded video frame 39 contains a video frame header 44 which contains bits for a number of partitions 40 and bits for offsets of each partition 42. Encoded video frame 39 also includes the encoded data from data partitions 36 illustrated as P1-PN where, as discussed previously, N is the total number of partitions in video frame 17.
Once encoder 14 has divided frame 17 into partitions 36, encoder 14 writes data into video frame header 44 to indicate number of partitions 40 and offsets of each partition 42. Number of partitions 40 and offsets of each partition 42 can be represented in frame 17 by a bit, a byte or any other record that can relay the specific information to decoder 21. Decoder 21 reads the number of data partitions 40 from video frame header 44 in order to decode the compressed data. In one example, two bits may be used to represent the number of partitions. One or more bits can be used to indicate the number of data partitions (or partition count). Other coding schemes can also be used to code the number of partitions into the bitstream. The following list indicates how two bits can represent the number of partitions:
BIT 1 BIT 2 NUMBER OF PARTITIONS
0 0 One partition
0 1 Two partitions
1 0 Four partitions
1 1 Eight partitions
If the number of data partitions is greater than one, decoder 21 also needs information about the positions of the data partitions 36 within the compressed bitstream 26. The offsets of each partition 42 (also referred to as partition location offsets) enable direct access to each partition during decoding.
In one example, offset of each partition 42 can be relative to the beginning of the bitstream and can be encoded and written into the bitstream 26. In another example, the offset for each data partition can be encoded and written into the bitstream except for the first partition since the first partition implicitly begins in the bitstream 26 after the offsets of each partition 42. The foregoing is merely exemplary. Other suitable data structures, flags or records such words and bytes, can be used to transmit partition count and partition location offset information.
Although the number of data partitions can be the same for each frame 17 throughout the input video sequence 16, the number of data partitions may also differ from frame to frame. Accordingly, each frame 17 would have a different number of partitions 40. The number of bits that are used to represent the number of partitions may also differ from frame to frame. Accordingly, each frame 17 could be divided into varying numbers of partitions.
Once the data has been compressed into bit stream 26 with the proper partition data information (i.e. number of partitions 40 and offsets of partitions 42), decoder 21 can decode the data partitions 36 on a multi-core processor in parallel. In this manner, each processor core may be responsible for decoding one of the data partitions 36. Since multi-core processors typically have more than one processing core and shared memory space, the workload can be allocated between each core as evenly as possible. Each core can use the shared memory space as an efficient way of sharing data between each core decoding each data partition 36.
For example, if there are two processors decoding two partitions, respectively, the first processor will begin decoding the first partition. The second processor can then decode macroblocks of the second partition and can use information received from the first processor, which has begun decoding macroblocks of the first partition. Concurrently with the second processor, the first processor can continue decoding macroblocks of the first partition and can use information received from the second processor. Accordingly, both the first and second processors can have the information necessary to properly decode macroblocks in their respective partitions.
Furthermore, as discussed in more detail below, when decoding a macroblock row of the second partition that is dependent on the first partition, a macroblock that is currently being processed in the second partition is offset by a specified number of macroblocks. In this manner, at least a portion of the output of the decoding of the first partition can be used as input in the decoding of the macroblock that is currently being processed in the second partition. Likewise, when decoding a macroblock row of the first partition that is dependent on the second partition, a macroblock that is currently being processed in the first partition is offset by a specified number of macroblocks so that at least a portion of the output of the decoding of the second partition can be used as input in the decoding of the macroblock that is currently being processed in the first partition.
When decoding the compressed bitstream, decoder 21 determines the number of threads needed to decode the data, which can be based on the number of partitions 40 in each encoded frame 39. For example, if number of partitions 40 indicates that there are four partitions in encoded frame 39, decoder 21 creates four threads with each thread decoding one of the data partitions. Referring to FIG. 4 , as an example, decoder 21 can determine that four data partitions have been created. Hence, if decoder 21 is using a multi-core processor, it can create four separate threads to decode the data from that specific frame.
As discussed previously, macroblocks 20 within each frame use context data from neighboring macroblocks when being encoded. When decoding macroblocks 20, the decoder will need the same context data in order to decode the macroblocks properly. On the decoder side, the context data can be available only after the neighboring macroblocks have already been decoded by the current thread or other threads. In order to decode properly, the decoder includes a staging and synchronization mechanism for managing the decoding of the multiple threads.
With reference to FIGS. 6A and 6B, a time diagram shows the staging and synchronization mechanism to decode partitions 36 on threads of a multi-core processor in accordance with an embodiment of the present invention. FIGS. 6A and 6B illustrate an exemplary partial image frame 45 at various stages of the decoding process. The example is simplified for purposes of this disclosure and the number of partitions 36 is limited to three. Each partition 36 can be assigned to one of the three threads 46, 48 and 50. As discussed previously, each partition 36 includes contiguous macroblocks.
As depicted in FIGS. 6A and 6B, as an example, three threads 46, 48 and 50 arc shown, and each of threads 46, 48 and 50 are capable of performing decoding in parallel with each other. Each of the three threads 46, 48 and 50 processes one partition in a serial manner while all three partitions 40 are processed in parallel with each other.
Each of FIGS. 6A and 6B contain an arrow that illustrates which macroblock is currently being decoded in each macroblock row, which macroblocks have been decoded in each macroblock row, and which macroblocks have yet to be decoded in each macroblock row. If the arrow is pointing to a specific macroblock, that macroblock is currently being decoded. Any macroblock to the left of the arrow (if any) has already been decoded in that row. Any macroblock to the right of the arrow has yet to be decoded. Although the macroblocks illustrated in FIGS. 6A and 6B all have similar sizes, the techniques of this disclosure are not limited in this respect. Other block sizes, as discussed previously, can also be used with embodiments of the present invention.
Referring to FIG. 6A, at time t1, thread 46 has initiated decoding of a first macroblock row 52. Thread 46 is currently processing macroblock j in first macroblock row 52 as shown by arrow 58. Macroblocks 0 to j−1 have already been decoded in first macroblock row 52. Macroblocks j+1 to the end of first macroblock row 52 have yet to be decoded in first macroblock row 52. Thread 48 has also initiated decoding of a second macroblock row 54. Thread 48 is currently processing macroblock 0 in second macroblock row 54 as shown by arrow 60. Macroblocks 1 to the end of second macroblock row 54 have been decoded in second macroblock row 54. Thread 50 has not begun decoding of a third macroblock row 56. No macroblocks have been decoded or are currently being decoded in third macroblock row 56.
Referring to FIG. 6B, at time t2, thread 46 has continued decoding of first macroblock row 52. Thread 46 is currently processing macroblock j*2 in first macroblock row 52 as shown by arrow 62. Macroblocks 0 to j*2-1 have already been decoded in first macroblock row 52. Macroblocks j*2+1 to the end of first macroblock row 52 have yet to be decoded in first macroblock row 52. Thread 48 has also continued decoding of second macroblock row 54. Thread 48 is currently processing macroblock j in second macroblock row 54 as shown by arrow 64. Macroblocks 0 to j−1 have already been decoded in second macroblock row 54. Macroblocks j+1 to the end of second macroblock row 54 have yet to be decoded in second macroblock row 54. Thread 50 has also initiated decoding of a third macroblock row 56. Thread 50 is currently processing macroblock 0 in third macroblock row 56 as shown by arrow 66. Macroblocks 1 to the end of third macroblock row 56 have yet to be decoded in third macroblock row 56.
Previous decoding mechanisms were unable to efficiently use a multi-core processor to decode a compressed bitstream because processing of a macroblock row could not be initiated until the upper adjacent macroblock row had been completely decoded. The difficulty of previous decoding mechanisms stems from the encoding phase. When data is encoded using traditional encoding techniques, spatial dependencies within macroblocks imply a specific order of processing of the macroblocks. Furthermore, once the frame has been encoded, a specific macroblock row cannot be discerned until the row has been completely decoded. Accordingly, video coding methods incorporating entropy coding methods such as CABAC created serialized dependencies which were passed to the decoder. As a result of these serialized dependencies, decoding schemes had limited efficiency because information for each computer processing system ( e.g. threads 46, 48 and 50) was not available until the decoding process has been completed on that macroblock row.
Utilizing the parallel processing staging and synchronization mechanism illustrated in FIGS. 6A and 6B allows decoder 21 to efficiently accelerate the decoding process of image frames. Because each partition 36 can be subject to a separate decoding process, interdependencies between partitions can be managed by embodiments of the staging and synchronization scheme discussed previously in connection with FIGS. 6A and 6B. Using this staging and synchronization decoding scheme, each thread 46, 48 and 50 that decodes an assigned partition can exploit context data from neighboring macroblocks. Thus, decoder 21 can decode macroblocks that contain context data necessary to decode a current macroblock before the preceding macroblock row has been completely decoded.
Referring again to FIGS. 6A and 6B, offset j can be determined by examining the size of the context data used in the preceding macroblock row (e.g. measured in a number of macroblocks) during the encoding process. Offset j can be represented in frame 17 by a bit, a byte or any other record that can relay the size of the context data to decoder 21. FIGS. 7A and 7B illustrate two alternatives for the size of offset j.
Referring to FIG. 7A, in one embodiment, current macroblock 68 is currently being processed. Current macroblock 68 uses context data from the left, top-left, top and top-right macroblocks during encoding. In other words, current macroblock 68 uses information from macroblocks: (r+1, c−1), (r, c−1), (r, c) and (r, c+1). In order to properly decode current macroblock 68, macroblocks (r+1, c−1), (r, c−1), (r, c) and (r, c+1) should be decoded before current macroblock 68. Since, as discussed previously, decoding of macroblocks can be performed in a serial fashion, macroblock (r+1, c−1) can be decoded before current macroblock 68. Further, in the preceding macroblock row (i.e. macroblock row r), since the encoding process uses (r, c+1) as the rightmost macroblock, the decoder can use (r, c+1) as the rightmost macroblock during decoding as well. Thus, offset j can be determined by subtracting the column row position of rightmost macroblock of the preceding row used during encoding of the current macroblock from the column row position of the current macroblock being processed. In FIG. 7A, offset j would be determined by subtracting the column row position of macroblock (r, c+1) from the column position of current macroblock 68 (i.e. (r+1, c)), or c+1−c, giving rise to an offset of 1.
Referring to FIG. 7B, in one embodiment, current macroblock 68′ is currently being processed. Current macroblock 68′ uses information from macroblocks: (r+1, c−1), (r, c−1), (r, c), (r, c+1), (r, c+2), and (r, c+3). In order to properly decode current macroblock 68′, macroblocks (r+1, c−1), (r, c−1), (r, c) (r, c+1), (r, c+2) and (r, c+3) should be decoded before current macroblock 68′. Since, as discussed previously, decoding of macroblocks can be performed in a serial fashion, macroblock (r+1, c−1) can be decoded before current macroblock 68′. Further, in the preceding macroblock row (i.e. macroblock row r), since the encoding process uses (r, c+3) as the rightmost macroblock, the decoder can use (r, c+3) as the rightmost macroblock during decoding as well. As discussed previously, offset j can be determined by subtracting the column row position of rightmost macroblock of the preceding row used during encoding of the current macroblock from the column row position of the current macroblock being processed. In FIG. 7A, offset j would be calculated by subtracting the column row position of macroblock (r, c+3) from the column position of current macroblock 68′ (i.e. (r+1, c)), or c+3−c, giving rise to an offset of 3.
In the preferred embodiment, the offset can be determined by the specific requirements of the codec. In alternative embodiments, the offset can be specified in the bitstream.
While the invention has been described in connection with certain embodiments, it is to be understood that the invention is not to he limited to the disclosed embodiments but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims, which scope is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures as is permitted under the law.

Claims (25)

What is claimed is:
1. An apparatus for decoding frames of a compressed video data stream, including at least one frame divided into partitions, the apparatus comprising:
a memory; and
a processor configured to execute instructions stored in the memory to:
read, from the compressed video data stream, partition data information indicative of a partition location with respect to the compressed video data stream for at least one of the partitions;
decode, from the compressed video data stream, a first partition of the partitions that includes a first sequence of blocks; and
decode, from the compressed video data stream, a second partition of the partitions that includes a second sequence of blocks identified based on the partition location indicated by the partition data information, using decoded information of the first partition;
wherein the first partition and the second partition have each been individually compressed; and
output or store a decoded frame including the first sequence of blocks and the second sequence of blocks.
2. The apparatus of claim 1, wherein the decoding includes decoding lossless coded information.
3. The apparatus of claim 1, wherein the processor is further configured to identify one row of blocks in the frame having a boundary between the first partition and the second partition.
4. The apparatus of claim 1, wherein the first partition includes contiguous blocks in at least a portion of a first row and at least a portion of a first subsequent row.
5. The apparatus of claim 4, wherein the second partition includes contiguous blocks in at least a portion of a second row and at least a portion of a second subsequent row.
6. The apparatus of claim 1, wherein the first partition comprises blocks of two or more contiguous rows of blocks.
7. The apparatus of claim 1, wherein the processor is further configured to decode the second sequence of blocks using context information contained in the first sequence of blocks.
8. The apparatus of claim 7, wherein the processor is further configured to perform at least one of intra-frame prediction or inter-frame prediction on the second partition.
9. The apparatus of claim 7, wherein the processor decodes the second partition with an offset of a specified number of blocks such that at least a portion of decoded context information of the first sequence of blocks is available as context data for decoding at least one block in the second partition.
10. The apparatus of claim 9, wherein the offset is determined based upon size of the context.
11. The apparatus of claim 7, wherein the first sequence of blocks in the first partition and the second sequence of blocks in the second partition are derived from corresponding rows of blocks in two successive frames of the video data, and wherein the processor is further configured to:
decode at least one block in the second partition using information from a block previously decoded.
12. The apparatus of claim 1, wherein the decoding includes context-based arithmetic coding.
13. A non-transitory computer-readable storage medium having stored thereon an encoded bitstream, including at least one frame divided into individually compressed partitions, wherein the encoded bitstream is configured for decoding by operations comprising:
reading, from the encoded bitstream, partition data information indicative of a partition location with respect to the encoded bitstream for at least one of the partitions;
decoding, from the encoded bitstream, a first partition of the partitions that includes a first sequence of blocks;
decoding, from the encoded bitstream, a second partition of the partitions that includes a second sequence of blocks identified based on the partition location indicated by the partition data information, using decoded information of the first partition; and
outputting or storing a decoded frame including the first sequence of blocks and the second sequence of blocks.
14. The non-transitory computer-readable storage medium of claim 13, wherein the decoding includes decoding losslessly coded information.
15. The non-transitory computer-readable storage medium of claim 13, wherein the decoding includes decoding the second sequence of blocks using context information contained in the first sequence of blocks.
16. The non-transitory computer-readable storage medium of claim 15, wherein the decoding includes decoding the second partition with an offset of a specified number of blocks such that at least a portion of decoded context information of the first sequence of blocks is available as context data for decoding at least one block in the second partition.
17. The non-transitory computer-readable storage medium of claim 16, wherein the offset is determined based upon size of the context.
18. The non-transitory computer-readable storage medium of claim 15, wherein the first sequence of blocks in the first partition and the second sequence of blocks in the second partition are derived from corresponding rows of blocks in two successive frames of the video data, and wherein the decoding includes:
decoding at least one block in the second partition using information from a block previously decoded.
19. The non-transitory computer-readable storage medium of claim 13, wherein the decoding includes context-based arithmetic coding.
20. An apparatus for encoding frames of a video, including at least one frame divided into partitions, the apparatus comprising:
a memory; and
a processor configured to execute instructions stored in the memory to:
encode, into a compressed video data stream, a first partition of the partitions that includes a first sequence of blocks;
encode, into the compressed video data stream, at a partition location with respect to the compressed video data stream, a second partition of the partitions that includes a second sequence of blocks encoded using information of the first partition;
include, in the compressed video data stream, partition data information indicative of the partition location with respect to the compressed video data stream for at least one of the partitions; and
output or store the compressed video data stream.
21. The apparatus of claim 20, wherein the processor is configured to execute the instructions to use context information from the first sequence of blocks to encode the second sequence of blocks.
22. The apparatus of claim 21, wherein the processor is configured to execute the instructions to encode the second partition with an offset of a specified number of blocks such that at least a portion of context information from the first sequence of blocks is available as context data for encoding at least one block in the second partition.
23. The apparatus of claim 22, wherein the offset is determined based upon size of the context.
24. The apparatus of claim 22, wherein the first sequence of blocks in the first partition and the second sequence of blocks in the second partition are derived from corresponding rows of blocks in two successive frames of the video data, and the processor is configured to execute the instructions to:
use information from a block previously decoded to encode at least one block in the second partition.
25. The apparatus of claim 24, wherein to encode the processor is configured to execute the instructions to use context-based arithmetic coding.
US17/200,761 2008-09-11 2021-03-12 System and method for decoding using parallel processing Active 2029-08-16 USRE49727E1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US17/200,761 USRE49727E1 (en) 2008-09-11 2021-03-12 System and method for decoding using parallel processing
US18/500,144 US20240080482A1 (en) 2008-09-11 2023-11-02 System And Method For Decoding Using Parallel Processing

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US9622308P 2008-09-11 2008-09-11
US12/329,248 US8311111B2 (en) 2008-09-11 2008-12-05 System and method for decoding using parallel processing
US13/565,364 US9357223B2 (en) 2008-09-11 2012-08-02 System and method for decoding using parallel processing
US15/165,577 US10230986B2 (en) 2008-09-11 2016-05-26 System and method for decoding using parallel processing
US17/200,761 USRE49727E1 (en) 2008-09-11 2021-03-12 System and method for decoding using parallel processing

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US15/165,577 Reissue US10230986B2 (en) 2008-09-11 2016-05-26 System and method for decoding using parallel processing

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/500,144 Continuation US20240080482A1 (en) 2008-09-11 2023-11-02 System And Method For Decoding Using Parallel Processing

Publications (1)

Publication Number Publication Date
USRE49727E1 true USRE49727E1 (en) 2023-11-14

Family

ID=41799267

Family Applications (5)

Application Number Title Priority Date Filing Date
US12/329,248 Active 2031-07-12 US8311111B2 (en) 2008-09-11 2008-12-05 System and method for decoding using parallel processing
US13/565,364 Active 2031-07-05 US9357223B2 (en) 2008-09-11 2012-08-02 System and method for decoding using parallel processing
US15/165,577 Ceased US10230986B2 (en) 2008-09-11 2016-05-26 System and method for decoding using parallel processing
US17/200,761 Active 2029-08-16 USRE49727E1 (en) 2008-09-11 2021-03-12 System and method for decoding using parallel processing
US18/500,144 Pending US20240080482A1 (en) 2008-09-11 2023-11-02 System And Method For Decoding Using Parallel Processing

Family Applications Before (3)

Application Number Title Priority Date Filing Date
US12/329,248 Active 2031-07-12 US8311111B2 (en) 2008-09-11 2008-12-05 System and method for decoding using parallel processing
US13/565,364 Active 2031-07-05 US9357223B2 (en) 2008-09-11 2012-08-02 System and method for decoding using parallel processing
US15/165,577 Ceased US10230986B2 (en) 2008-09-11 2016-05-26 System and method for decoding using parallel processing

Family Applications After (1)

Application Number Title Priority Date Filing Date
US18/500,144 Pending US20240080482A1 (en) 2008-09-11 2023-11-02 System And Method For Decoding Using Parallel Processing

Country Status (7)

Country Link
US (5) US8311111B2 (en)
EP (1) EP2324639B1 (en)
JP (1) JP5400888B2 (en)
KR (1) KR20110053243A (en)
CN (1) CN102150425B (en)
CA (1) CA2736888A1 (en)
WO (1) WO2010030752A2 (en)

Families Citing this family (78)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7386048B2 (en) 2002-05-28 2008-06-10 Sharp Laboratories Of America, Inc. Methods and systems for image intra-prediction mode organization
US7515710B2 (en) 2006-03-14 2009-04-07 Divx, Inc. Federated digital rights management scheme including trusted systems
US8311111B2 (en) 2008-09-11 2012-11-13 Google Inc. System and method for decoding using parallel processing
KR101590633B1 (en) * 2008-11-11 2016-02-02 삼성전자주식회사 / /apparatus for processing video encoding and decoding using video separation based on slice level and method therefor
WO2010080911A1 (en) 2009-01-07 2010-07-15 Divx, Inc. Singular, collective and automated creation of a media guide for online content
WO2011068668A1 (en) 2009-12-04 2011-06-09 Divx, Llc Elementary bitstream cryptographic material transport systems and methods
EP2534643A4 (en) * 2010-02-11 2016-01-06 Nokia Technologies Oy Method and apparatus for providing multi-threaded video decoding
JP5914962B2 (en) * 2010-04-09 2016-05-11 ソニー株式会社 Image processing apparatus and method, program, and recording medium
KR101673186B1 (en) * 2010-06-09 2016-11-07 삼성전자주식회사 Apparatus and method of processing in parallel of encoding and decoding of image data by using correlation of macroblock
KR101698797B1 (en) * 2010-07-27 2017-01-23 삼성전자주식회사 Apparatus of processing in parallel of encoding and decoding of image data by partitioning and method of the same
US8344917B2 (en) * 2010-09-30 2013-01-01 Sharp Laboratories Of America, Inc. Methods and systems for context initialization in video coding and decoding
US8611415B1 (en) 2010-11-15 2013-12-17 Google Inc. System and method for coding using improved motion estimation
GB2486692B (en) * 2010-12-22 2014-04-16 Canon Kk Method for encoding a video sequence and associated encoding device
US8914534B2 (en) 2011-01-05 2014-12-16 Sonic Ip, Inc. Systems and methods for adaptive bitrate streaming of media stored in matroska container files using hypertext transfer protocol
US9497466B2 (en) * 2011-01-17 2016-11-15 Mediatek Inc. Buffering apparatus for buffering multi-partition video/image bitstream and related method thereof
US8990435B2 (en) 2011-01-17 2015-03-24 Mediatek Inc. Method and apparatus for accessing data of multi-tile encoded picture stored in buffering apparatus
US20120314775A1 (en) * 2011-06-08 2012-12-13 Vixs Systems, Inc. Video decoder with transposing vector processor and methods for use therewith
US8767824B2 (en) 2011-07-11 2014-07-01 Sharp Kabushiki Kaisha Video decoder parallelization for tiles
US9467708B2 (en) 2011-08-30 2016-10-11 Sonic Ip, Inc. Selection of resolutions for seamless resolution switching of multimedia content
US8909922B2 (en) 2011-09-01 2014-12-09 Sonic Ip, Inc. Systems and methods for playing back alternative streams of protected content protected using common cryptographic information
US8964977B2 (en) 2011-09-01 2015-02-24 Sonic Ip, Inc. Systems and methods for saving encoded media streamed using adaptive bitrate streaming
EP2740270A4 (en) 2011-10-31 2015-04-29 Mediatek Inc Apparatus and method for buffering context arrays referenced for performing entropy decoding upon multi-tile encoded picture and related entropy decoder
US9124895B2 (en) * 2011-11-04 2015-09-01 Qualcomm Incorporated Video coding with network abstraction layer units that include multiple encoded picture partitions
US9077998B2 (en) * 2011-11-04 2015-07-07 Qualcomm Incorporated Padding of segments in coded slice NAL units
TWI470575B (en) * 2011-11-24 2015-01-21 Mediatek Inc Method for read pointer maintenance of a buffering apparatus, buffer controller and buffer apparatus
US9565476B2 (en) * 2011-12-02 2017-02-07 Netzyn, Inc. Video providing textual content system and method
US9100657B1 (en) 2011-12-07 2015-08-04 Google Inc. Encoding time management in parallel real-time video encoding
CN104041031B (en) 2011-12-29 2018-04-24 Lg电子株式会社 Video coding and coding/decoding method and the device using this method
US9332259B2 (en) 2012-01-18 2016-05-03 Qualcomm Incorporated Indication of use of wavefront parallel processing in video coding
US20130188732A1 (en) * 2012-01-20 2013-07-25 Qualcomm Incorporated Multi-Threaded Texture Decoding
US20130204962A1 (en) * 2012-02-02 2013-08-08 Texas Instruments Incorporated Network and peripheral interface circuits, systems and processes
US9185429B1 (en) 2012-04-30 2015-11-10 Google Inc. Video encoding and decoding using un-equal error protection
US9113164B1 (en) 2012-05-15 2015-08-18 Google Inc. Constant bit rate control using implicit quantization values
JP6080405B2 (en) 2012-06-29 2017-02-15 キヤノン株式会社 Image encoding device, image encoding method and program, image decoding device, image decoding method and program
US9426498B2 (en) * 2012-07-10 2016-08-23 Broadcom Corporation Real-time encoding system of multiple spatially scaled video based on shared video coding information
CN102769750A (en) * 2012-07-12 2012-11-07 国家计算机网络与信息安全管理中心 Many-core-based decoding method and decoding equipment
CN102761487B (en) * 2012-07-12 2016-04-27 国家计算机网络与信息安全管理中心 data flow processing method and system
US9510019B2 (en) 2012-08-09 2016-11-29 Google Inc. Two-step quantization and coding method and apparatus
US9491461B2 (en) * 2012-09-27 2016-11-08 Qualcomm Incorporated Scalable extensions to HEVC and temporal motion vector prediction
US9826229B2 (en) 2012-09-29 2017-11-21 Google Technology Holdings LLC Scan pattern determination from base layer pixel information for scalable extension
US9407915B2 (en) 2012-10-08 2016-08-02 Google Inc. Lossless video coding with sub-frame level optimal quantization values
US9350988B1 (en) 2012-11-20 2016-05-24 Google Inc. Prediction mode-based block ordering in video coding
CN107318027B (en) * 2012-12-27 2020-08-28 日本电信电话株式会社 Image encoding/decoding method, image encoding/decoding device, and image encoding/decoding program
US9313510B2 (en) 2012-12-31 2016-04-12 Sonic Ip, Inc. Use of objective quality measures of streamed content to reduce streaming bandwidth
US9191457B2 (en) 2012-12-31 2015-11-17 Sonic Ip, Inc. Systems, methods, and media for controlling delivery of content
US9681128B1 (en) 2013-01-31 2017-06-13 Google Inc. Adaptive pre-transform scanning patterns for video and image compression
KR101932539B1 (en) * 2013-02-18 2018-12-27 한화테크윈 주식회사 Method for recording moving-image data, and photographing apparatus adopting the method
US10397292B2 (en) 2013-03-15 2019-08-27 Divx, Llc Systems, methods, and media for delivery of content
US9906785B2 (en) * 2013-03-15 2018-02-27 Sonic Ip, Inc. Systems, methods, and media for transcoding video data according to encoding parameters indicated by received metadata
US9094737B2 (en) 2013-05-30 2015-07-28 Sonic Ip, Inc. Network video streaming with trick play based on separate trick play files
US11228769B2 (en) * 2013-06-03 2022-01-18 Texas Instruments Incorporated Multi-threading in a video hardware engine
US9967305B2 (en) 2013-06-28 2018-05-08 Divx, Llc Systems, methods, and media for streaming media content
US9247251B1 (en) 2013-07-26 2016-01-26 Google Inc. Right-edge extension for quad-tree intra-prediction
JP6242139B2 (en) * 2013-10-02 2017-12-06 ルネサスエレクトロニクス株式会社 Video decoding processing apparatus and operation method thereof
US9866878B2 (en) 2014-04-05 2018-01-09 Sonic Ip, Inc. Systems and methods for encoding and playing back video at different frame rates using enhancement layers
US20160191935A1 (en) * 2014-04-22 2016-06-30 Mediatek Inc. Method and system with data reuse in inter-frame level parallel decoding
US9143161B1 (en) 2014-04-25 2015-09-22 International Business Machines Corporation Field level compression in parallel data flows
CN105100803B (en) * 2014-04-29 2018-12-18 三星电子(中国)研发中心 Video decoding optimization method
KR20160070512A (en) 2014-12-10 2016-06-20 삼성전자주식회사 Semiconductor device and operating method thereof
CN105376583B (en) * 2015-04-07 2017-02-22 佛山世寰智能科技有限公司 Multi-core parallel video decoding method for allocating tasks and data by row in staggered manner
CN106210728B (en) * 2015-04-10 2019-08-30 上海澜至半导体有限公司 For the decoded circuit of video, method and Video Decoder
WO2016199330A1 (en) * 2015-06-12 2016-12-15 パナソニックIpマネジメント株式会社 Image coding method, image decoding method, image coding device and image decoding device
KR102576630B1 (en) * 2015-12-10 2023-09-08 삼성전자주식회사 An operation method of a decoder, and an operation method of an application processor including the decoder
US9794574B2 (en) 2016-01-11 2017-10-17 Google Inc. Adaptive tile data size coding for video and image compression
US10542258B2 (en) 2016-01-25 2020-01-21 Google Llc Tile copying for video compression
KR101974261B1 (en) * 2016-06-24 2019-04-30 한국과학기술원 Encoding method and apparatus comprising convolutional neural network(cnn) based in-loop filter, and decoding method and apparatus comprising convolutional neural network(cnn) based in-loop filter
CN108063948B (en) * 2016-11-08 2020-08-04 联发科技股份有限公司 Image processing device and image processing method matched with multiple processors
JP6505142B2 (en) * 2017-01-18 2019-04-24 キヤノン株式会社 Image encoding device, image encoding method and program, image decoding device, image decoding method and program
US10498795B2 (en) 2017-02-17 2019-12-03 Divx, Llc Systems and methods for adaptive switching between multiple content delivery networks during adaptive bitrate streaming
GB2579462B (en) * 2017-08-24 2022-02-16 Toyota Motor Europe System and method for label augmentation in video data
GB2570879B (en) * 2018-02-06 2022-08-17 Advanced Risc Mach Ltd Encoding data arrays
CN111447453B (en) * 2020-03-31 2024-05-17 西安万像电子科技有限公司 Image processing method and device
CN112702598B (en) * 2020-12-03 2024-06-04 浙江智慧视频安防创新中心有限公司 Method, device, electronic equipment and medium for encoding and decoding based on displacement operation
US20220236399A1 (en) * 2021-01-27 2022-07-28 Texas Instruments Incorporated System and method for the compression of echolocation data
US11516477B2 (en) 2021-02-11 2022-11-29 Qualcomm Incorporated Intra block copy scratch frame buffer
CN113259675B (en) * 2021-05-06 2021-10-01 北京中科大洋科技发展股份有限公司 Ultrahigh-definition video image parallel processing method
CN116114245A (en) 2021-09-02 2023-05-12 辉达公司 Parallel processing of video frames during video encoding
WO2023028965A1 (en) * 2021-09-02 2023-03-09 Nvidia Corporation Hardware codec accelerators for high-performance video encoding

Citations (181)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3825832A (en) 1971-06-03 1974-07-23 Ibm Method and device for coding and decoding video signals
US4719642A (en) 1985-02-27 1988-01-12 Scientific Atlanta, Inc. Error detection and concealment using predicted signal values
US4729127A (en) 1981-10-20 1988-03-01 The United States Of America As Represented By The Secretary Of The Army Method and system for compression and reconstruction of cultural data for use in a digital moving map display
US4736446A (en) 1985-03-29 1988-04-05 Quad-Tech Inc. Cutoff control system
US4797729A (en) 1988-02-05 1989-01-10 Eastman Kodak Company System incorporating an error tolerant picture compression algorithm
US4868764A (en) 1986-04-14 1989-09-19 U.S. Philips Corporation Image encoding and decoding method and apparatus
US4891748A (en) 1986-05-30 1990-01-02 Mann Ralph V System and method for teaching physical skills
US5068724A (en) 1990-06-15 1991-11-26 General Instrument Corporation Adaptive motion compensation for digital television
US5083214A (en) 1990-05-02 1992-01-21 Eastman Kodak Company Apparatus and methods for extracting data from a scanned bit-mapped data strip
US5091782A (en) 1990-04-09 1992-02-25 General Instrument Corporation Apparatus and method for adaptively compressing successive blocks of digital video
US5136376A (en) 1989-10-14 1992-08-04 Sony Corporation Method of coding video signals and transmission system thereof
US5136371A (en) 1990-03-15 1992-08-04 Thomson Consumer Electronics, Inc. Digital image coding using random scanning
US5164819A (en) 1991-04-03 1992-11-17 Music John D Method and system for coding and compressing color video signals
US5225832A (en) 1992-02-13 1993-07-06 Industrial Technology Research Institute High speed variable length decoder
US5270812A (en) 1990-07-20 1993-12-14 U.S. Philips Corporation Method of encoding image pixel values for storage as compressed digital data and method of decoding the compressed digital data
US5274442A (en) 1991-10-22 1993-12-28 Mitsubishi Denki Kabushiki Kaisha Adaptive blocking image signal coding system
US5313306A (en) 1991-05-13 1994-05-17 Telerobotics International, Inc. Omniview motionless camera endoscopy system
US5341440A (en) 1991-07-12 1994-08-23 Earl Joseph G Method and apparatus for increasing information compressibility
US5381145A (en) 1993-02-10 1995-01-10 Ricoh Corporation Method and apparatus for parallel decoding and encoding of data
US5432870A (en) 1993-06-30 1995-07-11 Ricoh Corporation Method and apparatus for compressing and decompressing images of documents
US5452006A (en) 1993-10-25 1995-09-19 Lsi Logic Corporation Two-part synchronization scheme for digital video decoders
US5561477A (en) 1994-10-26 1996-10-01 Thomson Consumer Electronics, Inc. System for coding a video signal in the presence of an image intensity gradient
US5576767A (en) 1993-02-03 1996-11-19 Qualcomm Incorporated Interframe video encoding and decoding system
US5576765A (en) 1994-03-17 1996-11-19 International Business Machines, Corporation Video decoder
US5589945A (en) 1993-01-11 1996-12-31 Abecassis; Max Computer-themed playing system
US5604539A (en) 1992-08-21 1997-02-18 Canon Kabushiki Kaisha Image processing method and apparatus
US5646690A (en) 1994-06-14 1997-07-08 Dacwoo Electronics Co., Ltd. Apparatus for parallel decoding of digital video signals
US5659539A (en) 1995-07-14 1997-08-19 Oracle Corporation Method and apparatus for frame accurate access of digital audio-visual information
US5696869A (en) 1992-02-07 1997-12-09 Max Abecassis Variable-content-video provider system
US5734744A (en) 1995-06-07 1998-03-31 Pixar Method and apparatus for compression and decompression of color data
US5737020A (en) 1995-03-27 1998-04-07 International Business Machines Corporation Adaptive field/frame encoding of discrete cosine transform
US5748247A (en) 1996-04-08 1998-05-05 Tektronix, Inc. Refinement of block motion vectors to achieve a dense motion field
US5774593A (en) 1995-07-24 1998-06-30 University Of Washington Automatic scene decomposition and optimization of MPEG compressed video
US5793647A (en) 1995-08-15 1998-08-11 Diffracto, Ltd. System and method for graphical image data acquistion, storage, and retrieval
US5794179A (en) 1995-07-27 1998-08-11 Victor Company Of Japan, Ltd. Method and apparatus for performing bit-allocation coding for an acoustic signal of frequency region and time region correction for an acoustic signal and method and apparatus for decoding a decoded acoustic signal
US5818969A (en) 1995-05-12 1998-10-06 Intel Corporation Intelligent start for motion estimation search
US5818530A (en) * 1996-06-19 1998-10-06 Thomson Consumer Electronics, Inc. MPEG compatible decoder including a dual stage data reduction network
US5828370A (en) 1996-07-01 1998-10-27 Thompson Consumer Electronics Inc. Video delivery system and method for displaying indexing slider bar on the subscriber video screen
US5835144A (en) 1994-10-13 1998-11-10 Oki Electric Industry Co., Ltd. Methods of coding and decoding moving-picture signals, using self-resynchronizing variable-length codes
US5883671A (en) 1996-06-05 1999-03-16 Matsushita Electric Industrial Co., Ltd. Method and apparatus for partitioning compressed digital video bitstream for decoding by multiple independent parallel decoders
US5929940A (en) 1995-10-25 1999-07-27 U.S. Philips Corporation Method and device for estimating motion between images, system for encoding segmented images
US5930493A (en) 1995-06-07 1999-07-27 International Business Machines Corporation Multimedia server system and method for communicating multimedia information
US5963203A (en) 1997-07-03 1999-10-05 Obvious Technology, Inc. Interactive video icon with designated viewing position
US5999641A (en) 1993-11-18 1999-12-07 The Duck Corporation System for manipulating digitized image objects in three dimensions
US6014706A (en) 1997-01-30 2000-01-11 Microsoft Corporation Methods and apparatus for implementing control functions in a streamed video display system
US6041145A (en) 1995-11-02 2000-03-21 Matsushita Electric Industrial Co., Ltd. Device and method for smoothing picture signal, device and method for encoding picture and device and method for decoding picture
US6061397A (en) 1994-04-19 2000-05-09 Sony Corporation Motion vector detecting device
US6084908A (en) 1995-10-25 2000-07-04 Sarnoff Corporation Apparatus and method for quadtree based variable block size motion estimation
US6108383A (en) 1997-07-15 2000-08-22 On2.Com, Inc. Method and apparatus for compression and decompression of video images
US6112234A (en) 1997-07-01 2000-08-29 Leiper; Thomas W. Method for transfer of radiographic images
US6115501A (en) 1995-07-10 2000-09-05 Hyundai Electronics Industries Co., Ltd. Grid moving method for minimizing image information of an object
US6119154A (en) 1995-07-14 2000-09-12 Oracle Corporation Method and apparatus for non-sequential access to an in-progress video feed
US6141381A (en) 1997-04-25 2000-10-31 Victor Company Of Japan, Ltd. Motion compensation encoding apparatus and motion compensation encoding method for high-efficiency encoding of video information through selective use of previously derived motion vectors in place of motion vectors derived from motion estimation
US6160846A (en) 1995-10-25 2000-12-12 Sarnoff Corporation Apparatus and method for optimizing the rate control in a coding system
US6167164A (en) 1997-03-10 2000-12-26 Samsung Electronics Co., Ltd. One-dimensional signal adaptive filter for reducing blocking effect and filtering method
US6181742B1 (en) 1998-01-26 2001-01-30 International Business Machines Corporation Single pass target allocation for video encoding
US6181822B1 (en) 1993-05-12 2001-01-30 The Duck Corporation Data compression apparatus and method
US6185363B1 (en) 1997-06-02 2001-02-06 Philips Electronics North America Corporation Visual indexing system
US6188799B1 (en) 1997-02-07 2001-02-13 Matsushita Electric Industrial Co., Ltd. Method and apparatus for removing noise in still and moving pictures
US6240135B1 (en) 1997-09-09 2001-05-29 Lg Electronics Inc Method of removing blocking artifacts in a coding system of a moving picture
US6292837B1 (en) 1997-10-30 2001-09-18 Daniel Miller Apparatus and method for non-sequential image data transmission and display
US6327304B1 (en) 1993-05-12 2001-12-04 The Duck Corporation Apparatus and method to digitally compress video signals
US20020012396A1 (en) 2000-05-05 2002-01-31 Stmicroelectronics S.R.L. Motion estimation process and system
US20020031184A1 (en) 1998-07-15 2002-03-14 Eiji Iwata Encoding apparatus and method of same and decoding apparatus and method of same
US6366704B1 (en) 1997-12-01 2002-04-02 Sharp Laboratories Of America, Inc. Method and apparatus for a delay-adaptive rate control scheme for the frame layer
US20020039386A1 (en) 2000-07-13 2002-04-04 Tae-Hee Han Block matching processor and method for block matching motion estimation in video compression
US6400763B1 (en) 1999-02-18 2002-06-04 Hewlett-Packard Company Compression system which re-uses prior motion vectors
US20020168114A1 (en) 2001-02-06 2002-11-14 Valente Stephane Edouard Preprocessing method applied to textures of arbitrarily shaped objects
US6496537B1 (en) * 1996-12-18 2002-12-17 Thomson Licensing S.A. Video decoder with interleaved data processing
US20030023982A1 (en) 2001-05-18 2003-01-30 Tsu-Chang Lee Scalable video encoding/storage/distribution/decoding for symmetrical multiple video processors
US6522784B1 (en) 2000-04-11 2003-02-18 International Business Machines Corporation Enhanced compression of gray-level images
US6529638B1 (en) 1999-02-01 2003-03-04 Sharp Laboratories Of America, Inc. Block boundary artifact reduction for block-based image compression
US6560366B1 (en) 1995-12-16 2003-05-06 Paul Gordon Wilkins Method for analyzing the content of a video signal
US6594315B1 (en) 1996-12-18 2003-07-15 Thomson Licensing S.A. Formatting of recompressed data in an MPEG decoder
US20030189982A1 (en) * 2002-04-01 2003-10-09 Macinnis Alexander System and method for multi-row decoding of video with dependent rows
US20030215018A1 (en) 2002-05-14 2003-11-20 Macinnis Alexander G. System and method for transcoding entropy-coded bitstreams
US20030219072A1 (en) * 2002-05-14 2003-11-27 Macinnis Alexander G. System and method for entropy code preprocessing
US6687303B1 (en) 1999-03-17 2004-02-03 Renesas Technology Corp. Motion vector detecting device
US20040028142A1 (en) 2002-08-08 2004-02-12 Kim Eung Tae Video decoding system
US6697061B1 (en) 1999-01-21 2004-02-24 Hewlett-Packard Development Company, L.P. Image compression featuring selective re-use of prior compression data
US6707952B1 (en) 2000-05-30 2004-03-16 Sharp Laboratories Of America, Inc. Method for removing ringing artifacts from locations near dominant edges of an image reconstructed after compression
JP3510433B2 (en) 1996-11-26 2004-03-29 シャープ株式会社 Image processing device
US20040066852A1 (en) 2002-05-20 2004-04-08 Maclnnis Alexander G. System, method, and apparatus for decoding flexibly ordered macroblocks
US20040120400A1 (en) 2002-12-20 2004-06-24 Lsi Logic Corporation Method and /or apparatus for motion estimation using a hierarchical search followed by a computation split for different block sizes
US6765964B1 (en) 2000-12-06 2004-07-20 Realnetworks, Inc. System and method for intracoding video data
US20040228410A1 (en) * 2003-05-12 2004-11-18 Eric Ameres Video compression method
US20040240556A1 (en) 2003-06-02 2004-12-02 Lsi Logic Corporation Method for improving rate-distortion performance of a video compression system through parallel coefficient cancellation in the transform
US20040258151A1 (en) 2003-06-05 2004-12-23 Stmicroelectronics S.R.L. Method and apparatus for decoding compressed and encoded digital images
US20050050002A1 (en) 2003-07-11 2005-03-03 Benjamin Slotznick Apparatus and method of presenting textual material to enhance readability for people who have difficulty distinguishing left from right
US20050053157A1 (en) * 2003-09-05 2005-03-10 Lillevold Karl O. Parallel video decoding
US6876703B2 (en) 2000-05-11 2005-04-05 Ub Video Inc. Method and apparatus for video coding
US20050117655A1 (en) 2003-11-13 2005-06-02 Mediatek Inc. Video bit stream decoding system and method used in a video decoding apparatus
US20050147165A1 (en) 2004-01-06 2005-07-07 Samsung Electronics Co., Ltd. Prediction encoding apparatus, prediction encoding method, and computer readable recording medium thereof
US20050169374A1 (en) 2004-01-30 2005-08-04 Detlev Marpe Video frame encoding and decoding
US20050210145A1 (en) 2000-07-24 2005-09-22 Vivcom, Inc. Delivering and processing multimedia bookmark
US20050259747A1 (en) * 2004-05-21 2005-11-24 Broadcom Advanced Compression Group, Llc Context adaptive binary arithmetic code decoder for decoding macroblock adaptive field/frame coded video data
US20050265461A1 (en) 2004-05-04 2005-12-01 Raveendran Vijayalakshmi R Method and apparatus to enable acquisition of media in streaming applications
US20050265447A1 (en) 2004-05-25 2005-12-01 Industry Academic Cooperation Foundation Kyunghee Univ. Prediction encoder/decoder, prediction encoding/decoding method, and computer readable recording medium having recorded thereon program for implementing the prediction encoding/decoding method
US20050276323A1 (en) 2002-09-27 2005-12-15 Vanguard Software Solutions, Inc. Real-time video coding/decoding
US6985526B2 (en) 1999-12-28 2006-01-10 Koninklijke Philips Electronics N.V. SNR scalable video encoding method and corresponding decoding method
US6987866B2 (en) 2001-06-05 2006-01-17 Micron Technology, Inc. Multi-modal motion estimation for video sequences
US7003035B2 (en) 2002-01-25 2006-02-21 Microsoft Corporation Video coding methods and apparatuses
US7023916B1 (en) 1998-08-07 2006-04-04 Infineon Technologies Ag Method and device for estimating motion in a digitized image with pixels
US20060072674A1 (en) 2004-07-29 2006-04-06 Stmicroelectronics Pvt. Ltd. Macro-block level parallel video decoder
US7027654B1 (en) 2001-08-16 2006-04-11 On2 Technologies Video compression system
US20060098737A1 (en) 2002-12-20 2006-05-11 Koninklijke Philips Electronics N.V. Segment-based motion estimation
US20060109912A1 (en) 2004-11-24 2006-05-25 Lsi Logic Corporation Method and/or apparatus for parsing compressed video bitstreams
US20060114985A1 (en) 2004-11-30 2006-06-01 Lsi Logic Corporation Parallel video encoder with whole picture deblocking and/or whole picture compressed as a single slice
US20060126726A1 (en) 2004-12-10 2006-06-15 Lin Teng C Digital signal processing structure for decoding multiple video standards
US20060126740A1 (en) 2004-12-10 2006-06-15 Lin Teng C Shared pipeline architecture for motion vector prediction and residual decoding
US20060150151A1 (en) 2004-12-08 2006-07-06 Encomia, L.P. Method and system for embedding user assistance in documents utilizing markup languages
US20060215758A1 (en) 2005-03-23 2006-09-28 Kabushiki Kaisha Toshiba Video encoder and portable radio terminal device using the video encoder
US20060239345A1 (en) 2002-09-20 2006-10-26 David Taubman Method of signalling motion information for efficient scalable video compression
US20060256858A1 (en) 2005-05-16 2006-11-16 Douglas Chin Method and system for rate control in a video encoder
US20060291567A1 (en) 2005-06-06 2006-12-28 Stmicroelectronics S.R.L. Method and system for coding moving image signals, corresponding computer program product
US7170937B2 (en) 2002-05-01 2007-01-30 Texas Instruments Incorporated Complexity-scalable intra-frame prediction technique
US20070025441A1 (en) 2005-07-28 2007-02-01 Nokia Corporation Method, module, device and system for rate control provision for video encoders capable of variable bit rate encoding
US20070053443A1 (en) 2005-09-06 2007-03-08 Samsung Electronics Co., Ltd. Method and apparatus for video intraprediction encoding and decoding
US20070086528A1 (en) 2005-10-18 2007-04-19 Mauchly J W Video encoder with multiple processors
US20070092006A1 (en) 2005-10-20 2007-04-26 Narendranath Malayath Scalable motion estimation for video encoding
US7227589B1 (en) 1999-12-22 2007-06-05 Intel Corporation Method and apparatus for video decoding on a multiprocessor system
US20070140342A1 (en) 1999-08-11 2007-06-21 Nokia Corporation Apparatus, and associated method, for forming a compressed motion vector field utilizing predictive motion coding
US7236524B2 (en) 2002-05-28 2007-06-26 Sharp Laboratories Of America, Inc. Methods and systems for image intra-prediction mode communication
JP2007166625A (en) 2005-12-12 2007-06-28 Thomson Licensing Video data encoder, video data encoding method, video data decoder, and video data decoding method
US20070229704A1 (en) 2006-03-30 2007-10-04 Satyajit Mohapatra Pipelining techniques for deinterlacing video information
US20070286288A1 (en) 2006-06-08 2007-12-13 Jayson Smith Parallel batch decoding of video blocks
US7330509B2 (en) 2003-09-12 2008-02-12 International Business Machines Corporation Method for video transcoding with adaptive frame rate control
WO2008020470A1 (en) 2006-08-15 2008-02-21 Fujitsu Limited Decoding method and device
US20080056348A1 (en) 2006-08-31 2008-03-06 Ati Technologies, Inc Decoding method and system for highly compressed video data
WO2008036237A2 (en) 2006-09-21 2008-03-27 Analog Devices, Inc. Multiprocessor decoder system and method
US20080152014A1 (en) 2006-12-21 2008-06-26 On Demand Microelectronics Method and apparatus for encoding and decoding of video streams
US20080159407A1 (en) 2006-12-28 2008-07-03 Yang Nick Y Mechanism for a parallel processing in-loop deblock filter
US20080198270A1 (en) 2007-02-20 2008-08-21 David Victor Hobbs Apparatus and methods for image decoding
US20080198920A1 (en) 2007-02-21 2008-08-21 Kai Chieh Yang 3d video encoding
US20080212678A1 (en) 2003-12-10 2008-09-04 Simon Booth Computational reduction in motion estimation based on lower bound of cost function
US20080215317A1 (en) * 2004-08-04 2008-09-04 Dts, Inc. Lossless multi-channel audio codec using adaptive segmentation with random access point (RAP) and multiple prediction parameter set (MPPS) capability
US20080240254A1 (en) * 2007-03-29 2008-10-02 James Au Parallel or pipelined macroblock processing
US20080267295A1 (en) * 2007-04-26 2008-10-30 Chih-Ta Star Sung Video decompression, de-interlacing and frame rate conversion with frame buffer compression
US20080298469A1 (en) * 2007-05-31 2008-12-04 Qualcomm Incorporated Bitrate reduction techniques for image transcoding
US20080317364A1 (en) * 2007-06-25 2008-12-25 Augusta Technology, Inc. Methods for determining neighboring locations for partitions of a video stream
US20090003447A1 (en) 2007-06-30 2009-01-01 Microsoft Corporation Innovations in video decoder implementations
US20090002379A1 (en) * 2007-06-30 2009-01-01 Microsoft Corporation Video decoding implementations for a graphics processing unit
US20090052529A1 (en) * 2006-01-09 2009-02-26 Thompson Licensing Method and Apparatus for Providing Reduced Resolution Update Mode for Multi-View Video Coding
US7499492B1 (en) 2004-06-28 2009-03-03 On2 Technologies, Inc. Video compression and encoding method
US20090080534A1 (en) 2005-09-20 2009-03-26 Mitsubishi Electric Corporation Image encoding method, image decoding method, image encoding apparatus, image decoding apparatus, image encoded bitstream and recording medium
US20090168893A1 (en) * 2007-12-31 2009-07-02 Raza Microelectronics, Inc. System, method and device for processing macroblock video data
US20090225845A1 (en) 2008-03-10 2009-09-10 Neomagic Corp. Multi-Directional Motion Estimation Using Parallel Processors and Pre-Computed Search-Strategy Offset Tables
US20090238277A1 (en) 2008-03-18 2009-09-24 Joseph Patrick Meehan Processing Video Data At A Target Rate
US20090249178A1 (en) 2008-04-01 2009-10-01 Ambrosino Timothy J Document linking
US20090245349A1 (en) * 2008-03-28 2009-10-01 Jie Zhao Methods and Systems for Parallel Video Encoding and Decoding
US20100061455A1 (en) 2008-09-11 2010-03-11 On2 Technologies Inc. System and method for decoding using parallel processing
WO2010063184A1 (en) 2008-12-03 2010-06-10 Mediatek Inc. Method for performing parallel cabac processing with ordered entropy slices, and associated apparatus
US20100158109A1 (en) * 2007-01-12 2010-06-24 Activevideo Networks, Inc. Providing Television Broadcasts over a Managed Network and Interactive Content over an Unmanaged Network to a Client Device
US20100177826A1 (en) 2001-07-24 2010-07-15 Sasken Communication Technologies Limited Motion estimation technique for digital video encoding applications
US20100183076A1 (en) 2009-01-22 2010-07-22 Core Logic, Inc. Encoding Images
US7764739B2 (en) 2004-02-13 2010-07-27 Panasonic Corporation Moving picture encoding device and method with time constraint
US20100189179A1 (en) 2009-01-29 2010-07-29 Microsoft Corporation Video encoding using previously calculated motion information
US20100215263A1 (en) 2008-06-10 2010-08-26 Takaaki Imanaka Decoding device, decoding method, and receiving device
US20100239181A1 (en) 2009-03-17 2010-09-23 Mstar Semiconductor, Inc. Device for Removing Mosquito Noise and Associated Method
US20100246665A1 (en) 2008-11-24 2010-09-30 Broadcast International Parallelization of high-performance video encoding on a single-chip multiprocessor
US7813570B2 (en) 2004-09-13 2010-10-12 Microsoft Corporation Accelerated video encoding using a graphics processing unit
US20100316132A1 (en) * 2002-05-20 2010-12-16 Macinnis Alexander G System, method, and apparatus for decoding flexibly ordered macroblocks
US20110261884A1 (en) 2010-04-22 2011-10-27 Jorge Rubinstein Multi-Bus Architecture for a Video Codec
US20120014451A1 (en) 2009-01-15 2012-01-19 Wei Siong Lee Image Encoding Methods, Image Decoding Methods, Image Encoding Apparatuses, and Image Decoding Apparatuses
US8175161B1 (en) 2008-09-12 2012-05-08 Arecont Vision, Llc. System and method for motion estimation
US20120128069A1 (en) 2009-08-12 2012-05-24 Kazushi Sato Image processing apparatus and method
US20120147958A1 (en) 2010-12-10 2012-06-14 Ronca David R Parallel Video Encoding Based on Complexity Analysis
US8213518B1 (en) * 2006-10-31 2012-07-03 Sony Computer Entertainment Inc. Multi-threaded streaming data decoding
US20120213448A1 (en) 2011-02-18 2012-08-23 Arm Limited Parallel image encoding
US20120294376A1 (en) 2010-09-16 2012-11-22 Takeshi Tanaka Image decoding device and image encoding device, methods therefor, programs thereof, integrated circuit, and transcoding device
US20130034150A1 (en) 2011-08-05 2013-02-07 Texas Instruments Incorporated Systems and methods for multimedia data encoding and decoding
US20130083161A1 (en) 2011-09-30 2013-04-04 University Of Illinois Real-time video coding using graphics rendering contexts
US8520734B1 (en) 2009-07-31 2013-08-27 Teradici Corporation Method and system for remotely communicating a computer rendered image sequence
US20130259137A1 (en) 2012-03-30 2013-10-03 Google Inc. System and Method for Multi-Core Hardware Video Encoding And Decoding
US8743979B2 (en) 2010-07-12 2014-06-03 Industrial Cooperation Foundation Chonbuk National University Method for precoding and decoding distributing MIMO channels in relay-based DF cooperative wireless networks
US8767817B1 (en) 2011-04-07 2014-07-01 Google Inc. Apparatus and method for coding using parameterized equation
US8948267B1 (en) * 2007-11-21 2015-02-03 Marvell International Ltd. System and method of video coding using adaptive macroblock processing
US20150043645A1 (en) 2012-06-20 2015-02-12 Google Inc. Video stream partitioning to allow efficient concurrent hardware decoding
US9100657B1 (en) 2011-12-07 2015-08-04 Google Inc. Encoding time management in parallel real-time video encoding
US9100509B1 (en) 2012-02-07 2015-08-04 Google Inc. Dynamic bit allocation in parallel video encoding
US20170188024A9 (en) * 2007-12-20 2017-06-29 Vixs Systems, Inc. Adaptive partition subset selection module and method for use therewith

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3157101B2 (en) 1996-03-08 2001-04-16 沖電気工業株式会社 Image encoding method and image encoding device
DE69734968T2 (en) 1996-12-20 2006-07-27 International Business Machines Corp. Distributed element switching system for connection to line adjusters and with multiple transmission capability
US6418166B1 (en) 1998-11-30 2002-07-09 Microsoft Corporation Motion estimation and block matching pattern
WO2001010135A1 (en) 1999-07-29 2001-02-08 Mitsubishi Denki Kabushiki Kaisha Moving vector detecting method
JP4607305B2 (en) 2000-09-27 2011-01-05 株式会社東芝 Video encoding apparatus and video encoding method
CN101448162B (en) * 2001-12-17 2013-01-02 微软公司 Method for processing video image
US7116831B2 (en) 2002-04-10 2006-10-03 Microsoft Corporation Chrominance motion vector rounding
JP4419458B2 (en) 2003-07-14 2010-02-24 リコープリンティングシステムズ株式会社 Inkjet head manufacturing method
CN101502119B (en) * 2006-08-02 2012-05-23 汤姆逊许可公司 Adaptive geometric partitioning for video decoding

Patent Citations (189)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3825832A (en) 1971-06-03 1974-07-23 Ibm Method and device for coding and decoding video signals
US4729127A (en) 1981-10-20 1988-03-01 The United States Of America As Represented By The Secretary Of The Army Method and system for compression and reconstruction of cultural data for use in a digital moving map display
US4719642A (en) 1985-02-27 1988-01-12 Scientific Atlanta, Inc. Error detection and concealment using predicted signal values
US4736446A (en) 1985-03-29 1988-04-05 Quad-Tech Inc. Cutoff control system
US4868764A (en) 1986-04-14 1989-09-19 U.S. Philips Corporation Image encoding and decoding method and apparatus
US4891748A (en) 1986-05-30 1990-01-02 Mann Ralph V System and method for teaching physical skills
US4797729A (en) 1988-02-05 1989-01-10 Eastman Kodak Company System incorporating an error tolerant picture compression algorithm
US5136376A (en) 1989-10-14 1992-08-04 Sony Corporation Method of coding video signals and transmission system thereof
US5136371A (en) 1990-03-15 1992-08-04 Thomson Consumer Electronics, Inc. Digital image coding using random scanning
US5091782A (en) 1990-04-09 1992-02-25 General Instrument Corporation Apparatus and method for adaptively compressing successive blocks of digital video
US5083214A (en) 1990-05-02 1992-01-21 Eastman Kodak Company Apparatus and methods for extracting data from a scanned bit-mapped data strip
US5068724A (en) 1990-06-15 1991-11-26 General Instrument Corporation Adaptive motion compensation for digital television
US5270812A (en) 1990-07-20 1993-12-14 U.S. Philips Corporation Method of encoding image pixel values for storage as compressed digital data and method of decoding the compressed digital data
US5164819A (en) 1991-04-03 1992-11-17 Music John D Method and system for coding and compressing color video signals
US5313306A (en) 1991-05-13 1994-05-17 Telerobotics International, Inc. Omniview motionless camera endoscopy system
US5341440A (en) 1991-07-12 1994-08-23 Earl Joseph G Method and apparatus for increasing information compressibility
US5274442A (en) 1991-10-22 1993-12-28 Mitsubishi Denki Kabushiki Kaisha Adaptive blocking image signal coding system
US5696869A (en) 1992-02-07 1997-12-09 Max Abecassis Variable-content-video provider system
US5225832A (en) 1992-02-13 1993-07-06 Industrial Technology Research Institute High speed variable length decoder
US5604539A (en) 1992-08-21 1997-02-18 Canon Kabushiki Kaisha Image processing method and apparatus
US5589945A (en) 1993-01-11 1996-12-31 Abecassis; Max Computer-themed playing system
US5576767A (en) 1993-02-03 1996-11-19 Qualcomm Incorporated Interframe video encoding and decoding system
US5381145A (en) 1993-02-10 1995-01-10 Ricoh Corporation Method and apparatus for parallel decoding and encoding of data
US6327304B1 (en) 1993-05-12 2001-12-04 The Duck Corporation Apparatus and method to digitally compress video signals
US6181822B1 (en) 1993-05-12 2001-01-30 The Duck Corporation Data compression apparatus and method
US5432870A (en) 1993-06-30 1995-07-11 Ricoh Corporation Method and apparatus for compressing and decompressing images of documents
US5452006A (en) 1993-10-25 1995-09-19 Lsi Logic Corporation Two-part synchronization scheme for digital video decoders
US6370267B1 (en) 1993-11-18 2002-04-09 The Duck Corporation System for manipulating digitized image objects in three dimensions
US5999641A (en) 1993-11-18 1999-12-07 The Duck Corporation System for manipulating digitized image objects in three dimensions
US5576765A (en) 1994-03-17 1996-11-19 International Business Machines, Corporation Video decoder
US6061397A (en) 1994-04-19 2000-05-09 Sony Corporation Motion vector detecting device
US5646690A (en) 1994-06-14 1997-07-08 Dacwoo Electronics Co., Ltd. Apparatus for parallel decoding of digital video signals
US5835144A (en) 1994-10-13 1998-11-10 Oki Electric Industry Co., Ltd. Methods of coding and decoding moving-picture signals, using self-resynchronizing variable-length codes
US5561477A (en) 1994-10-26 1996-10-01 Thomson Consumer Electronics, Inc. System for coding a video signal in the presence of an image intensity gradient
US5737020A (en) 1995-03-27 1998-04-07 International Business Machines Corporation Adaptive field/frame encoding of discrete cosine transform
US5818969A (en) 1995-05-12 1998-10-06 Intel Corporation Intelligent start for motion estimation search
US5734744A (en) 1995-06-07 1998-03-31 Pixar Method and apparatus for compression and decompression of color data
US5930493A (en) 1995-06-07 1999-07-27 International Business Machines Corporation Multimedia server system and method for communicating multimedia information
US6115501A (en) 1995-07-10 2000-09-05 Hyundai Electronics Industries Co., Ltd. Grid moving method for minimizing image information of an object
US6119154A (en) 1995-07-14 2000-09-12 Oracle Corporation Method and apparatus for non-sequential access to an in-progress video feed
US5659539A (en) 1995-07-14 1997-08-19 Oracle Corporation Method and apparatus for frame accurate access of digital audio-visual information
US5774593A (en) 1995-07-24 1998-06-30 University Of Washington Automatic scene decomposition and optimization of MPEG compressed video
US5794179A (en) 1995-07-27 1998-08-11 Victor Company Of Japan, Ltd. Method and apparatus for performing bit-allocation coding for an acoustic signal of frequency region and time region correction for an acoustic signal and method and apparatus for decoding a decoded acoustic signal
US5793647A (en) 1995-08-15 1998-08-11 Diffracto, Ltd. System and method for graphical image data acquistion, storage, and retrieval
US6084908A (en) 1995-10-25 2000-07-04 Sarnoff Corporation Apparatus and method for quadtree based variable block size motion estimation
US5929940A (en) 1995-10-25 1999-07-27 U.S. Philips Corporation Method and device for estimating motion between images, system for encoding segmented images
US6160846A (en) 1995-10-25 2000-12-12 Sarnoff Corporation Apparatus and method for optimizing the rate control in a coding system
US6041145A (en) 1995-11-02 2000-03-21 Matsushita Electric Industrial Co., Ltd. Device and method for smoothing picture signal, device and method for encoding picture and device and method for decoding picture
US6560366B1 (en) 1995-12-16 2003-05-06 Paul Gordon Wilkins Method for analyzing the content of a video signal
US5748247A (en) 1996-04-08 1998-05-05 Tektronix, Inc. Refinement of block motion vectors to achieve a dense motion field
US5883671A (en) 1996-06-05 1999-03-16 Matsushita Electric Industrial Co., Ltd. Method and apparatus for partitioning compressed digital video bitstream for decoding by multiple independent parallel decoders
US5818530A (en) * 1996-06-19 1998-10-06 Thomson Consumer Electronics, Inc. MPEG compatible decoder including a dual stage data reduction network
US5828370A (en) 1996-07-01 1998-10-27 Thompson Consumer Electronics Inc. Video delivery system and method for displaying indexing slider bar on the subscriber video screen
US5903264A (en) 1996-07-01 1999-05-11 Sun Microsystems, Inc. Video delivery system and method for displaying an indexing slider bar
JP3510433B2 (en) 1996-11-26 2004-03-29 シャープ株式会社 Image processing device
US6594315B1 (en) 1996-12-18 2003-07-15 Thomson Licensing S.A. Formatting of recompressed data in an MPEG decoder
US6496537B1 (en) * 1996-12-18 2002-12-17 Thomson Licensing S.A. Video decoder with interleaved data processing
US6014706A (en) 1997-01-30 2000-01-11 Microsoft Corporation Methods and apparatus for implementing control functions in a streamed video display system
US6188799B1 (en) 1997-02-07 2001-02-13 Matsushita Electric Industrial Co., Ltd. Method and apparatus for removing noise in still and moving pictures
US6167164A (en) 1997-03-10 2000-12-26 Samsung Electronics Co., Ltd. One-dimensional signal adaptive filter for reducing blocking effect and filtering method
US6141381A (en) 1997-04-25 2000-10-31 Victor Company Of Japan, Ltd. Motion compensation encoding apparatus and motion compensation encoding method for high-efficiency encoding of video information through selective use of previously derived motion vectors in place of motion vectors derived from motion estimation
US6185363B1 (en) 1997-06-02 2001-02-06 Philips Electronics North America Corporation Visual indexing system
US6112234A (en) 1997-07-01 2000-08-29 Leiper; Thomas W. Method for transfer of radiographic images
US5963203A (en) 1997-07-03 1999-10-05 Obvious Technology, Inc. Interactive video icon with designated viewing position
US6108383A (en) 1997-07-15 2000-08-22 On2.Com, Inc. Method and apparatus for compression and decompression of video images
US6240135B1 (en) 1997-09-09 2001-05-29 Lg Electronics Inc Method of removing blocking artifacts in a coding system of a moving picture
US6292837B1 (en) 1997-10-30 2001-09-18 Daniel Miller Apparatus and method for non-sequential image data transmission and display
US6366704B1 (en) 1997-12-01 2002-04-02 Sharp Laboratories Of America, Inc. Method and apparatus for a delay-adaptive rate control scheme for the frame layer
US6181742B1 (en) 1998-01-26 2001-01-30 International Business Machines Corporation Single pass target allocation for video encoding
US20020031184A1 (en) 1998-07-15 2002-03-14 Eiji Iwata Encoding apparatus and method of same and decoding apparatus and method of same
US7023916B1 (en) 1998-08-07 2006-04-04 Infineon Technologies Ag Method and device for estimating motion in a digitized image with pixels
US6697061B1 (en) 1999-01-21 2004-02-24 Hewlett-Packard Development Company, L.P. Image compression featuring selective re-use of prior compression data
US6529638B1 (en) 1999-02-01 2003-03-04 Sharp Laboratories Of America, Inc. Block boundary artifact reduction for block-based image compression
US6400763B1 (en) 1999-02-18 2002-06-04 Hewlett-Packard Company Compression system which re-uses prior motion vectors
US6687303B1 (en) 1999-03-17 2004-02-03 Renesas Technology Corp. Motion vector detecting device
US20070140342A1 (en) 1999-08-11 2007-06-21 Nokia Corporation Apparatus, and associated method, for forming a compressed motion vector field utilizing predictive motion coding
US7227589B1 (en) 1999-12-22 2007-06-05 Intel Corporation Method and apparatus for video decoding on a multiprocessor system
US6985526B2 (en) 1999-12-28 2006-01-10 Koninklijke Philips Electronics N.V. SNR scalable video encoding method and corresponding decoding method
US6522784B1 (en) 2000-04-11 2003-02-18 International Business Machines Corporation Enhanced compression of gray-level images
US6934419B2 (en) 2000-04-11 2005-08-23 International Business Machines Corporation Enhanced compression of gray-level images
US20020012396A1 (en) 2000-05-05 2002-01-31 Stmicroelectronics S.R.L. Motion estimation process and system
US6876703B2 (en) 2000-05-11 2005-04-05 Ub Video Inc. Method and apparatus for video coding
US6707952B1 (en) 2000-05-30 2004-03-16 Sharp Laboratories Of America, Inc. Method for removing ringing artifacts from locations near dominant edges of an image reconstructed after compression
US20020039386A1 (en) 2000-07-13 2002-04-04 Tae-Hee Han Block matching processor and method for block matching motion estimation in video compression
US20050210145A1 (en) 2000-07-24 2005-09-22 Vivcom, Inc. Delivering and processing multimedia bookmark
US6765964B1 (en) 2000-12-06 2004-07-20 Realnetworks, Inc. System and method for intracoding video data
US20020168114A1 (en) 2001-02-06 2002-11-14 Valente Stephane Edouard Preprocessing method applied to textures of arbitrarily shaped objects
US20030023982A1 (en) 2001-05-18 2003-01-30 Tsu-Chang Lee Scalable video encoding/storage/distribution/decoding for symmetrical multiple video processors
US6987866B2 (en) 2001-06-05 2006-01-17 Micron Technology, Inc. Multi-modal motion estimation for video sequences
US20100177826A1 (en) 2001-07-24 2010-07-15 Sasken Communication Technologies Limited Motion estimation technique for digital video encoding applications
US7027654B1 (en) 2001-08-16 2006-04-11 On2 Technologies Video compression system
US7003035B2 (en) 2002-01-25 2006-02-21 Microsoft Corporation Video coding methods and apparatuses
US20030189982A1 (en) * 2002-04-01 2003-10-09 Macinnis Alexander System and method for multi-row decoding of video with dependent rows
US8401084B2 (en) 2002-04-01 2013-03-19 Broadcom Corporation System and method for multi-row decoding of video with dependent rows
US7170937B2 (en) 2002-05-01 2007-01-30 Texas Instruments Incorporated Complexity-scalable intra-frame prediction technique
US20030219072A1 (en) * 2002-05-14 2003-11-27 Macinnis Alexander G. System and method for entropy code preprocessing
US20030215018A1 (en) 2002-05-14 2003-11-20 Macinnis Alexander G. System and method for transcoding entropy-coded bitstreams
US20100316132A1 (en) * 2002-05-20 2010-12-16 Macinnis Alexander G System, method, and apparatus for decoding flexibly ordered macroblocks
US20040066852A1 (en) 2002-05-20 2004-04-08 Maclnnis Alexander G. System, method, and apparatus for decoding flexibly ordered macroblocks
US7236524B2 (en) 2002-05-28 2007-06-26 Sharp Laboratories Of America, Inc. Methods and systems for image intra-prediction mode communication
US20040028142A1 (en) 2002-08-08 2004-02-12 Kim Eung Tae Video decoding system
US20060239345A1 (en) 2002-09-20 2006-10-26 David Taubman Method of signalling motion information for efficient scalable video compression
US20050276323A1 (en) 2002-09-27 2005-12-15 Vanguard Software Solutions, Inc. Real-time video coding/decoding
US20040120400A1 (en) 2002-12-20 2004-06-24 Lsi Logic Corporation Method and /or apparatus for motion estimation using a hierarchical search followed by a computation split for different block sizes
US20060098737A1 (en) 2002-12-20 2006-05-11 Koninklijke Philips Electronics N.V. Segment-based motion estimation
US20040228410A1 (en) * 2003-05-12 2004-11-18 Eric Ameres Video compression method
US20040240556A1 (en) 2003-06-02 2004-12-02 Lsi Logic Corporation Method for improving rate-distortion performance of a video compression system through parallel coefficient cancellation in the transform
US20040258151A1 (en) 2003-06-05 2004-12-23 Stmicroelectronics S.R.L. Method and apparatus for decoding compressed and encoded digital images
US20050050002A1 (en) 2003-07-11 2005-03-03 Benjamin Slotznick Apparatus and method of presenting textual material to enhance readability for people who have difficulty distinguishing left from right
US20050053157A1 (en) * 2003-09-05 2005-03-10 Lillevold Karl O. Parallel video decoding
US7330509B2 (en) 2003-09-12 2008-02-12 International Business Machines Corporation Method for video transcoding with adaptive frame rate control
US20050117655A1 (en) 2003-11-13 2005-06-02 Mediatek Inc. Video bit stream decoding system and method used in a video decoding apparatus
US20080212678A1 (en) 2003-12-10 2008-09-04 Simon Booth Computational reduction in motion estimation based on lower bound of cost function
US20050147165A1 (en) 2004-01-06 2005-07-07 Samsung Electronics Co., Ltd. Prediction encoding apparatus, prediction encoding method, and computer readable recording medium thereof
US20050169374A1 (en) 2004-01-30 2005-08-04 Detlev Marpe Video frame encoding and decoding
US7764739B2 (en) 2004-02-13 2010-07-27 Panasonic Corporation Moving picture encoding device and method with time constraint
US20050265461A1 (en) 2004-05-04 2005-12-01 Raveendran Vijayalakshmi R Method and apparatus to enable acquisition of media in streaming applications
US20050259747A1 (en) * 2004-05-21 2005-11-24 Broadcom Advanced Compression Group, Llc Context adaptive binary arithmetic code decoder for decoding macroblock adaptive field/frame coded video data
US20050265447A1 (en) 2004-05-25 2005-12-01 Industry Academic Cooperation Foundation Kyunghee Univ. Prediction encoder/decoder, prediction encoding/decoding method, and computer readable recording medium having recorded thereon program for implementing the prediction encoding/decoding method
US7499492B1 (en) 2004-06-28 2009-03-03 On2 Technologies, Inc. Video compression and encoding method
US7606310B1 (en) 2004-06-28 2009-10-20 On2 Technologies, Inc. Video compression and encoding method
US20060072674A1 (en) 2004-07-29 2006-04-06 Stmicroelectronics Pvt. Ltd. Macro-block level parallel video decoder
US20080215317A1 (en) * 2004-08-04 2008-09-04 Dts, Inc. Lossless multi-channel audio codec using adaptive segmentation with random access point (RAP) and multiple prediction parameter set (MPPS) capability
US7813570B2 (en) 2004-09-13 2010-10-12 Microsoft Corporation Accelerated video encoding using a graphics processing unit
US20060109912A1 (en) 2004-11-24 2006-05-25 Lsi Logic Corporation Method and/or apparatus for parsing compressed video bitstreams
US20060114985A1 (en) 2004-11-30 2006-06-01 Lsi Logic Corporation Parallel video encoder with whole picture deblocking and/or whole picture compressed as a single slice
US20060150151A1 (en) 2004-12-08 2006-07-06 Encomia, L.P. Method and system for embedding user assistance in documents utilizing markup languages
US20060126726A1 (en) 2004-12-10 2006-06-15 Lin Teng C Digital signal processing structure for decoding multiple video standards
US20060126740A1 (en) 2004-12-10 2006-06-15 Lin Teng C Shared pipeline architecture for motion vector prediction and residual decoding
US20060215758A1 (en) 2005-03-23 2006-09-28 Kabushiki Kaisha Toshiba Video encoder and portable radio terminal device using the video encoder
US20060256858A1 (en) 2005-05-16 2006-11-16 Douglas Chin Method and system for rate control in a video encoder
US20060291567A1 (en) 2005-06-06 2006-12-28 Stmicroelectronics S.R.L. Method and system for coding moving image signals, corresponding computer program product
US20070025441A1 (en) 2005-07-28 2007-02-01 Nokia Corporation Method, module, device and system for rate control provision for video encoders capable of variable bit rate encoding
US20070053443A1 (en) 2005-09-06 2007-03-08 Samsung Electronics Co., Ltd. Method and apparatus for video intraprediction encoding and decoding
US20090080534A1 (en) 2005-09-20 2009-03-26 Mitsubishi Electric Corporation Image encoding method, image decoding method, image encoding apparatus, image decoding apparatus, image encoded bitstream and recording medium
US20070086528A1 (en) 2005-10-18 2007-04-19 Mauchly J W Video encoder with multiple processors
US20070092006A1 (en) 2005-10-20 2007-04-26 Narendranath Malayath Scalable motion estimation for video encoding
JP2007166625A (en) 2005-12-12 2007-06-28 Thomson Licensing Video data encoder, video data encoding method, video data decoder, and video data decoding method
US20090052529A1 (en) * 2006-01-09 2009-02-26 Thompson Licensing Method and Apparatus for Providing Reduced Resolution Update Mode for Multi-View Video Coding
US20070229704A1 (en) 2006-03-30 2007-10-04 Satyajit Mohapatra Pipelining techniques for deinterlacing video information
US20070286288A1 (en) 2006-06-08 2007-12-13 Jayson Smith Parallel batch decoding of video blocks
WO2008020470A1 (en) 2006-08-15 2008-02-21 Fujitsu Limited Decoding method and device
US20080056348A1 (en) 2006-08-31 2008-03-06 Ati Technologies, Inc Decoding method and system for highly compressed video data
WO2008036237A2 (en) 2006-09-21 2008-03-27 Analog Devices, Inc. Multiprocessor decoder system and method
US8213518B1 (en) * 2006-10-31 2012-07-03 Sony Computer Entertainment Inc. Multi-threaded streaming data decoding
US20080152014A1 (en) 2006-12-21 2008-06-26 On Demand Microelectronics Method and apparatus for encoding and decoding of video streams
US20080159407A1 (en) 2006-12-28 2008-07-03 Yang Nick Y Mechanism for a parallel processing in-loop deblock filter
US20100158109A1 (en) * 2007-01-12 2010-06-24 Activevideo Networks, Inc. Providing Television Broadcasts over a Managed Network and Interactive Content over an Unmanaged Network to a Client Device
US20080198270A1 (en) 2007-02-20 2008-08-21 David Victor Hobbs Apparatus and methods for image decoding
US20080198920A1 (en) 2007-02-21 2008-08-21 Kai Chieh Yang 3d video encoding
US20080240254A1 (en) * 2007-03-29 2008-10-02 James Au Parallel or pipelined macroblock processing
US20080267295A1 (en) * 2007-04-26 2008-10-30 Chih-Ta Star Sung Video decompression, de-interlacing and frame rate conversion with frame buffer compression
US20080298469A1 (en) * 2007-05-31 2008-12-04 Qualcomm Incorporated Bitrate reduction techniques for image transcoding
US20080317364A1 (en) * 2007-06-25 2008-12-25 Augusta Technology, Inc. Methods for determining neighboring locations for partitions of a video stream
US8265144B2 (en) * 2007-06-30 2012-09-11 Microsoft Corporation Innovations in video decoder implementations
US20090003447A1 (en) 2007-06-30 2009-01-01 Microsoft Corporation Innovations in video decoder implementations
US20090002379A1 (en) * 2007-06-30 2009-01-01 Microsoft Corporation Video decoding implementations for a graphics processing unit
US8948267B1 (en) * 2007-11-21 2015-02-03 Marvell International Ltd. System and method of video coding using adaptive macroblock processing
US20170188024A9 (en) * 2007-12-20 2017-06-29 Vixs Systems, Inc. Adaptive partition subset selection module and method for use therewith
US20090168893A1 (en) * 2007-12-31 2009-07-02 Raza Microelectronics, Inc. System, method and device for processing macroblock video data
US20090225845A1 (en) 2008-03-10 2009-09-10 Neomagic Corp. Multi-Directional Motion Estimation Using Parallel Processors and Pre-Computed Search-Strategy Offset Tables
US20090238277A1 (en) 2008-03-18 2009-09-24 Joseph Patrick Meehan Processing Video Data At A Target Rate
US20090245349A1 (en) * 2008-03-28 2009-10-01 Jie Zhao Methods and Systems for Parallel Video Encoding and Decoding
US20090249178A1 (en) 2008-04-01 2009-10-01 Ambrosino Timothy J Document linking
US20100215263A1 (en) 2008-06-10 2010-08-26 Takaaki Imanaka Decoding device, decoding method, and receiving device
US20100061455A1 (en) 2008-09-11 2010-03-11 On2 Technologies Inc. System and method for decoding using parallel processing
US20120307892A1 (en) 2008-09-11 2012-12-06 Google Inc. System and Method for Decoding using Parallel Processing
US8175161B1 (en) 2008-09-12 2012-05-08 Arecont Vision, Llc. System and method for motion estimation
US20100246665A1 (en) 2008-11-24 2010-09-30 Broadcast International Parallelization of high-performance video encoding on a single-chip multiprocessor
WO2010063184A1 (en) 2008-12-03 2010-06-10 Mediatek Inc. Method for performing parallel cabac processing with ordered entropy slices, and associated apparatus
US20120014451A1 (en) 2009-01-15 2012-01-19 Wei Siong Lee Image Encoding Methods, Image Decoding Methods, Image Encoding Apparatuses, and Image Decoding Apparatuses
US20100183076A1 (en) 2009-01-22 2010-07-22 Core Logic, Inc. Encoding Images
US20100189179A1 (en) 2009-01-29 2010-07-29 Microsoft Corporation Video encoding using previously calculated motion information
US20100239181A1 (en) 2009-03-17 2010-09-23 Mstar Semiconductor, Inc. Device for Removing Mosquito Noise and Associated Method
US8520734B1 (en) 2009-07-31 2013-08-27 Teradici Corporation Method and system for remotely communicating a computer rendered image sequence
US20120128069A1 (en) 2009-08-12 2012-05-24 Kazushi Sato Image processing apparatus and method
US20110261884A1 (en) 2010-04-22 2011-10-27 Jorge Rubinstein Multi-Bus Architecture for a Video Codec
US8743979B2 (en) 2010-07-12 2014-06-03 Industrial Cooperation Foundation Chonbuk National University Method for precoding and decoding distributing MIMO channels in relay-based DF cooperative wireless networks
US20120294376A1 (en) 2010-09-16 2012-11-22 Takeshi Tanaka Image decoding device and image encoding device, methods therefor, programs thereof, integrated circuit, and transcoding device
US20120147958A1 (en) 2010-12-10 2012-06-14 Ronca David R Parallel Video Encoding Based on Complexity Analysis
US20120213448A1 (en) 2011-02-18 2012-08-23 Arm Limited Parallel image encoding
US8767817B1 (en) 2011-04-07 2014-07-01 Google Inc. Apparatus and method for coding using parameterized equation
US20130034150A1 (en) 2011-08-05 2013-02-07 Texas Instruments Incorporated Systems and methods for multimedia data encoding and decoding
US20130083161A1 (en) 2011-09-30 2013-04-04 University Of Illinois Real-time video coding using graphics rendering contexts
US9100657B1 (en) 2011-12-07 2015-08-04 Google Inc. Encoding time management in parallel real-time video encoding
US20150326888A1 (en) 2011-12-07 2015-11-12 Google Inc. Encoding time management in parallel real-time video encoding
US9100509B1 (en) 2012-02-07 2015-08-04 Google Inc. Dynamic bit allocation in parallel video encoding
US20130259137A1 (en) 2012-03-30 2013-10-03 Google Inc. System and Method for Multi-Core Hardware Video Encoding And Decoding
US20150043645A1 (en) 2012-06-20 2015-02-12 Google Inc. Video stream partitioning to allow efficient concurrent hardware decoding

Non-Patent Citations (24)

* Cited by examiner, † Cited by third party
Title
"Introduction to Video Coding Part 1: Transform Coding", Mozilla, Mar. 2012, 171 pp.
"Overview VP7 Data Format and Decoder", Version 1.5, On2 Technologies, Inc., Mar. 28, 2005, 65 pp.
Armando J. Pinho, "Encoding of Image Partitions Using a Standard Technique for Lossless Image Compression," Dep. Electrónica e Telecomunicacoes/ INESC Universidade de Aveiro, Portugal (IEEE 1999), 4 pp.
B. Vasudev & N. Merhav, "DCT Mode Conversions for Field/Frame Coded MPEG Video", IEEE 2d Workshop on Multimedia Signal Processing 605-610 (Dec. 1998).
Bankoski et al. "Technical Overview of VP8, an Open Source Video Codec for the Web". Dated Jul. 11, 2011.
Bankoski et al., "VP8 Data Format and Decoding Guide draft-bankoski-vp8-bitstream-02", Network Working Group, Internet-Draft, May 18, 2011, 288 pp.
Bankoski et al., "VP8 Data Format and Decoding Guide", Independent Submission RFC 6389, Nov. 2011, 305 pp.
Chen, T, Y.H. Ng; Lossless Color Image Compression Technique for Multimedia Applications; IBM Technical Disclosure Bulletin; vol. 37 No. 10, Oct. 1994.
Fore June "An Introduction to Digital Video Data Compression in Java", Chapter 12: DPCM video Codec, CreateSpace, Jan. 22, 2011.
International Search Report and Written Opinion Issued in co-pending PCT International Application No. PCT/US2013/034581 dated Jun. 11, 2013.
Li E Q et al., "Implementation of H.264 encoder on general-purpose processors with hyper-threading technology", Proceedings of SPIE, pp. 384-395, vol. 5308, No. 1, Jan. 20, 2004.
On2 Technologies Inc., White Paper TrueMotion VP7 Video Codec, Jan. 10, 2005, 13 pages, Document Version: 1.0, Clifton Park, New York.
On2 Technologies, Inc., White Paper On2's TrueMotion VP7 Video Codec, Jul. 11, 2008, pp. 7 pages, Document Version:1.0, Clifton Park, New York.
Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services, Amendment 1: Support of additional colour spaces and removal of the High 4:4:4 Profile, International Telecommunication Union, Jun. 2006, 16 pp.
Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services, Version 3, International Telecommunication Union, Mar. 2005, 343 pp.
Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Amendment 2: New profiles for professional applications, International Telecommunication Union, Apr. 2007, 75 pp.
Sharp, "Entropy slices for parallel entropy decoding", ITU-T SG16 Meeting, Apr. 22, 2008-Feb. 5, 2008, Geneva.
Sze, "Massively Parallel CABAC", VCEG meeting, Jan. 7, 2009, London and MPEG meeting, Aug. 7, 2009, Geneva.
Tasdizen, et al.; "A High Performance Reconfigurable Motion Estimation Hardware Architecture", Design, Automation & Test in Europe Conference & Exhibition, Apr. 20, 2009, IEEE, Piscataway, NJ, US pp. 882-885.
Vos, Luc De and Stegherr, Michael; "Parameterizable VLSI Architectures for the Full-Search Block-Matching Algorithm", IEEE Transactions on Circuits and Systems, vol. 36, No. 10, Oct. 1989 NY US pp. 1309-1316.
VP6 Bitstream and Decoder Specification, Version 1.03, (On2 Technologies, Inc.), Dated Oct. 29, 2007.
Wiegand et al, "Overview of the H 264/AVC Video Coding Standard," IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, No. 7, pp. 568, 569, Jul. 1, 2003.
Yao Wang, "Motion Estimation for Video coding", EE4414: Motion Estimation basics, 2005.
Youn et al., "Motion Vector Refinement for high-performance Transcoding" IEEE Transactions on Multimedia, vol. 1, No. 1, Mar. 1999.

Also Published As

Publication number Publication date
JP5400888B2 (en) 2014-01-29
US20100061455A1 (en) 2010-03-11
WO2010030752A3 (en) 2010-05-14
US20240080482A1 (en) 2024-03-07
US8311111B2 (en) 2012-11-13
US20160277766A1 (en) 2016-09-22
WO2010030752A2 (en) 2010-03-18
US9357223B2 (en) 2016-05-31
JP2012502592A (en) 2012-01-26
KR20110053243A (en) 2011-05-19
CA2736888A1 (en) 2010-03-18
US10230986B2 (en) 2019-03-12
CN102150425B (en) 2014-12-10
CN102150425A (en) 2011-08-10
EP2324639A4 (en) 2012-08-29
US20120307892A1 (en) 2012-12-06
EP2324639B1 (en) 2019-04-24
EP2324639A2 (en) 2011-05-25

Similar Documents

Publication Publication Date Title
USRE49727E1 (en) System and method for decoding using parallel processing
US11805253B2 (en) Processing a video frame having slices and tiles
US10225549B1 (en) System and method for video coding
US9872018B2 (en) Random access point (RAP) formation using intra refreshing technique in video coding
US9667971B2 (en) Video decoder for slices
US8218641B2 (en) Picture encoding using same-picture reference for pixel reconstruction
US8218640B2 (en) Picture decoding using same-picture reference for pixel reconstruction
JP6792685B2 (en) How and equipment to encode video frames
US20130272428A1 (en) Video decoder for copy slices
TWI786000B (en) Low-latency video coding methods and apparatuses for chroma separated tree

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: GOOGLE INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ON2 TECHNOLOGIES, LLC;REEL/FRAME:064952/0033

Effective date: 20101028

Owner name: ON2 TECHNOLOGIES, INC., NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:XU, YAOWU;WILKINS, PAUL;BANKOSKI, JAMES;SIGNING DATES FROM 20090324 TO 20090615;REEL/FRAME:064951/0738

Owner name: ON2 TECHNOLOGIES, LLC, CALIFORNIA

Free format text: MERGER;ASSIGNOR:ON2 TECHNOLOGIES, INC.;REEL/FRAME:064951/0918

Effective date: 20100219