US8300696B2 - Transcoding for systems operating under plural video coding specifications - Google Patents
Transcoding for systems operating under plural video coding specifications Download PDFInfo
- Publication number
- US8300696B2 US8300696B2 US12/180,501 US18050108A US8300696B2 US 8300696 B2 US8300696 B2 US 8300696B2 US 18050108 A US18050108 A US 18050108A US 8300696 B2 US8300696 B2 US 8300696B2
- Authority
- US
- United States
- Prior art keywords
- threshold
- sar
- macroblocks
- motion vector
- macroblock
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 230000033001 locomotion Effects 0.000 claims abstract description 143
- 239000013598 vector Substances 0.000 claims abstract description 92
- 238000000034 method Methods 0.000 claims abstract description 53
- 238000013507 mapping Methods 0.000 claims description 8
- 238000000638 solvent extraction Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 19
- 238000009826 distribution Methods 0.000 description 16
- 238000010586 diagram Methods 0.000 description 15
- 238000012545 processing Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 238000005192 partition Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000013139 quantization Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 229930091051 Arenine Natural products 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000001747 exhibiting effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/57—Motion estimation characterised by a search window with variable size or shape
Definitions
- Particular embodiments are generally related to processing of video streams.
- Video conferencing is a popular way of long distance communication nowadays. Many kinds of products have appeared in the markets and gained great attention through their ability to save large amounts of time and expenses by enabling the conducting of conversations for people that are not in the same location.
- AVC H.264/AVC
- AVC represents a significant advance in coding efficiency compared to previous video standards, such as H.263, H.261, and MPEG-2. Because of its superior improvement in video data compression and high decoded video quality, AVC is rapidly becoming more widely used in recent years. However, not all products that are based on the previous video standards can be replaced with AVC-based products in a short time. Accordingly, there has been a focus recently on providing transcoders that implement video format conversion in view of AVC. However, engineering and design of transcoders and corresponding methods involving AVC are not without challenges.
- AVC enables significant gains in bit rate savings and visual quality improvement, it is also more computationally extensive due, for instance, to its comprehensive motion compensated estimation process.
- AVC extends the partition choices for motion estimation to seven (7) sizes for P frames: 16 ⁇ 16, 16 ⁇ 8, 8 ⁇ 16, 8 ⁇ 8, 8 ⁇ 4, 4 ⁇ 8 and 4 ⁇ 4.
- frames there are four (4) modes to choose from for 16 ⁇ 16 macroblocks (MBs), while for 4 ⁇ 4 blocks, there are nine (9) different modes from which to choose.
- AVC also enlarges the range of the reference frames up to sixteen (16) decoded frames.
- For B frames besides the same amount of mode choices, there are two lists of reference frames to choose from.
- the motion search process may exhaustively compute the cost of all the modes and selects the one resulting in the minimum cost. This motion search process is computationally extensive and time consuming. Therefore, many transcoding techniques have been proposed, and several methods on reducing the complexity of the motion estimation process have been presented (e.g., with a focus toward reducing the complexity of the motion estimation process in AVC encoding in the direction of converting H.263 video stream to AVC streams).
- AVC applies integer precision transform to the predicted error signals in more than one block size.
- Context adaptive entropy coding also presents some computational challenges.
- Another challenge involves the fact that, typically, a pixel domain deblocking filter is employed in AVC to reduce the blocking artifacts because of the block based encoding process. In view of this in-loop deblocking filter function, the H.263 decoded predicted error signals cannot be directly used if corresponding H.263 motion vectors are to be reused in AVC encoding.
- FIG. 1 is a block diagram that illustrates an example environment in which embodiments of a transcoding system may be implemented.
- FIG. 2 is a block diagram of an embodiment of a transcoding system.
- FIG. 3 is a block diagram that further illustrates the embodiment shown in FIG. 2 .
- FIG. 4 is a schematic diagram that illustrates a simulated example distribution of a sum of absolute residuals (SAR) for a frame.
- FIGS. 5A-5B are block diagrams that conceptually illustrate motion vector prediction.
- FIGS. 6A-6B are block diagrams that conceptually illustrate motion vector mapping from an H.263 motion vector.
- FIG. 7 is a composite block diagram that illustrates an example partition process and mode decision.
- FIG. 8 is a block diagram that conceptually illustrates an example motion vector decision for a 4 ⁇ 4 block.
- FIG. 9 is a block diagram that conceptually illustrates an example spiral motion search.
- FIG. 10 is a flow diagram of an embodiment of a thresholding method.
- FIG. 11 is a flow diagram of another embodiment of a thresholding method.
- FIG. 12 is a flow diagram of an embodiment of a transcoding method.
- a system and method that computes a threshold based on an average sum of absolute residual (SAR) values and a standard deviation, each SAR corresponding to the sum of absolute values of the residual signal of a non-intra encoded macroblock in a frame of a first video stream encoded according to a first video specification, decodes the macroblocks of the frame, compares a SAR of one of the macroblocks to the threshold, the one of the macroblocks having a first motion vector; and provides the first motion vector for encoding the one of the macroblocks according to a second video specification if the SAR of the one of the macroblocks is less than the threshold.
- SAR average sum of absolute residual
- transcoding technology that converts video bit streams corresponding to different video compression specifications, such as standards.
- transcoding systems and methods which possess the ability to bridge the communication between different video specifications or standards using low complexity and time-saving transcoding methods.
- a transcoding method is described that, in one embodiment, reuses video information of a first video specification (such as H.263) bit stream and the corresponding decoded video data, or parts thereof, to conduct a simple but effective motion re-estimation process.
- Such a method enables the reduction or possibly omission of the computation in a second video specification's (such as AVC) motion estimation process, resulting in a significant reduction in complexity and transcoding time.
- a second video specification's such as AVC
- AVC advanced video specification
- FIG. 1 is a block diagram that illustrates an example environment in which an embodiment of a transcoding system can be implemented, namely a video conferencing network 100 .
- the video conferencing network 100 includes plural end point devices 102 , 104 , and 106 , and a video conferencing system (VCS) 108 , which includes an audio mixer 110 and a video switching module 112 .
- the video switching module 112 comprises a transcoding system 200 .
- the end point devices 102 , 104 , and 106 communicate information to each other via the video conferencing system 108 over a communication medium 116 , which may include a local area network, wide area network, among other media that enables wireless and/or wired communication.
- the video conferencing network 100 provides an environment where basic, multi-points video conferencing is conducted between several end point devices 102 , 104 , and 106 .
- computer-type devices 102 , 104 , and 106 other types of devices (e.g., set-top terminals, televisions, phones with video capability, media play/record devices, etc.) are contemplated to be within the scope of devices suitable for interfacing with the transcoding system 200 .
- functionality of the end point devices 102 and the transcoding system 200 may be embodied within a single device, where the communication medium may be in the form of wires, busses, fiber, or other mediums, or wireless.
- each end point device 102 , 104 , and 106 is equipped with a TV/PC interface, a microphone and a camera (the latter two components not shown) for voice and visual communication.
- Voice data (or hereinafter, audio) streams are sent over the communication medium 116 to the audio mixer 110 , which mixes all the audio bit streams and sends the resultant mixed streams to respective end point devices 102 , 104 , or 106 .
- audio streams 118 , 126 , and 134 are provided by respective end point devices 102 , 104 , and 106 to audio mixer 110 , which mixes the audio streams and provides mixed audio streams 120 , 128 , and 136 to end point devices 102 , 104 , and 106 , respectively.
- the video bit streams 122 , 130 , and 138 are sent to the video switching module 112 , which switches the video bit stream to the current active one. In other words, in one embodiment, only the video stream of the current speaker is broadcasted to each end-point.
- the transcoding system 200 is configured to convert the received video stream 122 , 130 , and 138 , provided according to a first video coding specification or standard, to a video stream 124 , 132 , and 140 provided to the end points according to a second video specification or standard.
- end point device 102 may be configured to operate using the H.263 video coding standard, and accordingly, video streams 122 and 124 are configured as H.263 video streams.
- End point devices 104 and 106 may operate using the H.264 video coding standard, and accordingly, video streams 130 , 132 and 138 , 140 are configured as H.264 video streams.
- the transcoding system 200 converts the corresponding H.263 video stream received from end point device 102 to an AVC stream, and provides (via video switching module 112 ) the AVC video streams to end point devices 104 and 106 .
- the transcoding system 200 converts video streams in accordance with the appropriate standard (e.g., as needed by the respective device), preferably in real-time.
- FIG. 2 is a block diagram that illustrates an embodiment of the transcoding system 200 shown in FIG. 1 , and referred to as transcoding system 200 a .
- the transcoding system 200 a is configured to convert an H.263 video stream into an AVC video stream.
- One mechanism the transcoding system 200 a uses to implement this conversion is to substitute the motion estimation process used in AVC encoding by a simple but effective motion vector re-estimation process which utilizes the incoming H.263 video information and the H.263 decoded video data.
- FIG. 2 is a block diagram that illustrates an embodiment of the transcoding system 200 shown in FIG. 1 , and referred to as transcoding system 200 a .
- the transcoding system 200 a is configured to convert an H.263 video stream into an AVC video stream.
- One mechanism the transcoding system 200 a uses to implement this conversion is to substitute the motion estimation process used in AVC encoding by a simple but effective motion vector re-estimation process which utilizes the incoming
- the transcoding system 200 a comprises an H.263 decoder 202 , a content-based motion re-estimation (CBMRE) module 204 , and an AVC encoder 206 .
- the H.263 decoder 202 receives and processes an H.263 video stream, and responsively provides H.263 decoded frames 208 , H.263 motion vectors 210 , quantized DCT coefficients 212 , and residuals (predicted error signals or residual signals) 214 to the CBMRE module 204 .
- the H.263 decoded frames 208 , H.263 motion vectors 210 , quantized DCT coefficients 212 , and residuals 214 are processed and reused in the CBMRE module 204 , the latter which outputs decoded frames 216 and refined motion vectors and the corresponding MB encoding modes 218 and provides the outputs to the AVC encoder 206 .
- the AVC encoder 206 in turn provides an AVC video stream at its output.
- transcoding system 200 b A particular embodiment of a transcoding system 200 a is shown in FIG. 3 , and referred to as transcoding system 200 b .
- the transcoding system 200 b reveals a more detailed structure for each component of the transcoding system 200 a shown in FIG. 2 .
- the transcoder 200 b comprises the H.263 decoder 202 , CBMRE module 204 , and the AVC encoder 206 .
- the AVC encoder 206 comprises known components, such as computation reduced motion estimation (CRME) module 336 (which receives skip mode decision signals, motion vectors, and MB encoding mode signals from the CBMRE module 204 ), combiner module 328 (which receives decoded frames from the CBMRE module 204 ) and combiner module 334 , transform module 326 , quantizer module 324 , entropy coding (EC) module 322 , inverse quantizer module 330 , integer transform module 332 , a deblock filter 338 and a frame buffer 340 (i.e., one or more repositories for reconstructed frames that serve as reference pictures).
- CRME computation reduced motion estimation
- EC entropy coding
- a given macroblock that is non-intra coded and motion compensated has a corresponding motion vector and may have a residual signal. If the MB has a residual signal, it is typically provided as information corresponding to quantized transform coefficients.
- the syntax of the received video stream indicates that the given macroblock has a motion vector that motion compensates the macroblock, and possibly also a residual signal to add (e.g., if not a perfect match or when not forced to appear as a perfect match through quantizing the resulting residual to make it zero across all 256 pixels of the macroblock).
- the H.263 decoder 202 comprises an entropy decoding (ED) module 302 that receives a video stream (e.g., H.263 video stream) that converts entropy coded tokens to decoded information, such as motion vectors provided on line 213 and quantized DCT coefficients provided on line 212 .
- the motion vectors (shown on line 213 ) are provided to a motion compensation (MC) module 310 , which in accordance with the values of the motion vectors retrieves motion compensated information stored in frame buffer 312 to provide motion compensated MB information on line 217 .
- MC motion compensation
- the MC module 310 further provides its output to the CBMRE module 204 for use in skip mode processing as described below.
- Quantized transform i.e., DCT
- IQ inverse quantizer
- the dequantized coefficients are provided to an inverse discrete cosine transform (IDCT) module 306 , which provides the resulting residual signal of a MB, or a portion thereof, to the CBMRE module 204 (e.g., for threshold set-up processing) as well as to combiner module 308 .
- the combiner module 308 combines the motion compensated video on line 217 with the residuals from the IDCT module 306 to provide decoded frames, or portions thereof, that are output on line 208 to the CBMRE module 204 (e.g., for MB encoding mode decision processing) as well as passed to the frame buffer 312 .
- the CBMRE module 204 comprises a threshold set-up module 314 , a mode decision module 316 , a skip mode decision (SMD) module 318 , and a motion vector re-estimation module 320 .
- the threshold set-up module 314 is coupled to the output of the IDCT module 306 via line 214 , and to the skip mode decision module 318 .
- the mode decision module 316 is coupled to the input of the motion vector re-estimation module 320 and to the outputs of the threshold set-up module 314 , the combiner module via line 208 , and the skip mode decision module 318 .
- the skip mode decision module 318 is coupled to the inputs of the mode decision module 316 and the AVC encoder 206 and to the outputs of the MC module 310 and the ED module 302 of the H.263 decoder 202 , as well as to the output of the threshold set-up module 314 .
- the motion vector re-estimation module 320 provides its output to the H.264 encoder 206 . Note that, although shown logically as individual components, functionality of one or more of these components may be combined in a single component, with or without additional connections that enable communication among one or more of the components of the CBMRE module 204 .
- the CBMRE module 204 is a separate module. In some embodiments, one or more of the internal components of the CBMRE module 204 are implemented by the same computing or processing devices implementing decoder 202 . In some embodiments, decoder 202 is controlled by a microprocessor (not shown) that causes information 208 , 210 , 212 , and 214 to be provided to CBMRE module 204 .
- the residual signals on line 214 are output by the IDCT module 306 and provided to the threshold set-up module 314 , where a threshold value is determined.
- the CBMRE module 204 e.g., threshold set-up module 314
- a threshold (or threshold value) is set up as a criterion for making decisions on partition modes. The value of the threshold enables a determination by the CBMRE module 204 as to whether each of the H.263 motion vectors is to be considered already optimal (e.g., not requiring re-calculation based on further block partition during AVC encoding) or not.
- the threshold enables a determination as to when to take (designate) a motion vector as a “good enough” motion vector representation for an entire MB (e.g., a 16 ⁇ 16 block) when re-encoding the MB in the AVC encoder 206 .
- the good enough motion vector may convey that there is no motion estimation or refinements to be done in the AVC encoder 206 as part of the transcode operation.
- the macroblock is a candidate to be partitioned into smaller blocks or MB sub-blocks (e.g., into 8 ⁇ 8 blocks, as allowed in the second video coding specification or H.264) and motion estimation is conducted for the four respective 8 ⁇ 8 blocks that comprise the 16 ⁇ 16 macroblock.
- MB sub-blocks e.g., into 8 ⁇ 8 blocks, as allowed in the second video coding specification or H.264
- motion estimation is conducted for the four respective 8 ⁇ 8 blocks that comprise the 16 ⁇ 16 macroblock.
- refinements are also possible as 16 ⁇ 8, 8 ⁇ 16 (i.e., not just 8 ⁇ 8), as well as further refinements from an 8 ⁇ 8 to 8 ⁇ 4, 4 ⁇ 8, or 4 ⁇ 4 blocks.
- the transcoding system 200 b is configured to reuse, when possible, the available video information from the H.263 decoder 202 .
- the CBMRE module 204 e.g., the threshold set-up module 314 ) computes statistics for the sum of the absolute differences (SAD) of the non-intra coded macroblocks (e.g., the temporally predicted macroblocks) in the decoded H.263 macroblock.
- the residual of each non-intra coded macroblock received at H.263 decoder 202 typically corresponds to the values of the quantized SAD of its prediction from one or possibly more reference pictures to its original pixel values while the respective macroblock is being encoded (i.e., by an H.263 encoder prior to the H.263 stream reception at the H.263 decoder 202 ).
- a representation of the sum of the respective SAD for the non-intra coded MBs for the entire decoded picture or pictures is computed by adding the respective residual absolute values 214 for each macroblock in threshold set-up module 314 . Note that in a video conferencing environment, video sequences typically exhibit slow motions for the majority of time.
- the residual of a MB is relevant in deciding if the motion vector is good enough or not rather than incurring more comprehensive computation or processing.
- the re-use of H.263 motion vectors does not necessarily eliminate the motion search processing of AVC in all implementations, but rather, aids the motion estimation in AVC encoding or reduces the AVC motion search process of AVC.
- the respective sum of the absolute values of each non-intra coded MB over a picture or a plurality of pictures results in a statistical distribution, called herein the residual distribution. It may not always be the case that a residual distribution comprises a symmetrical density around the mean, since video data manifests many different distributions. Some distributions may be asymmetrical or have insufficient population around the mean, for any of several reasons.
- the residual distribution serves as a model to decide the thresholds, as well as MB encoding mode selections in AVC encoder 206 .
- the sum of absolute residuals of a MB is referred to as its SAR. If the SAR of a given macroblock is smaller than the determined threshold, the H.263 motion vector for the given macroblock is considered good enough and can be reused to aid motion estimation in AVC encoding. On the other hand, if the SAR is larger than the threshold, the H.263 motion vector is not considered good enough and needs to be re-estimated by the CBMRE module 204 (e.g., the motion vector re-estimation module 320 ).
- the motion vector is re-used for guiding the motion estimation when the decoded pictures is AVC encoded
- the corresponding residuals and the motion vector, when encoded in AVC may differ based on differences in quantization and based on the use in AVC of quarter pel interpolation (a refinement step) that likely affects (and possibly reduces) the residual.
- a refinement step to half pel granularity or two refinement steps to quarter pel granularity (or only one refinement step from half to quarter pel).
- the motion vector of a MB in the H.263 stream may be (0,0) (i.e., the MB is temporally compensated without a motion vector such as when a portion of the video is static).
- the motion vector obtained during H.263 decoding serves to offset the search space during motion estimation in the AVC encoder 206 , where such a search space is smaller than if there were no motion vector guidance from the H.263 decode operation. Accordingly, even if a given motion vector is deemed or designated as a good or optimal motion vector, the motion vector values may vary slightly in AVC during a refinement step.
- motion estimation may be performed over a search space whose size is determined by how far the SAR of the MB was from the threshold.
- the shape of the search space is also determined according to the motion vector direction.
- the SAR of the MB also determines the search space size for motion estimation of MB sub-blocks (e.g., macroblocks broken down to 8 ⁇ 8).
- the AVC encoder 206 may calculate the SAD since pictures in AVC are deblocked (so the residual is different).
- FIG. 4 illustrates a simulated example distribution 400 of SARs for a picture or frame.
- the SAR of each macroblock is small and the distribution of these SAR values should be around the average value of the SARs out of all the macroblocks in a frame (or multiple frames).
- the SAR of macroblocks not deemed to be good enough are values that deviate (to the right or higher in FIG. 4 ) from the mean of the SARs.
- distributions that are below the mean of the SARs demonstrate the case where the motion vector is considered good enough for reuse and/or to guide the motion estimation of the AVC encoder 206 .
- distributions above SAR 16 ⁇ 16 are those that result in a large predicted error and merit breaking the MB into sub-blocks for motion estimation in AVC encoder 206 .
- the threshold or threshold value is chosen by evaluating the SAR distribution over one or more pictures and setting the threshold for “good enough” motion vectors as a function of the standard deviation (e.g., at one standard deviation (1 ⁇ ) 402 ). Any SAR 16 ⁇ 16 above the standard deviation 402 is subject to further motion re-estimation in AVC encoder 206 .
- the standard deviation 402 of the SAR 16 ⁇ 16 is given in Equation (1) below, where N is the total number of the non-intra coded macroblocks contributing to the distribution over one or more frames.
- the threshold is then set as follows:
- Threshold 16 ⁇ 16 SAR 16 ⁇ 16 _ + q ⁇ ⁇ ⁇ 16 ⁇ 16 .
- q is a scalar. In one embodiment, q is 1.0.
- a further refinement of the thresholds for block sizes 8 ⁇ 8 and 4 ⁇ 4 can be made by using a factor or weight parameter (e.g., q) in front of ⁇ 16 ⁇ 16 .
- a factor or weight parameter e.g., q
- q may take on values of 1.5, 1.7, etc., among other values.
- the relationship of the picture quantization (non-intra) and SAR 16 ⁇ 16 average may influence the threshold determination (e.g., the actual picture quantization level is used to determine the value of q).
- the skip mode features of the CBMRE module 204 e.g., skip mode decision module 318 .
- Skip mode is used prevalently in the slow motion sequences, like those often present in video conferencing.
- the skip mode decision module 318 provides a signal to the AVC encoder 206 (e.g., to the CRME module 336 ).
- the skip mode is decoded in decoder 202 by using the predicted motion vectors (PMV) as the motion vector of the block and zeros as the transform coefficients.
- PMV predicted motion vectors
- SMD 318 decides if skip mode is to be selected for the current macroblock 502 according to the following:
- the SAR 16 ⁇ 16 of the macroblock 502 and the neighboring three macroblocks are compared to Threshold 16 ⁇ 16 . If all four macroblocks 502 , 504 , 506 , and 508 satisfy SAR 16 ⁇ 16 ⁇ Threshold 16 ⁇ 16 , then processing proceeds to step 2 below;
- Another condition of deciding on the skip mode is that the reference frame is the previous one which is the only choice in H.263. Since the video conferencing is most likely slow motion sequence, the motion refinement by employing multiple reference frames is not included in the above step mode decision process.
- the skip mode is selected and the signal is sent to the AVC encoder 206 (e.g., CRME module 336 ) as guidance to motion estimation. If skip mode is not chosen, further mode decision (e.g., implemented in one embodiment by mode decision module 316 ) needs to be made, as set forth by the processing described below (Cases 1-4) and described in association with FIGS. 6A-6B .
- Case 2 For the current macroblock, if SAR 16 ⁇ 16 >Threshold 16 ⁇ 16 , the macroblock is further partitioned into four 8 ⁇ 8 blocks 602 , 604 , 606 , and 608 as conceptually shown in FIG. 6A . Shown in FIG. 6A is 16 ⁇ 16 motion vector 610 and a corresponding motion vector 612 for one of the 8 ⁇ 8 quadrants of the MB. The SAR for each of the 8 ⁇ 8 blocks are recomputed and compared to Threshold 8 ⁇ 8 .
- the motion vector 612 for this 8 ⁇ 8 block is obtained by mapping the corresponding motion vector for the 8 ⁇ 8 from the MV 16 ⁇ 16 610 as conceptually shown in FIG. 6A with MV 8 ⁇ 8 612 .
- the MV 8 ⁇ 8 612 is mapped from the MV 16 ⁇ 16 610 by simple index calculation.
- Case 3 For blocks where SAR 8 ⁇ 8 >Threshold 8 ⁇ 8 , such blocks are further partitioned into 4 ⁇ 4 blocks. Shown conceptually in FIG. 6B is 16 ⁇ 16 motion vector 614 and corresponding 4 ⁇ 4 motion vector 616 . The SAR of each 4 ⁇ 4 block is computed and compared to Threshold 4 ⁇ 4 . If SAR 4 ⁇ 4 ⁇ Threshold 4 ⁇ 4 , the MV 4 ⁇ 4 616 is obtained again by mapping from the MV 16 ⁇ 16 614 as conceptually illustrated in FIG. 6B .
- the motion vector for this 4 ⁇ 4 block may be used in AVC encoder 206 as an offset of the search space to perform motion estimation, such as with a spiral pattern search around the motion vector that was not good enough, as explained below.
- skip mode is provided as a syntax element.
- Blocks 702 , 704 , and 706 correspond to illustrations of a 16 ⁇ 16 block, partitioned further into four 8 ⁇ 8 block, and further into 4 ⁇ 4 blocks, respectively.
- the transition 708 between the 16 ⁇ 16 block to the 8 ⁇ 8 blocks corresponds to the determination that SAR of the 16 ⁇ 16 macroblock is greater than (>) the 16 ⁇ 16 threshold.
- the transition 710 between the 8 ⁇ 8 blocks to the 4 ⁇ 4 blocks corresponds to the determination that the SAR of an 8 ⁇ 8 macroblock is greater than (>) the 8 ⁇ 8 threshold.
- motion vector re-estimation e.g., as implemented in one embodiment by motion vector re-estimation module 320
- the motion vector re-estimation is conducted for those 4 ⁇ 4 blocks (e.g., 4 ⁇ 4 block 802 ) exhibiting SAR 4 ⁇ 4 >Threshold 4 ⁇ 4 .
- the offset for the search space is decided by choosing between 804 and PMV 4 ⁇ 4 .
- PMV 4 ⁇ 4 is the predicted motion vector for the current 4 ⁇ 4 block and is computed as the median of the motion vectors of the neighboring blocks immediately above, diagonally above and to the right, and immediately left of the current block (e.g., as conceptually shown in FIG. 5B ). If some of the neighboring blocks are not available, such as the blocks on the border of the frame, PMV 4 ⁇ 4 is computed as the median of the remaining available neighboring blocks only.
- the candidate motion vector chosen between and PMV 4 ⁇ 4 for the search space offset is according to which one results in the smallest SAD. Once an offset is decided, a spiral pattern search is conducted.
- the number of candidate motion vectors, or number of layers in the spiral motion search may be determined by the magnitude of SAR of the 4 ⁇ 4 and/or the SAR of the 16 ⁇ 16 MB.
- An example of deciding the initial motion vector and conducting the following spiral motion search are conceptually shown in FIGS. 8 and 9 , respectively.
- the SAD 4 ⁇ 4 is computed and compared to Threshold 4 ⁇ 4 .
- the searching process stops and this motion vector is selected as the new MV 4 ⁇ 4 .
- the spiral search space is limited to 5 ⁇ 5.
- the initial motion vector (or offset) is provided by CBMRE 204 and the spiral motion estimation is conducted by CRME 336 in AVC encoder 206 .
- the spiral motion estimation is conducted on both search spaces corresponding to the PMV and the MV or a search space demarcated by the intersection of two search spaces corresponding to the PMV and the MV.
- one thresholding method embodiment 314 a comprises obtaining a SAR for all non-intra encoded macroblocks in a frame ( 1002 ), and computing a threshold based on SAR statistics collected over one or more pictures ( 1004 ).
- the threshold is set at the standard deviation to the right of the SAR mean or a scalar factor of the standard deviation.
- macroblocks having zero residual signals do not contribute towards the SAR statistics collection.
- macroblocks corresponding to zero residual signals do count towards the SAR statistics and computation of the threshold. For block sizes smaller than 16 ⁇ 16, a factor or weighting may be applied in the threshold determination.
- Another thresholding method embodiment 314 b shown in FIG. 11 , comprises computing the mean SAR ( 1102 ), determining for each SAR whether its magnitude is greater than the mean SAR ( 1104 ), and computing a right standard deviation or right first-order central moment, which in turn results in computing a threshold that is based only by those MBs having SARs above the mean SAR ( 1106 ).
- the standard deviation used for the threshold can be computed from only macroblocks that have 16 ⁇ 16 SAR values greater than the mean SAR 16 ⁇ 16 . In this manner, perfect matches (block matching) do not influence the computation of the threshold. For smaller block sizes (i.e., where further partitioning occurs due to values above the threshold), a factor or weighting is applied in the threshold determination.
- the right standard deviation of the SAR distribution is computed by modifying equation (1), such that N is replaced by N R , the number of MBs having a SAR greater than (or greater than or equal to, ⁇ ) the mean SAR, and only including in the equation's computations those SARs (greater than the mean SAR).
- one transcoding method embodiment 204 b implemented by the CBMRE module 204 comprises computing a threshold based on an average sum of residuals (SAR) and a standard deviation, the SARs for non-intra encoded macroblocks in a frame of a first video stream encoded according to a first video specification ( 1202 ), decoding the macroblocks of the frame ( 1204 ), comparing a first SAR of one of the macroblocks to the threshold, the first SAR associated with a first macroblock and a first motion vector ( 1206 ), and re-using the first motion vector to encode or in the encoding of the first macroblock according to a second video specification if the first SAR is less than the threshold ( 1208 ).
- SAR average sum of residuals
- the statistics may be based on the mean SAR 16 ⁇ 16 for different types of pictures (e.g., not just P pictures) and treated differently (e.g., kept or collected separately for different types of pictures).
- there may be further delineation within picture types e.g., separate means recorded based on number of reference pictures used, such as separate statistics collection for P-type or B-type pictures depending on how many reference pictures are used).
- thresholding may be based on SAR of macroblocks from plural pictures (versus a single picture or frame).
- the statistics may be kept for the last few pictures of the same type (e.g., collected for the same last N pictures of the same type), or until a scene change is detected (e.g., statistics collection may restart at scene change or after scene change detection). For instance, the number of macroblocks in the smaller pictures used in video conferencing may not be sufficient for statistics to have significance or to be meaningful, and hence, more samples may be required (e.g., continuously collect the previous 3-4 frame statistics to obtain a better threshold).
- the CBMRE module 204 (and components thereof) can be implemented in hardware, software, firmware, or a combination thereof. In software or firmware embodiments, functionality of the CBMRE module 204 is stored in a memory and executed by a suitable instruction execution system. In hardware embodiments, the CBMRE module 204 can be implemented with any or a combination of the following technologies, which are all well known in the art: a discrete logic circuit(s) having logic gates for implementing logic functions upon data signals, an application specific integrated circuit (ASIC) having appropriate combinational logic gates, a programmable gate array(s) (PGA), a field programmable gate array (FPGA), etc.
- ASIC application specific integrated circuit
- PGA programmable gate array
- FPGA field programmable gate array
- functionality of the CBMRE module in the form of a program can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions.
- an instruction execution system, apparatus, or device such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions.
- the scope of an embodiment of the present disclosure includes embodying the functionality of the embodiments of the present disclosure in logic embodied in hardware or software-configured mediums.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
where “q” is a scalar. In one embodiment, q is 1.0. For further partitions of a sub-block, such as from 8×8 to 4×4 sub-blocks, the thresholds are set up by directly dividing Threshold16×16 by K, where K=4 for 8×8 blocks. The value of K is linearly reduced based on the size of the block to be partitioned. While there exists a linear relationship of average SARs at three different sizes:
the standard deviations of three block sizes are not linear. One reason for not computing standard deviations for
Initial(MV 4×4)=MinMV(, SAD PMV
The number of candidate motion vectors, or number of layers in the spiral motion search, may be determined by the magnitude of SAR of the 4×4 and/or the SAR of the 16×16 MB. An example of deciding the initial motion vector and conducting the following spiral motion search are conceptually shown in
Claims (18)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/180,501 US8300696B2 (en) | 2008-07-25 | 2008-07-25 | Transcoding for systems operating under plural video coding specifications |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/180,501 US8300696B2 (en) | 2008-07-25 | 2008-07-25 | Transcoding for systems operating under plural video coding specifications |
Publications (2)
Publication Number | Publication Date |
---|---|
US20100020878A1 US20100020878A1 (en) | 2010-01-28 |
US8300696B2 true US8300696B2 (en) | 2012-10-30 |
Family
ID=41568637
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/180,501 Active 2031-03-03 US8300696B2 (en) | 2008-07-25 | 2008-07-25 | Transcoding for systems operating under plural video coding specifications |
Country Status (1)
Country | Link |
---|---|
US (1) | US8300696B2 (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080019448A1 (en) * | 2006-07-24 | 2008-01-24 | Samsung Electronics Co., Ltd. | Motion estimation apparatus and method and image encoding apparatus and method employing the same |
US20100149424A1 (en) * | 2008-12-15 | 2010-06-17 | Electronics And Telecommunications Research Institute | System and method for detecting scene change |
US20130114716A1 (en) * | 2011-11-04 | 2013-05-09 | Futurewei Technologies, Co. | Differential Pulse Code Modulation Intra Prediction for High Efficiency Video Coding |
US20140038514A1 (en) * | 2012-07-31 | 2014-02-06 | General Instrument Corporation | Display aware transcoder source selection system |
US20150139304A1 (en) * | 2012-06-29 | 2015-05-21 | Sony Corporation | Image processing apparatus and method |
US20170188048A1 (en) * | 2008-10-14 | 2017-06-29 | Sk Telecom Co., Ltd. | Method and apparatus for encoding/decoding the motion vectors of a plurality of reference pictures, and apparatus and method for image encoding/decoding using same |
US9998750B2 (en) | 2013-03-15 | 2018-06-12 | Cisco Technology, Inc. | Systems and methods for guided conversion of video from a first to a second compression format |
CN109413435A (en) * | 2018-10-26 | 2019-03-01 | 西安科锐盛创新科技有限公司 | A kind of prediction technique based on video compress |
Families Citing this family (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
BR0015959A (en) * | 1999-12-14 | 2002-08-06 | Scientific Atlanta | System and method for processing adaptive video with coordinated resource allocation |
US7274857B2 (en) | 2001-12-31 | 2007-09-25 | Scientific-Atlanta, Inc. | Trick modes for compressed video streams |
US7966642B2 (en) * | 2003-09-15 | 2011-06-21 | Nair Ajith N | Resource-adaptive management of video storage |
US8600217B2 (en) * | 2004-07-14 | 2013-12-03 | Arturo A. Rodriguez | System and method for improving quality of displayed picture during trick modes |
US20090033791A1 (en) * | 2007-07-31 | 2009-02-05 | Scientific-Atlanta, Inc. | Video processing systems and methods |
WO2010050089A1 (en) * | 2008-10-29 | 2010-05-06 | パナソニック株式会社 | Encoding method and encoding device for compression encoding of moving images |
US9100656B2 (en) * | 2009-05-21 | 2015-08-04 | Ecole De Technologie Superieure | Method and system for efficient video transcoding using coding modes, motion vectors and residual information |
US8374113B2 (en) | 2010-06-03 | 2013-02-12 | Cisco Technology, Inc. | Distributed gateway for reliable multicast wireless video |
KR101677696B1 (en) * | 2010-12-14 | 2016-11-18 | 한국전자통신연구원 | Method and Apparatus for effective motion vector decision for motion estimation |
US8811167B2 (en) | 2011-02-24 | 2014-08-19 | Cisco Technology, Inc. | Shaping multimedia stream bit-rates to adapt to network conditions |
KR101830352B1 (en) | 2011-11-09 | 2018-02-21 | 에스케이 텔레콤주식회사 | Method and Apparatus Video Encoding and Decoding using Skip Mode |
US9532080B2 (en) | 2012-05-31 | 2016-12-27 | Sonic Ip, Inc. | Systems and methods for the reuse of encoding information in encoding alternative streams of video data |
US9357210B2 (en) * | 2013-02-28 | 2016-05-31 | Sonic Ip, Inc. | Systems and methods of encoding multiple video streams for adaptive bitrate streaming |
US9350990B2 (en) | 2013-02-28 | 2016-05-24 | Sonic Ip, Inc. | Systems and methods of encoding multiple video streams with adaptive quantization for adaptive bitrate streaming |
US10616578B2 (en) * | 2015-01-30 | 2020-04-07 | Texas Instruments Incorporated | Semi-global matching (SGM) cost compression |
US10972788B1 (en) * | 2018-08-30 | 2021-04-06 | Amazon Technologies, Inc. | Distortion-based video re-encoding |
CN111988648A (en) * | 2020-08-27 | 2020-11-24 | 青岛海信传媒网络技术有限公司 | Time display method and display device |
Citations (111)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4216504A (en) | 1978-04-07 | 1980-08-05 | Arvin Industries, Inc. | Slow motion color video recording and playback system |
US4504852A (en) | 1982-09-10 | 1985-03-12 | Beehler, Pavitt, Siegemund, Jagger & Martella | Method and apparatus for video standard conversion |
US4881125A (en) | 1988-10-14 | 1989-11-14 | General Instrument Corporation | Progressive scan display of video derived from film |
US5187575A (en) | 1989-12-29 | 1993-02-16 | Massachusetts Institute Of Technology | Source adaptive television system |
US5218435A (en) | 1991-02-20 | 1993-06-08 | Massachusetts Institute Of Technology | Digital advanced television systems |
US5262854A (en) | 1992-02-21 | 1993-11-16 | Rca Thomson Licensing Corporation | Lower resolution HDTV receivers |
EP0595323A2 (en) | 1992-10-30 | 1994-05-04 | Sony Corporation | Downward compatible video system |
US5329309A (en) | 1990-11-15 | 1994-07-12 | Sony United Kingdom Limited | Method of integrating format material and an interlace scan format signal |
US5377051A (en) | 1993-01-13 | 1994-12-27 | Hitachi America, Ltd. | Digital video recorder compatible receiver with trick play image enhancement |
US5426464A (en) | 1993-01-14 | 1995-06-20 | Rca Thomson Licensing Corporation | Field elimination apparatus for a video compression/decompression system |
US5444491A (en) | 1993-02-26 | 1995-08-22 | Massachusetts Institute Of Technology | Television system with multiple transmission formats |
US5606359A (en) | 1994-06-30 | 1997-02-25 | Hewlett-Packard Company | Video on demand system with multiple data sources configured to provide vcr-like services |
US5614952A (en) | 1994-10-11 | 1997-03-25 | Hitachi America, Ltd. | Digital video decoder for decoding digital high definition and/or digital standard definition television signals |
US5646693A (en) | 1994-11-04 | 1997-07-08 | Cismas; Sorin | Memory utilization for video decoding and display with 3:2 pull-down |
US5703966A (en) | 1995-06-27 | 1997-12-30 | Intel Corporation | Block selection using motion estimation error |
US5742829A (en) | 1995-03-10 | 1998-04-21 | Microsoft Corporation | Automatic software installation on heterogeneous networked client computer systems |
US5748789A (en) | 1996-10-31 | 1998-05-05 | Microsoft Corporation | Transparent block skipping in object-based video coding systems |
US5764992A (en) | 1995-06-06 | 1998-06-09 | Apple Computer, Inc. | Method and apparatus for automatic software replacement |
US5812787A (en) | 1995-06-30 | 1998-09-22 | Intel Corporation | Video coding scheme with foreground/background separation |
US5828370A (en) | 1996-07-01 | 1998-10-27 | Thompson Consumer Electronics Inc. | Video delivery system and method for displaying indexing slider bar on the subscriber video screen |
US5835149A (en) | 1995-06-06 | 1998-11-10 | Intel Corporation | Bit allocation in a coded video sequence |
US5836003A (en) | 1993-08-26 | 1998-11-10 | Visnet Ltd. | Methods and means for image and voice compression |
US5835151A (en) | 1996-05-15 | 1998-11-10 | Mitsubishi Electric Information Technology Center America | Method and apparatus for down-converting a digital signal |
US5844620A (en) | 1995-08-11 | 1998-12-01 | General Instrument Corporation | Method and apparatus for displaying an interactive television program guide |
US5929911A (en) | 1997-10-27 | 1999-07-27 | International Business Machines Corporation | Multiformat reduced memory MPEG-2 compliant decoder |
US5953506A (en) | 1996-12-17 | 1999-09-14 | Adaptive Media Technologies | Method and apparatus that provides a scalable media delivery system |
DE19810814A1 (en) | 1998-03-12 | 1999-09-16 | Ericsson Telefon Ab L M | Software processing device with software actualization function |
US5956026A (en) | 1997-12-19 | 1999-09-21 | Sharp Laboratories Of America, Inc. | Method for hierarchical summarization and browsing of digital video |
US5959684A (en) | 1997-07-28 | 1999-09-28 | Sony Corporation | Method and apparatus for audio-video synchronizing |
US5982360A (en) | 1997-06-08 | 1999-11-09 | United Microelectronics Corp. | Adaptive-selection method for memory access priority control in MPEG processor |
US6006034A (en) | 1996-09-05 | 1999-12-21 | Open Software Associates, Ltd. | Systems and methods for automatic application version upgrading and maintenance |
US6009231A (en) | 1994-09-05 | 1999-12-28 | Sony Corporation | Reproduction of information using a ring buffer with read and write pointers separated from each other by substantially half of the total ring buffer capacity |
US6043838A (en) | 1997-11-07 | 2000-03-28 | General Instrument Corporation | View offset estimation for stereoscopic video coding |
US6072532A (en) | 1997-02-18 | 2000-06-06 | Scientific-Atlanta, Inc. | Method and apparatus for generic insertion of data in vertical blanking intervals |
US6072531A (en) | 1997-11-21 | 2000-06-06 | Nec Corporation | Scanning system converting into progressive scanning system regardless of scanning system before coding |
US6084908A (en) | 1995-10-25 | 2000-07-04 | Sarnoff Corporation | Apparatus and method for quadtree based variable block size motion estimation |
EP1026899A1 (en) | 1997-10-27 | 2000-08-09 | Mitsubishi Denki Kabushiki Kaisha | Image encoding device, image encoding method, image decoding device and image decoding method |
US6137948A (en) | 1997-11-04 | 2000-10-24 | Samsung Electronics Co., Ltd. | Frame construction apparatus for slow-speed reproduction of a moving picture signal |
US6148027A (en) | 1997-05-30 | 2000-11-14 | Sarnoff Corporation | Method and apparatus for performing hierarchical motion estimation using nonlinear pyramid |
US6157396A (en) | 1999-02-16 | 2000-12-05 | Pixonics Llc | System and method for using bitstream information to process images for use in digital display systems |
WO2001013625A1 (en) | 1999-08-17 | 2001-02-22 | General Instrument Corporation | Transcoding for consumer set-top storage applications |
US6201927B1 (en) | 1997-02-18 | 2001-03-13 | Mary Lafuze Comer | Trick play reproduction of MPEG encoded signals |
US6208692B1 (en) | 1997-12-31 | 2001-03-27 | Sarnoff Corporation | Apparatus and method for performing scalable hierarchical motion estimation |
US6222979B1 (en) | 1997-02-18 | 2001-04-24 | Thomson Consumer Electronics | Memory control in trick play mode |
US6233253B1 (en) | 1997-05-23 | 2001-05-15 | Thomson Licensing S.A. | System for digital data format conversion and bit stream generation |
US20010014206A1 (en) | 1995-07-13 | 2001-08-16 | Max Artigalas | Method and device for recording and reading on a large-capacity medium |
US6326964B1 (en) | 1995-08-04 | 2001-12-04 | Microsoft Corporation | Method for sorting 3D object geometry among image chunks for rendering in a layered graphics rendering system |
EP1161089A2 (en) | 1995-09-11 | 2001-12-05 | Matsushita Electric Industrial Co., Ltd. | Video signal recording and reproducing apparatus |
US20020009149A1 (en) | 1999-12-14 | 2002-01-24 | Rodriguez Arturo A. | System and method for adaptive video processing with coordinated resource allocation |
US6353633B1 (en) | 1996-12-20 | 2002-03-05 | Lg Electronics Inc. | Device and methods for transposing matrix of video signal and T.V. receiver employing the same |
US6360015B1 (en) | 1999-04-06 | 2002-03-19 | Philips Electronics North America Corp. | RAM-based search engine for orthogonal-sum block match motion estimation system |
US20020039483A1 (en) | 2000-10-03 | 2002-04-04 | Pace Micro Technology Plc. | Recompression of data in memory |
US20020044762A1 (en) | 1998-08-07 | 2002-04-18 | Anthony Wood | Method and apparatus for fast forwarding and rewinding in a video recording device |
WO2002043385A2 (en) | 2000-10-10 | 2002-05-30 | Broadcom Corporation | System and method for special reproduction modes of a digitally encoded video data stream |
US6400764B1 (en) | 1999-04-06 | 2002-06-04 | Koninklijke Philips Electronics N. V. | Motion estimation method featuring orthogonal-sum concurrent multi matching |
US20020071663A1 (en) | 2000-12-07 | 2002-06-13 | O'donnel John Setel | Digital video recording system having multi-pass video processing |
US6408101B1 (en) | 1997-12-31 | 2002-06-18 | Sarnoff Corporation | Apparatus and method for employing M-ary pyramids to enhance feature-based classification and motion estimation |
US6414991B1 (en) | 1997-04-01 | 2002-07-02 | Sony Corporation | Image encoder, image encoding method, image decoder, image decoding method, and distribution media |
US6430317B1 (en) | 1997-12-31 | 2002-08-06 | Sarnoff Corporation | Method and apparatus for estimating motion using block features obtained from an M-ary pyramid |
US6434196B1 (en) | 1998-04-03 | 2002-08-13 | Sarnoff Corporation | Method and apparatus for encoding video information |
US6434197B1 (en) | 1999-01-07 | 2002-08-13 | General Instrument Corporation | Multi-functional transcoder for compressed bit streams |
US6441754B1 (en) | 1999-08-17 | 2002-08-27 | General Instrument Corporation | Apparatus and methods for transcoder-based adaptive quantization |
US6477562B2 (en) | 1998-12-16 | 2002-11-05 | Clearwater Networks, Inc. | Prioritized instruction scheduling for multi-streaming processors |
US20030001964A1 (en) | 2001-06-29 | 2003-01-02 | Koichi Masukura | Method of converting format of encoded video data and apparatus therefor |
US20030066084A1 (en) | 2001-09-28 | 2003-04-03 | Koninklijke Philips Electronics N. V. | Apparatus and method for transcoding data received by a recording device |
US6560371B1 (en) | 1997-12-31 | 2003-05-06 | Sarnoff Corporation | Apparatus and method for employing M-ary pyramids with N-scale tiling |
US20030093800A1 (en) | 2001-09-12 | 2003-05-15 | Jason Demas | Command packets for personal video recorder |
US6570579B1 (en) | 1998-11-09 | 2003-05-27 | Broadcom Corporation | Graphics display system |
US20030098924A1 (en) | 1998-10-02 | 2003-05-29 | Dale R. Adams | Method and apparatus for detecting the source format of video images |
US20030103604A1 (en) | 2000-04-21 | 2003-06-05 | Motoki Kato | Information processing apparatus and method, program and recorded medium |
US20030113098A1 (en) | 2001-12-19 | 2003-06-19 | Willis Donald H. | Trick mode playback of recorded video |
US20030147631A1 (en) | 2002-01-31 | 2003-08-07 | Sony Corporation | System and method for efficiently performing a storage management procedure |
US6608625B1 (en) | 1998-10-14 | 2003-08-19 | Hitachi, Ltd. | Three dimensional graphic processor |
US6618507B1 (en) | 1999-01-25 | 2003-09-09 | Mitsubishi Electric Research Laboratories, Inc | Methods of feature extraction of video sequences |
US20030170003A1 (en) | 1999-09-03 | 2003-09-11 | Alain P. Levesque | Time-shifted video signal processing |
US6654539B1 (en) | 1998-10-26 | 2003-11-25 | Sony Corporation | Trick playback of digital video data |
US6658157B1 (en) | 1999-06-29 | 2003-12-02 | Sony Corporation | Method and apparatus for converting image information |
US6658199B1 (en) | 1999-12-16 | 2003-12-02 | Sharp Laboratories Of America, Inc. | Method for temporally smooth, minimal memory MPEG-2 trick play transport stream construction |
US20030233663A1 (en) | 2002-06-14 | 2003-12-18 | Rao Ram R. | Transcoding media content from a personal video recorder for a portable device |
US6671322B2 (en) | 2001-05-11 | 2003-12-30 | Mitsubishi Electric Research Laboratories, Inc. | Video transcoder with spatial resolution reduction |
US6671454B1 (en) | 1998-11-19 | 2003-12-30 | Nec Corporation | Program information providing apparatus and record/playback control apparatus |
US6690881B1 (en) | 1998-08-24 | 2004-02-10 | Sony Corporation | Digital camera apparatus and recording method thereof |
US20040055020A1 (en) | 2002-08-29 | 2004-03-18 | Opentv, Inc. | Method and apparatus for selecting compression for an incoming video signal in an interactive television system |
US20040062313A1 (en) * | 2002-03-27 | 2004-04-01 | Schoenblum Joel W. | Digital stream transcoder with a hybrid-rate controller |
US6735253B1 (en) | 1997-05-16 | 2004-05-11 | The Trustees Of Columbia University In The City Of New York | Methods and architecture for indexing and editing compressed video over the world wide web |
US6766407B1 (en) | 2001-03-27 | 2004-07-20 | Microsoft Corporation | Intelligent streaming framework |
US6768774B1 (en) | 1998-11-09 | 2004-07-27 | Broadcom Corporation | Video and graphics system with video scaling |
US6847778B1 (en) | 1999-03-30 | 2005-01-25 | Tivo, Inc. | Multimedia visual progress indication system |
US20050022245A1 (en) | 2003-07-21 | 2005-01-27 | Ramesh Nallur | Seamless transition between video play-back modes |
US6876703B2 (en) | 2000-05-11 | 2005-04-05 | Ub Video Inc. | Method and apparatus for video coding |
US20050074063A1 (en) | 2003-09-15 | 2005-04-07 | Nair Ajith N. | Resource-adaptive management of video storage |
US6909749B2 (en) | 2002-07-15 | 2005-06-21 | Pts Corporation | Hierarchical segment-based motion vector encoding and decoding |
US6931064B2 (en) | 2001-09-21 | 2005-08-16 | Mitsubishi Denki Kabushiki Kaisha | Motion picture data converter, and computer product |
US20060013568A1 (en) | 2004-07-14 | 2006-01-19 | Rodriguez Arturo A | System and method for playback of digital video pictures in compressed streams |
US6996838B2 (en) | 2001-06-12 | 2006-02-07 | Scientific Atlanta, Inc. | System and method for media processing with adaptive resource access priority assignment |
US7010040B2 (en) * | 2000-11-30 | 2006-03-07 | Lg Electronics Inc. | Apparatus and method of transcoding image data in digital TV |
US7027713B1 (en) | 1999-11-30 | 2006-04-11 | Sharp Laboratories Of America, Inc. | Method for efficient MPEG-2 transport stream frame re-sequencing |
US20060093320A1 (en) | 2004-10-29 | 2006-05-04 | Hallberg Bryan S | Operation modes for a personal video recorder using dynamically generated time stamps |
US7050499B2 (en) | 2002-09-26 | 2006-05-23 | Kabushiki Kaisha Toshiba | Video encoding apparatus and method and video encoding mode converting apparatus and method |
US7079578B2 (en) | 2002-10-28 | 2006-07-18 | Scopus Network Technologies Ltd. | Partial bitstream transcoder system for compressed digital video bitstreams |
US7154560B1 (en) | 1997-10-27 | 2006-12-26 | Shih-Fu Chang | Watermarking of digital image data |
US7233622B2 (en) | 2003-08-12 | 2007-06-19 | Lsi Corporation | Reduced complexity efficient binarization method and/or circuit for motion vector residuals |
US7274857B2 (en) | 2001-12-31 | 2007-09-25 | Scientific-Atlanta, Inc. | Trick modes for compressed video streams |
US20070286581A1 (en) | 2002-06-25 | 2007-12-13 | Boston Stephen B | Personal Video Recording With Further Compression Of Recorded Shows |
US7324595B2 (en) | 2003-09-22 | 2008-01-29 | Lsi Logic Corporation | Method and/or apparatus for reducing the complexity of non-reference frame encoding using selective reconstruction |
US7327786B2 (en) * | 2003-06-02 | 2008-02-05 | Lsi Logic Corporation | Method for improving rate-distortion performance of a video compression system through parallel coefficient cancellation in the transform |
US20080031337A1 (en) * | 2006-08-04 | 2008-02-07 | Megachips Corporation | Transcoder and coded image conversion method |
US7356082B1 (en) | 1999-11-29 | 2008-04-08 | Sony Corporation | Video/audio signal processing method and video-audio signal processing apparatus |
US7391809B2 (en) * | 2003-12-30 | 2008-06-24 | Microsoft Corporation | Scalable video transcoding |
US20080260024A1 (en) * | 2006-10-03 | 2008-10-23 | Matsushita Electric Industrial Co., Ltd. | Method, device, integrated circuit, and transcoder for selectively reducing quantization levels |
US20090033791A1 (en) | 2007-07-31 | 2009-02-05 | Scientific-Atlanta, Inc. | Video processing systems and methods |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4216125A (en) * | 1978-12-07 | 1980-08-05 | Pq Corporation | Detergent compositions with silane-zeolite silicate builder |
-
2008
- 2008-07-25 US US12/180,501 patent/US8300696B2/en active Active
Patent Citations (125)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4216504A (en) | 1978-04-07 | 1980-08-05 | Arvin Industries, Inc. | Slow motion color video recording and playback system |
US4504852A (en) | 1982-09-10 | 1985-03-12 | Beehler, Pavitt, Siegemund, Jagger & Martella | Method and apparatus for video standard conversion |
US4881125A (en) | 1988-10-14 | 1989-11-14 | General Instrument Corporation | Progressive scan display of video derived from film |
US5187575A (en) | 1989-12-29 | 1993-02-16 | Massachusetts Institute Of Technology | Source adaptive television system |
US5329309A (en) | 1990-11-15 | 1994-07-12 | Sony United Kingdom Limited | Method of integrating format material and an interlace scan format signal |
US5485210A (en) | 1991-02-20 | 1996-01-16 | Massachusetts Institute Of Technology | Digital advanced television systems |
US5218435A (en) | 1991-02-20 | 1993-06-08 | Massachusetts Institute Of Technology | Digital advanced television systems |
US5262854A (en) | 1992-02-21 | 1993-11-16 | Rca Thomson Licensing Corporation | Lower resolution HDTV receivers |
EP0595323A2 (en) | 1992-10-30 | 1994-05-04 | Sony Corporation | Downward compatible video system |
US5377051A (en) | 1993-01-13 | 1994-12-27 | Hitachi America, Ltd. | Digital video recorder compatible receiver with trick play image enhancement |
US5426464A (en) | 1993-01-14 | 1995-06-20 | Rca Thomson Licensing Corporation | Field elimination apparatus for a video compression/decompression system |
US5444491A (en) | 1993-02-26 | 1995-08-22 | Massachusetts Institute Of Technology | Television system with multiple transmission formats |
US5836003A (en) | 1993-08-26 | 1998-11-10 | Visnet Ltd. | Methods and means for image and voice compression |
US5606359A (en) | 1994-06-30 | 1997-02-25 | Hewlett-Packard Company | Video on demand system with multiple data sources configured to provide vcr-like services |
US6009231A (en) | 1994-09-05 | 1999-12-28 | Sony Corporation | Reproduction of information using a ring buffer with read and write pointers separated from each other by substantially half of the total ring buffer capacity |
US5614952A (en) | 1994-10-11 | 1997-03-25 | Hitachi America, Ltd. | Digital video decoder for decoding digital high definition and/or digital standard definition television signals |
US5646693A (en) | 1994-11-04 | 1997-07-08 | Cismas; Sorin | Memory utilization for video decoding and display with 3:2 pull-down |
US5742829A (en) | 1995-03-10 | 1998-04-21 | Microsoft Corporation | Automatic software installation on heterogeneous networked client computer systems |
US5764992A (en) | 1995-06-06 | 1998-06-09 | Apple Computer, Inc. | Method and apparatus for automatic software replacement |
US5835149A (en) | 1995-06-06 | 1998-11-10 | Intel Corporation | Bit allocation in a coded video sequence |
US5703966A (en) | 1995-06-27 | 1997-12-30 | Intel Corporation | Block selection using motion estimation error |
US5812787A (en) | 1995-06-30 | 1998-09-22 | Intel Corporation | Video coding scheme with foreground/background separation |
US20010014206A1 (en) | 1995-07-13 | 2001-08-16 | Max Artigalas | Method and device for recording and reading on a large-capacity medium |
US6326964B1 (en) | 1995-08-04 | 2001-12-04 | Microsoft Corporation | Method for sorting 3D object geometry among image chunks for rendering in a layered graphics rendering system |
US5844620A (en) | 1995-08-11 | 1998-12-01 | General Instrument Corporation | Method and apparatus for displaying an interactive television program guide |
EP1161089A2 (en) | 1995-09-11 | 2001-12-05 | Matsushita Electric Industrial Co., Ltd. | Video signal recording and reproducing apparatus |
US6084908A (en) | 1995-10-25 | 2000-07-04 | Sarnoff Corporation | Apparatus and method for quadtree based variable block size motion estimation |
US5835151A (en) | 1996-05-15 | 1998-11-10 | Mitsubishi Electric Information Technology Center America | Method and apparatus for down-converting a digital signal |
US5828370A (en) | 1996-07-01 | 1998-10-27 | Thompson Consumer Electronics Inc. | Video delivery system and method for displaying indexing slider bar on the subscriber video screen |
US6006034A (en) | 1996-09-05 | 1999-12-21 | Open Software Associates, Ltd. | Systems and methods for automatic application version upgrading and maintenance |
US5748789A (en) | 1996-10-31 | 1998-05-05 | Microsoft Corporation | Transparent block skipping in object-based video coding systems |
US5953506A (en) | 1996-12-17 | 1999-09-14 | Adaptive Media Technologies | Method and apparatus that provides a scalable media delivery system |
US6353633B1 (en) | 1996-12-20 | 2002-03-05 | Lg Electronics Inc. | Device and methods for transposing matrix of video signal and T.V. receiver employing the same |
US6222979B1 (en) | 1997-02-18 | 2001-04-24 | Thomson Consumer Electronics | Memory control in trick play mode |
US6201927B1 (en) | 1997-02-18 | 2001-03-13 | Mary Lafuze Comer | Trick play reproduction of MPEG encoded signals |
US6072532A (en) | 1997-02-18 | 2000-06-06 | Scientific-Atlanta, Inc. | Method and apparatus for generic insertion of data in vertical blanking intervals |
US7302002B2 (en) | 1997-04-01 | 2007-11-27 | Sony Corporation | Image encoder, image encoding method, image decoder, image decoding method, and distribution media |
US6414991B1 (en) | 1997-04-01 | 2002-07-02 | Sony Corporation | Image encoder, image encoding method, image decoder, image decoding method, and distribution media |
US6535559B2 (en) | 1997-04-01 | 2003-03-18 | Sony Corporation | Image encoder, image encoding method, image decoder, image decoding method, and distribution media |
US6643328B2 (en) | 1997-04-01 | 2003-11-04 | Sony Corporation | Image encoder, image encoding method, image decoder, image decoding method, and distribution media |
US6735253B1 (en) | 1997-05-16 | 2004-05-11 | The Trustees Of Columbia University In The City Of New York | Methods and architecture for indexing and editing compressed video over the world wide web |
US6233253B1 (en) | 1997-05-23 | 2001-05-15 | Thomson Licensing S.A. | System for digital data format conversion and bit stream generation |
US6148027A (en) | 1997-05-30 | 2000-11-14 | Sarnoff Corporation | Method and apparatus for performing hierarchical motion estimation using nonlinear pyramid |
US5982360A (en) | 1997-06-08 | 1999-11-09 | United Microelectronics Corp. | Adaptive-selection method for memory access priority control in MPEG processor |
US5959684A (en) | 1997-07-28 | 1999-09-28 | Sony Corporation | Method and apparatus for audio-video synchronizing |
US7154560B1 (en) | 1997-10-27 | 2006-12-26 | Shih-Fu Chang | Watermarking of digital image data |
EP1026899A1 (en) | 1997-10-27 | 2000-08-09 | Mitsubishi Denki Kabushiki Kaisha | Image encoding device, image encoding method, image decoding device and image decoding method |
US5929911A (en) | 1997-10-27 | 1999-07-27 | International Business Machines Corporation | Multiformat reduced memory MPEG-2 compliant decoder |
US6137948A (en) | 1997-11-04 | 2000-10-24 | Samsung Electronics Co., Ltd. | Frame construction apparatus for slow-speed reproduction of a moving picture signal |
US6043838A (en) | 1997-11-07 | 2000-03-28 | General Instrument Corporation | View offset estimation for stereoscopic video coding |
US6072531A (en) | 1997-11-21 | 2000-06-06 | Nec Corporation | Scanning system converting into progressive scanning system regardless of scanning system before coding |
US5956026A (en) | 1997-12-19 | 1999-09-21 | Sharp Laboratories Of America, Inc. | Method for hierarchical summarization and browsing of digital video |
US5995095A (en) | 1997-12-19 | 1999-11-30 | Sharp Laboratories Of America, Inc. | Method for hierarchical summarization and browsing of digital video |
US6408101B1 (en) | 1997-12-31 | 2002-06-18 | Sarnoff Corporation | Apparatus and method for employing M-ary pyramids to enhance feature-based classification and motion estimation |
US6560371B1 (en) | 1997-12-31 | 2003-05-06 | Sarnoff Corporation | Apparatus and method for employing M-ary pyramids with N-scale tiling |
US6208692B1 (en) | 1997-12-31 | 2001-03-27 | Sarnoff Corporation | Apparatus and method for performing scalable hierarchical motion estimation |
US6430317B1 (en) | 1997-12-31 | 2002-08-06 | Sarnoff Corporation | Method and apparatus for estimating motion using block features obtained from an M-ary pyramid |
DE19810814A1 (en) | 1998-03-12 | 1999-09-16 | Ericsson Telefon Ab L M | Software processing device with software actualization function |
US6434196B1 (en) | 1998-04-03 | 2002-08-13 | Sarnoff Corporation | Method and apparatus for encoding video information |
US20020044762A1 (en) | 1998-08-07 | 2002-04-18 | Anthony Wood | Method and apparatus for fast forwarding and rewinding in a video recording device |
US6690881B1 (en) | 1998-08-24 | 2004-02-10 | Sony Corporation | Digital camera apparatus and recording method thereof |
US6700622B2 (en) | 1998-10-02 | 2004-03-02 | Dvdo, Inc. | Method and apparatus for detecting the source format of video images |
US20030098924A1 (en) | 1998-10-02 | 2003-05-29 | Dale R. Adams | Method and apparatus for detecting the source format of video images |
US6608625B1 (en) | 1998-10-14 | 2003-08-19 | Hitachi, Ltd. | Three dimensional graphic processor |
US6654539B1 (en) | 1998-10-26 | 2003-11-25 | Sony Corporation | Trick playback of digital video data |
US6768774B1 (en) | 1998-11-09 | 2004-07-27 | Broadcom Corporation | Video and graphics system with video scaling |
US6570579B1 (en) | 1998-11-09 | 2003-05-27 | Broadcom Corporation | Graphics display system |
US6671454B1 (en) | 1998-11-19 | 2003-12-30 | Nec Corporation | Program information providing apparatus and record/playback control apparatus |
US6477562B2 (en) | 1998-12-16 | 2002-11-05 | Clearwater Networks, Inc. | Prioritized instruction scheduling for multi-streaming processors |
US6434197B1 (en) | 1999-01-07 | 2002-08-13 | General Instrument Corporation | Multi-functional transcoder for compressed bit streams |
US6618507B1 (en) | 1999-01-25 | 2003-09-09 | Mitsubishi Electric Research Laboratories, Inc | Methods of feature extraction of video sequences |
US6157396A (en) | 1999-02-16 | 2000-12-05 | Pixonics Llc | System and method for using bitstream information to process images for use in digital display systems |
US6847778B1 (en) | 1999-03-30 | 2005-01-25 | Tivo, Inc. | Multimedia visual progress indication system |
US6360015B1 (en) | 1999-04-06 | 2002-03-19 | Philips Electronics North America Corp. | RAM-based search engine for orthogonal-sum block match motion estimation system |
US6400764B1 (en) | 1999-04-06 | 2002-06-04 | Koninklijke Philips Electronics N. V. | Motion estimation method featuring orthogonal-sum concurrent multi matching |
US6658157B1 (en) | 1999-06-29 | 2003-12-02 | Sony Corporation | Method and apparatus for converting image information |
US6532593B1 (en) | 1999-08-17 | 2003-03-11 | General Instrument Corporation | Transcoding for consumer set-top storage application |
WO2001013625A1 (en) | 1999-08-17 | 2001-02-22 | General Instrument Corporation | Transcoding for consumer set-top storage applications |
US6441754B1 (en) | 1999-08-17 | 2002-08-27 | General Instrument Corporation | Apparatus and methods for transcoder-based adaptive quantization |
US20030170003A1 (en) | 1999-09-03 | 2003-09-11 | Alain P. Levesque | Time-shifted video signal processing |
US7356082B1 (en) | 1999-11-29 | 2008-04-08 | Sony Corporation | Video/audio signal processing method and video-audio signal processing apparatus |
US7027713B1 (en) | 1999-11-30 | 2006-04-11 | Sharp Laboratories Of America, Inc. | Method for efficient MPEG-2 transport stream frame re-sequencing |
US20080253464A1 (en) | 1999-12-14 | 2008-10-16 | Rodriguez Arturo A | System and Method for Adapting Video Decoding Rate |
US20040218680A1 (en) | 1999-12-14 | 2004-11-04 | Rodriguez Arturo A. | System and method for adaptive video processing with coordinated resource allocation |
US20080279284A1 (en) | 1999-12-14 | 2008-11-13 | Rodriguez Arturo A | System and Method for Adapting Video Decoding Rate By Multiple Presentation of Frames |
US7869505B2 (en) | 1999-12-14 | 2011-01-11 | Rodriguez Arturo A | System and method for adaptive video processing with coordinated resource allocation |
US20020009149A1 (en) | 1999-12-14 | 2002-01-24 | Rodriguez Arturo A. | System and method for adaptive video processing with coordinated resource allocation |
US6658199B1 (en) | 1999-12-16 | 2003-12-02 | Sharp Laboratories Of America, Inc. | Method for temporally smooth, minimal memory MPEG-2 trick play transport stream construction |
US20030103604A1 (en) | 2000-04-21 | 2003-06-05 | Motoki Kato | Information processing apparatus and method, program and recorded medium |
US6876703B2 (en) | 2000-05-11 | 2005-04-05 | Ub Video Inc. | Method and apparatus for video coding |
EP1195995A2 (en) | 2000-10-03 | 2002-04-10 | Pace Micro Technology PLC | Recompression of data in memory |
US20020039483A1 (en) | 2000-10-03 | 2002-04-04 | Pace Micro Technology Plc. | Recompression of data in memory |
WO2002043385A2 (en) | 2000-10-10 | 2002-05-30 | Broadcom Corporation | System and method for special reproduction modes of a digitally encoded video data stream |
US7010040B2 (en) * | 2000-11-30 | 2006-03-07 | Lg Electronics Inc. | Apparatus and method of transcoding image data in digital TV |
US20020071663A1 (en) | 2000-12-07 | 2002-06-13 | O'donnel John Setel | Digital video recording system having multi-pass video processing |
US6766407B1 (en) | 2001-03-27 | 2004-07-20 | Microsoft Corporation | Intelligent streaming framework |
US6671322B2 (en) | 2001-05-11 | 2003-12-30 | Mitsubishi Electric Research Laboratories, Inc. | Video transcoder with spatial resolution reduction |
US6996838B2 (en) | 2001-06-12 | 2006-02-07 | Scientific Atlanta, Inc. | System and method for media processing with adaptive resource access priority assignment |
US20030001964A1 (en) | 2001-06-29 | 2003-01-02 | Koichi Masukura | Method of converting format of encoded video data and apparatus therefor |
US20030093800A1 (en) | 2001-09-12 | 2003-05-15 | Jason Demas | Command packets for personal video recorder |
US6931064B2 (en) | 2001-09-21 | 2005-08-16 | Mitsubishi Denki Kabushiki Kaisha | Motion picture data converter, and computer product |
US20030066084A1 (en) | 2001-09-28 | 2003-04-03 | Koninklijke Philips Electronics N. V. | Apparatus and method for transcoding data received by a recording device |
US20030113098A1 (en) | 2001-12-19 | 2003-06-19 | Willis Donald H. | Trick mode playback of recorded video |
US20080037957A1 (en) | 2001-12-31 | 2008-02-14 | Scientific-Atlanta, Inc. | Decoding and output of frames for video trick modes |
US20080037952A1 (en) | 2001-12-31 | 2008-02-14 | Scientific-Atlanta, Inc. | Annotations for trick modes of video streams with simultaneous processing and display |
US7274857B2 (en) | 2001-12-31 | 2007-09-25 | Scientific-Atlanta, Inc. | Trick modes for compressed video streams |
US20030147631A1 (en) | 2002-01-31 | 2003-08-07 | Sony Corporation | System and method for efficiently performing a storage management procedure |
US20040062313A1 (en) * | 2002-03-27 | 2004-04-01 | Schoenblum Joel W. | Digital stream transcoder with a hybrid-rate controller |
US20030233663A1 (en) | 2002-06-14 | 2003-12-18 | Rao Ram R. | Transcoding media content from a personal video recorder for a portable device |
US20070286581A1 (en) | 2002-06-25 | 2007-12-13 | Boston Stephen B | Personal Video Recording With Further Compression Of Recorded Shows |
US6909749B2 (en) | 2002-07-15 | 2005-06-21 | Pts Corporation | Hierarchical segment-based motion vector encoding and decoding |
US20040055020A1 (en) | 2002-08-29 | 2004-03-18 | Opentv, Inc. | Method and apparatus for selecting compression for an incoming video signal in an interactive television system |
US7050499B2 (en) | 2002-09-26 | 2006-05-23 | Kabushiki Kaisha Toshiba | Video encoding apparatus and method and video encoding mode converting apparatus and method |
US7079578B2 (en) | 2002-10-28 | 2006-07-18 | Scopus Network Technologies Ltd. | Partial bitstream transcoder system for compressed digital video bitstreams |
US7327786B2 (en) * | 2003-06-02 | 2008-02-05 | Lsi Logic Corporation | Method for improving rate-distortion performance of a video compression system through parallel coefficient cancellation in the transform |
US20050022245A1 (en) | 2003-07-21 | 2005-01-27 | Ramesh Nallur | Seamless transition between video play-back modes |
US7233622B2 (en) | 2003-08-12 | 2007-06-19 | Lsi Corporation | Reduced complexity efficient binarization method and/or circuit for motion vector residuals |
US20050074063A1 (en) | 2003-09-15 | 2005-04-07 | Nair Ajith N. | Resource-adaptive management of video storage |
US7324595B2 (en) | 2003-09-22 | 2008-01-29 | Lsi Logic Corporation | Method and/or apparatus for reducing the complexity of non-reference frame encoding using selective reconstruction |
US7391809B2 (en) * | 2003-12-30 | 2008-06-24 | Microsoft Corporation | Scalable video transcoding |
US20060013568A1 (en) | 2004-07-14 | 2006-01-19 | Rodriguez Arturo A | System and method for playback of digital video pictures in compressed streams |
US20060093320A1 (en) | 2004-10-29 | 2006-05-04 | Hallberg Bryan S | Operation modes for a personal video recorder using dynamically generated time stamps |
US20080031337A1 (en) * | 2006-08-04 | 2008-02-07 | Megachips Corporation | Transcoder and coded image conversion method |
US20080260024A1 (en) * | 2006-10-03 | 2008-10-23 | Matsushita Electric Industrial Co., Ltd. | Method, device, integrated circuit, and transcoder for selectively reducing quantization levels |
US20090033791A1 (en) | 2007-07-31 | 2009-02-05 | Scientific-Atlanta, Inc. | Video processing systems and methods |
Non-Patent Citations (52)
Title |
---|
Canadian Office Action cited in Application No. 2,472,244 mailed Apr. 3, 2008. |
Canadian Office Action cited in Application No. 2,539,120 mailed Mar. 9, 2010. |
Canadian Office Action cited in Application No. 2,573,906 mailed Apr. 1, 2009. |
Canadian Office Action cited in Application No. 2,573,906 mailed Apr. 7, 2011. |
Canadian Office Action cited in Application No. 2,573,906 mailed Aug. 9, 2010. |
EP Communication Pursuant to Article 94(3) EPC cited in 00 984 341.8 mailed May 19, 2009. |
EP Communication Pursuant to Article 94(3) EPC cited in 02 794 331.5 mailed Jan. 12, 2009. |
EP Examination cited in 00 984 341.8 mailed Dec. 14, 2009. |
EP Examination cited in 05 764 529.3 mailed Jun. 18, 2010. |
EP Examination cited in 08 150 948.1 mailed Dec. 17, 2010. |
International Preliminary Report on Patentability and Written Opinion cited in PCT/US2008/070856 mailed Feb. 2, 2010. |
International Search Report and Written Opinion cited in PCT/US2004/030012 mailed Dec. 27, 2004. |
International Search Report and Written Opinion cited in PCT/US2005/024706 mailed Oct. 18, 2005. |
International Search Report and Written Opinion cited in PCT/US2008/070856 mailed Dec. 15, 2008. |
International Search Report cited in PCT/US00/33837 mailed Mar. 1, 2001. |
International Search Report cited in PCT/US02/40828 mailed Apr. 21, 2003. |
Japanese Final Office Action cited in 2001-546180 mailed Jun. 18, 2009. |
Japanese Final Office Action cited in 2006-526399 mailed Sep. 29, 2009. |
Japanese Office Action cited in 2001-546180 mailed Jun. 9, 2008. |
Japanese Office Action cited in 2001-546180 mailed Mar. 30, 2007. |
Richardson, I. et al., "Video codec complexity management," Proc. International Picture Coding Symposium (PCS01), Seoul, Korea, 4 pages (Apr. 2001). |
Simonson et al., "Version augmented URIs for reference permanencevia an Apache module design," Computer Networks and ISDN Systems, North Holland Publishing, Amsterdam, NL, vol. 30, Apr. 1-7, 1998, pp. 337-345. |
Topiwala, P., "Status of the emerging ITU-T/H.264| ISO/MPEG-4, Part 10 Video coding standard," Proceedings of SPIE, vol. 4790, pp. 261-277 (Jul. 8, 2002). |
U.S. Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Apr. 10, 2002. |
U.S. Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Apr. 11, 2008. |
U.S. Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Jan. 3, 2007. |
U.S. Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Mar. 9, 2010. |
U.S. Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Sep. 22, 2005. |
U.S. Final Office Action cited in U.S. Appl. No. 10/623,683 mailed Jul. 25, 2008. |
U.S. Final Office Action cited in U.S. Appl. No. 10/663,037 mailed Dec. 10, 2008. |
U.S. Final Office Action cited in U.S. Appl. No. 10/663,037 mailed Nov. 24, 2009. |
U.S. Final Office Action cited in U.S. Appl. No. 10/854,874 mailed Jun. 11, 2009. |
U.S. Final Office Action cited in U.S. Appl. No. 10/891,318 mailed Dec. 1, 2009. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Aug. 24, 2001. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Jul. 17, 2006. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Jul. 19, 2004. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Jul. 29, 2008. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Mar. 26, 2003. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Mar. 3, 2009. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Oct. 20, 2003. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Sep. 11, 2007. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 09/736,661 mailed Sep. 16, 2009. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 10/623,683 mailed Dec. 28, 2007. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 10/663,037 mailed Dec. 10, 2007. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 10/663,037 mailed Jun. 27, 2008. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 10/663,037 mailed May 14, 2009. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 10/854,874 mailed Dec. 15, 2008. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 10/854,874 mailed May 13, 2008. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 10/891,318 mailed Mar. 15, 2011. |
U.S. Non-Final Office Action cited in U.S. Appl. No. 10/891,318 mailed Mar. 19, 2009. |
Written Opinion cited in PCT/US00/33837 mailed Dec. 27, 2001. |
Written Opinion cited in PCT/US02/40828 mailed Dec. 16, 2003. |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080019448A1 (en) * | 2006-07-24 | 2008-01-24 | Samsung Electronics Co., Ltd. | Motion estimation apparatus and method and image encoding apparatus and method employing the same |
US8619859B2 (en) * | 2006-07-24 | 2013-12-31 | Samsung Electronics Co., Ltd. | Motion estimation apparatus and method and image encoding apparatus and method employing the same |
US10051284B2 (en) * | 2008-10-14 | 2018-08-14 | Sk Telecom Co., Ltd. | Method and apparatus for encoding/decoding the motion vectors of a plurality of reference pictures, and apparatus and method for image encoding/decoding using same |
US20170188048A1 (en) * | 2008-10-14 | 2017-06-29 | Sk Telecom Co., Ltd. | Method and apparatus for encoding/decoding the motion vectors of a plurality of reference pictures, and apparatus and method for image encoding/decoding using same |
US20100149424A1 (en) * | 2008-12-15 | 2010-06-17 | Electronics And Telecommunications Research Institute | System and method for detecting scene change |
US8421928B2 (en) * | 2008-12-15 | 2013-04-16 | Electronics And Telecommunications Research Institute | System and method for detecting scene change |
US9253508B2 (en) * | 2011-11-04 | 2016-02-02 | Futurewei Technologies, Inc. | Differential pulse code modulation intra prediction for high efficiency video coding |
US9503750B2 (en) | 2011-11-04 | 2016-11-22 | Futurewei Technologies, Inc. | Binarization of prediction residuals for lossless video coding |
US9813733B2 (en) | 2011-11-04 | 2017-11-07 | Futurewei Technologies, Inc. | Differential pulse code modulation intra prediction for high efficiency video coding |
US20130114716A1 (en) * | 2011-11-04 | 2013-05-09 | Futurewei Technologies, Co. | Differential Pulse Code Modulation Intra Prediction for High Efficiency Video Coding |
US20150139304A1 (en) * | 2012-06-29 | 2015-05-21 | Sony Corporation | Image processing apparatus and method |
US9894362B2 (en) * | 2012-06-29 | 2018-02-13 | Sony Corporation | Image processing apparatus and method |
US10142634B2 (en) * | 2012-06-29 | 2018-11-27 | Sony Corporation | Image processing apparatus and method |
US9049470B2 (en) * | 2012-07-31 | 2015-06-02 | Google Technology Holdings LLC | Display aware transcoder source selection system |
US9680759B2 (en) | 2012-07-31 | 2017-06-13 | Google Technology Holdings LLC | Display aware transcoder source selection system |
US20140038514A1 (en) * | 2012-07-31 | 2014-02-06 | General Instrument Corporation | Display aware transcoder source selection system |
US9998750B2 (en) | 2013-03-15 | 2018-06-12 | Cisco Technology, Inc. | Systems and methods for guided conversion of video from a first to a second compression format |
CN109413435A (en) * | 2018-10-26 | 2019-03-01 | 西安科锐盛创新科技有限公司 | A kind of prediction technique based on video compress |
CN109413435B (en) * | 2018-10-26 | 2020-10-16 | 苏州市吴越智博大数据科技有限公司 | Prediction method based on video compression |
Also Published As
Publication number | Publication date |
---|---|
US20100020878A1 (en) | 2010-01-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8300696B2 (en) | Transcoding for systems operating under plural video coding specifications | |
US7620107B2 (en) | Video transcoding method and apparatus and motion vector interpolation method | |
US7602851B2 (en) | Intelligent differential quantization of video coding | |
US7058127B2 (en) | Method and system for video transcoding | |
US8428118B2 (en) | Technique for transcoding MPEG-2/MPEG-4 bitstream to H.264 bitstream | |
EP2283655B1 (en) | Adaptive quantization for enhancement layer video coding | |
US8098732B2 (en) | System for and method of transcoding video sequences from a first format to a second format | |
US8693540B2 (en) | Method and apparatus of temporal error concealment for P-frame | |
US9414086B2 (en) | Partial frame utilization in video codecs | |
CA2752080C (en) | Method and system for selectively performing multiple video transcoding operations | |
US8634463B2 (en) | Apparatus and method of enhanced frame interpolation in video compression | |
US7933336B2 (en) | Image down-sampling transcoding method and device | |
US20100296580A1 (en) | Method and system for efficient video transcoding | |
US20060193527A1 (en) | System and methods of mode determination for video compression | |
US9294764B2 (en) | Video encoder with intra-prediction candidate screening and methods for use therewith | |
US9100656B2 (en) | Method and system for efficient video transcoding using coding modes, motion vectors and residual information | |
US20050105615A1 (en) | Selective and/or scalable complexity control for video codecs | |
US20150078446A1 (en) | Method and apparatus for inter-layer intra prediction | |
US11627325B2 (en) | Intra prediction method and apparatus | |
Wang et al. | Adaptive downsampling video coding with spatially scalable rate-distortion modeling | |
US9438925B2 (en) | Video encoder with block merging and methods for use therewith | |
US8295349B2 (en) | Methods and apparatuses for video compression intra prediction mode determination | |
US20130177078A1 (en) | Apparatus and method for encoding/decoding video using adaptive prediction block filtering | |
US7236529B2 (en) | Methods and systems for video transcoding in DCT domain with low complexity | |
Nguyen et al. | Efficient coding unit size selection for HEVC downsizing transcoding |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: CISCO TECHNOLOGY, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LIANG, LIANG;CHENG, NORMAN;RODRIGUEZ, ARTURO A.;REEL/FRAME:021417/0186;SIGNING DATES FROM 20080813 TO 20080817 Owner name: CISCO TECHNOLOGY, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LIANG, LIANG;CHENG, NORMAN;RODRIGUEZ, ARTURO A.;SIGNING DATES FROM 20080813 TO 20080817;REEL/FRAME:021417/0186 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |