US20090141814A1 - Method and Apparatus for Providing Reduced Resolution Update Mode for Multi-View Video Coding - Google Patents

Method and Apparatus for Providing Reduced Resolution Update Mode for Multi-View Video Coding Download PDF

Info

Publication number
US20090141814A1
US20090141814A1 US12/086,206 US8620607A US2009141814A1 US 20090141814 A1 US20090141814 A1 US 20090141814A1 US 8620607 A US8620607 A US 8620607A US 2009141814 A1 US2009141814 A1 US 2009141814A1
Authority
US
United States
Prior art keywords
reduced resolution
resolution update
update mode
picture
filtering operation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/086,206
Other languages
English (en)
Inventor
Peng Yin
Yeping Su
Cristina Gomila
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US12/086,206 priority Critical patent/US20090141814A1/en
Assigned to THOMSON LICENSING reassignment THOMSON LICENSING ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GOMILA, CRISTINA, SU, YEPING, YIN, PENG
Publication of US20090141814A1 publication Critical patent/US20090141814A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness

Definitions

  • the present invention relates generally to video encoding and decoding and, more particularly, to a method and apparatus for providing a reduced resolution update mode for Multi-view Video Coding (MVC).
  • MVC Multi-view Video Coding
  • a Multi-view Video Coding (MVC) sequence is a set of two or more video sequences that capture the same scene from a different view point.
  • a possible approach to the encoding of a multi-view video sequence is to encode each single view independently.
  • any existing video coding standard as for example, the International Telecommunication Union, Telecommunication Sector (ITU-T) H.263 recommendation (hereinafter the “H.263 Recommendation”) and the International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) Moving Picture Experts Group-4 (MPEG-4) Part 10 Advanced Video Coding (AVC) standard/International Telecommunication Union, Telecommunication Sector (ITU-T) H.264 recommendation (hereinafter the “MPEG-4 AVC standard”) can be used.
  • the approach has low compression efficiency since it only exploits the temporal redundancy between pictures of the same video sequence.
  • the Reduced-Resolution Update mode was introduced in the H.263 Recommendation to allow an increase in the coding picture rate while maintaining sufficient subjective quality.
  • the syntax of a bitstream encoded in this mode was essentially identical to a bitstream coded in full resolution, the main difference was on how all modes within the bitstream were interpreted, and how the residual information was considered and added after motion compensation. More specifically, an image in this mode had 1 ⁇ 4 the number of macroblocks compared to a full resolution coded picture, while motion vector data was associated with block sizes of 32 ⁇ 32 and 16 ⁇ 16 of the full resolution picture instead of 16 ⁇ 16 and 8 ⁇ 8, respectively.
  • DCT discrete cosine transform
  • texture data are associated with 8 ⁇ 8 blocks of a reduced resolution image, while an upsampling process is required in order to generate the final full image representation.
  • RRU mode compared to normal encoding are the consideration of larger block sizes and the subsampling of the residual prior to encoding.
  • the first difference allows for a significant overhead reduction within the bitstream (critical for lower bit rates), while the second difference can be seen as a “spatial” quantization process.
  • Possible options include scaling by 1 horizontally & 2 vertically (MBs are of size 16 ⁇ 32), 2 vertically & 1 horizontally (MB size 32 ⁇ 16), or, in general, to have macroblocks of size (rru_width_scale*16) ⁇ (rru_height_scale*16).
  • FIG. 1 a diagram for exemplary macroblock partitions 100 and sub-macroblock partitions 150 in a Reduced Resolution Update (RRU) mode is indicated generally by the reference numeral 100 .
  • RRU Reduced Resolution Update
  • Skipped macroblocks in P slices in this mode are considered as of having a 32 ⁇ 32 size, while the process for computing their associated motion data remains unchanged, although obviously we need to now consider 32 ⁇ 32 neighbors instead of 16 ⁇ 16.
  • the residual data is then downsampled and is coded using the same transform and quantization process already available in the MPEG-4 AVC standard. The same process is applied for both Luma and Chroma samples.
  • the residual data needs to be upsampled.
  • the downsampling process is done only in the encoder and, hence, does not need to be standardized.
  • the upsampling process must be matched in the encoder and the decoder, and so must be standardized. Possible upsampling methods that could be used are the zero or first order hold or by considering a similar strategy as in the H.263 Recommendation.
  • the MPEG-4 AVC standard also considers an in-loop deblocking filter, applied to 4 ⁇ 4 block edges. Since currently the prediction process is applied to block sizes of 8 ⁇ 8 and above, this process is modified to consider 8 ⁇ 8 block edges instead.
  • Different slices in the same picture may have different values of reduced_resolution_update, rru_width_scale and rru_height_scale. Since the in-loop deblocking filter is applied across slice boundaries, blocks on either side of the slice boundary may have been coded at different resolutions. In this case, we need to consider for the deblocking filter parameters computation, the largest quantization parameter (QP) value among the two neighboring 4 ⁇ 4 normal blocks on a given 8 ⁇ 8 edge, while the strength of the deblocking is now based on the total number of non-zero coefficients of the two blocks.
  • QP quantization parameter
  • an additional parameter referred to as reduced_resolution_update_enable is transmitted in the picture parameter set. It is not allowed to encode a slice using the Reduced Resolution Mode if FMO is present and this parameter is not set. Furthermore, if this parameter is set, the parameters rru_max_width_scale and rru_max_height_scale should also be transmitted. These parameters ensure that the map provided can always support all possible Reduced Resolution Update macroblock sizes. This means that the following parameters should conform to the following conditions:
  • the FMO slice group map that is transmitted corresponds to the lowest allowed reduced resolution, corresponding to rru_max_width_scale and rru_max_height_scale. Note that if multiple macroblock resolutions are used then rru_max_width_scale and rru_max_height_scale need to be multiples of the least common multiple of all possible resolutions within the same picture.
  • Direct modes in the MPEG-4 AVC standard are affected depending on whether the current slice is in reduced resolution mode, or the list1 reference is in reduced resolution mode and the current one is not.
  • For the direct mode case when the current picture is in reduced resolution and the reference picture is in full resolution, a similar method is borrowed from that is currently employed within the MPEG-4 AVC standard when direct — 8 ⁇ 8_inference_flag is enabled.
  • co-located partitions are assigned by considering only the corresponding corner 4 ⁇ 4 blocks (corner is based on block indices) of an 8 ⁇ 8 partition. In our case if direct belongs to a reduced resolution slice, motion vectors and references for the co-located partitions are derived as if direct — 8 ⁇ 8_inference_flag was set to 1.
  • MB-AFF macroblock adaptive field frame mode
  • the upsampling process is performed on individual coded block residuals. If an entire picture is coded in field mode, then the corresponding block residuals are coded in field mode and, hence, the upsampling is also done in fields.
  • MB-AFF macroblock adaptive field frame mode
  • individual blocks are coded either in field of frame mode, and their corresponding residuals are upsampled in field or frame mode respectively.
  • a picture is always extended vertically and horizontally in order to be always divisible by 16*rru_height scale and 16*rru_width_scale, respectively.
  • the original resolution of an image was H R ⁇ V R and the image is padded to a resolution equal to H C ⁇ V C
  • V C (( V R +31)/32)*32
  • the process for extending the image resolution is similar to what is currently done for the MPEG-4 AVC standard to extend the picture size to be divisible by 16.
  • the present invention is directed to a method and apparatus for providing a reduced resolution update mode for Multi-view Video Coding (MVC).
  • MVC Multi-view Video Coding
  • the video encoder includes an encoder for encoding a picture using a reduced resolution update mode.
  • the picture is one of a set of pictures corresponding to multi-view content having different view points with respect to a same or similar scene.
  • the picture represents one of the different view points.
  • a video encoding method includes encoding a picture using a reduced resolution update mode.
  • the picture is one of a set of pictures corresponding to multi-view content having different view points with respect to a same or similar scene, the picture representing one of the different view points.
  • the video decoder includes a decoder for decoding a picture using a reduced resolution update mode.
  • the picture is one of a set of pictures corresponding to multi-view content having different view points with respect to a same or similar scene.
  • the picture represents one of the different view points.
  • a video decoding method includes decoding a picture using a reduced resolution update mode.
  • the picture is one of a set of pictures corresponding to multi-view content having different view points with respect to a same or similar scene, the picture representing one of the different view points.
  • FIG. 1 is a block diagram for exemplary macroblock and sub-macroblock partitions in a Reduced Resolution Update (RRU) mode;
  • RRU Reduced Resolution Update
  • FIG. 2 is a block diagram for an exemplary encoder supporting reduced resolution update mode to which the present principles may be applied in accordance with an embodiment of the present principles;
  • FIG. 3 is a block diagram for an exemplary decoder supporting Reduced Resolution Update (RRU) mode to which the present principles may be applied in accordance with an embodiment of the present principles;
  • RRU Reduced Resolution Update
  • FIG. 4 is a block diagram for a Multi-view Video Coding (MVC) encoder supporting reduced resolution update mode to which the present principles may be applied in accordance with an embodiment of the present principles;
  • MVC Multi-view Video Coding
  • FIG. 5 is a block diagram for a Multi-view Video Coding (MVC) decoder supporting reduced resolution update mode is indicated generally by the reference numeral 500 ;
  • MVC Multi-view Video Coding
  • FIG. 6 is a block diagram for an exemplary Multi-view Video Coding (MVC) encoding method for a slice-based Reduced Resolution Update (RRU) mode is indicated generally by the reference numeral 600 ;
  • MVC Multi-view Video Coding
  • FIG. 7 is a block diagram for an exemplary Multi-view Video Coding (MVC) decoding method for slice-based Reduced Resolution Update (RRU) mode is indicated generally by the reference numeral 700 ;
  • MVC Multi-view Video Coding
  • FIG. 8 is a block diagram for an exemplary Multi-view Video Coding (MVC) encoding method for a 32 ⁇ 32 MB based on a Reduced Resolution Update (RRU) Mode is indicated generally by the reference numeral 800 ; and
  • MVC Multi-view Video Coding
  • RRU Reduced Resolution Update
  • FIG. 9 is a block diagram for an exemplary Multi-view Video Coding (MVC) decoding method for a 32 ⁇ 32 MB based on a Reduced Resolution Update (RRU) Mode is indicated generally by the reference numeral 900 .
  • MVC Multi-view Video Coding
  • the present invention is directed to a method and apparatus for providing a reduced resolution update mode for Multi-view Video Coding (MVC).
  • MVC Multi-view Video Coding
  • processor or “controller” should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (“DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory (“RAM”), and non-volatile storage.
  • DSP digital signal processor
  • ROM read-only memory
  • RAM random access memory
  • any switches shown in the figures are conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the implementer as more specifically understood from the context.
  • any element expressed as a means for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements that performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with appropriate circuitry for executing that software to perform the function.
  • the invention as defined by such claims resides in the fact that the functionalities provided by the various recited means are combined and brought together in the manner which the claims call for. It is thus regarded that any means that can provide those functionalities are equivalent to those shown herein.
  • the encoder 200 includes a combiner 205 having an output connected to an input of a switch 210 .
  • a first output of the switch 210 is connected in signal communication with an input of a downsampler 215 , a first output of a switch 245 and a first input of a motion compensator 270 .
  • An output of the downsampler 215 is connected in signal communication with an input of a transformer 220 .
  • a second output of the switch 210 is connected in signal communication with the input of the transformer 220 .
  • An output of the transformer 220 is connected in signal communication with an input of a quantizer 225 .
  • An output of the quantizer 225 is connected in signal communication with a first input of a variable length coder 230 and an input of an inverse quantizer 235 .
  • An output of the inverse quantizer 235 is connected in signal communication with an input of an inverse transformer 240 .
  • An output of the inverse transformer 240 is connected in signal communication with an input of the switch 245 .
  • a first output of the switch 245 is connected in signal communication with an input of an upsampler 250 .
  • An output of the upsampler 250 is connected in signal communication with a first non-inverting input of a combiner 255 .
  • a second output of the switch 245 is connected in signal communication with the first non-inverting input of the combiner 255 .
  • An output of the combiner 255 is connected in signal communication with an input of a loop filter 260 .
  • An output of the loop filter 260 is connected in signal communication with an input of a reference picture store 265 .
  • An output of the reference picture store 265 is connected in signal communication with a second input of a motion compensator 270 and a first input of a motion estimator 275 .
  • An output of the motion estimator 275 is connected in signal communication with a third input of the motion compensator 270 .
  • An output of the motion compensator 270 is connected in signal communication with a second non-inverting input of the combiner 255 , an inverting input of the combiner 205 , and a second input of the variable length coder 230 .
  • a second input of the motion estimator 275 and a non-inverting input of the combiner 205 are available as an input of the encoder 200 .
  • An output of the variable length coder 230 is available as an output of the encoder 200 .
  • an exemplary decoder supporting Reduced Resolution Update (RRU) mode is indicated generally by the reference numeral 300 .
  • An input of an inverse discrete cosine transformer(IDCT)/inverse quantizer (IQuant) 305 is available as an input of the decoder 300 , for receiving a residual bitstream.
  • An input of a motion compensator 325 is also available as an input of the decoder 300 , for receiving motion vectors.
  • An output of the inverse discrete cosine transformer/inverse quantizer 305 is connected in signal communication with an input of an upscaler 315 .
  • An output of the upscaler 315 is connected in signal communication with a first non-inverting input of a combiner 320 .
  • An output of the combiner 320 is connected in signal communication with an input of a loop filter 399 .
  • a first output of the loop filter 399 is connected in signal communication with an input of a reference buffer 330 .
  • An output of the reference buffer 330 is connected in signal communication with an input of a motion compensator 325 .
  • An output of the motion compensator 325 is connected in signal communication with a second non-inverting input of the combiner 320 .
  • a second output of the loop filter 399 is available as an output of the decoder 300 , and provides the decoded video.
  • An output of the inverse discrete cosine transformer/inverse quantizer 305 provides a residue(s).
  • An output of the reference picture buffer 330 provides a reference picture(s).
  • An output of the motion compensator provides a motion compensated prediction(s).
  • the model involving the encoder 200 and decoder 300 can be extended and improved by using additional processing elements, such as spatio-temporal analysis in both the encoder and decoder, which would allow us to remove some of the artifacts introduced through the residual downsampling and upsampling process.
  • a Multi-view Video Coding (MVC) encoder supporting reduced resolution update mode is indicated generally by the reference numeral 400 .
  • the encoder 400 includes a combiner 402 having an output connected in signal communication with an input of a switch 404 .
  • a first output of the switch 404 is connected in signal communication with an input of a downsampler 406 .
  • a second output of the switch 404 is connected in signal communication with an input of a transformer 408 .
  • the output of the downsampler 406 is connected in signal communication with the input of the transformer 408 .
  • An output of the transformer 408 is connected in signal communication with an input of a quantizer 410 .
  • An output of the quantizer 410 is connected in signal communication with an input of an entropy coder 412 and an input of an inverse quantizer 414 .
  • An output of the inverse quantizer 414 is connected in signal communication with an input of an inverse transformer 416 .
  • An output of the inverse transformer 416 is connected in signal communication with an input of a switch 418 .
  • a first output of the switch 418 is connected in signal communication with an input of an upsampler 420 .
  • a second output of the switch 418 is connected in signal communication with a first non-inverting input of a combiner 422 .
  • the output of the upsampler 420 is connected in signal communication with the first non-inverting input of the combiner 422 .
  • An output of the combiner 422 is connected in signal communication with an input of an intra predictor 424 and an input of a deblocking filter 426 .
  • An output of the deblocking filter 426 is connected in signal communication with an input of a reference picture store 428 (for view i).
  • An output of the reference picture store 428 is connected in signal communication with a first input of a motion estimator 436 and a first input of a motion compensator 438 .
  • An output of the motion estimator 436 is connected in signal communication with a second input of the motion compensator 438 .
  • An output of a reference picture store 430 (for other views) is connected in signal communication with a first input of a disparity estimator 432 and a first input of a disparity compensator 434 .
  • An output of the disparity estimator 432 is connected in signal communication with a second input of the disparity compensator 434 .
  • An inverting input of the combiner 402 is connected in signal communication with an output of a switch 440 .
  • the output of the switch 440 is also connected in signal communication with a second non-inverting input of the combiner 422 .
  • a first input of the switch 440 is connected in signal communication with an output of the intra predictor 424 .
  • a second input of the switch 440 is connected in signal communication with an output of the disparity compensator 434 .
  • a third input of the switch 440 is connected in signal communication with an output of the motion compensator 438 .
  • a first output of a macroblock (MB) mode decision module 442 is connected in signal communication with the switch 404 for controlling which input is selected by the switch 402 .
  • MB macroblock
  • a second output of the macroblock mode decision module 442 is connected in signal communication with the switch 418 for controlling which output is selected by the switch 418 .
  • a third output of the macroblock mode decision module 442 is connected in signal communication with the switch 440 for controlling which input is selected by the switch 440 .
  • An input of the encoder 400 is connected in signal communication with a non-inverting input of the combiner 402 , a second input of the motion estimator 436 , and a second input of the disparity estimator 432 .
  • An output of the entropy coder 412 is available as an output of the encoder 400 .
  • a Multi-view Video Coding (MVC) decoder supporting reduced resolution update mode is indicated generally by the reference numeral 500 .
  • the decoder 500 includes an entropy decoder 505 having an output connected in signal communication with an input of an inverse quantizer 510 .
  • An output of the inverse quantizer is connected in signal communication with an input of an inverse transformer 515 .
  • An output of the inverse transformer 515 is connected in signal communication with an input of a switch 517 .
  • a first output of the switch 517 is connected in signal communication with an input of an upsampler 519 .
  • a second output of the switch 517 is connected in signal communication with a first non-inverting input of a combiner 520 .
  • the output of the upsampler 519 is connected in signal communication with the first non-inverting input of the combiner 520 .
  • An output of the combiner 520 is connected in signal communication with an input of a deblocking filter 525 and an input of an intra predictor 530 .
  • An output of the deblocking filter 525 is connected in signal communication with an input of a reference picture store 540 (for view i).
  • An output of the reference picture store 540 is connected in signal communication with a first input of a motion compensator 535 .
  • An output of a reference picture store 545 (for other views) is connected in signal communication with a first input of a disparity/illumination compensator 550 .
  • An input of the entropy coder 505 is available as an input to the decoder 500 , for receiving a residue bitstream.
  • an input of a mode module 560 is also available as an input to the decoder 500 , for receiving control syntax to control which input is selected by the switch 555 .
  • a second input of the motion compensator 535 is available as an input of the decoder 500 , for receiving motion vectors.
  • a second input of the disparity/illumination compensator 550 is available as an input to the decoder 500 , for receiving disparity vectors and/or illumination compensation syntax.
  • An output of a switch 555 is connected in signal communication with a second non-inverting input of the combiner 520 .
  • a first input of the switch 555 is connected in signal communication with an output of the disparity/illumination compensator 550 .
  • a second input of the switch 555 is connected in signal communication with an output of the motion compensator 535 .
  • a third input of the switch 555 is connected in signal communication with an output of the intra predictor 530 .
  • An output of the deblocking filter 525 is available as an output of the decoder.
  • Embodiments of the present principles are directed to efficient encoding of Multi-view Video Coding (MVC) sequences.
  • MVC Multi-view Video Coding
  • a multi-view video sequence is a set of two or more video sequences that capture the same scene from a different view point. Since multiple views of the same scene are expected to have a high degree of correlation, the present principles advantageously exploit view (or spatial) redundancy by performing prediction across different views.
  • Embodiments of the present principles are directed to the extension of Reduced Resolution Update (RRU) mode for Multi-view Video Coding (MVC), which combines both temporal prediction and view prediction.
  • RRU Reduced Resolution Update
  • MVC Multi-view Video Coding
  • exemplary techniques to adapt RRU to MVC will be described and then exemplary applications in MVC.
  • RRU is currently supported by the H.263 Recommendation and is extended to the MPEG-4 AVC standard.
  • This mode provides the opportunity to increase the coding picture rate, while maintaining sufficient subjective quality. This is done by encoding an image at a reduced resolution, while performing prediction using a high resolution reference. This allows the final image to be reconstructed at full resolution and with good quality, although the bit rate required to encode the image has been reduced considerably.
  • exemplary method provided herein may be used for any video coding tools for MVC.
  • exemplary embodiments described herein are so described with respect to the MPEG-4 AVC standard.
  • rru_width_scale and rru_height_scale equal to two (2) for the exemplary cases described herein.
  • MVC_prediction_flag is sent to indicate if it is coded as temporal prediction or view prediction.
  • the basic coding macroblock unit is 32 ⁇ 32.
  • the present principles are not limited to the preceding macroblock unit and other macroblock units may also be utilized in accordance with the teachings of the present principles, while maintaining the scope of the present principles.
  • RRU is decided on a slice basis.
  • inter motion compensation can be either from temporal prediction or view prediction. After motion compensation is performed, the residue is coded using RRU.
  • indexA and indexB as follows:
  • indexA Clip3(0, 51, qP av +RRUoffset+FilterOffsetA)
  • indexB Clip3(0, 51, qP av +RRUoffset+FilterOffsetB)
  • RRUoffset is the quantization offset we wish to apply in the presence of RRU.
  • the boundary strength is adapted based on the MVC_prediction_flag across the boundaries.
  • the deblocking should only consider 8 ⁇ 8 edges and the boundary strength and RRU offset should be combined together to adapt the strength of deblocking filter.
  • reduce_resolution_update_flag When reduce_resolution_update_flag is equal to 1, this specifies that RRU mode is applied in the current slice. When reduce_resolution_update_flag is equal to 0, this specifies that RRU mode is not applied in the current slice.
  • an exemplary Multi-view Video Coding (MVC) encoding method for a slice-based Reduced Resolution Update (RRU) mode is indicated generally by the reference numeral 600 .
  • the method 600 includes a start block 600 that passes control to a decision block 605 .
  • the decision block 605 determines whether or not to encode a current slice using view prediction. If so, then control is passed to a function block 615 . Otherwise, control is passed to a function block 635 .
  • the function block 615 sets the MVC_prediction_flag to 1, encodes the current slice using view prediction, and passes control to a decision block 620 .
  • the decision block 620 determines whether or not to encode the current slice using RRU mode. If so, then control is passed to a function block 625 . Otherwise, control is passed to a function block 640 .
  • the function block 625 sets reduce_resolution_update_flag to 1, encodes the current slice using RRU mode, and passes control to a function block 630 .
  • the function block 630 encodes the current slice, and passes control to a function block 632 .
  • the function block 632 performs deblocking filtering, and passes control to an end block 645 .
  • the function block 635 sets MVC_prediction_flag to 0, encodes the current slice using temporal prediction, and passes control to the decision block 620 .
  • the function block 640 sets reduce_resolution_update_flag to 0, encodes the current slice using a non-RRU mode, and passes control to the function block 630 .
  • an exemplary Multi-view Video Coding (MVC) decoding method for slice-based Reduced Resolution Update (RRU) mode is indicated generally by the reference numeral 700 .
  • the method 700 includes a start block 705 that passes control to a function block 710 .
  • the function block 710 parses the bitstream, and passes control to a decision block 715 .
  • the decision block 715 determines whether or not MVC_prediction_flag is equal to 1. If so, then control is passed to a function block 720 . Otherwise, control is passed to a function block 740 .
  • the function block 720 decodes the current slice using view prediction, and passes control to a decision block 725 .
  • the decision block 725 determines whether or not reduce_resolution_update_flag is equal to 1. If so, then control is passed to a function block 730 . Otherwise, control is passed to a function block 745 .
  • the function block 730 decodes the current slice using RRU mode, and passes control to a function block 735 .
  • the function block 735 decodes the current slice, and passes control to a function block 738 .
  • the function block 738 performing deblocking filtering, and passes control to an end block 750 .
  • the function block 740 decodes the current slice using temporal prediction, and passes control to the decision block 725 .
  • the function block 745 decodes the current slice using a non-RRU mode, and passes control to the function block 735 .
  • RRU is decided on 32 ⁇ 32 MB basis, based on the MVC_prediction_flag.
  • RRU can be switched on or off on a 32 ⁇ 32 MB basis, based on MVC_prediction_flag. For example, we can decide to use RRU for temporal prediction and non-RRU for view prediction. For simplicity, the MVC_prediction_flag can only be set on a 32 ⁇ 32 MB basis. If RRU is on, then we code one 32 ⁇ 32 MB as one MB. If RRU is off, then we code on a 32 ⁇ 32 MB as 4 16 ⁇ 16 MBs. The coding order is from left to right and up to down.
  • deblocking filter we shall differentiate inner block edges from 32 ⁇ 32 MB boundaries. For inner block edges, if RRU mode is used, then deblocking filter is applied to 8 ⁇ 8 block edges and RRUoffset is applied as in above-described slice based method. If RRU mode is not used, then deblocking filtering is applied to 4 ⁇ 4 block edges. For a 32 ⁇ 32 MB boundary, if both of the neighboring blocks use RRU mode, then 8 ⁇ 8 block edges are considered and RRU offset is used. Otherwise, 4 ⁇ 4 block edges are considered and if one block uses RRU mode, then RRUoffset is applied.
  • slice header syntax two syntaxes are added to indicate if RRU mode is applied for view prediction or temporal prediction.
  • reduce_resolution_update_flag_for_view_prediction When reduce_resolution_update_flag_for_view_prediction is equal to 1, this specifies that RRU mode is applied for a view prediction 32 ⁇ 32 macroblock in the current slice. When reduce_resolution_update_flag_for_view_prediction is equal to 0, this specifies that RRU mode is not applied for a view prediction 32 ⁇ 32 macroblock in the current slice.
  • reduce_resolution_update_flag_for_temporal_prediction When reduce_resolution_update_flag_for_temporal_prediction is equal to 1, this specifies that RRU mode is applied for a temporal prediction 32 ⁇ 32 macroblock in the current slice. When reduce_resolution_update_flag_for_temporal_prediction is equal to 0, this specifies that RRU mode is not applied for a temporal prediction 32 ⁇ 32 macroblock in the current slice.
  • an exemplary Multi-view Video Coding (MVC) encoding method for a 32 ⁇ 32 MB based on a Reduced Resolution Update (RRU) Mode is indicated generally by the reference numeral 800 .
  • the method 800 includes a start block 805 that passes control to a decision block 810 .
  • the decision block 810 determines whether or not to encode a view prediction of the 32 ⁇ 32 MB using RRU mode. If so, then control is passed to a function block 815 . Otherwise, control is passed to a function block 855 .
  • the function block 815 sets reduce_resolution_update_flag_for_view_prediction to 1, and passes control to a decision block 820 .
  • the decision block 820 determines whether or not to encode a temporal prediction for the 32 ⁇ 32 MB using RRU mode. If so, then control is passed to a function block 825 . Otherwise, control is passed to a function block 860 .
  • the function block 825 sets reduce_resolution_update_flag_for_temporal_prediction to 1, and passes control to a loop limit block 830 .
  • the decision block 835 determines whether or not to encode the ith 32 ⁇ 32 MB using view prediction. If so, then control is passed to a decision block 840 . Otherwise, control is passed to a decision block 870 .
  • the decision block 840 determines whether or not the reduce_resolution_update_flag_for_view prediction is equal to 1. If so, then control is passed to a function block 845 . Otherwise, control is passed to a function block 865 .
  • the function block 845 encodes the ith 32 ⁇ 32 MB using RRU mode, and passes control to a loop limit bock 850 .
  • the loop limit block 850 ends the loop over each 32 ⁇ 32 MB, and passes control to a function block 852 .
  • the function block 852 performing deblocking filtering, and passes control to an end block 885 .
  • the function block 855 sets reduce_resolution_update_flag_for_view_prediction to 0, and passes control to the decision block 825 .
  • the function block 860 sets reduce_resolution_update_flag_for_temporal_prediction to 0, and passes control to the decision block 830 .
  • the function block 865 encodes the ith 32 ⁇ 32 MB using a non-RRU mode, and passes control to loop limit block 850 .
  • the decision block 870 determines whether or not the reduce_resolution_update_flag_for_temporal_prediction is equal to 1. If so, then control is passed to a function block 875 . Otherwise, control is passed to a function block 880 .
  • the function block 875 encodes the ith 32 ⁇ 32 MB using RRU mode, and passes control to the loop limit block 850 .
  • the function block 880 encodes the ith 32 ⁇ 32 MB using a non-RRU mode, and passes control to the loop limit block 850 .
  • an exemplary Multi-view Video Coding (MVC) decoding method for a 32 ⁇ 32 MB based on a Reduced Resolution Update (RRU) Mode is indicated generally by the reference numeral 900 .
  • the method 900 includes a start block 905 that passes control to a function block 910 .
  • the function block 910 parses the bitstream, and passes control to a loop limit block 915 .
  • the decision block 920 determines whether or not MVC_view_prediction_flag is equal to 1. If so, then control is passed to a decision block 925 . Otherwise, control is passed to a decision block 945 .
  • the decision block 925 determines whether or not the reduce_resolution_update_flag_for_view_prediction is equal to 1. If so, then control is passed to a function block 930 . Otherwise, control is passed to a function block 940 .
  • the function block 930 decodes the ith 32 ⁇ 32 MB using RRU mode, and passes control to a loop limit block 935 that ends the loop over each of the 32 ⁇ 32 MBs, and passes control to a function block 938 .
  • the function block 938 performs deblocking filtering, and passes control to an end block 960 .
  • the function block 940 decodes the ith 32 ⁇ 32 MB using a non-RRU mode, and passes control to the loop limit block 935 .
  • the decision block 945 determines whether or not the reduce_resolution_update_flag_for_temporal_prediction is equal to 1. If so, then control is passed to a function block 950 . Otherwise, control is passed to a function block 955 .
  • the function block 950 decodes the ith 32 ⁇ 32 MB using RRU mode, and passes control to the loop limit block 935 .
  • the function block 955 decodes the ith 32 ⁇ 32 MB using a non-RRU mode, and passes control to the loop limit block 935 .
  • RRU mode was found useful in video coding, especially during the presence of heavy motion within the sequence, since it allowed an encoder to maintain a high frame rate (and thus improved temporal resolution) while also maintaining high resolution and quality in stationary areas, it can introduce certain artifacts or a lower objective PSNR due to non-invertibility of the downsampling and upsampling processes.
  • RRU in MVC the following exemplary applications are presented: RRU can be used for non-referenced slices; RRU can be used for the views that can allow lower objective video quality; and RRU can be used for the temporal instance that can allow lower objective video quality.
  • RRU can be used for non-referenced slices
  • RRU can be used for the views that can allow lower objective video quality
  • RRU can be used for the temporal instance that can allow lower objective video quality.
  • other applications for using RRU in MVC may also be employed, while maintaining the scope of the present principles.
  • one advantage/feature is a video encoder that includes an encoder for encoding a picture using a reduced resolution update mode.
  • the picture is one of a set of pictures corresponding to multi-view content having different view points with respect to a same or similar scene.
  • the picture represents one of the different view points.
  • Another advantage/feature is the video encoder as described above, wherein the reduced resolution update mode is used for at least one of view prediction and temporal prediction.
  • Yet another advantage/feature is the video encoder as described above, wherein the reduced resolution update mode is used on a slice basis.
  • another advantage/feature is the video encoder that uses the reduced resolution update mode on a slice basis as described above, wherein the encoder applies a deblocking filtering operation to reduced resolution update block edges of a slice partitioned from the picture when the reduced resolution update mode is used for the slice, and a strength of the deblocking filtering operation is adapted based on at least one of the reduced resolution update mode and prediction information.
  • Another advantage/feature is the video encoder as described above, wherein the reduced resolution update mode is switched on and off based on a view prediction or a temporal prediction on a reduced resolution update macroblock basis.
  • another advantage/feature is the video encoder that switches the reduced resolution update mode on and off as described above, wherein the encoder applies a deblocking filtering operation to the picture, and wherein inner block edges of the picture are differentiated from reduced resolution update macroblock boundaries when the deblocking filtering operation is applied.
  • another advantage/feature is the video encoder that switches the reduced resolution update mode on and off and differentiates inner block edges as described above, wherein the deblocking filtering operation is applied to reduced resolution update block edges and a filter strength is adapted for the reduced resolution update mode when the reduced resolution update mode is used for the inner block edges, and the deblocking filtering operation is applied to 4 ⁇ 4 block edges when the reduced resolution update mode is without use.
  • another advantage/feature is the video encoder that switches the reduced resolution update mode on and off and differentiates inner block edges as described above, wherein reduced resolution update block edges are deblock filtered and a filter strength is adapted for the reduced resolution update mode for a reduced resolution update macroblock edge boundary when two neighboring macroblocks use the reduced resolution update mode, and 4 ⁇ 4 block edges are deblock filtered and the filter strength is adapted for the reduced resolution update mode when at least one of the two neighboring blocks uses the reduced resolution update mode.
  • another advantage/feature is the video encoder that switches the reduced resolution update mode on and off as described above, wherein the encoder applies a deblocking filtering operation to the macroblocks partitioned from the picture.
  • the deblocking filtering operation has a filter strength adapted based on at least one of view prediction and temporal prediction.
  • Another advantage/feature is the video encoder as described above, wherein the encoder encodes the picture to provide a resultant bitstream compliant with at least one of the International Organization for Standardization/International Electrotechnical Commission Moving Picture Experts Group-4 Part 10 Advanced Video Coding standard/international Telecommunication Union, Telecommunication Sector H.264 recommendation and an extension thereto.
  • another advantage/feature is the compliant video encoder as described above, wherein the encoder applies a deblocking filtering operation to the picture, the deblocking filtering operation having a filter strength adaptable based upon at least one of the reduced resolution update mode and prediction information.
  • Another advantage/feature is the video encoder as described above, wherein the reduced resolution update mode is used for a non-reference slice in the multi-view video scene.
  • Another advantage/feature is the video encoder as described above, wherein the reduced resolution update mode is used for at least some views in the multi-view video scene.
  • Another advantage/feature is the video encoder as described above, wherein the reduced resolution update mode is used for a particular temporal instance in the multi-view video scene.
  • the teachings of the present invention are implemented as a combination of hardware and software.
  • the software may be implemented as an application program tangibly embodied on a program storage unit.
  • the application program may be uploaded to, and executed by, a machine comprising any suitable architecture.
  • the machine is implemented on a computer platform having hardware such as one or more central processing units (“CPU”), a random access memory (“RAM”), and input/output (“I/O”) interfaces.
  • CPU central processing units
  • RAM random access memory
  • I/O input/output
  • the computer platform may also include an operating system and microinstruction code.
  • the various processes and functions described herein may be either part of the microinstruction code or part of the application program, or any combination thereof, which may be executed by a CPU.
  • various other peripheral units may be connected to the computer platform such as an additional data storage unit and a printing unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
US12/086,206 2006-01-09 2007-01-05 Method and Apparatus for Providing Reduced Resolution Update Mode for Multi-View Video Coding Abandoned US20090141814A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/086,206 US20090141814A1 (en) 2006-01-09 2007-01-05 Method and Apparatus for Providing Reduced Resolution Update Mode for Multi-View Video Coding

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US75728906P 2006-01-09 2006-01-09
US75729106P 2006-01-09 2006-01-09
PCT/US2007/000448 WO2007081908A1 (en) 2006-01-09 2007-01-05 Method and apparatus for providing reduced resolution update mode for multi-view video coding
US12/086,206 US20090141814A1 (en) 2006-01-09 2007-01-05 Method and Apparatus for Providing Reduced Resolution Update Mode for Multi-View Video Coding

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2007/000448 A-371-Of-International WO2007081908A1 (en) 2006-01-09 2007-01-05 Method and apparatus for providing reduced resolution update mode for multi-view video coding

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/308,525 Division US9918064B2 (en) 2006-01-09 2014-06-18 Method and apparatus for providing reduced resolution update mode for multi-view video coding

Publications (1)

Publication Number Publication Date
US20090141814A1 true US20090141814A1 (en) 2009-06-04

Family

ID=38080969

Family Applications (2)

Application Number Title Priority Date Filing Date
US12/086,206 Abandoned US20090141814A1 (en) 2006-01-09 2007-01-05 Method and Apparatus for Providing Reduced Resolution Update Mode for Multi-View Video Coding
US14/308,525 Active 2029-03-30 US9918064B2 (en) 2006-01-09 2014-06-18 Method and apparatus for providing reduced resolution update mode for multi-view video coding

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14/308,525 Active 2029-03-30 US9918064B2 (en) 2006-01-09 2014-06-18 Method and apparatus for providing reduced resolution update mode for multi-view video coding

Country Status (6)

Country Link
US (2) US20090141814A1 (ja)
EP (1) EP1972144B1 (ja)
JP (1) JP5227187B2 (ja)
CN (1) CN101371584B (ja)
BR (1) BRPI0706407B1 (ja)
WO (1) WO2007081908A1 (ja)

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080165863A1 (en) * 2007-01-05 2008-07-10 Freescale Semiconductor, Inc. Reduction of block effects in spatially re-sampled image information for block-based image coding
US20090304086A1 (en) * 2008-06-06 2009-12-10 Apple Inc. Method and system for video coder and decoder joint optimization
US20110134999A1 (en) * 2009-12-09 2011-06-09 Samsung Electronics Co., Ltd. Method and apparatus for encoding video, and method and apparatus for decoding video
US20110222597A1 (en) * 2008-11-25 2011-09-15 Thomson Licensing Method and apparatus for sparsity-based de-artifact filtering for video encoding and decoding
US20110268193A1 (en) * 2007-10-05 2011-11-03 Electronics And Telecommunications Research Institute Encoding and decoding method for single-view video or multi-view video and apparatus thereof
US20110268366A1 (en) * 2009-01-20 2011-11-03 Megachips Corporation Image processing apparatus and image conversion apparatus
US20110274158A1 (en) * 2010-05-10 2011-11-10 Mediatek Inc. Method and Apparatus of Adaptive Loop Filtering
US20110286513A1 (en) * 2009-02-05 2011-11-24 Yunfei Zheng Methods and apparatus for adaptive mode video encoding and decoding
US20120140827A1 (en) * 2010-12-02 2012-06-07 Canon Kabushiki Kaisha Image coding apparatus and image coding method
WO2013109631A1 (en) * 2012-01-19 2013-07-25 Magnum Semiconductor, Inc. Methods and apparatuses for providing an adaptive reduced resolution update mode
US20140119440A1 (en) * 2011-06-15 2014-05-01 Electronics And Telecommunications Research Institute Method for coding and decoding scalable video and apparatus using same
US8861617B2 (en) 2010-10-05 2014-10-14 Mediatek Inc Method and apparatus of region-based adaptive loop filtering
US8928733B2 (en) 2010-11-27 2015-01-06 Korea Electronics Technology Institute Method for service compatibility-type transmitting in digital broadcast
US8976856B2 (en) 2010-09-30 2015-03-10 Apple Inc. Optimized deblocking filters
US8982966B2 (en) 2011-07-28 2015-03-17 Kabushiki Kaisha Toshiba Moving image decoder and moving image decoding method
US8982186B2 (en) 2010-11-27 2015-03-17 Korea Electronics Technology Institute Method for providing and recognizing transmission mode in digital broadcasting
US9392286B2 (en) 2013-03-15 2016-07-12 Magnum Semiconductor, Inc. Apparatuses and methods for providing quantized coefficients for video encoding
US9414061B2 (en) 2012-05-09 2016-08-09 Sun Patent Trust Method of performing motion vector prediction, and apparatus thereof
US9479777B2 (en) 2012-03-06 2016-10-25 Sun Patent Trust Moving picture coding method, moving picture decoding method, moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US9491475B2 (en) 2012-03-29 2016-11-08 Magnum Semiconductor, Inc. Apparatuses and methods for providing quantized coefficients for video encoding
US9591328B2 (en) 2012-01-20 2017-03-07 Sun Patent Trust Methods and apparatuses for encoding and decoding video using temporal motion vector prediction
US9609320B2 (en) 2012-02-03 2017-03-28 Sun Patent Trust Image decoding method and image decoding apparatus
US9794573B2 (en) * 2010-12-28 2017-10-17 Dolby Laboratories Licensing Corporation Method and system for selectively breaking prediction in video coding
US9794575B2 (en) 2013-12-18 2017-10-17 Magnum Semiconductor, Inc. Apparatuses and methods for optimizing rate-distortion costs in video encoding
US20180063544A1 (en) * 2016-08-29 2018-03-01 Apple Inc. Multidimensional quantization techniques for video coding/decoding systems
US10075708B2 (en) 2012-04-09 2018-09-11 Sun Patent Trust Image encoding method and image decoding method
CN110225356A (zh) * 2013-04-08 2019-09-10 Ge视频压缩有限责任公司 多视图解码器
US20210211737A1 (en) * 2018-09-28 2021-07-08 Fraunhofer-Gesellschaft Zur Foerderung Der Angewadten Forschung E.V. Deblocking or deringing filter and encoder, decoder and method for applying and varying a strength of a deblocking or deringing filter
US11616979B2 (en) * 2018-02-20 2023-03-28 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Picture/video coding supporting varying resolution and/or efficiently handling region-wise packing
US11677966B2 (en) 2013-01-04 2023-06-13 Ge Video Compression, Llc Efficient scalable coding concept

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100779875B1 (ko) * 2005-01-14 2007-11-27 주식회사 휴맥스 다-시점 코딩을 위한 참조 프레임 순서 설정 방법 및 그방법을 기록한 기록매체
KR101348276B1 (ko) * 2006-05-04 2014-01-10 한국전자통신연구원 다시점 동영상을 부호화 하는 방법 및 장치
KR20090129926A (ko) * 2008-06-13 2009-12-17 삼성전자주식회사 영상 부호화 방법 및 그 장치, 영상 복호화 방법 및 그 장치
JP4993224B2 (ja) * 2009-04-08 2012-08-08 ソニー株式会社 再生装置および再生方法
KR101939016B1 (ko) 2009-07-01 2019-01-15 톰슨 라이센싱 비디오 인코더 및 디코더용 대형 블록에 대한 인트라 예측을 시그널링하기 위한 방법 및 장치
US8660174B2 (en) * 2010-06-15 2014-02-25 Mediatek Inc. Apparatus and method of adaptive offset for video coding
US9225961B2 (en) 2010-05-13 2015-12-29 Qualcomm Incorporated Frame packing for asymmetric stereo video
JP2011259362A (ja) * 2010-06-11 2011-12-22 Sony Corp 画像処理装置および方法
US9596447B2 (en) 2010-07-21 2017-03-14 Qualcomm Incorporated Providing frame packing type information for video coding
US9055305B2 (en) 2011-01-09 2015-06-09 Mediatek Inc. Apparatus and method of sample adaptive offset for video coding
US20120269275A1 (en) * 2010-10-20 2012-10-25 Nokia Corporation Method and device for video coding and decoding
WO2012147622A1 (ja) * 2011-04-28 2012-11-01 ソニー株式会社 画像処理装置、及び、画像処理方法
KR102111917B1 (ko) * 2011-06-30 2020-05-18 미쓰비시덴키 가부시키가이샤 화상 부호화 장치, 화상 복호 장치, 화상 부호화 방법, 화상 복호 방법 및 기억 매체
KR20150013741A (ko) * 2012-07-09 2015-02-05 니폰 덴신 덴와 가부시끼가이샤 영상 부호화 방법 및 장치, 영상 복호 방법 및 장치와 이들의 프로그램
CN107637081A (zh) * 2015-06-16 2018-01-26 夏普株式会社 图像解码装置以及图像编码装置
US20180091812A1 (en) * 2016-09-23 2018-03-29 Apple Inc. Video compression system providing selection of deblocking filters parameters based on bit-depth of video data
CN107454416B (zh) * 2017-09-12 2020-06-30 广州酷狗计算机科技有限公司 视频流发送方法和装置
KR102503743B1 (ko) 2018-04-11 2023-02-28 삼성전자주식회사 이미지 처리 장치 및 방법
US11290749B2 (en) * 2018-07-17 2022-03-29 Comcast Cable Communications, Llc Systems and methods for deblocking filtering
CN111479164A (zh) * 2019-01-23 2020-07-31 上海哔哩哔哩科技有限公司 硬件解码动态分辨率无缝切换方法、装置及存储介质
CN114762326B (zh) * 2020-01-21 2024-03-22 阿里巴巴集团控股有限公司 用于自适应分辨率视频编码的下一代环路滤波器实现

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020176508A1 (en) * 1994-10-11 2002-11-28 Boyce Jill Macdonald Methods and apparatus for decoding and displaying multiple digital images in parallel
US20070025448A1 (en) * 2005-07-29 2007-02-01 Samsung Electronics Co., Ltd. Deblocking filtering method considering intra-BL mode and multilayer video encoder/decoder using the same
US20070172133A1 (en) * 2003-12-08 2007-07-26 Electronics And Telecommunications Research Instit System and method for encoding and decoding an image using bitstream map and recording medium thereof

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6057884A (en) * 1997-06-05 2000-05-02 General Instrument Corporation Temporal and spatial scaleable coding for video object planes
JP2007528675A (ja) * 2004-03-09 2007-10-11 トムソン リサーチ ファンディング コーポレイション Ａｖｃ用解像度低下更新モード

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020176508A1 (en) * 1994-10-11 2002-11-28 Boyce Jill Macdonald Methods and apparatus for decoding and displaying multiple digital images in parallel
US20070172133A1 (en) * 2003-12-08 2007-07-26 Electronics And Telecommunications Research Instit System and method for encoding and decoding an image using bitstream map and recording medium thereof
US20070025448A1 (en) * 2005-07-29 2007-02-01 Samsung Electronics Co., Ltd. Deblocking filtering method considering intra-BL mode and multilayer video encoder/decoder using the same

Cited By (85)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7907789B2 (en) * 2007-01-05 2011-03-15 Freescale Semiconductor, Inc. Reduction of block effects in spatially re-sampled image information for block-based image coding
US20080165863A1 (en) * 2007-01-05 2008-07-10 Freescale Semiconductor, Inc. Reduction of block effects in spatially re-sampled image information for block-based image coding
US20110268193A1 (en) * 2007-10-05 2011-11-03 Electronics And Telecommunications Research Institute Encoding and decoding method for single-view video or multi-view video and apparatus thereof
US20090304086A1 (en) * 2008-06-06 2009-12-10 Apple Inc. Method and system for video coder and decoder joint optimization
US9723330B2 (en) * 2008-11-25 2017-08-01 Thomson Licensing Dtv Method and apparatus for sparsity-based de-artifact filtering for video encoding and decoding
US20110222597A1 (en) * 2008-11-25 2011-09-15 Thomson Licensing Method and apparatus for sparsity-based de-artifact filtering for video encoding and decoding
US20110268366A1 (en) * 2009-01-20 2011-11-03 Megachips Corporation Image processing apparatus and image conversion apparatus
US8818123B2 (en) * 2009-01-20 2014-08-26 Megachips Corporation Image processing apparatus and image conversion apparatus
US20110286513A1 (en) * 2009-02-05 2011-11-24 Yunfei Zheng Methods and apparatus for adaptive mode video encoding and decoding
US20110134999A1 (en) * 2009-12-09 2011-06-09 Samsung Electronics Co., Ltd. Method and apparatus for encoding video, and method and apparatus for decoding video
US9998737B2 (en) 2010-05-10 2018-06-12 Hfi Innovation Inc. Method and apparatus of adaptive loop filtering
US20130259117A1 (en) * 2010-05-10 2013-10-03 Mediatek Inc. Method and Apparatus of Adaptive Loop Filtering
US9094658B2 (en) * 2010-05-10 2015-07-28 Mediatek Inc. Method and apparatus of adaptive loop filtering
US9615093B2 (en) 2010-05-10 2017-04-04 Hfi Innovation Inc. Method and appartus of adaptive loop filtering
US20110274158A1 (en) * 2010-05-10 2011-11-10 Mediatek Inc. Method and Apparatus of Adaptive Loop Filtering
US9154778B2 (en) * 2010-05-10 2015-10-06 Mediatek Inc. Method and apparatus of adaptive loop filtering
US8976856B2 (en) 2010-09-30 2015-03-10 Apple Inc. Optimized deblocking filters
US8861617B2 (en) 2010-10-05 2014-10-14 Mediatek Inc Method and apparatus of region-based adaptive loop filtering
US9635344B2 (en) 2010-11-27 2017-04-25 Korea Electronics Technology Institute Method for service compatibility-type transmitting in digital broadcast
US9288467B2 (en) 2010-11-27 2016-03-15 Korea Electronics Technology Institute Method for providing and recognizing transmission mode in digital broadcasting
US9030527B2 (en) 2010-11-27 2015-05-12 Korea Electronics Technology Institute Method for providing and recognizing transmission mode in digital broadcasting
US8982186B2 (en) 2010-11-27 2015-03-17 Korea Electronics Technology Institute Method for providing and recognizing transmission mode in digital broadcasting
US8928733B2 (en) 2010-11-27 2015-01-06 Korea Electronics Technology Institute Method for service compatibility-type transmitting in digital broadcast
US9204124B2 (en) * 2010-11-27 2015-12-01 Korea Electronics Technology Institute Method for service compatibility-type transmitting in digital broadcast
US20120140827A1 (en) * 2010-12-02 2012-06-07 Canon Kabushiki Kaisha Image coding apparatus and image coding method
US9532076B2 (en) * 2010-12-02 2016-12-27 Canon Kabushiki Kaisha Apparatus and method for encoding combined image including different images
US11356670B2 (en) 2010-12-28 2022-06-07 Dolby Laboratories Licensing Corporation Method and system for picture segmentation using columns
US11949878B2 (en) 2010-12-28 2024-04-02 Dolby Laboratories Licensing Corporation Method and system for picture segmentation using columns
US9794573B2 (en) * 2010-12-28 2017-10-17 Dolby Laboratories Licensing Corporation Method and system for selectively breaking prediction in video coding
US10986344B2 (en) 2010-12-28 2021-04-20 Dolby Laboratories Licensing Corporation Method and system for picture segmentation using columns
US10225558B2 (en) 2010-12-28 2019-03-05 Dolby Laboratories Licensing Corporation Column widths for picture segmentation
US10104377B2 (en) 2010-12-28 2018-10-16 Dolby Laboratories Licensing Corporation Method and system for selectively breaking prediction in video coding
US10244239B2 (en) 2010-12-28 2019-03-26 Dolby Laboratories Licensing Corporation Parameter set for picture segmentation
US11178400B2 (en) 2010-12-28 2021-11-16 Dolby Laboratories Licensing Corporation Method and system for selectively breaking prediction in video coding
US11582459B2 (en) 2010-12-28 2023-02-14 Dolby Laboratories Licensing Corporation Method and system for picture segmentation using columns
US11871000B2 (en) 2010-12-28 2024-01-09 Dolby Laboratories Licensing Corporation Method and system for selectively breaking prediction in video coding
US10819991B2 (en) 2011-06-15 2020-10-27 Electronics And Telecommunications Research Institute Method for coding and decoding scalable video and apparatus using same
US20140119440A1 (en) * 2011-06-15 2014-05-01 Electronics And Telecommunications Research Institute Method for coding and decoding scalable video and apparatus using same
US9686543B2 (en) * 2011-06-15 2017-06-20 Electronics And Telecommunications Research Institute Method for coding and decoding scalable video and apparatus using same
US9686544B2 (en) * 2011-06-15 2017-06-20 Electronics And Telecommunications Research Institute Method for coding and decoding scalable video and apparatus using same
US20140119441A1 (en) * 2011-06-15 2014-05-01 Kwangwoon University Industry-Academic Collaboration Foundation Method for coding and decoding scalable video and apparatus using same
US11838524B2 (en) 2011-06-15 2023-12-05 Electronics And Telecommunications Research Institute Method for coding and decoding scalable video and apparatus using same
US11412240B2 (en) 2011-06-15 2022-08-09 Electronics And Telecommunications Research Institute Method for coding and decoding scalable video and apparatus using same
US10142648B2 (en) 2011-06-15 2018-11-27 Electronics And Telecommunications Research Institute Method for coding and decoding scalable video and apparatus using same
US8982966B2 (en) 2011-07-28 2015-03-17 Kabushiki Kaisha Toshiba Moving image decoder and moving image decoding method
WO2013109631A1 (en) * 2012-01-19 2013-07-25 Magnum Semiconductor, Inc. Methods and apparatuses for providing an adaptive reduced resolution update mode
US9591328B2 (en) 2012-01-20 2017-03-07 Sun Patent Trust Methods and apparatuses for encoding and decoding video using temporal motion vector prediction
US10616601B2 (en) 2012-01-20 2020-04-07 Sun Patent Trust Methods and apparatuses for encoding and decoding video using temporal motion vector prediction
US10129563B2 (en) 2012-01-20 2018-11-13 Sun Patent Trust Methods and apparatuses for encoding and decoding video using temporal motion vector prediction
US9609320B2 (en) 2012-02-03 2017-03-28 Sun Patent Trust Image decoding method and image decoding apparatus
US9648323B2 (en) 2012-02-03 2017-05-09 Sun Patent Trust Image coding method and image coding apparatus
US9883201B2 (en) 2012-02-03 2018-01-30 Sun Patent Trust Image coding method and image coding apparatus
US10334268B2 (en) 2012-02-03 2019-06-25 Sun Patent Trust Image coding method and image coding apparatus
US11812048B2 (en) 2012-02-03 2023-11-07 Sun Patent Trust Image coding method and image coding apparatus
US10034015B2 (en) 2012-02-03 2018-07-24 Sun Patent Trust Image coding method and image coding apparatus
US11451815B2 (en) 2012-02-03 2022-09-20 Sun Patent Trust Image coding method and image coding apparatus
US10904554B2 (en) 2012-02-03 2021-01-26 Sun Patent Trust Image coding method and image coding apparatus
US10623762B2 (en) 2012-02-03 2020-04-14 Sun Patent Trust Image coding method and image coding apparatus
US11595682B2 (en) 2012-03-06 2023-02-28 Sun Patent Trust Moving picture coding method, moving picture decoding method, moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US10880572B2 (en) 2012-03-06 2020-12-29 Sun Patent Trust Moving picture coding method, moving picture decoding method, moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US10212447B2 (en) 2012-03-06 2019-02-19 Sun Patent Trust Moving picture coding method, moving picture decoding method, moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US10560716B2 (en) 2012-03-06 2020-02-11 Sun Patent Trust Moving picture coding method, moving picture decoding method, moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US9479777B2 (en) 2012-03-06 2016-10-25 Sun Patent Trust Moving picture coding method, moving picture decoding method, moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US11949907B2 (en) 2012-03-06 2024-04-02 Sun Patent Trust Moving picture coding method, moving picture decoding method, moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US9491475B2 (en) 2012-03-29 2016-11-08 Magnum Semiconductor, Inc. Apparatuses and methods for providing quantized coefficients for video encoding
US10075708B2 (en) 2012-04-09 2018-09-11 Sun Patent Trust Image encoding method and image decoding method
US10027973B2 (en) 2012-05-09 2018-07-17 Sun Patent Trust Method of performing motion vector prediction, and apparatus thereof
US9414061B2 (en) 2012-05-09 2016-08-09 Sun Patent Trust Method of performing motion vector prediction, and apparatus thereof
US11451817B2 (en) 2012-05-09 2022-09-20 Sun Patent Trust Method of performing motion vector prediction, and apparatus thereof
US10992949B2 (en) 2012-05-09 2021-04-27 Sun Patent Trust Method of performing motion vector prediction, and apparatus thereof
US11902562B2 (en) 2012-05-09 2024-02-13 Sun Patent Trust Method of performing motion vector prediction, and apparatus thereof
US10715826B2 (en) 2012-05-09 2020-07-14 Sun Patent Trust Method of performing motion vector prediction, and apparatus thereof
US10368085B2 (en) 2012-05-09 2019-07-30 Sun Patent Trust Method of performing motion vector prediction, and apparatus thereof
US11677966B2 (en) 2013-01-04 2023-06-13 Ge Video Compression, Llc Efficient scalable coding concept
US9392286B2 (en) 2013-03-15 2016-07-12 Magnum Semiconductor, Inc. Apparatuses and methods for providing quantized coefficients for video encoding
CN110225356A (zh) * 2013-04-08 2019-09-10 Ge视频压缩有限责任公司 多视图解码器
US11582473B2 (en) 2013-04-08 2023-02-14 Ge Video Compression, Llc Coding concept allowing efficient multi-view/layer coding
US9794575B2 (en) 2013-12-18 2017-10-17 Magnum Semiconductor, Inc. Apparatuses and methods for optimizing rate-distortion costs in video encoding
US11153594B2 (en) * 2016-08-29 2021-10-19 Apple Inc. Multidimensional quantization techniques for video coding/decoding systems
US20180063544A1 (en) * 2016-08-29 2018-03-01 Apple Inc. Multidimensional quantization techniques for video coding/decoding systems
US11539974B2 (en) 2016-08-29 2022-12-27 Apple Inc. Multidimensional quantization techniques for video coding/decoding systems
US11616979B2 (en) * 2018-02-20 2023-03-28 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Picture/video coding supporting varying resolution and/or efficiently handling region-wise packing
US11843805B2 (en) * 2018-09-28 2023-12-12 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Deblocking or deringing filter and encoder, decoder and method for applying and varying a strength of a deblocking or deringing filter
US20210211737A1 (en) * 2018-09-28 2021-07-08 Fraunhofer-Gesellschaft Zur Foerderung Der Angewadten Forschung E.V. Deblocking or deringing filter and encoder, decoder and method for applying and varying a strength of a deblocking or deringing filter
CN113170120A (zh) * 2018-09-28 2021-07-23 弗劳恩霍夫应用研究促进协会 去块或去振铃滤波器以及应用和改变去块或去振铃滤波器的强度的编码器、解码器和方法

Also Published As

Publication number Publication date
EP1972144B1 (en) 2017-03-29
US20150003522A1 (en) 2015-01-01
US9918064B2 (en) 2018-03-13
JP2009522941A (ja) 2009-06-11
JP5227187B2 (ja) 2013-07-03
CN101371584B (zh) 2011-12-14
CN101371584A (zh) 2009-02-18
BRPI0706407B1 (pt) 2019-09-03
EP1972144A1 (en) 2008-09-24
BRPI0706407A2 (pt) 2011-03-29
WO2007081908A1 (en) 2007-07-19

Similar Documents

Publication Publication Date Title
US9918064B2 (en) Method and apparatus for providing reduced resolution update mode for multi-view video coding
US8532175B2 (en) Methods and apparatus for reducing coding artifacts for illumination compensation and/or color compensation in multi-view coded video
AU2005226021B2 (en) Reduced resolution update mode for advanced video coding
EP2486731B1 (en) Methods and apparatus for adaptive filtering of prediction pixels for chroma components in video encoding and decoding
US11483556B2 (en) Methods and apparatus for collaborative partition coding for region based filters
EP2204046B1 (en) Methods and apparatus for artifact removal for bit depth scalability
US9628823B2 (en) Method and apparatus for providing reduced resolution update mode for multi-view video coding
KR101692829B1 (ko) 감소된 비트 깊이 갱신 모드와 감소된 크로마 샘플링 갱신 모드로 비디오 코딩 및 디코딩하기 위한 방법 및 장치
WO2008118562A1 (en) Simplified deblock filtering for reduced memory access and computational complexity
WO2011046617A2 (en) Methods and apparatus for efficient adaptive filtering for video encoders and decoders
US20130272398A1 (en) Long term picture signaling
WO2010134973A1 (en) Methods and apparatus for a generalized filtering structure for video coding and decoding

Legal Events

Date Code Title Description
AS Assignment

Owner name: THOMSON LICENSING, FRANCE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:YIN, PENG;SU, YEPING;GOMILA, CRISTINA;REEL/FRAME:021121/0723

Effective date: 20060523

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION