US20180124376A1 - Video decoding device and image display device - Google Patents

Video decoding device and image display device Download PDF

Info

Publication number
US20180124376A1
US20180124376A1 US15/813,900 US201715813900A US2018124376A1 US 20180124376 A1 US20180124376 A1 US 20180124376A1 US 201715813900 A US201715813900 A US 201715813900A US 2018124376 A1 US2018124376 A1 US 2018124376A1
Authority
US
United States
Prior art keywords
macro block
motion vector
macro
block group
decoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/813,900
Inventor
Ren Imaoka
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Renesas Electronics Corp
Original Assignee
Renesas Electronics Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Renesas Electronics Corp filed Critical Renesas Electronics Corp
Priority to US15/813,900 priority Critical patent/US20180124376A1/en
Publication of US20180124376A1 publication Critical patent/US20180124376A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H04N13/0048
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/625Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]

Definitions

  • the present invention relates to a technique for decoding a 3-dimensional video stream having a right-eye macro block group including a plurality of macro blocks for forming a right-eye image and a left-eye macro block group including a plurality of macro blocks for forming a left-eye image, formed on a same frame.
  • Patent document 1 Japanese Patent Laid-Open No. 2005-124200 describes a technique for displaying on a conventional 2-dimensional display by decoding only one of the views of a compressed 3-dimensional or stereo view (specification paragraphs 0083 to 0085).
  • Patent document 2 Japanese Patent Laid-Open No. 2011-014956 describes a technique for converting a 3-dimensional video stream into a 2-dimensional video stream by searching the 3-dimensional video stream to extract only a stream on one side and only by rewriting the header information (specification paragraphs 0018 to 0019).
  • Patent document 3 Japanese Patent Laid-Open No. 2008-042645 describes a technique for reproducing an image having stored therein a 2D (2-dimensional) image and a 3D (3-dimensional) image in a coexisting manner (specification paragraph 0001).
  • Patent document 4 Japanese Patent Laid-Open No. 2010-2882344 describes a technique for reproducing the coexistence of a 3-dimensional video image and a 2-dimensional video image, depending on the function of the receiving device (specification paragraph 0006).
  • Patent document 5 Japanese Patent Laid-Open No. 2010-034704 described a technique for converting a side-by-side 3-dimensional image into a 2-dimensional image (specification paragraph 0076-0078).
  • 2-dimensional display can be performed by decoding all the frames of a 3-dimensional video stream and subsequently reproducing only the left-eye image in an enlarged manner.
  • the inventors of the present application have found that decoding all frames and subsequently extracting and reproducing the left-eye image require decoding of the right-eye image which is not necessary for display, which takes a long time and requires extra memory space for decoding.
  • a macro block selector is provided for sequentially selecting, as objects to be decoded, macro blocks belonging to a range required for 2-dimensional display.
  • the video decoding device has provided thereto a decoding unit for sequentially decoding macro blocks selected by the macro block selector, and a motion vector shift unit for correcting, if a motion vector of a macro block selected by the macro block selector is referring to outside the range required for the 2-dimensional display, the reference indicated by the motion vector to be within the range required for the 2-dimensional display.
  • FIG. 1 is a block diagram of an exemplary configuration of the image display device according to the present invention.
  • FIG. 2 is an explanatory diagram of decoding processing for the side-by-side system
  • FIG. 3 is an explanatory diagram of decoding processing for a top-and-bottom system
  • FIG. 4 is a flow chart of a main operation in the video decoding device
  • FIG. 5 is an explanatory diagram of frame reference in the decoding processing of a 3-dimensional video stream
  • FIGS. 6A and 6B are explanatory diagrams of a motion vector shift in a 3-dimensional video stream encoded in a side-by-side system
  • FIGS. 7A and 7B are explanatory diagrams of a motion vector shift in 3-dimensional video stream encoded in a top-and-bottom system.
  • FIG. 8 is a flow chart of a motion vector shift in a 3-dimensional video stream.
  • a video decoding device ( 100 ) decodes a 3-dimensional video stream having a right-eye macro block group including a plurality of macro blocks for forming a right-eye image, and a left-eye macro block group including a plurality of macro blocks for forming a left-eye image formed on a same frame.
  • the video decoding device includes a macro block selector ( 103 ) for sequentially selecting, as objects to be decoded, macro blocks belonging to a range required for 2-dimensional display, a decoding unit ( 110 ) for sequentially decoding macro blocks selected by the macro block selector, and a motion vector shift unit ( 108 ) for correcting, if a motion vector of a macro block selected by the macro block selector is referring to outside the range required for the 2-dimensional display, the reference indicated by the motion vector to be within the range required for the 2-dimensional display.
  • the decoding unit skips processing of macro blocks which are not supposed to be 2-dimensionally displayed. Accordingly, decoding time can be reduced by about 1 ⁇ 2 in comparison with the case of reproducing only the left-eye image after decoding all the frames, whereby 2-dimensional display of a 3-dimensional video stream can be efficiently performed.
  • decoding of macro blocks is skipped by selecting blocks in the macro block selector, image degradation caused by reference to an undecoded region can be avoided by shifting and correcting the motion vector.
  • the decoding unit may include an inverse quantizer ( 104 ) which performs inverse quantization, an inverse discrete cosine transformer ( 105 ) which performs inverse discrete cosine transformation on the output of the inverse quantizer, a motion compensator ( 109 ) which extracts decoded data to acquire a predicted image, and an adder ( 106 ) for adding the output of the motion compensator to the output of the inverse discrete cosine transformer.
  • an inverse quantizer 104
  • an inverse discrete cosine transformer 105
  • a motion compensator 109
  • an adder 106
  • the macro block selector may be configured to determine whether an input 3-dimensional video stream has been encoded in a side-by-side system or a top-and-bottom system, and in accordance with the determination result, specify a range required for 2-dimensional display, and sequentially select, as objects to be decoded, macro blocks belonging to the range.
  • the motion vector shift unit may perform first determination processing to determine whether or not a motion vector of a macro block selected by the macro block selector is referring to a macro block for forming a right-eye image.
  • the motion vector shift unit may perform second determination processing to determine whether or not the input 3-dimensional video stream has been encoded in a side-by-side system or a top-and-bottom system, in the case where the motion vector of the macro block selected by the macro block selector is referring to a macro block for forming a right-eye image.
  • the motion vector shift unit may correct, in accordance with result of the first determination processing and the second determination processing, the reference indicated by the motion vector to be within a range required for the 2-dimensional display.
  • variable-length decoder ( 102 ) may be disposed in a preceding stage of the macro block selector for performing variable-length decoding processing in which partitions of the macro block can be analyzed.
  • an image display device ( 10 ) may include the video decoding device ( 100 ) and a display unit ( 400 ) capable of performing 2-dimensional display of the decoding result of the video decoding device.
  • FIG. 1 illustrates an exemplary configuration of the image display device according to the invention.
  • the image display device 10 shown in FIG. 1 can decode and display a 3-dimensional video stream encoded by a compression algorithm based on MPEG (Moving Picture Experts Group)-4.
  • MPEG Motion Picture Experts Group
  • space conversion, intra-frame prediction, quantization or the like is employed.
  • Discrete cosine transformation is used for space conversion. For example, a DCT coefficient of the original image or a predicted error image of an intra-frame prediction is obtained with a macro block of 8 ⁇ 8 pixels being a unit, and the coefficient is quantized.
  • encoding with a P-frame is performed by making use of a single image from a frame located anterior in the time axis
  • encoding with a B-frame is performed by making use of two, i.e., anterior and posterior images.
  • decoding processing is required.
  • P-frames are sequentially referred to along the time axis t as shown in FIG. 5 , for example.
  • the image display device 10 shown in FIG. 1 is mounted on a cellular phone or a digital video camera, although not being particularly limited thereto, and includes a video decoding device 100 , a stream recording unit 200 , a 2D/3D display determination unit 300 , and a display unit 400 .
  • the stream recording unit 200 is assumed to be a semiconductor memory, and the semiconductor memory has a 3-dimensional video stream recorded therein.
  • the 3-dimensional video stream is encoded in a side-by-side system or in a top-and-bottom system.
  • the video decoding device 100 has a function of decoding a 3-dimensional video stream taken in from the stream recording unit 200 .
  • the video decoding device 100 has a 2D/3D control signal input thereto from the 2D/3D display determination unit 300 .
  • 2-dimensional display is specified by the 2D/3D control signal
  • the video decoding device 100 performs decoding processing for 2-dimensional display.
  • 3-dimensional display is specified by the 2D/3D control signal
  • the video decoding device 100 performs decoding processing for 3-dimensional display.
  • the video decoding device 100 includes a Buffer 101 , a variable length decoder (VLD) 102 , a macro block selector (MB Selector) 103 , a macro block shifter (MB Shifter) 108 , and a decoding unit 110 .
  • VLD variable length decoder
  • MB Selector macro block selector
  • M Shifter macro block shifter
  • a 3-dimensional video stream is transferred from the stream recording unit 200 to the Buffer 101 .
  • the 3-dimensional video stream stored in a Buffer 31 is supplied to the variable-length decoder 102 .
  • the variable-length decoder 102 predicted residual components of color and brightness of a plurality of blocks included in a picture are decoded from the input 3-dimensional video stream. It should be noted that the boundary between macro blocks is clarified by the decoding processing.
  • the macro block selector 103 selects a corresponding block for an output signal from the variable-length decoder 102 . That is, when 2-dimensional display is instructed by the 2D/3D control signal which can selectively instruct 2-dimensional display or 3-dimensional display, a range required for the 2-dimensional display is specified, and predicted residual components of color and brightness are sequentially selected for macro blocks belonging to the range and supplied to the decoding unit 110 at a subsequent stage. At this time, predicted residual components of color and brightness for macro blocks which have not been selected by the macro block selector 103 are not supplied to the decoding unit 110 .
  • the motion vector shifter 108 decodes a motion vector of a macro block of a picture from a 3-dimensional video stream. In addition, the motion vector shifter 108 determines whether or not a motion vector of a macro block selected by the macro block selector is referring to a macro block for forming a right-eye image. Furthermore, the motion vector shifter 108 determines whether or not the input 3-dimensional video stream has been encoded in a side-by-side system or a top-and-bottom system, in the case where the motion vector of the macro block selected by the macro block selector is referring to a macro block for forming a right-eye image and corrects, in accordance with determination result, the reference indicated by the motion vector within a range required for 2-dimensional display. The correction will be described in detail below.
  • the decoding unit 110 includes an inverse quantizer (IQ) 104 , an inverse discrete cosine transformer (IDCT) 105 , an adder 106 , a memory (MEM) 107 , and a motion compensator (MC) 109 .
  • IQ inverse quantizer
  • IDCT inverse discrete cosine transformer
  • MEM memory
  • MC motion compensator
  • Predicted residual components of color and brightness for macro blocks selected by the macro block selector 103 are subject to inverse quantization by the inverse quantizer 104 , subject to inverse cosine transformation by the inverse discrete cosine transformer 105 , and then supplied to the adder 106 .
  • the output of the adder 106 is written into a memory 107 at a subsequent stage.
  • the picture type is I-picture in which no intra-frame prediction is performed
  • data of the macro blocks are stored in the memory 107 as-is.
  • the data of macro blocks has information of the motion vector added thereto, and thus, after the motion compensator 109 has extracted the decoded data in the memory 107 and acquired a predicted image based on the motion vector data supplied from the variable-length decoder 102 , image data having difference data added thereto and motion-compensated by the adder 106 is acquired.
  • the motion compensator 109 performs motion compensation by forming a predicted image of a macro block for motion compensation, which is supplied to the adder 106 , and added to the output of the inverse discrete cosine transformer 105 . In this manner, a motion-compensated video signal is provided in the memory 107 . The video signal is transferred to and displayed on the display unit 400 .
  • FIG. 4 illustrates a flow chart of the main operation in the video decoding device 100 .
  • the 2D/3D display determination unit 300 determines whether or not 2-dimensional display is specified (S 1 ).
  • the macro block selector 103 determines whether or not MB (macro block) coordinates are supposed to be displayed (S 2 ).
  • decoding of the macro block (MB) is performed (S 3 ).
  • decoding of the MB is skipped (S 4 ).
  • determination at step S 2 has been made for all the macro blocks, the processing is completed (S 5 ).
  • all the MB are subjected to decoding, for 3-dimensional display (S 6 , S 7 ).
  • the processing at step S 3 differs between the case where the input 3-dimensional video stream has been encoded in a side-by-side system and the case where it has been encoded in a top-and-bottom system.
  • the processing is performed as shown in FIG. 2 .
  • the horizontal line is traced back each time four horizontal MB have been decoded as shown by thick arrows, and thus only the L-region is decoded.
  • the R-region is not decoded.
  • the motion vector shifter 108 if a viewer selected 2-dimensional display of a 3-dimensional video stream, the motion vector is checked by the motion vector shifter 108 .
  • the motion vector referring to a region which has already been decoded is supplied to the compensator 109 as is without conversion.
  • a predicted image (equivalent to a P-frame or B-frame) indicated by the original motion vector cannot be referred to, and thus the macro block shifter 108 compensates the motion vector by shifting it so as to refer to the already decoded region regarded as most resembling the predicted image indicated by the original motion vector.
  • the shift method is determined through the use of 3-dimensional format information acquired from the variable-length decoder 102 .
  • FIG. 8 illustrates a flow chart of motion vector shift.
  • the MV shifter 108 first determines whether or not the motion vector is referring to the R-region (S 11 ). If it is determined that the motion vector is referring to the R-region (YES), it is determined whether or not the input 3-dimensional video stream has been encoded in a side-by-side system (S 12 ). The content of the correction differs (S 13 , S 14 , S 15 ) depending on whether or not the motion vector is referring to the R-region in the determination at step S 11 and, further, whether or not the input 3-dimensional video stream has been encoded in a side-by-side system.
  • MV′ motion vector MV′ (mv_x′, mv_y′) shown by the dashed line 62 in FIG. 6B is acquired if the motion vector 61 is referring to the R-region.
  • mv_x′ is indicated by formula 1
  • mv_y′ is indicated by formula 2.
  • x_pic_size expresses the number of horizontal MBs.
  • the symbol “*” means multiplication.
  • the symbol “a” expresses a coefficient in accordance with precision of the motion vector.
  • the input 3-dimensional video stream has been encoded in a top-and-bottom system, it is determined not to be a side-by-side system (NO) in the determination at step S 12 and corrected as follows.
  • MV′ motion vector MV′ (mv_x′, mv_y′) shown by the dashed line 72 in FIG. 7B is acquired if the motion vector is referring to a bottom region.
  • mv_x′ is indicated by formula 3
  • mv_y′ is indicated in formula 4.
  • a place corresponding to the bottom region in the top region is regarded as the place most resembling the predicted image indicated by the original motion vector, to which the motion vector is shifted and corrected.
  • the decoding unit 110 skips processing of macro blocks which are not supposed to be 2-dimensionally displayed. Accordingly, decoding time can be reduced by about 1 ⁇ 2 in comparison with the case of reproducing only the left-eye image after decoding all the frames, whereby 2-dimensional display of a 3-dimensional video stream can be efficiently provided.
  • the image display device 10 shown in FIG. 1 may have the 2D/3D display determination unit 300 omitted therefrom and may be configured to be dedicated for 2-dimensional display.
  • the decoding unit 110 skips processing of macro blocks which are not supposed to be 2-dimensionally displayed either in a side-by-side system or a top-and-bottom system, and therefore memory capacity of the memory 107 can be made smaller than in the case shown in FIG. 1 .

Abstract

To efficiently provide 2-dimensional display of 3-dimensional video stream.
A video decoding device 100 includes a macro block selector 103 for sequentially selecting, as objects to be decoded, macro blocks belonging to a range required for 2-dimensional display, and a decoding unit 100 for sequentially decoding macro blocks selected by the macro block selector. Furthermore, the video decoding device includes a motion vector shift unit 108 for correcting, when a motion vector of a macro block selected by the macro block selector is referring to outside the range required for the 2-dimensional display, the reference indicated by the motion vector to be within the range required for the 2-dimensional display. Since the macro block selector performs block selection, the decoding unit skips processing of macro blocks which are not supposed to be 2-dimensionally displayed.

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • The disclosure of Japanese Patent Application No. 2011-176796 filed on Aug. 12, 2011 including the specification, drawings and abstract is incorporated herein by reference in its entirety.
  • BACKGROUND
  • The present invention relates to a technique for decoding a 3-dimensional video stream having a right-eye macro block group including a plurality of macro blocks for forming a right-eye image and a left-eye macro block group including a plurality of macro blocks for forming a left-eye image, formed on a same frame.
  • Patent document 1 (Japanese Patent Laid-Open No. 2005-124200) describes a technique for displaying on a conventional 2-dimensional display by decoding only one of the views of a compressed 3-dimensional or stereo view (specification paragraphs 0083 to 0085).
  • Patent document 2 (Japanese Patent Laid-Open No. 2011-014956) describes a technique for converting a 3-dimensional video stream into a 2-dimensional video stream by searching the 3-dimensional video stream to extract only a stream on one side and only by rewriting the header information (specification paragraphs 0018 to 0019).
  • Patent document 3 (Japanese Patent Laid-Open No. 2008-042645) describes a technique for reproducing an image having stored therein a 2D (2-dimensional) image and a 3D (3-dimensional) image in a coexisting manner (specification paragraph 0001).
  • Patent document 4 (Japanese Patent Laid-Open No. 2010-288234) describes a technique for reproducing the coexistence of a 3-dimensional video image and a 2-dimensional video image, depending on the function of the receiving device (specification paragraph 0006).
  • Patent document 5 (Japanese Patent Laid-Open No. 2010-034704) described a technique for converting a side-by-side 3-dimensional image into a 2-dimensional image (specification paragraph 0076-0078).
  • SUMMARY
  • As described above, 2-dimensional display can be performed by decoding all the frames of a 3-dimensional video stream and subsequently reproducing only the left-eye image in an enlarged manner. However, the inventors of the present application have found that decoding all frames and subsequently extracting and reproducing the left-eye image require decoding of the right-eye image which is not necessary for display, which takes a long time and requires extra memory space for decoding.
  • It is an object of the invention to provide a technique for efficiently performing 2-dimensional display of a 3-dimensional video stream.
  • The other purposes and the new feature of the present invention will become clear from the description of the present specification and the accompanying drawings.
  • The following explains briefly the outline of a typical invention among the inventions disclosed in the present application.
  • That is, in a video decoding device which decodes a 3-dimensional video stream having a right-eye macro block group including a plurality of macro blocks for forming a right-eye image, and a left-eye macro block group including a plurality of macro blocks for forming a left-eye image formed on a same frame, a macro block selector is provided for sequentially selecting, as objects to be decoded, macro blocks belonging to a range required for 2-dimensional display. In addition, the video decoding device has provided thereto a decoding unit for sequentially decoding macro blocks selected by the macro block selector, and a motion vector shift unit for correcting, if a motion vector of a macro block selected by the macro block selector is referring to outside the range required for the 2-dimensional display, the reference indicated by the motion vector to be within the range required for the 2-dimensional display.
  • The following explains briefly the effect acquired by the typical invention among the inventions disclosed in the present application.
  • That is, 2-dimensional display of a 3-dimensional video stream can be efficiently provided.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram of an exemplary configuration of the image display device according to the present invention;
  • FIG. 2 is an explanatory diagram of decoding processing for the side-by-side system;
  • FIG. 3 is an explanatory diagram of decoding processing for a top-and-bottom system;
  • FIG. 4 is a flow chart of a main operation in the video decoding device;
  • FIG. 5 is an explanatory diagram of frame reference in the decoding processing of a 3-dimensional video stream;
  • FIGS. 6A and 6B are explanatory diagrams of a motion vector shift in a 3-dimensional video stream encoded in a side-by-side system;
  • FIGS. 7A and 7B are explanatory diagrams of a motion vector shift in 3-dimensional video stream encoded in a top-and-bottom system; and
  • FIG. 8 is a flow chart of a motion vector shift in a 3-dimensional video stream.
  • DETAILED DESCRIPTION 1. Outline of Embodiments
  • First, the following explains briefly the outline of a typical embodiment of the inventions disclosed in the present application. Reference numerals of the drawings referred to in the outline explanation of representative embodiments in a parenthesized manner are only illustrative of what are included in the concept of the components to which they are provided.
  • [1] A video decoding device (100) according to a representative embodiment of the invention decodes a 3-dimensional video stream having a right-eye macro block group including a plurality of macro blocks for forming a right-eye image, and a left-eye macro block group including a plurality of macro blocks for forming a left-eye image formed on a same frame. The video decoding device includes a macro block selector (103) for sequentially selecting, as objects to be decoded, macro blocks belonging to a range required for 2-dimensional display, a decoding unit (110) for sequentially decoding macro blocks selected by the macro block selector, and a motion vector shift unit (108) for correcting, if a motion vector of a macro block selected by the macro block selector is referring to outside the range required for the 2-dimensional display, the reference indicated by the motion vector to be within the range required for the 2-dimensional display.
  • According to the configuration described above, since the macro block selector performs block selection, the decoding unit skips processing of macro blocks which are not supposed to be 2-dimensionally displayed. Accordingly, decoding time can be reduced by about ½ in comparison with the case of reproducing only the left-eye image after decoding all the frames, whereby 2-dimensional display of a 3-dimensional video stream can be efficiently performed. In addition, in a case where decoding of macro blocks is skipped by selecting blocks in the macro block selector, image degradation caused by reference to an undecoded region can be avoided by shifting and correcting the motion vector.
  • [2] In the item [1] , the decoding unit may include an inverse quantizer (104) which performs inverse quantization, an inverse discrete cosine transformer (105) which performs inverse discrete cosine transformation on the output of the inverse quantizer, a motion compensator (109) which extracts decoded data to acquire a predicted image, and an adder (106) for adding the output of the motion compensator to the output of the inverse discrete cosine transformer.
  • [3] In the item [2], the macro block selector may be configured to determine whether an input 3-dimensional video stream has been encoded in a side-by-side system or a top-and-bottom system, and in accordance with the determination result, specify a range required for 2-dimensional display, and sequentially select, as objects to be decoded, macro blocks belonging to the range.
  • [4] In the item [3], the motion vector shift unit may perform first determination processing to determine whether or not a motion vector of a macro block selected by the macro block selector is referring to a macro block for forming a right-eye image. In addition, the motion vector shift unit may perform second determination processing to determine whether or not the input 3-dimensional video stream has been encoded in a side-by-side system or a top-and-bottom system, in the case where the motion vector of the macro block selected by the macro block selector is referring to a macro block for forming a right-eye image. Furthermore, the motion vector shift unit may correct, in accordance with result of the first determination processing and the second determination processing, the reference indicated by the motion vector to be within a range required for the 2-dimensional display.
  • [5] In the item [4], a variable-length decoder (102) may be disposed in a preceding stage of the macro block selector for performing variable-length decoding processing in which partitions of the macro block can be analyzed.
  • [6] In the item [5], an image display device (10) may include the video decoding device (100) and a display unit (400) capable of performing 2-dimensional display of the decoding result of the video decoding device.
  • 2. Details of Embodiments
  • Embodiment will be further described in detail.
  • First Embodiment
  • FIG. 1 illustrates an exemplary configuration of the image display device according to the invention.
  • The image display device 10 shown in FIG. 1 can decode and display a 3-dimensional video stream encoded by a compression algorithm based on MPEG (Moving Picture Experts Group)-4. As a compression algorithm based on MPEG-4, space conversion, intra-frame prediction, quantization or the like is employed. Discrete cosine transformation is used for space conversion. For example, a DCT coefficient of the original image or a predicted error image of an intra-frame prediction is obtained with a macro block of 8×8 pixels being a unit, and the coefficient is quantized. For example, encoding with a P-frame is performed by making use of a single image from a frame located anterior in the time axis, whereas encoding with a B-frame is performed by making use of two, i.e., anterior and posterior images. In order to display an image which has been encoded in this manner, decoding processing is required. In the decoding processing, P-frames are sequentially referred to along the time axis t as shown in FIG. 5, for example.
  • The image display device 10 shown in FIG. 1 is mounted on a cellular phone or a digital video camera, although not being particularly limited thereto, and includes a video decoding device 100, a stream recording unit 200, a 2D/3D display determination unit 300, and a display unit 400. The stream recording unit 200 is assumed to be a semiconductor memory, and the semiconductor memory has a 3-dimensional video stream recorded therein. The 3-dimensional video stream is encoded in a side-by-side system or in a top-and-bottom system.
  • The video decoding device 100 has a function of decoding a 3-dimensional video stream taken in from the stream recording unit 200. The video decoding device 100 has a 2D/3D control signal input thereto from the 2D/3D display determination unit 300. When 2-dimensional display is specified by the 2D/3D control signal, the video decoding device 100 performs decoding processing for 2-dimensional display. When 3-dimensional display is specified by the 2D/3D control signal, the video decoding device 100 performs decoding processing for 3-dimensional display.
  • The video decoding device 100 includes a Buffer 101, a variable length decoder (VLD) 102, a macro block selector (MB Selector) 103, a macro block shifter (MB Shifter) 108, and a decoding unit 110.
  • A 3-dimensional video stream is transferred from the stream recording unit 200 to the Buffer 101. The 3-dimensional video stream stored in a Buffer 31 is supplied to the variable-length decoder 102. In the variable-length decoder 102, predicted residual components of color and brightness of a plurality of blocks included in a picture are decoded from the input 3-dimensional video stream. It should be noted that the boundary between macro blocks is clarified by the decoding processing.
  • In accordance with 2D/3D control signal from the 2D/3D display determination unit 300, the macro block selector 103 selects a corresponding block for an output signal from the variable-length decoder 102. That is, when 2-dimensional display is instructed by the 2D/3D control signal which can selectively instruct 2-dimensional display or 3-dimensional display, a range required for the 2-dimensional display is specified, and predicted residual components of color and brightness are sequentially selected for macro blocks belonging to the range and supplied to the decoding unit 110 at a subsequent stage. At this time, predicted residual components of color and brightness for macro blocks which have not been selected by the macro block selector 103 are not supplied to the decoding unit 110.
  • The motion vector shifter 108 decodes a motion vector of a macro block of a picture from a 3-dimensional video stream. In addition, the motion vector shifter 108 determines whether or not a motion vector of a macro block selected by the macro block selector is referring to a macro block for forming a right-eye image. Furthermore, the motion vector shifter 108 determines whether or not the input 3-dimensional video stream has been encoded in a side-by-side system or a top-and-bottom system, in the case where the motion vector of the macro block selected by the macro block selector is referring to a macro block for forming a right-eye image and corrects, in accordance with determination result, the reference indicated by the motion vector within a range required for 2-dimensional display. The correction will be described in detail below.
  • The decoding unit 110 includes an inverse quantizer (IQ) 104, an inverse discrete cosine transformer (IDCT) 105, an adder 106, a memory (MEM) 107, and a motion compensator (MC) 109.
  • Predicted residual components of color and brightness for macro blocks selected by the macro block selector 103 are subject to inverse quantization by the inverse quantizer 104, subject to inverse cosine transformation by the inverse discrete cosine transformer 105, and then supplied to the adder 106. The output of the adder 106 is written into a memory 107 at a subsequent stage.
  • When the picture type is I-picture in which no intra-frame prediction is performed, data of the macro blocks are stored in the memory 107 as-is. In contrast to this, when the picture type is P-picture or B-picture accompanied with intra-frame prediction, the data of macro blocks has information of the motion vector added thereto, and thus, after the motion compensator 109 has extracted the decoded data in the memory 107 and acquired a predicted image based on the motion vector data supplied from the variable-length decoder 102, image data having difference data added thereto and motion-compensated by the adder 106 is acquired. That is, the motion compensator 109 performs motion compensation by forming a predicted image of a macro block for motion compensation, which is supplied to the adder 106, and added to the output of the inverse discrete cosine transformer 105. In this manner, a motion-compensated video signal is provided in the memory 107. The video signal is transferred to and displayed on the display unit 400.
  • FIG. 4 illustrates a flow chart of the main operation in the video decoding device 100.
  • The 2D/3D display determination unit 300 determines whether or not 2-dimensional display is specified (S1). When 2-dimensional display is specified in the determination (YES), the macro block selector 103 determines whether or not MB (macro block) coordinates are supposed to be displayed (S2). When it is determined that MB (macro block) coordinates are supposed to be displayed (YES), decoding of the macro block (MB) is performed (S3). When, however, it is determined that MB coordinates are not supposed to be displayed (NO), decoding of the MB is skipped (S4). When determination at step S2 has been made for all the macro blocks, the processing is completed (S5). In addition, when it is determined at step S1 that 2-dimensional display is not specified (NO), all the MB are subjected to decoding, for 3-dimensional display (S6, S7).
  • The processing at step S3 differs between the case where the input 3-dimensional video stream has been encoded in a side-by-side system and the case where it has been encoded in a top-and-bottom system.
  • When, for example, the input 3-dimensional video stream has been encoded in a side-by-side system, the processing is performed as shown in FIG. 2. Here, for convenience of illustration, the image size including the L (left) image and the R (right) image is assumed to be 8×4 (number of horizontal MB=8, number of vertical MB=4). In this case, the horizontal line is traced back each time four horizontal MB have been decoded as shown by thick arrows, and thus only the L-region is decoded. The R-region is not decoded.
  • In contrast, if the input 3-dimensional video stream has been encoded in a top-and-bottom system, only the L-region is decoded by terminating the decoding when all the horizontal MB for two lines have been decoded, as shown in FIG. 3. The R-region is not decoded.
  • Here, if a viewer selected 2-dimensional display of a 3-dimensional video stream, the motion vector is checked by the motion vector shifter 108. The motion vector referring to a region which has already been decoded is supplied to the compensator 109 as is without conversion. However, for a motion vector referring to a region (macro block) which has not been selected by the macro block selector 103, a predicted image (equivalent to a P-frame or B-frame) indicated by the original motion vector cannot be referred to, and thus the macro block shifter 108 compensates the motion vector by shifting it so as to refer to the already decoded region regarded as most resembling the predicted image indicated by the original motion vector. At this time, the shift method is determined through the use of 3-dimensional format information acquired from the variable-length decoder 102.
  • FIG. 8 illustrates a flow chart of motion vector shift. The MV shifter 108 first determines whether or not the motion vector is referring to the R-region (S11). If it is determined that the motion vector is referring to the R-region (YES), it is determined whether or not the input 3-dimensional video stream has been encoded in a side-by-side system (S12). The content of the correction differs (S13, S14, S15) depending on whether or not the motion vector is referring to the R-region in the determination at step S11 and, further, whether or not the input 3-dimensional video stream has been encoded in a side-by-side system.
  • In the case where the input 3-dimensional video stream has been encoded in a side-by-side system, for example, with a motion vector 61 of a particular macro block (x=3, y=1) in the L-region being denoted as MV (mv_x, mv_y) as shown in FIG. 6A, for example, a motion vector MV′ (mv_x′, mv_y′) shown by the dashed line 62 in FIG. 6B is acquired if the motion vector 61 is referring to the R-region. Here, “mv_x′” is indicated by formula 1, and “mv_y′” is indicated by formula 2.

  • mv_mv=mv_x−(x_pic_size/2)*a  [Formula 1]
  • Here, “x_pic_size” expresses the number of horizontal MBs. The symbol “*” means multiplication. The symbol “a” expresses a coefficient in accordance with precision of the motion vector. The coefficient according to the precision of the motion vector is given such as a=1 for integer pixel units, a=2 for ½ pixel units, and a=4 for ¼ pixels units.

  • mv_y′=mv_y  [Formula 2]
  • For example, since the number of horizontal MB (x_pic_size) becomes “8” and mv_x of the motion vector 61 is “4” when the size of an image including the L (left) image and the R (right) image is 8×4 (number of horizontal MB=8, number of vertical MB=4), the motion vector MV′ (mv_x′, mv_y′) indicated by the dashed line 62 for the case of a=1 becomes MV′ (0,0). That is, a place corresponding to the R-region in the L-region is regarded as the place most resembling the predicted image indicated by the original motion vector, to which the motion vector is shifted and corrected. Correcting the motion vector in this manner prevents an undecoded region from being referred to.
  • In addition, if the input 3-dimensional video stream has been encoded in a top-and-bottom system, it is determined not to be a side-by-side system (NO) in the determination at step S12 and corrected as follows.
  • With a motion vector 71 of a particular macro block (x=3, y=1s) being denoted as MV (mv_x, mv_y) as shown in FIG. 7A, for example, a motion vector MV′ (mv_x′, mv_y′) shown by the dashed line 72 in FIG. 7B is acquired if the motion vector is referring to a bottom region. Here, “mv_x′” is indicated by formula 3 and “mv_y′” is indicated in formula 4.

  • mv_xv=mv_x  [Formula 3]

  • mv_yv=mv_y−(y_pic_size/2)*a  [Formula 4]
  • That is, a place corresponding to the bottom region in the top region is regarded as the place most resembling the predicted image indicated by the original motion vector, to which the motion vector is shifted and corrected.
  • If it is determined in the determination at step S11 that the motion vector is not referring to the R-region (NO), the motion vector is not corrected. In this case, “mv_y′” and “mv_x′” are expressed by formulas 2 and 3, respectively.
  • According to the First Embodiment, the following effect is exhibited.
  • (1) Since the macro block selector 103 performs block selection, the decoding unit 110 skips processing of macro blocks which are not supposed to be 2-dimensionally displayed. Accordingly, decoding time can be reduced by about ½ in comparison with the case of reproducing only the left-eye image after decoding all the frames, whereby 2-dimensional display of a 3-dimensional video stream can be efficiently provided.
  • (2) In a case where decoding of macro blocks is skipped by selecting blocks in the macro block selector 103, leaving the motion vector 61 in the L-region referring to the R-region may cause image degradation due to reference to an undecoded region, as shown in FIG. 6A. In contrast to this, image degradation caused by reference to an undecoded region can be avoided by shifting and correcting the motion vector as described above.
  • Although the invention made by the inventors has been specifically described based on embodiments, it is needless to say that the invention is not limited thereto and may be modified in various ways within a range that does not deviate from the spirit thereof.
  • For example, the image display device 10 shown in FIG. 1 may have the 2D/3D display determination unit 300 omitted therefrom and may be configured to be dedicated for 2-dimensional display. When only 2-dimensional display is assumed, the decoding unit 110 skips processing of macro blocks which are not supposed to be 2-dimensionally displayed either in a side-by-side system or a top-and-bottom system, and therefore memory capacity of the memory 107 can be made smaller than in the case shown in FIG. 1.

Claims (21)

1-6. (canceled)
7. A decoding device receiving an input video stream having a first macro block group including a plurality of macro blocks for forming a first image, and a second macro block group including a plurality of macro blocks for forming a second image, formed on the same frame,
the decoding device comprising:
a macro block selector circuit for selecting, as objects to be decoded, macro blocks of one of the macro block groups;
a decoding circuit for decoding only the selected macro blocks; and
a motion vector shift circuit for supplying a motion vector of a selected macro block to the decoding circuit,
wherein the motion vector shift circuit is further configured to correct a reference indicated by the motion vector of the selected macro block when the motion vector refers to a macro block outside of the one macro block group.
8. The decoding device according to claim 7, wherein, when the motion vector refers to a macro block outside of the one macro block group, the motion vector shift circuit corrects the reference so as to be within the one macro block group.
9. The decoding device according to claim 7, wherein, when the motion vector refers to a macro block within the one macro block group, the motion vector shift circuit supplies the motion vector to the decoding circuit without correcting the reference.
10. The decoding device according to claim 7, wherein the motion vector shift circuit is further configured to:
determine whether the motion vector is referring to a macro block outside of the one macro block group;
determine the encoding system of the video stream; and
correct the reference based on a result of the determinations.
11. The decoding device according to claim 10, wherein the macro block selector circuit specifies a range of macro blocks within the one macro block group required for a 2-dimensional display, and selects, as objects to be decoded, macro blocks belonging to the range.
12. The decoding device according to claim 11,
wherein the first macro block group is a right-eye macro block group including a plurality of macro blocks for forming a right-eye image and the second macro block group is a left-eye macro block group including a plurality of macro blocks for forming a left-eye image, and
the image motion vector shift circuit determines whether or not the motion vector of a macro block selected by the macro block selector is referring to a macro block of the right-eye macro block group, and determines whether or not the video stream has been encoded in a side-by-side system or a top-and-bottom system, and
in the case where the motion vector of the macro block selected by the macro block selector circuit is referring to a macro block for forming a right-eye image, corrects, in accordance with the result of the determinations, the reference indicated by the motion vector to be within a range for the 2-dimensional display.
13. The decoding device according to claim 12, wherein a variable-length decoder is disposed, in a preceding stage of the macro block selector circuit, for performing variable-length decoding processing in which partitions of a macro block can be analyzed.
14. A method of decoding an input video stream having a first macro block group including a plurality of macro blocks for forming a first image, and a second macro block group including a plurality of macro blocks for forming a second image, formed on the same frame, comprising:
selecting, as objects to be decoded, macro blocks of one of the first and second macro block groups;
decoding only the selected macro blocks at a decoding circuit; and
supplying a motion vector of a selected macro block to the decoding circuit,
wherein a reference indicated by the motion vector of the selected macro block is corrected before the motion vector is supplied to the decoding circuit when the motion vector refers to a macro block outside of the one macro block group.
15. The decoding method according to claim 14, wherein when the motion vector refers to a macro block outside of the one macro block group, the reference is corrected so as to be within the one macro block group.
16. The decoding method according to claim 15, wherein when the motion vector refers to a macro block within the one macro block group, the motion vector is supplied to the decoding circuit without correcting the reference.
17. The decoding method according to claim 14, further comprising:
determining whether the motion vector is referring to a macro block outside of the one macro block group;
determining an encoding system of the input video stream; and
correcting the reference based on the determinations.
18. The decoding method according to claim 17, wherein the input video stream is a 3-dimensional video stream, the first macro block group is a right-eye macro block group including a plurality of macro blocks for forming a right-eye image and the second macro block group is a left-eye macro block group including a plurality of macro blocks for forming a left-eye image.
19. The decoding method according to claim 18, further comprising:
specifying a range of macro blocks required for a 2-dimensional display; and
selecting, as the objects to be decoded, macro blocks belonging to the range.
20. The decoding method according to claim 19, wherein the specifying is based on the encoding system of the input video stream.
21. The decoding method according to claim 20,
wherein the determining whether the motion vector is referring to a macro block outside of the one macro block group includes determining whether or not the motion vector is referring to a macro block of the right-eye macro block group, and the determining the encoding system of the input video stream includes determining whether or not the video stream has been encoded in a side-by-side system or a top-and-bottom system,
the method further comprising correcting, in a case where the motion vector of the selected macro block is referring to a macro block for forming a right-eye image, the reference indicated by the motion vector so as to be within the range for the 2-dimensional display, the correcting being in accordance with a result of the determinations.
22. A method of decoding an input 3-dimensional video stream having a right-eye macro block group including a plurality of macro blocks for forming a right-eye image, and a left-eye macro block group including a plurality of macro blocks for forming a left-eye image, the method comprising:
selecting macro blocks belonging to a single macro block group, the single micro-block group being the left-eye macro block group or the right-eye macro block group, as objects to be decoded;
supplying the selected macro blocks to a decoding circuit for decoding;
determining a first motion vector for one of the selected macro blocks; and
supplying a second motion vector to the decoding circuit based on the first motion vector,
wherein, when the first motion vector refers to a macro block belonging to the single macro block group, the second motion vector is supplied to the decoding circuit without shifting the first motion vector, and
wherein, when the first motion vector refers to a macro block belonging to the other macro block group, the second motion vector is supplied to the decoding circuit by first shifting the first motion vector.
23. The decoding method according to claim 22, wherein the shifting includes shifting the first motion vector so as to be within the single macro block group.
24. The decoding method according to claim 23, further comprising acquiring a predicted image based on the second motion vector.
25. The decoding method of claim 24, further comprising:
extracting decoded data belonging to the single macro block group based on the second motion vector; and
acquiring the predicted image based on the extracted decoded data.
26. The decoding method of claim 25, further comprising:
checking whether the first motion vector refers to a macro block belonging to the other macro block group after receipt of a control signal instructing for a 2-dimensional display; and
not checking whether the first motion vector refers to a macro block belonging to the other macro block group after receipt of a control signal instructing for a 3-dimensional display,
wherein the macro blocks belonging to the other macro block group are not supplied to the decoding circuit.
US15/813,900 2011-08-12 2017-11-15 Video decoding device and image display device Abandoned US20180124376A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/813,900 US20180124376A1 (en) 2011-08-12 2017-11-15 Video decoding device and image display device

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2011176796A JP5815326B2 (en) 2011-08-12 2011-08-12 Video decoding device and image display device
JP2011-176796 2011-08-12
US13/571,334 US9838666B2 (en) 2011-08-12 2012-08-09 Video decoding device and image display device
US15/813,900 US20180124376A1 (en) 2011-08-12 2017-11-15 Video decoding device and image display device

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/571,334 Continuation US9838666B2 (en) 2011-08-12 2012-08-09 Video decoding device and image display device

Publications (1)

Publication Number Publication Date
US20180124376A1 true US20180124376A1 (en) 2018-05-03

Family

ID=47677289

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/571,334 Active 2034-03-25 US9838666B2 (en) 2011-08-12 2012-08-09 Video decoding device and image display device
US15/813,900 Abandoned US20180124376A1 (en) 2011-08-12 2017-11-15 Video decoding device and image display device

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US13/571,334 Active 2034-03-25 US9838666B2 (en) 2011-08-12 2012-08-09 Video decoding device and image display device

Country Status (2)

Country Link
US (2) US9838666B2 (en)
JP (1) JP5815326B2 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015226216A (en) * 2014-05-28 2015-12-14 オリンパス株式会社 Medical image recording apparatus

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07327242A (en) * 1994-05-31 1995-12-12 Sanyo Electric Co Ltd Compressing and encoding device and decoding and reproducing device for stereoscopical animation picture
KR100750092B1 (en) * 2000-01-28 2007-08-21 삼성전자주식회사 Variable Length Coding method and device therefor
JP2002034047A (en) * 2000-07-18 2002-01-31 Pioneer Electronic Corp Method and device for coding image, method and device for coding information, image recording device, and image recording medium
KR100523052B1 (en) * 2002-08-30 2005-10-24 한국전자통신연구원 Object base transmission-receive system and method, and object-based multiview video encoding apparatus and method for supporting the multi-display mode
US7650036B2 (en) * 2003-10-16 2010-01-19 Sharp Laboratories Of America, Inc. System and method for three-dimensional video coding
JP4421940B2 (en) * 2004-05-13 2010-02-24 株式会社エヌ・ティ・ティ・ドコモ Moving picture coding apparatus and method, and moving picture decoding apparatus and method
JP2006332985A (en) * 2005-05-25 2006-12-07 Sharp Corp Stereoscopic image format decision device
JP5055570B2 (en) 2006-08-08 2012-10-24 株式会社ニコン Camera, image display device, and image storage device
CN101878486B (en) * 2007-11-30 2016-10-26 杜比实验室特许公司 The method and apparatus of processing moving sequence
JP2010034704A (en) 2008-07-25 2010-02-12 Sony Corp Reproduction apparatus and reproduction method
KR20100040640A (en) * 2008-10-10 2010-04-20 엘지전자 주식회사 Receiving system and method of processing data
KR101659576B1 (en) * 2009-02-17 2016-09-30 삼성전자주식회사 Method and apparatus for processing video image
US9124874B2 (en) * 2009-06-05 2015-09-01 Qualcomm Incorporated Encoding of three-dimensional conversion information with two-dimensional video sequence
JP5463747B2 (en) 2009-06-15 2014-04-09 ソニー株式会社 Reception device, transmission device, communication system, display control method, program, and data structure
JP5250491B2 (en) * 2009-06-30 2013-07-31 株式会社日立製作所 Recording / playback device
CN102204255B (en) * 2009-07-07 2014-09-17 松下电器产业株式会社 Moving picture decoding device, moving picture decoding method, moving picture decoding system, integrated circuit, and program
WO2011021894A2 (en) * 2009-08-20 2011-02-24 Lg Electronics Inc. Image display apparatus and method for operating the same
US8487981B2 (en) * 2009-09-04 2013-07-16 Broadcom Corporation Method and system for processing 2D/3D video
JP5482254B2 (en) * 2009-11-05 2014-05-07 ソニー株式会社 Reception device, transmission device, communication system, display control method, program, and data structure
WO2011061973A1 (en) * 2009-11-18 2011-05-26 日本ビクター株式会社 Three-dimensional image display device and method of deriving motion vector
US20110157322A1 (en) * 2009-12-31 2011-06-30 Broadcom Corporation Controlling a pixel array to support an adaptable light manipulator
IT1399417B1 (en) * 2010-04-12 2013-04-16 Sisvel Technology Srl METHOD FOR THE GENERATION AND RECONSTRUCTION OF A COMPATIBLE STEREOSCOPIC VIDEO FLOW AND RELATED CODING AND DECODING DEVICES.
US20110280311A1 (en) * 2010-05-13 2011-11-17 Qualcomm Incorporated One-stream coding for asymmetric stereo video
JPWO2012017643A1 (en) * 2010-08-06 2013-10-03 パナソニック株式会社 Encoding method, display device, and decoding method
JP5402953B2 (en) * 2011-01-24 2014-01-29 富士通株式会社 Decompression decoding apparatus, decompression decoding method, and program

Also Published As

Publication number Publication date
US20130038687A1 (en) 2013-02-14
JP5815326B2 (en) 2015-11-17
JP2013042279A (en) 2013-02-28
US9838666B2 (en) 2017-12-05

Similar Documents

Publication Publication Date Title
US9877044B2 (en) Video encoder and operation method thereof
US9872018B2 (en) Random access point (RAP) formation using intra refreshing technique in video coding
US7324595B2 (en) Method and/or apparatus for reducing the complexity of non-reference frame encoding using selective reconstruction
KR101197506B1 (en) Boundary artifact correction within video units
US9204168B2 (en) Image decoding method, image coding method, image decoding apparatus, image coding apparatus, and image coding and decoding apparatus
US8487981B2 (en) Method and system for processing 2D/3D video
US8179969B2 (en) Method and apparatus for encoding or decoding frames of different views in multiview video using global disparity
US7010044B2 (en) Intra 4×4 modes 3, 7 and 8 availability determination intra estimation and compensation
US20130022111A1 (en) Coding motion depth maps with depth range variation
US7212573B2 (en) Method and/or apparatus for determining minimum positive reference indices for a direct prediction mode
US20140105295A1 (en) Moving image encoding method and apparatus, and moving image decoding method and apparatus
JP5340289B2 (en) Image decoding apparatus, image decoding method, integrated circuit, and program
US8704932B2 (en) Method and system for noise reduction for 3D video content
US8379985B2 (en) Dominant gradient method for finding focused objects
WO2012098845A1 (en) Image encoding method, image encoding device, image decoding method, and image decoding device
US8165217B2 (en) Image decoding apparatus and method for decoding prediction encoded image data
US20120195381A1 (en) Image processing apparatus and method for processing image
US20180124376A1 (en) Video decoding device and image display device
US20080212886A1 (en) Image processing method, image processing apparatus and image pickup apparatus using the same
US20090067494A1 (en) Enhancing the coding of video by post multi-modal coding
US10531112B2 (en) Signal processing apparatus, imaging apparatus, and signal processing method to reduce electric power required for signal processing
RU2803187C1 (en) Method and device for image coding based on sub-image
JP5911982B2 (en) Image decoding method
JP2015035785A (en) Dynamic image encoding device, imaging device, dynamic image encoding method, program, and recording medium

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION