EP1933567B1 - Apparatus for encoding interlaced macroblock texture information - Google Patents
Apparatus for encoding interlaced macroblock texture information Download PDFInfo
- Publication number
- EP1933567B1 EP1933567B1 EP20080004285 EP08004285A EP1933567B1 EP 1933567 B1 EP1933567 B1 EP 1933567B1 EP 20080004285 EP20080004285 EP 20080004285 EP 08004285 A EP08004285 A EP 08004285A EP 1933567 B1 EP1933567 B1 EP 1933567B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- texture
- field block
- block
- undefined
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/649—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding the transform being applied to non rectangular image segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/16—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter for a given display mode, e.g. for interlaced or progressive display mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/563—Motion estimation with padding, i.e. with filling of non-object values in an arbitrarily shaped picture block or region for estimation purposes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
Definitions
- the present invention relates to an apparatus for encoding interlaced macroblock texture information.
- One of such techniques for encoding video signals for a low bit-rate encoding system is the so-called object-oriented analysis-synthesis coding technique, wherein an input video image is divided into objects, and three sets of parameters for defining the motion, contour and pixel data of each object are processed through different encoding channels.
- MPEG-4 Motion Picture Express Group
- MPEG-4 Video Verification Model Version 7.0, International Organisation for Standardisation, ISO/IEC JTC1/SC29/WG11 MPEG97/N1642, April 1997.
- an input video image is divided into a plurality of video object planes(VOP's), which correspond to entities in a bitstream that a user can access and manipulate.
- VOP can be referred to as an object and represented by a bounding rectangle whose width and height may be the smallest multiple of 16 pixels(a macroblock size) surrounding each object so that the encoder may process the input video image on a VOP-by-VOP basis, i.e., an object-by-object basis.
- Each VOP in the MPEG-4 is described by three sets of parameters defining shape information, motion information and texture information, i.e., color information thereof, wherein the shape information represented by, e.g., a binary mask corresponds to the contour of said each VOP, i.e., the boundary of an object; the motion information represents spatial correlation between a current frame and a corresponding previous frame; and the texture information consists of luminance and chrominance data.
- shape information represented by, e.g., a binary mask corresponds to the contour of said each VOP, i.e., the boundary of an object
- the motion information represents spatial correlation between a current frame and a corresponding previous frame
- the texture information consists of luminance and chrominance data.
- the texture information for two input video images sequentially received has naturally time redundancy, it is desirable to get rid of the time redundancy therein by using a motion estimation and compensation technique in order to efficiently encode the texture information in the MPEG-4.
- a progressive image padding technique i.e., a conventional repetitive padding technique, is applied on a frame-by-frame basis to the VOP prior to the motion estimation and compensation.
- the repetitive padding technique fills the transparent area outside the object of the VOP by repeating boundary pixels of the object, wherein the boundary pixels are located on the contour of the object. It is preferable to perform the repetitive padding technique with respect to the reconstructed shape information, which is generated by decoding the encoded shape information in the reverse order along the encoding scheme.
- Each boundary pixel is repeated towards the exterior of the object. If transparent pixels in the transparent area outside the object can be filled by the repetition of more than one boundary pixel, taking the average of the repeated values as a padded value is preferred.
- This progressive padding process is generally divided into 3 steps, i.e., a horizontal repetitive padding; a vertical repetitive padding and an exterior padding(see, MPEG-4 Video Verification Model Version 7.0).
- an interlaced padding technique is required to perform the motion estimation and compensation on a field-by-field basis, wherein two fields, i.e., a top and a bottom field are combined to be reconstructed as a frame, i.e., an interlaced texture image.
- the interlaced encoding technique to perform the motion estimation and compensation on a field-by-field basis may be suitably used to encode precisely the interlaced texture information either for the fast movement such as a sport, horse racing and car racing or with a rarely field correlation, i.e., with a rarely temporal correlation between the top and the bottom fields.
- the padding for each field block is performed independently without considering its field correlation based on the interlaced texture information as described in the progressive padding technique, there may exist some pixel which will not be modified based on only the object pixels of the object, but will be modified by padding when taking account of their field correlation, needing two consecutive fields, i.e., the top and the bottom fields, included in the interlaced texture information.
- MPEG-4 Video Verification Model Version 7.0 Chapter 3: Encoder Definition ad hoc group on MPEG-Video VM editing, international organisation for standardization, pages 1, 17-122, 1 April 1997, discloses a repetitive padding technique for VOPs prior to motion estimation/compensation (section 3.3.2), a low pass extrapolation padding technique before performing DCT (section 3.4.1) and an adaptive frame/field DCT for interlaced video (section 3.4.1).
- an object of the invention to provide an apparatus for encoding interlaced texture information on a texture macroblock basis.
- Fig. 1 there is shown a schematic block diagram of an apparatus for encoding interlaced texture information on a current frame, wherein the interlaced texture information may be referred as a current VOP in MPEG-4.
- the interlaced texture information is partitioned into a plurality of texture macroblocks to be applied to a frame division circuit 102, wherein each texture macroblock has M x N texture pixels, M and N being positive even integers typically ranging between 4 and 16.
- the frame division circuit 102 divides each texture macroblock into a top and a bottom field blocks, wherein the top field block having M/2 x N texture pixels contains every odd row of said each texture macroblock and the bottom field block having the other M/2 x N texture pixels contains every even row of said each texture macroblock.
- the top and the bottom field blocks for said each texture macroblock are sequentially provided as a current top and a current bottom field blocks, respectively, to a subtractor 104 and a motion estimator 116.
- previous interlaced texture information is read out from a previous frame processing circuit 114 and provided to the motion estimator 116 and a motion compensator 118, wherein the previous interlaced texture information of a previous frame has previous texture pixels and precedes the interlaced texture information of the current frame by one frame period.
- the previous frame is also partitioned into a plurality of search regions and each search region is divided into a top and a bottom search region, wherein the top search region having P(M/2 x N) previous texture pixels contains every odd row of said each search region and the bottom search region having the other P(M/2 x N) previous texture pixels contains every even row of said each search region, P being a positive integer, typically, 2.
- the motion estimator 116 determines motion vectors for the current VOP on a field-by-field basis. First, the motion estimator 116 detects a previous texture macroblock in the previous frame for each current top or bottom field block, wherein the previous texture macroblock is located at a same position as said each current top or bottom field block. Then the previous texture macroblock is divided into a previous top and a previous bottom field blocks; and errors between said each current top or bottom field block and two previous top and bottom field blocks are calculated.
- the top and the bottom search regions have a plurality of candidate top and candidate bottom field blocks including the previous top and the previous bottom field blocks, respectively
- said each current top or bottom field block is displaced on a pixel-by-pixel basis within the top and the bottom search regions in accordance with each candidate top and each candidate bottom field block, respectively; and, at each displacement, two errors between said each current top or bottom field block and said each candidate top and said each candidate bottom field blocks are compared with each other.
- the motion estimator 116 performs motion estimation of said each current top or bottom field block with respect to its previous top and bottom field blocks and selects, as an optimum candidate field block or a most similar field block, a candidate top or bottom field block which yields a minimum error.
- Outputs from the motion estimator 116 are a motion vector and a field indication flag being provided to the motion compensator 118 and a variable length coding(VLC) circuit 108, wherein the motion vector denotes a displacement between said each current top or bottom field block and the optimum candidate field block and the field indication flag represents whether the optimum candidate field block belongs to the top search region or not.
- the motion compensator 118 performs a motion compensation by making the optimum candidate field block shift by the motion vector toward said each current top or bottom field block depending on the field indication flag, to thereby provide a motion-compensated optimal candidate field block as a predicted top or bottom field block for said each current top or bottom field block to the subtractor 104 and an adder 112.
- the subtractor 104 obtains an error field block by subtracting the predicted top or bottom field block from said each current top or bottom field block on a corresponding pixel-by-pixel basis, to provide the error field block to a texture encoding circuit 106.
- the error field block may be subjected to an orthogonal transform for removing spatial redundancy thereof and then transform coefficients are quantized, to thereby provide the quantized transform coefficients to the VLC circuit 108 and a texture reconstruction circuit 110.
- an orthogonal transform such as a discrete cosine transform(DCT) is performed on a DCT block-by-DCT block basis, each DCT block having typically 8 x 8, i.e., M/2 x N/2, texture pixels, the error field block having 8 x 16 error texture pixels may be preferably divided into two DCT blocks in the texture encoding circuit 106.
- each error field block may be DCT-padded based on the shape information or the reconstructed shape information of each VOP in order to reduce higher frequency components which may be generated in the DCT processing.
- a predetermined value e.g., '0', may be assigned to the error texture pixels at the exterior of the contour in each VOP.
- the VLC circuit 108 performs a statistical encoding on the quantized transform coefficients fed from the texture encoding circuit 106 and the field indication flag and the motion vector, for said each current top or bottom field block, fed from the motion estimator 116 by using, e.g., a conventional variable length coding technique, to thereby provide statistically encoded data to a transmitter(not shown) for the transmission thereof.
- the texture reconstruction circuit 110 performs an inverse quantization and inverse transform on the quantized transform coefficients to provide a reconstructed error field block, which corresponds to the error field block, to the adder 112.
- the adder 112 combines the reconstructed error field block from the texture reconstruction circuit 110 and the predicted top or bottom field block from the motion compensator 118 on a pixel-by-pixel basis, to thereby provide a combined result as a reconstructed top or bottom field block for said each current top or bottom field block to the previous frame processing circuit 114.
- the previous frame processing circuit 114 sequentially modifies the reconstructed top or bottom field block based on the shape information or the reconstructed shape information for the current VOP, to thereby provide all the modified top and bottom field blocks as another previous interlaced texture information for a subsequent current VOP to the motion estimator 116 and the motion compensator 118.
- FIG. 2 there is a flow chart illustrating an important aspect of the invention related to the operation of the previous frame processing circuit 114 shown in Fig. 1 , i.e., explaining a padding procedure for texture information on a previous frame on a macroblock-by-macroblock basis.
- the reconstructed top or bottom field block for the current top or bottom field block is sequentially received and, at step S203, exterior pixels in the reconstructed top or bottom field block are removed based on the shape information of the current VOP, wherein the exterior pixels are located at the outside of the contour for the current VOP.
- the reconstructed shape information may be used on behalf of the shape information, wherein the shape information is encoded in accordance with an encoding scheme to generate the encoded shape information and the encoded shape information is reconstructed as the reconstructed shape information by being decoded in the reverse order along the encoding scheme.
- the exterior pixels are removed to be set as transparent pixels, i.e., undefined texture pixels
- the remaining interior pixels in the reconstructed top or bottom field block are provided as defined texture pixels on a field block-by-field block basis.
- each reconstructed block is determined whether or not being located on the contour of the current VOP, wherein said each reconstructed block has the reconstructed top field block and the corresponding reconstructed bottom field block.
- said each reconstructed block is determined as an interior block, a boundary block, or an exterior block, wherein the interior block has only the defined texture pixels, the exterior block has only the undefined texture pixels and the boundary block has both the defined texture pixels and the undefined texture pixels. If the reconstructed block is determined as an interior block, at step S210, no padding is performed and the process goes to step S211.
- each boundary block is divided into a top and a bottom boundary field blocks as shown in Fig. 3B , each boundary field block having M/2 x N texture pixels.
- the undefined texture pixels are padded on a row-by-row basis by using a horizontal repetitive padding technique as shown in Fig. 3C to generate a padded row for each row.
- the undefined texture pixels are filled by repeating boundary pixels toward the arrows as shown in Fig.
- each boundary pixel among the defined texture pixels is located on the contour, i.e., the border, of the current VOP. If any undefined texture pixel may be filled by the repetition of more than one boundary pixel, the average value of the repeated values is used.
- each transparent row is padded by using one or more nearest defined or padded rows among the corresponding top or bottom field block, wherein the defined row has all the defined texture pixels therein.
- each undefined texture pixel of the transparent row shown in the bottom field block is replaced with an average of two defined or padded texture pixels based on a nearest upward and a nearest downward padded rows, i.e., the 2nd and the 4th padded rows in the bottom field block. If the transparent row is located at the highest or the lowest row, i.e., corresponds to the 1st row 1 or the 8th row, said each texture pixel is replaced with a defined or padded texture pixel of the nearest padded or defined row.
- the transparent boundary field block is padded based on another boundary field block of the boundary block, wherein the transparent boundary field block, i.e., an undefined field block having no defined texture pixel therein.
- the transparent boundary field block i.e., an undefined field block having no defined texture pixel therein.
- all the undefined texture pixels of the transparent boundary field block, i.e., the top field block may be replaced with a constant value P as shown in Fig. 3E , e.g., a mean value of the defined texture pixels within the bottom field block.
- the mean value of both the defined and the padded pixels within the bottom field block can also be used to fill the transparent field block.
- a middle value 2 L-1 of all the possible values for any texture pixel may be used based on the channel characteristics, wherein L is the number of bits assigned for each pixel. For example, if L is equal to 8, there are 256 texture pixels 0 to 255 and the middle value is determined to be 128.
- the padding must be further extended to blocks which stretch outside the VOP but are immediately next to any boundary block. If the reconstructed block is determined as the exterior block at step S204, at step S207, it is determined whether the exterior block is adjacent to any extrapolated boundary block. If the exterior block is adjacent to no extrapolated boundary block, at step 209, no padding is performed and the process goes to step S211.
- the undefined texture pixels in the undefined adjacent block are padded based on one of the extrapolated boundary blocks to generate an extrapolated adjacent block for the undefined adjacent block, wherein each extrapolated boundary block has a part of the contour A or B of the current VOP and each undefined adjacent block is shown as a shaded region as shown in Fig. 4 .
- an extrapolated boundary block is selected in priority sequence of the leftward, upward, rightward and downward based on the undefined adjacent block and then a vertical or a horizontal border of the selected extrapolated boundary block is repeated rightwards, downwards, leftwards or upwards, wherein the vertical or the horizontal border adjoins the undefined adjacent block .
- a vertical or a horizontal border of the selected extrapolated boundary block is repeated rightwards, downwards, leftwards or upwards, wherein the vertical or the horizontal border adjoins the undefined adjacent block .
- the undefined adjacent blocks JB4, JB20, JB9 and JB2 select their respective leftward, upward, rightward and downward extrapolated boundary blocks a2, a10, a3 and a1, respectively; and a rightmost vertical border of the extrapolated boundary block a2 is expanded rightward to fill the undefined adjacent block JB4, a lowermost horizontal border of the extrapolated boundary block a10 is expanded downward to fill the undefined adjacent block JB20 and so on.
- undefined diagonal blocks such as M1 and M2 may be padded with a constant value, e.g., '128' to be the extrapolated adjacent block for the undefined diagonal block, wherein each undefined diagonal block is diagonally adjacent to the extrapolated boundary block and has all undefined texture pixels.
- the modified top and bottom field blocks i.e, the extrapolated boundary and the extrapolated adjacent blocks as well as the interior blocks are provided as another previous interlaced texture information for the subsequent current VOP.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression Of Band Width Or Redundancy In Fax (AREA)
- Image Generation (AREA)
- Analogue/Digital Conversion (AREA)
Description
- The present invention relates to an apparatus for encoding interlaced macroblock texture information.
- In digitally televised systems such as video-telephone, teleconference and high definition television systems, a large amount of digital data is needed to define each video frame signal since a video line signal in the video frame signal comprises a sequence of digital data referred to as pixel values. Since, however, the available frequency bandwidth of a conventional transmission channel is limited, in order to transmit the large amount of digital data therethrough, it is necessary to compress or reduce the volume of data through the use of various data compression techniques, especially in the case of such low bit-rate video signal encoders as video-telephone and teleconference systems.
- One of such techniques for encoding video signals for a low bit-rate encoding system is the so-called object-oriented analysis-synthesis coding technique, wherein an input video image is divided into objects, and three sets of parameters for defining the motion, contour and pixel data of each object are processed through different encoding channels.
- One example of object-oriented coding scheme is the so-called MPEG(Moving Picture Express Group) phase 4(MPEG-4), which is designed to provide an audio-visual coding standard for allowing content-based interactivity, improved coding efficiency and/or universal accessibility in such applications as low-bit rate communication, interactive multimedia(e.g., games, interactive TV, etc.) and area surveillance(see, for instance, MPEG-4 Video Verification Model Version 7.0, International Organisation for Standardisation, ISO/IEC JTC1/SC29/WG11 MPEG97/N1642, April 1997).
- According to the MPEG-4, an input video image is divided into a plurality of video object planes(VOP's), which correspond to entities in a bitstream that a user can access and manipulate. A VOP can be referred to as an object and represented by a bounding rectangle whose width and height may be the smallest multiple of 16 pixels(a macroblock size) surrounding each object so that the encoder may process the input video image on a VOP-by-VOP basis, i.e., an object-by-object basis.
- Each VOP in the MPEG-4 is described by three sets of parameters defining shape information, motion information and texture information, i.e., color information thereof, wherein the shape information represented by, e.g., a binary mask corresponds to the contour of said each VOP, i.e., the boundary of an object; the motion information represents spatial correlation between a current frame and a corresponding previous frame; and the texture information consists of luminance and chrominance data.
- Meanwhile, since the texture information for two input video images sequentially received has naturally time redundancy, it is desirable to get rid of the time redundancy therein by using a motion estimation and compensation technique in order to efficiently encode the texture information in the MPEG-4.
- A progressive image padding technique, i.e., a conventional repetitive padding technique, is applied on a frame-by-frame basis to the VOP prior to the motion estimation and compensation. In principle, the repetitive padding technique fills the transparent area outside the object of the VOP by repeating boundary pixels of the object, wherein the boundary pixels are located on the contour of the object. It is preferable to perform the repetitive padding technique with respect to the reconstructed shape information, which is generated by decoding the encoded shape information in the reverse order along the encoding scheme. Each boundary pixel is repeated towards the exterior of the object. If transparent pixels in the transparent area outside the object can be filled by the repetition of more than one boundary pixel, taking the average of the repeated values as a padded value is preferred. This progressive padding process is generally divided into 3 steps, i.e., a horizontal repetitive padding; a vertical repetitive padding and an exterior padding(see, MPEG-4 Video Verification Model Version 7.0).
- While the progressive padding technique is used to perform the motion estimation and compensation based on each frame generated for every 1/30 seconds as described above, an interlaced padding technique is required to perform the motion estimation and compensation on a field-by-field basis, wherein two fields, i.e., a top and a bottom field are combined to be reconstructed as a frame, i.e., an interlaced texture image. The interlaced encoding technique to perform the motion estimation and compensation on a field-by-field basis may be suitably used to encode precisely the interlaced texture information either for the fast movement such as a sport, horse racing and car racing or with a rarely field correlation, i.e., with a rarely temporal correlation between the top and the bottom fields.
- However, if the padding for each field block is performed independently without considering its field correlation based on the interlaced texture information as described in the progressive padding technique, there may exist some pixel which will not be modified based on only the object pixels of the object, but will be modified by padding when taking account of their field correlation, needing two consecutive fields, i.e., the top and the bottom fields, included in the interlaced texture information.
- "MPEG-4 Video Verification Model Version 7.0 Chapter 3: Encoder Definition", ad hoc group on MPEG-Video VM editing, international organisation for standardization,
pages 1, 17-122, 1 April 1997, discloses a repetitive padding technique for VOPs prior to motion estimation/compensation (section 3.3.2), a low pass extrapolation padding technique before performing DCT (section 3.4.1) and an adaptive frame/field DCT for interlaced video (section 3.4.1). - It is, therefore, an object of the invention to provide an apparatus for encoding interlaced texture information on a texture macroblock basis.
- In accordance with the invention, there is provided an apparatus according to
claim 1, preferred embodiments thereof being defined in the dependent claims. - The above and other objects and features of the present invention will become apparent from the following description of preferred embodiments given in conjunction with the accompanying drawings, in which:
-
Fig. 1 shows a schematic block diagram of a conventional apparatus for encoding interlaced texture information of an object in a video signal; -
Fig. 2 presents a flow chart for illustrating the operation of the previous frame processing circuit shown inFig. 1 in accordance with the present invention; -
Figs. 3A and 3B describe an exemplary boundary macroblock and a top and a bottom boundary field blocks for the boundary macroblock, respectively; -
Figs. 3C to 3E represent a padding procedure of the top and the bottom boundary field blocks sequentially in accordance with the present invention; and -
Fig. 4 depicts a plurality of undefined adjacent blocks for an exemplary VOP and the padding directions for each undefined adjacent block. - Referring to
Fig. 1 , there is shown a schematic block diagram of an apparatus for encoding interlaced texture information on a current frame, wherein the interlaced texture information may be referred as a current VOP in MPEG-4. The interlaced texture information is partitioned into a plurality of texture macroblocks to be applied to aframe division circuit 102, wherein each texture macroblock has M x N texture pixels, M and N being positive even integers typically ranging between 4 and 16. - The
frame division circuit 102 divides each texture macroblock into a top and a bottom field blocks, wherein the top field block having M/2 x N texture pixels contains every odd row of said each texture macroblock and the bottom field block having the other M/2 x N texture pixels contains every even row of said each texture macroblock. The top and the bottom field blocks for said each texture macroblock are sequentially provided as a current top and a current bottom field blocks, respectively, to asubtractor 104 and amotion estimator 116. - Essentially at the same time, previous interlaced texture information is read out from a previous
frame processing circuit 114 and provided to themotion estimator 116 and amotion compensator 118, wherein the previous interlaced texture information of a previous frame has previous texture pixels and precedes the interlaced texture information of the current frame by one frame period. The previous frame is also partitioned into a plurality of search regions and each search region is divided into a top and a bottom search region, wherein the top search region having P(M/2 x N) previous texture pixels contains every odd row of said each search region and the bottom search region having the other P(M/2 x N) previous texture pixels contains every even row of said each search region, P being a positive integer, typically, 2. - The
motion estimator 116 determines motion vectors for the current VOP on a field-by-field basis. First, themotion estimator 116 detects a previous texture macroblock in the previous frame for each current top or bottom field block, wherein the previous texture macroblock is located at a same position as said each current top or bottom field block. Then the previous texture macroblock is divided into a previous top and a previous bottom field blocks; and errors between said each current top or bottom field block and two previous top and bottom field blocks are calculated. Since the top and the bottom search regions have a plurality of candidate top and candidate bottom field blocks including the previous top and the previous bottom field blocks, respectively, said each current top or bottom field block is displaced on a pixel-by-pixel basis within the top and the bottom search regions in accordance with each candidate top and each candidate bottom field block, respectively; and, at each displacement, two errors between said each current top or bottom field block and said each candidate top and said each candidate bottom field blocks are compared with each other. - As described above, the
motion estimator 116 performs motion estimation of said each current top or bottom field block with respect to its previous top and bottom field blocks and selects, as an optimum candidate field block or a most similar field block, a candidate top or bottom field block which yields a minimum error. Outputs from themotion estimator 116 are a motion vector and a field indication flag being provided to themotion compensator 118 and a variable length coding(VLC)circuit 108, wherein the motion vector denotes a displacement between said each current top or bottom field block and the optimum candidate field block and the field indication flag represents whether the optimum candidate field block belongs to the top search region or not. - The
motion compensator 118 performs a motion compensation by making the optimum candidate field block shift by the motion vector toward said each current top or bottom field block depending on the field indication flag, to thereby provide a motion-compensated optimal candidate field block as a predicted top or bottom field block for said each current top or bottom field block to thesubtractor 104 and anadder 112. - The
subtractor 104 obtains an error field block by subtracting the predicted top or bottom field block from said each current top or bottom field block on a corresponding pixel-by-pixel basis, to provide the error field block to atexture encoding circuit 106. - In the
texture encoding circuit 106, the error field block may be subjected to an orthogonal transform for removing spatial redundancy thereof and then transform coefficients are quantized, to thereby provide the quantized transform coefficients to theVLC circuit 108 and atexture reconstruction circuit 110. Since a conventional orthogonal transform such as a discrete cosine transform(DCT) is performed on a DCT block-by-DCT block basis, each DCT block having typically 8 x 8, i.e., M/2 x N/2, texture pixels, the error field block having 8 x 16 error texture pixels may be preferably divided into two DCT blocks in thetexture encoding circuit 106. If necessary, before performing the DCT, each error field block may be DCT-padded based on the shape information or the reconstructed shape information of each VOP in order to reduce higher frequency components which may be generated in the DCT processing. For example, a predetermined value, e.g., '0', may be assigned to the error texture pixels at the exterior of the contour in each VOP. - The
VLC circuit 108 performs a statistical encoding on the quantized transform coefficients fed from thetexture encoding circuit 106 and the field indication flag and the motion vector, for said each current top or bottom field block, fed from themotion estimator 116 by using, e.g., a conventional variable length coding technique, to thereby provide statistically encoded data to a transmitter(not shown) for the transmission thereof. - In the meantime, the
texture reconstruction circuit 110 performs an inverse quantization and inverse transform on the quantized transform coefficients to provide a reconstructed error field block, which corresponds to the error field block, to theadder 112. Theadder 112 combines the reconstructed error field block from thetexture reconstruction circuit 110 and the predicted top or bottom field block from themotion compensator 118 on a pixel-by-pixel basis, to thereby provide a combined result as a reconstructed top or bottom field block for said each current top or bottom field block to the previousframe processing circuit 114. - The previous
frame processing circuit 114 sequentially modifies the reconstructed top or bottom field block based on the shape information or the reconstructed shape information for the current VOP, to thereby provide all the modified top and bottom field blocks as another previous interlaced texture information for a subsequent current VOP to themotion estimator 116 and themotion compensator 118. - Referring to
Fig. 2 , there is a flow chart illustrating an important aspect of the invention related to the operation of the previousframe processing circuit 114 shown inFig. 1 , i.e., explaining a padding procedure for texture information on a previous frame on a macroblock-by-macroblock basis. - At step S201, the reconstructed top or bottom field block for the current top or bottom field block is sequentially received and, at step S203, exterior pixels in the reconstructed top or bottom field block are removed based on the shape information of the current VOP, wherein the exterior pixels are located at the outside of the contour for the current VOP. The reconstructed shape information may be used on behalf of the shape information, wherein the shape information is encoded in accordance with an encoding scheme to generate the encoded shape information and the encoded shape information is reconstructed as the reconstructed shape information by being decoded in the reverse order along the encoding scheme. While the exterior pixels are removed to be set as transparent pixels, i.e., undefined texture pixels, the remaining interior pixels in the reconstructed top or bottom field block are provided as defined texture pixels on a field block-by-field block basis.
- At step S204, each reconstructed block is determined whether or not being located on the contour of the current VOP, wherein said each reconstructed block has the reconstructed top field block and the corresponding reconstructed bottom field block. In other words, said each reconstructed block is determined as an interior block, a boundary block, or an exterior block, wherein the interior block has only the defined texture pixels, the exterior block has only the undefined texture pixels and the boundary block has both the defined texture pixels and the undefined texture pixels. If the reconstructed block is determined as an interior block, at step S210, no padding is performed and the process goes to step S211.
- If the reconstructed block is a boundary block as shown in
Fig. 3A , at steps S221 to S224, the undefined texture pixels of the boundary block are extrapolated from the defined texture pixels thereof to generate an extrapolated boundary block. First, at step S221, each boundary block is divided into a top and a bottom boundary field blocks as shown inFig. 3B , each boundary field block having M/2 x N texture pixels. At step S222, the undefined texture pixels are padded on a row-by-row basis by using a horizontal repetitive padding technique as shown inFig. 3C to generate a padded row for each row. In other words, the undefined texture pixels are filled by repeating boundary pixels toward the arrows as shown inFig. 3C , wherein each boundary pixel among the defined texture pixels is located on the contour, i.e., the border, of the current VOP. If any undefined texture pixel may be filled by the repetition of more than one boundary pixel, the average value of the repeated values is used. - If there exist one or more transparent rows on each top or bottom field block, at step S223, each transparent row is padded by using one or more nearest defined or padded rows among the corresponding top or bottom field block, wherein the defined row has all the defined texture pixels therein. For example, as shown in
Fig. 3D , each undefined texture pixel of the transparent row shown in the bottom field block is replaced with an average of two defined or padded texture pixels based on a nearest upward and a nearest downward padded rows, i.e., the 2nd and the 4th padded rows in the bottom field block. If the transparent row is located at the highest or the lowest row, i.e., corresponds to the1st row 1 or the 8th row, said each texture pixel is replaced with a defined or padded texture pixel of the nearest padded or defined row. - If there exists only one transparent boundary field block of the two boundary field blocks as shown in
Fig. 3B , at step S224, the transparent boundary field block is padded based on another boundary field block of the boundary block, wherein the transparent boundary field block, i.e., an undefined field block having no defined texture pixel therein. In other words, if a top field block is transparent, all the undefined texture pixels of the transparent boundary field block, i.e., the top field block, may be replaced with a constant value P as shown inFig. 3E , e.g., a mean value of the defined texture pixels within the bottom field block. The mean value of both the defined and the padded pixels within the bottom field block can also be used to fill the transparent field block. If necessary, amiddle value 2L-1 of all the possible values for any texture pixel may be used based on the channel characteristics, wherein L is the number of bits assigned for each pixel. For example, if L is equal to 8, there are 256 texture pixels 0 to 255 and the middle value is determined to be 128. - To cope with a VOP of fast motion, the padding must be further extended to blocks which stretch outside the VOP but are immediately next to any boundary block. If the reconstructed block is determined as the exterior block at step S204, at step S207, it is determined whether the exterior block is adjacent to any extrapolated boundary block. If the exterior block is adjacent to no extrapolated boundary block, at step 209, no padding is performed and the process goes to step S211.
- If the exterior block is adjacent to one or more extrapolated boundary blocks so that the exterior block corresponds to an undefined adjacent block, at step S208, the undefined texture pixels in the undefined adjacent block are padded based on one of the extrapolated boundary blocks to generate an extrapolated adjacent block for the undefined adjacent block, wherein each extrapolated boundary block has a part of the contour A or B of the current VOP and each undefined adjacent block is shown as a shaded region as shown in
Fig. 4 . If a plurality of extrapolated boundary blocks surround the undefined adjacent block, an extrapolated boundary block is selected in priority sequence of the leftward, upward, rightward and downward based on the undefined adjacent block and then a vertical or a horizontal border of the selected extrapolated boundary block is repeated rightwards, downwards, leftwards or upwards, wherein the vertical or the horizontal border adjoins the undefined adjacent block . As shown inFig. 4 , the undefined adjacent blocks JB4, JB20, JB9 and JB2 select their respective leftward, upward, rightward and downward extrapolated boundary blocks a2, a10, a3 and a1, respectively; and a rightmost vertical border of the extrapolated boundary block a2 is expanded rightward to fill the undefined adjacent block JB4, a lowermost horizontal border of the extrapolated boundary block a10 is expanded downward to fill the undefined adjacent block JB20 and so on. Also, undefined diagonal blocks such as M1 and M2 may be padded with a constant value, e.g., '128' to be the extrapolated adjacent block for the undefined diagonal block, wherein each undefined diagonal block is diagonally adjacent to the extrapolated boundary block and has all undefined texture pixels. - As described above, at step S211, the modified top and bottom field blocks, i.e, the extrapolated boundary and the extrapolated adjacent blocks as well as the interior blocks are provided as another previous interlaced texture information for the subsequent current VOP.
Claims (8)
- A method for encoding interlaced texture information on a texture macroblock basis using a field block prediction between a current VOP and a reference VOP, wherein the texture macroblock of the current VOP has MxN defined or undefined texture pixels, M and N being positive integers, respectively, the method comprising:providing top field block or bottom field block of the texture macroblock of the current VOP;determining a motion vector and a predicted top or bottom field block for each current top or bottom field block on a field-by-field basis, wherein the motion vector denotes a displacement between each current top or bottom field block and the predicted top or bottom field block of the reference VOP;obtaining an error field block by subtracting the predicted top or bottom field block from each current top or bottom field block on a corresponding pixel-by-pixel basis;discrete-cosine-transforming the error field block on a DCT block-by-DCT block basis;quantizing the DCT coefficients; andperforming a statistical encoding on the quantized DCT coefficients and motion vector, for each top or bottom field block,wherein the reference VOP is obtained by padding the previous reconstructed texture information based on shape information,wherein when the previous reconstructed texture information is a boundary macroblock of interlaced VOP, (i) the undefined texture pixel in a row of the macroblock of interlaced VOP is padded based an one or more of the defined texture pixels in said row, (ii) the undefined texture pixels in a row having only the undefined texture pixels are padded based on one or more of the defined texture pixels in one or more rows having at least one defined texture pixel in same field block, and (iii) the field block having only the undefined texture pixels is padded with a constant value.
- The method of claim 1, wherein the constant value is 2L-1, wherein L is a number of bits assigned for each pixel.
- The method of claim 1, wherein the constant value is 128.
- The method of claim 1, further including:performing an inverse quantization and inverse transform on the quantized DCT coefficients to obtain a reconstructed error field block;combining the reconstructed error field block and the predicted top or bottom field block on a pixel-by-pixel basis.
- The method of claim 1, wherein the padding includes:padding a reconstructed top or bottom field block based on shape information for the current VOP, to thereby store the padded top or bottom field blocks as reference interlaced texture information, wherein the step of padding a reconstructed top or bottom field block further includes the substeps of:padding the undefined texture pixel of the reconstructed boundary top or bottom field block based on one or more of the defined texture pixels in same field block,if the boundary top or bottom field block has only undefined texture pixels, padding the undefined texture pixels with middle value 2L-1 of all the possible values for any texture pixel, wherein L is the number of bits assigned for each pixel;expanding an undefined adjacent macroblock based on the padded boundary macroblock, wherein the undefined adjacent macroblock is adjacent to the padded boundary macroblock and has only undefined texture pixels.
- The method of claim 5, wherein the substep of padding the undefined texture pixel of the reconstructed boundary top or bottom field block includes the steps of;
row-padding at least one undefined texture pixel on a row-by-row basis to generate a padded row, and
padding, if there exist one or more transparent rows, the transparent row based on at least one nearest padded row, wherein the transparent row has only the undefined textures. - The method of claim 5, wherein the substep of expanding an undefined adjacent macroblock based on the padded boundary macroblock includes the steps of;
selecting, if said undefined adjacent block is surrounded by a plurality of padded boundary macroblocks, one of the left, the upper, the right and the below extrapolated boundary macroblocks of said undefined adjacent macroblock in this priority, and
replicating a vertical border or a horizontal border of the selected padded boundary macroblock rightwards, downwards, leftwards or upwards. - The method of claim 5, wherein middle value 2L-1 of all the possible values for any texture pixel is 128.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1019980008637A KR100285599B1 (en) | 1998-03-14 | 1998-03-14 | Device and method for texture padding for motion estimation in alternate line encoding |
EP19980921904 EP1076998B1 (en) | 1998-03-14 | 1998-05-15 | Method and apparatus for padding interlaced macroblock texture information |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19980921904 Division EP1076998B1 (en) | 1998-03-14 | 1998-05-15 | Method and apparatus for padding interlaced macroblock texture information |
EP98921904.3 Division | 1998-05-15 |
Publications (3)
Publication Number | Publication Date |
---|---|
EP1933567A2 EP1933567A2 (en) | 2008-06-18 |
EP1933567A3 EP1933567A3 (en) | 2010-08-11 |
EP1933567B1 true EP1933567B1 (en) | 2012-01-11 |
Family
ID=19534803
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP20080004285 Expired - Lifetime EP1933567B1 (en) | 1998-03-14 | 1998-05-15 | Apparatus for encoding interlaced macroblock texture information |
EP20080004286 Expired - Lifetime EP1940177B1 (en) | 1998-03-14 | 1998-05-15 | Apparatus for encoding interlaced macroblock texture information |
EP19980921904 Expired - Lifetime EP1076998B1 (en) | 1998-03-14 | 1998-05-15 | Method and apparatus for padding interlaced macroblock texture information |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP20080004286 Expired - Lifetime EP1940177B1 (en) | 1998-03-14 | 1998-05-15 | Apparatus for encoding interlaced macroblock texture information |
EP19980921904 Expired - Lifetime EP1076998B1 (en) | 1998-03-14 | 1998-05-15 | Method and apparatus for padding interlaced macroblock texture information |
Country Status (8)
Country | Link |
---|---|
US (7) | US6259732B1 (en) |
EP (3) | EP1933567B1 (en) |
JP (1) | JPH11298901A (en) |
KR (1) | KR100285599B1 (en) |
CN (1) | CN1159915C (en) |
AU (2) | AU762187B2 (en) |
ES (3) | ES2380501T3 (en) |
WO (1) | WO1999048298A1 (en) |
Families Citing this family (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1216199A (en) * | 1997-01-30 | 1999-05-05 | 松下电器产业株式会社 | Digital image replenishment method, image processing device and data recording medium |
US6952501B2 (en) * | 2000-02-24 | 2005-10-04 | Canon Kabushiki Kaisha | Image processing apparatus, image encoding apparatus, and image decoding apparatus |
US6718066B1 (en) * | 2000-08-14 | 2004-04-06 | The Hong Kong University Of Science And Technology | Method and apparatus for coding an image object of arbitrary shape |
US7197070B1 (en) * | 2001-06-04 | 2007-03-27 | Cisco Technology, Inc. | Efficient systems and methods for transmitting compressed video data having different resolutions |
CN101448162B (en) * | 2001-12-17 | 2013-01-02 | 微软公司 | Method for processing video image |
US8265163B2 (en) * | 2001-12-21 | 2012-09-11 | Motorola Mobility Llc | Video shape padding method |
US7362374B2 (en) * | 2002-08-30 | 2008-04-22 | Altera Corporation | Video interlacing using object motion estimation |
US10554985B2 (en) | 2003-07-18 | 2020-02-04 | Microsoft Technology Licensing, Llc | DC coefficient signaling at small quantization step sizes |
US7860326B2 (en) * | 2003-09-22 | 2010-12-28 | Kddi Corporation | Adaptable shape image encoding apparatus and decoding apparatus |
US7480335B2 (en) * | 2004-05-21 | 2009-01-20 | Broadcom Corporation | Video decoder for decoding macroblock adaptive field/frame coded video data with spatial prediction |
KR100688383B1 (en) * | 2004-08-13 | 2007-03-02 | 경희대학교 산학협력단 | Motion estimation and compensation for panorama image |
US7623682B2 (en) * | 2004-08-13 | 2009-11-24 | Samsung Electronics Co., Ltd. | Method and device for motion estimation and compensation for panorama image |
CN101189880B (en) * | 2005-06-03 | 2010-06-16 | Nxp股份有限公司 | Video decoder with hybrid reference texture |
CN100466746C (en) * | 2005-07-21 | 2009-03-04 | 海信集团有限公司 | Method for information selecting and dividing based on micro block inner edge |
KR101536732B1 (en) | 2008-11-05 | 2015-07-23 | 삼성전자주식회사 | Device and method of reading texture data for texture mapping |
US9787966B2 (en) * | 2012-09-04 | 2017-10-10 | Industrial Technology Research Institute | Methods and devices for coding interlaced depth data for three-dimensional video content |
US9544612B2 (en) * | 2012-10-04 | 2017-01-10 | Intel Corporation | Prediction parameter inheritance for 3D video coding |
JP6095955B2 (en) * | 2012-11-16 | 2017-03-15 | ルネサスエレクトロニクス株式会社 | Measuring method, measuring apparatus and measuring program |
US10249029B2 (en) | 2013-07-30 | 2019-04-02 | Apple Inc. | Reconstruction of missing regions of images |
US10104397B2 (en) * | 2014-05-28 | 2018-10-16 | Mediatek Inc. | Video processing apparatus for storing partial reconstructed pixel data in storage device for use in intra prediction and related video processing method |
US10142613B2 (en) * | 2015-09-03 | 2018-11-27 | Kabushiki Kaisha Toshiba | Image processing apparatus, image processing system, and image processing method |
FI20165256L (en) * | 2016-03-24 | 2017-09-25 | Nokia Technologies Oy | An apparatus, a method and a computer program for video coding and decoding |
KR20240051314A (en) * | 2016-10-04 | 2024-04-19 | 주식회사 비원영상기술연구소 | Image data encoding/decoding method and apparatus |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW241416B (en) | 1992-06-29 | 1995-02-21 | Sony Co Ltd | |
KR0181052B1 (en) * | 1995-03-31 | 1999-05-01 | 배순훈 | Segmentation apparatus for high definition image system |
KR100488422B1 (en) * | 1996-09-24 | 2005-09-02 | 주식회사 팬택앤큐리텔 | Grayscale-shaped information encoding / decoding device and method |
US5987184A (en) * | 1996-09-30 | 1999-11-16 | Kweon; Ji-Heon | Device for coding/decoding image information |
US6055330A (en) * | 1996-10-09 | 2000-04-25 | The Trustees Of Columbia University In The City Of New York | Methods and apparatus for performing digital image and video segmentation and compression using 3-D depth information |
US6005980A (en) * | 1997-03-07 | 1999-12-21 | General Instrument Corporation | Motion estimation and compensation of video object planes for interlaced digital video |
US5929915A (en) * | 1997-12-02 | 1999-07-27 | Daewoo Electronics Co., Ltd. | Interlaced binary shape coding method and apparatus |
JPH11308610A (en) * | 1998-04-02 | 1999-11-05 | Daewoo Electronics Co Ltd | Video signal adaptive coder |
-
1998
- 1998-03-14 KR KR1019980008637A patent/KR100285599B1/en active IP Right Grant
- 1998-05-15 WO PCT/KR1998/000122 patent/WO1999048298A1/en active IP Right Grant
- 1998-05-15 ES ES08004285T patent/ES2380501T3/en not_active Expired - Lifetime
- 1998-05-15 EP EP20080004285 patent/EP1933567B1/en not_active Expired - Lifetime
- 1998-05-15 ES ES98921904T patent/ES2380590T3/en not_active Expired - Lifetime
- 1998-05-15 EP EP20080004286 patent/EP1940177B1/en not_active Expired - Lifetime
- 1998-05-15 AU AU74562/98A patent/AU762187B2/en not_active Expired
- 1998-05-15 ES ES08004286T patent/ES2380502T3/en not_active Expired - Lifetime
- 1998-05-15 EP EP19980921904 patent/EP1076998B1/en not_active Expired - Lifetime
- 1998-06-02 US US09/088,375 patent/US6259732B1/en not_active Ceased
- 1998-06-08 CN CNB981023681A patent/CN1159915C/en not_active Expired - Lifetime
- 1998-06-10 JP JP16235598A patent/JPH11298901A/en active Pending
-
2003
- 2003-09-10 AU AU2003244627A patent/AU2003244627B2/en not_active Expired
-
2008
- 2008-06-02 US US12/131,712 patent/USRE41383E1/en not_active Expired - Lifetime
- 2008-06-02 US US12/131,723 patent/USRE41951E1/en not_active Expired - Lifetime
-
2010
- 2010-06-20 US US12/819,207 patent/USRE43060E1/en not_active Expired - Lifetime
- 2010-06-20 US US12/819,210 patent/USRE43130E1/en not_active Expired - Lifetime
- 2010-06-20 US US12/819,208 patent/USRE43061E1/en not_active Expired - Lifetime
- 2010-06-20 US US12/819,209 patent/USRE43129E1/en not_active Expired - Lifetime
Also Published As
Publication number | Publication date |
---|---|
CN1229323A (en) | 1999-09-22 |
WO1999048298A1 (en) | 1999-09-23 |
EP1076998B1 (en) | 2012-01-11 |
USRE43130E1 (en) | 2012-01-24 |
AU7456298A (en) | 1999-10-11 |
USRE41951E1 (en) | 2010-11-23 |
USRE41383E1 (en) | 2010-06-22 |
EP1933567A3 (en) | 2010-08-11 |
EP1933567A2 (en) | 2008-06-18 |
USRE43129E1 (en) | 2012-01-24 |
EP1940177A3 (en) | 2010-08-11 |
ES2380590T3 (en) | 2012-05-16 |
EP1940177B1 (en) | 2012-01-11 |
CN1159915C (en) | 2004-07-28 |
EP1940177A2 (en) | 2008-07-02 |
KR100285599B1 (en) | 2001-04-02 |
AU762187B2 (en) | 2003-06-19 |
AU2003244627A1 (en) | 2003-10-09 |
USRE43061E1 (en) | 2012-01-03 |
USRE43060E1 (en) | 2012-01-03 |
JPH11298901A (en) | 1999-10-29 |
US6259732B1 (en) | 2001-07-10 |
ES2380502T3 (en) | 2012-05-14 |
AU2003244627B2 (en) | 2005-07-14 |
KR19990074806A (en) | 1999-10-05 |
EP1076998A1 (en) | 2001-02-21 |
ES2380501T3 (en) | 2012-05-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
USRE41383E1 (en) | Method and apparatus for encoding interplaced macroblock texture information | |
US5973743A (en) | Mode coding method and apparatus for use in an interlaced shape coder | |
US6404814B1 (en) | Transcoding method and transcoder for transcoding a predictively-coded object-based picture signal to a predictively-coded block-based picture signal | |
US6094225A (en) | Method and apparatus for encoding mode signals for use in a binary shape coder | |
EP1528813B1 (en) | Improved video coding using adaptive coding of block parameters for coded/uncoded blocks | |
JP4357506B2 (en) | Chrominance shape information generator | |
US5978048A (en) | Method and apparatus for encoding a motion vector based on the number of valid reference motion vectors | |
JPH09224254A (en) | Device and method for estimating motion | |
KR100238622B1 (en) | A motion video compression system with novel adaptive quantisation | |
US6133955A (en) | Method for encoding a binary shape signal | |
US6049567A (en) | Mode coding method in a binary shape encoding | |
US5978031A (en) | Method and apparatus for determining an optimum grid for use in a block-based video signal coding system | |
US7426311B1 (en) | Object-based coding and decoding apparatuses and methods for image signals | |
EP0923250A1 (en) | Method and apparatus for adaptively encoding a binary shape signal | |
GB2341030A (en) | Video motion estimation | |
MXPA00008676A (en) | Method and apparatus for padding interlaced macroblock texture information |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AC | Divisional application: reference to earlier application |
Ref document number: 1076998 Country of ref document: EP Kind code of ref document: P |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): CH DE ES FR GB IT LI NL SE |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: LEE, SANG HOON |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): CH DE ES FR GB IT LI NL SE |
|
17P | Request for examination filed |
Effective date: 20100902 |
|
AKX | Designation fees paid |
Designated state(s): CH DE ES FR GB IT LI NL SE |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAC | Information related to communication of intention to grant a patent modified |
Free format text: ORIGINAL CODE: EPIDOSCIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04N 7/26 20060101AFI20110622BHEP |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AC | Divisional application: reference to earlier application |
Ref document number: 1076998 Country of ref document: EP Kind code of ref document: P |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): CH DE ES FR GB IT LI NL SE |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: CH Ref legal event code: NV Representative=s name: E. BLUM & CO. AG PATENT- UND MARKENANWAELTE VSP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 69842567 Country of ref document: DE Effective date: 20120308 |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: TRGR |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: T3 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2380501 Country of ref document: ES Kind code of ref document: T3 Effective date: 20120514 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20121012 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 69842567 Country of ref document: DE Effective date: 20121012 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 69842567 Country of ref document: DE Representative=s name: SAMSON & PARTNER, PATENTANWAELTE, DE |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20130418 AND 20130424 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 69842567 Country of ref document: DE Representative=s name: SAMSON & PARTNER, PATENTANWAELTE, DE Effective date: 20130424 Ref country code: DE Ref legal event code: R081 Ref document number: 69842567 Country of ref document: DE Owner name: ZTE CORPORATION, CN Free format text: FORMER OWNER: DAEWOO ELECTRONICS CORP., SEOUL/SOUL, KR Effective date: 20130424 Ref country code: DE Ref legal event code: R082 Ref document number: 69842567 Country of ref document: DE Representative=s name: SAMSON & PARTNER PATENTANWAELTE MBB, DE Effective date: 20130424 Ref country code: DE Ref legal event code: R081 Ref document number: 69842567 Country of ref document: DE Owner name: ZTE CORPORATION, SHENZHEN, CN Free format text: FORMER OWNER: DAEWOO ELECTRONICS CORP., SEOUL/SOUL, KR Effective date: 20130424 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: PC2A Owner name: ZTE CORPORATION Effective date: 20130624 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: SD Effective date: 20130808 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: TP Owner name: ZTE CORPORATION, CN Effective date: 20130923 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 19 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 20 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20170524 Year of fee payment: 20 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20170531 Year of fee payment: 20 Ref country code: FR Payment date: 20170526 Year of fee payment: 20 Ref country code: DE Payment date: 20170530 Year of fee payment: 20 Ref country code: CH Payment date: 20170529 Year of fee payment: 20 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20170524 Year of fee payment: 20 Ref country code: ES Payment date: 20170615 Year of fee payment: 20 Ref country code: SE Payment date: 20170526 Year of fee payment: 20 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R071 Ref document number: 69842567 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MK Effective date: 20180514 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: PE20 Expiry date: 20180514 |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: EUG |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION Effective date: 20180514 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20200724 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION Effective date: 20180516 |