US9270996B2 - Method and apparatus for generating encoded motion information/recovering motion information using motion information integration, and image encoding/decoding method and apparatus using same - Google Patents
Method and apparatus for generating encoded motion information/recovering motion information using motion information integration, and image encoding/decoding method and apparatus using same Download PDFInfo
- Publication number
- US9270996B2 US9270996B2 US13/914,910 US201313914910A US9270996B2 US 9270996 B2 US9270996 B2 US 9270996B2 US 201313914910 A US201313914910 A US 201313914910A US 9270996 B2 US9270996 B2 US 9270996B2
- Authority
- US
- United States
- Prior art keywords
- motion information
- current block
- block
- motion vector
- merge
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H04N19/00793—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/517—Processing of motion vectors by encoding
- H04N19/52—Processing of motion vectors by encoding by predictive encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
- H04N19/615—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding using motion compensated temporal filtering [MCTF]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
Definitions
- the present disclosure relates to a method for generating coded motion information before reconstructing by using motion information merge, and video encoding apparatus and a video decoding apparatus for encoding and decoding images by using the same.
- the determination as to whether the motion vectors are similar may be made by determining whether distances between the motion vectors of the neighboring blocks included in the group of merge-decision blocks are smaller than predetermined threshold value information.
- the distance between the motion vectors may use a two-dimensional Euclidean distance or a city-block distance.
- the determination as to whether the pieces of the motion information are similar to one another may be made by using a part of information among the pieces of the motion information, for example, by using only the motion vector.
- the determination as to whether the pieces of the motion information are similar to one another may be made by additionally determining whether the reference frames of the motion information are equal to one another. That is, when the reference frames as well as the motion vectors are equal to one another, it can be determined that the pieces of the motion information are similar to one another.
Abstract
A video encoding apparatus, a video decoding apparatus and a method for generating coded motion information before reconstructing by using motion information merge, the video encoding apparatus includes an inter prediction unit configured to generate a prediction block of a current block by using motion compensation, decide whether to encode motion information by merging and generate coded motion information of the current block depending on the decision; a subtraction unit configured to generate a residual block by subtracting the prediction block generated from the current block; a transform and quantization unit configured to transform and quantize the residual block to thereby generate a quantized frequency residual block; and an encoding unit configured to encode the quantized frequency residual block and the coded motion information to thereby generate a bitstream.
Description
The present application is a continuation of International Patent Application No. PCT/KR2011/009673, filed Dec. 15, 2011, which is based on and claims priority to Korean Patent Application No. 10-2010-0127985, filed on Dec. 15, 2010. The disclosures of the above-listed applications are hereby incorporated by reference herein in their entirety.
The present disclosure relates to a method for generating coded motion information before reconstructing by using motion information merge, and video encoding apparatus and a video decoding apparatus for encoding and decoding images by using the same.
The statements in this section merely provide background information related to the present disclosure and may not constitute prior art.
Moving Picture Experts Group (MPEG) and Video Coding Experts Group (VCEG) have developed H.264 AVC (Advanced Video Coding), the video compression standard superior to the existing MPEG-4 Part 2 and H.263 standards, and have developed HEVC (High Efficiency Video Coding) in earnest since 2010. In a similar manner to the existing video compression technology, Test Model under Consideration (TMuC) divides an image into blocks and performs entropy encoding by frequency-transforming and quantizing a residual block by motion estimation or intra prediction. The TMuC of the HEVC performs motion estimation by using multiple reference frames, encodes reference frame indexes and motion vectors as motion information, and outputs a bitstream.
The TMuC of the HEVC efficiently encodes motion information by using a merging method. A known merging method generates a set of motion information candidates composed of N pieces of merge direction motion information from decoded adjacent image blocks so as to encode motion information of a current block. When identical motion information with the current motion information exists in the motion information candidate set, merge flag information is designated as “unmerged”. On the other hand, when the identical motion information with the current motion information exists in the motion information candidate set, merge flag information is designated as “merged”, and merge direction information is designated to represent the identical motion information in the motion information candidate set.
Even though the merge flag information is “merged”, the merge direction information is not designated when all pieces of motion information of the motion information candidate set are equal to one another. The merge flag information is output to a bitstream, and current motion information is output to the bitstream when the merge flag is “unmerged”. That is, when the merge flag is “merged” and all pieces of the motion information of the motion information candidate set are equal to one another, the merge direction information is not output to the bitstream. Otherwise, the merge direction information is output to the bitstream. Specifically, the TMuC of the HEVC configures the motion information candidate set as motion information of a block including a sample located just above the leftmost upper sample of the current block and motion information of a block including a sample located on the immediate left side. The inventor(s), however, has experienced that the motion information merge by the above-described method encodes the merge flag with respect to all cases so that efficient encoding becomes difficult.
The inventor(s), therefore, has noted that there is a need for a video encoding and decoding method that can efficiently encode and decode the motion information by deciding whether to encode the motion information by merging, based on pre-encoded information, when performing encoding by merging the motion information.
In accordance with some embodiments, a video encoding apparatus comprises an inter prediction unit, a subtraction unit, a transform and quantization unit, a transform and quantization unit, and an encoding unit. The inter prediction unit is configured to generate a prediction block of a current block by using motion compensation, decide whether to encode motion information by merging, and generate coded motion information of the current block depending on the decision. The subtraction unit is configured to generate residual block by subtracting the prediction block from the current block. The transform and quantization unit is configured to frequency-transform and quantize the residual block so as to generate a quantized frequency residual block. And the encoding unit is configured to encode the quantized frequency residual block and the coded motion information to thereby generate a bitstream.
In accordance with some embodiments, a video decoding apparatus comprises a decoding unit, a dequantization and inverse transform unit, an inter prediction unit, and an addition unit. The decoding unit is configured to receive encoded data, extract coded motion information and a quantization coefficient string, and reconstruct a quantized frequency residual block. The dequantization and inverse transform unit is configured to dequantize and inversely transform the quantized frequency residual block to reconstruct the residual block. The inter prediction unit is configured to decide whether to reconstruct motion information by merging, reconstruct motion information of a current block from the coded motion information according to the decision, and generate a prediction block of the current block by using the reconstructed motion information. And the addition unit is configured to add the prediction block to the reconstructed residual block so as to reconstruct the current block.
In accordance with some embodiments, for performing a video decoding method the video decoding apparatus is configured to perform a reconstruction including: receiving encoded data, extracting coded motion information and quantization coefficient string, and reconstructing a quantized frequency residual block; dequantize and inversely transform the quantized frequency residual block to reconstruct a residual block; perform an inter prediction including: deciding whether to reconstruct motion information by merging, reconstructing motion information of a current block from the coded motion information according to the decision, and generating a prediction block of the current block by using reconstructed motion information; and add the prediction block to a reconstructed residual block to reconstruct the current block.
The present disclosure improves video compression efficiency by deciding whether to encode motion information by merge, based on pre-encoded information, when encoding by merging the motion information, thereby reducing the encoding of a merge-related flag and efficiently encoding the motion information.
Hereinafter, a video encoding apparatus and a video decoding apparatus described below may be user terminals such as a personal computer (PC), a notebook computer, personal digital assistant (PDA), portable multimedia player (PMP), PlayStation Portable (PSP), wireless communication terminal, smart phone, TV and the like, or server terminals such as an application server, service server and the like, and may refer to various apparatuses including a communication apparatus such as a communication modem and the like for performing communication with various types of devices or a wired/wireless communication network, memory for storing various types of programs and data for encoding or decoding a video, or performing an inter or intra prediction for the encoding or decoding, and a microprocessor and the like for executing the program to perform an operation and control.
Further, a video encoded into a bitstream (encoded data) by the video encoding apparatus may be transmitted in real time or non-real-time to the video decoding apparatus through wired/wireless communication networks such as the Internet, wireless personal area network (WPAN), wireless local area network (WLAN), WiBro (wireless broadband, aka WiMax) network, mobile communication network and the like or through various communication interfaces such as a cable, a universal serial bus (USB) and the like, and thus decoded in the video decoding apparatus and reconstructed and reproduced as the video.
A video typically may include a series of pictures each of which is divided into predetermined areas, such as frames or blocks. When the area of the video is partitioned into blocks, the partitioned blocks may be classified into an intra block or an inter block depending on an encoding method. The intra block means a block that is encoded through an intra prediction coding method which generates a predicted block by predicting a pixel of a current block using pixels of a reconstructed block that underwent previous encoding and decoding and then encodes a differential value between the predicted block and the pixel of the current block within a current picture where the current encoding is performed. The inter block means a block that is encoded through an inter prediction encoding which generates the predicted block by predicting the current block in the current picture through referencing one or more past pictures or future pictures and then encoding the differential value of the predicted block from the current block. Here, the picture that is referenced in encoding or decoding the current picture is called a reference picture.
The video encoding apparatus 100 according to one or more embodiments of the present disclosure may include an intra prediction unit 110, an inter prediction unit 120, a subtraction unit 130, a transform and quantization unit 140, an encoding unit 150, an inverse quantization/inverse transform unit 160, an addition unit 170, and a frame memory 180. Other components of the video encoding apparatus 100, such as the intra prediction unit 110, the inter prediction unit 120, the transform and quantization unit 140, the encoding unit 150, and the inverse quantization/inverse transform unit 160 are implemented by one or more processors and/or application-specific integrated circuits (ASICs).
An input image to be encoded is input on the basis of coding block unit. In the present disclosure, the coding block has an M×N form, where M and N may be equal to or different from each other. In addition, the coding block may be divided into variously sized prediction unit blocks.
The intra prediction unit 110 generates a prediction block by using one or more adjacent pixels so as to predict a current prediction unit block. That is, the intra prediction unit 110 generates a prediction block according to a mode of the intra prediction unit 110 by using one or more adjacent pixels of a current block previously reconstructed through an encoding process.
The inter prediction unit 120 generates a prediction block by using a reference frame so as to predict the current prediction unit block. That is, the inter prediction unit 120 generates motion information including a motion vector, a reference frame index, and a motion vector resolution through motion estimation according to the mode of the inter prediction unit 120 in a previous frame previously reconstructed through an encoding process, and generates a prediction block in a motion compensation process by using the motion information. In addition, the inter prediction unit 120 decides whether to encode the motion information by merging, based on pre-encoded information. When it is decided not to encode the motion information by merging, coded motion information including motion information is generated by using a known method. When it is decided to encode the motion information by merging, coded motion information including a merge flag and a merge direction flag, or a merge flag and motion information is generated by using a known merging method.
The inter prediction unit 120 may include a coded motion information generation unit (not shown), and the coded motion information generation unit may be implemented by an individual hardware or software module and may be configured with a coded motion information generating apparatus 200 as shown in FIG. 2 . The operation of the coded motion information generation unit will be described below in detail with reference to FIG. 2 .
The subtraction unit 130 generates a residual block by subtracting the prediction block from the current block. That is, the subtraction unit 130 generates a residual block by subtracting a pixel value of the prediction block generated by the intra prediction unit 110 or the inter prediction unit 120 from a pixel value of the current block.
The transform and quantization unit 140 generates a quantized frequency residual block in such a manner that it transforms the residual block generated by the subtraction unit 130 into a frequency coefficient, and quantizes the transformed residual block. That is, the transform and quantization unit 140 generates the residual block having a residual coefficient of the residual block generated by the subtraction unit 130 as the frequency coefficient, and quantizes the residual block of the frequency coefficient. As the transform method used herein, a method for transforming an image signal of a spatial domain, such as Hadamard Transform or Discrete Cosine Transform Based Integer Transform, may be used. As the quantization method, various quantization methods, including Dead Zone Uniform Threshold Quantization (hereinafter, referred to as “DZUTQ”) or Quantization Weighted Matrix, may be used.
The encoding unit 150 may generate encoded data (bitstream) by encoding the residual block transformed and quantized by the transform and quantization unit 140. As the encoding technique, an entropy encoding technique may be used. However, the present disclosure is not limited thereto, and various encoding techniques may also be used.
In addition, the encoding unit 150 may include not only a bitstream resulting from the encoding of quantization frequency coefficients but also various pieces of information necessary for decoding the encoded frequency coefficient bitstream in the encoded data. That is, the encoded data may include a first field including a bitstream where coded block pattern (CBP), delta quantization parameter, and quantization frequency coefficient are encoded, and a second field including a bit for information necessary for prediction (for example, intra prediction mode in the case of the intra prediction or motion information in the case of the inter prediction).
The dequantization and inverse transform unit 160 generates the residual block by dequantizing and inversely transforming the residual block transformed and quantized by the transform and quantization unit 140. The inverse quantization and inverse transform may be achieved by inversely performing the transform and quantization process of the transform and quantization unit 140. That is, the dequantization and inverse transform unit 160 may generate the residual block with the residual coefficients by dequantizing the quantized block transferred from the transform and quantization unit 140 and inversely transforming the dequantized frequency block.
The addition unit 170 generates a reconstructed block by adding the prediction block generated by the intra prediction unit 110 or the inter prediction unit 120 to the residual block generated by the dequantization and inverse transform unit 160.
The frame memory 180 stores the reconstructed block generated by the addition unit 170, and the stored reconstructed block is used as a reference block for generating the prediction block in the process of the intra prediction or the inter prediction.
Referring to FIG. 2 , the coded motion information generating apparatus 200 according to one or more embodiments of the present disclosure includes a merge decision unit 210, a merge motion information generator 220, and a non-merge motion information generator 230. The merge decision unit 210 decides whether to encode the motion information by merging, based on the pre-encoded information. In a case where the merge decision unit 210 decides to encode the motion information by merging, the merge motion information generator 220 generates the coded motion information by merging. In a case where the merge decision unit 210 decides not to encode the motion information by merging, the non-merge motion information generator 230 generates the coded motion information without merging. Other components of the coded motion information generating apparatus 200, such as the merge decision unit 210, the merge motion information generator 220 an the non-merge motion information generator 230 are implemented by one or more processors and/or application-specific integrated circuits (ASICs).
In FIG. 3 , Hn represents the current block, the motion information of which is to be encoded, Ln represents a left neighboring block including a left sample of the upper leftmost sample of the current block Hn, and Un represents an upper neighboring block including an upper sample of the leftmost sample of the current block Hn. ULn represents a left upper neighboring block including a sample located just above a left sample of the upper leftmost sample of the current block Hn, and URn represents a right upper neighboring block including a sample located on the right side just above the upper rightmost sample of the current block Hn.
The merge decision unit 210 decides whether to generate coded motion information of the current block to be encoded in the merge motion information generator 220, or whether to generate coded motion information of the current block to be encoded in the non-merge motion information generator 230, based on whether all pieces of motion information of the merge-decision blocks, composed of the motion information of the neighboring blocks, are similar to one another. When the merge decision unit 210 decides that there is almost no possibility of encoding the motion information by merging based on the pre-encoded information of the neighboring blocks and the motion information of the current block, the coded motion information generating apparatus 200 generates coded motion information to be encoded in the non-merge motion information generator 230, without passing through the merge motion information generator 220. Therefore, the encoding of the merge flag information is reduced to improve compression efficiency.
In an image, an area where motion is very complex is divided into small blocks, and it is highly likely that pieces of the motion information such as the motion vectors of neighboring blocks are not similar to one another. Under this condition, the motion information of the current block is not merged into the motion information of the neighboring blocks. In addition, in a case where the motion information of the current block is merged into Ln or Un before encoding, if the motion information of Ln is different from the motion information of Un, at least two pieces of information (merge flag and merge direction flag) may be encoded. The merge direction flag refers to information representing a direction of a block having identical motion information with motion information of Hn (i.e., Current block). For the information representing the direction, Ln may be allocated with 1 bit, such as “0”, and Un may be allocated with 1 bit, such as “1”.
The merge decision unit 210 may refer to a motion information set of a neighboring block set (for example, {Ln, Un, ULn, URn}) as merge-decision block's motion information for a current block (S410). The neighboring block set referred to by the merge decision unit 210 may be configured in various methods, for example, {Ln, Un}, {Ln, Un, ULn}, or {Ln, Un, URn}, and the present disclosure is not limited thereto. In addition, the merge decision unit 210 may decide whether to encode the motion information by merging, by additionally deciding whether the current block is sized larger than a predetermined size. That is, the merge decision unit 210 determines a condition as to whether the current block Hn is sized smaller than or equal to a predetermined size PXQ (for example, 4×4 or 8×8), or all pieces of the motion information of the neighboring block set {Ln, Un, ULn, URn} are similar to one another (S420). If not satisfying the condition, it is determined that the corresponding area is an area where the motions of the current block and/or the neighboring blocks are very complex, and thus, the coded motion information is generated without merging (S430). If the current block Hn is sized larger than the predetermined size PXQ (for example, 4×4 or 8×8) and all pieces of the motion information of the neighboring block set {Ln, Un, ULn, URn} included in the merge-decision blocks are similar to one another, the coded motion information is generated by merging (S440). It is determined that the motion information of the neighboring block encoded in the intra mode is different from the motion information of other neighboring blocks. The determination as to whether the merge-decision block's motion information items have similarity may be made by determining similarity or nonsimilarity between their motion vectors, which are contained in the motion information. In this case, the determination as to whether the motion vectors are similar may be made by determining whether distances between the motion vectors of the neighboring blocks included in the group of merge-decision blocks are smaller than predetermined threshold value information. At this time, the distance between the motion vectors may use a two-dimensional Euclidean distance or a city-block distance. In addition, the determination as to whether the pieces of the motion information are similar to one another may be made by using a part of information among the pieces of the motion information, for example, by using only the motion vector. In addition, the determination as to whether the pieces of the motion information are similar to one another may be made by additionally determining whether the reference frames of the motion information are equal to one another. That is, when the reference frames as well as the motion vectors are equal to one another, it can be determined that the pieces of the motion information are similar to one another.
The merge motion information generator 220 and the non-merge motion information generator 230 according to at least one embodiment of the present disclosure may follow the TMUC of HEVC of the Joint Collaborative Team for Video Coding Committee (JCT-VC).
According to the TMUC of HEVC, the merge motion information generator 220 may generate coded motion information including a merge flag and/or a merge direction flag, based on motion information of merge candidate blocks in which reference index information representing the reference frame and the motion information of the current block including the motion vector and the motion vector resolution are configured with pieces of motion information of pre-encoded adjacent image blocks.
For example, in a case where the merge candidate blocks are {Ln, Un}, the merge motion information generator 220 receives the motion information of the current block Hn and the merge candidate block set including {Ln, Un}, sets the merge flag information as “unmerged” when the motion information of the current block Hn is non-identical with any pieces of the motion information among the pieces of the motion information of the merge candidate blocks {Ln, Un}, and sets the merge flag information “merged” when the motion information of the current block Hn is identical with any one of the pieces of the motion information of the merge candidate blocks {Ln, Un}. When the merge flag represents “merged”, the merge direction flag is set to represent the block whose motion information is identical with the motion information of the current block among the pieces of the motion information of the merge candidate blocks {Ln, Un}, and generates the coded motion information including the merge flag and the merge direction flag. In addition, when a part of motion information set (i.e., a set of the pieces motion information) of the merge candidate blocks is non-identical with the motion information of the current block, the coded motion information generated by merging comprises a merge flag representing “merged” and a merge direction flag representing a direction of a block having identical motion information with the motion information of the current block among the merge candidate blocks. Even though the merge flag information is “merged”, when all pieces of the motion information of the merge candidate blocks {Ln, Un} are equal to one another, the merge direction flag is not included in the coded motion information. In addition, in a case where all pieces of the motion information among the motion information set of the merge candidate blocks are non-identical with the motion information of the current block, the coded motion information generated by merging includes the merge flag representing “unmerged” and the motion information of the current block. When the merge flag represents “unmerged”, the merge motion information generator 220 generates the motion information, including one or more of the reference index, the motion vector, and the motion vector resolution, together with the merge flag as the coded motion information. In this case, the motion information is generated as a differential motion vector by calculating the prediction motion vector from pre-encoded temporal/spatial adjacent motion vectors, and the coded motion information may be configured together with the merge flag.
In the same method as the above-described “unmerged” case, the non-merge motion information generator 230 may generate the coded motion information including the motion information, such as the reference index, the motion vector, and the motion vector resolution, without the merge flag.
As described above with reference to FIGS. 2 to 4 , if using the coded motion information generating apparatus 200, the encoding of the merge flag information is reduced according to the characteristic of the image when the encoding is performed by merging the motion information. Therefore, the motion information is efficiently encoded to thereby increase the coding efficiency and improve the compression efficiency.
The video decoding apparatus 500 according to at least one embodiment of the present disclosure may include a decoding unit 510, a dequantization and inverse transform unit 520, an intra prediction unit 530, an inter prediction unit 540, an addition unit 550, and a frame memory 560. Other components of the video decoding apparatus 500, such as the decoding unit 510, the dequantization and inverse transform unit 520, the intra prediction unit 530, and the inter prediction unit 540 are implemented by one or more processors and/or application-specific integrated circuits (ASICs).
The decoding unit 510 decodes the encoded data (bitstream) to extract data necessary for block decoding, such as the inter prediction mode, the coded motion information, the intra prediction mode, and texture. That is, the decoding unit 510 extracts the quantization frequency coefficient string by decoding the encoded data, inversely scans the quantization frequency coefficient string in various inverse scanning methods, such as inverse zigzag scanning, and generates the residual block having the quantization frequency coefficients. In this case, the decoding unit 510 may extract the residual block from the first field included in the encoded data, and decode the extracted residual block. The decoding unit 510 may extract information necessary for prediction, such as the intra prediction mode, the inter prediction mode, and the coded motion information, from the second field included in the encoded data. The decoding unit 510 may transfer the extracted information necessary for prediction to the intra prediction unit 530 or the inter prediction unit 540, so that the corresponding prediction unit can predict the current block in the same method as the corresponding prediction unit of the video encoding apparatus 100. The coded motion information to be decoded may include the motion information. In some cases, instead of the motion information, the merge flag and the merge direction flag may be included in the coded motion information, and the motion information and the merge flag may be included in the coded motion information.
The dequantization and inverse transform unit 520 generates the dequantized residual block by dequantizing the quantized residual block, and generates the residual block by inversely transforming the dequantized block.
The intra prediction unit 530 generates the prediction block of the current block by using the information necessary for intra prediction, which is transferred from the decoding unit 510.
The inter prediction unit 540 generates the prediction block of the current block by using the information necessary for inter prediction, which is transferred from the decoding unit 510. At this time, when the inter prediction unit 540 receives the coded motion information from the decoding unit 510 and all pieces of motion information of the merge-decision block composed of the motion information of the neighboring blocks are equal to one another, the motion information of the current block can be reconstructed from the motion information set of the merge candidate blocks composed of the motion information of the neighboring blocks or the motion information included in the coded motion information according to the merge flag included in the coded motion information, and the prediction block of the current block can be generated by using the reconstructed motion information. In addition, in a case where all pieces of motion information of the merge-decision block composed of the motion information of the neighboring blocks are not similar to one another, the inter prediction unit 540 can reconstruct the motion information of the current block by using the motion information included in the coded motion information, and generate the prediction block of the current block by using the reconstructed motion information. The inter prediction unit 540 may include a motion information reconstructing unit (not shown). The motion information reconstructing unit may be implemented by an individual hardware or software mode and may be configured with a motion information reconstructing apparatus 600 as shown in FIG. 6 . The operation of the motion information reconstructing apparatus 600 will be described in detail with reference to FIG. 6 .
The addition unit 550 reconstructs the current block by adding the prediction block to the residual block. The current block reconstructed by the addition unit 550 may be transferred to the frame memory 560, and may be used to predict other blocks in the prediction unit.
The frame memory 560 stores the reconstructed image and enables the generation of intra and inter prediction blocks.
The inter prediction unit 530 may include a motion information reconstructing unit that receives the coded motion information from the decoding unit 510, decodes (or reconstructs) the motion information, and generates the prediction block by using the decoded motion information. The motion information reconstructing unit may be implemented by an individual hardware or software module and may be configured with the motion information reconstructing apparatus 600 as shown in FIG. 6 .
The motion information reconstructing apparatus 600 according to one or more embodiments of the present disclosure includes a merge decision unit 610, a merge motion information decoder 620, and a non-merge motion information decoder 630. Other components of the motion information reconstructing apparatus 600 such as the merge decision unit 610, the merge motion information decoder 620, and the non-merge motion information decoder 630 are implemented by one or more processors and/or application-specific integrated circuits (ASICs). In the identical or similar manner to that used in the video encoding apparatus 100, the merge decision unit 610 decides whether to reconstruct (or decode the motion information by merging according to whether all pieces of motion information of the merge-decision blocks composed of the motion information of the neighboring blocks are similar to one another. In a case where the merge decision unit 610 decides to reconstruct (or decode) the motion information by merging, the merge motion information decoder 620 receives the merge flag included in the coded motion information, and sets one of the pieces of the motion information of the merge candidate blocks as the motion information of the current block when the merge flag represents “merged” and all pieces of the motion information of the merge candidate blocks are equal to one another. When all of the pieces of the motion information of the merge candidate blocks are not equal to one another (that is, when some parts of the pieces of the motion information of the merge candidate blocks are equal to one another), the merge motion information decoder 620 receives the merge direction flag, and sets the motion information of the corresponding block among the merge candidate blocks represented by the merge direction flag as the motion information of the current block. When the merge flag represents “unmerged”, the merge motion information decoder 620 receives the motion information included in the coded motion information, and sets the received motion information as the motion information of the current block. In a case where the merge decision unit 610 decides not to reconstruct (or decode) the motion information by merging, the non-merge motion information decoder 630 extracts the motion information of the current block from the coded motion information extracted by the decoding unit 510.
The merge motion information decoder 620 generates the merge candidate set, generates one of the motion information set of the merge candidate blocks as the motion information of the current block to be decoded (or reconstructed), when the merge flag included in the coded motion information represents “merged” and all pieces of the motion information are identical with one another among the motion information sets of the merge candidate blocks composed of the motion information of the merge candidate blocks, and generate the motion information of the neighboring block represented by the merge direction flag as the motion information of the current block among the merge candidate blocks sets by using the merge direction flag included in the coded motion information. In addition, when the merge flag included in the coded motion information represents “unmerged”, the merge motion information decoder 620 extracts the motion information of the current block from the motion information included in the coded motion information.
When the merge decision unit 610 decides to directly reconstruct (or decode) the motion information without merging, the non-merge motion information decoder 630 receives the motion information included in the decoded coded-motion information, such as the reference index, the motion vector, and the motion vector resolution, and sets the received motion information as the motion information of the current block.
As shown in FIG. 7 , the merge decision unit 610 may refer to motion information of a neighboring block set {Ln, Un, ULn, URn} as a set of motion information of merge-decision blocks for a current block (S710). The neighboring blocks constituting the merge-decision block set may be different from the neighboring blocks constituting the merge candidate block set used for the actual merge. In addition, the merge decision unit 610 may decide whether to encode the motion information by merging, by additionally deciding whether the current block is sized larger than a predetermined size. That is, the merge decision unit 610 determines a condition as to whether the current block Hn is sized smaller than or equal to a predetermined size PXQ (for example, 4×4 or 8×8), or all pieces of the motion information of the neighboring block set {Ln, Un, ULn, URn} are similar to one another (S720). If not satisfying the condition, it is determined that the corresponding area is an area where the motions of the current block and/or the neighboring blocks are very complex, and thus, the coded motion information is generated without merging (S730). If the current block Hn is sized larger than the predetermined size PXQ (for example, 4×4 or 8×8) and all pieces of the motion information of the neighboring block set {Ln, Un, ULn, URn} are similar to one another, the coded motion information is generated by merging (S740). It is determined that the motion information of the neighboring block encoded in the intra mode is different from the motion information of other neighboring blocks. In at least one embodiment, PXQ may be set to 8×8 or 4×4. The determination for similarity or nonsimilarity between the motion vectors contained in the motion information of the merge-decision blocks may be made by determining whether the distances between the motion vectors of the neighboring blocks are smaller than predetermined threshold value information. At this time, the distance between the motion vectors may use a two-dimensional Euclidean distance or a city-block distance. In addition, the determination as to whether the pieces of the motion information are similar to one another may be made by using a part of information among the pieces of the motion information, for example, by using only the motion vector. In addition, the determination as to whether the pieces of the motion information are similar to one another may be made by additionally determining whether the reference frames of the motion information are equal to one another. That is, when the reference frames as well as the motion vectors are equal to one another, it can be determined that the pieces of the motion information are similar to one another.
Meanwhile, the video encoding and decoding apparatus according to one or more embodiments of the present disclosure may be configured by connecting an encoded data (bitstream) output terminal of the video encoding apparatus 100 of FIG. 1 to an encoded data (bitstream) input terminal of the video decoding apparatus 500 of FIG. 5 .
The video encoding and decoding apparatus according to one or more embodiments of the present disclosure includes: a video encoder for generating a prediction block of a current block by using motion compensation, deciding whether to encode motion information by merging, based on pre-encoded information, generating coded motion information of the current block according to the decision result, generating a residual block by subtracting the prediction block from the current block, generating a quantized frequency residual block by frequency-transforming (i.e., hereinafter, “frequency-transforming” is referred to as “transforming the residual block with a frequency coefficient,” for description convenience) and quantizing the residual block, and generating a bitstream by entropy-encoding the coded motion information and the quantized frequency residual block; and a video decoder for receiving a bitstream, reconstructing coded motion information and a residual block, deciding whether to reconstruct the motion information by merging, based on pre-decoded information, reconstructing motion information of the current block from the coded motion information according to the decision result, and reconstructing the current block by adding the reconstructed residual block to the prediction block generated by using the reconstructed motion information.
The video encoder can be implemented with the video encoding apparatus 100 according to one or more embodiments of the present disclosure, and the video decoder can be implemented with the video decoding apparatus 500 according to one or more embodiments. The below described steps S810˜S840 and S910˜S940 are not shown.
A video encoding method according to one or more embodiments of the present disclosure includes an inter prediction step (S810) of generating a prediction block of a current block by using motion compensation, deciding whether to encode motion information by merging, based on pre-encoded information, and generating coded motion information of the current block according to the determination result, a subtraction step (S820) of generating a residual block by subtracting the prediction block from the current block, a transform and quantization step (S830) of generating a quantized frequency residual block by frequency-transforming and quantizing the residual block, and an encoding step (S840) of generating a bitstream by entropy-encoding the coded motion information and the quantized frequency residual block.
Since the prediction step (S810), the subtraction step (S820), the transform and quantization step (S830), and the encoding step (S840) correspond to the operations of the prediction unit 120, the subtraction unit 130, the transform and quantization unit 140, and the encoding unit 150, respectively, detailed description thereof will be omitted.
A video decoding method according to one or more embodiments of the present disclosure includes a decoding step (S910) of receiving encoded data, extracting coded motion information and quantization coefficient string, and reconstructing a quantized frequency residual block, a dequantization and inverse transform step (S920) of reconstructing the residual block by dequantizing and inversely transforming the quantized frequency residual block, an inter prediction step (S930) of deciding whether to reconstruct (or decode) motion information by merging, based on pre-decoded information, reconstructing motion information of a current block from the coded motion information according to the decision result, and generating a prediction block of the current block by using the reconstructed motion information, and an addition step (S940) of reconstructing the current block by adding the prediction block to the reconstructed residual block.
Since the decoding step (S910), the dequantization and inverse transform step (S920), the inter prediction step S(930), and the addition step S(940) correspond to the operations of the decoding unit 510, the dequantization and inverse transform unit 520, the inter prediction unit 840, and the addition unit 550, respectively, detailed description thereof will be omitted.
A coded motion information generating method according to one or more embodiments of the present disclosure includes a merge decision step (S1010) of deciding whether to encode coded-motion information by merging according to whether all pieces of the motion information of merge-decision blocks composed of motion information of neighboring blocks are similar to one another, a merge motion information generation step (S1020) of generating the coded motion information by merging according to whether the motion information of the current block is identical with the motion information of the merge candidate blocks composed of the motion information of the neighboring blocks when it is decided to encode the motion information, and a non-merge motion information generation step (S1030) of generating the coded motion information without merging when it is decided not to encode the motion information by merging.
Since the merge decision step (S1010), the merge motion information generation step (S1020), and the non-merge motion information generation step (S1030) correspond to the operations of the merge decision unit 210, the merge motion information generator 220, and the non-merge motion information generator 230, detailed description thereof will be omitted.
A motion information decoding method according to one or more embodiments of the present disclosure includes a merge decision step (S1110) of deciding whether to reconstruct (or decode) motion information by merging according to whether all pieces of merge-decision block motion information composed of motion information of neighboring blocks, a merge motion information decoding step (S1120) of, in a case where it is decided to reconstruct (or decode) the motion information by merging in the merge decision step, receiving a merge flag included in the coded motion information, and setting one of the pieces of the motion information of the merge candidate blocks as the motion information of the current block when the merge flag represents “merged” and all pieces of the motion information of the merge candidate blocks are equal to one another, receiving the merge direction flag when all of the pieces of the motion information of the merge candidate blocks are not equal to one another, and setting the motion information of the block represented by the merge direction flag as the motion information of the current block, receiving the motion information included in the coded motion information when the merge flag represents “unmerged”, and setting the received motion information as the motion information of the current block, and a non-merge motion information decoding step (S1130) of, in a case where it is decided not to reconstruct (or decode) the motion information by merging in the merge decision step, extracting the motion information of the current block from the coded motion information.
Since the merge decision step (S1110), the merge motion information decoding step (S1120), and the non-merge motion information decoding step (S1130) correspond to the operations of the merge decision unit 610, the merge motion information decoder 620, and the non-merge motion information decoder 630, detailed description thereof will be omitted. The below described steps S1010˜S1130 are not shown.
The video encoding and decoding method according to one or more embodiments of the present disclosure may be realized by a combination of the video encoding method according to one or more embodiments of the present disclosure and the video decoding method according to one or more embodiments of the present disclosure.
The video encoding and decoding method according to one or more embodiments of the present disclosure includes a video encoding step of generating a prediction block of a current block by using motion compensation, deciding whether to encode motion information by merging, based on pre-encoded information, generating coded motion information of the current block according to the decision resulted, generating a residual block by subtracting the prediction block from the current block, generating a quantized frequency residual block by frequency-transforming and quantizing the residual block, and generating a bitstream by entropy-encoding the coded motion information and the quantized frequency residual block. The video encoding/decoding method further includes a video decoding step of receiving a bitstream, reconstructing coded motion information and a residual block, determining whether to reconstruct the motion information by merging, based on pre-decoded information, reconstructing motion information of the current block from the coded motion information according to the determination resulted, and reconstructing the current block by adding the reconstructed residual block to the prediction block generated by using the reconstructed motion information.
The video encoding step can be realized by the video encoding method according to one or more embodiments of the present disclosure, and the video decoding step can be realized by the video decoding method according to one or more embodiments.
According to the present disclosure as described above, when performing encoding by merging motion information, whether to encode motion information is decided, based on pre-encoded information. Therefore, the amount of merge-related data is reduced, thereby efficiently encoding the motion information and improving video compression efficiency. As a result, the video compression efficiency is improved, and encoded data is efficiently reconstructed.
In addition, when performing encoding by merging motion information, the size of a block to be encoded is checked, and the block is encoded without merging when a corresponding image is determined as a complex area. The block to be encoded is selectively merged according to image characteristics. This reduces the amount of relevant merge flag information to effect reconstructing the smaller transmission of the encoded data.
In the description above, although all of the components of the embodiments of the present disclosure may have been explained as assembled or operatively connected as a unit, the present disclosure is not intended to limit itself to such embodiments. Rather, within the objective scope of the present disclosure, the respective components may be selectively and operatively combined in any numbers. Every one of the components may be also implemented by itself in hardware while the respective ones can be combined in part or as a whole selectively and implemented in a computer program having program modules for executing functions of the hardware equivalents.
Some embodiments as described above may be implemented in the form of one or more program commands that can be read and executed by a variety of computer systems and be recorded in any non-transitory, computer-readable recording medium. The computer-readable recording medium may include a program command, a data file, a data structure, etc. alone or in combination. The program commands written to the medium are designed or configured especially for the at least one embodiment, or known to those skilled in computer software. Examples of the computer-readable recording medium include magnetic media such as a hard disk, a floppy disk, and a magnetic tape, optical media such as a CD-ROM and a DVD, magneto-optical media such as an optical disk, and a hardware device configured especially to store and execute a program, such as a ROM, a RAM, and a flash memory. Examples of a program command include a premium language code executable by a computer using an interpreter as well as a machine language code made by a compiler. The hardware device may be configured to operate as one or more software modules to implement one or more embodiments of the present disclosure. In some embodiments, one or more of the processes or functionality described herein is/are performed by specifically configured hardware (e.g., by one or more application specific integrated circuits or ASIC(s)). Some embodiments incorporate more than one of the described processes in a single ASIC. In some embodiments, one or more of the processes or functionality described herein is/are performed by at least one processor which is programmed for performing such processes or functionality.
Although exemplary embodiments of the present disclosure have been described for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the various characteristics of the disclosure. That is, it is understood that the present disclosure should not be limited to these embodiments but various changes and modifications can be made by one ordinarily skilled in the art within the subject matter, the spirit and scope of the present disclosure as hereinafter claimed. Specific terms used in this disclosure and drawings are used for illustrative purposes and not to be considered as limitations of the present disclosure. Exemplary embodiments of the present disclosure have not been described for limiting purposes. Accordingly, the scope of the claimed invention is not to be limited by the above embodiments but by the claims and the equivalents thereof.
Claims (8)
1. An apparatus for encoding a current block, the apparatus comprising:
an inter prediction unit configured to
generate a plurality of motion vector candidates of the current block from neighboring blocks of the current block, and
decide whether a motion vector of the current block is set as one of the plurality of motion vector candidates,
generate a first identification information indicating whether the motion vector of the current block is set as one of the plurality of motion vector candidates, and
generate, when the motion vector of the current block is set as one of the plurality of motion vector candidates, a second identification information for identifying one of the plurality of motion vector candidates,
wherein the first identification information indicates that the motion vector of the current block is set as one of the plurality of motion vector candidates;
a subtraction unit configured to generate a residual block by subtracting a predicted block of the current block from the current block, wherein the predicted block has been generated by using the motion vector of the current block;
a transform and quantization unit configured to frequency-transform and quantize the residual block so as to generate a quantized frequency residual block; and
an encoding unit configured to
encode the quantized frequency residual block and the quantized frequency residual block and the first identification information, and
encode the second identification information when the motion vector of the current block is set as one of the plurality of motion vector candidates.
2. The apparatus of claim 1 , wherein the plurality of motion vector candidates are generated by using motion vectors of the neighboring blocks of the current block.
3. The apparatus of claim 2 , wherein
the neighboring blocks include a neighboring block including a sample located just above a left sample of a top-left sample of the current block, and
a neighboring block including a sample located on a right side just above a top-right sample of the current block.
4. The apparatus of claim 1 , wherein
when the motion vector of the current block is not set as any of the plurality of motion vector candidates:
the inter prediction unit is further configured to
calculate a predicted motion vector of the current block, and
generate a differential motion vector between the predicted motion vector and the motion vector of the current block,
wherein the first identification information indicates that the motion vector of the current block is not set as any of the plurality of motion vector candidates; and
the encoding unit is further configured to encode the differential motion vector.
5. A method for decoding a current block, the method performed by a video decoding apparatus and comprising:
extracting a first identification information from a bitstream, wherein the first identification information indicates whether a motion vector of the current block is set as one of a plurality of motion vector candidates;
when the first identification information indicates that the motion vector of the current block is set as one of the plurality of motion vector candidates, performing the following steps:
generating the plurality of motion vector candidates of the current block from neighboring blocks of the current blocks,
decoding, from the bitstream, a second identification information for identifying one of the plurality of motion vector candidates,
selecting a motion vector candidate from the plurality of motion vector candidates based on the second identification information,
reconstructing the motion vector of the current block as the selected motion vector candidate, and
generating a predicted block of the current block by using the reconstructed motion vector of the current block;
reconstructing a quantized frequency residual block of the current block from the bitstream;
dequantizing and inversely transforming the quantized frequency residual block to reconstruct a residual block of the current block; and
adding the predicted block to the reconstructed residual block to reconstruct the current block.
6. The method of claim 5 , further comprising:
when the first identification information indicates that the motion vector of the current block is not set as any of the plurality of motion vector candidates,
generating a predicted block of the current block by using a decoded motion vector of the current block, wherein the decoded motion vector of the current block has been extracted from the bitstream and decoded.
7. The video decoding method of claim 5 , wherein the plurality of motion vector candidates are generated by using motion vectors of the neighboring blocks of the current block.
8. The method of claim 7 , wherein the neighboring blocks include a neighboring block including a sample located just above a left sample of a top-left sample of the current block, and
neighboring blocks including a sample located on a right side just above a top-right sample of the current block.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US14/937,277 US9888248B2 (en) | 2010-12-15 | 2015-11-10 | Method and apparatus for generating encoded motion information /recovering motion information using motion information integration, and image encoding/decoding method and apparatus using same |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR10-2010-0127985 | 2010-12-15 | ||
| KR20100127985A KR101506446B1 (en) | 2010-12-15 | 2010-12-15 | Code Motion Information Generating/Motion Information Reconstructing Method and Apparatus Using Motion Information Merge and Image Encoding/Decoding Method and Apparatus Using The Same |
| PCT/KR2011/009673 WO2012081917A2 (en) | 2010-12-15 | 2011-12-15 | Method and apparatus for generating coded motion information/recovering motion information using motion information integration, and image encoding/decoding method and apparatus using same |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/KR2011/009673 Continuation WO2012081917A2 (en) | 2010-12-15 | 2011-12-15 | Method and apparatus for generating coded motion information/recovering motion information using motion information integration, and image encoding/decoding method and apparatus using same |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US14/937,277 Continuation US9888248B2 (en) | 2010-12-15 | 2015-11-10 | Method and apparatus for generating encoded motion information /recovering motion information using motion information integration, and image encoding/decoding method and apparatus using same |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20130272419A1 US20130272419A1 (en) | 2013-10-17 |
| US9270996B2 true US9270996B2 (en) | 2016-02-23 |
Family
ID=46245230
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US13/914,910 Active 2033-01-18 US9270996B2 (en) | 2010-12-15 | 2013-06-11 | Method and apparatus for generating encoded motion information/recovering motion information using motion information integration, and image encoding/decoding method and apparatus using same |
| US14/937,277 Active 2031-12-25 US9888248B2 (en) | 2010-12-15 | 2015-11-10 | Method and apparatus for generating encoded motion information /recovering motion information using motion information integration, and image encoding/decoding method and apparatus using same |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US14/937,277 Active 2031-12-25 US9888248B2 (en) | 2010-12-15 | 2015-11-10 | Method and apparatus for generating encoded motion information /recovering motion information using motion information integration, and image encoding/decoding method and apparatus using same |
Country Status (4)
| Country | Link |
|---|---|
| US (2) | US9270996B2 (en) |
| KR (1) | KR101506446B1 (en) |
| CN (5) | CN105847832B (en) |
| WO (1) | WO2012081917A2 (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10645398B2 (en) * | 2011-10-25 | 2020-05-05 | Texas Instruments Incorporated | Sample-based angular intra-prediction in video coding |
| US10291827B2 (en) | 2013-11-22 | 2019-05-14 | Futurewei Technologies, Inc. | Advanced screen content coding solution |
| EP3055830A4 (en) | 2014-03-21 | 2017-02-22 | Huawei Technologies Co., Ltd. | Advanced screen content coding with improved color table and index map coding methods |
| KR102260146B1 (en) | 2014-03-31 | 2021-06-03 | 인텔렉추얼디스커버리 주식회사 | Method and device for creating inter-view merge candidates |
| US10091512B2 (en) * | 2014-05-23 | 2018-10-02 | Futurewei Technologies, Inc. | Advanced screen content coding with improved palette table and index map coding methods |
| JP7423624B2 (en) * | 2018-11-08 | 2024-01-29 | オッポ広東移動通信有限公司 | Video signal encoding/decoding method and equipment |
| WO2020139005A1 (en) * | 2018-12-28 | 2020-07-02 | 한국전자통신연구원 | Image encoding/decoding method and device, and recording medium in which bitstream is stored |
Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR970004896A (en) | 1995-06-29 | 1997-01-29 | Motion vector estimation method for video reduction | |
| US5608458A (en) * | 1994-10-13 | 1997-03-04 | Lucent Technologies Inc. | Method and apparatus for a region-based approach to coding a sequence of video images |
| KR20010000248A (en) | 2000-08-29 | 2001-01-05 | 안병엽 | Apparatus for variable block size motion compensation using template pattern coding in an image compressing system |
| KR100381061B1 (en) | 1995-10-20 | 2003-08-19 | 노키아 모빌 폰즈 리미티드 | Motion vector field coding |
| KR20050052130A (en) | 2003-11-29 | 2005-06-02 | 엘지전자 주식회사 | Image decoding method |
| US20050141614A1 (en) * | 2002-04-11 | 2005-06-30 | Braspenning Ralph Antonius C. | Motion estimation unit and method of estimating a motion vector |
| US20060017843A1 (en) * | 2004-07-20 | 2006-01-26 | Fang Shi | Method and apparatus for frame rate up conversion with multiple reference frames and variable block sizes |
| US20060251330A1 (en) * | 2003-05-20 | 2006-11-09 | Peter Toth | Hybrid video compression method |
| US20080126278A1 (en) * | 2006-11-29 | 2008-05-29 | Alexander Bronstein | Parallel processing motion estimation for H.264 video codec |
| US20080165852A1 (en) * | 2007-01-05 | 2008-07-10 | Sony Corporation | Video coding system |
| US20080165855A1 (en) * | 2007-01-08 | 2008-07-10 | Nokia Corporation | inter-layer prediction for extended spatial scalability in video coding |
| CN101472174A (en) | 2007-12-29 | 2009-07-01 | 智多微电子（上海）有限公司 | Method and device for recuperating original image data in video decoder |
| US20090210857A1 (en) * | 2008-02-19 | 2009-08-20 | International Business Machines Corporation | Automated merging in a software development environment |
| US20100054585A1 (en) * | 2008-09-03 | 2010-03-04 | Jean-Pierre Guillou | Text localization for image and video OCR |
| US20100135387A1 (en) * | 2007-04-12 | 2010-06-03 | Thomson Licensing | Method and apparatus for context dependent merging for skip-direct modes for video encoding and decoding |
| US20100239019A1 (en) * | 2007-06-06 | 2010-09-23 | Alois Martin Bock | Post processing of motion vectors using sad for low bit rate video compression |
| US20100322314A1 (en) * | 2009-06-23 | 2010-12-23 | Acer Incorporated | Method for temporal error concealment |
| US20110129015A1 (en) * | 2007-09-04 | 2011-06-02 | The Regents Of The University Of California | Hierarchical motion vector processing method, software and devices |
| US20110170608A1 (en) * | 2010-01-08 | 2011-07-14 | Xun Shi | Method and device for video transcoding using quad-tree based mode selection |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1225127C (en) * | 2003-09-12 | 2005-10-26 | 中国科学院计算技术研究所 | A coding/decoding end bothway prediction method for video coding |
| KR100728031B1 (en) * | 2006-01-23 | 2007-06-14 | 삼성전자주식회사 | Method and apparatus for deciding encoding mode for variable block size motion estimation |
| CN101014129B (en) * | 2007-03-06 | 2010-12-15 | 孟智平 | Video data compression method |
| KR20090132629A (en) * | 2007-04-09 | 2009-12-30 | 가부시키가이샤 엔.티.티.도코모 | Image prediction/encoding device, image prediction/encoding method, image prediction/encoding program, image prediction/decoding device, image prediction/decoding method, and image prediction decoding program |
| CN101415116B (en) * | 2007-10-15 | 2011-08-03 | 华为技术有限公司 | Method and system for determining corresponding macro block |
| CN101562745B (en) * | 2008-04-18 | 2012-07-04 | 华为技术有限公司 | Method and device for encoding and decoding multi-viewpoint video image |
| KR100968371B1 (en) * | 2008-04-25 | 2010-07-06 | 주식회사 코아로직 | Method and Apparatus of Decoding Image |
| CN101610413B (en) * | 2009-07-29 | 2011-04-27 | 清华大学 | Video coding/decoding method and device |
| CN101815218B (en) * | 2010-04-02 | 2012-02-08 | 北京工业大学 | Method for coding quick movement estimation video based on macro block characteristics |
-
2010
- 2010-12-15 KR KR20100127985A patent/KR101506446B1/en active IP Right Grant
-
2011
- 2011-12-15 WO PCT/KR2011/009673 patent/WO2012081917A2/en active Application Filing
- 2011-12-15 CN CN201610307932.XA patent/CN105847832B/en active Active
- 2011-12-15 CN CN201180060212.3A patent/CN103262538B/en active Active
- 2011-12-15 CN CN201610308617.9A patent/CN105847834B/en active Active
- 2011-12-15 CN CN201610308383.8A patent/CN105847833B/en active Active
- 2011-12-15 CN CN201610308620.0A patent/CN105828085B/en active Active
-
2013
- 2013-06-11 US US13/914,910 patent/US9270996B2/en active Active
-
2015
- 2015-11-10 US US14/937,277 patent/US9888248B2/en active Active
Patent Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5608458A (en) * | 1994-10-13 | 1997-03-04 | Lucent Technologies Inc. | Method and apparatus for a region-based approach to coding a sequence of video images |
| KR970004896A (en) | 1995-06-29 | 1997-01-29 | Motion vector estimation method for video reduction | |
| KR100381061B1 (en) | 1995-10-20 | 2003-08-19 | 노키아 모빌 폰즈 리미티드 | Motion vector field coding |
| KR20010000248A (en) | 2000-08-29 | 2001-01-05 | 안병엽 | Apparatus for variable block size motion compensation using template pattern coding in an image compressing system |
| US20050141614A1 (en) * | 2002-04-11 | 2005-06-30 | Braspenning Ralph Antonius C. | Motion estimation unit and method of estimating a motion vector |
| US20060251330A1 (en) * | 2003-05-20 | 2006-11-09 | Peter Toth | Hybrid video compression method |
| KR20050052130A (en) | 2003-11-29 | 2005-06-02 | 엘지전자 주식회사 | Image decoding method |
| US20060017843A1 (en) * | 2004-07-20 | 2006-01-26 | Fang Shi | Method and apparatus for frame rate up conversion with multiple reference frames and variable block sizes |
| US20080126278A1 (en) * | 2006-11-29 | 2008-05-29 | Alexander Bronstein | Parallel processing motion estimation for H.264 video codec |
| US20080165852A1 (en) * | 2007-01-05 | 2008-07-10 | Sony Corporation | Video coding system |
| US20080165855A1 (en) * | 2007-01-08 | 2008-07-10 | Nokia Corporation | inter-layer prediction for extended spatial scalability in video coding |
| US20100135387A1 (en) * | 2007-04-12 | 2010-06-03 | Thomson Licensing | Method and apparatus for context dependent merging for skip-direct modes for video encoding and decoding |
| US20100239019A1 (en) * | 2007-06-06 | 2010-09-23 | Alois Martin Bock | Post processing of motion vectors using sad for low bit rate video compression |
| US20110129015A1 (en) * | 2007-09-04 | 2011-06-02 | The Regents Of The University Of California | Hierarchical motion vector processing method, software and devices |
| CN101472174A (en) | 2007-12-29 | 2009-07-01 | 智多微电子（上海）有限公司 | Method and device for recuperating original image data in video decoder |
| US20090210857A1 (en) * | 2008-02-19 | 2009-08-20 | International Business Machines Corporation | Automated merging in a software development environment |
| US20100054585A1 (en) * | 2008-09-03 | 2010-03-04 | Jean-Pierre Guillou | Text localization for image and video OCR |
| US20100322314A1 (en) * | 2009-06-23 | 2010-12-23 | Acer Incorporated | Method for temporal error concealment |
| US20110170608A1 (en) * | 2010-01-08 | 2011-07-14 | Xun Shi | Method and device for video transcoding using quad-tree based mode selection |
Non-Patent Citations (1)
| Title |
|---|
| International Search Report mailed Aug. 1, 2012 for PCT/KR2011/009673. |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105847833B (en) | 2018-12-04 |
| CN105828085B (en) | 2019-01-15 |
| CN103262538A (en) | 2013-08-21 |
| CN105847833A (en) | 2016-08-10 |
| CN105847832A (en) | 2016-08-10 |
| US9888248B2 (en) | 2018-02-06 |
| WO2012081917A2 (en) | 2012-06-21 |
| WO2012081917A3 (en) | 2012-10-04 |
| CN105847832B (en) | 2019-02-22 |
| KR101506446B1 (en) | 2015-04-08 |
| CN105847834B (en) | 2019-03-26 |
| CN105828085A (en) | 2016-08-03 |
| US20160065972A1 (en) | 2016-03-03 |
| CN105847834A (en) | 2016-08-10 |
| CN103262538B (en) | 2016-09-28 |
| KR20120066741A (en) | 2012-06-25 |
| US20130272419A1 (en) | 2013-10-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10491920B2 (en) | Method and apparatus for encoding/decoding the motion vectors of a plurality of reference pictures, and apparatus and method for image encoding/decoding using same | |
| US9888248B2 (en) | Method and apparatus for generating encoded motion information /recovering motion information using motion information integration, and image encoding/decoding method and apparatus using same | |
| US10123014B2 (en) | Method and apparatus for coding/decoding image | |
| US9392300B2 (en) | Method and apparatus for encoding a motion vector, and method and apparatus for encoding/decoding image using same | |
| US10116942B2 (en) | Method and apparatus for decoding a video using an intra prediction | |
| US20120269268A1 (en) | Motion vector encoding/decoding method and device and image encoding/decoding method and device using same | |
| US9510017B2 (en) | Method and apparatus for encoding/decoding image in spatial domain for noise component | |
| KR20120011428A (en) | Method and Apparatus for Encoding/Decoding of Video Data Using Partitioned-Block Prediction | |
| KR20120009861A (en) | Method and Apparatus for Encoding/Decoding of Video Data Using Expanded Skip Mode | |
| US10038900B2 (en) | Method and apparatus for effective encoding/decoding using detailed predictive unit | |
| US10715805B2 (en) | Method and device for subband coding frequency conversion unit, and method and device for image encoding/decoding using same | |
| KR20120033546A (en) | Method and apparatus for adaptive motion vector coding/decoding using the information of image structure and method and apparatus for encoding/decoding using the same | |
| KR101567982B1 (en) | Code Motion Information Generating/Motion Information Reconstructing Method and Apparatus Using Motion Information Merge and Image Encoding/Decoding Method and Apparatus Using The Same | |
| KR101567986B1 (en) | Code Motion Information Generating/Motion Information Reconstructing Method and Apparatus Using Motion Information Merge and Image Encoding/Decoding Method and Apparatus Using The Same | |
| KR101567961B1 (en) | Code Motion Information Generating/Motion Information Reconstructing Method and Apparatus Using Motion Information Merge and Image Encoding/Decoding Method and Apparatus Using The Same | |
| KR101527153B1 (en) | Code Motion Information Generating/Motion Information Reconstructing Method and Apparatus Using Motion Information Merge and Image Encoding/Decoding Method and Apparatus Using The Same | |
| KR101483688B1 (en) | Code Motion Information Generating/Motion Information Reconstructing Method and Apparatus Using Motion Information Merge and Image Encoding/Decoding Method and Apparatus Using The Same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: SK TELECOM. CO., LTD., KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SONG, JINHAN;LIM, JEONGYEON;KIM, HAEKWANG;AND OTHERS;SIGNING DATES FROM 20130528 TO 20130713;REEL/FRAME:030869/0309 |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |