KR20140127406A - Method for encoding and decoding image, and apparatus thereof - Google Patents
Method for encoding and decoding image, and apparatus thereof Download PDFInfo
- Publication number
- KR20140127406A KR20140127406A KR20130045311A KR20130045311A KR20140127406A KR 20140127406 A KR20140127406 A KR 20140127406A KR 20130045311 A KR20130045311 A KR 20130045311A KR 20130045311 A KR20130045311 A KR 20130045311A KR 20140127406 A KR20140127406 A KR 20140127406A
- Authority
- KR
- South Korea
- Prior art keywords
- enhancement layer
- layer
- picture
- motion information
- motion
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/573—Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The present invention relates to a method and apparatus for compensating a motion vector of an enhancement layer for prediction of inter-layer differential coefficients. When a difference coefficient is generated in the reference layer using the motion vector of the enhancement layer, the motion vector information of the enhancement layer may not be used as it is due to mismatch of the frame rate of the reference layer and the enhancement layer. The encoding / decoding method and apparatus include: extracting motion information of an enhancement layer; A motion information adjustment step of the enhancement layer; Layer difference signal prediction step.
Description
The present invention relates to image processing techniques, and more particularly, to a method and apparatus for predicting differential coefficients between layers in a scalable video codec.
Recently, as the demand for high resolution and high definition video has increased, there has been a need for a highly efficient video compression technology for the next generation video service. In response to these market demands, MPEG and VCEG, which jointly standardized MPEG-2 Video and H.264 / AVC codecs, have been jointly standardized on new video compression technologies since 2010. MPEG and VCEG have established Joint Collaborative Team on Video Coding (JCT-VC) in January 2010 for the development of new standard technologies. In January 2013, JCT-VC will be used for the next generation video standard called HEVC (High Efficiency Video Coding) Technology has been completed. HEVC has a compression efficiency of more than 50% compared to H.264 / AVC High profile, which is known to have the highest compression efficiency, and supports full-HD, 4K-UHD, and 8K-UHD resolution video .
The HEVC standardization for the base layer was established in January 2013 under the name HEVC
The present invention aims to provide a method and apparatus for minimizing a difference signal of an enhancement layer by further predicting a difference signal of an enhancement layer in a scalable video codec by using a difference signal of a reference layer.
According to an aspect of the present invention, there is provided a motion vector compensation method for predicting an inter-layer differential coefficient, the method comprising: extracting motion information of an enhancement layer; A motion information adjustment step of the enhancement layer; Layer difference signal prediction step.
According to a first aspect of the present invention, there is provided a method of decoding a video using a scalable video codec, the method comprising: extracting motion information of an enhancement layer; Determining whether a picture corresponding to a reference frame index of the enhancement layer exists in a reference layer based on the extracted motion information of the enhancement layer; And adjusting the reference frame index of the enhancement layer if the picture is not present.
According to another aspect of the present invention, there is provided a method of decoding a video using a scalable video codec, the method comprising: extracting motion information of an enhancement layer; Determining whether a picture corresponding to a reference frame index of the enhancement layer exists in a reference layer based on the extracted motion information of the enhancement layer; Adjusting the reference frame index of the enhancement layer if the picture is not present; And scaling the motion vector included in the motion information according to the adjusted index.
According to an embodiment of the present invention, the motion information extracting unit of the enhancement layer extracts the reference frame index and the motion vector of the enhancement layer. The motion information adjustment unit of the enhancement layer checks whether the extracted reference frame index and motion vector are usable in the reference layer. If the motion information of the enhancement layer can not be used in the reference layer due to a different frame rate between layers, Scales the vector. The inter-layer difference signal predicting unit obtains a difference coefficient in the reference layer using the motion information of the enhancement layer or the motion information of the adjusted enhancement layer, and generates a more accurate prediction value using the coefficient value and the prediction block of the enhancement layer The difference coefficient of the enhancement layer can be minimized.
1 is a block diagram showing a configuration of a scalable video encoder.
FIG. 2 is a conceptual diagram for explaining prediction of inter-layer difference coefficients in an image coding / decoding apparatus to which the present invention is applied.
3 is a conceptual diagram for explaining generalized residual prediction for predicting inter-layer difference coefficients in more detail.
4 is a conceptual diagram for explaining a case where a picture corresponding to a reference picture of an enhancement layer in prediction of inter-layer differential signals in a picture decoding apparatus to which the present invention is applied does not exist in a reference layer.
5 is a block diagram illustrating a configuration of an image encoding apparatus according to an embodiment of the present invention.
FIG. 6 is a block diagram illustrating a configuration of an image decoding apparatus according to an embodiment of the present invention. Referring to FIG.
7 is a block diagram illustrating a configuration of an image decoding apparatus according to an embodiment of the present invention.
FIG. 8 is a conceptual diagram for explaining adjustment of motion information by the motion information adjustment unit 720 of FIG.
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the following description of the embodiments of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present disclosure rather unclear.
It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . In addition, the description of "including" a specific configuration in the present invention does not exclude a configuration other than the configuration, and means that additional configurations can be included in the practice of the present invention or the technical scope of the present invention.
The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.
In addition, the components shown in the embodiments of the present invention are shown independently to represent different characteristic functions, which does not mean that each component is composed of separate hardware or software constituent units. That is, each constituent unit is included in each constituent unit for convenience of explanation, and at least two constituent units of the constituent units may be combined to form one constituent unit, or one constituent unit may be divided into a plurality of constituent units to perform a function. The integrated embodiments and separate embodiments of the components are also included within the scope of the present invention, unless they depart from the essence of the present invention.
In addition, some of the components are not essential components to perform essential functions in the present invention, but may be optional components only to improve performance. The present invention can be implemented only with components essential for realizing the essence of the present invention, except for the components used for the performance improvement, and can be implemented by only including the essential components except the optional components used for performance improvement Are also included in the scope of the present invention.
1 is a block diagram showing a configuration of a scalable video encoder.
Referring to FIG. 1, a scalable video encoder provides spatial scalability, temporal scalability, and SNR scalability. For spatial scalability, multi-layer scheme using up-sampling is used, and temporal scalability uses a hierarchical B picture structure. For image quality scalability, only the quantization coefficient is changed in the same manner as the technique for spatial scalability, or an incremental coding technique for quantization error is used.
The
In the enhancement layer, the
Although each layer in FIG. 1 can be encoded independently, input video in the lower layer is very similar in that it is down-sampled in video in the upper layer. Therefore, if the reconstructed pixel value of the lower layer video, the motion vector, and the residual signal are used in the enhancement layer, the coding efficiency can be increased.
In FIG. 1, the inter-layer
In FIG. 1, the
In FIG. 1, the inter-layer difference
FIG. 2 is a conceptual diagram for explaining prediction of inter-layer difference coefficients in an image coding / decoding apparatus to which the present invention is applied.
Referring to FIG. 2, in a scalable video encoder, when a
In the reference layer up-sampled in the same manner as the resolution of the enhancement layer, the
3 is a conceptual diagram for explaining the generalized residual prediction (GRP) predicting inter-layer difference coefficients in more detail.
Referring to FIG. 3, a
In the GRP technique, the difference coefficient derived from the upsampled base layer is derived, and the derived difference coefficient value is used as the prediction value of the enhancement layer. For this, a
The
When bi-directional prediction is used, the GRP derives the difference coefficient from the reference layer using the bidirectional motion information of the enhancement layer. In the bi-directional prediction, a compensation block in the L0 direction in the enhancement layer, a difference coefficient in the L0 direction derived in the reference layer, a compensation block in the L1 direction in the enhancement layer, The weighting sum of the difference coefficients in the L1 direction derived from the layer is used.
4 is a conceptual diagram for explaining a case where a picture corresponding to a reference picture of an enhancement layer in prediction of inter-layer differential signals in a picture decoding apparatus to which the present invention is applied does not exist in a reference layer.
Referring to FIG. 4, when a
5 is a block diagram illustrating a configuration of an image encoding apparatus according to an embodiment of the present invention.
Referring to FIG. 5, the image encoding apparatus to which the present invention is applied is based on a GRP that generates a difference coefficient in a reference layer and uses the differential coefficient as a prediction value to predict a difference coefficient of an enhancement layer. For this, the
The
FIG. 6 is a block diagram illustrating a configuration of an image decoding apparatus according to an embodiment of the present invention. Referring to FIG.
Referring to FIG. 6, an image decoding apparatus to which the present invention is applied is based on a GRP that generates a difference coefficient in a reference layer and uses the difference coefficient as a prediction value to predict a difference coefficient of an enhancement layer. For this, the
The
7 is a block diagram illustrating a configuration of an image encoding / decoding apparatus according to an embodiment of the present invention.
Referring to FIG. 7, an apparatus for decoding / decoding an image according to an embodiment of the present invention includes an enhancement layer motion
The motion
In a case where the inter-layer difference coefficient prediction is performed, the motion information adjustment unit 720 may determine that the reference frame index and the motion vector information extracted from the enhancement layer can not be directly used in the reference layer, And performs the process of adjusting the motion vector scaling and the reference frame index using the motion information in the enhancement layer.
The base layer
FIG. 8 is a conceptual diagram for explaining adjustment of motion information by the motion information adjustment unit 720 of FIG.
Referring to FIG. 8, in a case where it is impossible to directly use the motion information of the enhancement layer in the reference layer, the motion information adjustment unit 720 re-adjusts the motion information in the enhancement layer. For example, if a
In the case where two enhancement layers have two motion compensation blocks using bidirectional prediction in the enhancement layer, the method described in FIG. 8 is directly applied to each prediction direction. For example, in the enhancement layer, the motion information for the L0 direction need not be adjusted by the motion information adjusting unit 720, and when only the motion information for the L1 direction needs to be adjusted through the motion information adjusting unit 720, The motion information is adjusted using the method described above. When motion information adjustment is required for both directions L0 and L1, the motion information is adjusted using the method described above for both directions.
The method according to the present invention may be implemented as a program for execution on a computer and stored in a computer-readable recording medium. Examples of the computer-readable recording medium include a ROM, a RAM, a CD- , A floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave (for example, transmission over the Internet).
The computer readable recording medium may be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And, functional programs, codes and code segments for implementing the above method can be easily inferred by programmers of the technical field to which the present invention belongs.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It should be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.
Claims (10)
Extracting motion information of the enhancement layer;
Determining whether a picture corresponding to a reference frame index of the enhancement layer exists in a reference layer based on the extracted motion information of the enhancement layer;
Adjusting the reference frame index of the enhancement layer if the picture is not present; And
And scaling a motion vector included in the motion information according to the adjusted index.
The step of adjusting the index
And adjusting the reference frame index using a frame rate of the enhancement layer, the reference layer, and motion information in the enhancement layer.
Wherein scaling the motion vector comprises:
And scaling the motion vector using a frame rate of the enhancement layer, the reference layer, and motion information in the enhancement layer.
Wherein scaling the motion vector comprises:
Selecting a picture closest to the prediction direction in the reference layer and scaling the motion vector of the enhancement layer based on a picture at the same position as the selected picture in the enhancement layer.
Wherein the picture closest to the prediction direction includes a picture having a value close to the POC of the current picture to be decoded based on the POC.
A motion compensation unit for extracting motion information of the enhancement layer; And
Determines whether a picture corresponding to a reference frame index of the enhancement layer exists in a reference layer based on the extracted motion information of the enhancement layer and adjusts the reference frame index of the enhancement layer if the picture does not exist And a motion information adjuster for scaling a motion vector included in the motion information according to the adjusted index.
Wherein the motion information adjustment unit adjusts the reference frame index using a frame rate of the enhancement layer, the reference layer, and motion information in the enhancement layer.
Wherein the motion information adjustment unit scales the motion vector using a frame rate of the enhancement layer, the reference layer, and motion information in the enhancement layer.
The motion information adjusting unit selects a picture closest to the prediction direction in the reference layer and scaling the motion vector of the enhancement layer based on a picture at the same position as the selected picture in the enhancement layer / RTI >
And the picture closest to the prediction direction includes a picture having a value close to the POC of the current picture to be decoded based on the POC.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR20130045311A KR20140127406A (en) | 2013-04-24 | 2013-04-24 | Method for encoding and decoding image, and apparatus thereof |
PCT/KR2014/003554 WO2014175658A1 (en) | 2013-04-24 | 2014-04-23 | Video encoding and decoding method, and apparatus using same |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR20130045311A KR20140127406A (en) | 2013-04-24 | 2013-04-24 | Method for encoding and decoding image, and apparatus thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20140127406A true KR20140127406A (en) | 2014-11-04 |
Family
ID=52451642
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR20130045311A KR20140127406A (en) | 2013-04-24 | 2013-04-24 | Method for encoding and decoding image, and apparatus thereof |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20140127406A (en) |
-
2013
- 2013-04-24 KR KR20130045311A patent/KR20140127406A/en not_active Application Discontinuation
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6416992B2 (en) | Method and arrangement for transcoding video bitstreams | |
US10791333B2 (en) | Video encoding using hierarchical algorithms | |
JP5039142B2 (en) | Quality scalable coding method | |
KR100679031B1 (en) | Method for encoding/decoding video based on multi-layer, and apparatus using the method | |
KR100772883B1 (en) | Deblocking filtering method considering intra BL mode, and video encoder/decoder based on multi-layer using the method | |
KR100772873B1 (en) | Video encoding method, video decoding method, video encoder, and video decoder, which use smoothing prediction | |
KR100763194B1 (en) | Intra base prediction method satisfying single loop decoding condition, video coding method and apparatus using the prediction method | |
KR100791299B1 (en) | Multi-layer based video encoding method and apparatus thereof | |
CN112042200B (en) | Method and device for video decoding | |
KR101253156B1 (en) | Method for encoding/decoding video signal | |
US20090103613A1 (en) | Method for Decoding Video Signal Encoded Using Inter-Layer Prediction | |
KR20110115172A (en) | Methods and apparatus for bit depth scalable video encoding and decoding utilizing tone mapping and inverse tone mapping | |
CN104380745A (en) | Method and apparatus of adaptive intra prediction for inter-layer and inter-view coding | |
CN103098471A (en) | Method and apparatus of layered encoding/decoding a picture | |
EP1659797A2 (en) | Method and apparatus for compressing motion vectors in video coder based on multi-layer | |
KR20140121355A (en) | Method and apparatus for image encoding/decoding | |
KR20060119736A (en) | Method for encoding video signal | |
CN110798686A (en) | Video decoding method and device, computer equipment and computer readable storage medium | |
KR102345770B1 (en) | Video encoding and decoding method and device using said method | |
CN115151941A (en) | Method and apparatus for video encoding | |
KR20150056679A (en) | Apparatus and method for construction of inter-layer reference picture in multi-layer video coding | |
KR20140127406A (en) | Method for encoding and decoding image, and apparatus thereof | |
KR20140127405A (en) | Method for encoding and decoding image, and apparatus thereof | |
KR20140127407A (en) | Method for encoding and decoding image, and apparatus thereof | |
JP2018032913A (en) | Video encoder, program and method, and video decoder, program and method, and video transmission system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
N231 | Notification of change of applicant | ||
WITN | Withdrawal due to no request for examination |