KR101674556B1 - Method and apparatus for estimating motion using multi reference frames - Google Patents

Method and apparatus for estimating motion using multi reference frames Download PDF

Info

Publication number
KR101674556B1
KR101674556B1 KR1020150106020A KR20150106020A KR101674556B1 KR 101674556 B1 KR101674556 B1 KR 101674556B1 KR 1020150106020 A KR1020150106020 A KR 1020150106020A KR 20150106020 A KR20150106020 A KR 20150106020A KR 101674556 B1 KR101674556 B1 KR 101674556B1
Authority
KR
South Korea
Prior art keywords
reference frame
frame
index
current
current frame
Prior art date
Application number
KR1020150106020A
Other languages
Korean (ko)
Inventor
박승보
김유원
Original Assignee
인하대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 인하대학교 산학협력단 filed Critical 인하대학교 산학협력단
Priority to KR1020150106020A priority Critical patent/KR101674556B1/en
Application granted granted Critical
Publication of KR101674556B1 publication Critical patent/KR101674556B1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/107—Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The present invention discloses an apparatus and a method for motion estimation using a plurality of reference frames. According to a specific example of the present invention, at least one of a reference frame index and a final reference frame index derived from a reference frame having a highest degree of similarity to a current frame is derived and transmitted, and a reference frame index In a plurality of reference models, a current frame and a neighboring reference frame or a reference frame matched with a final reference frame index are indexed by a predetermined reference frame holding time value and stored in a reference frame storing unit. It is possible to restore a high-quality image for a frame having a large amount of change by calling a reference frame of a matching reference frame storage unit as a comparison target reference frame and restoring the current frame. By using the stored reference frame index, (I + k) of the current frame is smaller than the reception time value (i), it is possible to reduce the complexity of searching for the reference frame, The storage capacity of the storage unit can be maximized.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a motion estimation apparatus and a motion estimation apparatus,

The present invention relates to a motion estimation apparatus and method using a plurality of reference frames, and more particularly, to a motion estimation apparatus and method using a plurality of reference frames, Technology.

In a general video codec, when performing inter-coding, a motion vector is estimated using a plurality of previous frames or a plurality of future frames as reference images. The use of multiple reference images increases the likelihood of finding blocks similar to the current block and enables accurate motion estimation in the presence of scene changes or obstructed objects.

FIG. 1 shows a case where only one previous frame is used as a reference image. A player with a ball has a mark of '19' in his uniform but it does not exist in the previous reference image.

When the macroblock size is 16x16, for example, when the change of the macro convexity between frames is large, for example, when the scene is changed or a flash is popped, the entire macroblock is inverted.

In order to solve the problem of expression of such a macroblock, a method of searching a motion vector by setting a size of a macroblock based on a change amount occurring on a screen is adopted. However, when a change of a macroblock is large, The data rate is lowered and the storage capacity is lowered.

Therefore, instead of searching for only one previous reference frame, the reference frame motion estimation is an efficient frame reference motion estimation method that can search for a plurality of reference frames and reduce the complexity to facilitate practical application of motion estimation Is required.

When a motion vector is estimated using a plurality of reference images, a reference frame index indicating a reference image must be encoded each time coding is performed.

According to the present invention, a reference frame index capable of restoring a high picture quality is improved, a storage capacity is improved, a motion estimation time is shortened, and a reference frame index is allocated to search for a frame having high similarity to the current frame, We propose an estimation method.

It is an object of the present invention to provide a motion estimation method and a motion estimation method using a plurality of motion estimation methods for improving motion estimation time by reducing complexity and enabling high- And a motion estimation apparatus and method using the reference frame.

According to an aspect of the present invention, there is provided a motion estimation apparatus using a plurality of reference frames for indexing a plurality of reference frames for estimating a motion vector, A reference frame selector for selecting a reference frame having a highest degree of similarity to a current frame among a plurality of previous reference frames using a motion vector function value for each of the previous reference frames and a reference frame appropriate value derived from the reference frame function value; And a reference frame indexing assignment unit for assigning a reference frame index to the selected reference frame according to a time position and transmitting a current frame having an assigned reference frame index.

Preferably, the apparatus further includes: a reference frame calling unit that calls a reference frame having a reference frame index closest to a time position among reference frame indexes of a current frame; And a reference frame storage unit for indexing and storing the called reference frame at a predetermined holding time (i + k) of the reference frame, wherein a reference frame index of the stored reference frame is the same as a reference frame index of the current frame, To-be-compared reference frame; And a current frame generator for generating a current frame using the called comparison reference frame and the motion vector of the current frame. Preferably, the apparatus further includes a reference frame management unit for deleting a reference frame of the reference frame storage unit in which the holding time value (i + k) of the reference frame Fi is smaller than the receiving time point (i) of the current frame.

A motion estimation apparatus using a plurality of reference frames according to the present invention is a motion estimation apparatus using a plurality of reference frames for constructing and indexing reference frames to estimate a motion vector, A reference frame selector for selecting a reference frame having a highest degree of similarity between the current frame and the plurality of previous reference frames using a reference frame appropriate value derived from the reference frame value; And an index assignment unit for assigning a final reference frame index (k-i) and a reference frame index (i-k) to the selected current frame to transmit the current frame.

Preferably, the apparatus includes a reference frame storage unit for indexing and storing a reference frame having a final reference frame index matched with a final reference frame index of a current frame, with a holding time value (i + k) of the reference frame, A comparison reference frame calling unit for calling a reference frame (Fi-k) stored in the reference frame storing unit using the stored reference frame index list; And a current frame generator for generating a current frame using the called comparison reference frame and the motion vector of the current frame. Preferably, the apparatus further includes a reference frame management unit for deleting a reference frame of the reference frame storage unit in which the holding time value (i + k) of the reference frame Fi is smaller than the receiving time point (i) of the current frame.

A motion estimation method using a plurality of reference frames according to the present invention based on the apparatus described above is a motion estimation method using a reference frame for constructing and indexing a reference image to estimate a motion vector, (A) selecting a reference frame having the highest degree of similarity with a current frame among the plurality of previous reference frames using a motion vector function value for each frame and a reference frame appropriate value derived from the reference frame function value; And (b) transmitting a current frame by allocating a reference frame index (k-i) according to a time position with respect to the current frame.

Preferably, the method further comprises: (c) calling a reference frame having a reference frame index closest to a time position among reference frame indexes of a current frame; (D) indexing and storing the called reference frame at a predetermined holding time (i + k) of the reference frame, wherein the reference frame index of the stored reference frame is the same as the reference frame index of the current frame (E) setting a comparison reference frame as a reference frame to be compared; And (f) generating a current frame using the called reference frame and the motion vector of the current frame. Preferably, the method further comprises: (g) deleting a reference frame of a reference frame store where the hold time value (i + k) of the reference frame (Fi) is smaller than the receive time (i) of the current frame.

A motion estimation method using a plurality of reference frames according to the present invention based on the apparatus described above is a motion estimation method using a reference frame for constructing and indexing a reference image to estimate a motion vector, (A) selecting a reference frame having a highest degree of similarity between a current frame and the plurality of previous reference frames using a motion vector function value for each frame and a reference frame appropriate value derived from the reference frame function value; And (B) transmitting a current frame by allocating a final reference frame index (k-i) and a reference frame index (i-k) to the current frame, respectively.

Preferably, the method further comprises: indexing a reference frame Fk having a final reference frame index matched with a final reference frame index of the current frame Fi to a holding time value (i + k) of the reference frame Fk (D) calling the reference frame (Fi-k) stored in the reference frame storage unit using the stored reference frame index list, And generating (E) a current frame using the called reference frame and the motion vector of the current frame. Preferably, the apparatus further comprises: (F) deleting all reference frames in which the retention time value (i + k) of the reference frame (Fi) is smaller than the reception time (i) of the current frame.

According to the present invention, at least one of a reference frame index and a final reference frame index derived from a reference frame having a highest similarity to a current frame is derived and transmitted, and a reference frame index matched with the current frame is allocated A reference frame matching a current frame with a current frame or a reference frame matching a final reference frame index is indexed by a predetermined reference frame holding time value and stored in a reference frame storing unit, The reference frame of the reference frame storage unit matching with the index is called as a reference frame to be compared and the current frame is restored. Accordingly, a high-quality image can be restored for a frame having a large amount of change, With it, so complexity is reduced as the search for the reference frame to obtain the effect of shortening the time motion estimation.

According to the present invention, there is an advantage that the reference frame holding time value can maximize the storage capability of the reference frame storing unit by deleting the reference frame from the current frame with respect to the receiving time value.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate preferred embodiments of the invention and, together with the description of the invention given below, serve to further understand the technical idea of the invention. And should not be construed as limiting.
FIG. 1 is an exemplary diagram showing a conventional frame in which a previous frame is allocated as a reference frame.
2 is a diagram illustrating a configuration of a motion estimation apparatus using a plurality of reference frames according to an embodiment of the present invention.
3 is a diagram illustrating a detailed configuration of an encoder according to an embodiment of the present invention.
4 is a diagram illustrating an encoder frame according to an exemplary embodiment of the present invention.
5 is a detailed configuration diagram of a decoder according to an embodiment of the present invention.
6 is a diagram illustrating a detailed configuration of an encoder according to another embodiment of the present invention.
7 is a detailed block diagram of a decoder according to another embodiment of the present invention.
8 is a flowchart illustrating a motion estimation process using a plurality of reference frames according to an embodiment of the present invention.
9 is a flowchart illustrating a motion estimation process using a plurality of reference frames according to another embodiment of the present invention.

Specific features and advantages of the present invention will become more apparent from the following detailed description based on the accompanying drawings. Prior to this, terms and words used in the present specification and claims are to be interpreted in accordance with the technical idea of the present invention based on the principle that the inventor can properly define the concept of the term in order to explain his invention in the best way. It should be interpreted in terms of meaning and concept. It is to be noted that the detailed description of known functions and constructions related to the present invention is omitted when it is determined that the gist of the present invention may be unnecessarily blurred.

2 is a diagram illustrating a configuration of a motion estimation apparatus using a plurality of reference frames according to an embodiment of the present invention. As shown in FIG. 2, the motion estimation apparatus using a plurality of reference frames according to the present invention includes an encoder 10 and a decoder 30.

Hereinafter, the encoder 10 according to the present invention should preferably be understood as a device for encoding an image of a pixel unit using a compression algorithm set in accordance with a video coding standard such as H.261, H.263, or MPEG Do.

The decoder 30 also refers to a device for decrypting a compressed file by decompressing it and converting it into an original pixel unit.

≪ Example 1 >

FIG. 3 is a diagram showing a detailed configuration of the encoder 10 shown in FIG. 2. FIG. 4 is a diagram illustrating an example of a reference frame index allocation when previous frames are used as reference frames in the encoder shown in FIG. FIG. 5 is a diagram illustrating a detailed configuration of the decoder 30 shown in FIG. 2. Referring to FIGS. 3 to 5, a detailed configuration of a motion estimation apparatus using a plurality of reference frames according to an embodiment of the present invention will be described. Look at the following.

First, the encoder 10 selects a reference frame having the highest degree of similarity with the current frame among a plurality of previous frames, adds the reference frame index allocated to the selected plurality of reference frames based on the time position to the reference frame list, 30). The reference frame index assigned to the selected reference frame is as shown in FIG.

As shown in FIG. 3, the encoder 10 uses a motion vector function value for each of a plurality of previous reference frames and a reference frame appropriate value derived from a reference frame function value, A reference frame selector 11 for selecting a reference frame Fi having the highest degree of similarity with the reference frame index Fk and a reference frame index ki according to the time position with respect to the current frame, And a reference frame indexing assignment unit 12 for transmitting the current frame.

As shown in FIG. 5, the decoder 30 for the decoder 30 includes a reference frame calling unit (called a reference frame calling unit) for calling a reference frame having the reference frame index k closest to the time position among the reference frame indexes of the current frame Fi 31), and a reference frame storage unit 32 for indexing and storing the called reference frame at a predetermined holding time (i + k) of the reference frame.

The decoder 30 includes a comparison reference frame calling unit 33 for setting a reference frame having the same reference frame index of the stored reference frame as the reference frame index of the stored reference frame as a comparison reference frame, And a current frame generator 34 for generating a current frame using a target reference frame and a motion vector of the current frame.

The decoder 30 further includes a reference frame management unit (hereinafter referred to as a reference frame management unit) 30 for deleting all the reference frames of the reference frame storage unit 32 in which the retention time value i + k of the reference frame Fi is smaller than the reception time i of the current frame 35).

That is, the reference frame calling unit 31 sets the reference frame index (k-1) having the closest reference frame index (k-1) at the time position among the reference frame indexes (k-10, Call the reference frame. The reference frame is provided to the reference frame storage unit 32. [

The reference frame storage unit 320 indexes and stores the reference frame called by the reference frame calling unit 31 as a reference frame holding time value (i + k).

The comparison target frame calling unit 33 sets a reference frame having a reference frame index of a reference frame matched with a reference frame index of the current frame Fi as a comparison target reference frame, (34).

The current frame generation unit 34 reconstructs and generates a current frame using a motion vector of a current frame and a reference frame to be compared.

Accordingly, a reference frame index having a highest degree of similarity to the current frame is allocated to a reference frame index derived from a time position, and a reference frame index having a reference frame index matched with the current frame is allocated. The reference frame is indexed with the predetermined reference frame holding time value and is stored in the reference frame storing unit and the reference frame of the reference frame storing unit matched with the reference frame index of the current frame is called as the comparison reference frame to restore the current frame Quality images can be restored with respect to a frame having a large amount of change and the complexity is reduced in searching for a reference frame having the highest degree of similarity with the current frame by using the stored reference frame index.

On the other hand, the reference frame management unit 35 deletes the reference frame in which the retention time value (i + k) of the reference frame stored in the reference frame storage unit 32 is smaller than the current frame reception time (i).

That is, the reference frame holding time value can maximize the storage capability of the reference frame storage unit 32 by deleting the reference frame from the current frame.

≪ Example 2 >

Fig. 6 is a diagram showing the detailed configuration of the encoder 10 shown in Fig. 2, and Fig. 7 is a diagram showing the detailed configuration of the decoder 30 shown in Fig. 2, A detailed configuration of a motion estimation apparatus using a plurality of reference frames according to another embodiment of the present invention is as follows.

2 selects a reference frame having the highest degree of similarity with a current frame among a plurality of previous frames and selects a reference frame index ki and a final reference frame index k-1 for the selected reference frame And transmits the current frame to the decoder 30.

As shown in FIG. 6, the encoder 10 uses the motion vector function value for each of the plurality of previous reference frames and the reference frame appropriate value derived from the reference frame function value, A reference frame selector 110 for selecting a reference frame Fi having the highest degree of similarity with respect to the selected reference frame and a reference frame index ik and a final reference frame index ki To the reference frame index list, and transmits the reference frame index to the reference frame index list.

The reference frame selecting unit 110 selects a reference frame using a motion vector function value for each of a plurality of previous reference frames existing on a time position on the basis of the current frame and a reference frame appropriate value derived from the reference frame function value, A plurality of reference frames having similarity to the current frame are selected.

The reference frame indexing allocation unit 120 allocates a reference frame index ik and a final reference frame index ki according to the time position with respect to the selected reference frame Fi, To the selected reference frame.

7, the decoder 30 includes a reference frame calling unit 310 for calling a reference frame having a final reference frame index of a current frame Fi, And a reference frame storage unit 32 for indexing and storing the frame at a retention time (i + k).

The decoder 30 further includes a comparison reference frame calling unit 330 for setting a reference frame having the same reference frame index as the reference frame index ik of the stored reference frame as a comparison reference frame, And a current frame generator 340 for generating a current frame using motion vectors of a reference frame to be compared and a current frame.

The decoder 30 may further include a reference frame management unit 350 that deletes all reference frames in which the retention time value (i + k) of the reference frame is smaller than the reception time (i) of the current frame.

The reference frame calling unit 310 calls a reference frame matched with a final reference frame index of the current frame Fi. The reference frame is provided to the reference frame storage unit 320.

The reference frame storage unit 320 indexes and stores the reference frame called by the reference frame calling unit 310 as a reference frame holding time value (i + k).

The comparison target frame calling unit 330 sets the reference frame having the reference frame index of the reference frame matched with the reference frame index ik of the current frame Fi as a comparison target reference frame, And is transmitted to the current frame generation unit 34.

The current frame generation unit 34 reconstructs and generates a current frame using a motion vector of a current frame and a reference frame to be compared.

Accordingly, the reference frame of the reference frame storage unit matching with the reference frame index of the current frame is called as a comparison reference frame to restore the current frame, so that a high-quality image can be restored for a frame having a large amount of change, The complexity is reduced in searching for a reference frame having the highest degree of similarity with the current frame, so that the motion estimation time can be shortened.

On the other hand, the reference frame management unit 350 deletes the reference frame in which the retention time value (i + k) of the reference frame stored in the reference frame storage unit 320 is smaller than the current frame reception time (i).

That is, the reference frame retention time value can maximize the storage capacity of the reference frame storage unit 320 by deleting the reference frame from the current frame with respect to the reception time value.

FIG. 8 is a flowchart illustrating a motion estimation process using a plurality of reference frames shown in FIG. 2. Referring to FIG. 8, a motion estimation process using a plurality of reference frames according to another embodiment of the present invention will be described.

First, in the reference frame selector 11 of the encoder 10, using a motion vector function value for each of a plurality of previous reference frames and a reference frame appropriate value derived from the reference frame function value, A reference frame having the highest similarity to the frame Fk is selected, and the selected reference frame is assigned a reference frame index according to the time position, and the current frame is transmitted to the decoder 30 (steps S1-S2).

The decoder 30 calls a reference frame having a reference frame index closest to the reference frame index at the time position among the reference frame indexes of the current frame Fi and sets the called reference frame to a predetermined holding time value i + And stored in the reference frame storage unit (steps S3 and S4).

Then, the decoder 30 sets a reference frame having the same reference frame index of the stored reference frame as the reference frame index of the stored reference frame as a comparison target reference frame, and then, using the called comparison reference frame and the motion vector of the current frame, And restores the frame (steps S5 and S6).

On the other hand, the decoder 30 deletes the reference frame of the reference frame storage unit 32 in which the retention time value (i + k) of the reference frame is smaller than the reception time (i) of the current frame (step S7).

Accordingly, the reference frame retention time value can maximize the storage capability of the reference frame storage unit by deleting the reference frame from the current frame with respect to the reception time value.

FIG. 9 is a flowchart illustrating a motion estimation process using a plurality of reference frames shown in FIG. 2. Referring to FIG. 9, a motion estimation process using a plurality of reference frames according to another embodiment of the present invention will be described.

First, in the encoder 10, a maximum similarity to the current frame Fk among the plurality of previous reference frames is calculated using a motion vector function value for each of a plurality of previous reference frames and a reference frame appropriate value derived from the reference frame function value The selected reference frame is selected and the current frame is transmitted to the decoder 30 by assigning the reference frame index ik and the final reference frame index ki allocated according to the time position (steps S11 and S12 ).

Then, the decoder 30 calls a reference frame having a final reference frame index matched with a final reference frame index of the current frame Fi, and indexes the called reference frame as a predetermined holding time value (i + k) And stores it in the reference frame storage unit (steps S13 and S14).

Then, the decoder 30 sets a reference frame having the same reference frame index (ik) as the reference frame index of the stored reference frame as a comparison reference frame, and then outputs the motion vector of the current frame and the called reference frame To restore the current frame (steps S15 and S16).

On the other hand, the decoder 30 deletes the reference frame of the reference frame storage unit 32 in which the retention time value (i + k) of the reference frame is smaller than the reception time of the current frame (step S17).

Accordingly, the reference frame retention time value can maximize the storage capability of the reference frame storage unit by deleting the reference frame from the current frame with respect to the reception time value.

The term " module " used in this embodiment means a hardware component such as software, FPGA or ASIC, and the module performs certain functions. However, a module is not limited to software or hardware. A module may be configured to reside on an addressable storage medium and configured to play back one or more processors. Thus, by way of example, a module may include components such as software components, object-oriented software components, class components and task components, and processes, functions, attributes, procedures, Microcode, circuitry, data, databases, data structures, tables, arrays, and variables, as will be appreciated by those skilled in the art. The functionality provided within the components and modules may be combined into a smaller number of components and modules or further separated into additional components and modules. In addition, components and modules may be implemented to play one or more CPUs in the device.

While the present invention has been particularly shown and described with reference to preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. It will be appreciated by those skilled in the art that numerous changes and modifications may be made without departing from the invention. And all such modifications and changes as fall within the scope of the present invention are therefore to be regarded as being within the scope of the present invention.

A reference frame index having a highest degree of similarity with a current frame is allocated to at least one of a reference frame index and a final reference frame index derived on a time position, A reference frame that is adjacent to the current frame or a reference frame that matches the last reference frame index is indexed by a predetermined reference frame holding time value and is stored in the reference frame storage unit and the reference frame of the reference frame storing unit A reference frame having a highest degree of similarity to the current frame is searched for by using the stored reference frame index, (I + k) is smaller than the reception time value (i), it is possible to maximize the storage capacity of the reference frame storage unit The motion estimation apparatus and method using a plurality of reference frames that can be used can be very accurate in terms of operation accuracy and reliability and further improve the performance efficiency. It is an invention that can be used industrially because it is practically possible to carry out clearly.

Claims (16)

A motion estimation apparatus using a plurality of reference frames for indexing a plurality of reference frames to estimate a motion vector,
A reference frame selector for selecting a reference frame having a highest degree of similarity with a current frame among a plurality of previous reference frames using a reference frame derived from a motion vector function value and a reference frame function value for each of a plurality of previous reference frames; And
And a reference frame indexing assignment unit for assigning a reference frame index according to a time position with respect to a selected reference frame and transmitting a current frame having an assigned reference frame index,
A reference frame calling unit for calling a reference frame having a reference frame index closest to a time position among reference frame indexes of a current frame; And
And a reference frame storage unit for indexing and storing the called reference frame at a predetermined holding time (i + k) of the reference frame,
A comparison reference frame calling unit for setting a reference frame having the same reference frame index as the reference frame index of the stored reference frame as a comparison target reference frame; And
And a current frame generator for generating a current frame using the called comparison reference frame and the motion vector of the current frame.
delete delete 2. The apparatus of claim 1,
Further comprising a reference frame managing unit for deleting a reference frame of a reference frame storing unit in which a holding time value (i + k) of the reference frame (Fi) is smaller than a receiving time (i) of a current frame. / RTI >
A motion estimation apparatus using a plurality of reference frames for constructing and indexing a reference frame to estimate a motion vector,
A reference frame selector for selecting a reference frame having a highest degree of similarity between a current frame and the previous reference frames using a reference frame derived from a motion vector function value and a reference frame function value for each of a plurality of previous reference frames; And
And an indexing assignment unit for assigning a final reference frame index (ki) and a reference frame index (ik) to the selected current frame to transmit the current frame,
And a reference frame storage unit for indexing and storing a reference frame having a final reference frame index matched with a final reference frame index of a current frame, with a holding time value (i + k) of the reference frame,
A comparison reference frame calling unit for calling a reference frame (Fi-k) stored in the reference frame storing unit using the stored reference frame index list; And
Further comprising a current frame generator for generating a current frame using the called comparison reference frame and the motion vector of the current frame.
delete delete 6. The apparatus of claim 5,
Further comprising a reference frame managing unit for deleting a reference frame of a reference frame storing unit in which a holding time value (i + k) of the reference frame (Fi) is smaller than a receiving time (i) of a current frame. / RTI > A motion estimation method using a reference frame for constructing and indexing a reference image to estimate a motion vector,
(A) selecting a reference frame having the highest degree of similarity to a current frame among the plurality of previous reference frames using a reference frame derived from a motion vector function value and a reference frame function value for each of a plurality of previous reference frames; And
(B) allocating a reference frame index (ki) according to a time position with respect to a current frame to transmit a current frame,
(C) calling a reference frame having a reference frame index closest to a time position among reference frame indexes of a current frame; And
(D) indexing and storing the called reference frame at a predetermined holding time (i + k) of the reference frame,
(E) setting a reference frame having a reference frame index of the stored reference frame equal to a reference frame index of the current frame as a comparison target reference frame; And
And (f) generating a current frame using the called reference frame and the motion vector of the current frame. delete delete 10. The method of claim 9, wherein step (d)
Further comprising: (g) deleting a reference frame of a reference frame storage unit in which the retention time value (i + k) of the reference frame (Fi) is smaller than the reception time (i) Motion estimation method using frame. A motion estimation method using a reference frame for constructing and indexing a reference image to estimate a motion vector,
(A) selecting a reference frame having a highest degree of similarity between a current frame and a plurality of previous reference frames using a reference frame derived from a motion vector function value and a reference frame function value for each of a plurality of previous reference frames; And
(B) assigning a final reference frame index (ki) and a reference frame index (ik) to the current frame to transmit the current frame,
(C) indexing and storing a reference frame (Fk) having a final reference frame index matched with a final reference frame index of a current frame (Fi) as a holding time value (i + k) of the reference frame Further comprising:
(D) calling the reference frame (Fi-k) stored in the reference frame storage unit using the stored reference frame index list; And
And generating (E) a current frame using the called comparison reference frame and the motion vector of the current frame. delete delete 14. The method of claim 13, wherein after step (C)
Further comprising: (F) deleting all reference frames in which the retention time value (i + k) of the reference frame (Fi) is smaller than the reception time (i) of the current frame Motion estimation method.


KR1020150106020A 2015-07-27 2015-07-27 Method and apparatus for estimating motion using multi reference frames KR101674556B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150106020A KR101674556B1 (en) 2015-07-27 2015-07-27 Method and apparatus for estimating motion using multi reference frames

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150106020A KR101674556B1 (en) 2015-07-27 2015-07-27 Method and apparatus for estimating motion using multi reference frames

Publications (1)

Publication Number Publication Date
KR101674556B1 true KR101674556B1 (en) 2016-11-10

Family

ID=57484570

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150106020A KR101674556B1 (en) 2015-07-27 2015-07-27 Method and apparatus for estimating motion using multi reference frames

Country Status (1)

Country Link
KR (1) KR101674556B1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020159993A1 (en) * 2019-01-28 2020-08-06 Op Solutions, Llc Explicit signaling of extended long term reference picture retention
EP3918801A4 (en) * 2019-01-28 2022-06-15 OP Solutions, LLC Online and offline selection of extended long term reference picture retention
US11595652B2 (en) * 2019-01-28 2023-02-28 Op Solutions, Llc Explicit signaling of extended long term reference picture retention

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090116281A (en) * 2008-05-07 2009-11-11 중앙대학교 산학협력단 Motion estimation procedure by fast multiple reference frame selection procedure
KR20110126544A (en) * 2010-05-17 2011-11-23 에스케이 텔레콤주식회사 Reference frame composing and indexing apparatus and method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090116281A (en) * 2008-05-07 2009-11-11 중앙대학교 산학협력단 Motion estimation procedure by fast multiple reference frame selection procedure
KR20110126544A (en) * 2010-05-17 2011-11-23 에스케이 텔레콤주식회사 Reference frame composing and indexing apparatus and method

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020159993A1 (en) * 2019-01-28 2020-08-06 Op Solutions, Llc Explicit signaling of extended long term reference picture retention
CN113615184A (en) * 2019-01-28 2021-11-05 Op方案有限责任公司 Explicit signaling to extend long-term reference picture preservation
EP3918801A4 (en) * 2019-01-28 2022-06-15 OP Solutions, LLC Online and offline selection of extended long term reference picture retention
US11595652B2 (en) * 2019-01-28 2023-02-28 Op Solutions, Llc Explicit signaling of extended long term reference picture retention
US11825075B2 (en) * 2019-01-28 2023-11-21 Op Solutions, Llc Online and offline selection of extended long term reference picture retention

Similar Documents

Publication Publication Date Title
US20220329844A1 (en) MULTIPLE HISTORY BASED NON-ADJACENT MVPs FOR WAVEFRONT PROCESSING OF VIDEO CODING
US9167250B2 (en) Method and encoding/decoding of video using common merging candidate set of asymmetric partitions
JP6334006B2 (en) System and method for high content adaptive quality restoration filtering for video coding
US10158870B2 (en) Method and apparatus for processing motion compensation of a plurality of frames
US10397567B2 (en) Motion vector coding apparatus, method and program for coding motion vector, motion vector decoding apparatus, and method and program for decoding motion vector
CN107205149B (en) Motion vector reference selection via reference frame buffer tracking
TW202021354A (en) Motion vector predictor list generation
US9961369B2 (en) Method and apparatus of disparity vector derivation in 3D video coding
US10003806B2 (en) Optimized plenoptic image encoding
KR101674556B1 (en) Method and apparatus for estimating motion using multi reference frames
KR20180054715A (en) Prediction of motion vectors using previous frame residuals
TW202038609A (en) Shared candidate list and parallel candidate list derivation for video coding
US20220232208A1 (en) Displacement vector prediction method and apparatus in video encoding and decoding and device
JP2010063092A (en) Image coding apparatus, image coding method, image coding integrated circuit and camera
TW202002654A (en) Coefficient coding with grouped bypass bins
US20220417550A1 (en) Method and apparatus for constructing motion information list in video encoding and decoding and device
US8503803B2 (en) Method and apparatus for encoding/decoding image by partitioning image
US8331704B2 (en) Coding method and coding apparatus
CN115297331A (en) Video data processing method, device, equipment and system
JP7494303B2 (en) Encoding and decoding method and device
CN110267047B (en) Video inter-frame motion estimation method, device and equipment and readable storage medium
US20160286212A1 (en) Video encoding apparatus and method, and video decoding apparatus and method
Jubran et al. Sequence-level reference frames in video coding
JP2017069617A (en) Semiconductor device and image encoding method
US9866841B2 (en) Image coding method and image coding apparatus

Legal Events

Date Code Title Description
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20191001

Year of fee payment: 4