KR20190056741A - Display apparatus and controlling method thereof - Google Patents

Abstract

The present invention relates to a display apparatus for providing an image with improved image quality, and a control method thereof. To this end, the control method of the display apparatus comprises the following steps: determining a motion vector (MV) based on the motion change amount between a current frame and previous and next frames; determining an occlusion area including an area in which a background image is covered or uncovered by a movement of a foreground image when the current frame moves to the next frame; correcting a motion vector included in the occlusion area based on a motion vector of the previous frame or the next frame; and generating an insert frame by applying the corrected motion vector.

Description

[0001] DISPLAY APPARATUS AND CONTROLLING METHOD THEREOF [0002]

The present invention relates to a display device and a control method thereof.

Liquid crystal cells of a liquid crystal display display an image by changing the transmittance according to the potential difference between the data voltage supplied to the pixel electrode and the common voltage supplied to the common electrode. The liquid crystal display device has a sample and hold characteristic in which one image is displayed while maintaining the same RGB luminance for the entire frame period. Due to such characteristics, it is possible to cause image sticking, false contour, or motion blur (hereinafter simply referred to as 'after-image') at the time of displaying a moving image through the liquid crystal display device have.

Motion estimation and motion compensation (MEMC) is widely used as a method for reducing a residual image of a display device. MEMC creates and inserts an insert frame to be inserted according to motion estimation and motion compensation between two original frames. The number of frames to be displayed per hour is increased by the inserted insert frame, and the frame rate is increased, so that the afterimage can be reduced.

At the time of motion estimation and compensation, an image is generated according to the estimated motion vector by estimating a motion vector of objects in a frame. However, there are cases in which the accurate actual motion vector can not be estimated due to various reasons in the motion estimation, and such a wrongly estimated motion vector causes severe image quality deterioration.

An area where motion estimation is difficult is an occlusion area. The occlusion region refers to an area that is visible in a time-lapse image but not in the next or previous image. This is caused by the fact that foreground objects in the scene that are closer to the camera than background objects can mask parts of the background objects. For example, when foreground objects move, some parts of the background objects are obscured, while other parts of the background objects appear.

The motion estimation is not easy because the occlusion region can not find correlated pixels in two consecutive images. As a result, the accuracy of the MEMC is lowered in the occlusion region, and consequently, the image quality of the entire image is deteriorated.

The present invention provides a display device and a control method thereof for providing an image of improved image quality by increasing the MEMC accuracy with respect to the occluded area and the occluded area which are the areas covered by the motion among the continuous images.

A control method of a display apparatus of the present invention includes: determining a motion vector (MV) based on a motion variation amount between a current frame, a previous frame, and a subsequent frame; Determining an occlusion area including an area in which a background image is obscured or exposed by movement of a foreground image when moving from the current frame to the subsequent frame; Correcting a motion vector included in the occlusion region based on a motion vector of the previous frame or a subsequent frame; And generating an insert frame by applying the corrected motion vector.

Wherein the step of determining a motion vector based on the amount of motion variation between the current frame and a previous frame and a subsequent frame includes determining a motion vector of the previous frame [t-1] - [ determining a motion vector MV0 to the motion vector; Determining MV1, which is a motion vector for a subsequent frame ([t + 1] -frame) on the basis of the current frame ([t] -frame); And determining a motion vector MV2 to the current frame ([t] -frame) on the basis of the following frame ([t + 1] -frame).

Wherein the step of determining an occlusion area including an area where an image of a background is obscured or exposed by movement of a foreground image when moving from the current frame to the subsequent frame comprises: t] -frame), if the code change of the MV1s arranged in the horizontal direction or the vertical direction does not match the preset pattern, determining the region including the MV1 as the occlusion region.

The step of determining an occlusion area including an area where an image of a background is obscured or exposed by movement of a foreground image when moving from the current frame to the subsequent frame includes: Judging the MV1 to be the occlusion region if the sign of the value calculated by multiplying the MV1s by the N * M filter in which +1 and -1 are arranged symmetrically with respect to 0 is not matched with the preset pattern .

The step of determining an occlusion area including an area where an image of a background is obscured or exposed by movement of a foreground image when moving from the current frame to the subsequent frame includes: Judging the MV1s as the occlusion region when the sign of the value calculated by multiplying the MV1s by the N * M filter in which +1 and -1 are arranged vertically symmetrically with respect to 0 is not matched with the preset pattern .

The step of correcting the motion vector included in the occlusion region based on the amount of motion variation between the previous frame or the subsequent frame includes correcting MV1 included in the occlusion region based on MV0 at the same point; And correcting MV2 contained in the occlusion region based on MV1 at the same point.

Wherein the step of correcting the motion vector included in the occlusion region based on the amount of motion variation between the previous frame or the subsequent frame includes the step of determining whether or not the occlusion region is in the background And replacing MV1 of the occlusion region with -MV0 at the same point when the image is an occluded region.

Wherein the step of correcting the motion vector included in the occlusion region based on the amount of motion variation between the previous frame and the subsequent frame includes the step of correcting the occlusion region based on the movement of the foreground image, ), It may include correcting MV1 of the current frame to -MV1 of the same point of the previous frame.

A display device of the present invention includes: a display panel; A signal input unit receiving a video signal to be displayed on the display panel; A signal processor for separating a video signal from a signal received by the signal input unit; And a frame compensator for generating an insert frame to be inserted between the original frames based on a motion vector indicating a motion variation amount between the frames of the video signal. The frame compensating unit compensates for an occlusion area including an area in which an image of a background is obscured or exposed by movement of a foreground image when moving from a current frame to a subsequent frame in an image frame input in a time- Corrects the motion vector included in the occlusion area based on the motion vector of the previous frame or the subsequent frame, and generates the insert frame.

A display device and a control method thereof according to the present invention discriminate an occlusion area, which is an exposed area and an occluded area, from continuous images, and correct the motion vector (MV) It is possible to improve the accuracy of motion estimation for the entire area.

The display device and the control method thereof according to the present invention can improve the accuracy of MEMC in the occlusion area and consequently improve the image quality of the entire image.

1 is a block diagram schematically showing a configuration of a display device according to an embodiment of the present invention.
Figs. 2 to 4 are views for explaining the concept of the MEMC.
5 is a detailed block diagram of the frame compensator shown in FIG.
6 to 9 are diagrams for explaining the principle of the MV correction method of the present invention.
10 is a view for explaining an MV correction structure according to an embodiment of the present invention.
11 to 13 are diagrams for explaining an occlusion area detecting method according to an embodiment of the present invention.
14 and 15 are views for explaining MEMC results according to an embodiment of the present invention.
FIGS. 16 and 17 are views showing the image display state when applying the MEMC method according to the comparative example and the image display state when applying the MEMC method according to the embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. It should be understood, however, that the invention is not limited to the disclosed embodiments, but is capable of many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims.

The shapes, sizes, ratios, angles, numbers, and the like disclosed in the drawings for describing the embodiments of the present invention are illustrative, and thus the present invention is not limited thereto. Like reference numerals refer to like elements throughout the specification. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. Where the terms "comprises", "having", "done", and the like are used in this specification, other portions may be added unless "only" is used. Unless the context clearly dictates otherwise, including the plural unless the context clearly dictates otherwise.

In interpreting the constituent elements, it is construed to include the error range even if there is no separate description.

In the case of a description of the positional relationship, for example, if the positional relationship between two parts is described as 'on', 'on top', 'under', and 'next to' Or " direct " is not used, one or more other portions may be located between the two portions.

The first, second, etc. may be used to describe various components, but these components are not limited by these terms. These terms are used only to distinguish one component from another. Therefore, the first component mentioned below may be the second component within the technical spirit of the present invention.

It is to be understood that each of the features of the various embodiments of the present invention may be combined or combined with each other partially or wholly and technically various interlocking and driving are possible and that the embodiments may be practiced independently of each other, It is possible.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Like reference numerals throughout the specification denote substantially identical components. In the following description, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

1 is a block diagram schematically showing a configuration of a display device according to an embodiment of the present invention.

Referring to FIG. 1, a display apparatus according to an exemplary embodiment of the present invention may include a signal input unit 100, a signal processing unit 110, a frame compensation unit 120, and a display panel 140.

The signal input unit 100 receives a signal input from the outside and outputs the signal. To this end, a tuner for tuning a signal of a channel selected by a user among broadcast signals received through an antenna or a cable, an AV terminal for receiving a signal from various external sources, an S-Video terminal, a component terminal for a PC input or a PC-signal terminal for a PC input.

The signal processing unit 110 demultiplexes a signal output from the signal receiving unit 110 into a video signal and a voice signal and decodes the separated video signal into a signal that can be displayed on the display panel 140 decoding the received signal, and perform predetermined processing for the received signal.

The display panel 140 displays an image according to a video signal output from the signal processing unit 110. For example, the display panel 140 may be a liquid crystal display device (LCD) panel. The LCD panel can display an image using light provided from a backlight unit. To this end, the LCD panel may include a liquid crystal layer and a TFT substrate and a color filter substrate facing each other with the liquid crystal layer interposed therebetween. However, the present invention is not limited to the above-described liquid crystal display device, and can be applied to various display devices such as a plasma display panel (PDP), an electro luminescent display (ELD), and a vacuum fluorescent display (VFD).

The frame compensator 120 may increase the frame rate by inserting a new insert frame between the consecutive current frame and the previous frame. For example, when a 60 Hz video signal, that is, a video signal including 60 frames per second is received, the frame compensator 120 inserts one insert frame between the consecutive current frame and the previous frame, ) Can be increased to 120 Hz. In addition, when the frame compensator 120 inserts two insert frames between the current frame and the previous frame, the frame rate of the image displayed on the display panel 140 may increase to 240 Hz.

The frame compensator 120 according to the present invention determines a motion vector (hereinafter referred to as MV) through motion estimation (ME) with respect to an image frame input in a time series, When moving to a subsequent frame, it is possible to determine the occlusion area including the area where the image of the background is covered or exposed by the movement of the foreground image. The accuracy of the MV is relatively low in the occlusion region compared to other regions. Accordingly, the frame compensator 120 corrects the MV of the occlusion region based on the MV of the previous frame or a subsequent frame, and then generates an insert frame. As described above, by improving the accuracy of motion estimation by correcting the MV of the occlusion region, the MEMC accuracy can be improved as a result, and the image quality of the entire image can be improved.

FIGS. 2 to 4 are views for explaining the basic concept of the MEMC.

Referring to FIG. 2, the MEMC is a technique for acquiring an insert frame (MEMC intermediate frame) image using a plurality of input original images. The input image may include frames (a), (b), and (c). The frame rate can be increased by inserting the frame (a-b) and the frame (b-c) between each frames, thereby reducing the blur.

In the process of acquiring an insert frame (ab) frame and a frame (bc), a process of obtaining a motion vector (MV) representing a motion between input original images is referred to as ME, and an insert frame is output This process is called motion compensation (MC). For example, (a) an object (Object) displayed in a frame may be displayed at another position in the (b) frame. The process of calculating the MV between the frame (a) and the frame (b) and generating an image so that the position of the object in the insert frame (a-b) has continuity is referred to as an MC.

3 is a diagram for explaining a motion estimation method.

As a motion estimation method, there are various methods such as a block matching method, a 3-D recursive search method, a hierarchical search method, and a MAP application method. Hereinafter, a case will be exemplified in which MV is determined using a block matching method. However, the MV estimation unit 200 of the present invention can determine MVs by various methods other than the block matching method.

Referring to FIG. 3, a block matching method according to an embodiment of the present invention includes 8x8 pixels as one MV block unit. In each block, a block of [t] -frame to [t + 1] Motion is stored in the form of values in horizontal and vertical directions. That is, MV = (mv_x, mv_y). Block matching is a process of obtaining image information in [t + 1] -frame at a position having the lowest value of image information (luminance, RGB, and the like) and cost in [t] Cost) generally uses the sum of absolute difference (SAD). The SAD can be defined as the absolute value of the difference of the image information of all the pixels included in the block. That is, the block of the previous frame data is shifted by one pixel on the basis of the block of the current frame data, and the similarity is obtained by a sum of absolute difference (SAD), and MV is calculated based on the absolute difference . The MV may indicate the direction and speed of movement of the object between the current frame data and the previous frame data on a block-by-block basis.

MV can be expressed by MV1, MV2, etc. based on MV0 and [t + 1] -frame, where [t] and [t + 1] ] -frame and MVs obtained based on a plurality of frames.

Thus, as shown in FIG. 4, MV0 can be defined as MV to [t-1] -frame based on the [t] -frame original image. MV1 can be defined as MV to [t + 1] -frame based on the [t] -frame original image. MV2 can be defined as MV to [t] -frame based on the [t + 1] -frame original image.

FIG. 5 is a detailed block diagram of the frame compensator 120 shown in FIG.

The frame compensator 120 may insert a new insert frame between the consecutive current frame and the previous frame. In order to perform such a function, the frame compensator 120 includes an MV estimator 200, an MV corrector 210, a motion compensator 220 and a pollbacker 230.

The MV estimator 200 performs ME (Motion Estimation) on the image frame input in a time-series manner to determine MVs. As the ME method, various methods such as a block matching method, a 3-D recursive search method, a hierarchical search method, and a MAP application method can be applied. The MV estimator 200 determines MV0 and MV0 that are the motion vectors of the previous frame ([t-1] -frame) and the current frame ([t] -frame) on the basis of the current frame The motion vector MV2 to the current frame ([t] -frame) can be determined with reference to the motion vector MV1 to the frame ([t + 1] -frame) and the subsequent frame .

MV correction unit 210 receives MV0, MV1, and MV2 from MV estimation unit 200 and determines an occlusion area. The occlusion area refers to the area where the background image is obscured or exposed by the movement of the foreground image. If the sign change of the MV1s arranged in the horizontal direction or the vertical direction in the current frame ([t] -frame) does not match the predetermined pattern, the MV correction unit 210 sets the region including the MV1 as the occlusion region It can be judged. The MV correction unit 210 corrects the MV included in the occlusion region based on the motion vector of the previous frame or the subsequent frame. The occlusion area determination process and the MV correction process of the MV correction unit 210 will be described in detail with reference to the drawings.

The motion compensation unit 220 generates an insert frame based on the frame in which the motion vector is corrected by the MV correction unit 210.

The poll back unit 230 may perform a fallback mode in which a previous frame is directly applied as an insert frame without motion compensation.

The insert frame generated through the motion compensating unit 220 and the poll unit 230 may be inserted between the original frames so that an image having a frame rate higher than that of the original image may be displayed on the display panel 140. [

6 to 9 are diagrams for explaining the principle of the MV correction method of the present invention.

Fig. 6 shows m1 which is MV from image1 corresponding to [t] -frame to image2 corresponding to [t + 1] -frame.

(1) shows a foreground (F) area, and (2) shows a background (B) area. (3) shows the occlusion area covered by the foreground (F) when the frame is switched from the background (B) image or from [t] to [t + 1].

(F) of the foreground (F) to the foreground (F) region. (B) of the background (B) can be correctly obtained as the background (B) region of the region (2).

On the other hand, in the area (3), the image displayed in image1 corresponding to [t] -frame is covered by foreground (F) in image2 corresponding to [t + 1] -frame.

With respect to such occlusion area, when the conventional ME method is applied, a wrong MV indicated by X is determined instead of the MV (B) in the background (B). The error of m1 deteriorates the performance of the MEMC.

FIG. 7 is a diagram for explaining the principle of MV correction according to the embodiment of the present invention, in which m0 and m1 are shown together to improve m1 accuracy in the occlusion region.

In the region of (3) where the accuracy of m1 is low, the MV of m0 has the correct value only in the opposite direction. Therefore, m1 in the area of (3) can be replaced by m0, which is the reverse of the direction only, that is, -m0, thereby increasing the accuracy.

On the other hand, in the area (2), m1 has an accurate value, and the accuracy of the m0 value is rather low. Therefore, m1 in the area of (2) should not be replaced by -m0. In other areas, there is no difference in accuracy.

Therefore, in order to increase the accuracy of m1, it is necessary to detect only the region (3) and replace it with -m0.

FIG. 8 shows m2, which is the MV from image2 corresponding to [t + 1] -frame to image1 corresponding to [t] -frame.

(a) shows a foreground (F) region, and (b) shows a background (B) region. (c) is a background (B) image. In contrast to the embodiment of Fig. 6, assuming that a frame is switched from [t + 1] to [t] The area of occlusion occluded by the photodetector.

the area (a) can accurately obtain the MV (F) of the foreground F as the foreground (F) area. (B) of the background (B) can be correctly obtained as the background (B) area.

On the other hand, in the area (c), the image displayed in image2 corresponding to [t + 1] -frame is covered by foreground (F) in image1 corresponding to [t1] -frame. As a result, the erroneous MV of X, not BG MV (B), is determined.

FIG. 9 is a view for explaining the principle of MV correction according to the embodiment of the present invention, in which m1 and m2 are shown together to improve the accuracy of m2 in the occlusion region.

In the region (c) where the accuracy of m2 is low, m1 has an exact value only in the direction of the MV, but the opposite. Therefore, m2 in the area (c) can be replaced by m1, which is the inverse of m1, that is, -m1, thereby increasing the accuracy.

On the other hand, in the region (b), m2 has an accurate value, and the accuracy of the m1 value is low. Therefore, m2 in area (b) should not be replaced by m1. In other areas, there is no difference in accuracy.

Therefore, in order to increase the accuracy of m2, only the region (c) should be detected and replaced with -m1.

As described above, the phenomenon of ME accuracy degradation in the occlusion region arises symmetrically with respect to m1 (see FIGS. 6 and 7) and m2 (see FIGS. 8 and 9), which causes MEMC performance degradation . To improve this, the present invention includes an MV correction unit 210 for discriminating an occlusion region, replacing m1 by -m0, and replacing m2 by -m1.

FIG. 10 is a diagram for explaining the MV correction structure according to the embodiment of the present invention, and may be applied at the time of MV correction of the MV correction unit 210 of FIG.

Referring to FIG. 10, the MV correcting unit 210 (see FIG. 5) receives MV0, MV1, and MV2 from the MV estimating unit 200 (see FIG. 5) and determines an occlusion area. Based on the motion vector of the previous frame or the subsequent frame.

The MV correcting unit 210 receives m1 and m2 from the MV estimating unit 200 (see Fig. 5) as an input, and outputs m1 to the m1 replacement unit m1 replacement (rep.) And the m2 replacement unit m2 replacement (rep. Respectively. m2 is input to m2 replacement (m2 replacement (rep.)) and is also stored in memory.

The m2 value stored in memory is called in [t + 1] -frame. Considering the [t] -frame as a reference, the value received from the memory in the m1 replacement (rep.) Is m1 in [t-1] . That is, the m1 replacement (m1 replacement (rep.)) Corrects m1 through m0 and m1, and the m2 replacement (m2 replacement (rep.)) Can correct m2 through m1 and m2.

11 to 13 are diagrams for explaining an occlusion area detecting method according to an embodiment of the present invention. The occlusion region is more likely to occur due to horizontal or vertical movement of the foreground image. Therefore, it is possible to detect the occlusion region by analyzing the horizontal direction or vertical direction characteristics of m1.

11 is a diagram illustrating a case where m1 is analyzed on the basis of the horizontal motion for the occlusion area detection.

In the analysis of the horizontal movement of m1, the relative value of the MV is distributed as the left (+) and the right (-) in the occlusion region. By using these characteristics, it is possible to detect the occlusion region by analyzing the horizontal motion characteristic of m1.

As shown in FIG. 11, the MV of the area (3) is a positive value (rightward motion), the MV of the area (2) is a negative value (leftward motion relative to the left) (3) and (2) can be detected as the occlusion region.

On the other hand, the case where the MV of (3) is 0 as in (1) can also occur. In this case, the area of (3) and (2) It can be detected as a full-blown area.

This principle can also be applied to vertical direction analysis. In other words, when the vertical movement of m1 is analyzed, the relative value of MV is distributed in the upward and downward directions in the occlusion region. By using these characteristics, it is possible to detect the occlusion region by analyzing the vertical motion characteristics of m1.

FIG. 12 illustrates a filter for detecting an occlusion region on the basis of a horizontal movement, and FIG. 13 illustrates a filter for detecting an occlusion region on the basis of a vertical movement.

Fig. 12 illustrates a horizontally oriented oblique region detection filter having a 5 * 3 MV block size. The horizontal direction oblique region detection filter can be set in such a manner that +1 and -1 are arranged symmetrically with respect to 0 as a center.

13 illustrates a vertical direction occlusion region detection filter having a 3 * 3 MV block size. The vertical direction oblique region detection filter can be set in such a manner that +1 and -1 are arranged vertically symmetrically around 0.

A filter having such a configuration is shifted in units of predetermined MV blocks, and the MV in the block of the frame is multiplied by the filter value to obtain a region having a distribution of left positive (+) negative (-) or a region having positive It is possible to detect the occlusion region by determining the region having the distribution.

14 and 15 are views for explaining MEMC results according to an embodiment of the present invention.

Figs. 14A and 14B show m1 which is MV from image1 corresponding to [t] -frame to image2 corresponding to [t + 1] -frame, and insert frame (MCI) generated based on m1 is inserted and displayed The results are shown.

14A is a diagram illustrating a case where an insert frame MCI is generated without correcting m1 as a comparative example. [t] -frame is overlaid by foreground (F) in image2 corresponding to [t + 1] -frame.

For this occlusion area, if the conventional ME method is applied, the erroneous MV indicated by the dotted line is determined instead of the MV indicated by the solid line. An error occurs in the insert frame MCI generated based on the erroneously calculated m1 (dashed line) so that the image to be close to the foreground F side is displayed at a position away from the foreground F. [ Such an error may cause image deterioration such as a residual image in an image.

14B is a diagram illustrating a case where an insert frame MCI is generated after replacing m1 with -m0 according to the present invention. In the low-accuracy region of m1, m0 has an exact MV value only in the direction opposite to m1. Therefore, m1 can be corrected to corrected m1 (solid line) by replacing m1 with -m0 at the same point. The insert frame MCI generated on the basis of the corrected m1 (solid line) can be displayed at the correct position, i.e., the image which is gradually shaded close to the foreground F side.

As described above, by correcting m1 by replacing m1 with -m0, the accuracy of the MCI image can be improved, and as a result, the image quality can be improved.

Figs. 15A and 15B illustrate m2, which is MV from image2 corresponding to [t + 1] -frame to image1 corresponding to [t] -frame, and insert frame (MCI) generated based on m2 is inserted and displayed The results are shown.

15A is a diagram illustrating a case where an insert frame MCI is generated without correcting m2 as a comparative example. On the other hand, in the area (c), the image displayed in image2 corresponding to [t + 1] -frame is covered by foreground (F) in image1 corresponding to [t1] -frame. For this occlusion area, if the conventional ME method is applied, the erroneous MV indicated by the dotted line is determined instead of the MV indicated by the solid line. An error is generated in the insert frame MCI generated based on the erroneously calculated m2 (dotted line) that the image displayed in accordance with the movement of the foreground F is displayed at the wrong position. Such an error may cause image deterioration such as a residual image in an image.

FIG. 15B is a diagram illustrating a case where an insert frame (MCI) is generated after replacing m2 with -m1 according to the present invention. In the low-accuracy region, m1 has an exact MV value only in the direction opposite to m2. Therefore, m2 can be corrected to m2 (solid line) corrected by substituting -m1 at the same point. The insert frame MCI generated on the basis of the corrected m2 (solid line) can be displayed at an accurate position in an image that is gradually exposed as the foreground F moves.

FIGS. 16 and 17 are views showing the image display state when applying the MEMC method according to the comparative example and the image display state when applying the MEMC method according to the embodiment of the present invention.

FIG. 16 is a diagram showing an example of a case where the image displayed in image1 corresponding to [t] -frame is m1 for an image including an occlusion area covered by foreground F in image2 corresponding to [t + 1] The case where the image is directly applied and the image to be displayed when m1 is replaced with -m0 is started.

16 shows an example in which the motion of the foreground (F) region (person) is stopped and the motion of the background (B) region (wall, tree, etc.) is directed to the left through m1.

The part corresponding to the foreground (F) area (person) is outputted as an accurate value when it is expressed in red color, and when the part corresponding to the background (B) area (wall, Value.

It is confirmed that the incorrect MV value (red color) in the right occlusion area (view of m1) corresponding to the right side of the foreground (F) area and the left side of the screen is improved to the correct MV value (green) .

FIG. 17 shows a video image in the case where m2 is replaced with -m1 for an image including an occlusion area.

The image of Fig. 17 shows motion of the foreground (F) region (person) is stopped and motion of the background (B) region (wall, tree, etc.) is shown through m2 to the left. Since the direction is opposite to m1, the color representation is reversed in the example of m2.

The portion corresponding to the foreground (F) region is output as an accurate value when expressed in a transparent color, and the portion corresponding to the background (B) region (wall, tree, etc.) Is output.

It is confirmed that an incorrect MV value (transparent color) is improved to an accurate MV value (red color) after the application of the present invention in the occlusion region (viewpoint of m2) corresponding to the left side of the foreground (F) region and the right side of the screen have.

As described above, according to the present invention, an occlusion area, which is an obstructed area and an occlusion area, is discriminated and a motion vector (MV) Motion Estimation). In the embodiment of the present invention, MV1 in the occlusion region is replaced by -MV0, and MV2 is replaced by -MV1 to improve the accuracy of MV. By improving the accuracy of the MV as described above, the accuracy of the MEMC can be improved, and as a result, the image quality of the entire image can be improved.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. Therefore, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification, but should be defined by the claims.

100: signal input unit 110: signal processing unit
120: frame compensator 140: display panel

Claims (15)

Determining a motion vector (MV) based on a motion variation between a current frame and a previous frame and a subsequent frame;
Determining an occlusion area including an area in which a background image is obscured or exposed by movement of a foreground image when moving from the current frame to the subsequent frame;
Correcting a motion vector included in the occlusion region based on a motion vector of the previous frame or a subsequent frame; And
Generating an insert frame by applying the corrected motion vector;
And controlling the display device. The method according to claim 1,
The step of determining a motion vector (MV) based on the amount of motion variation between the current frame and a previous frame and a subsequent frame includes:
Determining a motion vector MV0 to a previous frame ([t-1] -frame) on the basis of the current frame ([t] -frame);
Determining MV1, which is a motion vector for a subsequent frame ([t + 1] -frame) on the basis of the current frame ([t] -frame); And
Determining a motion vector MV2 to the current frame ([t] -frame) on the basis of the following frame ([t + 1] -frame);
And controlling the display device. 3. The method of claim 2,
Wherein the step of determining an occlusion area including an area in which a background image is obscured or exposed by movement of a foreground image when moving from the current frame to the subsequent frame,
If the sign change of the MV1s arranged in the horizontal direction or the vertical direction in the current frame ([t] -frame) does not match the preset pattern, the step of judging the area including the MV1 as the occlusion area Of the display device. The method of claim 3,
Wherein the step of determining an occlusion area including an area in which a background image is obscured or exposed by movement of a foreground image when moving from the current frame to the subsequent frame,
When the sign of the value calculated by multiplying MV1 arranged in the horizontal direction by the N * M filter in which +1 and -1 are symmetrically arranged with 0 centering on 0 is not matched with the preset pattern, Of the display device. The method of claim 3,
Wherein the step of determining an occlusion area including an area in which a background image is obscured or exposed by movement of a foreground image when moving from the current frame to the subsequent frame,
When the sign of the value calculated by multiplying MV1 arranged in the vertical direction by an N * M filter in which +1 and -1 are arranged vertically symmetrically with respect to 0 is not matched with a preset pattern, Of the display device. 3. The method of claim 2,
The step of correcting the motion vector included in the occlusion region based on the amount of motion variation between the previous frame or the subsequent frame includes:
Correcting MV1 included in the occlusion region based on MV0 at the same point; And
Correcting MV2 contained in the occlusion region based on MV1 at the same point;
And controlling the display device. 3. The method of claim 2,
The step of correcting the motion vector included in the occlusion region based on the amount of motion variation between the previous frame or the subsequent frame includes:
And replacing MV1 of the occlusion region with -MV0 at the same point when the occlusion region is an area where the background image is covered by the foreground image Of the display device. 3. The method of claim 2,
The step of correcting the motion vector included in the occlusion region based on the amount of motion variation between the previous frame or the subsequent frame includes:
And correcting the MV1 of the current frame to -MV1 of the same point of the previous frame if the occlusion region is an area where the image of the background is exposed as the foreground image moves A method of controlling a display device. A display panel;
A signal input unit receiving a video signal to be displayed on the display panel;
A signal processor for separating a video signal from a signal received by the signal input unit; And
And a frame compensator for generating an insert frame to be inserted between the original frames based on a motion vector indicating a motion variation amount between frames of the video signal,
Wherein the frame compensator comprises:
When moving from the current frame to the next frame in the thermally input image frame, it determines the occlusion area including the area where the background image is obscured or revealed by the movement of the foreground image And corrects the motion vector included in the occlusion area based on the motion vector of the previous frame or the subsequent frame, and generates the insert frame. 10. The method of claim 9,
Wherein the frame compensator comprises:
(T + 1) -frame on the basis of the current frame ([t] -frame) as the motion vector MV0 to the previous frame ([t] ] - frame, MV1, MV2, which is a motion vector to the current frame ([t] -frame), with reference to the frame ([t + 1] -frame)
If the sign change of the MV1s arranged in the horizontal direction or the vertical direction in the current frame ([t] -frame) does not match the predetermined pattern, the region including the MV1 is determined as the occlusion region, An MV correction unit for correcting a motion vector included in the entire area based on the motion vectors of the previous frame or the subsequent frame; And
A motion compensation unit for generating the insert frame based on the frame in which the motion vector is corrected;
. 10. The method of claim 9,
Wherein the frame compensator comprises:
A filter applied to the MV1s arranged in the horizontal direction, the N * M filter being arranged such that +1 and -1 are symmetrically arranged around 0 and multiplied by MV1 arranged in the horizontal direction. 10. The method of claim 9,
Wherein the frame compensator comprises:
And a N × M filter applied to MV1 arranged in the vertical direction, wherein +1 and -1 are arranged vertically symmetrically with respect to 0 and multiplied by MV1 arranged in the vertical direction. 11. The method of claim 10,
Wherein the MV correcting unit comprises:
MV1 included in the occlusion region is corrected based on MV0 at the same point, and MV2 is corrected based on MV1 at the same point. 11. The method of claim 10,
Wherein the MV correcting unit comprises:
And MV1 of the occlusion region is replaced by -MV0 at the same point when the occlusion region is an area covered with the background image by the foreground image. 11. The method of claim 10,
Wherein the MV correcting unit comprises:
The display device according to claim 1, wherein, when the occlusion area is an area in which the image of the background is exposed according to the movement of the foreground image, the MV1 of the current frame is replaced with -MV1 of the same point of the previous frame, .

Images