KR102404389B1 - Display apparatus and controlling method thereof - Google Patents

Abstract

The present invention relates to a display apparatus and a method for controlling the same, comprising: determining a motion vector (MV) based on a motion variation between a current frame and a previous frame and a subsequent frame; determining an occlusion area including an area in which an image of a background is hidden or exposed by movement of a foreground image when moving from the current frame to the next frame; correcting a motion vector included in the occlusion region based on a motion vector of the previous frame or the subsequent frame; and generating an insert frame by applying the corrected motion vector.

Description

Display device and its control method {DISPLAY APPARATUS AND CONTROLLING METHOD THEREOF}

The present invention relates to a display device and a method for controlling the same.

Liquid crystal cells of a liquid crystal display display an image by changing transmittance according to a potential difference between a data voltage supplied to a pixel electrode and a common voltage supplied to a common electrode. The liquid crystal display has sample and hold characteristics in which one image is displayed while maintaining the same RGB luminance during the entire frame period. Due to these characteristics, image sticking, false contour, or image blurring (motion blur) (hereinafter simply referred to as 'afterimage') may occur when displaying a video through a liquid crystal display device. have.

Motion estimation/compensation (MEMC) is widely used as a method for reducing an afterimage of a display device. MEMC generates and inserts an insert frame to be inserted between two original frames according to motion estimation and motion compensation. Since the number of frames displayed per time increases as much as the inserted insert frame increases the frame rate, the afterimage may be reduced.

In motion estimation and compensation, motion vectors of objects in a frame are estimated and an image is generated according to the estimated motion vectors. However, during motion estimation, it may not be possible to accurately estimate an actual motion vector for various reasons, and such an erroneously estimated motion vector causes serious image quality degradation.

An area in which motion estimation is difficult includes an occlusion area. The occlusion area refers to an area that is visible in the image at a specific point in time among images inputted in time series but is not visible in the next or previous image. This is caused by the fact that foreground objects in the scene located closer to the camera than background objects may obscure parts of the background objects. For example, when foreground objects are moved, some parts of the background objects are obscured, while other parts of the background objects are made visible.

In the occlusion region, motion estimation is not easy because interrelated pixels cannot be found in two consecutive images. Accordingly, in the occlusion region, MEMC accuracy is lowered, and consequently, there is a problem in that the image quality of the entire image is deteriorated.

The present invention provides a display apparatus and a control method for providing an image with improved image quality by increasing MEMC accuracy for an occlusion area that is an area covered by a motion and an area exposed by a motion among consecutive images.

A method of controlling a display apparatus of the present invention includes: determining a motion vector (MV) based on a motion variation between a current frame and a previous frame and a subsequent frame; determining an occlusion area including an area in which an image of a background is hidden or exposed by movement of a foreground image when moving from the current frame to the next frame; correcting a motion vector included in the occlusion region based on a motion vector of the previous frame or the subsequent frame; and generating an insert frame by applying the corrected motion vector.

The step of determining a motion vector (MV) based on the amount of motion variation between the current frame and the previous frame and the subsequent frame includes the current frame ([t]-frame) and the previous frame ([t-1]- determining MV0, which is a motion vector to frame); determining MV1 as a motion vector to a subsequent frame ([t+1]-frame) based on the current frame ([t]-frame); and determining MV2, which is a motion vector to the current frame ([t]-frame), based on the subsequent frame ([t+1]-frame).

When moving from the current frame to the subsequent frame, the step of determining the occlusion area including the area in which the image of the background is hidden or exposed by the movement of the foreground image includes the current frame ([ t]-frame), when the sign change of the MV1s arranged in the horizontal or vertical direction does not match a preset pattern, determining an area including the corresponding MV1 as the occlusion area.

When moving from the current frame to the next frame, the step of determining an occlusion area including an area in which an image of a background is hidden or exposed by movement of a foreground image comprises: arranging in the horizontal direction If the sign of the value calculated by multiplying the N*M filters in which +1 and -1 are symmetrically arranged left and right with respect to 0 as the center of the MV1s does not match the preset pattern, determining the occlusion area. may include

When moving from the current frame to the next frame, the step of determining the occlusion area including the area where the background image is hidden or exposed by the movement of the foreground image is arranged in the vertical direction If the sign of the value calculated by multiplying the N*M filters in which +1 and -1 are vertically symmetrically arranged with respect to 0 as the center of 0 for the MV1s does not match the preset pattern, determining the occlusion area. may include

Compensating the motion vector included in the occlusion region based on the amount of motion variation between the previous frame or the subsequent frames may include: correcting MV1 included in the occlusion region based on MV0 of the same point; and correcting MV2 included in the occlusion region based on MV1 of the same point.

The step of correcting the motion vector included in the occlusion region based on the amount of motion variation between the previous frame or the subsequent frames may include: When the image is an area to be covered, the method may include correcting by replacing MV1 of the occlusion area with -MV0 of the same point.

The step of correcting the motion vector included in the occlusion region based on the amount of motion variation between the previous frame or the subsequent frames may include: ), correcting MV1 of the current frame to -MV1 of the same point of the previous frame when the image of ) is exposed.

The display apparatus of the present invention includes a display panel; a signal input unit for receiving an image signal to be displayed on the display panel; a signal processing unit for separating an image signal from the signal received through the signal input unit; and a frame compensator for generating an insert frame to be inserted between original frames based on a motion vector indicating an amount of motion variation between frames of the video signal. The frame compensator, when moving from the current frame to the next frame in a time-series input image frame, an occlusion area including an area in which an image of a background is hidden or exposed by movement of a foreground image After determining and correcting the motion vector included in the occlusion region based on the motion vector of the previous frame or the subsequent frame, the insert frame is generated.

The display apparatus and the control method thereof according to the present invention discriminate an occlusion area, which is an area covered by motion and an area exposed by motion, from among successive images, and correct the motion vector (MV) of the corresponding area for occlusion. It is possible to increase the accuracy of motion estimation for the entire region.

The display apparatus and the control method thereof of the present invention can improve the MEMC accuracy in the occlusion region, and consequently the image quality of the entire image can be improved.

1 is a block diagram schematically showing the configuration of a display device according to an embodiment of the present invention.
2 to 4 are diagrams for explaining the concept of MEMC.
FIG. 5 is a block diagram illustrating the frame compensator shown in FIG. 1 in detail.
6 to 9 are diagrams for explaining the principle of the MV correction method of the present invention.
10 is a diagram for explaining an MV correction structure according to an embodiment of the present invention.
11 to 13 are diagrams for explaining a method for detecting an occlusion region according to an embodiment of the present invention.
14 and 15 are diagrams for explaining MEMC results according to an embodiment of the present invention.
16 and 17 are diagrams illustrating a comparison of the image display state when the MEMC method according to the comparative example is applied and the image display state when the MEMC method according to the embodiment of the present invention is applied.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be embodied in various different forms, and only these embodiments allow the disclosure of the present invention to be complete, and common knowledge in the art to which the present invention pertains It is provided to fully inform those who have the scope of the invention, and the present invention is only defined by the scope of the claims.

The shapes, sizes, proportions, angles, numbers, etc. disclosed in the drawings for explaining the embodiments of the present invention are illustrative and the present invention is not limited to the illustrated matters. Like reference numerals refer to like elements throughout. In addition, in describing the present invention, if it is determined that a detailed description of a related known technology may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. When 'including', 'having', 'consisting', etc. mentioned in this specification are used, other parts may be added unless 'only' is used. When a component is expressed in the singular, cases including the plural are included unless otherwise explicitly stated.

In interpreting the components, it is construed as including an error range even if there is no separate explicit description.

In the case of a description of the positional relationship, for example, when the positional relationship of two parts is described as 'on', 'on', 'on', 'next to', etc., 'right' Alternatively, one or more other parts may be positioned between two parts unless 'directly' is used.

The first, second, etc. may be used to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one component from another. Accordingly, the first component mentioned below may be the second component within the spirit of the present invention.

Each feature of the various embodiments of the present invention may be partially or wholly combined or combined with each other, technically various interlocking and driving are possible, and each embodiment may be implemented independently of each other or may be implemented together in a related relationship. may be

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings. Like reference numerals refer to substantially identical elements throughout. In the following description, if it is determined that a detailed description of a known function or configuration related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

1 is a block diagram schematically showing the configuration of a display device according to an embodiment of the present invention.

Referring to FIG. 1 , a display apparatus according to an embodiment of the present invention may include a signal input unit 100 , a signal processing unit 110 , a frame compensator 120 , and a display panel 140 .

The signal input unit 100 receives and outputs a signal input from the outside. To this end, a tuner for tuning a signal of a channel selected by a user among broadcast signals received through an antenna or a cable, or an AV terminal, S-Video terminal, and component for receiving signals from various external sources It may include a (component) terminal or a PC-Signal terminal for PC input.

The signal processing unit 110 demultiplexes the signal output from the signal receiving unit 110 to separate it into an image signal and an audio signal, and decodes the separated image signal into a signal displayable on the display panel 140 ( decoding), etc., may perform predetermined processing on the received signal.

The display panel 140 displays an image according to an image signal output from the signal processing unit 110 . For example, the display panel 140 may be a liquid crystal display device (LCD) panel. The LCD panel may display an image using light provided from the backlight unit. For this purpose, the LCD panel may include a liquid crystal layer and a TFT substrate and a color filter substrate facing each other with the liquid crystal layer interposed therebetween. However, the present invention is not limited to the liquid crystal display device as described above, and may be applied to various display devices such as a plasma display panel (PDP), an electro luminescent display (ELD), and a vacuum fluorescent display (VFD).

The frame compensator 120 may increase the frame rate by inserting a new insert frame between a continuous current frame and a previous frame. For example, when an image signal of 60 Hz, that is, an image signal including 60 frames per second is received, the frame compensator 120 inserts one insert frame between the continuous current frame and the previous frame, so that the display panel 140 ), the frame rate of the displayed image may be increased to 120 Hz. Also, when the frame compensator 120 inserts two insert frames between the current frame and the previous frame, the frame rate of the image displayed on the display panel 140 may increase to 240 Hz.

The frame compensator 120 according to the present invention determines a motion vector (hereinafter referred to as MV) through motion estimation (hereinafter referred to as ME) for an image frame inputted in time series, and determines the current frame When moving from to a subsequent frame, it is possible to determine an occlusion area including an area in which a background image is hidden or exposed by the movement of the foreground image. The occlusion region has relatively low MV accuracy compared to other regions. Accordingly, the frame compensator 120 according to the present invention corrects the MV of the occlusion region based on the MV of the previous frame or the subsequent frame, and then generates an insert frame. As described above, by improving the accuracy of motion estimation by correcting the MV of the occlusion region, as a result, MEMC accuracy can be improved, thereby improving the quality of the entire image.

2 to 4 are diagrams for explaining the basic concept of MEMC.

Referring to FIG. 2 , MEMC is a technology for acquiring an insert frame (MEMC intermediate frame) image using a plurality of input original images. The input image may include (a), (b), and (c) frames. The frame rate can be increased by inserting frames (a-b) and (b-c) between each frame, thereby reducing blur.

The process of obtaining the motion vector (MV) representing the motion between the input original images in the process of acquiring the insert frame (a-b) frame and (b-c) frame is called ME, and the insert frame is output using the MV and the original image. This process is called motion compensation (MC). For example, the object displayed in the frame (a) may be displayed in a different position in the frame (b). Accordingly, the process of generating an image so that the position of the object can have continuity in the insert frame (a-b) by calculating the MV between the frames (a) and (b) is referred to as MC.

3 is a diagram for explaining a motion estimation method.

As a motion estimation method, there are various methods such as a block matching method, a 3-D recursive search method, a hierarchical search method, and a MAP application method. In the following embodiment, a case in which the MV is determined using the block matching method will be exemplified. However, the MV estimator 200 of the present invention may determine the MV in various methods other than the block matching method.

Referring to FIG. 3 , in the block matching method according to an embodiment of the present invention, 8x8 pixels are used as one MV block unit, and in each block, the image from [t]-frame to [t+1]-frame is Stores the MV in the form of values in the horizontal and vertical directions of movement. That is, it may be expressed as MV=(mv_x, mv_y). Block matching is a process of obtaining image information in [t+1]-frame at the position where the image information (luminance, RGB, etc.) in the [t]-frame and the cost have the lowest value, and the cost ( Cost) is generally the most widely used sum of absolute difference (SAD). SAD may be defined as the absolute value of the difference in image information of all pixels included in the block. That is, based on the block of the current frame data, the block of the previous frame data is moved one pixel at a time, the similarity is calculated as the sum of absolute difference (SAD), and the MV is calculated based on the sum of the absolute difference (SAD). Calculate. The MV may indicate the movement direction and speed of the object between the current frame data and the previous frame data in block units.

The value obtained based on [t]-frame for block matching can be expressed as MV0, and the value obtained based on [t+1]-frame can be expressed as MV1, MV2, etc. In general, ME is [t], [t+1] All MVs obtained based on a plurality of frames, including ]-frame, may be included.

Accordingly, as shown in FIG. 4 , MV0 may be defined as an MV of [t-1]-frame based on the [t]-frame original image. MV1 may be defined as an MV of [t+1]-frame based on the [t]-frame original image. MV2 may be defined as an MV of [t]-frame based on the [t+1]-frame original image.

FIG. 5 is a detailed block diagram showing the frame compensator 120 shown in FIG. 1 .

The frame compensator 120 may insert a new insert frame between a continuous current frame and a previous frame. To perform this function, the frame compensator 120 includes an MV estimator 200 , an MV compensator 210 , a motion compensator 220 , and a fallback unit 230 .

The MV estimator 200 determines the MV by performing motion estimation (ME) on the image frames inputted in time series. As the ME method, various methods such as a block matching method, a 3-D recursive search method, a hierarchical search method, and a MAP application method may be applied. The MV estimator 200 is a motion vector MV0 from the current frame ([t]-frame) to the previous frame ([t-1]-frame) based on the current frame ([t]-frame). It is possible to determine MV1, which is a motion vector to a frame ([t+1]-frame), and MV2, which is a motion vector to a current frame ([t]-frame), based on a subsequent frame ([t+1]-frame). .

The MV compensator 210 receives MV0, MV1, and MV2 from the MV estimator 200 to determine the occlusion area. The occlusion area refers to an area in which a background image is hidden or exposed by movement of the foreground image. The MV compensator 210 converts the region including the MV1 into the occlusion region when the sign change of the MV1s arranged in the horizontal or vertical direction in the current frame ([t]-frame) does not match a preset pattern. can judge The MV compensator 210 corrects the MV included in the occlusion region based on the motion vector of the previous frame or the subsequent frame. The occlusion region determination process and the MV correction process of the MV correction unit 210 will be described in more detail later with reference to the drawings.

The motion compensator 220 generates an insert frame based on the frame in which the motion vector is corrected by the MV compensator 210 .

The fallback unit 230 may perform a fallback mode in which a previous frame is applied as an insert frame as it is without motion compensation.

The insert frame generated by the motion compensator 220 and the fallback unit 230 is inserted between the original frames so that an image having an increased frame rate compared to the original image may be displayed on the display panel 140 .

6 to 9 are diagrams for explaining the principle of the MV correction method of the present invention.

6 shows the MV m1 from image1 corresponding to [t]-frame to image2 corresponding to [t+1]-frame.

(1) shows the foreground (F) area, (2) shows the background (background, B) area. (3) shows the background (B) image or the occlusion area covered by the foreground (F) when the frame is switched from [t] to [t+1].

The area of (1) is the foreground (F) area, and the MV(F) of the foreground (F) can be correctly obtained. The area of (2) is the background (B) area, and the MV(B) of the background (B) can be correctly obtained.

On the other hand, in the area of (3), the ● image displayed in image1 corresponding to [t]-frame is covered by the foreground (F) in image2 corresponding to [t+1]-frame.

For such an occlusion region, when the conventional ME method is applied, an incorrect MV indicated by X is determined instead of the MV (B) of the background (B). This m1 error degrades the performance of the MEMC.

7 is a diagram for explaining the MV correction principle according to an embodiment of the present invention, and m0 and m1 are shown together to improve m1 accuracy in the occlusion region.

In the region of (3) where the accuracy of m1 is low, the MV of m0 has an exact value only in the opposite direction. Therefore, m1 of the region of (3) can be replaced with m0 that only reverses the direction, that is, -m0 to increase the accuracy.

On the other hand, in the region of (2), m1 has an accurate value, and the accuracy of the m0 value is rather low. Therefore, m1 in the area of (2) should not be replaced by -m0. There is no difference in accuracy in other areas.

Therefore, in order to increase the accuracy of m1, it is necessary to detect only the region of (3) and replace it with -m0.

8 shows the MV m2 from image2 corresponding to [t+1]-frame to image1 corresponding to [t]-frame.

(a) shows the foreground (F) area, (b) shows the background (background, B) area. (c) is a background (B) image. Contrary to the embodiment of FIG. 6 , when it is assumed that the frame is switched from [t+1] to [t] (the opposite situation to m1), the foreground (F) It shows the occlusion area covered by .

The area in (a) is the foreground (F) area, and the MV(F) of the foreground (F) can be correctly obtained. The area of (b) is the background (B) area, and the MV(B) of the background (B) can be correctly obtained.

On the other hand, in the area of (c), the ● image displayed in image2 corresponding to [t+1]-frame is obscured by the foreground (F) in image1 corresponding to [t1]-frame. This determines the incorrect MV of X, not the BG MV(B).

9 is a diagram for explaining the MV correction principle according to an embodiment of the present invention, and shows m1 and m2 together to improve accuracy of m2 in the occlusion region.

In the region of (c) where the accuracy of m2 is low, m1 has an exact value only in the opposite direction of the MV. Therefore, the accuracy can be improved by replacing m2 of the region in (c) with m1 that only reverses the direction, that is, -m1.

On the other hand, in the region of (b), m2 has an accurate value, and the accuracy of the m1 value is rather low. Therefore, m2 of the area in (b) should not be replaced by m1. There is no difference in accuracy in other areas.

Therefore, in order to increase the accuracy of m2, only the area in (c) should be detected and replaced with -m1.

As described above, the degradation of ME accuracy in the occlusion region occurs symmetrically as in m1 (refer to FIGS. 6 and 7) and m2 (refer to FIGS. 8 and 9), which leads to deterioration of MEMC performance. . In order to improve this, the present invention includes an MV correction unit 210 that determines the occlusion area and replaces m1 with -m0 and m2 with -m1.

FIG. 10 is a diagram for explaining an MV correction structure according to an embodiment of the present invention, and may be applied during MV correction of the MV correction unit 210 of FIG. 5 .

Referring to FIG. 10 , the MV compensator 210 (refer to FIG. 5 ) receives MV0, MV1, and MV2 from the MV estimator 200 (refer to FIG. 5 ), determines the occlusion region, and includes it in the occlusion region. The MV is corrected based on the motion vector of the previous frame or the subsequent frame.

When the MV correction unit 210 receives m1 and m2 from the MV estimator 200 (refer to FIG. 5 ) as inputs, m1 is replaced by an m1 replacement unit (m1 replacement(rep.)) and an m2 replacement unit (m2 replacement(rep.) ), respectively. m2 is input to m2 replacement(rep.) and also stored in memory.

The m2 value stored in memory is called in [t+1]-frame. That is, considering the [t]-frame as a standard, the value input from the memory in the m1 replacement (rep.) is m2 in the [t-1]-frame, and m0 in the [t]-frame applies to That is, the m1 replacement unit (m1 replacement(rep.)) may correct m1 through m0 and m1, and the m2 replacement unit (m2 replacement(rep.)) may correct m2 through m1 and m2.

11 to 13 are diagrams for explaining a method for detecting an occlusion region according to an embodiment of the present invention. The occlusion region is highly likely to occur due to horizontal or vertical movement of the foreground image. Accordingly, it is possible to detect the occlusion region by analyzing the horizontal or vertical characteristics of m1.

11 is a diagram illustrating a case of analysis based on horizontal movement of m1 for detecting an occlusion region.

When analyzed based on the horizontal movement of m1, in the occlusion region, the relative value of MV is distributed in left positive (+) and right negative (-) directions. It is possible to detect the occlusion region by analyzing the horizontal motion characteristic of m1 using this characteristic.

As shown in FIG. 11 , the MV of region (3) has a positive (+) value (right-direction motion), and the MV of region (2) has a negative (-) value (relatively left-direction motion compared to the left). When detected as , the regions of (3) and (2) can be detected as an occlusion region.

On the other hand, on the other hand, there may also be a case where the MV of (3) is 0 as in (1). Also in this case, the regions of (3) and (2) are misplaced because they correspond to the distribution of left-right (+) and right-tone (-). It can be detected as a closure region.

The same principle can be applied to vertical direction analysis. That is, when analyzed based on the vertical motion of m1, the relative value of MV is distributed in positive (+) and negative (-) in the occlusion region. It is possible to detect the occlusion region by analyzing the vertical motion characteristic of m1 using this characteristic.

12 illustrates a filter for detecting an occlusion area based on horizontal motion, and FIG. 13 illustrates a filter for detecting an occlusion area based on vertical motion.

12 illustrates a horizontal occlusion region detection filter having a 5*3 MV block size. The horizontal occlusion region detection filter may be set in a form in which +1 and -1 are symmetrically arranged around 0.

13 illustrates a vertical occlusion region detection filter having a 3*3 MV block size. The vertical occlusion region detection filter may be set in a form in which +1 and -1 are vertically symmetrical with respect to 0.

By multiplying the filter value by the MV in the block of the frame while moving the filter having such a configuration in units of a predetermined MV block, a region having a distribution of left (+) and right (-) or positive (+) and negative (-) An occlusion region may be detected by determining a region having a distribution.

14 and 15 are diagrams for explaining MEMC results according to an embodiment of the present invention.

14A and 14B show m1, which is an MV from image1 corresponding to [t]-frame to image2 corresponding to [t+1]-frame, and inserting and displaying an insert frame (MCI) generated based on m1. the results are shown.

14A is a diagram illustrating a case in which an insert frame (MCI) is generated without correcting m1 as a comparative example. The image displayed in image1 corresponding to [t]-frame is covered by the foreground (F) in image2 corresponding to [t+1]-frame.

For such an occlusion region, when the conventional ME method is applied, an erroneous MV indicated by a dotted line is determined instead of an MV indicated by a solid line. In the insert frame MCI generated based on the incorrectly calculated m1 (dotted line), an error occurs in that the image that should be covered by being close to the foreground F is displayed at a position away from the foreground F. Due to such an error, image quality deterioration such as an afterimage may occur in an image.

14B is a diagram illustrating a case in which an insert frame (MCI) is generated after correction by replacing m1 with -m0 according to the present invention. In the region where the accuracy of m1 is low, m0 has an accurate MV value with only the opposite direction to m1. Therefore, it is possible to correct m1 (solid line) by replacing m1 with -m0 at the same point. In the insert frame MCI generated based on the corrected m1 (solid line), an image that is gradually closed toward the foreground F may be displayed at an accurate position.

As described above, the accuracy of the MCI image can be improved by replacing m1 with -m0 and correcting it, and as a result, the image quality can be improved.

15A and 15B show m2, which is the MV from image2 corresponding to [t+1]-frame to image1 corresponding to [t]-frame, and inserting and displaying an insert frame (MCI) generated based on m2. the results are shown.

15A is a diagram illustrating a case in which an insert frame (MCI) is generated without correcting m2 as a comparative example. On the other hand, in the area of (c), the ● image displayed in image2 corresponding to [t+1]-frame is obscured by the foreground (F) in image1 corresponding to [t1]-frame. For such an occlusion region, when the conventional ME method is applied, an erroneous MV indicated by a dotted line is determined instead of an MV indicated by a solid line. In the insert frame MCI created based on the erroneously calculated m2 (dotted line), an error occurs in which the ● image that is revealed as the foreground F moves is displayed in the wrong position. Due to such an error, image quality deterioration such as an afterimage may occur in an image.

15B is a diagram illustrating a case in which an insert frame (MCI) is generated after correction by replacing m2 with -m1 according to the present invention. In the region where the accuracy of m2 is low, m1 has an accurate MV value with only the opposite direction to m2. Therefore, it is possible to correct m2 (solid line) by replacing m2 with -m1 at the same point. In the insert frame MCI generated based on the corrected m2 (solid line), an image that is gradually revealed as the foreground F moves may be displayed at an accurate location.

16 and 17 are diagrams illustrating a comparison of the image display state when the MEMC method according to the comparative example is applied and the image display state when the MEMC method according to the embodiment of the present invention is applied.

16 shows that the image displayed in image1 corresponding to [t]-frame is m1 for the image including the occlusion area covered by the foreground F in image2 corresponding to [t+1]-frame. The displayed image is disclosed when it is applied as it is and when m1 is replaced with -m0 and corrected.

In the image of FIG. 16, the motion of the foreground (F) area (person) is stopped and the motion of the background (B) area (wall, tree, etc.) is directed to the left through m1.

The part corresponding to the foreground (F) area (person) is output as an accurate value when expressed in red, and the part corresponding to the background (B) area (wall, tree, etc.) is displayed in green when the correct value is displayed. It is output as a value.

It can be confirmed that the inaccurate MV value (red) in the occlusion area (view of m1) corresponding to the right side of the foreground (F) area and the left side of the screen has been improved to the correct MV value (green) in the image after the application of the present invention. can

17 illustrates a displayed image when an image including an occlusion region is corrected by replacing m2 with -m1.

In the image of FIG. 17, the motion of the foreground (F) area (person) is stopped, and the motion of the background (B) area (wall, tree, etc.) is directed to the left through m2. Since the direction is opposite to that of m1, in the example of m2, the color representation is reversed.

The part corresponding to the foreground (F) area is output with an accurate value when it is expressed in transparent color, and the part corresponding to the background (B) area (wall, tree, etc.) is displayed as an accurate value when expressed in red. in case it is output.

It can be confirmed that the inaccurate MV value (transparent color) in the occlusion area (view of m2) corresponding to the left side of the foreground (F) area and the right side of the screen is improved to the correct MV value (red color) after the present invention is applied. have.

As described above, in the present invention, motion estimation ( Motion Estimation) accuracy can be increased. In the embodiment of the present invention, MV1 in the occlusion region is corrected by replacing -MV0, and MV2 is corrected by replacing -MV1 to improve the accuracy of MV. As described above, by improving the accuracy of the MV, the accuracy of the MEMC can be increased, and as a result, the image quality of the entire image can be improved.

Those skilled in the art from the above description will be able to see that various changes and modifications are possible without departing from the technical spirit of the present invention. Accordingly, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification, but should be defined by the claims.

100: signal input unit 110: signal processing unit
120: frame compensation unit 140: display panel

Claims (15)

determining a motion vector (MV) based on the amount of motion variation between the current frame and the previous frame and subsequent frames;
determining an occlusion area including an area in which an image of a background is hidden or exposed by movement of a foreground image when moving from the current frame to the next frame;
correcting a motion vector included in the occlusion region based on a motion vector of the previous frame or the subsequent frame; and
generating an insert frame by applying the corrected motion vector;
including,
Determining a motion vector (MV) based on the amount of motion variation between the current frame and the previous frame and subsequent frames comprises:
determining MV0 which is a motion vector to a previous frame ([t-1]-frame) based on the current frame ([t]-frame);
determining MV1 as a motion vector to a subsequent frame ([t+1]-frame) based on the current frame ([t]-frame); and
determining MV2 as a motion vector to the current frame ([t]-frame) based on the subsequent frame ([t+1]-frame);
including,
When moving from the current frame to the next frame, determining the occlusion area including the area where the image of the background is hidden or exposed by the movement of the foreground image includes:
In the current frame ([t]-frame), +1 and -1 are symmetrically arranged with respect to 0 for the MV1s arranged in the horizontal direction, or 0 for the MV1s arranged in the vertical direction. By multiplying N*M filters arranged symmetrically with +1 and -1 around A method of controlling a display device comprising determining an occlusion area. delete According to claim 1,
When moving from the current frame to the next frame, determining the occlusion area including the area where the image of the background is hidden or exposed by the movement of the foreground image includes:
When the sign change of the MV1s arranged in the horizontal or vertical direction in the current frame ([t]-frame) does not match a preset pattern, determining an area including the corresponding MV1 as the occlusion area; A control method of a display device comprising a. 4. The method of claim 3,
When moving from the current frame to the next frame, determining the occlusion area including the area where the image of the background is hidden or exposed by the movement of the foreground image includes:
When a sign of a value calculated by multiplying the horizontally arranged MV1s by the N*M filters arranged symmetrically with +1 and -1 with respect to 0 as a center does not match a preset pattern, the occlusion A method of controlling a display device comprising determining a region. 4. The method of claim 3,
When moving from the current frame to the next frame, determining the occlusion area including the area where the image of the background is hidden or exposed by the movement of the foreground image includes:
When a sign of a value calculated by multiplying the vertically arranged MV1s by the N*M filters arranged vertically symmetrically with +1 and -1 with respect to 0 as a center does not match a preset pattern, the occlusion A method of controlling a display device comprising determining a region. According to claim 1,
Compensating the motion vector included in the occlusion region based on the amount of motion variation between the previous frame or the subsequent frame comprises:
correcting MV1 included in the occlusion area based on MV0 of the same point; and
correcting MV2 included in the occlusion area based on MV1 of the same point;
A control method of a display device comprising a. According to claim 1,
Compensating the motion vector included in the occlusion region based on the amount of motion variation between the previous frame or the subsequent frame comprises:
When the occlusion area is an area in which the background image is covered by the foreground image, correcting the occlusion area by replacing MV1 of the occlusion area with -MV0 at the same point A method of controlling a display device. According to claim 1,
Compensating the motion vector included in the occlusion region based on the amount of motion variation between the previous frame or the subsequent frame comprises:
When the occlusion area is an area in which the background image is exposed according to the movement of the foreground image, correcting MV1 of the current frame to -MV1 of the same point of the previous frame A method of controlling a display device. display panel;
a signal input unit for receiving an image signal to be displayed on the display panel;
a signal processing unit for separating an image signal from the signal received through the signal input unit; and
and a frame compensator for generating an insert frame to be inserted between original frames based on a motion vector indicating an amount of motion variation between frames of the video signal;
The frame compensator,
When moving from the current frame to the next frame in a time-series input image frame, the occlusion area including the area where the background image is hidden or exposed by the movement of the foreground image is determined and after correcting the motion vector included in the occlusion region based on the motion vector of the previous frame or the subsequent frame, the insert frame is generated,
The frame compensator,
MV0, which is a motion vector from the current frame ([t]-frame) to the previous frame ([t-1]-frame), and the subsequent frame ([t+1] based on the current frame ([t]-frame) ]-frame), which is a motion vector, and an MV estimator that determines MV2, a motion vector to the current frame ([t]-frame), based on the subsequent frame ([t+1]-frame);
When the sign change of the MV1s arranged in the horizontal or vertical direction in the current frame ([t]-frame) does not match a preset pattern, an area including the corresponding MV1 is determined as the occlusion area, and the occlusion area is determined. an MV compensator for correcting a motion vector included in the previous region based on the motion vector of the previous frame or the subsequent frame; and
a motion compensator for generating the insert frame based on the frame in which the motion vector is corrected;
including,
The frame compensator,
In the current frame ([t]-frame), +1 and -1 are symmetrically arranged with respect to 0 for the MV1s arranged in the horizontal direction, or 0 for the MV1s arranged in the vertical direction. By multiplying N*M filters arranged symmetrically with +1 and -1 around A display device judging by the occlusion area. delete 10. The method of claim 9,
The frame compensator,
and the N*M filter applied to the MV1s arranged in the horizontal direction, wherein +1 and -1 are symmetrically arranged around 0 and multiplied by the MV1s arranged in the horizontal direction. 10. The method of claim 9,
The frame compensator,
and the N*M filter applied to the vertically arranged MV1s, wherein +1 and -1 are vertically symmetrical about 0 and multiplied by the vertically arranged MV1. 10. The method of claim 9,
The MV correction unit,
A display apparatus for correcting MV1 included in the occlusion area based on MV0 of the same point, and correcting MV2 based on MV1 of the same point. 10. The method of claim 9,
The MV correction unit,
When the occlusion area is an area in which the background image is covered by the foreground image, the display apparatus is corrected by replacing MV1 of the occlusion area with -MV0 of the same point. 10. The method of claim 9,
The MV correction unit,
When the occlusion area is an area in which the background image is exposed according to the movement of the foreground image, the MV1 of the current frame is replaced with -MV1 of the same point of the previous frame and corrected. .

Images