TWI410123B - Image display module, image display apparatus and method to display dynamic image thereof - Google Patents

Abstract

A method to display dynamic image is disclosed. This method includes firstly calculate a minimum sum of absolute difference (SAD) according to a first frame data corresponding to a clock t and a second frame data corresponding to a clock t+1. Secondly, the first frame data is divided into a plurality of first sub-frame datas while the second frame data is also divided into a plurality of second sub-frame datas. Thirdly, choose one of these first sub-frame datas as a standard and compare the rest of the first sub-frame datas to the chosen sub-frame data to gain a first detail ratio number (DRN). Also, choose one of these second sub-frame datas as a standard and compare the rest of the second sub-frame datas to the chosen sub-frame data to gain a second DRN. Then, compare the first DRN to a first standard value to gain a first result while a second result is gained via comparing the second DRN to a second standard value. According to the difference between the first and the second results, determine a frame moving vector. At last, a middle frame is inserted between the first and the second frames.

Description

Image display module, image display device and dynamic image display method thereof

The present invention relates to a display module, a display device, and an image display method thereof, and more particularly to an image display module, an image display device, and a moving image display method thereof for estimating an image display according to a degree of change in brightness.

Due to the long response time of LCD panels, how to reduce the residual image and jitter has always been one of the most important topics in LCD TV design, especially in high-definition TVs. Therefore, in order to solve this problem, a panel having a frame rate of 100/120 Hz has been gradually introduced on the market to replace the panel with a previous screen update rate of 50/60 Hz. However, it does not make much sense to improve the panel update rate. It is also necessary to try to match the signal sources to achieve the goal of truly improving image quality, thus making Motion Estimation (ME) and motion compensation (Motion). The technology of Compensation, MC) is highly valued.

That is to say, when the panel update rate used has been updated to the 100/120Hz specification, if the image signal source still stays at the 50/60Hz specification, the ME/MC technology must be imported for the refresh rate conversion (Frame). Rate Conversion (FRC), which enables the original 50/60Hz image signal to be boosted to 100/120Hz for the best image quality. There are many ways to achieve the refresh rate conversion. Most of the common methods are to insert a black or gray picture between each frame of 50/60 Hz, so that the purpose of eliminating the residual image can be achieved, thereby reducing the screen. The brightness and contrast of the display.

More notably, in the current technical background, the estimation of the image does not allow the brightness corresponding to the adjacent two frames to be included in the calculation reference, but can simply have the same position in the adjacent two frames. The sub-picture frame is operated to obtain the motion vector of the picture frame, but the frame motion vector obtained by such calculation method often causes the deviation of the estimation result due to the difference in brightness between the adjacent two picture frames, so that the insertion is made. The frame cannot be smoothly connected to the front and back frames, which affects the display quality.

Therefore, how to provide an image display module, an image display device and a dynamic image display method thereof is one of the current important topics.

In view of the above problems, an object of the present invention is to provide an image display module, an image display device, and a dynamic image display method thereof, which are used as a parameter for calculating a frame motion vector by using the difference of the details of two adjacent frames. One of the two frames, wherein the comparison target is the difference in brightness between each sub-frame and the sub-frame of the comparison frame in the frame, so that the difference between the two frames can be The brightness change is included in the estimation to achieve smooth picture transition and improve the image display.

In order to achieve the above object, a dynamic image display method according to the present invention comprises the following steps: First, calculating according to a first frame data corresponding to a time sequence t and a second picture frame data corresponding to a time sequence t+1; a minimum absolute difference sum value; secondly, the first frame data is divided into a plurality of first sub-frame data, and the selected second frame data is also divided into a plurality of second sub-frame data; third, selection One of the first sub-frame materials is used as a comparison benchmark, and is compared with the remaining first sub-frame data to obtain a first detail quantity, and at the same time, the second sub-value is also selected. One of the frame materials is used as a comparison benchmark, and compared with the remaining second sub-frame data to obtain a second detail value; fourth, the first detail value and a first standard The values are compared to obtain a first comparison result, and the second detail quantity is compared with a second standard value to obtain a second comparison result; fifth, according to the first comparison result and the second The difference between the comparison results to determine a frame movement vector; sixth, benefit The vector is moved by the frame to calculate an intermediate frame interpolated between the first frame and the second frame.

Wherein, in the fifth step, when the difference between the first comparison result and the second comparison result is zero, the frame movement vector is the sum of the minimum absolute differences (that is, the sum of the absolute values of the calculated differences) For the parameter calculation, when the difference between the first comparison result and the second comparison result is not equal to zero, the frame movement vector is simultaneously the minimum absolute difference sum value (that is, the sum of the absolute values of the calculated difference values), The first detail magnitude and the second detail magnitude are calculated from the parameters.

In order to achieve the above objective, the image display module driven by the dynamic image display method disclosed in the present invention has a display panel for displaying an image, and the image display module includes an image processing unit and a timing control unit. The image processing unit calculates the frame motion vector by using the dynamic image display method described above; the timing control unit is coupled to the image processing unit and the display panel, and the timing control unit receives the frame motion vector and drives the frame Display panel to display images.

In order to achieve the above object, the image display device driven by the dynamic image display method disclosed in the present invention comprises an image display module and a backlight module, and the image display module and the backlight module are respectively arranged corresponding to each other. The light generated by the backlight module can be supplied to the image display module. The image display module has a display panel for displaying an image, and includes an image processing unit and a timing control unit. The image processing unit calculates the frame motion vector by using the dynamic image display method described above; the timing control unit is coupled to the image processing unit and the display panel, and the timing control unit receives the frame motion vector and drives the frame Display panel to display images.

As can be seen from the above, an image display module, an image display device and a moving image display method thereof can use the images of the two adjacent frame materials as reference, and use the ME/MC calculation. The method calculates the data corresponding to the middle frame, so as to insert the middle frame between the two adjacent frames, and can also incorporate the brightness changes of the two adjacent frames while performing image estimation. As one of the estimated parameters, the smoothness of the screen transition is achieved and the display effect of the image is improved. Compared with the prior art, the dynamic image display method disclosed in the present invention can incorporate the brightness change into one of the parameters of the frame motion vector, so that the smoothness between the inner frame frame and the adjacent two frames is further improved. .

Hereinafter, a dynamic image display method according to a preferred embodiment of the present invention will be described with reference to the related drawings.

Please refer to FIG. 1 , which is an embodiment of a dynamic image display method disclosed in the present invention. According to FIG. 1, it is known that seven main steps are disclosed. First, in step S01, a minimum absolute value is calculated according to the first frame data corresponding to the time sequence t and the second frame data corresponding to the time sequence t+1. The sum of the differences.

In more detail, in step S01, the sub-steps shown in FIG. 2 are further included. First, as shown in step S011, the first frame data corresponding to the timing t and the complex number corresponding to the timing t+1 are retrieved. a candidate second frame data; continuation, in step S012, the first frame data is compared with all the candidate second frame materials, and each second frame data is calculated and The sum of the absolute differences between the first frame data; finally, as shown in step S013, the smallest absolute difference sum value is selected among all the absolute difference sum values, and the candidate corresponding to the minimum absolute difference sum value is defined. The second frame data is the second frame data disclosed in the above step S01.

Next, in step S02, the first frame data is divided into a plurality of first sub-frame materials, and the selected second frame data is also divided into a plurality of second sub-frame materials.

The matrix arrangement of the plurality of first sub-frame materials divided in the first frame data may be the same as the matrix arrangement of the plurality of second sub-frame materials divided in the second frame data. At the same time, because of this, the number of the first sub-frame materials divided in the first frame data is equivalent to the number of the second sub-frame materials divided in the second frame data. However, the configuration and arrangement of the sub-frame materials as described above are only one embodiment of the present invention. Of course, the first frame data and the second frame data may be divided into different matrix arrangements, and At this time, the number of the first sub-frame data and the second sub-frame data may be the same or different.

Then, in step S03, it selects one of the first sub-frame materials as the comparison reference in all the first sub-frame materials, and compares the first sub-frame data with the rest of the first Sub-frame data is compared to obtain a first detail value, and similarly, one of the second sub-frame materials is selected as the comparison reference in all the second sub-frame materials, and The second sub-frame material is compared with the remaining second sub-frame data to obtain a second detail value.

In more detail, since the calculation of the first detail magnitude and the calculation of the second detail magnitude are based on the difference in luminance as a reference for comparison, the following is only the first sub-frame in the first frame data. The frame data is taken as an example. As shown in FIG. 3, the first frame data is divided into nine first sub-frame materials, which are numbered 0, 1, 2, 3, 4, 5, 6, 7, and 8, respectively. The frame data 0 is the comparison reference, and when the remaining eight first sub-frame materials 1, 2, 3, 4, 5, 6, 7, 8 have three first sub-frame materials 2, 3, 4 When the brightness of the first sub-frame data is different from the brightness of the first sub-frame data, that is, when the brightness between the two first sub-frame materials is different, or the brightness difference between the two first sub-frame data If it is greater than a predetermined value, the first detail magnitude obtained after the comparison is 3.

Next, in step S04, the first detail quantity obtained in step S03 is compared with a first standard value, and a first comparison result is obtained, and the second detail quantity is also Comparing the two standard values, and obtaining a second comparison result, wherein the values corresponding to the first standard value and the second standard value may be the same value, and when comparing the first detail quantity with the first standard When the value is compared, the value of the first detail value and the first standard value are compared, in other words, when the first detail quantity is greater than or equal to the first standard value, the value of the first comparison result is the first The value corresponding to the detail value, and conversely, when the first detail quantity is smaller than the first standard value, the value corresponding to the first comparison result is zero, that is, only when the first detail quantity is greater than or equal to When the first standard value is set, the first detail magnitude will affect the dynamic estimation of the image; and similarly, the comparison between the second detail value and the second standard value is the same as the above a comparison between the magnitude of the detail and the first standard value, , The details also only when the second value is greater than a second reference value equal to a set, second detail will affect the magnitude of the image motion estimation.

As shown in step S05, after the first comparison result and the second comparison result are obtained in step S04, the difference between the obtained first comparison result and the second comparison result is further determined in this step. Determining a frame motion vector, wherein, as shown in step S051, when the first comparison result is equal to the second comparison result, that is, the difference between the first comparison result and the second comparison result is zero, then The frame motion vector directly calculates the parameter with the minimum absolute difference sum value. For example, the frame motion vector in this case is proportional to the sum of the minimum absolute differences, but when the first comparison result is not equal to the first When the result of the comparison is as shown in step S052, that is, the difference between the first comparison result and the second comparison result is not zero, the frame movement vector system must simultaneously have the minimum absolute difference sum value, A detail magnitude and a second detail magnitude are calculation parameters, and the frame motion vector at this time refers to the influence of the first detail magnitude and the second detail magnitude in addition to the decision of the minimum absolute difference sum value.

It can be seen that when the first sub-frame data in the first frame data and the second sub-frame data in the second frame data do not change much in brightness, due to the variation of the brightness The first detail magnitude and the second detail magnitude are both within a certain standard range, so when estimating the frame motion vector, it is not necessary to incorporate the luminance variation into the calculation consideration, but when in the first frame data When the first sub-frame data and the second sub-frame data in the second frame data have a certain degree of change in brightness, after the comparison result of the above step S04, the brightness is related to the brightness in this step. The first detail magnitude is included in the estimate of the frame motion vector along with the second detail magnitude.

Finally, in step S06, the frame moving vector is used to calculate an intermediate frame interpolated between the first frame and the second frame, so that when the first frame is converted into the second frame It is possible to present a smoother image change by means of this intermediate frame.

The dynamic image display method of the present invention can be applied to an image display module to further improve the display quality of the image, and FIG. 4A is a schematic diagram of the image display module. In this embodiment, the image display module 40 has a display panel 403 for displaying images. The image display module 40 includes an image processing unit and a timing control unit 402. Here, the image processing unit is The scaler 401 is taken as an example, but is not intended to limit the scope of the invention.

In order to enable the above method to be implemented in the image display module 40, first, the scaler 401 in the image display module 40 captures (or receives) the first frame data FD1 corresponding to the timing t and corresponds to The second frame data FD2 at the time t+1, and using the image display method described above to adjust the received image data (including the first frame data FD1 and the second frame data FD2), after the method is completed The image data is sent to the Timing Controller 402, and the subsequent ME/MC algorithm is performed, so that the display panel 403 of the image display device 40 can display the final image, in other words, the adjacent frame. The method of incorporating the brightness change into the estimation is mainly performed in the scaler 401 of the display device 40.

In addition, although the above ME/MC algorithm is executed in the timing control unit 402, in actual application and design, as shown in FIG. 4B, the ME/MC algorithm may be executed in the scaler 401, and That is, the ME/MC is executed by the scaler 401 or the timing control unit 402, and does not affect the original operation of the scaler 401 and the timing control unit 402.

In addition, when the image display module is combined with a backlight module, an image display device can be formed. In order to transmit the light generated by the backlight module to the image display module, the backlight module is coupled with The image display modules are relatively arranged, and the operation mode of each component, the features of the image display module, and the dynamic image display method are all detailed above, and will not be described herein.

In summary, the dynamic image display method of the present invention can be used as a reference basis by using the images of the two adjacent frames before and after, and using the ME/MC algorithm to calculate the middle frame, and more is performed. At the same time of image estimation, the brightness change of two adjacent frames is included as one of the estimated parameters, so as to achieve smooth picture conversion and improve the display effect of the image. Compared with the prior art, the dynamic image display method disclosed in the present invention can incorporate the brightness change into one of the parameters of the frame motion vector, so that the smoothness between the inner frame frame and the adjacent two frames is further improved. .

The above is intended to be illustrative only and not limiting. Any equivalent modifications or alterations to the spirit and scope of the invention are intended to be included in the scope of the appended claims.

S01～S06. . . Main process steps

S011～S013. . . Substep of step S01

40. . . Image display module

401. . . Scaler

402. . . Timing control unit

403. . . Display panel

FD1. . . First frame data

FD2. . . Second frame data

1 is an embodiment of a dynamic image display method according to the present invention;

Figure 2 is a sub-step of step S01;

3 is a schematic structural view corresponding to step S02;

4A is a schematic diagram of an image display module to which the dynamic image display method disclosed in the present invention is applied;

FIG. 4B is a schematic diagram of another image display module applying the dynamic image display method disclosed in the present invention.

S01～S06. . . Process step

Claims (26)

A dynamic image display method includes the following steps: (A) calculating a minimum absolute difference sum value according to a first frame data corresponding to the time sequence t and a second frame data corresponding to the time sequence t+1; Dividing the first frame data into a plurality of first sub-frame materials, and dividing the second frame data into a plurality of second sub-frame materials; (C) selecting the first sub-frame materials One of them compares the reference and compares it with the rest of the first sub-frame data to obtain a first detail quantity, and also selects one of the second sub-frame materials as Comparing the reference and comparing it with the remaining second sub-frame data to obtain a second detail quantity; (D) comparing the first detail quantity value with a first standard value to obtain a first comparison result, and comparing the second detail quantity value with a second standard value to obtain a second comparison result; (E) according to the first comparison result and the second comparison result The difference determines a frame movement vector; and (F) uses the frame to move the vector to calculate the interpolation into the first frame An intermediate frame between the second frame. The dynamic image display method according to claim 1, wherein the step (A) further comprises the following substeps: capturing the first frame material corresponding to the timing t and the complex candidate corresponding to the timing t+1 a second frame data; performing a block comparison operation on the first frame data with the candidate second frame materials to obtain a complex absolute difference sum value; and selecting the sum of the absolute differences and selecting the The second frame data of the candidate corresponding to the minimum absolute difference sum value is the second frame data in the step (A). The dynamic image display method according to claim 1, wherein the step of calculating the difference between the first result and the second result in the step (E) further comprises the following substeps: when the first result and the first If the difference between the two results is zero, the frame motion vector is calculated by using the minimum absolute difference sum value as a parameter; and when the difference between the first result and the second result is not equal to zero, the frame moves The vector system is calculated by simultaneously calculating the minimum absolute difference sum value, the first detail quantity value and the second detail quantity value. The dynamic image display method of claim 1, wherein the number of the first sub-frame materials is equal to the number of the second sub-frame materials. The dynamic image display method of claim 1, wherein the matrix arrangement of the first sub-frame materials is the same as the matrix arrangement of the second sub-frame materials. The method for displaying a dynamic image according to claim 1, wherein the spatial arrangement relationship between the first sub-frame data and the other first sub-frame materials is selected and selected as a comparison reference. The spatial configuration relationship between the second sub-frame material as the comparison reference and the other second frame materials is the same. The dynamic image display method of claim 1, wherein the first standard value is equal to the second standard value. The method of displaying a dynamic image according to claim 1, wherein in the step (D), the comparing the first detail value with the first standard value is performed by comparing the first detail value Whether it is greater than or equal to the first standard value to achieve. The dynamic image display method of claim 8, wherein the first detail value is greater than or equal to the first standard value, and the value corresponding to the first comparison result is equal to the first detail value. Corresponding values. The dynamic image display method of claim 8, wherein the first detail value is less than the first standard value, and the value corresponding to the first comparison result is equal to zero. The dynamic image display method according to claim 1, wherein in the step (D), comparing the second detail value with the second standard value is performed by comparing the second detail value Whether it is greater than or equal to the second standard value to achieve. The dynamic image display method of claim 11, wherein the second detail value is greater than or equal to the second standard value, and the value corresponding to the second comparison result is equal to the second detail value Corresponding values. The dynamic image display method of claim 11, wherein the second detail value is less than the second standard value, and the value corresponding to the second comparison result is equal to zero. The dynamic image display method according to claim 1, wherein in the step (C), one of the first sub-frame materials is used as a comparison reference and the remaining portions are The comparison of a sub-frame data is achieved by comparing the brightness differences of all of the first sub-frame materials. The dynamic image display method according to claim 1, wherein in the step (C), one of the second sub-frame materials is used as a comparison reference and the remaining portions are The comparison of the two sub-frame materials is achieved by comparing the brightness differences of all the second sub-frame materials. An image display module comprises: a display panel; an image processing unit for calculating a minimum absolute according to a first frame data corresponding to the time sequence t and a second frame data corresponding to the time sequence t+1 a difference sum value, and dividing the first frame data into a plurality of first sub-frame data, and dividing the second frame data into a plurality of second sub-frame materials, and then selecting the first sub-frame data One of the comparison benchmarks is compared with the rest of the first sub-frame data to obtain a first detail value, and one of the second sub-frame materials is also selected. Comparing the reference with the remaining second sub-frame data to obtain a second detail quantity, and comparing the first detail quantity with the first standard value to obtain a first Comparing the result, and comparing the second detail quantity with the second standard value to obtain a second comparison result, and finally, according to the difference between the first comparison result and the second comparison result Determining the frame movement vector; and a timing control unit coupled to The image processing unit and the display panel, the timing control unit drives the display panel according to the frame motion vector determined by the image processing unit. The image display module of claim 16, wherein the image processing unit further comprises a dynamic estimation unit and a dynamic compensation unit. The image display module of claim 16, wherein the timing control unit further comprises a dynamic estimation unit and a dynamic compensation unit. The image display module of claim 16, wherein the image processing unit is a scaler. The image display module of claim 16, wherein the display panel is a liquid crystal display panel. An image display device includes: an image display module, comprising: a display panel; an image processing unit, according to a first frame data corresponding to the timing t and a corresponding to the time t+1 The second frame data is used to calculate a sum of minimum absolute differences, and the first frame data is divided into a plurality of first sub-frame materials, and the second frame data is divided into a plurality of second sub-frame materials. And selecting one of the first sub-frame data as a comparison benchmark and comparing it with the remaining first sub-frame data to obtain a first detail quantity, and also selecting the first One of the two sub-frame data is used as a comparison benchmark and compared with the remaining second sub-frame data to obtain a second detail quantity, and the first detail quantity and the first Comparing a standard value to obtain the first comparison result, and comparing the second detail quantity value with the second standard value to obtain the second comparison result, and finally, according to the first comparison result The difference from the second comparison result determines a frame movement vector; And a timing control unit coupled to the image processing unit and the display screen, wherein the timing control unit drives the display panel according to the frame motion vector determined by the image processing unit; and a backlight module It provides a light source to the display panel. The image display device of claim 21, wherein the image processing unit further comprises a dynamic estimation unit and a dynamic compensation unit. The image display device of claim 21, wherein the timing control unit further comprises a dynamic estimation unit and a dynamic compensation unit. The image display device of claim 21, wherein the image processing unit is a scaler. The image display device of claim 21, wherein the display panel is a liquid crystal display panel. The image display device according to claim 21, which is a liquid crystal display device.