WO2020098130A1

WO2020098130A1 - Image interpolation magnification method, image interpolation magnification apparatus and display apparatus

Info

Publication number: WO2020098130A1
Application number: PCT/CN2019/070083
Authority: WO
Inventors: 朱江
Original assignee: 深圳市华星光电半导体显示技术有限公司
Priority date: 2018-11-14
Filing date: 2019-01-02
Publication date: 2020-05-22
Also published as: CN109658333A

Abstract

Disclosed are an image interpolation magnification method, an image interpolation magnification apparatus and a display apparatus. The method comprises: inputting an image, wherein the image comprises multiple groups of pixels and each group of pixels comprises multiple pixel points; calculating a correlation between the pixel points of each group of pixels to obtain a correlation of each group of pixels; comparing the correlations of multiple groups of pixels; and calculating an interpolation according to the comparison result of the correlations of multiple groups of pixels.

Description

Image enlargement interpolation method, image enlargement interpolation device and display device

Technical field

The present disclosure relates to the field of display technology, and in particular, to an image enlargement interpolation method, an image enlargement interpolation device, and a display device.

Background technique

With the rapid development of computer technology and modern communication technology, people's demand for image information is becoming more and more urgent. Current image digitization input devices generate corresponding pixel points by sampling tiny areas on the image, thereby forming a dotted image data, that is, for a fixed image input condition and a fixed image, the amount of data that can be obtained is Relatively fixed.

However, in many cases, it is often unavoidable that the image is interpolated and enlarged. The interpolation of images means an increase in the amount of recorded image data, which is a process of image data regeneration. So, how to realize this image data regeneration process, and how to achieve the visual effect and operation complexity are the issues that need to be considered and paid attention to in the research work of image enlargement algorithms.

Existing image interpolation methods do not judge the correlation of each pixel in the image. As a result, the details of the image with rich information are lost to varying degrees and the edges are blurred.

Therefore, there is a need to provide an image enlargement interpolation method, an image enlargement interpolation device, and a display device to solve the problems in the prior art.

technical problem

Technical solution

In order to solve the above technical problems, the present disclosure provides an image enlargement and interpolation method. The method includes:

Input image, the image includes multiple groups of pixels, and each group of pixels includes multiple pixels;

Calculating the correlation between the pixels of each group of pixels to obtain the correlation of each group of pixels;

Comparing the correlation of the multiple sets of pixels; and

The interpolation calculation is performed according to the result of comparing the correlation sizes of the multiple groups of pixels.

In one embodiment of the present disclosure, a group of pixels with the greatest correlation is selected for interpolation calculation.

In one embodiment of the present disclosure, a group of pixels with the greatest correlation is selected in the horizontal direction for interpolation calculation.

In one embodiment of the present disclosure, a group of pixels with the highest correlation is selected in the vertical direction for interpolation calculation.

In one embodiment of the present disclosure, the image includes 4x4 pixel regions, and the method includes performing interpolation calculation on the 4x4 pixel regions by bicubic interpolation.

In one embodiment of the present disclosure, the image includes 3x3 pixel regions, and the method includes performing interpolation calculation on the 3x3 pixel regions by Newton interpolation.

In one embodiment of the present disclosure, the image includes 2x2 pixel regions, and the method includes performing interpolation calculation on the 2x2 pixel regions by bilinear interpolation.

The present disclosure also provides an image enlargement and interpolation device including an image input and output unit, a correlation calculation unit, a correlation comparison unit, and an interpolation calculation unit. The image input and output unit is used to input images. The image includes multiple sets of pixels. Each group of pixels includes multiple pixels. The correlation calculation unit is used to calculate the correlation between the pixels of each group of pixels to obtain the correlation of each group of pixels. The correlation comparison unit is used to compare the correlation of the multiple groups of pixels. The interpolation calculation unit is configured to perform interpolation calculation according to the result of comparing the correlation magnitudes of the multiple groups of pixels.

In one embodiment of the present disclosure, the interpolation calculation unit is used to select a group of pixels with the greatest correlation for interpolation calculation.

In one embodiment of the present disclosure, the interpolation calculation unit selects a group of pixels with the greatest correlation in the horizontal direction to perform interpolation calculation.

In one embodiment of the present disclosure, the interpolation calculation unit selects a group of pixels with the greatest correlation in the vertical direction to perform interpolation calculation.

In one embodiment of the present disclosure, the image includes 4x4 pixel regions, and the interpolation calculation unit performs interpolation calculation on the 4x4 pixel regions by bicubic interpolation.

In one embodiment of the present disclosure, the image includes 3x3 pixel regions, and the interpolation calculation unit performs interpolation calculation on the 3x3 pixel regions by Newton interpolation method.

In one embodiment of the present disclosure, the image includes 2x2 pixel regions, and the interpolation calculation unit performs interpolation calculation on the 2x2 pixel regions by bilinear interpolation.

The present disclosure also provides a display device including an image enlargement and interpolation device. The image enlargement and interpolation device includes an image input and output unit, a correlation calculation unit, a correlation comparison unit, and an interpolation calculation unit. The image input and output unit is used to input images. The image includes multiple sets of pixels. Each group of pixels includes multiple pixels. The correlation calculation unit is used to calculate the correlation between the pixels of each group of pixels to obtain the correlation of each group of pixels. The correlation comparison unit is used to compare the correlation of the multiple groups of pixels. The interpolation calculation unit is configured to perform interpolation calculation according to the result of comparing the correlation magnitudes of the multiple groups of pixels.

Beneficial effect

Compared with the prior art, in order to solve the above technical problems, the present disclosure provides an image enlargement interpolation method, an image enlargement interpolation device, and a display device. By performing interpolation calculation based on the result of comparing the correlation of multiple sets of pixels, image resolution can be increased Rate and improve the edge effect of the interpolated enlarged image.

BRIEF DESCRIPTION

FIG. 1 shows a flow block diagram of an image enlargement and interpolation method according to an embodiment of the present disclosure;

FIG. 2 shows a schematic diagram of interpolation calculation on 4x4 pixel regions of an image according to an embodiment of the present disclosure;

FIG. 3 shows a schematic diagram of interpolation calculation on 3x3 pixel regions of an image according to an embodiment of the present disclosure;

4 shows a schematic diagram of interpolating 2x2 pixel regions of an image according to an embodiment of the present disclosure; and

FIG. 5 shows a structural block diagram of a display device including an image enlargement and interpolation device according to an embodiment of the present disclosure.

Best Mode of the Invention

The descriptions of the following embodiments refer to the attached drawings to illustrate specific embodiments that can be implemented in the present disclosure.

In order to make the above-mentioned and other objects, features, and advantages of the present disclosure more comprehensible, the preferred embodiments of the present disclosure will be cited below in conjunction with the accompanying drawings, which will be described in detail below. Furthermore, the directional terms mentioned in this disclosure, such as top, bottom, top, bottom, front, back, left, right, inner, outer, side layer, surrounding, center, horizontal, horizontal, vertical, vertical, longitudinal, axial , Radial, uppermost or lowermost layer, etc., only refer to the directions of the attached drawings. Therefore, the directional terminology is used to illustrate and understand this disclosure, not to limit it.

In the figure, units with similar structures are indicated by the same reference numerals.

Referring to FIG. 1, a method of image enlargement and interpolation 100 according to an embodiment of the present disclosure includes block 110, an input image, the image includes multiple groups of pixels, and each group of pixels includes multiple pixels, and block 120, calculates the pixels of each group of pixels To obtain the correlation of each group of pixels, block 130, compare the correlation of multiple groups of pixels, block 140, perform interpolation calculation based on the results of comparing the correlation of multiple groups of pixels, and block 150, the output has High-resolution interpolated enlarged image.

Specifically, after the image is input, the correlation calculation of each group of pixels is performed first, and pixels with a greater correlation are selected for interpolation, and the resulting image edge is clearer.

Referring to FIG. 2, specifically, when the image is interpolated and enlarged, the value of the target pixel is calculated by interpolating the pixel at the corresponding position of the original image. Fig. 2 is a schematic diagram of an image doubled in the horizontal direction and the vertical direction, wherein the solid dots correspond to the pixels of the original image, and the hollow figures represent the pixels to be interpolated. For the pixels identified in the figure, the horizontal interpolation can be calculated from the pixels at positions 1, 2, 3, and 4, or from the pixels at positions 2, 3, 4, and 5.

Specifically, the method in this embodiment is to first calculate the correlation between pixels, and select a group of pixels with the greatest correlation for interpolation calculation. For example, a group of pixels with the highest correlation is selected in the horizontal direction for interpolation calculation. For example, a group of pixels with the highest correlation is selected in the vertical direction for interpolation calculation. For the situation shown in Figure 2, the correlation between pixels can be calculated as △ f1 = | (f22 + f23 + f24) / 3-f21 |, △ f2 = | (f22 + f23 + f24) / 3- f25 |, if △ f1 <= △ f2, select f21, f22, f23, f24 to calculate. If △ f1> = △ f2, select f22, f23, f24, f25 to calculate. Similarly, when interpolating in the vertical direction, the pixels at certain special positions first determine the correlation between the interpolated pixels, and select the pixels with greater correlation to interpolate. Calculate the pixels with greater directional correlation. The above example applies to bicubic interpolation for the algorithm of selecting images including 4x4 pixel regions for interpolation.

Referring to FIG. 3, specifically, the algorithm for selecting 3x3 pixel regions for interpolation is, for example, suitable for Newton interpolation. As shown in FIG. 3, the pixel correlation calculation method is △ f1 = | 2xf1-f0-f2 |, △ f2 = | 2xf2-f1-f3 |, compare the size of △ f1 and △ f2, the smaller the value, the greater the correlation.

Referring to FIG. 4, specifically, the algorithm for selecting 2x2 pixel regions for interpolation is, for example, suitable for bilinear interpolation. As shown in FIG. 4, when interpolating in the horizontal direction, the pixel correlation calculation method is △ f1 = | f21-f22 |, △ f2 = | f22-f23 |, compare the size of △ f1 and △ f2, the smaller the value, the greater the correlation.

Referring to FIG. 5, an embodiment of the present disclosure further provides a display device 20 including an image enlargement and interpolation device 200. The image enlargement and interpolation device 200 includes an image input and output unit 210, a correlation calculation unit 220, a correlation comparison unit 230, and an interpolation calculation unit 240. The image input and output unit 210 is used to input images. The image includes multiple sets of pixels. Each group of pixels includes multiple pixels. The correlation calculation unit 220 is used to calculate the correlation between the pixels of each group of pixels to obtain the correlation of each group of pixels. The correlation comparing unit 230 is used to compare the correlation of multiple groups of pixels. The interpolation calculation unit 240 is used to perform interpolation calculation according to the result of comparing the correlation sizes of multiple groups of pixels. The image input and output unit 210 is used to output an interpolated and enlarged image with high resolution.

Specifically, after the image input and output unit 210 inputs the image, the correlation calculation unit 220 first calculates the correlation of each group of pixels, and the interpolation calculation unit 240 selects pixels with greater correlation to perform the interpolation operation, resulting in a clearer image edge .

Referring to FIGS. 2 and 5, specifically, when the image is interpolated and enlarged, the value of the target pixel is calculated from the pixel interpolation at the position corresponding to the original image. Fig. 2 is a schematic diagram of an image doubled in the horizontal direction and the vertical direction, wherein the solid dots correspond to the pixels of the original image, and the hollow figures represent the pixels to be interpolated. For the pixels identified in the figure, through the interpolation calculation unit 240, the horizontal interpolation can be calculated from the pixels at positions 1, 2, 3, and 4, or from the pixels at positions 2, 3, 4, and 5.

Specifically, in the method of this embodiment, the correlation calculation unit 220 first calculates the correlation between the pixels, and the interpolation calculation unit 240 selects a group of pixels with the greatest correlation to perform the interpolation calculation. For example, in the horizontal direction, the interpolation calculation unit 240 selects a group of pixels with the greatest correlation to perform interpolation calculation. For example, in the vertical direction, the interpolation calculation unit 240 selects a group of pixels with the greatest correlation to perform interpolation calculation. For the situation shown in Figure 2, the correlation between pixels can be calculated as △ f1 = | (f22 + f23 + f24) / 3-f21 | ， △ f2 = | (f22 + f23 + f24) / 3-f25 |, if the correlation comparison unit 230 judges Δf1 <= Δf2, the interpolation calculation unit 240 selects f21, f22, f23, f24 for calculation. If the correlation comparison unit 230 determines that Δf1> = Δf2, the interpolation calculation unit 240 selects f22, f23, f24, and f25 for calculation. Similarly, when performing interpolation in the vertical direction, the correlation calculation unit 220 first determines the correlation between the interpolated pixels, and the interpolation calculation unit 240 selects pixels with greater correlation for interpolation, as shown in FIG. 2 For the calculation of the pixel at the triangle position, the interpolation calculation unit 240 needs to select a pixel with a greater vertical correlation to perform the calculation. The above example applies an algorithm for the interpolation calculation unit 240 to select an image including 4x4 pixel regions for interpolation, for example, for bicubic interpolation.

Referring to FIGS. 3 and 5, specifically, the algorithm for the interpolation calculation unit 240 to select 3x3 pixel regions for interpolation is, for example, suitable for Newton interpolation, as shown in FIG. 3, and its pixel correlation calculation method is Δf1 = | 2xf1-f0-f2 |, △ f2 = | 2xf2-f1-f3 |, the correlation comparison unit 230 compares the magnitude of Δf1 and Δf2, the smaller the value, the greater the correlation.

Referring to FIGS. 4 and 5, specifically, the algorithm for the interpolation calculation unit 240 to select 2x2 pixel regions for interpolation is, for example, suitable for bilinear interpolation, as shown in FIG. 4, when interpolating in the horizontal direction, the pixel correlation calculation The method is △ f1 = | f21-f22 |, △ f2 = | f22-f23 |, the correlation comparison unit 230 compares the magnitudes of Δf1 and Δf2, the smaller the value, the greater the correlation.

Since the image enlargement and interpolation method, the image enlargement and interpolation device, and the display device of the embodiments of the present disclosure, by performing interpolation calculations based on the results of comparing the correlation of multiple sets of pixels, the image resolution can be increased and the interpolated and enlarged image Edge effect. In addition, the display device of this embodiment can be applied to a flat panel display, and its solution design is simple, it is easy to be fabricated into a corresponding chip, and the cost is low.

Although the present disclosure has been shown and described with respect to one or more implementations, those skilled in the art will think of equivalent variations and modifications based on reading and understanding of this specification and the drawings. This disclosure includes all such modifications and variations, and is limited only by the scope of the appended claims. With particular reference to the various functions performed by the above-mentioned components, the terminology used to describe such components is intended to correspond to any component (unless otherwise indicated) that performs the specified function of the component (eg, it is functionally equivalent) Even if it is structurally different from the disclosed structure that performs the functions in the exemplary implementation of the present specification shown herein. Furthermore, although specific features of this specification have been disclosed with respect to only one of several implementations, such features may be combined with one or more other implementations as may be desirable and advantageous for a given or specific application Other feature combinations. Moreover, to the extent that the terms "including", "having", "containing" or variations thereof are used in specific embodiments or claims, such terms are intended to be included in a manner similar to the term "comprising".

The above are only the preferred embodiments of the present disclosure. It should be noted that those of ordinary skill in the art can make several improvements and retouching without departing from the principles of the present disclosure. protected range.

Claims

An image enlargement and interpolation method, including:

Input image, the image includes multiple groups of pixels, and each group of pixels includes multiple pixels;

Calculating the correlation between the pixels of each group of pixels to obtain the correlation of each group of pixels;

Comparing the correlation of the multiple sets of pixels; and

The interpolation calculation is performed according to the result of comparing the correlation sizes of the multiple groups of pixels.
The image enlargement and interpolation method according to claim 1, wherein a group of pixels with the greatest correlation is selected for interpolation calculation.
The image enlargement and interpolation method according to claim 2, wherein a group of pixels with the greatest correlation is selected in the horizontal direction for interpolation calculation.
The image enlargement and interpolation method according to claim 2, wherein a group of pixels with the greatest correlation is selected in the vertical direction for interpolation calculation.
The image enlargement and interpolation method according to claim 1, wherein the image includes 4x4 pixel regions, and the method includes performing interpolation calculation on the 4x4 pixel regions by bicubic interpolation.
The image enlargement and interpolation method according to claim 1, wherein the image includes 3x3 pixel regions, and the method includes performing interpolation calculation on the 3x3 pixel regions by Newton interpolation.
The image enlargement and interpolation method according to claim 1, wherein the image includes 2x2 pixel regions, and the method includes performing interpolation calculation on the 2x2 pixel regions by bilinear interpolation.
An image enlargement and interpolation device, including:

An image input and output unit for inputting an image, the image includes multiple groups of pixels, and each group of pixels includes multiple pixels;

A correlation calculation unit, configured to calculate the correlation between the pixels of each group of pixels to obtain the correlation of each group of pixels;

A correlation comparison unit for comparing the correlations of the multiple groups of pixels; and

The interpolation calculation unit is configured to perform interpolation calculation according to a result of comparing the correlation sizes of the multiple groups of pixels.
The image enlargement and interpolation device according to claim 8, wherein the interpolation calculation unit is used to select a group of pixels with the greatest correlation to perform interpolation calculation.
The image enlargement and interpolation device according to claim 9, wherein the interpolation calculation unit selects a group of pixels with the greatest correlation in the horizontal direction to perform interpolation calculation.
The image enlargement and interpolation device according to claim 9, wherein the interpolation calculation unit selects a group of pixels with the greatest correlation in the vertical direction to perform interpolation calculation.
The image enlargement and interpolation device according to claim 8, wherein the image includes 4x4 pixel regions, and the interpolation calculation unit performs interpolation calculation on the 4x4 pixel regions by bicubic interpolation.
The image enlargement and interpolation device according to claim 8, wherein the image includes 3x3 pixel regions, and the interpolation calculation unit performs interpolation calculation on the 3x3 pixel regions by Newton interpolation.
The image enlargement and interpolation device according to claim 8, wherein the image includes 2x2 pixel regions, and the interpolation calculation unit performs interpolation calculation on the 2x2 pixel regions by a bilinear interpolation method.
A display device includes an image enlargement and interpolation device, wherein the image enlargement and interpolation device includes:

An image input and output unit for inputting an image, the image includes multiple groups of pixels, and each group of pixels includes multiple pixels;

A correlation calculation unit, configured to calculate the correlation between the pixels of each group of pixels to obtain the correlation of each group of pixels;

A correlation comparison unit for comparing the correlations of the multiple groups of pixels; and

The interpolation calculation unit is configured to perform interpolation calculation according to a result of comparing the correlation sizes of the multiple groups of pixels.
The display device according to claim 15, wherein the interpolation calculation unit is used to select a group of pixels with the greatest correlation for interpolation calculation.
The display device according to claim 16, wherein the interpolation calculation unit selects a group of pixels with the greatest correlation in the horizontal direction to perform interpolation calculation.
The display device according to claim 16, wherein the interpolation calculation unit selects a group of pixels having the greatest correlation in the vertical direction to perform interpolation calculation.
The display device according to claim 15, wherein the image includes 4x4 pixel areas, and the interpolation calculation unit performs interpolation calculation on the 4x4 pixel areas by bicubic interpolation.
The display device according to claim 15, wherein the image includes 3x3 pixel areas, and the interpolation calculation unit performs interpolation calculation on the 3x3 pixel areas by Newton interpolation.