KR101211102B1 - Image processing device and method for processing image data of the same - Google Patents

Abstract

The present invention comprises the steps of constructing first window data from input Bayer data; Generating edge data by detecting an edge direction of a center pixel in the first window data; Combining Bayer data with image data and edge data of the center pixel; Constructing second window data using the regenerated Bayer data; Maintaining or changing edge data of the center pixel in the second window data by comparing edge data of the center pixel in the second window data with edge data of a peripheral pixel placed around the center pixel; And interpolating the second window data using the second window data.

Description

Image processing apparatus and data processing method using the same {IMAGE PROCESSING DEVICE AND METHOD FOR PROCESSING IMAGE DATA OF THE SAME}

The present invention relates to an edge direction processing method of an image for re-determining an edge direction of a center pixel in consideration of an edge direction of a peripheral pixel.

The image processing apparatus is a device that converts a signal of light into an electrical signal so that it can be displayed on a display device or stored in a storage device. The application of image processing devices is very wide and continues to expand, including digital cameras, mobile phone cameras, camcorders, security devices, and medical devices. The image processing apparatus is divided into two types according to a method of reading a signal, a solid state image pickup device (CCD) and a CMOS image sensor (CMOS image sensor). .

The CCD transfers the charge generated in the photodiode out of the array by using vertical and horizontal CCD unit elements and converts it into a voltage using a single amplifier to read the signal out in series. CIS, on the other hand, reads out through a readout circuit that is added pixel by pixel. The difference between the CCD and the CIS stems from this difference in readout.

CCD has the advantage of low pixel overhead, which makes the pixel very small and has a high fill factor. In addition, since there is no active circuit in the process of reading out the signal, there is no thermal noise or a deviation between circuits in the pixel, so that fixed pattern noise (FPN) does not appear. In addition, because CCD uses a special process, the process can be optimized for image quality and charge transfer to provide a high quality image, and the pixel size can be reduced without significant performance degradation. However, CCD has a disadvantage of increasing the size of the entire camera system due to its high price and difficulty of integrating with other camera blocks using a special process. In addition, the CCD has a disadvantage in that the readout speed is limited because of the series readout method, and a high power and high voltage clock is required for fast and complete charge transfer, which is not suitable for mobile applications due to high power consumption.

On the other hand, CIS can achieve high frame rate because of parallel readout, and it can be manufactured at low price because it uses general CMOS process and has low power consumption because it readout using CMOS circuit. In addition, analog blocks and digital blocks are directly adjacent to each other to realize camera-on-a-chip, and focal plane analog image processing enables wide area correction, edge detection, motion detection, and real-time object tracking. It can be implemented in hardware. In recent years, CIS products that are comparable to CCDs in terms of image quality have been released, and CIS is rapidly replacing CCDs in the image processing device market.

The present invention provides an image processing apparatus capable of performing efficient data processing and a data processing method using the same.

The present invention comprises the steps of constructing first window data from input Bayer data; Generating edge data by detecting an edge direction of a center pixel in the first window data; Combining Bayer data with image data and edge data of the center pixel; Constructing second window data using the regenerated Bayer data; Maintaining or changing edge data of the center pixel in the second window data by comparing edge data of the center pixel in the second window data with edge data of a peripheral pixel placed around the center pixel; And interpolating the second window data using the second window data.

In addition, the present invention provides a pixel array; A memory for storing information provided from the pixel array as first window data; A data format generator for extracting an edge direction of data of a center pixel among the first window data stored in the memory and regenerating data including the image data and the edge data; Comprising the second window data implemented by the regenerated data provided by the data format generation unit, by comparing the edge data of the center pixel of the second window data and the edge data of the peripheral pixel disposed around the center pixel An edge data verification unit for maintaining or changing edge data of the center pixel in the second window data; And an interpolation unit for interpolating data of the Chinese pixel held or changed by the edge data verification unit.

Since the image processing apparatus of the present invention does not need to extract the edge information many times, it is possible to greatly reduce the memory usage, and it is not necessary to include unnecessary detection circuits.

1 is a block diagram of an image processing apparatus according to an embodiment of the present invention;
FIG. 2 is a block diagram showing a Bayer data processor of FIG. 1; FIG.
FIG. 3 is a more detailed view of the YcbCr data processor of FIG. 2; FIG.
4 is a view showing a window pattern stored in the memory device of FIG.
FIG. 5 is a diagram showing that the window pattern shown in FIG. 4 is displayed according to the characteristics of pixels. FIG.
FIG. 6 is a view showing display of the window pattern shown in FIG. 4 according to the position of a pixel; FIG.
FIG. 7 is a block diagram showing an edge data generator shown in FIG. 1; FIG.
Fig. 8 shows the edge direction of the center pixel in 5 * 5 window data.
9 is a flowchart showing a data processing method of the image processing apparatus according to the embodiment of the present invention.
10 and 11 illustrate an embodiment of window data for applying the method shown in FIG.
12 is a block diagram for implementing a data processing method of the image processing apparatus shown in FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, in order to facilitate a person skilled in the art to easily carry out the technical idea of the present invention. do.

1 is a block diagram of an image processing apparatus according to an embodiment of the present invention.

Referring to FIG. 1, the image processing apparatus according to the present embodiment includes a pixel array 110, an A / D converter 120, a Bayer data processor 130, a YCbCr data processor 140, and an edge data generator ( 200).

In the pixel array 110, a plurality of pixels are arranged in a Bayer pattern, and green pixels, red pixels, and blue pixels are disposed at 50%, 25%, and 25%, respectively. Bayer Pattern considers that the human visual system is most sensitive to luminance components, ie, green, so that color filters for green components are placed to 50% of the total photocells and the rest The most commonly used color filter array (CFA) with alternating red and blue color filters. Therefore, in order to process data having such a Bayer pattern, it is required to have a complete red, green, and blue component for one pixel by interpolating a color component.

The A / D converter 120 converts an image data value in an analog form provided from a pixel array into a digital form and outputs the digital data. Since the value provided by the pixel array 110 is a Bayer pattern, the data converted to the A / D converter 120 is also a Bayer pattern. That is, there is only green information, red information, or blue information in one pixel value. In addition, although not shown, a pixel read-out circuit is provided between the pixel array 110 and the A / D converter 120.

The Bayer data processor 130 represents a section in which the shape of the bait pattern is maintained in processing the image data. The YCbCr data processor 140 converts RGB data provided from the Bayer data processor 130 into YCbCr data and processes the same. YCbCr is a format used in imaging systems. Y is the luminance component and Cb and Cr are the chrominance components.

The block diagram shown in FIG. 1 is displayed for each function of the emissive sensor and may vary depending on the case, and a block not shown may be further included. For example, the color error (false color), which is the phenomenon that some pixels bounce out of harmony with the surrounding color by interpolating with the color different from the original color at the edge such as the outline or boundary of the object with reference to the edge information. Falling image blur, zipper artifacts caused by a fine and repeated cross-stripe pattern in the vicinity of the image edge, and an aliasing effect in which high-frequency components are confused with low-frequency components. A block such as a defect processing unit for processing a defect can be provided.

FIG. 2 is a block diagram illustrating a Bayer data processor of FIG. 1.

Referring to FIG. 2, the Bayer data processor 130 includes a DPC unit 131, a GbGr offset adjuster 132, an NR unit 133, and an interpolation unit 134. In addition, the Bayer data processing unit 120 processes the data in the memory 135 and the interpolation unit 134 used when processing data in the DPC unit 131, the GbGr offset adjustment unit 132, and the NR unit 133. Memory 136, which is used when doing so.

The dead pixel concealment (DPC) unit 131 detects a dead pixel and replaces the found dead pixel with surrounding normal pixel data. In the Bayer pattern, the GbGr offset adjustment unit 132 outputs a different value even though the green pixel Gb of which the neighboring pixel is blue and the green pixel Gr of which the neighboring pixel is red receive the same amount of light. Block to adjust In the process of generating the image information through the pixel array of the Bayer pattern, a difference, that is, an offset, occurs in generating image data values of Gr and Gb pixels. In the GbGr offset adjustment unit 132, the block effectively eliminates the Gr-Gb offset.

The noise reduction unit 133 is a block for processing pixel data to reduce noise. Pixel data values captured by the image processing device contain noise due to internal or external factors of the image processing device, and the actual captured image is reproduced when the image is reproduced using the pixel value including this noise. Can be different. In addition, the NR unit 133 determines whether the pixel data belongs to the edge region, and corrects the pixel value including the noise to remove the noise.

The interpolation unit 134 is a block for generating RGB data that generates red, green, and blue data values corresponding to each pixel from data of only one of red, green, and blue information for each pixel. For this color interpolation operation, it is necessary to consider the orientation of edges such as horizontal, vertical, and diagonal in a predetermined pixel area.

3 illustrates the YcbCr data processor of FIG. 1 in more detail.

3, the YcbCr data processing section includes an NR 141 section, a data interface adjusting section 142, and a memory 143. FIG. The NR 141 is a block for reducing noise in the YcbCr data domain, and the data boundary adjusting unit 142 is a block for realizing an image more sharply by adjusting data values of both sides at the boundary of the image. For example, darker areas are darker and brighter areas are converted to lighter data. The NR 141 and the data interface adjusting unit 142 also implement data using one memory 143 to reduce memory capacity.

FIG. 4 is a diagram illustrating a window pattern generated by the memory device of FIG. 3. FIG. 5 is a diagram showing that the window pattern shown in FIG. 4 is displayed according to the characteristics of pixels. Next, the process of configuring the window will be described with reference to FIGS. 4 and 5.

The image processing apparatus is configured not to process all the information provided in the pixel array at once, but each block receives and processes only a certain area of data and transfers it to the next stage. This is to minimize the capacity of the memory provided.

As shown in Fig. 4, assuming that the memory 135 can store five lines (L1 to L5) of data in the pixel array, the first 5 * 5 data are stored by window A as shown in Fig. 5 (a). Sorted together. In this case, the pixel at the center is referred to as the center pixel X, and each block of the image processing apparatus performs necessary data processing on the center pixel X. Here, data processing refers to operations such as interpolation or detecting an edge direction with respect to the center pixel data. When data processing is performed on the center pixel X, the window is next moved to B and aligned as shown in FIG. 5 (b). In this case, the pixel at the 'Y' position becomes the center pixel. As the data window is changed sequentially, all data in the pixel array is processed sequentially. Therefore, the two outermost lines of the pixel array are used as auxiliary data.

In addition, although the case where the data window processed by the image processing apparatus is 5 * 5 was demonstrated here, in some cases, the data window processed by the image processing apparatus may be 3 * 3 or 7 * 7. In this case, the memory 135 stores pixel data of three lines or seven lines. In addition, in FIG. 5, the green pixel is Gr, the two neighboring pixels are red pixels, and the Gb is the neighboring two pixels, is blue pixels.

FIG. 6 is a diagram illustrating display of the window pattern illustrated in FIG. 4 according to the position of a pixel. In addition, the case where the data window is 3 * 3, 5 * 5, or 7 * 7 is shown, respectively. The numbers on the sides of R, B, and G, which represent red, blue, and green pixels, respectively, indicate pixel positions.

FIG. 7 is a block diagram illustrating an edge data generator shown in FIG. 1.

Referring to FIG. 7, the edge data generator 200 may include a data input controller 210 for receiving image data, an N * N window transfer unit 220, an edge data detector 230, and a data format generator ( 240, a memory device 250. In this case, the memory device 250 may use the memory device shown in FIG. 2, or a separate memory device may be separately provided in the edge data generator 200.

The data input controller 210 receives pixel data from the A / D converter 120 and transfers the pixel data to the memory device 250. The N * N window data transfer unit 220 provides the window data stored in the memory device 250 to the edge data detector 230. The edge data detector 230 detects the edge direction of the center pixel in the window data transferred by the N * N window data transfer unit 220. There are numerous ways to detect the edge direction, and all the various edge detection methods can be used here. For example, an edge value of the center pixel may be obtained by obtaining a difference value between neighboring pixel values and comparing the difference value. The edge direction refers to which direction the image boundary of the area containing the center pixel value is.

The edge detection method uses gradient and Laplacian techniques to calculate color information around pixels by calculating gradients or pixel value variations in the vertical and horizontal directions, diagonal directions, and calculated calculated gradients or The direction in which the edge is formed is determined by referring to the pixel value change amount and the like. At this time, when the gradient or pixel value variation is less than the threshold value, it is determined as a flat region where no edge component exists in the pixel group. If the gradient or pixel value variation is the same, when two or more edge directions exist, it is determined as a complicated region. do. As described above, the edge direction information of the image may be determined as an edge in a vertical direction, an edge in a horizontal direction, an edge in a diagonal direction, a flat area, a complicated area, or the like. In addition, as in the edge direction information, the edge information may include edge coring, edge gain, and edge limit used for edge calculation.

Continuing with reference, the data format generator 240 stores edge data in 2 bits or 3 bits, combines the data with the center pixel data, and outputs the combined data. The combined edge data is then used when edge information of the data is needed in the next step of the image processing apparatus. That is, the edge data generator 200 detects and determines the edge direction of the center pixel data in the window data such as 3 × 3, 5 × 5, 7 × 7, etc. using the memory, and uses the data of the center pixel using the memory. In combination with

8 is window data showing the edge direction of the center pixel. In Fig. 8, the center pixel B23 is denoted by an arrow when (1) has vertical edges, (2) and (4) diagonal edges, and (3) horizontal edges.

9 is a flowchart showing a data processing method of the image processing apparatus according to the embodiment of the present invention.

Referring to FIG. 9, the data processing method of the image processing apparatus according to the present embodiment receives Bayer data (S310). Subsequently, first window data is configured (S320). At this time, it can be set to 3x3, 5x5 or 7x7.

Subsequently, edge data of the center pixel is detected from the first window data to generate edge data (S330). Next, Bayer data is regenerated by combining image data and edge data of the center pixel (S340). Subsequently, second window data is configured (S350). In this case, the second window data may be configured as the first window data or may be configured differently. For example, the first window data is set to 5 * 5 and the second window data is set to 3 * 3. Next, in the second window data, the edge direction of the peripheral pixel and the edge direction of the center pixel are compared and determined to determine or maintain the edge direction of the center pixel (S360). Then, the interpolation process is performed using the data of the center pixel. Perform (S370)

Looking in more detail, as follows. First, the optical signal obtained from the pixel array is converted into digital data by the A / D converter 120 and output.

As described above, the edge data is stored as a 2-bit or 3-bit digital value in one of the vertical direction, the horizontal direction, the 45 degree diagonal direction, the 135 degree diagonal direction, the flat direction, or the complex direction. The flat direction is when there is no special direction, and the complicated area is when two or more edge directions exist. The edge data generator detects the edge direction of the center pixels.

As the window is sequentially changed, edge data for the values of all the center pixels are detected and combined with the image data of each center pixel to reproduce the data.

The regenerated data is then used to construct a second window and again to determine the correct edge direction of the center pixel of the constructed second window. In this case, it is determined whether to maintain or change the edge direction of the center pixel in consideration of the edge direction of the surrounding pixels.

In the case where the second window data is 3 * 3, the edge direction is first analyzed for eight peripheral pixels adjacent to the center pixel. If the edge direction of eight peripheral pixels is the same as the center pixel, it is determined that the edge direction of the center pixel is correct.

If the edge direction of the peripheral pixel is different from the edge direction of the center pixel, it is determined how many of the eight peripheral pixels are the same as the edge direction. For example, when the center pixel has a vertical edge, five pixels having a vertical edge direction, two pixels having a horizontal edge direction, and one pixel having a diagonal edge direction among the edge directions of eight peripheral pixels In the individual case, the edge direction of the center pixel is maintained.

If the edge direction of eight adjacent pixels is four pixels having a vertical edge direction and four pixels having a horizontal edge direction, one of the main edge directions of two peripheral pixels is arbitrarily selected. In addition, when the edge direction of the center pixel does not coincide with the edge direction of the plurality of eight peripheral pixels, the edge direction of the center pixel is changed to the edge direction of adjacent pixels. The interpolation process is performed using the changed center pixel value.

10 and 11 illustrate an embodiment of window data for applying the method shown in FIG. FIG. 10 shows a case where there is only image data, and FIG. 11 shows an aligned state after all edge directions of the center pixel are obtained using the first window data.

FIG. 11 is a diagram illustrating digital data of FIG. 10 to be included in RGB data by detecting edge direction information of a center pixel and surrounding pixels. At this time, Rv, Gv, Bv, etc. are pixels having vertical edges, Rh, Gh, Bh, etc. are pixels having horizontal edges, and Rd, Gd, Bd are pixels having diagonal edges, Rc , Gc and Bc are pixels represented by a complex region in which two or more edge directions are detected, and Rf, Gf and Bf are pixels represented by a flat region where edge detection is not performed.

In FIG. 11, each type indicates what pixel the center pixel is. In the Rtype window data of Fig. 11, the majority of the peripheral pixels are in the vertical direction, and then the flat region. The edge direction of the center pixel and the peripheral direction of the peripheral pixel coincide in the vertical direction. It can be determined that the vertical direction without change. In the Btype window data of Fig. 12, the majority of the peripheral pixels are in the vertical direction, and then in the complex area. Since the edge direction of the center pixel and the edge direction of the adjacent pixel do not coincide with each other, the value of the center pixel is changed in the vertical direction in the vertical direction in the complicated region.

In the Grtype window data of Fig. 12, the majority edge direction of the peripheral pixel is a flat area, followed by the minor edge direction is a complicated area. Since the edge direction of the center pixel and the main edge direction of the adjacent pixel do not coincide with each other, the value of the center pixel changes the edge direction from the vertical direction to the flat area. In the Gbtype window data of Fig. 12, the edge direction of most of the adjacent pixels is a flat area followed by the vertical direction, and since the edge direction of the center pixel and the edge direction of the adjacent pixel do not coincide with each other, the center pixel is moved from the vertical direction to the flat area. The edge direction is changed. In this way, interpolation by correcting the edge direction of the center pixel in the vertical direction instead of the complicated area can reduce color noise and improve sharpness.

FIG. 12 functionally displays each block required in accordance with the data processing method of the image processing apparatus according to the present embodiment shown in FIG.

The image processing apparatus according to the present exemplary embodiment includes a pixel array 410, a memory device 420, a data format generation unit 430, a data verification unit 440, and an interpolation unit 450.

The memory device 420 is for storing first window data provided by the pixel array. The data format generator 430 extracts an edge direction of data of a center pixel among the first window data stored in the memory device 420 to regenerate data including the image data and the edge data.

The edge data verification unit 440 is composed of second window data implemented by regenerated data provided by the data format generation unit. The edge data verification unit 440 is arranged around edge data of the center pixel of the second window data and the center pixel. Comparing the edge data of the peripheral pixels, to maintain or change the edge data of the center pixel in the second window data. The interpolation unit 450 is for interpolating data of the Chinese pixel held or changed by the edge data verification unit. The memory device may be used to store not only the first window data but also the second window data.

As described above, the image processing apparatus according to the present embodiment includes an edge data generation unit, and detects edge information of the center pixel from the window data and combines the edge information with the center pixel data. If it is necessary to use the edge information of the data later, the image data is processed using the edge information attached in the form of a tag without detecting the edge information newly.

In the past, an image processing apparatus generally used requires a lot of time for processing data, and a lot of memory is used since edge information of data is used every day. For example, edge information is required when the DPC unit 131 of FIG. 2 finds and removes the dead pixel, and the interpolation unit 134 uses the edge information when performing the interpolation operation. In addition, the data boundary adjustment unit 142 of FIG. 3 also needs edge information. However, the previous image processing apparatus extracts edge information of the data in each block by comparing the values of the window data before processing the data in the block requiring the edge information. As the edge information is detected in each block, the memory must be frequently used, and thus, the necessary detection logic is provided in each block of the image processing apparatus.

However, according to the present invention, the image processing apparatus extracts edge information from the edge data generating unit 200 and combines the data of the pixel in the form of a tag. I use it. Therefore, since the edge information does not need to be extracted many times in the image processing apparatus, the memory usage can be greatly reduced, and there is no need to provide unnecessary detection circuits.

As such, when the edge data detection unit 200 detects edge information at one time and includes the detected edge information in the image data to regenerate the image data, the image signal processing unit 370 receives the input and receives all the edge information of the image. By eliminating the edge information detection logic in the circuit unit and immediately performing image processing using the edge information, the image processing apparatus may process image data more easily using a minimum of memory. In particular, since the data of the center pixel is corrected with reference to the edge data information of the data of the surrounding pixels and then interpolated, more reliable interpolation results can be obtained.

The quality of the final image depends on how the data is processed in the demosaicing or color interpolation process. In the process of performing the interpolation process, if the edge of the image is detected and processed with the information, a higher quality image can be realized.

In order to analyze the data and detect the edge information and perform interpolation using the data, a large amount of resources are required for the image processing apparatus. Previously, Bayer data was used to construct window data such as 3x3 or 5x5, obtain edge information about a center pixel, and use it to perform interpolation.

In this case, since edge information is obtained with limited information, edge information may be incorrectly obtained due to distortion due to noise or the like, which may cause an error in the interpolation result. This error appears as color noise when implementing the image.

When processing data to implement an image with the edge information of the center pixel may be less accurate. The present invention regenerates data in which edge data including edge information is combined with all data before performing the interpolation process. When the window is constructed using the regenerated data and the interpolation line is performed using the generated data, interpolation can be performed more accurately because edge information is included in every pixel value of the window data.

In particular, the image processing apparatus according to the present embodiment performs interpolation after changing or maintaining the value of the center pixel with reference to the values of surrounding pixels while the edge data is included in all pixel values. When all the data in the window data has an edge direction, and the edge direction of the center pixel is different from the edge direction of the surrounding pixel data, the data is processed with reference to the edge data of the peripheral pixel, thereby more accurately processing the data of the center pixel. It is possible. Therefore, the image processing apparatus according to the present exemplary embodiment may interpolate the value of the center pixel having the correct edge information. It is possible to prevent noise from being included due to incorrect edge information in the RGB value after interpolation.

In addition, since all values of the window data have this edge information, this edge data can be used to use interpolation in various forms.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the present invention. I will understand. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the scope of the appended claims, as well as the appended claims.

Claims (14)

Constructing first window data from input Bayer data;
Generating edge data by detecting an edge direction of a center pixel in the first window data;
Combining Bayer data with image data and edge data of the center pixel;
Constructing second window data using the regenerated Bayer data;
Maintaining or changing edge data of the center pixel in the second window data by comparing edge data of the center pixel in the second window data with edge data of a peripheral pixel placed around the center pixel; And
Performing interpolation using the second window data
And a peripheral pixel of the center pixel in the second window data is eight pixels in contact with the center pixel.
delete Claim 3 has been abandoned due to the setting registration fee. The method of claim 1,
And the first window data is 3 * 3, 5 * 5, or 7 * 7 data.
Claim 4 has been abandoned due to the setting registration fee. The method of claim 1,
And the second window data comprises 3 * 3, 5 * 5, or 7 * 7 data.
Claim 5 was abandoned upon payment of a set-up fee. The method of claim 1,
Maintaining or changing the edge data of the center pixel in the second window data
Comparing edge data of the center pixel with edge data of eight peripheral pixels in contact with the center pixel; And
Changing the edge data of the center pixel to the edge data of the peripheral pixel when all of the edge data of the eight peripheral pixels is identical to and different from the edge data of the central pixel. Data processing method of processing device.
Claim 6 has been abandoned due to the setting registration fee. The method of claim 1,
Maintaining or changing the edge data of the center pixel in the second window data
Comparing edge data of the center pixel with edge data of eight peripheral pixels in contact with the center pixel; And
Changing the edge data of the center pixel to matched edge data of the peripheral pixel when at least four values of the edge data of the eight peripheral pixels match and are different from the edge data of the central pixel. And a data processing method of the image processing apparatus.
Claim 7 has been abandoned due to the setting registration fee. The method of claim 1,
The edge data is
The direction of the image characteristic of the data of the center pixel has information about one of the vertical direction, the horizontal direction, the diagonal direction in the 45 degree direction, the diagonal direction in the 135 degree direction, the flat direction and the complex direction. Data processing method of the image processing apparatus.
Pixel arrays;
A storage unit for storing the information provided from the pixel array as first window data;
A data format generation unit for extracting an edge direction of image data of a center pixel among the first window data stored in the storage unit and regenerating data including the image data and the edge data;
Reconstructed data provided by the data format generation unit is composed of second window data, and compares edge data of a center pixel of the second window data with edge data of a peripheral pixel disposed around the center pixel. An edge data verification unit for holding or changing edge data of the center pixel in the second window data; And
Interpolation unit for interpolating data of the center pixel maintained or changed by the edge data verification unit
And surrounding pixels of the center pixel in the second window data are eight pixels in contact with the center pixel.
delete Claim 10 has been abandoned due to the setting registration fee. The method of claim 8,
And the first window data comprises 3 * 3, 5 * 5, or 7 * 7 data.
Claim 11 was abandoned upon payment of a setup registration fee. The method of claim 8,
And the second window data comprises 3 * 3, 5 * 5, or 7 * 7 data.
Claim 12 is abandoned in setting registration fee. The method of claim 8,
The edge data verification unit
When the edge directions of the eight peripheral pixels surrounding the center pixel all coincide with each other, and the edge data of the eight peripheral pixels is different from the edge data of the central pixel, the edge data of the central pixel is set to the edge pixel of the peripheral pixel. An image processing apparatus characterized by changing to edge data.
Claim 13 was abandoned upon payment of a registration fee. The method of claim 8,
The edge data verification unit
When the edge directions of the four or more peripheral pixels surrounding the center pixel all match, and the edge data of the four peripheral pixels is different from the edge data of the center pixel, the edge data of the center pixel is converted into the peripheral pixel. And change to the matched edge data of the image processing apparatus.
Claim 14 has been abandoned due to the setting registration fee. The method of claim 8,
The edge data is
The direction of the image characteristic of the data of the center pixel has information about one of the vertical direction, the horizontal direction, the diagonal direction in the 45 degree direction, the diagonal direction in the 135 degree direction, the flat direction and the complex direction. Image processing unit.

Images