JP2000332998A - Image processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processor capable of generating high quality magnified and reduced image data. SOLUTION: In this image processor, (n) pieces of dots and images data of (m) pieces of lines composed of the (n) pieces of dots are successively inputted and outputted as YUV data, the data is subjected to writing or reading to/from a memory 6, a contour extraction flag is written to the memory by performing vertical contour extraction and vertical filtering while read data and a plurality of optional vertical thresholds inputted from the outside are defined as inputs, thinning and interpolation processing is performed from vertical magnification and reduction rates inputted from the outside with the data as an input, the vertically thinned and interpolated data and the plurality of optional horizontal thresholds inputted from the outside are inputted, horizontal contour extraction and horizontal filter processing are performed, thinning and interpolation processing is performed from horizontal magnification and reduction rates inputted from the outside with the data as an input, and the data is outputted as an input to a display device.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus having a function of enlarging and reducing a digital image, and more particularly to an image processing apparatus for performing image enlargement and reduction processing by a bilinear interpolation method.

[0002]

2. Description of the Related Art In recent years, cameras, video tape recorders,
Various products with digital special effects added to personal computers have been made. One of the functions of the digital special effects device is a digital zoom function for enlarging or reducing an image, and its signal processing is performed based on a frame memory. When the image is enlarged or reduced in the digital special effect device, contour enhancement is performed at the time of image enlargement, and filter processing is performed at the time of image reduction to prevent image deterioration or the like due to folding back of the screen reduction. In particular, at the time of enlargement, the outline of the image becomes ambiguous unless the outline emphasis filter processing is performed. Generally, the filter that performs edge enhancement is a filter that has a negative impulse response (an interpolation function that has a negative value).
Was used.

For this reason, conventionally, enlargement and reduction of digital images have been performed by adopting a configuration as shown in FIGS. 7, 8 and 9. Hereinafter, a conventional image processing apparatus will be described. In FIG. 7, reference numeral 101 denotes a memory which holds R (red data), G (green data), and B (blue data) of image data for one screen. Reference numeral 102 denotes a memory control unit which stores the image data RGB in the memory 101
Read from Reference numeral 103 denotes a vertical filter, and image data R read out from the memory control
Image data RG which receives GB as input and is subjected to vertical filter processing
B is output. Numeral 104 denotes a vertical thinning-out interpolation means, which is the image data RG filtered in the vertical direction.
B is input, and image data RGB subjected to thinning and interpolation processing in the vertical direction are output. Reference numeral 105 denotes a horizontal filter unit which receives the image data RGB which has been thinned out and interpolated in the vertical direction as input and outputs image data RGB which has been filtered in the horizontal direction. Reference numeral 106 denotes a horizontal thinning-out interpolation unit which receives the image data RGB filtered in the horizontal direction as input, and outputs the image data RGB thinned out and interpolated in the horizontal direction. Reference numeral 107 denotes a horizontal / vertical direction control unit that receives as input the vertical enlargement / reduction ratio and the horizontal enlargement / reduction ratio input from the outside,
The vertical filter means 103, the vertical thinning interpolation means 10
4. Horizontal filter means 105, horizontal thinning interpolation means 10
6 is output. An image output unit 108 outputs image data to an image display device.

In FIG. 8, reference numeral 1031 ₁ denotes a first multiplication means, which is an arbitrary coefficient inputted from the outside and image data RGB of the first line among s lines outputted from the memory means 102. And outputs multiplied image data. Multiplying means 1 connected as described above
There are s 031s. Reference numeral 1032 denotes an adding unit which receives the s multiplied image data RGB output from the s multiplying unit 1031 as an input, adds all the s image RGB data, and outputs the added data.

In FIG. 9, reference numeral 1051 ₁ denotes a first one-dot holding means, which is the vertical thinning-out interpolation means 104;
The image data RGB output from the device is input, and one dot is held and output. Reference numeral 1051 ₂ denotes a second one-dot holding unit, and the first one-dot holding unit 1051 ₁
The image data RGB output from the device is input, and one dot is held and output. The connected one-dot holding means 1051 as described above, that is, the preceding one-dot holding means 105
There are q pieces of 1-dot holding means 1051 that receive image data RGB output from 1 as input, hold 1 dot, and output.

[0006] 1052 ₁ is a first multiplication means,
An arbitrary coefficient input from the outside and the image data RGB output from the first dot holding unit 10511 ₁ are input and image data RGB subjected to multiplication processing is output.
1052 ₂ is a second multiplying means, which is an arbitrary coefficient input from the outside and the second dot holding means 1051
_The image data RGB output from ₂ is input and the multiplied image data RGB is output. Multiplying means 1052 connected as described above, that is, multiplying means for outputting image data RGB multiplied by inputting an arbitrary coefficient input from the outside and image data RGB output from second dot holding means 1051 There are q pieces of 1052. Reference numeral 1053 denotes an adding unit which receives q multiplied image data RGB output from the q multiplying units 1052, and adds and outputs all q image data RGB.

In the above configuration, the vertical filter means 1
In step 03, the s-line image data R output from the memory control means 102 is simultaneously input, and an arbitrary coefficient a1 input from the outside and the first-line image data R input from the memory control means 102 are converted into the first data. Multiplication means 103
Multiplied treated with 1 _1, multiplies processed in any coefficient a2 and the memory control unit 102 the second line image data and the R second multiplication means 1031 ₂ input from input from the outside at the same time. The above processing performs multiplication processing for all the image data R s of lines output from the memory control unit 102, addition processing for all the multiplication processing image data of the s of lines in addition means 103 ₂ I do. At the time of enlargement, a filter coefficient (a coefficient having a negative value) having a negative impulse response is generally given to a1,... The image data R added by the adding means 103 ₂ is output as vertical filtered image data R of the r-th line (1 <r <s) of the s line image data R output from the memory control means 102. Is done. The above processing is also performed for the image data G and B at the same time.

[0008] The vertical thinning interpolation means 104 receives the image data R which has been subjected to the vertical filter processing output from the vertical filter means 103 as input, and obtains a horizontal / vertical direction control means 107 from a vertical enlargement / reduction ratio inputted from the outside. Performs a process of thinning out what line out of what line or inserting what line out of what line according to the control signal output by. The above processing is also performed for the image data G and B at the same time.

The horizontal filter means 105 sequentially inputs the image data R, which has been output from the vertical thinning and interpolating means 104 and has been subjected to filtering, thinning and interpolation in the vertical direction, to a first dot holding means 10511 ₁ , The image data R output from the first dot holding unit 1051 ₁ is input to the second dot holding unit 1051 ₂ ..., The p-th dot holding unit 1051 _p ,.
Have the same connection also dot holding means 1051 _q. Then, an arbitrary coefficient c1 input from the outside
And the first dot image data R input from the first one-dot holding means 10511 ₁ by the first multiplication means 105
2 ₁ , and at the same time, an arbitrary coefficient c 2 inputted from outside and the second dot image data R inputted from the second dot holding means 1051 ₂
Multiply by 2 ₂ . The above processing is similarly performed for the subsequent... P-th dot holding means 1051 _p ,..., Q-th dot holding means 1051 _q , and multiplication processing is performed on q-dot image data R. an addition process is performed for all the adding means 105 ₃ multiplication processing image data of dot. At the time of enlargement, a filter coefficient (a coefficient having a negative value) having a negative impulse response is generally given to c1,..., Cq in order to use an outline emphasis filter. The image data R that has been subjected to the addition processing by the addition means 105 ₃ is stored in the q pieces of one-dot holding means 1051.
Line of the q-dot image data R output from
p <q) is output as horizontal filtered image data R. The above processing is also performed for the image data G and B at the same time.

The horizontal thinning interpolation means 106 receives the horizontal filtered image data R output from the horizontal filter means 105 as input, and controls the horizontal / vertical direction control means from the horizontal enlargement / reduction ratio inputted from the outside. According to the control signal output from the control unit 107, a process of thinning out what dots out of what dots or inserting what dots out of what dots is performed.
The above processing is also performed for the image data G and B at the same time.
In the image output means 108, the horizontal thinning interpolation means 10
The image data arbitrarily enlarged or reduced output from 6 is output to the image display device. As described above, conventionally, digital image data has been enlarged or reduced.

[0011]

As described above, conventionally, in an image processing apparatus for enlarging and reducing an image, especially in the case of enlarging, in order to prevent image deterioration due to ambiguity of the contour, for example, Japanese Patent Application Laid-Open No. Hei 7-274064. As shown in Japanese Patent Application Laid-Open Publication No. H10-209, the contour enhancement is performed by uniformly applying the contour enhancement filter. However, a contour emphasis filter generally uses a filter having a negative impulse response (an interpolation function having a negative value) in many cases, and if filter processing is performed uniformly on image data, an unsightly ringing or other distortion may occur. I was In particular, the image data of the original image is significantly distorted in a so-called contour region having a high-frequency component of the image.

The image distortion called ringing will be described with reference to the drawings. FIG. 10A shows an example of the impulse response of the filter. When a unit step signal is added to this filter, a response as shown in FIG. 10B is obtained.
As shown in FIG. 10B, the step response can be known by continuously adding the values of the impulse response. Therefore, if the sign of each impulse response value is different, the impulse response oscillates. This causes unpleasant distortion in the image. In particular, the distortion occurs at an edge portion of an image, and the higher the order of the filter, the more the distortion is spread over a wide range. Therefore, the quality of the enlarged image data did not improve as expected.

However, in the real-time enlargement / reduction function, if a function is added with emphasis on the function, it is recognized as an added value of the product. Therefore, at least if the outline is emphasized, distortion such as ringing or the like as described above is tolerated. Met. However, in recent years, the display device has been improved in definition and the display performance has been rapidly improved, so that the image quality has been shifted to the emphasis.As a result, a high-quality enlarged image without distortion such as ringing at the time of enlargement is strongly intensified. It has come to be desired.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems, and has as its object to provide an image processing apparatus capable of generating high-quality enlarged and reduced image data.

[0015]

In order to solve the above-mentioned problems, the present invention comprises n dots output from a conversion matrix calculating means and m lines composed of the n dots. Data is sequentially input, and the current contour evaluation image data is image data (p, r) (each variable is a natural number and has the following relationship, (1 ≦ p
≦ q ≦ n) (1 ≦ r ≦ s ≦ m)), the image data (p−1, r−1), (p−1, r), (p−1, r +)
1), a horizontal outline is extracted by using an outline flag corresponding to each image data and a plurality of arbitrary horizontal thresholds input from the outside. If the outline is an outline, the outline flag is added to the current outline evaluation image data. Means for adding and outputting a horizontal direction contour extraction and contour flag writing means, inputting data output from the horizontal direction contour extraction and contour flag writing means and corresponding contour flags, and setting the data and the contour flags to q Q horizontal filter selecting means for sequentially reading data into one dot holding means for holding one dot and selecting an arbitrary coefficient by a flag of the p-th horizontal filter one dot holding means; The arbitrary coefficient output from the means and the data output from the q horizontal filter 1 dot holding means, respectively. The q horizontal filter multiplying means to be calculated and the operation results output from the q horizontal filter multiplying means are input, all the q data are added, and the result is output as the operation result of the p-th data S lines are input via a memory control unit to data constituted by a horizontal filter unit constituted by a horizontal filter addition unit, and m lines composed of n dots and the n dots, If the current contour evaluation image data is image data (p, r), image data (p-1, r-1),
Vertical contour extraction is performed by using (p, r-1), (p + 1, r-1), a contour flag corresponding to each image data, and a plurality of arbitrary vertical threshold values input from the outside. If so, a contour flag is added to the current contour evaluation image data, and a vertical contour extraction and contour flag writing means for outputting simultaneously with s lines, and s outputted from the vertical contour extraction and contour flag writing means. S vertical filter selecting means for selecting an arbitrary coefficient by an r-th contour flag in the book line;
S vertical filter multiplying means for multiplying an arbitrary coefficient output from the vertical filter selecting means with the image data of s lines output from the vertical contour extracting and contour flag writing means; All the calculation results output from the vertical filter multiplication means are added, and r
And vertical direction filter means comprising adder means for outputting the result as an operation result of the second data.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIGS. 1, 2 and 3 relate to an embodiment of the present invention, and FIG. 1 is a block diagram of an image processing apparatus. In FIG. 1, reference numeral 1 denotes a conversion matrix operation means, which is image data RGB composed of n dots and m lines composed of the n dots.
Are sequentially input, converted into image data YUV (Y: luminance, UV: color difference) and output. Reference numeral 2 denotes a horizontal contour extraction and horizontal filter means, which receives a horizontal threshold value input from the outside and the image data YUV as input, and performs horizontal contour extraction and horizontal filter processing on the image data Y.
Output UV. 3 is a horizontal thinning interpolation means,
The image data YUV that has been subjected to the horizontal contour extraction and horizontal filter processing is input, and image data YUV that has been subjected to horizontal thinning interpolation processing is output. Reference numeral 4 denotes a horizontal direction control unit which receives a horizontal enlargement / reduction ratio input from the outside and outputs a control signal for controlling the horizontal outline extraction / horizontal filter unit 2 and the horizontal thinning interpolation unit 3. I do. Reference numeral 5 denotes a memory control unit which receives the image data YUV subjected to the horizontal thinning-out processing and an outline flag as input, and outputs the image data subjected to the horizontal thinning-out interpolation processing, an outline flag, and a memory control signal. . Reference numeral 6 denotes a memory, which stores image data according to a control signal of the memory control means 5. Reference numeral 7 denotes a vertical contour extraction and vertical filter unit, which is a vertical threshold value input from the outside and image data YUV output from the memory control unit 5.
And outputs image data YUV that has been subjected to vertical contour extraction and vertical filter processing. Numeral 8 denotes a vertical thinning-out interpolation means, which inputs the image data YUV subjected to the vertical contour extraction and the vertical filtering, and outputs the image thinning-out image data YUV. Reference numeral 9 denotes a vertical direction control unit which receives a vertical enlargement / reduction ratio input from the outside and outputs a control signal for controlling the vertical contour extraction and vertical filter unit 7 and the vertical thinning interpolation unit 8. I do. Reference numeral 10 denotes an image output unit that receives the image data YUV that has been subjected to the vertical thinning-out process and outputs the data to an image display device.

As shown in FIG. 2, the horizontal filter / contour extraction means 2 comprises a horizontal contour extraction / contour flag writing means 21 and a horizontal filter means 22. Horizontal contour extraction and contour flag writing means 21
Receives the image data Y output from the conversion matrix calculating means 1 and performs horizontal edge extraction processing to output the image data Y and an outline flag corresponding to the image data Y.

In the horizontal direction contour extraction and contour flag writing means 21, reference numeral 2101 denotes a first horizontal contour extraction 1;
A dot holding unit which receives image data Y output from the conversion matrix calculating unit 1 and a first contour flag corresponding to the image data Y, and holds image data Y and a contour flag for one dot; Is output. 210
2 is a second horizontal contour extraction 1 dot holding means,
The image data Y output from the first horizontal contour extraction one dot holding unit 2101 is input, and the image data Y held for one dot is output. Reference numeral 2103 denotes a first horizontal contour extraction n dot holding unit which receives the image data Y output from the conversion matrix operation unit 1 and the first contour flag, holds n dots, and sequentially inputs n dots. The image data Y and the outline flag are output in the order in which they are performed. 2
Reference numeral 104 denotes a third horizontal contour extraction 1 dot holding means, and the first horizontal contour extraction n dot holding means 2103
And outputs the image data Y and the outline flag held for one dot. Reference numeral 2105 denotes a second horizontal contour extraction n-dot holding unit which receives the image data Y output from the first horizontal contour extraction n-dot holding unit 2103 and the second contour flag, and outputs n dots for the n dots. , And outputs the image data Y and the outline flag in the order in which they are sequentially input. Reference numeral 2106 denotes a fourth horizontal contour extraction 1 dot holding means, and the second horizontal contour extraction n dot holding means 2
The image data Y and the outline flag output from 105 are input, and the image data and the outline flag held for one dot are output.

Reference numeral 2107 denotes a first horizontal contour extraction and subtraction means, and the first horizontal contour extraction one dot holding means 2
101 and second horizontal contour extraction 1 dot holding means 2102
The image data Y output from the above is input, and the difference between the two image data Y is obtained and output. Reference numeral 2108 denotes a second horizontal contour extraction / subtraction unit, which receives image data Y output from the first horizontal contour extraction 1 dot holding unit 2101 and the first horizontal contour extraction n dot holding unit 2103 as an input. , And outputs the difference between the two image data Y. Reference numeral 2109 denotes a third horizontal contour extraction / subtraction unit, and the third horizontal contour extraction one-dot holding unit 2104
And the image data Y output from the first horizontal contour extraction n dot holding means 2103, and outputs the difference between the two image data Y. Reference numeral 2110 denotes a fourth horizontal contour extraction and subtraction means, and the fourth horizontal contour extraction 1
The image data Y output from the dot holding unit 2106 and the first horizontal contour extraction n dot holding unit 2102 is input, and the difference between the two image data Y is obtained and output.

Reference numeral 2111 denotes a first horizontal contour judging means which receives the subtraction processing data output from the first horizontal contour extraction and subtraction means 2107 and a horizontal threshold value input from the outside, and Is output. 21
Numeral 12 denotes a second horizontal contour judging means. The subtraction processing data outputted from the second horizontal contour extracting and subtracting means 2108 and the first horizontal contour extracting one dot holding means 21
A second contour determination signal is output by using the contour flag output from S01 and a horizontal threshold value input from the outside as inputs. Reference numeral 2113 denotes a third horizontal contour determination means, which is subtraction processing data output from the third horizontal contour extraction / subtraction means 2109 and a contour flag output from the third horizontal contour extraction / one-dot holding means 2104. And an externally input horizontal threshold value, and outputs a third contour determination signal. Reference numeral 2114 denotes a fourth horizontal contour determination means, which is subtraction processing data output from the fourth horizontal contour extraction / subtraction means 2110 and a contour flag output from the fourth horizontal contour extraction / one-dot holding means 2106. And a horizontal threshold value input from the outside, and outputs a fourth horizontal contour determination signal. Reference numeral 2115 denotes a horizontal contour flag writing unit which receives the first, second, third, and fourth contour determination signals as input and outputs first and second contour flags.

Reference numeral 22 denotes a horizontal filter which receives image data Y output from the horizontal contour extraction and contour flag writing means 21 and a contour flag corresponding to the image data Y, and outputs a horizontal filter. Processing is performed to output image data Y. In the horizontal filter unit 22, 221 _1, a first horizontal filter 1 dot holding means, the outline flag corresponding to the image data and the image data Y output from the horizontal edge extraction and the outline flag writing means 21 And outputs image data held for one dot. Reference numeral 221 ₂ denotes a second horizontal filter 1 dot holding unit which receives as input the image data Y output from the first horizontal filter 1 dot holding unit 221 ₁ and a contour flag corresponding to the image data Y. And outputs image data held for one dot. The horizontal connection as described above (inputting the image data Y output from the preceding horizontal filter 1 dot holding unit 221 and the contour flag corresponding to this image data Y and outputting the image data held for one dot) P filter 1 dot holding means 221 (each variable is a natural number,
The following relationship exists ((1 ≦ p ≦ q ≦ n)). 221 _{p + 1} (not shown in FIG. 2)
Is a (p + 1) -th horizontal filter one-dot holding unit, which receives the image data Y output from the p-th horizontal filter one-dot holding unit 221 _p and outputs image data held for one dot. Reference numeral 221 _{p + 2} denotes a (p + 2) -th horizontal filter 1-dot holding unit, which receives the image data Y output from the ( _{p + 1)} -th horizontal filter 1-dot holding unit 221 _{p + 1} and holds 1-dot image data. Is output. Connection as described above (inputs image data Y output from the preceding horizontal filter one-dot holding unit 221 and outputs image data held for one dot)
There are qp horizontal filter 1 dot holding units 221 further.

222₁Is the horizontal filter selection means.
And the coefficient c input from outside₁, D ₁Is the p-th horizontal
1 dot holding means 221_pTo the contour flag output from
Therefore, it is selected and output. 222_TwoIs a horizontal filter selection
A coefficient c input from outside_Two, D_TwoThe above
P-th horizontal one-dot holding means 221_pWheel output from
Select and output by Guo flag. The connection like above
(Coefficients c and d input from the outside are converted to the p-th horizontal 1
Dot holding means 221_pBy the contour flag output from
Q) horizontal filter selection means
Exists. 223 ₁Is the first horizontal filter multiplication means
The first horizontal filter 1 dot holding means 22
1₁Image data Y output from the
Filter selection means 222₁Multiplication with the coefficient output from
And output. 223_TwoIs the power of the second horizontal filter
Calculating means for holding one dot of the second horizontal filter
Means 221_TwoImage data Y output from the
Horizontal filter selection means 222_TwoWith the coefficient output from
Perform multiplication processing and output. Connections as above (above
The output from the second horizontal filter 1 dot holding means 221
Image data Y and the first horizontal filter selecting means 2
22 is multiplied with the coefficient output from
Q) horizontal filter multiplying means 223). 2
Reference numeral 24 denotes a horizontal filter adding means, and the q water
Image data Y output from flat filter multiplying means 223
Are added, and the horizontal thinning is performed as the p-th image data.
Output to the interpolation means 3.

Here, the horizontal filter processing of the image data UV is performed by the same configuration as that of the conventional example shown in FIG. As shown in FIG. 3, the vertical filter / contour extraction means 7 comprises a vertical contour extraction / contour flag writing means 71 and a vertical filter means 72. Vertical contour extraction and contour flag writing means 71
Is the s-line image data Y output from the memory control means 5 and the r-th in the s-line (each variable is a natural number and has the following relationship: (1 ≦ r ≦ s ≦
m)), the contour flag corresponding to the line is input, and a contour extraction process in the vertical direction is performed.
And the contour flag corresponding to the image data Y of the (r + 1) th line, and writes the result in the memory 6 via the memory control means 5.

In the vertical contour extraction and contour flag writing means 71, 711 ₁ is the first vertical contour extraction 1
A dot holding unit that receives the image data Y of the first line among the s lines output from the memory control unit 5 and outputs the image data Y held for one dot.
711 ₂ (omitted in FIG. 3) is a second vertical contour extraction 1 dot holding unit, which receives as input the image data Y of the second line of the s lines output from the memory control unit 5 The image data Y for one dot is output. The above connection (the memory control means 5
The image data Y of the n-th line among the s lines output from the input is input, and the image data Y held for one dot is output).
Exists. Reference _numeral 711 _r denotes an r-th vertical contour extraction 1 dot holding unit which stores the image data Y of the r-th line in the s-line output from the memory control unit 5 and a contour flag corresponding to the image data Y. As input, the image data Y and the outline flag held for one dot are output. 7
11 _{r + 1} is an (r + 1) th vertical contour extraction 1 dot holding means, and the r-th vertical contour extraction 1 dot holding means 7
11 in s-line is output from the _r and the r th image data Y of the line between the input and the outline flag corresponding to the data, it outputs the image data Y and the outline flag holding one dot. 711 _{r + 2} (omitted in FIG. 3)
Is an (r + 2) th vertical contour extraction 1 dot holding unit, and r in the s line output from the memory control unit 5
The image data Y of the + 1st line is input, and the image data Y held for one dot is output. 711 _{r + 3} (FIG. 3
) Is the (r + 3) th vertical contour extraction 1
A dot holding means for outputting image data Y of an (r + 2) th line among s lines output from the memory control means 5;
, And outputs image data Y held for one dot. Vertical contour extraction 1 dot holding unit 711 of the connection as described above (inputting image data Y of the previous line in the s line output from the memory control unit 5 and outputting image data Y for one dot) Are present sr.

Reference numeral 712 denotes first vertical contour extraction and subtraction means, which is the image data Y output from the (r-1) th vertical contour extraction one dot holding means 711 _r-1 and the output from the memory control means 5. And the r-th image data Y in the s-line to be input, and outputs the difference between the two image data Y. Reference numeral 713 denotes a second vertical contour extraction and subtraction means, which is the (r-1) th vertical contour extraction 1 dot holding means 7
_11r-1 and the _r- th image data Y in the s-line output from the r-th vertical contour extraction 1-dot holding means 711 _r as inputs. Output the difference. Reference numeral 714 denotes third vertical contour extraction and subtraction means, which stores the image data Y output from the (r-1) th vertical contour extraction one dot holding means 711 _r-1 and the (r + 1) th vertical contour extraction one dot. The r-th image data Y in the s-line output from the means 711 _{r + 1} is input, and the difference between the two image data Y is obtained and output.

Reference numeral 715 denotes a first vertical contour judging means, which is a contour flag corresponding to the r-th image data in the s-line output from the memory control 5 and which is provided by the first vertical contour extraction and subtraction means 712. The output processing data and the externally input vertical threshold value are input, and a first contour determination signal is output. Reference numeral 716 denotes a second vertical contour determination means, which is a contour flag corresponding to the r-th image data in the s-line output from the r-th vertical contour extraction 1 dot holding means 711 _r and the second vertical contour determination means. The subtraction processing data output from the contour extraction / subtraction unit 713 and a vertical threshold value input from the outside are input, and a second contour determination signal is output. Reference numeral 717 denotes a third vertical contour determination means, which is a contour flag corresponding to the r-th image data in the s-line output from the (r + 1) th vertical contour extraction 1 dot holding means 711 _{r + 1} and the third vertical contour determination means. The subtraction processing data output from the vertical contour extraction / subtraction unit 714 and a vertical threshold value input from the outside are input, and a third contour determination signal is output. Reference numeral 718 denotes a vertical contour flag writing unit that receives the first, second, and third contour determination signals, outputs a contour flag, and writes the flag to the memory 6 via the memory control unit 5.

The vertical filter means 72 converts the image data Y of the s-line output from the vertical contour extraction and contour flag writing means 71 and the contour flag corresponding to the image data Y of the r-th line in the s-line. Input and
The image data Y is output by performing a filtering process in the vertical direction. In the vertical filter means 72, 721 ₁ is the first
The vertical filter selecting means corresponds to the externally input coefficients a ₁ and b ₁ corresponding to the image data Y of the r-th line in the s-line output from the vertical contour extraction and contour flag writing means 71. Select and output by the contour flag. Reference numeral 721 ₂ denotes a second vertical filter selecting means for converting coefficients a ₂ and b ₂ inputted from the outside into the r-th line of the s lines output from the vertical contour extracting and contour flag writing means 71. The data is selected and output by the contour flag corresponding to the image data Y. As described above, the coefficients a and b input from the outside are selected by the contour flag corresponding to the image data Y of the r-th line in the s-line output from the vertical contour extraction and contour flag writing means 71. S vertical filter selection means 721 exist.

Reference numeral 722 ₁ denotes a first vertical filter multiplying means, which outputs the image data Y of the first line among the s lines output from the vertical contour extraction and contour flag writing means 71 and the first vertical filter. Filter selection means 721
The result is multiplied by a coefficient output from 1 and output.
Reference numeral 722 ₂ denotes a second vertical filter multiplying means, which outputs the image data Y of the second line among the s lines output from the vertical contour extracting and contour flag writing means 71.
Performing a multiplication process with the coefficients output from the second vertical filter selection unit 721 ₂ and outputs. As described above (the multiplication of the image data Y of the second line in the s-line output from the vertical contour extraction and contour flag writing means 71 by the coefficient output from the second vertical filter selection means 721) S vertical filter multiplying means 722). 723 is
The vertical filter adding means adds all the image data Y output from the s vertical filter multiplying means 722 and outputs the result to the vertical thinning interpolation means 8 as r-th image data.

Here, the vertical filter processing of the image data UV is performed with the same configuration as the conventional example shown in FIG. In the above configuration, the conversion matrix operation means 1
In this example, image data composed of n dots inputted from the outside and m lines composed of the n dots are sequentially inputted, and if the data is RGB data, YUV data (Y: luminance, UV: color difference ) And output it. If it is YUV data, the data is bypassed and output as it is. The horizontal outline extraction and outline flag writing unit 21 sequentially receives the image data Y output from the conversion matrix calculation unit 1 and outputs the current outline output from the first horizontal outline extraction n dot holding unit 2103. Assuming that the evaluation image data Y is image data Y (p, r), the image data (p, r) and the image data Y (p−r) output from the first horizontal contour extraction 1 dot holding unit 2101 are stored.
1, r−1) is calculated by the second subtraction means 2108, and the calculation result and the image data (p−1, r−) are calculated.
The outline is determined by the second outline determination unit 2112 based on the outline flag corresponding to 1) and a horizontal threshold value input from the outside.

In the contour judgment processing by the second contour judgment means 2112, the absolute value of the subtraction result is larger than the horizontal threshold or the image data Y (p-
The contour flag corresponding to (1, r-1) is set, and when there is almost no difference between the two image data Y, the contour evaluation image data Y (p, r) is set as the contour, and the contour flag is set. The difference between the image data (p, r) and the image data Y (p−1, r) output from the third horizontal contour extraction 1 dot holding unit 2104 is calculated by the third subtraction unit 2109. The third contour determining means 2 calculates the third contour determining means 2 based on a result of the calculation, a contour flag corresponding to the image data (p-1, r), and a horizontal threshold value inputted from outside.
At 113, the contour is determined.

In the contour judgment processing by the third contour judgment means 2113, when the absolute value of the subtraction result is larger than the horizontal threshold value, or when the image data Y (p-
The contour flag corresponding to (1, r) is set, and when there is almost no difference between the two image data Y, the contour evaluation image data Y (p, r) is set as the contour, and the contour flag is set.
The difference between the image data (p, r) and the image data Y (p-1, r + 1) output from the fourth horizontal contour extraction 1 dot holding unit 2106 is calculated by the fourth subtraction unit 2110. The fourth contour determining means 2 calculates a fourth contour determining means 2 based on a result of the computation, a contour flag corresponding to the image data (p-1, r + 1), and a horizontal threshold value inputted from outside.
At 114, the contour is determined.

The outline judgment processing by the fourth outline judgment means 2114 is performed when the absolute value of the subtraction result is larger than the horizontal threshold value or when the image data Y (p-
The contour flag corresponding to (1, r + 1) is set, and when there is almost no difference between the two image data Y, the contour evaluation image data Y (p, r) is set as the contour, and the contour flag is set. The second, third, and fourth contour determining means 2112, 2
If any one of the contour flags output from 113 and 2114 is set, the contour flag writing means 2115
Indicates the second contour flag in the third one-dot holding means 21.
04 and the second n-dot holding means 2105.

The outline determination process for the image data Y (p-1, r-1) is performed by the image data Y (p-1, r-1) output from the first horizontal outline extraction 1 dot holding unit 2101.
-1) and the second horizontal contour extraction 1 dot holding means 21
02 in accordance with the difference between the image data Y (p, r-1) output from the image data Y.02 and the horizontal threshold value input from the outside.
The contour determination means 2111 determines the contour. In the contour judgment processing by the first contour judgment means 2111, when the absolute value of the subtraction result is larger than the horizontal threshold value, the contour evaluation image data Y (p-1, r-1) is set as the contour, and the contour flag is set. Stand up.

For example, a description will be given using the outline determination in the horizontal direction in FIG. 4. In the image data composed of n dots and m lines composed of the n dots, FIG. Let us consider a case where a contour such as
Assuming that the image data (8, 6) is the contour evaluation image data Y, the contour evaluation image data Y (8, 6) and the image data Y
The difference between (7, 5), (7, 6), and (7, 7) is calculated. If any of the absolute values of the differences is larger than an arbitrary threshold value input from the outside, the contour evaluation image data Y is determined as a contour, and if any of the differences is smaller than the given threshold, the image data Y (7,
5), (7, 6), (7, 7), an outline flag is set, and the difference between the image data Y with the set outline flag and the outline evaluation image data Y (8, 6) is If there is almost no, the contour evaluation image data Y is determined as a contour. By performing the contour determination using the contour flag as described above, it is possible to accurately perform the contour determination even if there is image data having little difference from the contour in the background, and the contour emphasis depends on the background image data. It can be realized without doing anything. The contour flag corresponding to each image data is written into the third one-dot holding unit 2104 by the contour judgment processing as described above. In the case where the filter in the horizontal direction is a q-tap filter and the p-th image data is filtered, the horizontal filter unit 22 includes the third horizontal filter 1 dot holding unit 2104.
As input outline flag corresponding to the image data and the image data output from the first input to the horizontal filter 1 dot holding means 221 _1, is input to the first horizontal filter 1 dot holding means 221 ₁ image data second horizontal filter 1 dot holding means 221 _2, ... horizontal filter 1 dot holding means 221 _p of the p, are sequentially entered in ... order of the q horizontal filter 1 dot holding means 221 _q of To go. The q horizontal filter selecting means 222
Then, the coefficient of the filter to be applied to the input contour and the coefficient of the filter to be applied to the area other than the contour are set to the coefficient of the filter to be applied to the contour if the p-th contour flag is set. Select and output the filter coefficient to be applied to the area. The image data output from the q horizontal filter 1 dot holding units 221 and the coefficients output from the q horizontal filter selecting units 222 are multiplied by the q horizontal filter multiplying units 223, respectively. The q multiplication results are added by the horizontal filter adding means 224. The result of the addition is output as the result of the horizontal filtering of the p-th image data.

For example, FIG. 6 shows a filter coefficient applied to a contour or a filter coefficient applied to a region other than the contour. The same processing is performed on the image data UV with the same configuration as the conventional horizontal filter 105 shown in FIG. The horizontal thinning-out interpolation means 3 thins out or interpolates in the horizontal direction according to a horizontal direction control signal output from the horizontal direction control means 4 in accordance with a horizontal enlargement / reduction ratio input from the outside, and enlarges, Perform reduction. For example, if the enlargement ratio is 5 and the reduction ratio is 4, enlargement is performed by interpolating once every 4 dots. If the enlargement ratio is 4 and the reduction ratio is 5, reduction is performed by thinning out one dot every 5 dots. . The memory control means 5 stores the image data Y output from the horizontal thinning-out interpolation means 3 in a memory 6
Write to. The vertical contour extraction and contour flag writing means 71 simultaneously inputs s lines of image data Y via the memory control means 7 and outputs the r-1
Of the current contour evaluation image data Y output from the vertical contour extraction 1 dot holding unit 711 _r-1 of the image data Y
(P, r-1), the image data Y (p, r-
1) and the difference between the image data Y (p−1, r) output from the memory control unit 5 is calculated by the first subtraction unit 712, and the calculation result is compared with the image data Y (p−1, r).
The first contour determining means 715 determines the contour based on the contour flag corresponding to r) and a vertical threshold value input from the outside.

The outline judgment processing by the first outline judgment means 715 is performed when the absolute value of the subtraction result is larger than the vertical threshold value or when the image data Y (p−
The contour flag corresponding to (1, r) is set, and when there is almost no difference between the two image data Y, the contour is set using the contour evaluation image data Y (p, r-1). Further, the image data Y (p, r-1) and the r-th
The second subtraction means 713 calculates the difference between the vertical contour extraction and the image data Y (p, r) output from the one-dot holding means 711r, and calculates the calculation result and the image data Y
Based on the contour flag corresponding to (p, r) and a vertical threshold value input from the outside, the second contour determining means 716 determines a contour.

The outline judgment processing by the second outline judgment means 716 is performed when the absolute value of the subtraction result is larger than the vertical threshold value or when the image data Y (p,
The contour flag corresponding to r) is set, and when there is almost no difference between the two image data Y, the contour is set using the contour evaluation image data Y (p, r-1) as the contour.
Further, the image data Y (p, r-1) and the (r + 1) th
The difference from the image data Y (p + 1, r) output from the vertical contour extraction 1 dot holding unit 711 _{r + 1}
The third contour determining means 717 determines the contour based on the result of the calculation, the contour flag corresponding to the image data Y (p + 1, r), and a vertical threshold value input from the outside. I do.

In the contour judgment processing by the third contour judgment means 717, the absolute value of the subtraction result is larger than the vertical threshold value or the image data Y (p +
The contour flag corresponding to (1, r) is set, and when there is almost no difference between the two image data Y, the contour is set using the contour evaluation image data Y (p, r-1). The first, second, and third contour determination means 715, 71
If any one of the contour flags output from 6 and 717 is set, the contour flag writing means 718 writes the contour flag to the memory 6 via the memory control means 5.

For example, a description will be given using the outline determination in the vertical direction in FIG. 5. In the image data composed of n dots and m lines composed of the n dots, FIG. Let us consider a case where a contour such as
Assuming that the image data (7, 6) is the contour evaluation image data Y, the contour evaluation image data Y (7, 6) and the image data Y
The difference between (6, 5), (7, 5), and (8, 5) is taken, and if any of the absolute values of the differences is larger than an arbitrary threshold value input from the outside, the contour evaluation image data Y is determined as a contour, and if any of the differences is smaller than the arbitrary threshold, the image data Y (6,
5), (7, 5), (8, 5), an outline flag is set, and the difference between the image data Y with the set outline flag and the outline evaluation image data Y (7, 6) is If there is almost no, the contour evaluation image data Y is determined as a contour. By performing the contour determination using the contour flag as described above, it is possible to accurately perform the contour determination even if there is image data having little difference from the contour in the background, and the contour emphasis depends on the background image data. It can be realized without doing anything.

The contour flags corresponding to the respective image data Y are written into the memory 6 via the memory control means 5 by the above-described contour judgment processing. The written outline flag is used for outline determination in the same manner as described above in outline determination of the next line. When the filter in the vertical direction is an s-tap filter and the r-th image data is filtered, the vertical filter 72 outputs s lines that are simultaneously output from the vertical contour extraction and contour flag writing means 71. The contour flags respectively corresponding to the image data Y of the r-th line are input, and the s vertical filter selecting means 721 calculates the coefficient of the filter to be applied to the inputted contour and the coefficient of the filter to be applied to the area other than the contour by r When the second contour flag is set, a filter coefficient to be applied to the contour is selected, and when the second flag is not set, a filter coefficient to be applied to a region other than the contour is selected and output. The image data of s lines simultaneously output from the vertical contour extraction and outline flag writing means 71 and the coefficients output from the s vertical filter selection means 721 are respectively converted by the s vertical filter multiplication means 722. The multiplication processing is performed, and the s multiplication processing results are added by the vertical filter addition means 723. The result of the addition process is r
The image data is output as the result of the vertical filtering of the image data.

For example, FIG. 6 shows a filter coefficient applied to an outline or a filter coefficient applied to a region other than an outline. The same processing is performed on the image data UV with the same configuration as the conventional vertical filter 103 shown in FIG. The vertical decimation interpolation means 8 performs decimation or interpolation in the vertical direction according to a vertical control signal output from the vertical direction control means 9 according to a vertical enlargement / reduction ratio input from the outside, thereby performing enlargement / reduction. . For example, if the enlargement ratio is 5 and the reduction ratio is 4
In the case of, the enlargement is performed by interpolating once every 4 dots, and when the enlargement ratio is 4 and the reduction ratio is 5, reduction is performed by thinning out one dot for every 5 dots. The image output means 10 receives the image data Y output from the vertical thinning-out interpolation means 8 and outputs it to an image display device.

By performing the above-described configuration and processing, the contour can be extracted with high accuracy only by the subtraction means and the contour determination means, and a plurality of low-frequency components and high-frequency components can be extracted in the same image data. By switching the filters, higher quality enlarged or reduced image data can be generated. In addition, by adopting a configuration in which a memory is provided between the horizontal scaling process and the vertical scaling process, the control in the horizontal direction or the vertical direction can be separated independently, and the timing in the horizontal and vertical directions can be adjusted. Since there is no need to consider it, it is possible to prevent the control unit from becoming complicated and to reduce the circuit scale.

[0043]

As described above, according to the present invention, data composed of n dots output from the conversion matrix calculation means and m lines composed of the n dots are sequentially read. As an input, the current contour evaluation image data is image data (p, r) (each variable is a natural number and has the following relationship: (1 ≦ p ≦ q ≦
n), (1 ≦ r ≦ s ≦ m)), the image data (p
-1, r-1), (p-1, r), (p-1, r + 1)
Then, a horizontal contour is extracted by a contour flag corresponding to each image data and a plurality of arbitrary horizontal thresholds input from the outside. If the contour is a contour, a contour flag is added to the current contour evaluation image data. A horizontal contour extraction and contour flag writing unit to be output, and data output from the horizontal contour extraction and contour flag writing unit and a corresponding contour flag are input, and the data and the contour flag are q dots. Q horizontal filter selecting means for sequentially reading into the horizontal filter 1 dot holding means, and selecting an arbitrary coefficient by the flag of the p-th horizontal filter 1 dot holding means, and outputting from the q horizontal filter selecting means. Are multiplied by the data output from the q horizontal filter 1 dot holding means, respectively. Number of horizontal filter multiplier means, said q-number of the are as input an operation result output from the horizontal filter multiplier unit, the p and addition process all the q number of data
Horizontal filter means comprising a horizontal filter adding means for outputting as a result of the operation of the data, and data constituted by n dots and m lines composed of the n dots via a memory control means. s lines are input, and the current contour evaluation image data is image data (p,
r), the image data (p-1, r-1), (p,
(r-1), (p + 1, r-1), a contour flag corresponding to each image data, and a plurality of arbitrary vertical threshold values input from the outside, and vertical contour extraction is performed.
If it is a contour, a contour flag is added to the current contour evaluation image data to output simultaneously with s lines, and the vertical contour extraction and contour flag writing means is output from the vertical contour extraction and contour flag writing means. s vertical filter selecting means for selecting an arbitrary coefficient by an r-th contour flag in s lines, arbitrary coefficients output from the s vertical filter selecting means, and the vertical contour extraction and contour S vertical filter multiplying means for multiplying the s lines of image data output from the flag writing means, and all the arithmetic results output from the s vertical filter multiplying means are added to perform r-th data By having a vertical direction filter means composed of an addition means for outputting as a calculation result, a loop is formed by only the subtraction means and the contour determination means. The in can be extracted with high accuracy, low frequency components in the same image data and the high frequency components more high-quality enlarged by performing switching of the filter of the plurality street, it generates reduced image data.

[Brief description of the drawings]

FIG. 1 is a block diagram of an image processing apparatus according to an embodiment of the present invention.

FIG. 2 is a block diagram showing horizontal contour extraction and horizontal filtering means of the image processing apparatus.

FIG. 3 is a block diagram showing a vertical contour extraction and vertical filter means of the image processing apparatus.

FIG. 4 is a diagram relating to the outline determination in the horizontal direction of the image processing apparatus.

FIG. 5 is a diagram relating to contour determination of the image processing apparatus.

FIG. 6 is a diagram showing an interpolation function without distortion in a high frequency range of the image processing apparatus.

FIG. 7 is a block diagram showing a conventional image processing apparatus.

FIG. 8 is a block diagram showing vertical filter means in the conventional image processing apparatus.

FIG. 9 is a block diagram showing horizontal filter means in the conventional image processing apparatus.

FIG. 10 is a diagram related to the principle of ringing.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Conversion matrix calculation means 2 Horizontal filter and contour extraction means 3 Horizontal thinning interpolation means 4 Horizontal direction control means 5 Memory control means 6 Memory 7 Vertical filter and contour extraction means 8 Vertical thinning interpolation means 9 Vertical direction control means 10 Image output means

 ──────────────────────────────────────────────────続 き Continued on the front page F-term (reference) CA22 CA33 CA34 CA85 DA53 MM10

Claims (11)

[Claims] 1. Image data composed of n dots and m lines composed of the n dots are sequentially input. If the data is RGB data, it is converted to YUV data and output. If it is data, the conversion matrix operation means for bypassing and outputting the data as it is, a memory control means for writing or reading the data output from the conversion matrix operation means to the memory, and the memory control means The data read and read and a plurality of arbitrary vertical threshold values input from the outside are input, and vertical contour extraction and vertical filter processing are performed, and a contour extraction flag is stored in the memory via the memory control means. Vertical contour extraction and vertical filter means to be written, and data output from the vertical contour extraction and vertical filter means. As input, vertical thinning and interpolation means for performing thinning and interpolation processing from a vertical enlargement and reduction ratio input from the outside, and data output from the vertical thinning and interpolation means and externally input data A plurality of arbitrary horizontal threshold values, and horizontal contour extraction and horizontal filtering means for performing horizontal contour extraction and horizontal filtering, and data output from the horizontal contour extraction and horizontal filter. And a horizontal thinning and interpolation means for performing thinning and interpolation processing based on horizontal enlargement and reduction rates input from the outside, and data output from the horizontal thinning and interpolation means as inputs, and a display device. An image processing apparatus comprising: 2. The image processing apparatus according to claim 1, wherein
In the vertical contour extraction processing, the current contour evaluation image data is image data (p, r) (each variable is a natural number and has the following relationship: (1 ≦ p), (1 ≦ r) )
, The image data (p-1, r-1), (p, r-
1), (p + 1, r-1), a contour flag corresponding to each image data, and a plurality of arbitrary vertical threshold values input from the outside are used to extract a contour in the vertical direction. An image processing apparatus characterized in that a contour flag is added to the contour evaluation image data. 3. The image processing apparatus according to claim 1, wherein
In the contour extraction processing in the horizontal direction, the current contour evaluation image data is image data (p, r) (each variable is a natural number and has the following relationship: (1 ≦ p ≦ q ≦ n) (1 ≤r
≦ s ≦ m)), the image data (p−1, r−
1), (p−1, r), (p−1, r + 1), a contour flag corresponding to each image data, and a plurality of arbitrary horizontal threshold values input from the outside, extract a horizontal contour. An image processing apparatus for performing an outline and adding an outline flag to the current outline evaluation image data. 4. The image processing apparatus according to claim 1, wherein
The vertical contour extraction and vertical filter means comprises:
Data composed of a number of dots and m lines composed of the n dots is input as s lines out of m via the memory control means, and s lines in the vertical direction from the data are input. The contour of the r-th line in is extracted, and the r-th line (each variable is a natural number and has the following relationship: (1 ≦ p ≦ q ≦ n) (1 ≦ r ≦ s ≦ m) )
A vertical contour extraction and contour flag writing means for simultaneously outputting a contour flag and s lines corresponding to the line, and an r-th one of s lines in the s lines output from the vertical contour extraction and contour flag writing means. A first vertical filter selecting means for selecting an arbitrary coefficient according to the contour flag, an arbitrary coefficient outputted from the first vertical filter selecting means, and s lines outputted from the vertical contour extracting and contour flag writing means. The first vertical filter multiplying means for multiplying the first data in the line of the first line and the r-th contour flag in the s lines output from the vertical contour extraction and contour flag writing means allows an arbitrary coefficient to be calculated. A second vertical filter selecting unit to be selected, an arbitrary coefficient output from the second vertical filter selecting unit, and the vertical contour A second vertical filter multiplying means for multiplying the second data in the s lines output from the output and contour flag writing means, and, like the second vertical filter multiplying means, the second vertical filter multiplying means. s-2 vertical filter selecting means for selecting an arbitrary coefficient according to the r-th contour flag, arbitrary coefficients outputted from the vertical filter selecting means, and outputted from the vertical contour extracting and contour flag writing means. s−2 vertical filter multiplying means for multiplying the t-th (t is a natural number from 3 to s) data in the s lines, and the operation result output from the s vertical filter multiplying means An image processing apparatus, comprising: an input unit that performs an addition process on all of the s pieces of data and outputs the result as an operation result of the r-th data. 5. The image processing apparatus according to claim 4, wherein
The vertical contour extraction and contour flag writing means includes:
A first vertical contour extraction 1-dot holding unit that receives the first line of the s lines through the memory control unit and holds the first line of the s lines by 1 dot; 2 out of s lines via memory control means
A second vertical contour extraction 1 dot holding unit that receives the second line as input and holds the second line of the s lines for one dot, and a second vertical contour extraction 1 dot holding unit as in the second vertical contour extraction 1 dot holding unit. , Each of which receives the u-th line (u is a natural number from 3 to r-1) of the s lines through the memory control means and sets the u-th line of the s lines to one dot Holding the r-3 vertical contour extraction 1-dot holding means to hold the data, and the data of the r-th line in the s lines and the contour flag corresponding to the data via the memory control means, Vertical contour extraction 1 holding the data and the contour flag
Dot holding means, r + 1-th vertical contour extraction one-dot holding means for receiving data output from the r-th vertical contour extraction one-dot holding means and a contour flag and holding one dot, and the memory control means And the (r + 2) th vertical contour extraction 1 dot holding means for inputting the (r + 1) th line in the s lines and holding the (r + 1) th line in the s lines for one dot, and the memory control means The (r + 2) th line of the s lines is input, and the (r + 3) th vertical contour extraction 1 dot holding means for holding one dot of the (r + 2) th line of the s lines, and the (r + 3) th vertical contour extraction 1 In the same manner as the dot holding unit, each of the v-1 (v is a natural number from r + 4 to s + 1) th line among s lines is input via the memory control unit. And, v in the s this line
S-r-2 vertical contour extraction 1 dot holding means for holding the -1st line for one dot, data output from the (r-1) th vertical contour extraction 1 dot holding means, and the memory control means Vertical contour extraction and subtraction means for performing subtraction processing on the data of the r-th line among the s lines input through the data processing unit, and data output from the (r-1) th vertical contour extraction one-dot holding means A second vertical contour extracting and subtracting means for performing a subtraction process on the data output from the r-th vertical contour extracting one-dot holding means, and data output from the (r-1) th vertical contour extracting one-dot holding means. R + 1
A third vertical contour extraction and subtraction means for subtracting data output from the vertical contour extraction dot holding means, and a contour flag of an r-th line among s lines inputted via the memory control means. A first vertical contour determining means for receiving an operation result outputted from the first vertical contour extracting and subtracting means and a plurality of arbitrary threshold values inputted from the outside to perform contour extraction determination; A contour extraction judging unit that receives as input the contour flag output from the contour extraction one-dot holding unit, the calculation result output from the second vertical contour extraction and subtraction unit, and a plurality of arbitrary thresholds input from the outside. (2) a vertical contour determining means, a contour flag output from the (r + 1) th vertical contour extracting one dot holding means, a calculation result output from the third vertical contour extracting and subtracting means, and a plurality of externally input An arbitrary threshold value is input, a third vertical contour determining means for performing contour extraction determination, and respective contour determination results output from the first, second, and third vertical contour determining means are input, and A vertical contour flag writing unit for generating a contour flag of the line and writing the contour flag to the memory via the memory control unit. 6. The image processing apparatus according to claim 1, wherein
The horizontal contour extraction and horizontal filter means comprises:
A horizontal contour for sequentially inputting data composed of a plurality of dots and m lines composed of the n dots, extracting a horizontal contour from the data, and outputting a contour flag corresponding to the data; A first horizontal line which receives the data output from the horizontal outline extraction and outline flag writing unit and the corresponding outline flag, and holds the data and the outline flag for one dot; A filter one-dot holding means, and a second means for holding one dot of data and an outline flag output from the first horizontal filter one-dot holding means.
Similarly to the horizontal filter 1 dot holding unit and the second horizontal filter 1 dot holding unit, q-2 holds the data output from the preceding horizontal filter 1 dot holding unit and the outline flag for one dot. (Each variable is a natural number and has the following relationship: (1 ≦ p ≦
q ≦ n)) horizontal filter 1 dot holding means, first horizontal filter selecting means for selecting an arbitrary coefficient by an outline flag output from the p-th horizontal filter 1 dot holding means, and the first horizontal First horizontal filter multiplying means for multiplying the coefficient output from the filter selecting means by the data output from the first horizontal filter one dot holding means, and the output from the p-th horizontal filter one dot holding means A second horizontal filter selecting means for selecting a coefficient based on an outline flag; an arbitrary coefficient output from the second horizontal filter selecting means;
A second multiplication by the data output from the dot holding means
Similarly to the horizontal filter multiplying means and the wth (w is a natural number from 3 to q) horizontal filter selecting means, respectively, Q-2 horizontal filter selecting means and horizontal filter multiplying means for multiplying the data output from the horizontal filter 1 dot holding means, and q
Horizontal filter multiplying means for inputting operation results output from the plurality of horizontal filter multiplying means, adding all the q data, and outputting the result as an operation result of p-th data. Image processing device. 7. The image processing apparatus according to claim 6, wherein
The horizontal contour extraction and contour flag writing means includes:
a first horizontal contour for sequentially inputting data constituted by n dots and m lines composed of the n dots, and holding the data and a first contour flag corresponding thereto for one dot; Extraction one-dot holding means;
The second horizontal contour extraction 1 which receives data output from the horizontal contour extraction 1 dot holding means and holds one dot.
A dot holding unit, data constituted by the n dots and m lines composed of the n dots, and the first contour flag are input, and n dots are held and sequentially input. First horizontal contour extraction n-dot holding means for outputting data and a contour flag in the specified order;
A third horizontal contour extraction 1-dot holding means for receiving the data output from the horizontal contour extraction n-dot holding means as input, and holding the data and a corresponding second contour flag for one dot; The second horizontal contour extraction n dot which receives the data outputted from the horizontal contour extraction n dot holding means and the second contour flag, holds n dots, and outputs the data in the order of sequential input. Holding means for inputting the data output from the second horizontal contour extraction n-dot holding means and the contour flag, and holding the data and the corresponding contour flag for one dot;
Subtraction processing using the data output from the first horizontal contour extraction one-dot holding means and the data output from the second horizontal contour extraction one-dot holding means. A first horizontal contour extracting and subtracting means for performing the following, inputting data output from the first horizontal contour extracting n dot holding means and data output from the first horizontal contour extracting one dot holding means, The second horizontal contour extraction and subtraction means for performing the subtraction processing, the data output from the first horizontal contour extraction n dot holding means, and the data output from the third horizontal contour extraction one dot holding means are input. , A third horizontal contour extraction and subtraction means for performing subtraction processing, data output from the first horizontal contour extraction n dot holding means, and data output from the fourth horizontal contour extraction one dot holding means. Horizontal contour extraction and subtraction means for performing subtraction processing by using the input data as input, and a calculation result output from the first horizontal contour extraction and subtraction means and a plurality of arbitrary threshold values input from the outside. A first horizontal contour determining means for performing a contour determination as an input; a contour flag output from the first horizontal contour extracting one dot holding means;
A second horizontal contour determining means for receiving an arithmetic result output from the horizontal contour extracting and subtracting means and a plurality of arbitrary threshold values inputted from the outside to determine a contour; A third horizontal line which receives an outline flag output from the dot holding unit, a calculation result output from the third horizontal outline extraction and subtraction unit, and a plurality of arbitrary threshold values input from the outside, and performs outline determination. A contour judging means, a contour flag outputted from the fourth horizontal contour extracting 1 dot holding means, a calculation result outputted from the fourth horizontal contour extracting and subtracting means, and a plurality of arbitrary thresholds inputted from outside And a fourth horizontal contour determining means for performing contour determination, and respective contour determination results output from the first, second, third, and fourth horizontal contour determining means as inputs.
An image processing apparatus comprising: a horizontal contour flag writing unit configured to generate a contour flag and a second contour flag. 8. The image processing apparatus according to claim 4, wherein
An image processing apparatus characterized in that the vertical contour extraction and the vertical contour extraction and the contour flag writing processing of the vertical filter means are performed only with the luminance signal (Y). 9. The image processing apparatus according to claim 6, wherein
An image processing apparatus characterized in that the horizontal contour extraction and the horizontal contour extraction by the horizontal filter means and the contour flag writing processing are performed only with the luminance signal (Y). 10. The image processing apparatus according to claim 1, wherein the contour extraction is performed by only one of the vertical contour extraction and vertical filter means and the horizontal contour extraction and horizontal filter means. Image processing device. 11. N-dots and image data composed of m lines composed of the n-dots are sequentially input, and if RGB data, they are converted to YUV data and output. If so, the transformation matrix computing means for bypassing and outputting the data, and the data output from the transformation matrix computing means and a plurality of arbitrary horizontal threshold values input from the outside are input to extract the contour in the horizontal direction. And horizontal direction extraction and horizontal filtering means for performing horizontal filtering, and inputting data output from the horizontal direction extraction and horizontal filter,
Horizontal thinning and interpolation means for performing thinning and interpolation processing based on horizontal enlargement and reduction rates input from the outside, and writing or reading data output from the horizontal thinning and interpolation means to / from a memory Memory control means for performing control, and data read through the memory control means and a plurality of arbitrary vertical threshold values input from the outside, and perform vertical contour extraction and vertical filter processing. A vertical contour extraction and vertical filter means for writing a contour extraction flag to a memory via the memory control means, and data outputted from the vertical contour extraction and vertical filter means as inputs, and a vertical direction inputted from the outside. Vertical thinning and interpolation means for performing thinning and interpolation processing based on the enlargement and reduction ratio of the image, and output from the vertical thinning and interpolation means. The image processing apparatus is the data as input is, characterized by comprising an image output means for outputting to the display device.