JP2003069859A - Moving image processing adapting to motion - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide technique for improving the image quality of a moving image. SOLUTION: In image processing of a moving image composed of a plurality of images arranged time sequentially, the magnitude of a motion vector is detected in each block on the basis of two pieces of image data, and sharpness adjustment is performed with a degree of enhancement corresponding to the detected magnitude of the motion vector.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to moving image processing adapted to motion.

[0002]

2. Description of the Related Art Various image display devices for displaying moving images have become widespread. In the image display device, as a moving image scanning method, there are an interlaced scanning (interlaced scanning) method and a progressive scanning (non-interlaced scanning, sequential scanning) method. The interlaced scanning is a scanning method in which one frame is displayed by alternately displaying an odd field displaying odd scan lines and an even field displaying even scan lines. In television broadcasting, image signals of interlaced scanning are transmitted,
A normal television receiver displays an image by an interlaced scanning method. With progressive scanning, every scan line is 1
It is a scanning method that displays every time. Progressive scanning is
It is applied to CRT displays, liquid crystal displays, plasma displays, etc.

By the way, in the image display apparatus, there is a demand for higher image quality and higher resolution from the viewpoint of preventing flickering as the display screen becomes larger. As described above, in the progressive scanning method, all the scanning lines are displayed at one time, so that it is superior to the interlaced scanning method in terms of vertical resolution under the same number of scanning lines. Therefore, an I / P (interlace / progressive) conversion technique for converting interlaced scan image data into progressive scan image data may be used. In the I / P conversion, the blurring of the image may be caused by the interpolating process between the scanning lines. Such deterioration of image quality was particularly remarkable in moving images.

To solve this problem, sharpening processing may be performed on the entire image data depending on whether or not there is a motion in the image. That is, a sharpening process is not performed on a still image with a relatively small image quality deterioration, and a sharpening process is performed on a moving image with a relatively large image quality deterioration.

[0005]

However, in general, there are many still image areas in which there is no motion even in a moving image. Therefore, if the entire image data is sharpened uniformly, There was a case where the degree of emphasis was excessive, which was rather unfavorable. Further, there are cases where sharpening processing for various moving images is effective in improving image quality, and cases where it is not.

Although the sharpening process has been described as an example here,
Conventionally, regarding the image processing of a moving image, the difference in preferable image quality adjustment between a moving image area and a still image area within the same screen has not been considered. In addition, the above-mentioned problem is
Not limited to the case where the / P conversion is performed, it can occur commonly in all moving images.

The present invention has been made to solve the above problems, and an object of the present invention is to provide a technique for improving the quality of moving images.

[0008]

[Means for Solving the Problem and Its Action / Effect] In order to solve at least a part of the above problem, the present invention adopts the following configuration. A first image processing apparatus of the present invention is an image processing apparatus that performs predetermined image processing on moving image data composed of a plurality of screens arranged in time series. An input unit for inputting image data, a motion vector detecting unit for detecting the magnitude of a motion vector based on the both image data, and an image processing for enhancing display clarity with an emphasis degree according to the magnitude of the motion vector. The gist is to provide an image processing unit for performing.

In the present invention, first, image data is input for two screens that are different in time series. The screen includes both a frame image and a field image. The frame image is an image displaying all scanning lines. The field image is an image displaying an odd scan line or an even scan line. The input image data is not limited to two. You may make it input three or more image data. Then, the magnitude of the motion vector is detected based on the two input image data. Various well-known methods such as a gradient method and a block matching method can be applied to the detection of the motion vector. Next, image processing is performed to emphasize the display intelligibility with an appropriate emphasis degree according to the magnitude of the detected motion vector. As a result, the image quality of the moving image can be improved.

In the above image processing apparatus, the motion vector detecting section divides each screen into a predetermined number of areas, and for each area, based on the both image data,
The magnitude of the motion vector may be detected, and the image processing unit may perform the image processing on each of the regions with an emphasis degree according to the magnitude of the motion vector.

By doing so, it is possible to flexibly change the emphasis degree according to the magnitude of the motion vector and perform image processing for emphasizing the display intelligibility for each area of the image. Therefore, for example, it is possible to perform the image processing in which the degree of emphasis is changed between a moving image area having a large motion and a still image area having a small motion, and a sense of discomfort resulting from an excessive display clarity of the still image area is generated. Can be relaxed.

The first image processing apparatus of the present invention further comprises a compensation coefficient storage unit for storing the relationship between the magnitude of the motion vector and the compensation coefficient representing the degree of enhancement, and the image processing unit is provided with the compensation unit. The image processing can be performed using a compensation coefficient which is given by the coefficient storage unit and corresponds to the magnitude of the motion vector.

Alternatively, a spatial filter storage unit for storing the relationship between the magnitude of the motion vector and the spatial filter used for the image processing is provided, and the image processing unit is provided by the spatial filter storage unit, The image processing may be performed by using a spatial filter corresponding to the size of.

By doing so, the compensation coefficient prepared in advance according to the magnitude of the motion vector or the spatial filter can be read out from the storage section as needed, and the image processing can be executed at high speed. Here, the spatial filter is a matrix that defines a range of pixels used for image processing, a weighting coefficient applied to each pixel, and the like. The compensation coefficient may be generated by calculation according to a predetermined function based on the magnitude of the motion vector.

The first image processing apparatus of the present invention is preferably applied when the image data has been subjected to interpolation processing for increasing the resolution.

Regardless of the vertical resolution or the horizontal resolution, the image data subjected to the interpolation processing for increasing the resolution has a large degree of image quality deterioration. Therefore, in such a case, the application of the present invention has a great effect of improving the image quality.

In the first image processing apparatus of the present invention, various image processing such as contrast adjustment and brightness adjustment can be applied as image processing for emphasizing display clarity, but the image processing is a sharpening processing. It can be.

By doing so, the contour is sharpened,
The image quality can be improved. When the sharpening process is performed, the contrast and the brightness of the image may be affected. Therefore, in addition to the sharpening process, contrast adjustment and brightness adjustment may be performed according to the degree of enhancement. Regardless of sharpness adjustment, image processing that affects display clarity such as contrast adjustment and brightness adjustment may be performed.

A second image processing apparatus of the present invention is an image processing apparatus for performing a predetermined image processing on moving image data composed of a plurality of screens arranged in time series, and the two image processing apparatuses have two screens. Regarding an input unit for inputting each image data, a moving image region extracting unit for extracting a moving image region whose display content changes temporally with respect to any one of the screens based on the both image data, and the moving image region, The gist is to provide an image processing unit that performs image processing that emphasizes display clarity.

In a moving image, there are a still image area with no motion and a moving image area with motion. When displaying a moving image, the outline is blurred and the display tends to be unclear in the moving image area compared to the still image area. In the present invention, first, two screens (frames or fields) that differ in time series are displayed.
Image data is input, and the moving image area is extracted based on both. The extraction of the moving image area can be performed, for example, based on the difference data between the two image data. The image data to be input is not limited to two. The moving image area may be extracted based on three or more pieces of image data.
Next, image processing for emphasizing display clarity is performed on the extracted moving image area. By doing so, the display clarity of the moving image area other than the still image area is emphasized, so that the ambiguity of the moving image area can be suppressed and the image quality of the moving image can be improved.

In addition to the image processing for the moving image area, the image processing for emphasizing the display clarity may be performed for the still image area. However, since the still image area generally has a higher display clarity than the moving image area, it is preferable to perform image processing that emphasizes the display clarity with a weaker emphasis degree than the moving image area.

The second image processing apparatus of the present invention further comprises a motion vector detecting section for detecting the size of the motion vector of the moving image area, and the image processing section responds to the size of the motion vector. It is preferable that the image processing is performed on the moving image area with an emphasis degree.

The degree of image quality deterioration in the moving image area depends on the speed of motion, that is, the magnitude of the motion vector. In other words, the larger the motion vector, the greater the degree of image quality deterioration. Therefore, the present invention enables more appropriate and flexible image processing.

The second image processing apparatus of the present invention further comprises a motion vector detecting section for detecting the size of the motion vector of the moving image area, and the image processing section determines the size of the motion vector. On the basis of this, a determination unit that determines whether or not to perform the image processing may be provided.

Even if the motion vector is detected by the motion vector detecting section, it may be preferable not to perform the image processing. For example, the detected motion vector is very small, or the motion vector is very large due to a scene change. In such a case, image quality may be deteriorated rather by performing image processing that emphasizes display clarity. Also,
When the effect of image processing is not expected to be large, such as when the magnitude of the motion vector is relatively small, it may be preferable to omit the image processing from the viewpoint of reducing the processing load. In the present invention, it is possible to determine whether or not the image processing should be performed based on the magnitude of the motion vector, so that it is possible to prevent unnecessary image processing.

In the above image processing apparatus, it is preferable that the determination is made based on a comparison between a lower limit value preset as a range to be subjected to the image processing and the magnitude of the motion vector. .

By doing so, if the detected motion vector size is smaller than the lower limit value of the motion vector size preset as the range to be subjected to the image processing, the image processing should not be performed. It is possible to determine that the image is not processed and perform unnecessary image processing. In this case, the lower limit value can be appropriately set in consideration of the effect of the image processing and the processing load.

Further, it is preferable that the determination is made based on a comparison between an upper limit value preset as a range to be subjected to the image processing and the magnitude of the motion vector.

By doing so, if the detected motion vector magnitude is larger than the upper limit of the magnitude of the motion vector preset as the range to be subjected to the image processing, the image processing should not be performed. It is possible to determine that the image is not processed and perform unnecessary image processing. The upper limit value in this case can be set, for example, in a range that is smaller than the magnitude of the motion vector obtained in the case of scene change or the like and larger than the magnitude of the motion vector obtained in other scenes.

The present invention can be configured as an invention of an image processing method in addition to the above-described configuration of the image processing apparatus. Also, a computer program that realizes these,
Further, it is possible to realize it in various forms such as a recording medium recording the program, a data signal including the program and embodied in a carrier wave. It is possible to apply the various additional elements shown above in each aspect.

When the present invention is configured as a computer program or a recording medium recording the program, it may be configured as an entire program for driving the image processing apparatus, or only a portion that fulfills the functions of the present invention. It may be configured. The recording medium may be a flexible disk, a CD-ROM, a magneto-optical disk, an IC card, a ROM cartridge, a punched card, a printed matter on which codes such as a bar code are printed, or an internal storage device of a computer (memory such as RAM or ROM). )
Also, various computer-readable media such as an external storage device can be used.

[0032]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in the following order based on Examples. A. Overall Configuration of Projector: B. Internal configuration of video processor: C. Contour compensation: D. Modification:

A. Overall Configuration of Projector: FIG. 1 is an explanatory diagram showing the overall configuration of a projector 10 as an embodiment of the present invention. The projector 10 includes an analog image input terminal 12, a digital image input terminal 14, and a 3
One A-D converter 20, a video decoder (synchronization separation circuit) 22, a frame memory 24, a video processor 26, a liquid crystal panel drive unit 30, a liquid crystal panel 32,
And a remote controller control unit 34. The frame memory 24 and the video processor 26 are
They are integrated as one image processing integrated circuit 60. The image processing integrated circuit 60 corresponds to the image processing apparatus of the present invention.

The projector 10 also includes an illuminating device 50 for illuminating the liquid crystal panel 32 and the liquid crystal panel 3.
And a projection optical system 52 that projects the transmitted light that has passed through 2 onto the screen SC. The liquid crystal panel 32 is a transmissive liquid crystal panel, and is used as a light valve (light modulator) that modulates the illumination light emitted from the illumination device 50. The liquid crystal panel 32 functions as an image forming unit during projection.

Although not shown, the projector 10 has three liquid crystal panels 32 for three colors of RGB.
have. Further, each circuit described later has a function of processing image signals of three colors. The illumination device 50 has a color light splitting optical system that splits white light into light of three colors.
In addition, the projection optical system 52 has a combining optical system that combines the image lights of the three colors to generate image light representing a color image.

As the input image signal, one of the analog image signal AV input to the analog image input terminal 12 and the digital image signal DV input to the digital image input terminal 14 can be selectively used. Is. The analog image signal AV is converted by the A / D converter 20 into a digital image signal containing image signal components of three colors.

The image signal input to the video processor 26 is temporarily stored in the frame memory 24, and then,
It is read from the frame memory 24 and supplied to the liquid crystal panel drive unit 30. The video processor 26 performs various image processes on the input image signal during the writing and reading. The liquid crystal panel drive unit 30 generates a drive signal for driving the liquid crystal panel 32 according to the applied image signal. The liquid crystal panel 32 modulates the illumination light according to this drive signal.

The user can use the remote controller 40 to input setting values for various adjustments to be performed on the entire image, such as sharpness adjustment, contrast adjustment, and brightness adjustment. Although not shown, the main body of the projector 10 is also provided with keys and buttons for inputting various set values.

B. Internal structure of video processor: Fig. 2
FIG. 3 is a block diagram showing an internal configuration of the video processor 26. The video processor 26 includes a frame memory controller 62, a trapezoidal distortion correction unit 64, an enlargement / reduction control unit 66, an image quality adjustment unit 68, and a contour compensation unit 70. The contour compensation section 70 corresponds to the image processing section of the present invention.

The frame memory controller 62 is shown in FIG.
The digital image signal DV0 supplied from the A / D converter 20 or the video decoder 22 shown in (1) is written in the frame memory 24, and the digital image signal is read from the frame memory 24. The frame memory controller 62 also performs so-called I / P conversion, in which image data for interlaced scanning is interpolated by scanning lines and converted into image data for progressive scanning.

The trapezoidal distortion correction unit 64 corrects the trapezoidal distortion that occurs when the projector 10 tilts and projects on the screen SC by image processing. Expansion /
The reduction control unit 66 executes enlargement or reduction of the image according to the setting of the user, and also performs interpolation processing as needed at the time of enlargement or reduction. The image quality adjustment unit 68 adjusts the contrast, brightness, sharpness, etc. of the entire image according to the user's settings. The processes performed by the trapezoidal distortion correction unit 64, the enlargement / reduction control unit 66, and the image quality adjustment unit 68 are well known, and detailed description thereof will be omitted.

The contour compensating unit 70 detects the movement of the moving object in the moving image, and adjusts the sharpness with the strength according to the magnitude of the movement. Details of the contour compensator 70 will be described below.

C. Contour compensation: FIG. 3 is a block diagram showing the configuration of the contour compensation unit 70. The contour compensation unit 70 includes a motion vector detection unit 72, a compensation coefficient generation unit 73, a contour compensation data generation circuit 74, a delay circuit 75, and a multiplier 76.
And an adder 77. Compensation coefficient generator 73
Includes an image determination unit 73a and a compensation coefficient storage unit 73b. The delay amount of the delay circuit 75 is one pixel in the horizontal direction and one line in the vertical direction.

The motion vector detecting section 72 divides two image data that are continuous in time series into pixel blocks of N × N pixel squares, and calculates the size of the motion vector in block units, which will be described later. The vector total amount D is calculated.

FIG. 4 is an explanatory diagram showing how image data is divided into blocks. In this embodiment, the pixel blocks are divided into square pixel blocks of 8 × 8 pixels. In the figure, the large cells and the small cells indicate blocks and pixels, respectively. The upper left block in the figure is (bx, by) =
It is a block of (1, 1). Further, in each block, the upper left pixel is the pixel of (x _i , y _j ) = (1,1).

The motion vector detecting section 72 first calculates the horizontal and vertical components of the motion vector in each block.
For example, it is calculated by the following formula.

[0047]

[Equation 1] Here, S _n is a pixel value in the target block of the n-th frame image data.

Dx and dy that minimize the value M in the above equation
Are the horizontal and vertical components of the motion vector, respectively. Horizontal component of motion vector: BVx (bx, by) = dx Vertical component of motion vector: BVy (bx, by) = dy

The block to be divided is not limited to a square of 8 × 8 pixels, but may be a rectangular block. Further, the motion vector may be calculated by another method.

Then, the motion vector detecting section 72 calculates the total vector amount D, which is the sum of the sizes of the motion vectors in all the blocks, by the following calculation. This vector total amount D represents the magnitude of the motion vector of the entire image.

[0051]

[Equation 2] In the following, a value obtained by rounding off the first decimal place is used as the vector total amount D.

The compensation coefficient generator 73 generates a compensation coefficient G representing the degree of emphasis of sharpness adjustment for each image data, based on the total vector amount D.

FIG. 5 is an explanatory diagram showing the relationship between the total vector amount D, the compensation coefficient G and the image determination. The value of the vector total amount D shown in the figure is conceptual and differs from the actual value. As can be seen from FIG. 5, the image determination unit 73a determines that the image data is a still image when the total vector amount D is 2 or less. Further, when the total vector amount D is 3 to 8, it is determined to be a moving image. If 9 or more, it is determined that the scene has changed. It is possible to determine whether to perform the sharpness adjustment according to the determination result. In this embodiment, the determination result is that the weak sharpness adjustment is performed even when the still image or the scene is changed.However, the sharpness adjustment is performed only for the moving image, and the sharpness adjustment is performed when the still image or the scene is changed. It may not be performed.

The compensation coefficient storage section 73b stores the relationship between the total vector amount D and the compensation coefficient G shown in FIG. The compensation coefficient generation unit 73 refers to the compensation coefficient storage unit 73b and generates the compensation coefficient G corresponding to the total vector amount D.

The compensation coefficient G may be calculated. For example, the compensation coefficient G can be obtained by calculation under the following conditions.

The lower limit value (still image determination criterion) Lmt and the upper limit value (scene change determination criterion) SLmt of the vector total amount D to be judged as a moving image, a constant K, and a value other than a moving image, that is, a still image or a scene change. The compensation coefficient Still is set. These values can be set arbitrarily. In this embodiment, Lmt = 3, SLmt = 8, K = 0.02, S
Till = 0.005. In this case, (1) When the total vector amount D is Lmt ≦ D ≦ SLmt, the compensation coefficient G = K · D + Still, and (2) The total vector amount D is D <Lmt (still image) or D> SLmt (scene change). ), The compensation coefficient G is calculated by setting the compensation coefficient G = Still. By doing so, the compensation coefficient G can be generated in the same manner as shown in FIG. In this embodiment, the case where the compensation coefficient G is linearly changed according to the total vector amount D has been illustrated, but a non-linear function may be used. The relationship between the two can be appropriately set so as to obtain an appropriate effect.

FIG. 6 is a block diagram showing the configuration of the contour compensation data generation circuit 74. Contour compensation data generation circuit 7
Reference numeral 4 is a two-dimensional filter in which a horizontal filter 80 and a vertical filter 90 are connected in series. Horizontal filter 80
Are two horizontal delay circuits 81 and 82 and three multipliers 8
It is an FIR filter (finite impulse response filter) composed of 3, 84 and 85 and an adder 86. The delay amount Dh of the horizontal delay circuits 81 and 82 is one pixel. The values multiplied by the multipliers 83, 84, 85, that is, the filter coefficients are -1/4, 1/2, and -1/4, respectively. The vertical filter 90 also has the same configuration as the horizontal filter 80. That is, the vertical filter 90 includes two horizontal delay circuits 91, 92 and three multipliers 93, 94, 9
5 and an adder 96. The delay amount Dv of the horizontal delay circuits 91 and 92 is one line. The values multiplied by the multipliers 93, 94, and 95, that is, the filter coefficients are -1/4 and 1 /, respectively.
It is 2, -1 / 4. These filter coefficients are values used for general sharpness adjustment.

FIG. 7 is an explanatory view showing the image processing in the contour compensating section 70. Each square in the figure represents a pixel. Image data is shown in the square. The contour compensation unit 70 includes an image quality adjustment unit 68 (see FIG. 2).
The image data generated in step 1 is sequentially input from the upper left of the image. Now, it is assumed that the image data is input up to the pixel A shown in the lower right of FIG. The target pixel of the image processing (sharpness adjustment) at this time is the pixel B shown in the center of FIG. 7. This is because the delay amount of the delay circuit 75 is one pixel in the horizontal direction (x direction) and one line in the vertical direction (y direction). The contour compensation data generation circuit 74 generates contour compensation data using the image data of 9 pixels shown in the figure. Then, as can be seen from FIG. 3, the contour compensation unit 70
Multiplies the contour compensation data by the compensation coefficient G generated by the compensation coefficient generation unit 73, and adds the multiplication result and the image data N (i-1, j-1) of the pixel B that is the target pixel. To do. In this way, the image data after the contour compensation processing of the pixel B is generated. These processes are sequentially executed for all pixels.

In this embodiment, the contour compensation processing is performed by hardware, but the above processing may be performed by the video processor 26 by software. FIG. 8 is a flowchart showing the flow of processing performed by the contour compensating unit 70. First, the original image data is input (step S100). In the present embodiment, the original image data is two pieces of data generated by the image quality adjustment unit 68 and continuous in time series. Next, as described above, each original image data is divided into blocks of 8 × 8 pixels, the motion vector of each block is detected, and the total amount of vector D described above is calculated.
Is calculated (step S110). Then, the compensation coefficient G is generated based on the total vector amount D (step S120). Then, contour compensation processing (sharpness adjustment) is executed (step S130). Then, it is determined whether or not the processing has been completed for all pixels (step S
140). If not completed, the above step S10
The processing from 0 to step S130 is repeated. When all the pixels are finished, this processing is exited. The image data thus processed is supplied to the liquid crystal panel drive unit 30.

In general, in a moving image, the image quality is deteriorated in that the contour becomes unclear in a moving area in relation to the display switching cycle of the screen. This image quality deterioration is more remarkable as the motion vector is larger. According to the projector 10 of the present embodiment, it is possible to perform sharpness adjustment on moving image data by changing the degree of emphasis according to the magnitude of motion (total vector amount D). Therefore, sharpness adjustment becomes excessive for images with small motion vectors,
It is possible to avoid a shortage in an image having a large motion vector, and it is possible to improve the image quality of various moving images without a feeling of strangeness.

Since the projector of the present embodiment described above includes the processing by the computer, it is possible to adopt an embodiment as a recording medium recording a program for realizing this processing. Such recording media include flexible disks and CD-ROs.
M, magneto-optical disk, IC card, ROM cartridge, punched card, printed matter on which codes such as bar codes are printed, internal storage device of computer (RAM or ROM
Various computer-readable media such as a memory) and an external storage device.

D. Modifications: Some embodiments of the present invention have been described above, but the present invention is not limited to such embodiments, and various modifications can be made without departing from the scope of the invention. It can be implemented. For example, the following modifications are possible.

D1. Modified Example 1: In the above-described embodiment, the contour compensation unit 70 generates the compensation coefficient G according to the vector total amount D for each image data and performs the sharpness adjustment, but the magnitude of the motion vector detected for each block. The compensation coefficient G may be generated according to the above, and the sharpness adjustment may be performed with a different emphasis degree for each block. By doing so, it is possible to perform sharpness adjustment with a desired degree of emphasis in the moving image region while avoiding excessive sharpness adjustment in the still image region.

D2. Modified Example 2: In the above-described embodiment, the contour compensating unit 70 performs sharpness adjustment on the entire image. However, a moving image region extracting unit that extracts a moving image region whose display content changes with time is provided and extracted. You may make it adjust a sharpness to a moving image area. The extraction of the moving image area can be performed, for example, based on the difference data between the two image data. Moreover, even if the determination shown in FIG. 5 of the embodiment is performed for each block based on the magnitude of the motion vector of each block, the extraction of the moving image region can be substantially realized. By doing so, it is possible to improve the image quality of the moving image area that tends to be unclear.

Further, it is preferable to detect the magnitude of the motion vector in the moving image area and change the emphasis degree of the sharpness adjustment accordingly. This makes it possible to more appropriately perform sharpness adjustment on the moving image area.

The present invention is applied to a moving image in which a moving object moves on the screen. For example, in the case of a moving image in which a moving object is tracked and photographed, the background becomes a moving image area and the moving object becomes a still image area. In this case, if sharpness adjustment is performed on the background, which is a moving image area, the image quality may be deteriorated. Therefore, in such a case, it is preferable to switch the image processing so that the present invention is not applied.

D3. Modified Example 3: In the above embodiment, sharpness adjustment is performed as image processing that emphasizes display clarity, but the present invention is not limited to this. Regardless of sharpness adjustment, image processing that affects display clarity such as contrast adjustment and brightness adjustment may be performed.

D4. Modification 4: In the above embodiment, the sharpness adjustment is performed using the compensation coefficient G according to the vector total amount D and the digital filter, but instead of these, the vector total amount D and a plurality of spatial filters are associated with each other. A sharpness adjustment may be performed by providing a spatial filter storage unit for storing and selectively using a spatial filter according to the total vector amount D. As described above, the sharpness adjustment is performed by multiplying a pixel to be processed and its peripheral pixels by a weighting coefficient, and adding or subtracting the pixel as shown in FIG. A spatial filter is a matrix that defines the range of pixels and weighting factors used in this process. FIG. 9 is an explanatory diagram showing an example of a 5 × 5 spatial filter. 9A and 9B are spatial filters that smooth the contour. FIG. 9C is a spatial filter that emphasizes the contour. FIG. 9D is a composite spatial filter having the effect of smoothing the contour and the effect of enhancing the contour. The pixel in the center corresponds to the pixel to be processed. By arbitrarily setting such a spatial filter according to the total vector amount D and the magnitude of the motion vector and using them properly, it is possible to improve the image quality as in the above embodiment.

D5. Modification 5: In the above embodiment, a two-dimensional FIR filter, which is a digital filter, is used as the contour compensation data generation circuit 74, but other filters,
For example, an analog filter or a spatial filter may be used.

D6. Modification 6: In the above embodiment, the configuration of the projector using the transmissive liquid crystal panel has been described, but the present invention is also applicable to other types of projectors. Other types of projectors include those using a reflection type liquid crystal panel, those using a micro mirror device (trademark of Texas Instruments Inc.), and those using a CRT. Further, the projector may be a so-called front projector or a rear projector. The present invention also provides an image display device other than the projector,
For example, PDP (Plasma Display Panel), LED display (Light Emitting Diode), ELD (Electroluminesce)
nceDisplay) is also applicable.

[Brief description of drawings]

FIG. 1 is an explanatory diagram showing an overall configuration of a projector 10 as an embodiment of the invention.

2 is a block diagram showing an internal configuration of a video processor 26. FIG.

FIG. 3 is a block diagram showing a configuration of a contour compensation unit 70.

FIG. 4 is an explanatory diagram showing how image data is divided into blocks.

FIG. 5 is an explanatory diagram showing the relationship between the total vector amount D, the compensation coefficient G, and the image determination.

FIG. 6 is a block diagram showing a configuration of a contour compensation data generation circuit 74.

7 is an explanatory diagram showing image processing in a contour compensation unit 70. FIG.

8 is a flowchart showing a flow of processing performed by the contour compensating section 70. FIG.

FIG. 9 is an explanatory diagram showing an example of a 5 × 5 spatial filter.

[Explanation of symbols]

10 ... Projector 12 ... Analog image input terminal 14 ... Digital image input terminal 20 ... AD converter 22 ... Video decoder 24 ... Frame memory 26 ... Video processor 30 ... Liquid crystal panel drive unit 32 ... Liquid crystal panel 34 ... Remote controller control unit 40 ... Remote controller 50 ... Lighting device 52 ... Projection optical system 60 ... Integrated circuit for image processing 62 ... Frame memory controller 64 ... Trapezoidal distortion correction unit 66 ... Enlargement / reduction processing circuit 68 ... Image quality adjustment section 70 ... Contour compensation section 72 ... Motion vector detection unit 73 ... Compensation coefficient generation unit 73a ... Image determination unit 73b ... Compensation coefficient storage unit 74 ... Contour compensation data generation circuit 75 ... Delay circuit 76 ... Multiplier 77 ... Adder 80 ... Horizontal filter 81, 82 ... Horizontal delay circuit 83-85 ... Multiplier 86 ... Adder 90 ... Vertical filter 91, 92 ... Vertical delay circuit 93-95 ... Multiplier 96 ... Adder

Claims (16)

[Claims] 1. An image processing apparatus for performing predetermined image processing on moving image data composed of a plurality of screens arranged in time series, wherein an input for inputting each image data for two screens. Section, a motion vector detection section that detects the magnitude of a motion vector based on the both image data, and an image processing section that performs image processing that emphasizes display intelligibility with an emphasis degree according to the magnitude of the motion vector. An image processing apparatus comprising: 2. The image processing apparatus according to claim 1, wherein the motion vector detection unit divides each screen into a predetermined number of areas, and for each area, the motion based on both the image data. An image processing apparatus that detects the magnitude of a vector, and the image processing unit performs the image processing on each of the regions with an enhancement degree according to the magnitude of the motion vector. 3. The image processing apparatus according to claim 1, wherein
Further, the image processing unit is provided with the compensation coefficient storage unit that stores the relationship between the magnitude of the motion vector and the compensation coefficient representing the degree of enhancement, An image processing apparatus that performs the image processing using a corresponding compensation coefficient. 4. The image processing apparatus according to claim 1, wherein:
Furthermore, a spatial filter storage unit that stores the relationship between the size of the motion vector and a spatial filter used for the image processing is provided, and the image processing unit is provided by the spatial filter storage unit, and the size of the motion vector An image processing apparatus which performs the image processing using a spatial filter corresponding to. 5. The image processing apparatus according to claim 1, wherein the image data is subjected to interpolation processing for increasing resolution. 6. The image processing apparatus according to claim 1, wherein: The image processing apparatus, wherein the image processing is sharpening processing. 7. An image processing apparatus for performing a predetermined image processing on moving image data composed of a plurality of screens arranged in time series, wherein an input for inputting each image data for two screens. Section, a moving picture area extracting section that extracts a moving picture area whose display content changes temporally on the basis of both image data, and image processing that emphasizes display clarity of the moving picture area. An image processing apparatus comprising: an image processing unit that performs the processing. 8. The image processing apparatus according to claim 7, wherein
The image processing unit further includes a motion vector detection unit that detects the size of the motion vector in the moving image region, and the image processing unit performs the image processing on the moving image region with an enhancement degree according to the size of the motion vector. An image processing device for applying. 9. The image processing apparatus according to claim 7, wherein
Further, the image processing unit includes a motion vector detection unit that detects the size of the motion vector of the moving image region, and the image processing unit determines whether or not to perform the image processing based on the size of the motion vector. An image processing apparatus including a unit. 10. The image processing device according to claim 9, wherein the determination is performed based on a comparison between a lower limit value preset as a range to be subjected to the image processing and a magnitude of the motion vector. , Image processing device. 11. The image processing apparatus according to claim 9, wherein the determination is made based on a comparison between an upper limit value preset as a range to be subjected to the image processing and a magnitude of the motion vector. , Image processing device. 12. An image processing method for subjecting moving image data composed of a plurality of time-sequentially arranged screens to a predetermined image processing, comprising: (a) Acquiring, and (b) detecting the magnitude of the motion vector based on both the image data,
(C) an image processing method for enhancing the display intelligibility with an enhancement degree according to the magnitude of the motion vector. 13. An image processing method for performing predetermined image processing on moving image data composed of a plurality of screens arranged in time series, wherein (a) each image data of two screens is processed. And (b) extracting a moving image area whose display content changes temporally on the basis of the image data of both of the screens, and (c) displaying clarity of the moving image area. An image processing method comprising: a step of performing image processing for emphasizing. 14. A computer program for performing predetermined image processing on moving image data composed of a plurality of screens arranged in time series, and having a function of acquiring each image data for two screens. , A function of detecting the magnitude of the motion vector based on the both image data, and a function of performing image processing for enhancing the display intelligibility with the emphasis degree based on the magnitude of the motion vector Computer program. 15. A computer program for performing predetermined image processing on moving image data composed of a plurality of screens arranged in time series, and having a function of acquiring each image data for two screens. A function of extracting a moving image area whose display content changes with time based on the image data of any one of the screens, and a function of performing image processing for emphasizing the display clarity of the moving image area. A computer program to be realized by a computer. 16. A recording medium in which the computer program according to claim 14 or 15 is recorded in a computer-readable manner.