JP2010026202A - Image correcting device, image correcting method, projector, and projection system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make distortion correction such that the whole projection image appears to give a uniform resolution feeling when distortion amount of local distortion on a screen is different in each local distortion. <P>SOLUTION: An image correcting device 330 which corrects an image to be projected by a projector based upon local distortion of a projection surface includes: a distortion amount calculating unit 332 which calculates distortion amounts at respective feature points of a plurality of feature points based upon a picked-up image obtained by picking up an image for distortion amount calculation projected on the projection surface and having the plurality of feature points; an image correction processing unit 333 which corrects the image to be projected based upon the distortion amounts at the respective feature points calculated by the distortion amount calculating unit 332; and an edge emphasis processing unit 337 which performs edge emphasis processing on a predetermined area of the image to be projected by an edge emphasizing method corresponding to the distortion amounts at the respective feature points calculated by the distortion amount calculating unit 332. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image correction apparatus, an image correction method, a projector, and a projection system that correct a projection image projected on a projection surface.

In recent years, a proximity projection type projection system has been developed in which a projector is installed at a position close to the screen and projection is performed from the projector onto the screen.
FIG. 12 is a diagram for explaining an example of a proximity projection type projection system. As shown in FIG. 12A, the proximity projection type projection system is often configured to install the projector PJ immediately before the screen SCR and near the lower end of the screen SCR.

  In such a proximity projection type projection system, the projection light from the projector PJ enters the screen SCR at an acute angle. For this reason, when local distortion exists in the screen SCR, distortion occurs in the projection image in the local distortion portion of the screen SCR. For example, as shown in FIG. 12B, if the screen SCR has irregularities (convex portions h in FIG. 12) as local distortion, the projected image is distorted at the convex portions h. That is, the image of the pixel to be projected at the position P1 in FIG. 12B is actually projected at the position P1 ′ of the convex portion h of the screen SCR, and the viewer's line-of-sight direction is projected onto the screen SCR. On the other hand, if the direction is vertical, the projected image is distorted at the convex portion h of the screen SCR. Although FIG. 12 shows a case where the convex portion h exists on the screen SCR, distortion also occurs when a concave portion exists.

  Thus, the distortion of the projected image due to the local distortion of the screen also causes the image quality to deteriorate. In particular, in a projection system in which the projection light from the projector PJ is incident on the screen SCR at an acute angle like the proximity projection type projection system shown in FIG. 12, the distortion of the projected image due to the local distortion of the screen. Is clearly recognized by the viewer.

  In a projection system in which projection light from the projector PJ is incident on the screen SCR at an acute angle, an image projected from the projector PJ to the screen SCR is displayed correctly when viewed from the viewer's line of sight. Various techniques for performing image correction have been proposed (see, for example, Patent Document 1).

  The technique (referred to as the prior art) disclosed in Patent Document 1 is an image display apparatus in which a projector is installed such that projection light is incident on the screen at an acute angle. In such an image display apparatus, A distortion amount calculation image as a test image is projected on a screen, the projected distortion amount calculation image is imaged by the imaging device 200 (see FIG. 12), and based on captured image data obtained thereby, Correction data for applying reverse distortion is generated, and image correction is performed using this correction data.

JP 2001-83949 A

The local distortion (unevenness) as shown in FIG. 12 often exists at a plurality of locations on the screen SCR. When there are a plurality of local distortions on the screen SCR, the magnitude of the distortion (distortion at each location). The distortion that appears in the projected image varies depending on the amount). In other words, the distortion of the projected image increases at a location where the distortion amount of the local distortion on the screen is large, and the distortion of the projection image does not increase too much at a location where the distortion amount of the local distortion of the screen is not very large. Therefore, it is preferable to perform distortion correction according to the distortion amount of the local distortion of the screen in order to obtain a visually uniform resolution feeling in the entire projection image.

  However, in the prior art, correction is performed using the same correction method over the entire projected image. Therefore, when there are multiple local distortions on the screen, the corrected projected image is the entire projected image. There is a problem that a uniform resolution cannot be obtained visually.

  FIG. 13 is a diagram for explaining the relationship between the sensed image and the sense of resolution obtained by capturing the distortion amount calculation image with the imaging device. FIG. 13A shows a captured image obtained by imaging a distortion amount calculation image with an imaging device, and FIG. 13B shows an MTF (Modulation Transfer Function) at each position of the distortion amount calculation image. . Note that the MTF is an index representing the sense of resolution of an image. If the MTF is high, it can be said that the sense of resolution of the image is high.

  13A represents the feature points P11, P12,..., P21, P22,..., And in the distortion amount calculation image, the feature points P11, P12,. .., P21, P22,... Are images arranged at equal intervals in the vertical and horizontal directions.

  Therefore, if there is no local distortion on the screen, the feature points P11, P12,..., P21, P22,. Evenly spaced. On the other hand, when local distortion exists on the screen, feature points (for example, feature points P22 and P24) at positions corresponding to the local distortion of the screen are indicated by broken-line circles A1 and A2 in FIG. As shown by, the image is shifted from the original position. Note that the larger the amount of local distortion of the screen, the greater the amount of positional deviation. For this reason, in the case of FIG. 13A, the MTF is reduced (the resolution is lowered) in the portions of the feature points P22 and P24, and in particular, the MTF is greatly reduced at the feature point P22. .

  As shown in FIG. 13, if the distortion amount of the local distortion of the screen is different in each local distortion, the resolution of the projection image also differs depending on the distortion amount of each local distortion of the screen. “Dispersion” occurs in the resolution. Therefore, when the entire projection image is corrected using the same image correction method as in the above-described conventional technology, the corrected projection image does not become an image having a uniform resolution to the eye in the entire projection image. In some cases.

  Therefore, the present invention provides an image correction apparatus and an image correction method capable of correcting distortion so as to have a visually uniform resolution in the entire projected image when the amount of local distortion of the screen differs in each local distortion. An object of the present invention is to provide a projector and a projection system.

An image correction apparatus according to the present invention is an image correction apparatus that corrects an image to be projected by a projector based on local distortion of a projection surface, and for calculating a distortion amount having a plurality of feature points projected on the projection surface. A distortion amount calculation unit that calculates a distortion amount at each feature point of the plurality of feature points based on a captured image obtained by capturing an image, and a distortion at each feature point calculated by the distortion amount calculation unit An image correction processing unit that corrects the image to be projected based on the amount, and a distortion amount at each feature point calculated by the distortion amount calculation unit with respect to the image to be projected corrected by the image correction processing unit And an edge enhancement processing unit that performs edge enhancement processing on a predetermined area of the image to be projected by an edge enhancement method according to the method.

  In the image correction apparatus of the present invention, when correcting the local distortion of the projection image caused by the local distortion of the projection surface (screen), the distortion amount calculation image is projected onto the projection surface, and the projected distortion amount calculation A distortion amount at each feature point of the distortion amount calculation image is calculated based on a captured image obtained by capturing the image. Then, image correction processing is performed based on the calculated distortion amount at each feature point, and edge enhancement processing according to the calculated distortion amount is performed on the predetermined region of the projection image for the image that has been subjected to the image correction processing. I am doing so. The image correction method performed here is not particularly limited, and a known image correction method that can reduce distortion can be used.

  As described above, in the image correction apparatus of the present invention, first, image correction processing is performed on the local distortion of the projection surface, and an edge corresponding to the distortion amount at each feature point is applied to the image subjected to the image correction processing. Emphasis processing is performed. As a result, even when there are a plurality of local distortions on the projection surface, the corrected projection image is an image having a visually uniform resolution in the entire projection image. In addition, the local distortion of the projection surface can be exemplified by unevenness or the like locally present on the projection surface due to “wrinkles” of the projection surface.

  In the image correction apparatus of the present invention, it is preferable that the feature points are set corresponding to a plurality of pixels at discrete positions among the pixels of the light modulation element in the projector.

  By projecting a distortion amount calculation image having such a feature point on a projection surface and capturing the projected distortion amount calculation image, a captured image in which local distortion of the projection surface appears as distortion of the feature point is obtained. Obtainable. Therefore, by using the captured image, it is possible to calculate a distortion amount that appropriately reflects the local distortion of the projection surface. As feature points, marks such as small circles and squares arranged at equal intervals in the vertical and horizontal directions, and intersections (grid points) of lines drawn in a grid pattern in the vertical and horizontal directions can be used. .

In the image correction apparatus of the present invention, the distortion amount calculation unit includes the coordinates of the feature points in the distortion amount calculation image and the feature points in a captured image obtained by capturing the distortion amount calculation image. It is preferable to calculate the amount of distortion at each feature point based on the coordinates.
Thereby, even when the local distortion of a projection surface exists in multiple places on a projection surface, the distortion amount in each of multiple places can be calculated with high precision.

  In the image correction apparatus of the present invention, an edge enhancement method corresponding to the distortion amount at each feature point calculated by the distortion amount calculation unit is selected for the image to be projected corrected by the image correction processing unit. An edge enhancement method selection unit, and the edge enhancement method selection unit has a function of determining the amount of distortion at each feature point as a plurality of levels of distortion, and for each of the plurality of levels. It is preferable to have a function of selecting an edge enhancement processing method corresponding to a distortion amount at each feature point from a plurality of types of edge enhancement methods having different edge enhancement levels.

Thereby, the edge emphasis process according to the distortion amount of the local distortion of a projection surface can be performed. Specifically, one or more threshold values for determining the magnitude of distortion at each feature point are set, and the magnitude of distortion at each feature point is determined in two or more stages. Then, edge enhancement methods having different edge enhancement levels are set for each stage, and it is determined to which stage of the plurality of stages the distortion amount at each feature point calculated by the distortion amount calculation unit belongs. An appropriate edge enhancement method is selected based on the result, and edge enhancement processing is performed using the selected edge enhancement method. As the edge enhancement method for each stage, an edge enhancement method is set that enables edge enhancement with higher edge enhancement as the distortion amount at each feature point is larger.

  In this way, the amount of distortion is determined as the magnitude of the amount of distortion in a plurality of stages, and edge enhancement is performed by selecting an edge enhancement method suitable for the determined amount of distortion. Appropriate edge enhancement processing can be performed accordingly.

  In the image correction apparatus of the present invention, the plurality of steps are two steps whether or not the distortion amount at each feature point is a predetermined value or more, and the plurality of types of edge enhancement methods having different edge enhancement levels are: There are two types of edge enhancement methods: a first edge enhancement method capable of performing an edge enhancement process with a high edge enhancement degree, and a second edge enhancement method for performing an edge enhancement process with an edge enhancement degree lower than that of the first edge enhancement method. When it is determined that the amount of distortion at a certain feature point of each feature point is equal to or greater than the predetermined value, the first edge enhancement method is selected for the feature point, and the feature of each feature point is When it is determined that the amount of distortion at a point is less than the predetermined value, it is preferable to select the second edge enhancement method for the feature point.

  This determines whether the amount of distortion at each feature point is greater than or less than a predetermined value, and selects either the first edge enhancement method or the second edge enhancement method according to the determination result. Thus, the edge enhancement processing is performed by the selected edge enhancement method, and according to this, the edge enhancement processing according to the distortion amount of the local distortion of the projection surface can be performed with a small amount of calculation.

  In the image correction apparatus of the present invention, the edge enhancement processing unit has a function of determining whether or not the distortion amount at each feature point is equal to or greater than a predetermined value, and the distortion amount at each feature point is a predetermined value. It is preferable to perform edge enhancement processing by a predetermined edge enhancement method only when it is determined that the above is true.

  This means that edge enhancement processing is performed by a predetermined edge enhancement method only when it is determined that the amount of distortion at each feature point is greater than or equal to a predetermined value. In other words, when the amount of distortion at each feature point is less than a predetermined value, the edge enhancement process is not performed. Even with such a configuration, it is possible to obtain an effect of improving the non-uniform appearance of the entire projected image on the projection surface. Further, in such a configuration, it is not particularly necessary to provide an edge enhancement method selection unit, so that the configuration can be simplified and the processing amount for selecting the edge enhancement method is not required, so that the amount of calculation can be reduced.

In the image correction apparatus of the present invention, it is preferable that the predetermined region of the image to be projected on which the edge enhancement processing is performed is a local region including pixels of the image to be projected corresponding to the feature points. .
By performing edge enhancement processing with the correction range set for the image to be projected in this way, when performing edge enhancement processing for the distortion of the projected image caused by local distortion of the projection surface, the edge within the appropriate range Emphasis processing can be performed.

  The image correction apparatus of the present invention further includes an image correction method selection unit that selects an image correction method according to the distortion amount at each feature point calculated by the distortion amount calculation unit, and the image correction processing unit includes: It is preferable that a predetermined area of the image to be projected is corrected by the image correction method selected by the image correction method selection unit.

This is because, prior to edge enhancement processing according to the amount of distortion at each feature point, local image correction is performed on the projected image using an image correction method according to the amount of distortion at each feature point, and the image correction is performed. The image is subjected to edge enhancement processing according to the amount of distortion of the local distortion of the projection surface, and by performing such processing, the corrected projection image is visually seen in the entire projection image, The image has a more uniform resolution.

  In the image correction apparatus of the present invention, the image correction method selection unit has a function of determining the amount of distortion at each feature point as a plurality of levels of distortion, and the amount of distortion at each feature point. It is preferable to have a function of selecting a corresponding image correction method from a plurality of types of image correction methods having different correction accuracy set for each of the plurality of steps.

  Thereby, the image correction according to the distortion amount of the local distortion of the projection surface can be performed. Specifically, one or more threshold values for determining the magnitude of distortion at each feature point are set, and the magnitude of distortion at each feature point is determined in two or more stages. Then, an image correction method having different correction accuracy is set for each stage, and it is determined to which stage of the plurality of stages the distortion amount at each feature point calculated by the distortion amount calculation unit belongs. An appropriate image correction method is selected based on the above, and image correction is performed using the selected image correction method. Note that as the image correction method for each stage, an image correction method is set that enables higher-precision image correction as the amount of distortion at each feature point increases.

  In this way, the amount of distortion is determined as the amount of distortion in multiple stages, and image correction is performed by selecting an image correction method suitable for the determined amount of distortion, so depending on the amount of distortion. Image correction method according to the amount of distortion at each feature point in addition to the edge enhancement processing according to the amount of distortion at each feature point after performing such image correction processing. By performing local image correction on the projection image using, the corrected projection image becomes an image having a more uniform resolution when viewed in the entire projection image.

  In the image correction apparatus of the present invention, the plurality of steps are two steps whether or not a distortion amount at each feature point is equal to or greater than a predetermined value. There are two types of image correction methods, a first image correction method capable of accurate correction and a second image correction method that performs correction with lower accuracy than the first image correction method. When it is determined that the amount of distortion at a point is greater than or equal to the predetermined value, the first image correction method is selected for the feature point, and the amount of distortion at a feature point at each feature point is the predetermined value. If it is determined that the second image correction method is less than the second image correction method, it is preferable to select the second image correction method for the feature point.

  This is to determine whether the amount of distortion at each feature point is greater than or less than a predetermined value and select either the first image correction method or the first image correction method according to the determination result Then, the image correction is performed by the selected image correction method, and according to this, the image correction according to the distortion amount of the local distortion of the projection surface can be performed with a small calculation amount.

  In the image correction apparatus according to the aspect of the invention, it is preferable that the projector is installed at a position close to the projection surface and that the projection light is incident on the projection surface at an acute angle.

  Thus, when the projector is installed at a position close to the projection surface and the projection light is installed so as to be projected at an acute angle with respect to the projection surface, the projection is performed when the direction perpendicular to the projection surface is the line-of-sight direction. The distortion of the projected image due to the local distortion of the surface is easily recognized by the viewer. Therefore, when the direction perpendicular to the projection surface is the line-of-sight direction, it is essential to perform correction so that the resolution is uniform in the entire projected image. When performing such correction, the present invention Is extremely effective.

  An image correction method of the present invention is an image correction method for correcting an image to be projected by a projector based on local distortion of a projection surface, and for calculating a distortion amount having a plurality of feature points projected on the projection surface. A distortion amount calculating step for calculating a distortion amount at each feature point of the plurality of feature points based on a captured image obtained by capturing an image, and a distortion at each feature point calculated by the distortion amount calculation unit An image correction processing step for correcting the image to be projected based on the amount, and a distortion amount at each feature point calculated by the distortion amount calculation unit for the image to be projected corrected by the image correction processing unit And an edge enhancement processing step of performing edge enhancement processing on a predetermined region of the image to be projected by an edge enhancement method according to the method.

  The projection image corrected by executing such processing steps is an image having a uniform resolution to the eye in the entire projection image. Note that the image correction method of the present invention preferably has the respective characteristics of the image correction apparatus of the present invention.

  The projector of the present invention is a projector having an image correction device that corrects an image to be projected based on local distortion of the projection surface, and the image correction device includes a plurality of feature points projected on the projection surface. Based on a captured image obtained by capturing a distortion amount calculation image having, a distortion amount calculation unit that calculates a distortion amount at each feature point of the plurality of feature points; and the distortion amount calculation unit that is calculated by the distortion amount calculation unit An image correction processing unit that corrects the image to be projected based on a distortion amount at each feature point, and each of the images that are calculated by the distortion amount calculation unit for the image to be projected that has been corrected by the image correction processing unit. And an edge enhancement processing unit that performs edge enhancement processing on a predetermined region of the image to be projected by an edge enhancement method according to a distortion amount at a feature point.

  By mounting such an image correction apparatus on the projector, the effects described in the image correction apparatus of the present invention can be obtained. Note that the projector according to the present invention preferably has the characteristics of the image correction apparatus according to the present invention.

  The projection system of the present invention is a projection system comprising: a projector that projects an image on a projection surface; and an image correction device that corrects an image to be projected by the projector based on local distortion of the projection surface, The image correction apparatus calculates a distortion amount at each feature point of the plurality of feature points based on a captured image obtained by imaging a distortion amount calculation image having a plurality of feature points projected on the projection surface. A distortion amount calculation unit that performs correction, an image correction processing unit that corrects the image to be projected based on the distortion amount at each feature point calculated by the distortion amount calculation unit, and the image correction processing unit that corrects the image For an image to be projected, a predetermined region of the image to be projected is determined by an edge enhancement method according to the distortion amount at each feature point calculated by the distortion amount calculation unit. And having an edge enhancement processing section which performs edge enhancement processing.

  This is a case where the image correction apparatus is a separate component from the projector, and an example is when the functions of the image correction apparatus are incorporated in an information processing apparatus such as a personal computer. Thus, even when the projection system is configured by the projector and the image correction apparatus, the effects described in the image correction apparatus of the present invention can be obtained. Note that the projection system of the present invention preferably has the characteristics of the image correction apparatus of the present invention.

  Hereinafter, embodiments of the present invention will be described.

[Embodiment 1]
FIG. 1 is a diagram illustrating a configuration of a projector according to the first embodiment. The projector (referred to as projector PJ1) according to the first embodiment includes an image projection unit 100, an imaging device 200, and an image processing device 300, as shown in FIG.

  The image projection unit 100 includes a projection control unit 110, a light modulation element 120 such as a liquid crystal panel, a light source 130, a projection optical system 140, and the like, and projects image light based on image data image-processed by the image processing device 300. Ejected by the system. In addition to these configurations, the image projection unit 100 includes various optical systems and the like, but these are well-known constituent elements of a general projector, and are not illustrated.

  The image pickup apparatus 200 includes an image pickup optical system 210, an image pickup element 220, and an image pickup element control unit 230 for controlling the image pickup element 220 such as acquisition of an output signal from the image pickup element 220. Note that the resolution of the imaging element 220 has a higher resolution than the resolution of the light modulation element 120.

  The image processing apparatus 300 includes a CPU 310, a storage device 320, and an image correction device 330. The image correction device 330 performs various image corrections including correction of a projected image (various corrections such as keystone distortion correction and distortion correction of a projected image caused by local distortion of a screen). A process for correcting the distortion of the projected image caused by the local distortion of the screen will be described later.

  When the proximity projection type projection system is configured by arranging the projector PJ1 shown in FIG. 1 close to the screen, as described with reference to FIG. 12, local unevenness (projection h in FIG. 12) and the like existing on the screen SCR. Due to the local distortion of the screen SCR caused by the above, the projected image is distorted at the convex portion h. The present invention appropriately corrects the distortion of the projected image due to such local distortion of the screen.

  FIG. 2 is a diagram showing the configuration of the image correction apparatus 330 shown in FIG. As shown in FIG. 2, the image correction apparatus 330 includes a distortion amount calculation image generation unit 331 that generates a distortion amount calculation image (details will be described later with reference to FIG. 3), and a distortion amount calculation image projected on the screen. , P21, P12,..., P21, P22,... In the distortion amount calculation image based on the captured image data (referred to as captured image) obtained by capturing the image with the imaging device 200. The distortion amount calculation unit 332 that calculates the distortion amount in ()), the image correction processing unit 334 that performs image correction on the image to be projected by the projector PJ1 based on the calculated distortion amount at each feature point, and the feature point An edge enhancement method selection unit 336 that selects an edge enhancement method according to the amount of distortion, and selects the selected edge enhancement method for an image that has undergone image correction processing (referred to as a corrected image). What the edge enhancement processing unit 337 performs edge enhancement processing, and a control unit 335 that performs control for the image pickup device 200 and projector PJ1.

  The edge enhancement method selection unit 336 has a function for determining the magnitude of the distortion amount at each feature point as the magnitude of the distortion amount at a plurality of stages, and a plurality of types with different edge enhancement levels set for each of the plurality of stages. A function of selecting an edge enhancement method corresponding to the distortion amount at each feature point from the edge enhancement methods.

  Note that in the projector PJ1 according to the first embodiment, the determination of the amount of distortion at each feature point is whether or not the distortion amount at each feature point is equal to or greater than a predetermined value (referred to as a distortion amount determination threshold TH1). In addition, the plurality of types of edge enhancement methods having different correction accuracy are lower in edge enhancement than the first edge enhancement method and the first edge enhancement method capable of performing edge enhancement processing with high correction edge enhancement. It is assumed that two types of image correction methods, the second edge enhancement method for performing edge enhancement processing, are set.

  If it is determined that the distortion amount at a certain feature point among the feature points is equal to or greater than the distortion amount determination threshold TH1, the first edge enhancement method is selected for the feature point, and each feature point is selected. When it is determined that the distortion amount at a certain feature point is less than the distortion amount determination threshold TH1, the second edge enhancement method is selected for the feature point.

  FIG. 3 is a diagram illustrating an example of a distortion amount calculation image projected on the screen and a captured image obtained by capturing the distortion amount calculation image. As shown in FIG. 3A, the distortion amount calculation image has feature points P11, P12,..., P21, P22,. Assume that the images are arranged. In the following description, the feature points P11, P12,..., P21, P22,... Have their symbols “P11, P12,. "P21, P22, ..." are omitted.

  Each feature point of the distortion amount calculation image is set corresponding to a pixel at a discrete position among the pixels of the light modulation element 120 (for example, a liquid crystal panel) in the projector PJ1. Specifically, the distortion amount calculation position is set so as to correspond to a predetermined number of pixels among the pixels in the vertical and horizontal directions of the light modulation element. The distortion amount calculation image shown in FIG. 3A shows an example in which each feature point is set at an interval of 10 pixels of the light modulation element in the vertical direction and the horizontal direction.

  FIG. 3B shows a distortion amount calculation image (projection distortion amount calculation image) when the distortion amount calculation image shown in FIG. 3A (referred to as an original distortion amount calculation image) is projected on the screen. It is shown). In the projection distortion amount calculation image shown in FIG. 3B, the distortion amount calculation based on the positions of the feature points (for example, feature points P22 and P24) corresponding to the local distortion of the screen shown in FIG. There is a “deviation” compared to the image for use.

  When such an image for calculating a projection distortion amount is picked up by the imaging apparatus 200, the captured image is naturally a local distortion of the screen with respect to the original distortion amount calculation image shown in FIG. The feature point corresponding to is a “deviation”. For example, if local distortion as shown in FIG. 12B is present on the screen, the captured image has a local distortion corresponding to the local distortion of the screen relative to the original distortion amount calculation image. According to the amount of distortion in the feature point, “displacement” occurs in the feature point.

  Since this “deviation” is proportional to the distortion amount in the local distortion of the screen, the “deviation” of the corresponding feature point is obtained from the captured image output from the imaging apparatus 200 and the original distortion amount calculation image. By calculating, the amount of distortion in the local distortion of the screen can be calculated. In the embodiment of the present invention, the amount of distortion due to local distortion of the screen is expressed as the amount of distortion at each feature point of the distortion amount calculation image.

  FIG. 4 is a flowchart illustrating an overall processing procedure performed by the image correction apparatus 330. First, a distortion amount calculation image is generated by the distortion amount calculation image generation unit 331 (step S1), the generated distortion amount calculation image is given to the image projection unit 100 by the control unit 335, and the distortion with respect to the image projection unit 100 is also performed. A projection instruction for the amount calculation image is output (step S2). As a result, the image projection unit 100 projects the distortion amount calculation image onto the screen.

  In addition, the imaging unit 200 outputs an imaging instruction for imaging the distortion amount calculation image projected on the screen by the control unit 335 (step S3). Thereby, the imaging device 200 captures the distortion amount calculation image projected on the screen SCR. The distortion amount calculation unit 332 receives the captured image output from the imaging apparatus 200 via the control unit 335, and calculates the distortion amount at each feature point of the distortion amount calculation image (step S4).

  Subsequently, based on the calculated distortion amount, the image correction processing unit 334 performs image correction by a predetermined image correction method on the image to be projected (step S5). Note that the image correction method performed by the image correction processing unit 334 is not particularly limited in the projector PJ1 according to the first embodiment. For example, correction data for applying reverse distortion is generated based on the captured image. Then, it is possible to use a general image correction method in which image correction is performed using the generated correction data. Then, the edge enhancement method selection unit 336 selects an edge enhancement method according to the distortion amount at each feature point (step S6). Thereafter, the edge enhancement processing unit 337 performs edge enhancement processing by the edge enhancement method selected by the edge enhancement method selection unit 336 on the corrected image that has been image-corrected by the image correction processing unit 334 (step S7).

  FIG. 5 is a flowchart illustrating a processing procedure for calculating a distortion amount at each feature point. As shown in FIG. 5, the distortion amount at each feature point of the distortion amount calculation image is based on a captured image obtained by imaging the projection distortion amount calculation image (see FIG. 3A). The coordinates of each feature point (referred to as imaging device system coordinates) in the captured image are calculated (step S11), and the calculated imaging device system coordinates of each feature point and the original distortion amount calculation image (see FIG. 3A). ) And the coordinates of each feature point (referred to as projector system coordinates) in ().

  Here, if there is no local distortion on the screen, the imaging device system coordinates and the projector system coordinates of the corresponding feature points respectively match. However, if there is local distortion on the screen, the part corresponding to the local distortion is present. A “deviation” occurs between the imaging device system coordinates and the projector system coordinates of the corresponding feature points. The larger the amount of distortion in the local distortion of the screen, the larger the “displacement” of the corresponding feature points.

  FIG. 6 is a flowchart for explaining the imaging device system coordinate calculation processing of each feature point in step S11 of FIG. As shown in FIG. 6, the calculation processing of the imaging device system coordinates of each feature point is performed by binarizing the captured image (step S21), labeling the binarized captured image (step S22), and calculating the labeling result. Imaging device system coordinates of each feature point are calculated (step S23).

  Here, in the binarization of the captured image in step S21, a threshold value TH2 (for example, an intermediate value between the maximum value and the minimum value of the pixel value of the captured image) is set as the pixel value, and the pixel value of each pixel is Binarization is performed depending on whether it is greater than or less than a threshold TH2 (referred to as binarization threshold TH2). For example, “1” is given to a pixel having a pixel value equal to or higher than the binarization threshold TH2, and “0” is given to a pixel having a pixel value less than the binarization threshold TH2.

  Further, the labeling process in step S22 is based on the binarized result. In this case, assuming that the region where “1” continues is a set of pixels corresponding to the feature points, Perform labeling.

  In addition, in the calculation processing of the imaging device system coordinates of each feature point in step S23, when using binarized image data, the position of the pixel serving as the center of gravity of the labeled area is the coordinate position of the feature point. And When image data before binarization is used, the position of the pixel having the maximum pixel value in the labeled area is set as the coordinate position of the feature point.

When the coordinate position of each feature point is calculated from the captured image, the calculated imaging device system coordinate of each feature point is collated with the projector system coordinate of each feature point in the original distortion amount calculation image (FIG. 5 step S12). The collation between the imaging device system coordinates of each feature point and the projector system coordinates of each feature point can be performed by using, for example, the least square method.

  Here, if there is no local distortion on the screen, the imaging device system coordinates and the projector system coordinates of the corresponding feature points respectively match, but if there is local distortion on the screen, each local distortion part A “deviation” occurs between the imaging device system coordinates and the projector system coordinates of the corresponding feature point. Therefore, by comparing the imaging device system coordinates of each feature point with the projector system coordinates of each feature point, the distortion amount at each feature point of the distortion amount calculation image can be calculated from the comparison result.

  Since the distortion amount at each feature point of the calculated distortion amount calculation image is caused by local distortion of the screen, the distortion amount at each feature point of the calculated distortion amount calculation image is The amount of distortion in the corresponding local distortion is reflected.

  By the way, in the projector PJ1 according to the first embodiment, edge enhancement is performed on the corrected image that has been image-corrected by the image correction processing unit 334 using an edge enhancement method according to the distortion amount calculated by the distortion amount calculation unit 332. The processing is performed. Specifically, the edge enhancement method selection unit 336 determines whether or not the distortion amount at each feature point is equal to or greater than the distortion amount determination threshold TH1, and the distortion amount at each feature point is the distortion amount determination threshold TH1. In the case above, for the feature point, the first edge enhancement correct method with high edge enhancement is selected, and the distortion amount at each feature point is less than the distortion amount determination threshold TH1. The second edge enhancement method having a low edge enhancement level is selected for the feature point.

  Then, the edge enhancement processing unit 337 performs edge enhancement processing using the edge enhancement method selected by the edge enhancement method selection unit 336. It should be noted that a pixel to be subjected to edge enhancement processing is a local region (referred to as a local region) including a feature point (referred to as a correction target feature point) having a predetermined “deviation” between the imaging device system coordinate and the projector system coordinate. ).

FIG. 7 is a diagram for explaining an example of setting a local region to be subjected to edge enhancement processing. As shown in FIG. 7, the local region to be subjected to edge enhancement processing is centered on individual feature points in the distortion amount calculation image (the same as the distortion amount calculation image shown in FIG. 3A). A rectangular area (area surrounded by a broken line). Then, the pixels existing in the local area are set as the pixels for edge enhancement processing. For example, if the feature point P22 is a correction target feature point, a local area A _P22 (area shown in gray) including the feature point P22 is set and is present in the local area A _P22 in the image to be projected. A pixel to be processed is set as a pixel to be subjected to edge enhancement processing.

  In addition, the local area | region set including each feature point is a very narrow area | region, if it sees from the whole projection image. Further, in FIG. 7, each local region is shown as an example in which adjacent local regions are set so as not to overlap each other, but may be set so that some pixels overlap. On the contrary, the adjacent local regions do not have to be in contact with each other, and there may be some pixel spacing.

Here, in the example of FIGS. 3A and 3B, the feature point P22 and the feature point P24 have a “deviation” between the projector system coordinates and the imaging device system coordinates, respectively. As a result of collating the projector system coordinates and the imaging device system coordinates at the feature point P22, the calculated distortion amount (referred to as W _P22 ) at the feature point P22 is equal to or greater than the distortion amount determination threshold TH1 (W _P22 ≧ If TH1), the edge enhancement method selection unit 336 selects the first edge enhancement method. Thereby, the edge enhancement processing unit 337 performs edge enhancement processing by the first edge enhancement method for the pixels in the local area _AP22 including the feature point P22.

Similarly, as a result of collating the projector system coordinates of the feature point P24 with the imaging device system coordinates, the calculated distortion amount W _P24 of the feature point P24 is less than the distortion amount determination threshold TH1 (W _P24 <TH1). If there is, the edge enhancement method selection unit 336 selects the second edge enhancement method. Thereby, the edge enhancement processing unit 337 performs edge enhancement processing by the second edge enhancement method for the pixels in the local area _AP24 including the feature point P24.

  Note that the edge enhancement process can be a known edge enhancement process such as an edge enhancement process using a Laplacian filter. The edge enhancement degree can be set by setting the filter coefficient to an appropriate value. In other words, the edge enhancement can be increased by setting a filter coefficient that increases the enhancement degree of the high frequency component, and the edge enhancement degree can be set by setting a filter coefficient that does not increase the enhancement degree of the high frequency component very much. Can be lowered.

  As described above, in the projector PJ1 according to the first embodiment, based on the distortion amount calculated at each feature point of the distortion amount calculation image, first, an image to be projected by a general image correction method or the like is used. Image correction is performed, and edge enhancement processing corresponding to the distortion amount at each feature point is performed on the corrected image. By projecting the image subjected to such processing onto the screen by the projector, the projected image on the screen has a visually uniform resolution in the entire projected image.

[Embodiment 2]
In the projector PJ1 according to the first embodiment, the image correction performed by the image correction processing unit 334 is image correction using a general image processing unit, but this image correction is also the distortion calculated by the distortion amount calculation unit 332. Image correction may be performed using an image correction method according to the amount. The overall configuration of the projector according to the second embodiment (referred to as projector PJ2) is the same as that in FIG. 1, and the projector PJ2 according to the second embodiment is different from the projector PJ1 according to the first embodiment in the image correction device 330. It is a configuration.

  FIG. 8 is a diagram illustrating a configuration of the image correction device 330 in the projector PJ2 according to the second embodiment. The image correction apparatus 330 shown in FIG. 8 differs from FIG. 2 only in that an image correction method selection unit 333 is provided on the input side of the image correction processing unit 334, and the same components as those in FIG. Is attached.

  The image correction method selection unit 333 selects an image correction method according to the distortion amount at each feature point, and determines a distortion amount at each feature point as a plurality of distortion amounts. A function of selecting an image correction method corresponding to a distortion amount at each feature point from a plurality of types of image correction methods having different correction accuracy set for each of the plurality of steps.

  In the projector PJ2 according to the second embodiment, the determination of the amount of distortion at each feature point is whether or not the amount of distortion at each feature point is greater than or equal to a predetermined value (referred to as a distortion amount determination threshold TH1). The plurality of types of image correction methods having different correction accuracy perform the first image correction method capable of image correction with high correction accuracy and image correction with lower correction accuracy than the first image correction method. Assume that two types of image correction methods of the second image correction method are set.

When it is determined that the distortion amount at a certain feature point among the feature points is the distortion amount determination threshold TH1, the first image correction method is selected for the feature point, and When it is determined that the distortion amount at a certain feature point is less than the distortion amount determination threshold TH1, the second image correction method is selected for the feature point. The first image correction method is an image correction method using a bicubic interpolation method, and the second image correction method is an image correction method using a bilinear interpolation method.
Further, the image correction processing unit 334 performs image correction on an image to be projected by the projector PJ2 using the image correction method selected by the image correction method selection unit 333.

  FIG. 9 is a flowchart illustrating an overall processing procedure performed by the image correction apparatus 330 of the projector PJ2 according to the second embodiment. 9 is the same as steps S1 to S4 in FIG. 4, and therefore, the processes after step S35 will be described. The image correction method selection unit 333 selects an image correction method according to the amount of distortion at each feature point (step S35). Then, the image correction processing unit 334 performs local image correction on the image to be projected using the image correction method selected by the image correction method selection unit 333 (step S36).

  Subsequently, the edge enhancement method selection unit 336 selects an edge enhancement method according to the amount of distortion at each feature point (step S37). Then, the edge enhancement processing unit 337 performs edge enhancement processing by the edge enhancement method selected by the edge enhancement method selection unit 336 on the local region of the corrected image that has been image-corrected by the image correction processing unit 334 ( Step S38). Since this edge enhancement processing has been described in the projector PJ1 according to the first embodiment, a description thereof will be omitted.

  Note that the image correction method selection unit 333 in step S36 determines whether the distortion amount at each feature point is equal to or greater than the distortion amount determination threshold TH1, and the distortion amount at each feature point is the distortion amount determination threshold TH1. In the case above, an image correction method using bicubic image interpolation is selected, and when the distortion amount at each feature point is less than the distortion amount determination threshold TH1, bilinear image interpolation is used. Select the image correction method. Then, the image correction processing unit 334 performs image correction using the image correction method selected by the image correction method selection unit 333. It should be noted that the pixel to be subjected to image correction is within a local region (see FIG. 7) including the correction target feature point.

  FIG. 10 is a diagram for explaining an example of image correction processing by the selected image correction method. FIG. 10 shows the image correction result of the captured image shown in FIG. 3B, and the feature point P22 (shown by a gray circle in FIG. 10) at the position shown in FIG. In this example, the image is corrected by the interpolation method, and the feature point P24 (indicated by a gray circle in FIG. 10) at the position shown in FIG. 3B is corrected by the bilinear interpolation method.

  As described above, in the projector PJ2 according to the second embodiment, after performing image correction using the image correction method according to the distortion amount at each feature point, the distortion is applied to the corrected image subjected to image correction. Edge enhancement processing according to the amount is performed. Thus, in the projector PJ2 according to the second embodiment, the image correction and the edge enhancement processing corresponding to the distortion amount in the local distortion of the screen are performed on the image to be projected. By projecting the edge-enhanced image on the screen by the projector, the projected image on the screen has a more uniform resolution when viewed on the entire projected image.

[Embodiment 3]
In the first embodiment and the second embodiment described above, the image correction device 330 is illustrated as being incorporated in the projectors PJ1 and PJ2. However, the image correction device 330 is provided as a separate component from the projectors PJ1 and PJ2. The projector PJ1 or projector PJ2 and the image correction device 330 may constitute a projection system. Note that in the projection system according to the third embodiment, an example in which the image correction device 330 is the image correction device 330 of the projector PJ1 according to the first embodiment will be described.

  FIG. 11 is a diagram illustrating a configuration of a projection system according to the third embodiment. The projection system according to the third embodiment is a proximity projection type projection system in which the projector PJ1 is disposed close to the screen SCR. As shown in FIG. 11, the projector PJ1, the imaging device 200, the image correction device 330, and the connection Cable 500.

  The image correction device 330 can be realized by providing an information processing device (such as a personal computer) with the function. The image correction apparatus 330 includes a distortion amount calculation image generation unit 331, a distortion amount calculation unit 332, an edge enhancement method selection unit 336, an image correction processing unit 334, an edge enhancement processing unit 337, and a control unit 335. (See FIG. 2). Since the processing performed by the image correction apparatus 330 has been described in the projector PJ1 according to the first embodiment, the description thereof is omitted here.

  In the example illustrated in FIG. 11, the distortion amount calculating image generation unit 331, the distortion amount calculation unit 332, the edge enhancement method selection unit 336, the image correction processing unit 334, and the edge enhancement are included in the image correction apparatus 330. The processing unit 337, the control unit 335, and the like are configured differently from the projector PJ1, but some of these components may be provided on the projector PJ1 side.

  In the projection system according to the third embodiment, the image correction device 330 is the image correction device 330 of the projector PJ1 according to the first embodiment. However, the projector PJ2 according to the second embodiment may be configured.

  The present invention is not limited to the above-described embodiments, and modifications as shown in the following (1) to (6) are possible without departing from the gist of the present invention.

  (1) In each of the embodiments described above, one of the two types of edge enhancement methods is selected depending on whether or not the distortion amount at each feature point is equal to or greater than a predetermined value (distortion amount determination threshold TH1). However, it is not limited to this. For example, two or more threshold values for determining the amount of distortion at each feature point may be set, and the amount of distortion may be determined in three or more stages.

  In this case, an edge enhancement method having different edge enhancement levels is set for each stage, and it is determined to which stage of the plurality of stages the distortion amount at each feature point belongs, and the edge enhancement method is based on the determination result. And the edge enhancement process is performed using the selected edge enhancement method. As the edge enhancement processing method for each stage, an edge enhancement processing method is set that enables edge enhancement processing with higher edge enhancement as the amount of distortion at each feature point increases. In this way, the amount of distortion at each feature point is determined as the amount of distortion in multiple stages, and an edge enhancement method suitable for the determined amount of distortion is selected to perform edge enhancement processing. Appropriate edge enhancement processing can be performed according to the amount of distortion at a point.

  (2) In each of the embodiments described above, the edge enhancement processing method having a different edge enhancement level is selected according to the distortion amount at each feature point, but it is determined that the distortion amount at each feature point is equal to or greater than a predetermined value. Only when this is done, the edge enhancement processing can be performed by a predetermined edge enhancement method.

In this case, if the edge enhancement processing unit 337 has a function of determining whether or not the distortion amount at each feature point is equal to or greater than a predetermined value, the edge enhancement method selection unit 336 shown in FIG. There is no. Then, the edge enhancement processing unit 337 performs the edge enhancement processing by a predetermined edge enhancement method only when it is determined that the distortion amount at each feature point is a predetermined value or more. That is, when the calculated distortion amount is less than a certain threshold value, the edge enhancement process is not performed. Even with such a configuration, it is possible to obtain an effect of improving the non-uniform appearance of the entire projected image on the screen.

  (3) Although an example in which the imaging device 200 is provided integrally with the projector PJ1 is shown (see FIG. 11), the imaging device 200 is a component different from the projector PJ1, and is in a position different from the projector PJ1. You may make it install in.

  (4) In each of the above-described embodiments, the image correction apparatus 330 includes the distortion amount calculation image generation unit 331, and the distortion amount calculation image generation unit 331 generates a distortion amount calculation image. Not limited to this, a distortion amount calculation image corresponding to the distortion amount calculation image is stored in a storage unit or the like, and the distortion amount calculation image is read from the storage unit and projected by a projector as necessary. May be.

  (5) In the distortion amount calculation image used in each of the above-described embodiments, the feature points as the distortion amount calculation positions are arranged at equal intervals in the vertical direction and the horizontal direction. However, the present invention is not limited to this. It suffices if the feature point can be specified in the captured image. For example, lines may be drawn in a grid pattern at equal intervals in the vertical direction and the horizontal direction. In this case, the positions (lattice points) where the lines in the vertical direction and the horizontal direction intersect are used as feature points. What is necessary is just to perform distortion amount calculation with the feature point.

  (6) In the second embodiment, one of the two image correction methods is selected depending on whether or not the distortion amount of each feature point is equal to or greater than a predetermined value (distortion amount determination threshold TH1). However, it is not limited to this. Similar to the edge enhancement method, for example, two or more threshold values for determining the amount of distortion at each feature point are set, and the amount of distortion is determined in three or more stages, based on the determination result. Thus, an optimal image correction method may be selected. Moreover, although the case where the bicubic or bilinear interpolation method is used as the two types of image correction methods is illustrated, the image correction method is not limited to this, and other image correction methods may be used.

FIG. 3 is a diagram illustrating a configuration of a projector according to the first embodiment. FIG. 3 is a diagram illustrating a configuration of the image correction apparatus 330 illustrated in FIG. 1. The figure which shows an example of the captured image obtained by imaging the distortion amount calculation image projected on a screen, and this distortion amount calculation image. 6 is a flowchart for explaining an overall processing procedure performed by the image correction apparatus 330; The flowchart explaining the process sequence of distortion amount calculation. The flowchart explaining the calculation process of the imaging device system coordinate of each feature point in step S11 of FIG. The figure explaining the example of a setting of the local range used as the object of an image correction process. FIG. 10 is a diagram illustrating a configuration of an image correction device 330 in a projector PJ2 according to a second embodiment. 9 is a flowchart for explaining an overall processing procedure performed by the image correction apparatus 330 of the projector PJ2 according to the second embodiment. The figure explaining an example of the image correction process by the selected image correction method. FIG. 6 is a diagram illustrating a configuration of a projection system according to a third embodiment. The figure explaining an example of a proximity projection type projection system. The figure explaining the relationship between the picked-up image obtained by imaging the image for distortion amount calculation with an imaging device, and a resolution feeling.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 ... Image projection part, 200 ... Imaging device, 300 ... Image processing part, 330 ... Image correction apparatus, 331 ... Image generation part for distortion amount calculation, 332 ... Calculation of distortion amount , 333... Image correction method selection unit, 334... Image correction processing unit, 336... Edge enhancement method selection unit, 337... Edge enhancement processing unit, PJ1, PJ2. P21,..., P11, P21,.

Claims (14)

An image correction apparatus that corrects an image to be projected by a projector based on local distortion of a projection surface,
A distortion amount calculation unit that calculates a distortion amount at each feature point of the plurality of feature points based on a captured image obtained by imaging a distortion amount calculation image having a plurality of feature points projected on the projection surface. When,
An image correction processing unit that corrects the image to be projected based on the distortion amount at each feature point calculated by the distortion amount calculation unit;
Edge enhancement is performed on a predetermined region of the image to be projected by the edge enhancement method according to the distortion amount at each feature point calculated by the distortion amount calculation unit for the image to be projected corrected by the image correction processing unit. An edge enhancement processing unit for processing;
An image correction apparatus comprising: The image correction apparatus according to claim 1,
Each of the feature points is set corresponding to a plurality of pixels at discrete positions among the pixels of the light modulation element in the projector. The image correction apparatus according to claim 1 or 2,
The distortion amount calculation unit, based on the coordinates of the feature points in the distortion amount calculation image and the coordinates of the feature points in a captured image obtained by capturing the distortion amount calculation image, An image correction apparatus that calculates a distortion amount at a feature point. The image correction apparatus according to any one of claims 1 to 3,
An edge enhancement method selection unit that selects an edge enhancement method according to the amount of distortion at each feature point calculated by the distortion amount calculation unit for the image to be projected corrected by the image correction processing unit;
The edge enhancement method selection unit has a function of determining the amount of distortion at each feature point as a plurality of levels of distortion, and a plurality of different edge enhancement levels set for each of the plurality of stages. An image correction apparatus having a function of selecting an edge enhancement method corresponding to a distortion amount at each feature point from among different types of edge enhancement methods. The image correction apparatus according to claim 4,
The plurality of stages are two stages of whether or not the amount of distortion at each feature point is greater than or equal to a predetermined value. The plurality of types of edge enhancement methods having different edge enhancement levels include edge enhancement processing with high edge enhancement levels. There are two types of edge enhancement methods: a first edge enhancement method that is possible and a second edge enhancement method that performs an edge enhancement process with a lower edge enhancement level than the first edge enhancement method,
When it is determined that the distortion amount at a certain feature point of each feature point is equal to or greater than the predetermined value, the first edge enhancement method is selected for the feature point, and the feature point having each feature point When it is determined that the amount of distortion is less than the predetermined value, the second edge enhancement method is selected for the feature point. The image correction apparatus according to any one of claims 1 to 3,
The edge enhancement processing unit has a function of determining whether or not the amount of distortion at each feature point is a predetermined value or more, and only when it is determined that the amount of distortion at each feature point is a predetermined value or more. An image correction apparatus that performs edge enhancement processing by a predetermined edge enhancement method. In the image correction apparatus according to any one of claims 1 to 6,
The image correction apparatus according to claim 1, wherein the predetermined area of the image to be projected on which the edge enhancement processing is performed is a local area including pixels of the image to be projected corresponding to the feature points. In the image correction apparatus according to any one of claims 1 to 7,
An image correction method selection unit that selects an image correction method according to the distortion amount at each feature point calculated by the distortion amount calculation unit;
The image correction processing unit corrects a predetermined area of the image to be projected by the image correction method selected by the image correction method selection unit. The image correction apparatus according to claim 8,
The image correction method selection unit has a function of determining the amount of distortion at each feature point as the amount of distortion in a plurality of stages, and a plurality of types having different correction accuracy set for each of the plurality of stages. And a function of selecting an image correction method corresponding to the amount of distortion at each feature point from among the image correction methods. The image correction apparatus according to claim 8 or 9,
The plurality of stages are two stages of whether or not the distortion amount at each feature point is equal to or greater than a predetermined value. Two types of image correction methods, a correction method and a second image correction method for performing correction with lower accuracy than the first image correction method,
When it is determined that the amount of distortion at a certain feature point of each feature point is greater than or equal to the predetermined value, the first image correction method is selected for the feature point, and the feature point having each feature point When it is determined that the amount of distortion in the image is less than the predetermined value, the second image correction method is selected for the feature point. The image correction apparatus according to any one of claims 1 to 10,
The image correction apparatus according to claim 1, wherein the projector is installed at a position close to the projection surface, and the projection light is installed at an acute angle with respect to the projection surface. An image correction method for correcting an image to be projected by a projector based on local distortion of a projection surface,
A distortion amount calculating step of calculating a distortion amount at each feature point of the plurality of feature points based on a captured image obtained by capturing a distortion amount calculation image having a plurality of feature points projected on the projection surface. When,
An image correction processing step of correcting the image to be projected based on the distortion amount at each feature point calculated by the distortion amount calculation unit;
Edge enhancement is performed on a predetermined region of the image to be projected by the edge enhancement method according to the distortion amount at each feature point calculated by the distortion amount calculation unit for the image to be projected corrected by the image correction processing unit. Edge enhancement processing steps for processing;
An image correction method comprising: A projector having an image correction device that corrects an image to be projected based on local distortion of a projection surface,
The image correction device includes:
A distortion amount calculation unit that calculates a distortion amount at each feature point of the plurality of feature points based on a captured image obtained by imaging a distortion amount calculation image having a plurality of feature points projected on the projection surface. When,
An image correction processing unit that corrects the image to be projected based on the distortion amount at each feature point calculated by the distortion amount calculation unit;
Edge enhancement is performed on a predetermined region of the image to be projected by the edge enhancement method according to the distortion amount at each feature point calculated by the distortion amount calculation unit for the image to be projected corrected by the image correction processing unit. An edge enhancement processing unit for processing;
A projector comprising: A projection system comprising: a projector that projects an image on a projection surface; and an image correction device that corrects an image to be projected by the projector based on local distortion of the projection surface,
The image correction device includes:
A distortion amount calculation unit that calculates a distortion amount at each feature point of the plurality of feature points based on a captured image obtained by imaging a distortion amount calculation image having a plurality of feature points projected on the projection surface. When,
An image correction processing unit that corrects the image to be projected based on the distortion amount at each feature point calculated by the distortion amount calculation unit;
Edge enhancement is performed on a predetermined region of the image to be projected by the edge enhancement method according to the distortion amount at each feature point calculated by the distortion amount calculation unit for the image to be projected corrected by the image correction processing unit. An edge enhancement processing unit for processing;
A projection system comprising:

Images