JP5561503B2 - Projector, program, information storage medium, and trapezoidal distortion correction method - Google Patents

Description

  The present invention relates to a projector, a program, an information storage medium, and a trapezoidal distortion correction method.

  As a method in which the projector performs trapezoidal distortion correction (also called keystone correction, keystone correction, etc.), for example, as described in JP-A-2005-229293, a projection object using a plurality of phase difference sensors. As described in Japanese Patent Application Laid-Open No. 2005-347790, a method for measuring and correcting the distances to a plurality of measurement points is used to capture the boundary line around the projection object. A method for acquiring and correcting information has been proposed.

JP 2005-229293 A JP 2005-347790 A

  However, in the case of the method of measuring the distance, since the measurement accuracy decreases as the distance to the projection object increases, the projector cannot correct the keystone distortion accurately. On the other hand, in the case of a method for acquiring information about the boundary line around the projection object and the shape of the projection object, when the distance to the projection object becomes short, some of the boundary line is not included in the imaging range. The projector cannot correct the keystone distortion accurately.

  Some embodiments according to the present invention provide a projector, a program, an information storage medium, and a trapezoidal distortion correction method capable of performing accurate trapezoidal distortion correction regardless of the projection distance by solving the above problems. It is.

  A projector according to an aspect of the present invention includes an imaging unit that captures a projection target and generates a captured image, and projection distance information that generates projection distance information indicating a projection distance that is a distance to the projection target. A generation unit; a determination unit that determines whether the projection distance exceeds a reference value based on the projection distance information; and a boundary of the projection target included in the captured image when the projection distance exceeds a reference value And a correction unit that performs a trapezoidal distortion correction based on a line and performs a keystone distortion correction according to a projection angle when the projection distance does not exceed a reference value.

  In addition, a program according to one aspect of the present invention causes a computer included in a projector to cause an imaging device to capture an image of a projection target, generate a captured image, and display a projection distance that is a distance to the projection target. Generating distance information, determining whether the projection distance exceeds a reference value based on the projection distance information, and a boundary line of the projection object included in the captured image when the projection distance exceeds a reference value And trapezoidal distortion correction based on the projection angle when the projection distance does not exceed a reference value.

  An information storage medium according to one aspect of the present invention is an information storage medium that stores a program readable by a computer included in a projector, and stores the program.

  In addition, a trapezoidal distortion correction method according to one aspect of the present invention is a projection in which a projector causes a photographing object to be picked up by an imaging device to generate a picked-up image, and indicates a projection distance that is a distance to the projection target. Generate distance information, determine whether the projection distance exceeds a reference value based on the projection distance information, and when the projection distance exceeds a reference value, a boundary line of the projection object included in the captured image Based on the keystone distortion correction, and when the projection distance does not exceed a reference value, the keystone distortion correction according to the projection angle is performed.

  According to the present invention, since the projector can perform the trapezoidal distortion correction by a method according to the projection distance, it is possible to perform the correct trapezoidal distortion correction regardless of the projection distance.

  The projection distance information generation unit may generate the projection distance information based on the captured image.

  According to this, the projector performs projection distance information generation and trapezoidal distortion correction using only the captured image without measuring the projection distance by the distance sensor and selecting or inputting a value indicating the projection distance by the user. be able to.

  Further, the correction unit, based on the captured image, a boundary line information generation unit that generates boundary line information regarding the coordinates of the boundary line of the projection target included in the captured image, and based on the boundary line information, A first distortion correction information generation unit that generates first distortion correction information for performing trapezoidal distortion correction.

  Accordingly, the projector can perform trapezoidal distortion correction according to the shape of the projection target.

  The correction unit includes a coordinate information generation unit that generates coordinate information indicating three-dimensional coordinates of a plurality of points of the projection target based on the captured image, and a projection angle that indicates the projection angle based on the coordinate information. A projection angle information generation unit that generates information, and a second distortion correction information generation unit that generates second distortion correction information for performing the trapezoidal distortion correction based on the projection angle information may be included.

  According to this, the projector can perform the trapezoidal distortion correction according to the projection angle.

  The second distortion correction information generation unit may generate the second distortion correction information based on the projection angle information and the boundary line information.

  According to this, the projector can perform trapezoidal distortion correction according to the shape and the like of the projection target and the projection angle.

  The correction unit performs trapezoidal distortion correction based on the first distortion correction information when the projection distance exceeds a reference value, and the second distortion correction information when the projection distance does not exceed the reference value. A trapezoidal distortion correction unit that performs keystone distortion correction based on the above may be included.

  According to this, the projector can perform the trapezoidal distortion correction by selecting the distortion correction information according to the projection distance.

  Further, the projection distance information generation unit may generate the projection distance information based on the coordinate information.

  According to this, the projector can generate projection distance information according to the three-dimensional coordinates of a plurality of points of the projection target.

It is a functional block diagram of the projector in a 1st Example. It is a flowchart which shows the trapezoid distortion correction | amendment procedure in a 1st Example. It is a schematic diagram which shows the vanishing point in a 1st Example. It is a figure which shows an example of the image for a measurement in 1st Example. It is a schematic diagram which shows the vanishing point in the three-dimensional space in a 1st Example. It is a schematic diagram which shows an example of the vanishing point in the coordinate system of the virtual area in a 1st Example. It is a schematic diagram which shows another example of the vanishing point in the coordinate system of the virtual area in a 1st Example. It is a functional block diagram of the projector in a 2nd Example. It is a flowchart which shows the trapezoid distortion correction | amendment procedure in a 2nd Example.

  Embodiments in which the present invention is applied to a projector will be described below with reference to the drawings. In addition, the Example shown below does not limit the content of the invention described in the claim at all. In addition, all of the configurations shown in the following embodiments are not necessarily essential as means for solving the problems described in the claims.

(First embodiment)
The projector according to the present embodiment has a function of generating distortion correction information by two methods, selecting distortion correction information according to the projection distance, and performing trapezoidal distortion correction using the selected distortion correction information. A functional block of the projector having such a function will be described.

  FIG. 1 is a functional block diagram of a projector 100 according to the first embodiment. The projector 100 includes an imaging unit 110 that captures a measurement image or the like and generates a captured image, an image input unit 120 that inputs image information (for example, RGB signals) from a PC (Personal Computer) or the like, and a projection distance. A projection distance information generation unit 130 that generates projection distance information to be shown, a determination unit 140 that determines whether the projection distance exceeds a reference value, a correction unit 150 that performs trapezoidal distortion correction, and the like, and a projection that projects an image The unit 190 is configured to be included.

  The correction unit 150 also includes a boundary line information generation unit 152 that generates boundary line information indicating the position of the outer frame of the screen, and a coordinate information generation unit 154 that generates coordinate information indicating the three-dimensional coordinates of a predetermined point on the screen. A projection angle information generation unit 155 that generates projection angle information indicating a projection angle, a first distortion correction information generation unit 157 that generates first distortion correction information, and a first distortion correction information that generates second distortion correction information. 2 distortion correction information generation unit 159 and a trapezoidal distortion correction unit 162 that performs trapezoidal distortion correction.

  The projector 100 may function as each of these units using the following hardware. For example, in the projector 100, the imaging unit 110 is a CCD camera, the image input unit 120 is an image signal input port, a converter, the projection distance information generation unit 130, the determination unit 140 is a CPU, the correction unit 150 is a CPU, and an image processing circuit. The projection unit 190 may use a lamp, a liquid crystal panel, a liquid crystal driving circuit, a projection lens, or the like.

The computer included in the projector 100 may function as the projection distance information generation unit 130 by reading a program stored in the information storage medium 200. As such an information storage medium 200, for example, a CD-ROM, DVD-ROM, ROM, RAM, HDD, or the like can be applied.

  Next, a trapezoidal distortion correction procedure using these units will be described. FIG. 2 is a flowchart showing the trapezoidal distortion correction procedure in the first embodiment.

  The imaging unit 110 captures a screen, which is a type of projection object, in a state where no image is projected or a black image is projected, and generates a first captured image (step S1). The boundary line information generation unit 152 generates boundary line information related to the coordinates of the screen boundary line based on the first captured image (step S2).

  Note that the screen may have, for example, a rectangular white area and a black area provided around the white area. In this case, the white area is an area where the projected image can be displayed, and the boundary between the white area and the black area corresponds to the boundary line. The coordinate information may be, for example, information indicating the coordinates of the end points of each boundary line, information indicating the coordinates of at least one point on each boundary line, and the inclination of each boundary line, and the like.

  The first distortion correction information generation unit 157 sets a correction target area indicating an image display area after the trapezoidal distortion correction in the image forming area of the liquid crystal panel based on the boundary line information, and sets 4 of the correction target area in the image forming area. First distortion correction information indicating corner coordinates is generated (step S3).

  More specifically, for example, the first distortion correction information generation unit 157, when the boundary line in the captured image is rectangular, that is, when the captured image includes four boundary lines, the captured image ( The correction target area is set by converting the coordinates of the end points of each boundary line in the imaging coordinate system) into coordinates in the projection coordinate system.

  Further, the first distortion correction information generation unit 157, when the captured image includes one or more and three or less boundary lines, the screen boundary lines in the projection coordinate system or the like with the principal point of the projection lens as the origin. By determining the infinity point with respect to, converting the coordinates of the infinity point to the vanishing point coordinates of the projection coordinate system, and complementing the straight line passing through the vanishing point as a missing side (insufficient boundary line), Set the correction target area.

  FIG. 3 is a schematic diagram showing vanishing points in the first embodiment. For example, in the example shown in FIG. 3, three sides (three boundary lines) of the upper side, the lower side, and the left side of the screen are detected. When three sides are detected, the first distortion correction information generation unit 157 determines the other vanishing point based on either the vertical or horizontal vanishing point.

  Specifically, for example, in the example shown in FIG. 3, the first distortion correction information generation unit 157 is a plane in which Z = 1 in a three-dimensional projection coordinate system having the principal point of the projection lens as the origin O. A virtual area 20 having the same shape and parallel to the image forming area of the liquid crystal panel is set, and the coordinate value of the horizontal vanishing point Hp at which the extended line on the upper side and the extended line on the lower side intersect is calculated.

  The vertical vanishing point Vp is on the extension line on the left side, and the angle formed by each vanishing point and the origin O is a right angle. Using this property, the first distortion correction information generation unit 157 calculates the coordinate value of the vertical vanishing point Vp where the extension line on the left side of the screen 10 and the extension line on the right side intersect.

  As described above, the first distortion correction information generation unit 157 can compensate for the missing side by calculating the coordinate value of each vanishing point when both the upper side and the lower side and the left side or the right side are detected. And a correction target area can be set.

  When both the left side and the right side and the upper side or the lower side are detected, the first distortion correction information generation unit 157 calculates the coordinate value of each vanishing point by performing the calculation by switching the vertical and horizontal directions by the above method. Can be compensated for and the correction target area can be set. When all four sides are detected, the first distortion correction information generation unit 157 can set the correction target area using the coordinates of the intersection of each side.

  The above is a case where three or more sides are detected, but the first distortion correction information generation unit 157 can set the correction target region even when the detection side is two sides or less. For example, it is assumed that the pitch angle indicating the projection angle is θ, the yaw angle is φ, and the roll angle is 0 degree. In this case, the two-dimensional coordinate value of the vertical vanishing point Vp is (0, −1 / tan θ). The two-dimensional coordinate value of the horizontal vanishing point Hp is (1 / (tan φ × cos θ), tan θ).

  For example, when only two sides of the upper side and the lower side are detected, the first distortion correction information generation unit 157 calculates the coordinate value of the horizontal vanishing point Hp by calculating the intersection of the extension lines of the upper side and the lower side. be able to. Further, in this case, the first distortion correction information generation unit 157 can obtain the pitch angle θ from the arithmetic expression (expression 2) of the coordinate value of the horizontal vanishing point Hp and the two-dimensional coordinate value of the horizontal vanishing point Hp. By substituting the pitch angle θ into the calculation formula (formula 1) of the two-dimensional coordinate value of the vertical vanishing point Vp, the two-dimensional coordinate value of the vertical vanishing point Vp can be obtained.

  In addition, for example, when only two sides of the upper side or the lower side and the left side or the right side are detected, the first distortion correction information generation unit 157 uses the coordinate values of either the left or right detection side and Expression 1 to perform vertical disappearance. The two-dimensional coordinate value of the point Vp and the pitch angle θ can be obtained. Further, in this case, the first distortion correction information generation unit 157 can obtain the two-dimensional coordinate value of the horizontal vanishing point Hp using the coordinate value of the detection edge on either the upper and lower sides, the pitch angle θ, and Equation 2.

  Further, for example, when only two sides of the left side and the right side are detected, the first distortion correction information generation unit 157 calculates the two-dimensional vertical vanishing point Vp by calculating the intersection of the extension lines of the left side and the right side. Coordinate values can be obtained. In this case, the two-dimensional coordinate value of the horizontal vanishing point Hp is an infinite point (∞, 0).

  As described above, the first distortion correction information generation unit 157 sets the correction target region using the coordinate value of each detection side and the coordinate value of each vanishing point even when the detection side is two sides. be able to.

  Further, for example, when only one of the upper side and the lower side is detected, the first distortion correction information generation unit 157 sets the two-dimensional coordinate value of the vertical vanishing point Vp as the infinity point (0, ∞) and the pitch. The two-dimensional coordinate value of the horizontal vanishing point Hp is determined using the coordinate value of the detection side and Equation 2 assuming that the angle θ = 0 degrees.

  For example, when only one side of the left side or the right side is detected, the first distortion correction information generation unit 157 uses the coordinate value of the detected side and the two-dimensional coordinate value of the vertical vanishing point Vp using Equation 1. The two-dimensional coordinate value of the horizontal vanishing point Hp is determined as the infinity point (∞, 0).

  As described above, the first distortion correction information generation unit 157 sets the correction target region using the coordinate value of each detection side and the coordinate value of each vanishing point even when the detection side is one side. be able to. Note that the projector 100 may project a message image for confirming the installation position or the like of the projector 100 when the captured image does not include a boundary line.

The trapezoidal distortion correction unit 162 generates a measurement image for measuring a plurality of reference points on the liquid crystal panel, and the projection unit 190 projects the measurement image on the screen 10. Further, the imaging unit 110 captures the measurement image projected on the screen 10 to generate a second captured image (step S4).

  FIG. 4 is a diagram illustrating an example of the measurement image 300 in the first embodiment. The measurement image 300 includes a pattern image having a shape in which four rectangles are arranged in two rows and two columns. That is, the pattern image is formed in a state in which three straight lines arranged in parallel in the vertical direction and at equal intervals and three straight lines arranged in parallel in the horizontal direction at equal intervals are orthogonal to each other. Nine intersections (reference points). In addition, this space | interval may be 200 pixels or more, for example, when a liquid crystal panel is 1024x768 pixels. As described above, the projector 100 can suppress interference with an adjacent line when measuring a luminance value or the like by keeping an interval between lines forming the pattern.

  Further, the straight line included in the pattern image has a gradation that is brightest at the center of the line and darkest at the outer edge of the line. For example, in the measurement image 300 shown in FIG. 4, a white region is provided at the center of the line, a light gray region is provided so as to sandwich the white region, and a dark region is provided so as to sandwich the light gray region. A gray area is provided.

  The width of each region may be 4 pixels or more, for example. Further, the background of the pattern image is a region (for example, a region of white, black, etc.) having a gradation different from the region of the outer edge portion of the pattern image (dark gray region in this embodiment). When the background of the pattern image has a darker gradation (for example, black) than the outer edge area of the pattern image, the measurement image 300 has four different gradations in total including the pattern image and the background. The measurement image 300 may have three different gradations including the pattern image and the background image as a whole, from the pattern image formed from the white region and the light gray region, and the dark gray region. It may be an image including a background image to be formed. In other words, the measurement image 300 includes a first region having a first gradation (white region) and a second region having a second gradation darker than the first gradation (dark gray region). ) And a third region (light gray) provided between the first region and the third region, which has a third gradation that is darker than the first gradation and brighter than the second gradation. The image may include an area).

  The coordinate information generation unit 154 generates coordinate information indicating the three-dimensional coordinates of the plurality of reference points based on the second captured image (step S5). More specifically, the coordinate information generation unit 154 performs a parabola approximation calculation, a center of gravity calculation, and the like using luminance information of the captured image, and the like, so that the white region that is the nine reference points included in the captured image Determine the coordinates of. Note that these coordinates are two-dimensional coordinates in the imaging region (imaging coordinate system) of the imaging unit 110.

  In addition, the coordinate information generation unit 154 performs an operation using an active active stereo method using the parallax between the projection lens of the projection unit 190 and the imaging lens of the imaging unit 110 on the two-dimensional coordinates, and performs the above operation on the screen. The three-dimensional coordinates of the reference point are determined, and coordinate information indicating the three-dimensional coordinates is generated. This three-dimensional coordinate is a three-dimensional coordinate in a projection coordinate system having the principal point of the projection lens as the origin.

  The projection distance information generation unit 130 generates projection distance information indicating the projection distance that is the distance from the projector 100 to the screen 10 based on the coordinate information (step S6).

  FIG. 5 is a schematic diagram showing vanishing points in the three-dimensional space in the first embodiment. For example, as shown in FIG. 5, an infinite point Hi exists on the extended line of the upper side of the screen 10 (the solid line portion in the screen 10 in FIG. 3). Further, an infinite point Vi exists on the extension line of the left side and the right side. There is also an infinite point Vi on an extension of a straight line perpendicular to the upper side.

Actually, the infinity point is located at infinity, but FIG. 5 schematically shows the infinity point for easy understanding. In this embodiment, a method of determining each vanishing point using the right infinity point Hi and the upper infinity point Vi is employed, but the left infinity point and the lower infinity point are employed. You may employ | adopt the system which determines each vanishing point using. Regardless of which method is used, the position of each vanishing point does not change. In practice, the liquid crystal panel is on the near side (−Z direction) with respect to the main point O of the projection lens. Are arranged parallel to the XY plane at Z = 1.

  For example, in FIG. 5, the distance DP from the principal point O of the projection lens to a predetermined point on the screen 10 (for example, the central reference point of the measurement image 300 projected on the screen 10) is the projection distance.

  The projection angle information generation unit 155 uses the at least three three-dimensional coordinates among the three reference points of the nine reference points to use the relative vertical and horizontal inclinations (projection) between the projection light and the screen 10. Projection angle information indicating (angle) is generated (step S7).

  The second distortion correction information generation unit 159 generates second distortion correction information indicating a correction target area in the liquid crystal panel based on the projection angle information and the boundary line information (step S8). More specifically, for example, when the captured image includes one to three boundary lines, the second distortion correction information generation unit 159 determines the vanishing point using the boundary line information and the projection angle information. Then, the second distortion correction information indicating the correction target region is generated by complementing the line segment on the straight line passing through the vanishing point as an insufficient boundary line.

  More specifically, the second distortion correction information generation unit 159 projects the infinity point shown in FIG. 5 onto the plane of the virtual region 20, thereby eliminating the vertical disappearance in the coordinate system (projection coordinate system) of the virtual region 20. The point Vp and the horizontal vanishing point Hp can be determined.

  FIG. 6 is a schematic diagram illustrating an example of a vanishing point in the coordinate system of the virtual region 20 in the first embodiment. FIG. 7 is a schematic diagram illustrating another example of the vanishing point in the coordinate system of the virtual region 20 in the first embodiment.

  For example, as shown in FIG. 6, when only one boundary line can be detected, the second distortion correction information generation unit 159 uses the projection angle information, the coordinates of the boundary line, and the coordinates of each vanishing point. Then, by compensating for the missing side by setting a straight line passing through each vanishing point, the coordinates of the four corners of the target area ABCD in the virtual area 20 are determined so as to satisfy a predetermined condition, and the correction target area in the liquid crystal panel is determined. Set.

  The target area ABCD is an area corresponding to the correction target area in the liquid crystal panel. The predetermined condition includes, for example, a condition that the corrected image satisfies a predetermined aspect ratio (for example, 4: 3, 16: 9), a condition that the liquid crystal panel is used to the maximum.

  For example, as shown in FIG. 7, when two or more boundary lines can be detected, the second distortion correction information generation unit 159 displays the projection angle information, the coordinates of each boundary line, and the vanishing points. Using the coordinates, the target area ABCD is determined by compensating for the missing side by setting a straight line passing through each vanishing point, and a correction target area in the liquid crystal panel is set.

  The determination unit 140 determines whether the projection distance exceeds the reference value based on the projection distance information (step S9). The reference value is 3 to 5 meters, for example, although it varies depending on the imaging conditions and the like.

  When the projection distance exceeds the reference value, the trapezoidal distortion correction unit 162 sets a correction target area on the liquid crystal panel based on the first distortion correction information, and generates an image in the correction target area, thereby correcting the keystone distortion. Is performed (step S10).

  On the other hand, when the projection distance does not exceed the reference value, the trapezoidal distortion correction unit 162 sets a correction target area on the liquid crystal panel based on the second distortion correction information, and generates an image in the correction target area. Trapezoidal distortion correction is performed (step S11).

  As described above, according to the present embodiment, since the projector 100 can perform the trapezoidal distortion correction by a method according to the projection distance, it can perform the correct keystone distortion correction regardless of the projection distance.

  In addition, according to the present embodiment, the projector 100 performs the trapezoidal distortion correction using the projection angle information and the boundary line information, so that the trapezoidal distortion can be obtained even when the inclination of the screen 10 is not perpendicular to the ground. Correction can be performed.

  In addition, according to the present embodiment, the projector 100 can project an image in which the trapezoidal distortion correction is performed on an area along the boundary line of the screen 10 by using the information on the boundary line of the screen 10.

  According to the present embodiment, the projector 100 determines the correction target area using only the two-dimensional coordinates of the virtual area 20 without using the three-dimensional coordinates when generating the first distortion correction information. When the second distortion correction information is generated, the correction target area can be determined using the three-dimensional coordinates and the two-dimensional coordinates of the virtual area 20.

(Second embodiment)
The method for generating distortion correction information is not limited to the first embodiment, and various modifications can be made. In the second embodiment, a method for generating distortion correction information different from the first embodiment will be described.

  FIG. 8 is a functional block diagram of the projector 101 in the second embodiment. In the correction unit 151 of the projector 101, the projection angle information generation unit 156 generates projection angle information using the boundary line information from the boundary line information generation unit 153, and the first distortion correction information generation unit 158 generates the projection angle information. Is different from the correction unit 150 of the projector 100 in that the first distortion correction information is generated using the second distortion correction information generation unit 160 and the second distortion correction information generation unit 160 generates the second distortion correction information without using the boundary line information. Yes. The projector 101 may also read the program from the information storage medium 201 and function as the first distortion correction information generation unit 158 or the like.

  Next, a trapezoidal distortion correction procedure in the projector 101 will be described. FIG. 9 is a flowchart showing a trapezoidal distortion correction procedure in the second embodiment. Steps S1 and S2 are the same as in the first embodiment.

  The projection angle information generation unit 156 generates first projection angle information indicating the projection angle based on the boundary line information from the boundary line information generation unit 153 (step S21). The first distortion correction information generation unit 158 generates first distortion correction information based on the first projection angle information (step S22).

More specifically, for example, the first distortion correction information generation unit 158 grasps the vertical projection angle and the horizontal projection angle based on the first projection angle information, and determines each projection angle and the correction target area. The first distortion correction information indicating the correction target area may be generated according to the projection angle by using data associated with the coordinates of.

  Steps S4 to S6 are the same as in the first embodiment. The projection angle information generation unit 156 generates second projection angle information indicating the projection angle based on the coordinate information from the coordinate information generation unit 154 (step S23). Note that the first projection angle information is information based on the boundary line of the screen 10, but the second projection angle information is information based on the three-dimensional coordinates of the reference point of the measurement image 300 on the screen 10. Both may be different.

  The second distortion correction information generation unit 160 generates second distortion correction information based on the second projection angle information by using, for example, the above-described data (step S24). Steps S9 to S11 are the same as in the first embodiment.

  As described above, according to this embodiment as well, the projector 101 has the same operational effects as those of the first embodiment.

(Other examples)
In addition, application of this invention is not limited to the Example mentioned above, A various deformation | transformation is possible. For example, in the above-described embodiment, the projectors 100 and 101 determine the projection distance after generating two types of distortion correction information. However, the distortion correction is performed according to the determination result after determining the projection distance. Information may be generated.

  Further, the reference value for selecting the trapezoidal distortion correction method may be determined according to the size of the screen 10 to be projected, for example. For example, the determination unit 140 may determine a reference value based on information indicating selection of the screen type by the user, data indicating the size of the screen, and the like, and perform the above-described determination using the reference value.

  Further, the projection target is not limited to the screen 10, and may be, for example, a blackboard, a white board, a wall, a pillar, a desk, or the like.

  Further, the measurement image 300 is not limited to the above-described embodiment. For example, the pattern image of the measurement image 300 may be an image in a state where each straight line protrudes from the outer peripheral line of the pattern image shown in FIG. 6 (for example, # or the like when the pattern image is a square).

  The pattern image described above has three gradations, but may have four or more gradations. Further, in the above-described pattern image, regions having the same gradation are arranged on both sides of the white region, but regions having different gradations may be arranged only on one side. For example, the pattern image may be a linear image having a dark gray area on the left, a light gray area on the center, and a white area on the right.

  In addition, the coordinate information generated by the coordinate information generation unit 154 is not limited to information indicating three-dimensional coordinates in the projection coordinate system, and may be information indicating three-dimensional coordinates in the imaging coordinate system, for example. That is, when the projection lens and the imaging lens are substantially at the same position, the projectors 100 and 101 may convert the two-dimensional coordinates in the imaging coordinate system into the three-dimensional coordinates in the imaging coordinate system as they are.

  Further, the projectors 100 and 101 generate the coordinate information of the screen boundary line by imaging in the non-projection state. If the measurement image is an image that can also detect the screen boundary line, You may generate | occur | produce the coordinate information of the boundary line of a screen based on the captured image of an image.

Further, the projection distance information generation unit 130 selects the projection value by the user when the measured value of the distance sensor, the adjustment value when driving the lens for focus adjustment during projection, and the image for selecting the projection distance are projected. The projection distance information may be generated in response to an input of a value indicating the projection distance by.

  Further, the projectors 100 and 101 are not limited to liquid crystal projectors (transmission type, reflection type such as LCOS), and may be, for example, projectors using DMD (Digital Micromirror Device). DMD is a trademark of Texas Instruments Incorporated. The functions of the projectors 100 and 101 may be distributed to a plurality of devices (for example, a PC and a projector, an external camera and a projector, etc.).

  10 screen, 20 virtual area, 100, 101 projector, 120 image input unit, 130 projection distance information generation unit, 140 determination unit, 150, 151 correction unit, 152, 153 boundary line information generation unit, 154 coordinate information generation unit, 155 156 Projection angle information generation unit, 157, 158 First distortion correction information generation unit, 159, 160 Second distortion correction information generation unit, 190 projection unit, 200, 201 Information storage medium, 300 Measurement image

Claims (13)

A projector,
An imaging unit that images a projection target to generate a first captured image, images a measurement image projected on the projection target, and generates a second captured image ;
A projection distance information generating unit that generates projection distance information indicating a projection distance that is a distance to the projection object;
A determination unit that determines whether the projection distance exceeds a reference value based on the projection distance information;
The have rows trapezoidal distortion correction based on the boundary line of the projection target included in the first captured image when the projection distance exceeds the reference value, the second when the projection distance does not exceed the reference value a correction unit intends row trapezoidal distortion correction based on the measurement image included in the captured image,
Including projector. The projector according to claim 1.
The correction unit includes a trapezoid based on a boundary line of the projection target included in the first captured image and the measurement image included in the second captured image when the projection distance does not exceed a reference value. Perform distortion correction,
projector. The projector according to any one of claims 1 and 2 ,
The projection distance information generation unit generates the projection distance information based on the second captured image.
projector. The projector according to any one of claims 1 to 3 ,
The correction unit is
And based on said first captured image, the first boundary line information generating unit for generating boundary information about the coordinates of the boundary line of the projection target included in the captured image,
A first distortion correction information generation unit that generates first distortion correction information for performing the trapezoidal distortion correction based on the boundary line information;
including,
projector. The projector according to claim 4 ,
The correction unit includes a trapezoidal distortion correction unit that performs trapezoidal distortion correction based on the first distortion correction information when the projection distance exceeds a reference value.
projector. In the projector in any one of Claims 1-5 ,
The correction unit is
A coordinate information generating unit that generates coordinate information indicating three-dimensional coordinates of a plurality of points of the projection target based on the second captured image;
The projection distance information generation unit generates the projection distance information based on the coordinate information.
projector. To computer which projector has,
Causing the imaging device to capture an image of the projection target to generate a first captured image;
Causing the imaging device to capture the measurement image projected on the projection object to generate a second captured image;
Generating projection distance information indicating a projection distance that is a distance to the projection object;
Based on the projection distance information, it is determined whether the projection distance exceeds a reference value,
When the projection distance exceeds a reference value, trapezoidal distortion correction based on the boundary line of the projection target included in the first captured image is performed, and when the projection distance does not exceed the reference value, the second program Ru to perform the trapezoidal distortion correction based on the measurement image included in the captured image. An information storage medium storing a program readable by a computer of a projector,
An information storage medium storing the program according to claim 7 . The projection target to generate a first captured image by the imaging in the imaging device,
Causing the imaging device to capture a measurement image projected on the projection object to generate a second captured image;
Generating projection distance information indicating a projection distance that is a distance to the projection object;
Based on the projection distance information, determine whether the projection distance exceeds a reference value,
The have rows trapezoidal distortion correction based on the boundary line of the projection target included in the first captured image when the projection distance exceeds the reference value, the second when the projection distance does not exceed the reference value cormorant row trapezoidal distortion correction based on the measurement image included in the captured image, the keystone distortion correction method for a projector. A projector,
An imaging unit that captures an image for measurement projected on a projection object and generates a captured image;
A projection distance information generating unit that generates projection distance information indicating a projection distance that is a distance to the projection object;
A determination unit that determines whether the projection distance exceeds a reference value based on the projection distance information;
When the projection distance exceeds a reference value, the keystone distortion correction based on the boundary line of the projection object included in the captured image is performed, and the measurement included in the captured image when the projection distance does not exceed the reference value A correction unit that performs trapezoidal distortion correction based on the image for use;
Including projector. To computer which projector has,
Have the imaging device capture the measurement image projected on the projection object and generate the captured image,
Generating projection distance information indicating a projection distance that is a distance to the projection object;
Based on the projection distance information, it is determined whether the projection distance exceeds a reference value,
When the projection distance exceeds a reference value, trapezoidal distortion correction based on the boundary line of the projection target included in the captured image is performed, and when the projection distance does not exceed the reference value, the trapped distortion is included in the captured image. A program that corrects keystone distortion based on measurement images. An information storage medium storing a program readable by a computer of a projector,
An information storage medium storing the program according to claim 11. The image for measurement projected on the projection object is captured by the imaging device to generate the captured image,
Generating projection distance information indicating a projection distance that is a distance to the projection object;
Based on the projection distance information, determine whether the projection distance exceeds a reference value,
When the projection distance exceeds a reference value, the keystone distortion correction based on the boundary line of the projection object included in the captured image is performed, and the measurement included in the captured image when the projection distance does not exceed the reference value A keystone distortion correction method for a projector that performs keystone distortion correction based on the image for use.

Images