JP2006267777A - Information processing device and method, picture display system and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform accurate correction without performing complicated model building. <P>SOLUTION: When a zoom ratio is minimum, an image 111 having a bright line projecting upward is included in a picked-up image 101 picked up by a camera for detecting distortion 62, and when the zoom ratio is maximum, an image 113 having a bright line projecting downward is included in a picked-up image 103 picked up by the camera for detecting distortion 62. When an image 112 having a bright line being an oblique straight line (or a curve as approximate to a straight line as possible) is included in the picked-up image 102 picked up by the camera for detecting distortion 62, the magnification of a projector 61 at this time is proper projection magnification suitable to perform correction processing. It is suitable to perform keystone correction after processing the picked-up image picked up by the camera for detecting distortion 62 by a correction processing device and setting the projector 61 to the proper projection magnification suitable to perform the correction processing. The invention is applied to the correction processing device and the picture display system. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an information processing device, an information processing method, an image display system, and a program, and in particular, an information processing device, an information processing method, an image display system, which are suitable for correcting geometric distortion of a projected image of a projector, In addition, it relates to the program.

  An image projected on a screen using a projector has a geometric distortion with respect to an image input to the projector. Among geometric distortions, keystone (also called keystone) is a trapezoidal distortion of the projected image that occurs when the projector cannot be placed in front of the screen, and it is a technology that corrects this keystone. (For example, Non-Patent Document 1).

Rahul Sukthankar, Robert G. Stockton, Matthew D. Mullin, ： Smarter Presentations: Exploiting Homography in Camera-Projector System, ： Proceedings of International Conference on Computer Vision, 2001

  For example, unlike the video display system using the projector shown in FIG. 1, an image is projected onto the screen 1 using the projector 1 without using a special image correction mechanism, and the projected image 11 is a projected image. Is captured using the camera 3 and the image supplied to the projector 1 is compared with the captured projection image 11. Here, it is assumed that the distortion of the lens of the camera 3 to be photographed is corrected and has no influence.

  FIG. 2A shows an image 21 input to the projector 1, and FIG. 2B shows a projected image 11 captured by the camera 3. A point representing an arbitrary pixel position of the image 21 input to the projector 1 is a point 1 (x, y), and a position corresponding to the point 1 (x, y) of the image 21 on the captured image 11 is a point 2 (u , V), the relationship can be generally modeled by the following equations (1) and (2).

u = (a ₁ x + a ₂ y + a ₃ ) / (a ₇ x + a ₈ y + 1) (1)
v = (a ₄ x + a ₅ y + a ₆ ) / (a ₇ x + a ₈ y + 1) (2)

Here, a ₁ , a ₂ , a ₃ , a ₄ , a ₅ , a ₆ , a ₇ , and a ₈ are predetermined coefficients. Then, for example, by obtaining a plurality of pairs of the position coordinates of the point on the input image and the position coordinates of the point on the camera image, the coefficients a ₁ , a ₂ , a ₃ , a ₄ , a ₅ , a ₆ , A ₇ and a ₈ are obtained, and correction processing can be performed.

  FIG. 3 is a schematic diagram of a plane xy having an angle π and a plane uv having an angle π ′ with respect to light rays from the projector. The model formulas of Formula (1) and Formula (2) are established based on the assumption that there is no nonlinear distortion in the projection of the projector 1 (in other words, a straight line is copied into a straight line). That is, only when there is no non-linear distortion in the projection of the projector 1, the models of the equations (1) and (2) hold. On the other hand, in cases where the assumption does not hold, accurate modeling cannot be performed.

  The projection lens of the projector 1 is generally provided with a mechanism (zoom mechanism) that can freely adjust the size of the projected image. However, since the projection image has nonlinear distortion depending on the magnification of the projection lens of the projector, the assumption that there is no nonlinear distortion in the projection of the projector 1 may not hold. For example, as shown in FIG. 4, an image 31 projected by the projector 1 when the magnification is the minimum is an image 32 projected by the projector 1 when the upper side of the projected image is convex upward and the magnification is the maximum. The upper side of the projected image may be distorted convexly downward. Such non-linear distortion gradually changes between upward and downward projections based on the magnification of the projected image.

  As described above, the distortion of the image projected by the projector 1 is asymmetrical because the center of the optical center of the projection lens of the projector and the projected image 41 is decentered as shown in FIG.

  As described above, when nonlinear distortion occurs in the image projected by the projector 1, the above-described method cannot be modeled with good accuracy. However, in the past, modeling with poor accuracy has been performed ignoring the influence of such distortion. Further, in order to increase the accuracy, for example, modeling has been performed in consideration of the distortion of the projection lens of the projector 1, but in such a case, the processing becomes complicated and the modeling is performed. It was difficult for users to handle.

  The present invention has been made in view of such a situation, and makes it possible to perform highly accurate correction without performing complicated modeling.

  The information processing apparatus according to the present invention includes a first image supply control unit that controls supply of a first image used for detecting projection distortion of the projector to the projector, and supply to the projector by the first image supply control unit. Is controlled, and a second image acquisition unit that acquires a second image obtained by capturing the first image displayed by the projector, and a second image that captures the first image acquired by the second image acquisition unit. And an appropriate projection magnification detecting means for detecting a projection magnification that does not cause projection distortion in the projector.

  In a state where the projection magnification of the projector is set to the appropriate projection magnification detected by the appropriate projection magnification detection means, it is possible to further include keystone correction processing means for executing keystone correction processing.

  In the appropriate projection magnification detection means, the portion corresponding to the horizontal straight line in the first image included in the second image acquired by the second image acquisition means is a straight line or a state close to a straight line. In this case, the projection magnification of the projector can be determined to be an appropriate magnification.

  The first image whose supply to the projector is controlled by the first image supply control means can be an image in which the upper side of the rectangle is a bright line and the luminance of other portions is a low value. .

  Projection magnification control means for controlling the projection magnification of the projector can be further provided. The appropriate projection magnification detection means can project the projector at a predetermined change amount from the minimum magnification to the maximum magnification by the projection magnification control means. The appropriate projection magnification can be detected based on the second image obtained by capturing the first image at each projection magnification acquired by the second image acquisition means when the magnification is changed.

  Projection magnification control means for controlling the projection magnification of the projector can be further provided. The keystone correction means includes a keystone correction process in a state where the projection magnification control means controls the projection magnification of the projector to an appropriate projection magnification. Can be executed.

  A user who uses the projector is further provided with auxiliary output control means for controlling the output of the sound or the image to assist the adjustment of the projector magnification to the appropriate projection magnification detected by the appropriate projection magnification detection means. be able to.

  The information processing method and the program according to the present invention include a first image supply control step for controlling supply of a first image used for detecting projection distortion of the projector to the projector, and processing of the first image supply control step. The supply to the projector is controlled, and the second image acquisition step for acquiring the second image captured so as to include the first image displayed by the projector and the second image acquisition step are acquired. And a proper projection magnification detecting step of detecting a projection magnification that does not cause projection distortion in the projector based on the second image including the first image.

  An image display system according to the present invention includes a projector that performs image display, an imaging device that captures an image projected on a screen by the projector to detect projection distortion, and information that performs processing for correcting image display by the projector. An image display system including a processing device, wherein the information processing device includes: a first image supply control unit that controls supply of a first image used to detect projection distortion of the projector to the projector; The first image supply control means controls the supply to the projector, and obtains a second image that is an image including the first image displayed on the screen by the projector and that is an image captured by the imaging device. And a second image obtained by capturing the first image acquired by the second image acquisition means and the second image acquisition means. Characterized in that it comprises a proper projection magnification detecting means for detecting a projection magnification projection distortion does not occur in.

  The imaging apparatus can be configured to capture the first image displayed on the screen by the projector from an angle other than a right angle with respect to the display surface of the screen. The device can acquire a second image captured from an angle other than a right angle with respect to the display surface of the screen.

  In the information processing apparatus, the information processing method, the image display system, and the program according to the present invention, the first image used for detecting the projection distortion of the projector is supplied to the projector and includes the first image displayed by the projector. In this way, the second image is picked up, and the picked-up second image is acquired. Based on the second image, a projection magnification at which no projection distortion occurs in the projector is detected.

  According to the present invention, a projection magnification that does not cause projection distortion in a projector is detected. In particular, by using the projection distortion detection image to detect the projection distortion of the projector, it is possible to perform highly accurate correction without performing complicated modeling.

  Embodiments of the present invention will be described below. Correspondences between constituent elements described in the claims and specific examples in the embodiments of the present invention are exemplified as follows. This description is to confirm that specific examples supporting the invention described in the claims are described in the embodiments of the invention. Accordingly, although there are specific examples that are described in the embodiment of the invention but are not described here as corresponding to the configuration requirements, the specific examples are not included in the configuration. It does not mean that it does not correspond to a requirement. On the contrary, even if a specific example is described here as corresponding to a configuration requirement, this means that the specific example does not correspond to a configuration requirement other than the configuration requirement. not.

  Further, this description does not mean that all the inventions corresponding to the specific examples described in the embodiments of the invention are described in the claims. In other words, this description is an invention corresponding to the specific example described in the embodiment of the invention, and the existence of an invention not described in the claims of this application, that is, in the future, a divisional application will be made. Nor does it deny the existence of an invention added by amendment.

  The information processing apparatus according to claim 1 (for example, the correction processing apparatus 63 in FIG. 11 or the correction processing apparatus 221 in FIG. 17) is configured to detect a first image (for example, FIG. The first image supply control means (for example, the projector output image control unit 153 in FIG. 11 or FIG. 17) for controlling the supply of the nine distortion detection images 91) and the first image supply control means Is controlled, and a second image acquisition unit (for example, a camera image acquisition unit for distortion detection 181 in FIG. 11 or 17) that acquires a second image obtained by capturing the first image displayed by the projector; Proper projection magnification for detecting a projection magnification at which no projection distortion occurs in the projector, based on the second image obtained by capturing the first image acquired by the second image acquisition means Detecting means (e.g., proper projection magnification detecting unit 251 of the appropriate projection magnification detecting unit 182 or 17 in FIG. 11), characterized in that it comprises a.

  A keystone correction processing unit (for example, the keystone correction processing unit 155 in FIG. 11 or FIG. 17) that performs keystone correction processing in a state where the projection magnification of the projector is set to the appropriate projection magnification detected by the appropriate projection magnification detection unit. be able to.

  The first image whose supply to the projector is controlled by the first image supply control means is an image in which the upper side of the rectangle is a bright line and the brightness of other parts is low (for example, distortion detection in FIG. 9). Image 91).

  Projection magnification control means (for example, the projector projection magnification control unit 183 in FIG. 11) for controlling the projection magnification of the projector can be further provided, and the appropriate projection magnification detection means is configured to change from the minimum magnification to the maximum magnification by the projection magnification control means. When the projection magnification of the projector is changed by a predetermined change amount, the appropriate projection magnification is detected based on the second image obtained by capturing the first image at each projection magnification acquired by the second image acquisition means. can do.

  Projection magnification control means (for example, the projector projection magnification control unit 183 in FIG. 11) for controlling the projection magnification of the projector can be further provided, and the keystone correction means sets the projection magnification of the projector to an appropriate projection magnification by the projection magnification control means. The keystone correction process can be executed in a controlled state.

  Auxiliary output control means (for example, detection in FIG. 17) that controls the output of audio or image to assist the user who uses the projector to adjust the magnification of the projector to the appropriate projection magnification detected by the appropriate projection magnification detection means. A result output control unit 252) may be further provided.

  An information processing method according to an eighth aspect is an information processing method of an information processing device (for example, the correction processing device 63 in FIG. 11 or the correction processing device 221 in FIG. 17) that executes processing for correcting image display by a projector. Then, a first image supply control step (for example, step S1 in FIG. 13) for controlling the supply of the first image (for example, the distortion detection image 91 in FIG. 9) used to detect the projection distortion of the projector to the projector. Alternatively, the second image captured so as to include the first image displayed by the projector is controlled by the processing of step S51 in FIG. 20 and the processing of the first image supply control step. A second image acquisition step to be acquired (for example, step S22 in FIG. 14, or step S73 or step S79 in FIG. 21); Based on the second image including the first image acquired by the processing of the second image acquisition step, an appropriate projection magnification detection step (for example, the step of FIG. 14) for detecting a projection magnification that does not cause projection distortion in the projector. S28 or the process of step S78 of FIG. 21).

  In the program according to claim 9, the embodiment (however, an example) to which each step corresponds is the same as the information processing method according to claim 8.

  The image display system according to claim 10 is a projector that performs image display (for example, projector 61 in FIG. 6 or FIG. 7 or projector 222 in FIG. 15 or FIG. 16) and an image projected on a screen by the projector. An image pickup apparatus (for example, the distortion detection camera 62 in FIG. 6, 7, 15 or 16) and an information processing apparatus (for example, FIG. 11, or the correction processing device 221 in FIG. 17, wherein the information processing device is a first image (for example, used for detecting projection distortion of the projector to the projector). , First image supply control means (for example, FIG. 11 or FIG. 17) for controlling supply of the distortion detection image 91 in FIG. The projector output image control unit 153) and the first image supply control means control the supply to the projector, and the image includes the first image displayed on the screen by the projector and is captured by the imaging device The second image acquisition unit (for example, the distortion detection camera captured image acquisition unit 181 in FIG. 11 or FIG. 17) and the first image acquired by the second image acquisition unit. 11 is used to detect a projection magnification that does not cause projection distortion in the projector (for example, an appropriate projection magnification detector 182 in FIG. 11 or an appropriate projection magnification detector 251 in FIG. 17). ).

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 6 is a system diagram of an image display system showing an embodiment of the present invention.

  The screen 51 displays an image projected by the projector 61.

  The projector 61 projects the supplied image on the screen 51. In FIG. 6, the image projected on the screen 51 by the projector 61 is observed from the other side across the screen 51 with respect to the projector 61 (the side on which a correction camera 64 described later in FIG. 6 is installed). It is possible (ie rear projection type). The projector 61 can change the projection magnification of the image based on the control of the correction processing device 63.

  The distortion detection camera 62 is a camera that images a distortion detection image, which will be described later, projected onto the screen 51 by the projector 61 in order to observe distortion of the projection lens of the projector 61. The distortion detection camera 62 corrects the captured image. 63.

  As illustrated in FIG. 6, the distortion detection camera 62 may be able to capture a projected image obliquely with respect to the screen 51 so that the distortion of the projection lens of the projector can be easily detected. The angle of the distortion detection camera 62 is shallow with respect to the screen 51 (the angle perpendicular to the screen 51 is 90 degrees and is close to 0 degrees), but the distortion of the projected image is easier to detect, but the angle is not so great. If it is too shallow, it is difficult to obtain and analyze the projection image. By doing so, it becomes easy to detect the distortion of the straight line of the captured image.

  The correction processing device 63 detects an appropriate projection magnification that does not cause nonlinear distortion in the projection image, based on the image obtained by the distortion detection camera 62 for observing the distortion of the projection lens of the projector 61. Then, based on the detected proper projection magnification, the projector 61 controls the change of the image projection magnification.

Further, the correction processing device 63 executes processing necessary for keystone correction of the projected image by the projector 61 based on the image supplied from the correction camera 64 that captures the image projected at the appropriate projection magnification. Specifically, as described with reference to FIG. 2, the correction processing device 63 obtains a plurality of pairs of position coordinates of a predetermined point on the input image and position coordinates of the point on the camera image. Then, the coefficients a ₁ , a ₂ , a ₃ , a ₄ , a ₅ , a ₆ , a ₇ , and a ₈ in the above equations (1) and (2) are obtained.

  The correction camera 64 is necessary for obtaining a plurality of pairs of position coordinates of a predetermined point on the input image and position coordinates on the camera image corresponding to the point as described with reference to FIG. An image is taken and supplied to the correction processing device 63.

  In FIG. 6, the projector 61 has been described as projecting an image from the back surface of the screen 51, but as shown in FIG. 7, the projector 61 projects an image from the front surface of the screen 51. Even if it is (ie, the case of the front projection type), the correction processing device 63 projects the projected image based on the image for observing the distortion of the projection lens of the projector 61 acquired by the distortion detection camera 62. Detects an appropriate projection magnification that does not cause nonlinear distortion, and controls the change of the image projection magnification by the projector 61 based on the detected appropriate projection magnification, and captures an image projected at the appropriate projection magnification. Executing processing necessary for keystone correction of the projected image by the projector 61 based on the image supplied from the correcting camera 64 It can be. At this time, the distortion detection camera 62 and the correction camera 64 are both installed in the same direction as the projector 61 with respect to the screen 51, that is, on the side where the image projected by the projector 61 is displayed.

  As described with reference to FIG. 4, the state of the projection distortion of the projector 61, in other words, the state of the upper side of the projection image is zoomed from the image 31 that becomes “upwardly convex” at the time of the minimum zoom, depending on the magnification. If the state changes to the state of the image 32 that is “downward convex” at the maximum time, there is a magnification between which the image 81 with the minimum projection distortion is displayed, as shown in FIG. .

  Therefore, in order to perform high-precision keystone correction without complicated modeling, a distortion detection image in which the distortion of the projection lens is easily observed is input to the projector 61, and the distortion detection displayed on the screen 51 is detected. The image is taken by the distortion detection camera 62, and the taken image is analyzed to obtain a magnification at which the image 81 with the minimum projection distortion described with reference to FIG. 8 is displayed. The projector 61 may be adjusted to the specified magnification. The distortion detection image projected from the projector 61 onto the screen 51 may be any image (for example, a projection area may include images or patterns of people or animals). As an image in which distortion of the lens is easily observed, an image including a straight line in the image is preferable. In particular, an image in which a horizontal straight line is included in the image, for example, a rectangular shape as shown in FIG. It is preferable that the distortion detection image 91 whose upper side is a bright line and the luminance of other portions is low is input to the projector 61 and projected onto the screen 51.

  The state of the projection distortion of the projector 61 changes depending on the magnification. Therefore, when the distortion detection image 91 whose upper side of the rectangle is a bright line as shown in FIG. 9 is input to the projector 61, as shown in FIG. The captured image 101 captured by the camera 62 includes an image 111 having an upwardly bright line. When the zoom ratio is maximum, the captured image 103 captured by the distortion detection camera 62 is convex downward. The image 113 having the bright line is included. When an image 112 having a bright line having an oblique straight line (or a curve as close as possible to a straight line) is included in the captured image 102 captured by the distortion detection camera 62, the magnification of the projector 61 at that time is This is an appropriate projection magnification suitable for performing the correction process.

  For example, when a distortion detection image includes a horizontal straight line, a portion corresponding to the horizontal straight line in the captured image captured by the distortion detection camera 62 is an oblique straight line (or a straight line). The magnification of the projector 61 when the curve becomes an infinitely close curve is an appropriate projection magnification suitable for performing the correction process. The horizontal straight line is preferably included above the image.

  FIG. 11 shows a configuration of a correction processing apparatus 63 that can determine the appropriate projection magnification of the projector 61 suitable for performing the keystone correction processing, adjust the magnification of the projector 61 based on the calculated projection magnification, and then execute the keystone correction. FIG.

  The operation input acquisition unit 151 acquires, for example, a user operation input input by an operation input device (not shown) such as a button, a keyboard, a mouse, or a remote commander, and supplies the acquired operation input to the overall control unit 152.

  The overall control unit 152 controls the projector output image control unit 153, the projection distortion correction control unit 154, and the keystone correction processing unit 155 based on the user's operation input supplied from the operation input acquisition unit 151.

  The projector output image control unit 153 includes a projector input image acquisition / generation unit 171, a distortion detection image generation / storage unit 172, and an image output control unit 173, and controls output of image data to the projector 61.

  Based on the control of the overall control unit 152, the projector input image acquisition / generation unit 171 acquires, for example, an image for keystone correction and image data displayed after the correction process from a personal computer (not shown) or the like. Alternatively, these images are generated and supplied to the image output control unit 173. The projector input image acquisition / generation unit 171 also supplies the keystone supplied to the projector 61 via the image output control unit 173 to the pixel pair extraction unit 192 when keystone correction is executed by a keystone correction processing unit 155 described later. Supply a correction image.

  The distortion detection image generation / storing unit 172 is based on the control of the overall control unit 152. For example, the distortion detection image generation / storage unit 172 can easily observe the distortion of the projection lens like the distortion detection image 91 described with reference to FIG. An image is generated, or such an image is supplied from a personal computer (not shown), stored, and supplied to the image output control unit 173.

  Based on the control of the overall control unit 152, the image output control unit 173 outputs the image data supplied from the projector input image acquisition / generation unit 171 or the distortion detection image generation / storage unit 172 to the projector 61 for projection. .

  The projection distortion correction control unit 154 includes a distortion detection camera captured image acquisition unit 181, an appropriate projection magnification detection unit 182, and a projector projection magnification control unit 183, and is based on an image captured by the distortion detection camera 62. The appropriate projection magnification suitable for performing the correction process is detected by image processing.

  For example, as described with reference to FIG. 10, the projection distortion correction control unit 154 detects the appropriate projection magnification suitable for performing the correction process on the captured image 101 captured by the distortion detection camera 62. Between the zoom rate minimum including the image 111 having the bright convex line on the upper side and the zoom rate maximum including the image 113 having the convex lower line on the captured image 103 captured by the distortion detection camera 62, An image captured by the distortion detection camera 62 is acquired by controlling the projection magnification of the projector 61 for each predetermined angle. Then, the projection distortion correction control unit 154 is a projector when the captured image 102 captured by the distortion detection camera 62 includes an image 112 having a straight line with an oblique bright line (or a curve close to a straight line). A magnification of 61, that is, an appropriate projection magnification suitable for performing correction processing is detected, and a projection magnification of the projector 61 is adjusted to an appropriate projection magnification suitable for performing correction processing.

  The distortion detection camera captured image acquisition unit 181 acquires an image captured by the distortion detection camera 62 and supplies the acquired image to the appropriate projection magnification detection unit 182.

  The appropriate projection magnification detection unit 182 obtains an appropriate projection magnification of the projector 61 by image processing. In order to obtain the proper projection magnification of the projector 61, the appropriate projection magnification detection unit 182 controls the projector projection magnification control unit 183, for example, and changes the projection magnification of the projector 61 from the minimum to the maximum state at predetermined angles. The pixel position corresponding to the bright line on the upper side is extracted from the distortion detection image from the images acquired for each angle, the set of extracted pixel positions is linearly approximated, and the approximated straight line and each pixel position are Can be used as a value for evaluating the degree of straight line (the smaller the calculated value, the closer to the appropriate projection magnification).

  The projector projection magnification control unit 183 controls the projection magnification of the projector 61 based on the control of the appropriate projection magnification detection unit 182 or the overall control unit 152. Specifically, the projector projection magnification control unit 183 controls the projection magnification of the projector 61 for each predetermined angle from the minimum to maximum projection magnification so that the appropriate projection magnification detection unit 182 detects the appropriate projection magnification. Or the keystone correction processing unit 155 controls the projection magnification of the projector 61 to the appropriate projection magnification detected by the appropriate projection magnification detection unit 182 before the keystone correction is performed. Furthermore, the projector projection magnification control unit 183 controls the projection magnification of the projector 61 according to the control of the overall control unit 152 based on the user operation input acquired by the operation input acquisition unit 151 after the correction processing is completed. It is also possible.

  Based on the control of the overall control unit 152, the keystone correction processing unit 155 performs keystone correction in a state where the projector 61 projects an image with an appropriate projection magnification.

  The correction camera captured image acquisition unit 191 acquires an image captured by the correction camera 64 and supplies the acquired image to the pixel pair extraction unit 192.

  The pixel pair extraction unit 192 receives the input image supplied to the projector supplied from the projector input image acquisition / generation unit 171 and the image supplied from the correction camera captured image acquisition unit 191 and performs keystone correction. Then, pairs of four or more pixels of the input image to the projector and pixels corresponding to these pixels of the captured image are extracted, and the extraction result is supplied to the coefficient calculation unit 193.

  Here, in order to perform the keystone correction process, four or more pairs of the position coordinates of the point on the input image and the position coordinates of the point on the camera image are necessary. The pixel pair extraction unit 192 may observe more pairs. In keystone correction, the observation error can be expected to decrease as more pairs are observed.

  For example, as shown in FIG. 12A, four corners (00), (W, 0) (0, H), and (W, H) of the image 21 input to the projector 61 are shown in FIG. 12B. Corresponding to the points (u1, v1) (u1, v2) (u3, v3) and (u4, v4) of the projected image 11 taken by the correction camera 64. Therefore, the pixel pair extraction unit 192 uses any one of the points (u1, v1) (u1, v2) (u3, v3) and (u4, v4) of the projection image 11 on the image captured by the correction camera 64. Observe the position.

  The pixel pair extraction method by the pixel pair extraction unit 192 includes, for example, supplying an image including the projection image 11 supplied from the correction camera captured image acquisition unit 191 to a computer (not shown) and displaying the image on a predetermined display. However, an application may be used in which the coordinate values of each point can be observed by selecting (clicking) the coordinate positions of the four corners using an input device such as a mouse. The pixel pair extraction unit 192 automatically performs image processing on the image including the projection image 11 supplied from the correction camera captured image acquisition unit 191, thereby automatically calculating the position coordinates of the four corners of the projection image 11. You may be able to do that.

  The coefficient calculation unit 193 obtains the coefficients of the above-described equations (1) and (2) based on the pixel pair extraction result supplied from the pixel pair extraction unit 192, and supplies the obtained coefficients to the coefficient output unit 194. Supply.

  The coefficient calculation unit 193 uses the pixel pair extraction result supplied from the pixel pair extraction unit 192, for example, to solve the simultaneous equations of the following equation (3), thereby obtaining the above-described equations (1) and (2 ) Coefficient.

・・・（３）

... (3)

  Equation (3) is generally solved by the method of least squares, but any method other than the method of least squares may be used as long as it is an appropriate method.

  The coefficient output control unit 194 supplies the coefficients of the expressions (1) and (2) calculated by the coefficient calculation unit 193 to the projector 61. The projector 61 performs keystone correction based on the supplied coefficient.

  Next, correction processing 1 executed by the correction processing device 63 described with reference to FIG. 11 will be described with reference to the flowchart of FIG.

  In step S <b> 1, the distortion detection image generation / storage unit 172 outputs the distortion detection image to the image output control unit 173. The image output control unit 173 supplies the supplied distortion detection image to the projector 61 and causes the screen 51 to display it.

  In step S2, a proper projection magnification detection process 1 described later using the flowchart of FIG. 14 is executed.

  In step S3, the projector projection magnification control unit 183 of the projection distortion correction control unit 154 controls the projection magnification of the projector 61 so that the appropriate projection magnification obtained in step S2 is obtained.

  In step S4, the projector input image acquisition / generation unit 171 outputs a correction image suitable for performing keystone correction to the image output control unit 173 and supplies it to the pixel pair extraction unit 192 of the keystone correction processing unit 155. To do. The image output control unit 173 supplies the supplied correction image to the projector 61 and causes the screen 51 to display it.

  In step S <b> 5, the correction camera captured image acquisition unit 191 of the keystone correction processing unit 155 acquires an image captured by the correction camera 64 and captured by the projector 61 on the screen 51. It supplies to the pair extraction part 192. The pixel pair extraction unit 192 is captured by the correction camera 64 supplied from the projector 61 and the image output to the projector 61 supplied from the projector input image acquisition / generation unit 171 and the correction camera captured image acquisition unit 191. A pair of corresponding pixels with the image is extracted and supplied to the coefficient calculation unit 193.

  In step S <b> 6, the coefficient calculation unit 193 uses the pixel pair extraction result supplied from the pixel pair extraction unit 192 to solve the simultaneous equations of Equation (3) described above using, for example, the least square method. Thus, the coefficients of the model expressions of the above-described expressions (1) and (2) are calculated and supplied to the coefficient output control unit 194.

  In step S7, the coefficient output control unit 194 outputs the coefficient calculated by the coefficient calculation unit 193 to the projector 61, and the process is ended. The projector 61 can perform keystone correction based on the supplied coefficient.

  By such processing, the correction processing device 63 can obtain an appropriate projection magnification of the projector 61 suitable for performing keystone correction processing. Further, in the correction processing device 63, after adjusting the magnification of the projector 61 based on the obtained appropriate projection magnification, a coefficient necessary for executing the keystone correction is obtained and supplied to the projector 61 to perform the keystone correction. It can be made to execute.

  Next, the appropriate projection magnification detection process 1 executed in step S2 of FIG. 13 will be described with reference to the flowchart of FIG.

  In step S21, the projector projection magnification control unit 183 of the projection distortion correction control unit 154 sets the projection magnification of the projector 61 to the minimum.

  In step S <b> 22, the distortion detection camera captured image acquisition unit 181 acquires a captured image of the distortion detection image captured by the distortion detection camera 62 and supplies the acquired image to the appropriate projection magnification detection unit 182.

  In step S23, the appropriate projection magnification detection unit 182 calculates an evaluation value of distortion of the supplied projection image. Specifically, the appropriate projection magnification detection unit 182 extracts, for example, a pixel position corresponding to the bright line on the upper side from the supplied projection image of the distortion detection image, linearly approximates the set of extracted pixel positions, The sum of errors between the approximated straight line and the individual pixel positions is obtained, and this value can be used as an evaluation value of distortion of the projected image (the smaller the calculated value, the closer to the appropriate projection magnification).

  In step S24, the appropriate projection magnification detection unit 182 acquires the current projection magnification of the projector 61 that is controlled by the projector projection magnification control unit 183.

  In step S25, the appropriate projection magnification detection unit 182 records the calculated evaluation value together with the magnification in a data storage area (not shown) inside.

  In step S <b> 26, the appropriate projection magnification detection unit 182 determines whether or not the current projection magnification of the projector 61 acquired in step S <b> 24 is the maximum magnification of the projector 61.

  If it is determined in step S26 that the current projection magnification of the projector 61 is not the maximum magnification of the projector 61, in step S27, the projector projection magnification control unit 183 increases the projection magnification of the projector 61 by a predetermined amount and performs processing. Returns to step S22, and the subsequent processing is repeated.

  When it is determined in step S26 that the current projection magnification of the projector 61 is the maximum magnification of the projector 61, in step S28, the appropriate projection magnification detection unit 182 uses the recorded evaluation values for the respective magnifications. Further, the magnification at which the projection distortion is minimized, that is, the appropriate projection magnification is detected, and the value of the appropriate projection magnification detected by the projector projection magnification control unit 183 is supplied, and the process returns to step S2 in FIG. Proceed to step S3.

  By such processing, a projection magnification that does not cause projection distortion can be obtained.

  In the above description, the correction processing device 63 has been described as being able to control the projection magnification of the projector 61. On the other hand, as shown in FIG. 15, when a correction processing apparatus 221 that cannot directly control the projection magnification of the projector 222 is used, that is, the user manually adjusts the projection magnification of the projector 222. If so, the correction processing device 221 provides audio to the user so that the user can easily adjust the display magnification of the projector 222 to such a magnification that an image with minimum projection distortion is displayed. Alternatively, it may be possible to perform operation assistance such as notification of a message by video.

  In FIG. 15, the projector 222 is illustrated as projecting an image from the back surface of the screen 51. However, as illustrated in FIG. 16, the projector 222 projects an image from the front surface of the screen 51. Even when the correction processing device 221 is configured, the correction processing device 221 allows the user to easily adjust the display magnification of the projector 222 to such a magnification that an image with minimum projection distortion is displayed. In addition, operation assistance such as notification of a message by voice or video can be performed. At this time, the distortion detection camera 62 and the correction camera 64 are both installed in the same direction as the projector 222 with respect to the screen 51, that is, on the side where the image projected by the projector 222 is displayed.

  FIG. 17 is a block diagram showing the configuration of the correction processing device 221. As shown in FIG.

  Note that portions corresponding to those in FIG. 11 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  That is, the correction processing device 221 is basically the same as the correction processing device 63 described with reference to FIG. 11 except that a projection distortion correction auxiliary control unit 241 is provided instead of the projection distortion correction control unit 154. It has a configuration. The projection distortion correction auxiliary control unit 241 includes the distortion detection camera captured image acquisition unit 181 described with reference to FIG. 11, and further includes an appropriate projection magnification detection unit 251 and a detection result output control unit 252.

  The appropriate projection magnification detection unit 251 performs image processing on the image captured by the distortion detection camera 62 supplied from the distortion detection camera captured image acquisition unit 181, and the current magnification of the projector 222 is corrected. It is detected whether or not it is an appropriate projection magnification suitable for performing or whether it is close to the appropriate projection magnification, and the detection result is supplied to the detection result output control unit 252.

  The detection result output control unit 252 easily adjusts the display magnification of the projector 222 to a magnification at which an image with minimum projection distortion is displayed based on the detection result supplied from the appropriate projection magnification detection unit 251. In order to be able to do so, the output of images, sounds, and the like, which are operation assistance for the user, is controlled.

  Specifically, the detection result output control unit 252 determines that the current magnification of the projector 222 is an appropriate projection magnification suitable for performing correction processing based on the detection result supplied by the appropriate projection magnification detection unit 251. If the projection magnification is close to the appropriate projection magnification, the user is notified from a speaker (not shown) that the current magnification of the projector 222 is an appropriate projection magnification suitable for performing the correction process or is close to the appropriate projection magnification. To control the sound output. In the audio output to notify the user, for example, “It is the right magnification”, “It is near the right magnification”, “Please lower the magnification to match the right magnification” or “Please increase the magnification to match the right magnification” , Etc., or an electronic sound or buzzer sound.

  In addition, the detection result output control unit 252 may, for example, as shown in FIG. 18 or FIG. 19 based on the detection result supplied by the appropriate projection magnification detection unit 251, for example, the current magnification and the appropriate magnification of the projector 222. So that the user can recognize whether the magnification of the projector 222 should be increased or decreased in order to match the magnification of the projector 222 with the appropriate magnification. Image data is generated, and display of the generated image data on a display (not shown) is controlled. Further, the detection result output control unit 252 supplies the generated image data to the image output control unit 173, and causes the projector 222 to display an image that assists the user in any position on the screen 51. You may be able to.

  Next, correction processing 2 executed by the correction processing device 221 described with reference to FIG. 17 will be described with reference to the flowchart of FIG.

  In step S <b> 51, the distortion detection image generation / storage unit 172 outputs the distortion detection image to the image output control unit 173. The image output control unit 173 supplies the supplied distortion detection image to the projector 222 and displays it on the screen 51.

  In step S52, an appropriate projection magnification detection process 2 described later using the flowchart of FIG. 21 is executed.

  In step S53, the detection result output control unit 252 of the projection distortion correction auxiliary control unit 241 assists the user in manually adjusting the projector so as to obtain the appropriate projection magnification obtained in step S52. Control the output.

  Specifically, the detection result output control unit 252 determines that the current magnification of the projector 222 is an appropriate projection magnification suitable for performing correction processing based on the detection result supplied by the appropriate projection magnification detection unit 251. If the projection magnification is close to the appropriate projection magnification, the user is notified from a speaker (not shown) that the current magnification of the projector 222 is an appropriate projection magnification suitable for performing the correction process or is close to the appropriate projection magnification. For example, the degree of coincidence between the current magnification and the appropriate magnification of the projector 222 and the current magnification and the appropriate magnification of the projector 222 as described with reference to FIG. The user can recognize whether the amount of deviation or the magnification of the projector 222 should be increased or decreased to match the appropriate magnification. It generates an image data, to a display (not shown), to control the display of the generated image data. Further, the detection result output control unit 252 supplies the generated image data to the image output control unit 173, and causes the projector 222 to display an image that assists the user in any position on the screen 51. You may be able to.

  In step S54, the overall control unit 152 determines whether or not the user has instructed to output an image for keystone correction based on the signal indicating the user's operation input supplied from the operation input acquiring unit 151. . If it is determined in step S54 that the output of the keystone correction image is not instructed, the process returns to step S52, and the subsequent processes are repeated.

  If it is determined in step S54 that the output of the correction image has been commanded, in steps S55 to S58, basically the same processing as in steps S4 to S7 in FIG. 13 is executed.

  That is, the projector input image acquisition / generation unit 171 supplies an image for keystone correction to the image output control unit 173 and the pixel pair extraction unit 192 of the keystone correction processing unit 155. The image output control unit 173 supplies the supplied correction image to the projector 222 and displays it on the screen 51. The correction camera captured image acquisition unit 191 of the keystone correction processing unit 155 acquires an image obtained by capturing the correction image projected on the projector 222 and supplies the acquired image to the pixel pair extraction unit 192. The pixel pair extraction unit 192 extracts a corresponding pixel pair between the image output to the projector 222 and the image captured by the correction camera 64 and supplies the extracted pixel pair to the coefficient calculation unit 193. The coefficient calculation unit 193 uses the pixel pair extraction result supplied from the pixel pair extraction unit 192 to solve the simultaneous equation of the above-described formula (3) by using, for example, the least square method. The coefficients of the model expressions of Expression (1) and Expression (2) are calculated and supplied to the coefficient output control unit 194. The coefficient output control unit 194 outputs the coefficient calculated by the coefficient calculation unit 193 to the projector 222, and the process ends. The projector 222 can perform keystone correction based on the supplied coefficient.

  By such processing, the correction processing device 221 obtains a candidate value for the appropriate projection magnification of the projector 222 suitable for performing the keystone correction processing, and the user can set the projection magnification of the projector 222 to an appropriate projection magnification. It is possible to control the output of video, audio, or the like that assists manual adjustment of the projector. Then, in the correction processing device 221, when the adjustment of the projection magnification by the user is completed and an output of an image for keystone correction is instructed, a coefficient necessary for executing the keystone correction is obtained and supplied to the projector 222. Thus, the keystone correction can be executed.

  Next, the appropriate projection magnification detection process 2 executed in step S52 of FIG. 20 will be described with reference to the flowchart of FIG.

  In step S71, the detection result output control unit 252 of the projection distortion correction auxiliary control unit 241 determines whether or not a candidate for a magnification that minimizes the projection distortion has been notified, that is, step S52 (described with reference to FIG. 20). The process of this flowchart is completed at least once, the process proceeds to step S53, and the output of video or audio, which assists the user to manually adjust the projector 222 so as to obtain an appropriate projection magnification, is controlled. Thereafter, in step S54, it is determined that the output of the keystone correction image is not instructed, and it is determined whether or not the second and subsequent steps S52 (the process of this flowchart) are being executed. .

  If it is determined in step S71 that the candidate for the magnification that minimizes the projection distortion has been notified, the process proceeds to step S79 described later.

  If it is determined in step S71 that the magnification candidate that minimizes the projection distortion has not been notified, that is, it is determined that the first step S52 (the process of this flowchart) is being executed. In this case, in step S72, the detection result output control unit 252 notifies the user using, for example, a voice message or an image so that the projection magnification of the projector 222 is set to the minimum.

  In step S <b> 73, the distortion detection camera captured image acquisition unit 181 acquires a captured image of the distortion detection image captured by the distortion detection camera 62 and supplies the acquired image to the appropriate projection magnification detection unit 251.

  In step S74, the appropriate projection magnification detection unit 251 calculates an evaluation value of distortion of the supplied projection image. Specifically, the appropriate projection magnification detection unit 251 extracts, for example, a pixel position corresponding to the bright line on the upper side from the supplied projection image of the distortion detection image, linearly approximates the set of extracted pixel positions, The sum of errors between the approximated straight line and the individual pixel positions is obtained, and this value can be used as an evaluation value of distortion of the projected image (the smaller the calculated value, the closer to the appropriate projection magnification).

  In step S75, the appropriate projection magnification detection unit 251 records the calculated evaluation value in an internal data storage area (not shown).

  In step S76, the appropriate projection magnification detection unit 251 matches the evaluation value calculated in step S73 with a predetermined condition necessary for detecting an evaluation value (magnification) candidate value that minimizes the projection distortion. Judge whether or not. Examples of the predetermined condition include a case where the evaluation value is equal to or less than a predetermined threshold, and a case where the change amount of the evaluation value changes from a decreasing tendency to an increasing tendency. Further, for example, in order to consider the influence of false detection caused by an image processing error, data noise, or the like, the predetermined condition is set when the evaluation value is equal to or lower than a predetermined threshold for a predetermined number of times or The change amount of the evaluation value may change from a decreasing trend that continues a predetermined number of times to an increasing trend that continues a predetermined number of times.

  If it is determined in step S76 that the predetermined condition is not met, in step S77, the appropriate projection magnification detection unit 251 is necessary to detect an evaluation value (magnification) candidate value that minimizes the projection distortion. Since the detection result output control unit 252 is notified that the predetermined condition is not met, the detection result output control unit 252 notifies the user that the projection magnification of the projector 222 is set higher by a predetermined amount. The processing returns to step S73, and the subsequent processing is repeated.

  If it is determined in step S76 that the predetermined condition is met, in step S78, the appropriate projection magnification detection unit 251 minimizes the projection distortion based on the recorded evaluation value of each magnification. A candidate for an evaluation value (that is, an evaluation value of projection distortion at an appropriate projection magnification) is detected and notified to the detection result output control unit 252, and the process returns to step S52 in FIG. 20 and proceeds to step S53.

  Specifically, the appropriate projection magnification detection unit 251 determines that the evaluation value is equal to or less than a predetermined threshold value, and therefore the amount of change in the evaluation value changes from a decreasing trend to an increasing trend. Therefore, when it is determined that the predetermined condition is satisfied, the current angle can be detected as the magnification at which the projection distortion is minimized. In addition, the appropriate projection magnification detection unit 251 considers erroneous detection due to an image processing error, data noise, or the like, when the evaluation value is equal to or less than a predetermined threshold for a predetermined number of times, When the amount of change changes from a decreasing trend that has continued for a predetermined number of times to an increasing trend that has continued for a predetermined number of times, it is determined that the predetermined condition is met. , Or a minimum value when the change amount of the evaluation value changes from a decreasing tendency that continues for a predetermined number of times to an increasing tendency that continues for a predetermined number of times can be detected as an evaluation value that minimizes the projection distortion. .

  When it is determined in step S71 that the candidate for the magnification that minimizes the projection distortion has been notified, the distortion detection camera captured image acquisition unit 181 detects the distortion detected by the distortion detection camera 62 in step S79. A captured image of the work image is acquired and supplied to the appropriate projection magnification detection unit 251.

  In step S80, the appropriate projection magnification detection unit 251 calculates an evaluation value of distortion of the supplied projection image.

  In step S81, the appropriate projection magnification detection unit 251 compares the evaluation value candidate that minimizes the projection distortion detected in step S78 with the evaluation value obtained in step S80, and detects the comparison result. The result output control unit 252 is supplied.

  In step S82, the detection result output control unit 252 is based on the comparison result between the evaluation value candidate with the minimum projection distortion supplied from the appropriate projection magnification detection unit 251 and the evaluation value obtained in the process of step S80. In addition, the output of the notification to the user is controlled, and the process returns to step S52 of FIG. 20 and proceeds to step S53.

  Specifically, the detection result output control unit 252 uses, for example, FIG. 18 based on the difference value between the evaluation value candidate that minimizes the projection distortion and the evaluation value obtained in the process of step S80. You may make it display the deviation | shift amount of the present magnification from the magnification which the projection distortion becomes the minimum as demonstrated. Also, red, blue, and yellow LEDs are prepared as output devices for detection results. When there is almost no deviation, a green lamp is used. When the deviation is less than a certain range, a yellow lamp is used. When the amount is larger than a predetermined value, each of the red lamps may be turned on.

  In addition, for example, the detection result output control unit 252 may decrease the evaluation value when the evaluation value is equal to or less than a predetermined threshold for a predetermined number of times or when the evaluation value change amount continues for a predetermined number of times. When it is determined that the predetermined condition is met when it changes to a continuous increasing trend from the predetermined number of times, the minimum value of the evaluation values below the predetermined threshold or the change of the evaluation value Since the minimum value when the amount changes from a decreasing trend that continues for a predetermined number of times to an increasing trend that continues for a predetermined number of times is the evaluation value that minimizes the projection distortion, Whether the magnification is large or small is detected, and the user can recognize whether the magnification should be increased or decreased in order to match the magnification of the projector 222 to the appropriate magnification as described with reference to FIG. Una display image data may be generated for.

  By such processing, it is possible to control the output of video or audio that assists the user to manually adjust the projector so as to obtain an appropriate projection magnification that does not cause projection distortion.

  As described above, by applying the present invention, it is possible to perform keystone correction at an appropriate projection magnification at which projection distortion does not occur, that is, at a projection magnification without nonlinear distortion in the projection of the projector. It is possible to perform highly accurate correction without performing the conversion.

  The series of processes described above can also be executed by software. The software is a computer in which the program constituting the software is incorporated in dedicated hardware, or various functions can be executed by installing various programs, for example, a general-purpose personal computer For example, it is installed from a recording medium. In this case, for example, all or part of the correction processing device 63 described with reference to FIG. 11 and the correction processing device 221 described with reference to FIG. 17 are configured by a personal computer 301 as shown in FIG.

  In FIG. 22, a CPU (Central Processing Unit) 311 performs various processes according to a program stored in a ROM (Read Only Memory) 312 or a program loaded from a storage unit 318 to a RAM (Random Access Memory) 313. Execute. The RAM 313 also appropriately stores data necessary for the CPU 311 to execute various processes.

  The CPU 311, ROM 312, and RAM 313 are connected to each other via a bus 314. An input / output interface 315 is also connected to the bus 314.

  The input / output interface 315 includes an input unit 316 including a keyboard and a mouse, an output unit 317 including a display and a speaker, a storage unit 318 including a hard disk, and a communication unit 319 including a modem and a terminal adapter. It is connected. The communication unit 319 performs communication processing via a network including the Internet.

  A drive 320 is connected to the input / output interface 315 as necessary, and a magnetic disk 331, an optical disk 332, a magneto-optical disk 333, a semiconductor memory 334, or the like is appropriately mounted, and a computer program read from them is loaded. Installed in the storage unit 318 as necessary.

  When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a network or a recording medium into a general-purpose personal computer or the like.

  As shown in FIG. 22, this recording medium is distributed to supply a program to a user separately from the apparatus main body, and includes a magnetic disk 331 (including a floppy disk) on which a program is stored, an optical disk 332 ( Package media including CD-ROM (compact disk-read only memory), DVD (including digital versatile disk), magneto-optical disk 333 (including MD (mini-disk) (trademark)), or semiconductor memory 334 In addition to being configured, it is configured by a ROM 312 in which a program is stored and a hard disk included in the storage unit 318, which is supplied to the user in a state of being incorporated in the apparatus main body in advance.

  Further, in the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but may be performed in parallel or It also includes processes that are executed individually.

  In the present specification, the term “system” represents the entire apparatus constituted by a plurality of apparatuses.

  Further, in this specification, even when a process executed by a part or all of a system constituted by a plurality of devices is realized by a smaller number of devices, or in this specification However, it goes without saying that the present invention is applicable even when processing executed by one device is realized by a plurality of devices.

It is a figure for demonstrating the video display system using a projector. It is a figure for demonstrating the image input into the projector, and the projection image image | photographed with the camera. It is a schematic diagram of a plane xy having an angle π and a plane uv having an angle π ′ with respect to light rays from the projector. It is a figure for demonstrating the nonlinear distortion of the image projected. It is a figure for demonstrating the eccentricity of the optical center of the projection lens of a projector, and the center of the image to project. 1 is a system diagram of an image display system (a rear projection type) showing an embodiment of the present invention. It is a system diagram of an image display system (front projection type) showing an embodiment of the present invention. It is a figure for demonstrating the relationship between zoom and distortion. It is a figure for demonstrating the image for distortion detection. It is a figure for demonstrating the relationship between zoom and the image for distortion detection imaged. It is a block diagram which shows the structure of the correction processing apparatus of FIG. 6 or FIG. It is a figure for demonstrating the pixel pair extracted. 6 is a flowchart for explaining correction processing 1; 5 is a flowchart for explaining proper projection magnification detection processing 1; It is a system diagram of an image display system (rear projection type) by a correction processing device that cannot directly control the projection magnification of a projector. It is a system diagram of an image display system (front projection type) by a correction processing device that cannot directly control the projection magnification of a projector. It is a block diagram which shows the structure of the correction processing apparatus of FIG. 15 or FIG. It is a figure for demonstrating the image provided with respect to a user. It is a figure for demonstrating the image provided with respect to a user. 10 is a flowchart for explaining correction processing 2; 5 is a flowchart for explaining proper projection magnification detection processing 2; It is a block diagram which shows the structure of a personal computer.

Explanation of symbols

  51 screen, 61 projector, 62 distortion detection camera, 63 correction processing device, 64 correction camera, 91 distortion detection image, 152 overall control unit, 153 projector output image control unit, 154 projection distortion correction control unit, 155 keystone correction Processing unit, 181 distortion detection camera captured image acquisition unit, 182 appropriate projection magnification detection unit, 183 projector projection magnification control unit, 221 correction processing device, 222 projector, 241 projection distortion correction auxiliary control unit, 251 appropriate projection magnification detection unit, 252 Detection result output control unit

Claims (11)

In an information processing apparatus that executes processing for correcting image display by a projector,
First image supply control means for controlling supply of a first image used for detection of projection distortion of the projector to the projector;
Supply to the projector is controlled by the first image supply control means, and second image acquisition means for acquiring a second image obtained by capturing the first image displayed by the projector;
Appropriate projection magnification detection means for detecting a projection magnification at which projection distortion does not occur in the projector based on the second image obtained by capturing the first image acquired by the second image acquisition means. An information processing apparatus characterized by the above. 2. The information according to claim 1, further comprising: a keystone correction processing unit configured to execute a keystone correction process in a state where the projection magnification of the projector is set to the appropriate projection magnification detected by the appropriate projection magnification detection unit. Processing equipment. The appropriate projection magnification detecting unit is configured such that a portion corresponding to a horizontal straight line in the first image included in the second image acquired by the second image acquiring unit is a straight line, or a straight line 2. The information processing apparatus according to claim 1, wherein when the projector is in a state close to, the projection magnification of the projector is determined to be an appropriate magnification. The first image whose supply to the projector is controlled by the first image supply control means is an image in which the upper side of the rectangle is a bright line and the luminance of other portions is a low value. The information processing apparatus according to claim 1. A projection magnification control means for controlling the projection magnification of the projector;
The proper projection magnification detection means is acquired by the second image acquisition means when the projection magnification control means changes the projection magnification of the projector by a predetermined change amount from the minimum magnification to the maximum magnification. The information processing apparatus according to claim 1, wherein the appropriate projection magnification is detected based on the second image obtained by capturing the first image at a projection magnification. A projection magnification control means for controlling the projection magnification of the projector;
The information processing apparatus according to claim 2, wherein the keystone correction unit performs keystone correction processing in a state where the projection magnification control unit controls the projection magnification of the projector to the appropriate projection magnification. Auxiliary output control means for controlling audio or image output to assist a user who uses the projector to adjust the magnification of the projector to the appropriate projection magnification detected by the appropriate projection magnification detection means The information processing apparatus according to claim 1. In an information processing method of an information processing apparatus that executes processing for correcting image display by a projector,
A first image supply control step for controlling supply of a first image used for detection of projection distortion of the projector to the projector;
Second image acquisition for acquiring a second image captured so as to include the first image displayed by the projector, the supply to the projector being controlled by the processing of the first image supply control step Steps,
An appropriate projection magnification detecting step for detecting a projection magnification at which no projection distortion occurs in the projector based on the second image including the first image acquired by the processing of the second image acquisition step. An information processing method characterized by the above. A program for causing a computer to execute processing for correcting image display by a projector,
A first image supply control step for controlling supply of a first image used for detection of projection distortion of the projector to the projector;
Second image acquisition for acquiring a second image captured so as to include the first image displayed by the projector, the supply to the projector being controlled by the processing of the first image supply control step Steps,
An appropriate projection magnification detecting step for detecting a projection magnification at which no projection distortion occurs in the projector based on the second image including the first image acquired by the processing of the second image acquisition step. A program for causing a computer to execute processing characterized by the above. A projector that performs image display;
An imaging device that captures an image projected on a screen by the projector for detection of projection distortion;
In an image display system configured by an information processing apparatus that executes processing for correcting image display by the projector,
The information processing apparatus includes:
First image supply control means for controlling supply of a first image used for detection of projection distortion of the projector to the projector;
Supply to the projector is controlled by the first image supply control means, and is an image including the first image displayed on the screen by the projector and is an image captured by the imaging device. Second image acquisition means for acquiring two images;
Appropriate projection magnification detection means for detecting a projection magnification at which projection distortion does not occur in the projector based on the second image obtained by capturing the first image acquired by the second image acquisition means. An image display system characterized by the above. The imaging device captures the first image displayed on the screen by the projector from an angle other than a right angle with respect to the display surface of the screen,
11. The image according to claim 10, wherein the second image acquisition unit acquires the second image captured from an angle other than a right angle with respect to a display surface of the screen by the imaging device. Display system.

Images