JP2006270461A - Image formation apparatus and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image formation apparatus capable of easily making various adjustments of a plurality of projectors at a low price. <P>SOLUTION: Respective cameras 15-a to 15-u photograph designated areas in an image formed on a screen 18 by at least one of projectors 11-1 to 11-12 from the back side of the screen 18 and provides a plurality of camera images obtained as the result to a controller 17 through a switcher 16. The controller 17 generates adjustment information needed to make various adjustments of the projectors 11-1 to 11-12 based upon the plurality of provided camera images and provides it to projector control sections 14-1 to 14-3. The present invention is applicable to an image forming apparatus comprising a plurality of projectors. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image forming apparatus and method, and more particularly to an image forming apparatus and method that can provide an image forming apparatus that can easily adjust various projectors at low cost.

  2. Description of the Related Art Conventionally, there is an image forming apparatus in which each of a plurality of projectors forms its own projector image on a screen, and as a result, one image composed of each of the projector images is formed on a screen or the like. To do.

  In order for the image forming apparatus to form an appropriate image on the screen, it is necessary to adjust the formation position of each projector image on the screen by each of the plurality of projectors. As conventional adjustment methods for performing such adjustment, there are the following first conventional adjustment method and second conventional adjustment method.

  The first conventional adjustment method is a method in which an adjuster (human) performs adjustment while actually viewing an image formed on a screen.

  The second conventional adjustment method is a method disclosed in Patent Documents 1 to 4, in which one camera located in front of the screen (on the same side as the observer viewing the image projected on the screen) This is a technique of taking an image formed on a screen and performing adjustment based on the image taken by the camera.

By the way, in recent years, for example, many requests for forming an image on a large screen having a width of about 50 m have begun to be mentioned.
JP 2001-339682 A JP 2004-332665 A JP 2004-208022 A JP 2004-228824 A

  However, when an image is formed on such a large screen, the projection distance of each of the plurality of projectors (the distance between the projector and the screen) becomes a long distance of about 50 m, for example. Thus, when the projection distance is long, the accuracy required for the adjustment of the projector becomes severe. As a result, simply applying the first conventional adjustment method and the second conventional adjustment method causes the following problems, respectively.

  That is, when the first conventional adjustment method is applied, the adjuster (human) must use binoculars to visually recognize the image formed on the screen. Therefore, the adjuster must make various adjustments of the projector while viewing the image with binoculars. These various adjustments themselves also require such difficult work that the quality (adjustment level) is determined by the skill level of the adjuster. Therefore, if the binoculars are used in addition to the originally difficult work, naturally, the various adjustments become much more difficult work. Even if these various adjustments can be made, it takes a long time to complete them. Such a problem occurs.

  In addition, when the second conventional adjustment method is applied, an image formed on the screen is photographed with one camera, and a wide angle of view and a wide angle of view are required in order to perform accurate adjustment based on the photographed image. Use of a high-resolution camera with high performance is essential. In this case, such a camera having a wide field angle and high resolution performance is expensive as much, and as a result, the cost of the entire image forming apparatus becomes very high.

  SUMMARY An advantage of some aspects of the invention is that an image forming apparatus that can easily perform various adjustments of a plurality of projectors can be provided at low cost.

  The image forming apparatus according to the present invention includes an image formed of a first partial image and a second partial image by superimposing a predetermined part of the first partial image and a predetermined part of the second partial image. Forming an image forming device on a first surface of an image forming target, wherein the first image forming unit and the second image forming device form a first partial image on the first surface of the image forming target Means, third image forming means and fourth image forming means for forming the second partial image on the first surface of the image forming target, and first image forming means to fourth image forming means. Each of the plurality of regions in the first partial image or the second partial image formed on the first surface of the image formation target by at least one of the first surface of the image formation target Taken from the side of the second surface facing the A plurality of photographing means for outputting the respective images, and a first portion by the first image forming means on the first surface of the image forming target based on the plurality of photographed images output from the plurality of photographing means. A first formation position of the image, a second formation position of the first partial image by the second image formation means, a third formation position of the second partial image by the third image formation means, and a fourth Adjustment information generating means for generating adjustment information for adjusting at least one of the fourth formation positions of the second partial image by the image forming means.

  The first partial image includes one or more feature points, the second partial image includes one or more feature points, and each of the plurality of photographing units photographs each of a plurality of regions including at least one feature point. Then, a plurality of captured images obtained as a result are output, and the adjustment information generating unit is provided by each of the first image forming unit to the fourth image forming unit included in at least one of the plurality of captured images. Adjustment information can be generated based on at least one of the formed feature points.

  The adjustment information generation unit is configured to determine the relative positional relationship between the feature points formed by each of the first image forming unit to the fourth image forming unit, which are included in at least one of the plurality of captured images. Based on this, adjustment information can be generated.

  The first partial image includes at least a first feature point, and the adjustment information generation unit includes a first feature point formed by the first image forming unit among a plurality of photographed images. At least a first captured image is obtained, and a shift amount between the coordinates of the first feature point and a preset first reference position is obtained in a coordinate system in the first captured image, and the shift amount is indicated. The information can be generated as first adjustment information for adjusting the first formation position.

  An adjusting means for adjusting the first formation position can be further provided based on the first adjustment information generated by the adjustment information generating means.

  The adjustment information generating unit further acquires a second captured image including the first feature point formed by the second image forming unit from among the plurality of captured images, and a coordinate system in the second captured image. In order to adjust the second formation position, the amount of deviation between the coordinates of the first feature point formed by the second image forming means and the first reference position is obtained, and information indicating the amount of deviation is adjusted. The adjustment unit may further adjust the second formation position based on the second adjustment information generated by the adjustment information generation unit.

  The first partial image further includes a second feature point in a predetermined part, and the second partial image corresponds to the arrangement position of the second feature point in the first partial image. The adjustment information generating means includes the first image forming means after the first forming position is adjusted by the adjusting means among the plurality of photographed images. A third captured image including the formed second feature point is further acquired, and the coordinates of the second feature point are acquired as the second reference position in the coordinate system in the third captured image. The fourth captured image including the third feature point formed by the image forming unit is further acquired, and the coordinates of the third feature point and the second reference position in the coordinate system in the fourth captured image are obtained. The amount of deviation is obtained, and information indicating the amount of deviation is obtained from the third information for adjusting the third formation position. Generated as integer data, adjustment means may further be adapted to adjust the third forming position based on the third adjustment information generated by the adjustment information generation means.

  The second partial image further includes a fourth feature point, and the adjustment information generation unit adjusts the third formation position after the third formation position is adjusted by the adjustment unit among the plurality of photographed images. A fifth captured image including the fourth feature point formed by the image forming unit is further acquired, and the fourth image formed by the third image forming unit in the coordinate system in the acquired fifth captured image. The coordinate of the feature point is acquired as the third reference position, and a sixth captured image including the fourth feature point formed by the fourth image forming unit is further acquired from the plurality of captured images. In the coordinate system in the sixth photographed image, a deviation amount between the coordinates of the fourth feature point formed by the fourth image forming unit and the third reference position is obtained, and information indicating the deviation amount is obtained. An adjustment hand is generated as fourth adjustment information for adjusting the fourth formation position. It may further be adapted to adjust the fourth forming position based on the fourth adjustment information generated by the adjustment information generation means.

  The image forming method of the present invention is the image forming method of the image forming apparatus of the present invention described above. In this image forming method, the first formation of the first partial image by the first image forming unit on the first surface of the image forming target is performed based on the plurality of captured images output from the plurality of imaging units. Position, the second formation position of the first partial image by the second image forming means, the third formation position of the second partial image by the third image forming means, and the second formation position by the fourth image forming means. And an adjustment information generation step of generating adjustment information for adjusting at least one of the fourth formation positions of the second partial image.

  In the image forming apparatus and method of the present invention, the first partial image and the second partial image are overlapped by superimposing a predetermined part of the first partial image and a predetermined part of the second partial image. Is formed on the first surface of the image formation target. Therefore, the image forming apparatus receives the first partial image forming means and the second image forming means for forming the first partial image on the first surface of the image forming target, and the second partial image. Image forming target by at least one of the third image forming unit and the fourth image forming unit formed on the first surface of the image forming target, and the first image forming unit through the fourth image forming unit. Each of the plurality of regions in the first partial image or the second partial image formed on the first surface is photographed from the second surface side facing the first surface to be imaged. And a plurality of photographing means for outputting a plurality of photographed images obtained as a result. Then, based on the plurality of captured images output from the plurality of imaging units, the first formation position of the first partial image by the first image forming unit on the first surface of the image formation target, the second The second formation position of the first partial image by the second image formation means, the third formation position of the second partial image by the third image formation means, and the second partial image by the fourth image formation means Adjustment information for adjusting at least one of the fourth formation positions is generated.

  As described above, according to the present invention, an image forming apparatus having a plurality of image forming units can be provided. In particular, an image forming apparatus that can easily adjust a plurality of image forming units can be provided at low cost.

  Embodiments of the present invention will be described below. Correspondences between constituent elements described in the claims and specific examples in the embodiments of the present invention are exemplified as follows. This description is to confirm that specific examples supporting the invention described in the claims are described in the embodiments of the invention. Therefore, even though there are specific examples that are described in the embodiment of the invention but are not described here as corresponding to the configuration requirements, the specific examples are not included in the configuration. It does not mean that it does not correspond to a requirement. On the contrary, even if a specific example is described here as corresponding to a configuration requirement, this means that the specific example does not correspond to a configuration requirement other than the configuration requirement. not.

  Further, this description does not mean that all the inventions corresponding to the specific examples described in the embodiments of the invention are described in the claims. In other words, this description is an invention corresponding to the specific example described in the embodiment of the invention, and the existence of an invention not described in the claims of this application, that is, in the future, a divisional application will be made. Nor does it deny the existence of an invention added by amendment.

According to the present invention, an image forming apparatus is provided. The image forming apparatus (for example, the image forming apparatus in FIG. 1)
A predetermined part (for example, the blending region 61 in FIG. 3) of the first partial image (for example, the Center partial image 52 in FIG. 3) and a predetermined part of the second partial image (for example, the Left partial image 51 in FIG. 3) ( For example, by superimposing the blending area 61) of FIG. 3, the first surface of the image formation target (for example, the screen 18 of FIG. 1) is formed from the first partial image and the second partial image. An image forming apparatus to be formed
First image forming means for forming the first partial image on the first surface of the image forming target (for example, a predetermined one of the projectors 11-5 to 11-8 in FIG. 1, here. , Projector 11-5) and second image forming means (for example, a predetermined one of the projectors 11-5 to 11-8 in FIG. 1, here referred to as projector 11-6), A third image forming unit for forming a second partial image on the first surface of the image formation target, for example, a predetermined one of the projectors 11-1 to 11-4 in FIG. Here, a projector 11-1) and a fourth image forming unit (for example, a predetermined one of the projectors 11-1 to 11-4 in FIG. 1; here, a projector 11-2);
The first partial image or the second portion formed on the first surface of the image formation target by at least one of the first image forming unit to the fourth image forming unit. A plurality of photographing means for photographing each of the plurality of regions in the image from the second surface side facing the first surface of the image forming target and outputting each of the plurality of photographed images obtained as a result (For example, the cameras 15-a to 15-o in FIG. 1);
A plurality of the photographed images output from the plurality of photographing means (for example, the camera images 91 and 92 in FIG. 5, the camera images 93, 94, and 95 in FIG. 6, and the camera images 111 to 115 in FIG. 9). Based on the first formation position of the first partial image by the first image forming unit and the first part by the second image forming unit on the first surface of the image formation target A second formation position of the image, a third formation position of the second partial image by the third image formation means, and a fourth formation of the second partial image by the fourth image formation means. And adjustment information generating means (for example, the controller 17 in FIG. 1) for generating adjustment information for adjusting at least one of the positions.

In this image forming apparatus,
The first partial image includes one or more feature points (for example, feature points g to o in FIG. 3), and the second partial image includes one or more feature points (for example, feature points a to i in FIG. 3). Including
Each of the plurality of imaging means images each of the plurality of regions including at least one feature point, and outputs a plurality of the captured images obtained as a result,
The adjustment information generating unit includes at least one of the feature points formed by each of the first image forming unit to the fourth image forming unit included in at least one of the plurality of captured images. The adjustment information may be generated based on one.

In this image forming apparatus,
The adjustment information generation unit includes a relative position of each of the feature points formed by each of the first image forming unit to the fourth image forming unit included in at least one of the plurality of captured images. The adjustment information can be generated on the basis of the actual positional relationship (for example, Δx1 and Δx2 in FIG. 5, θ in FIG. 6, and the shift amount in FIG. 10).

In this image forming apparatus,
The first partial image includes at least a first feature point (for example, a feature point k of the Center partial image 52 in FIG. 9),
The adjustment information generation unit includes a first photographed image including the first feature point formed by the first image forming unit among the plurality of photographed images (for example, after the process of step S1 in FIG. 8). At least the camera image 113 in FIG. 9 to be photographed is acquired and set in advance in the coordinate system in the first photographed image as the coordinates of the first feature point (for example, the coordinates of the point k ′ in FIG. 10). A shift amount (for example, the shift amount in FIG. 10) with respect to the first reference position (for example, the center (Cx, Cy) of the image in FIG. 10) is obtained, and information indicating the shift amount is used as the first formation position. Is generated as first adjustment information for adjusting (for example, the processing of steps S2 and S3 in FIG. 8 is executed).
Can be.

This image forming apparatus
Adjustment means for adjusting the first formation position based on the first adjustment information generated by the adjustment information generation means (for example, projector control units 14-1 and 14-2 in FIG. 1).
Can be further provided.

In this image forming apparatus,
The adjustment information generating means includes
Of the plurality of photographed images, a second photographed image including the first feature point formed by the second image forming means (for example, the projector 11-6 is subject to processing in the process of step S33 in FIG. 11). Further acquiring the camera image 113) of FIG. 9 taken after being selected as the projector,
In the coordinate system in the second photographed image, a deviation amount between the coordinates of the first feature point formed by the second image forming unit and the first reference position is obtained, and the deviation amount is obtained. The information shown is generated as second adjustment information for adjusting the second formation position (for example, the processes of steps S34 and S35 in FIG. 11 are executed)
The adjustment unit further adjusts the second formation position based on the second adjustment information generated by the adjustment information generation unit (for example, executes the process of step S36 in FIG. 11).
Can be.

In this image forming apparatus,
The first partial image further includes a second feature point (for example, a feature point h for the center image 52 in FIG. 9) in the predetermined part,
The second partial image includes a third feature point (for example, a feature point for the Left image 51 in FIG. 9) at a position corresponding to the arrangement position of the second feature point in the first partial image. h) at least,
The adjustment information generating means includes
Of the plurality of photographed images, a third photographed image (for example, including the second feature point formed by the first image forming means after the first formation position is adjusted by the adjusting means) The camera image 112 in FIG. 9 taken after it is determined as YES in step S3 in FIG. 8 is further acquired, and the coordinates of the second feature point are obtained in the coordinate system in the third photographed image. Obtained as the second reference position (for example, the reference position (CLx, CLy) in step S5 of FIG. 8) (for example, the process of step S5 of FIG. 8 is executed)
Further obtaining a fourth captured image including the third feature point formed by the third image forming means (for example, the camera image 112 of FIG. 9 captured after the process of step S6 of FIG. 8), In the coordinate system in the fourth photographed image, a deviation amount between the coordinates of the third feature point and the second reference position is obtained, and information indicating the deviation amount is adjusted to the third formation position. Is generated as the third adjustment information (for example, the processes of steps S7 and S8 in FIG. 8 are executed)
The adjustment unit further adjusts the third formation position based on the third adjustment information generated by the adjustment information generation unit (for example, executes the process of step S9 in FIG. 8).
Can be.

In this image forming apparatus,
The second partial image further includes a fourth feature point (for example, feature point e in FIG. 9),
The adjustment information generating means includes
Of the plurality of photographed images, a fifth photographed image (for example, including the fourth feature point formed by the third image forming means after the third formation position is adjusted by the adjusting means) The camera image 111) of FIG. 9 captured after the process of step S6 of FIG. 8 is further acquired, and the coordinate image in the acquired fifth captured image is formed by the third image forming unit. The coordinates of the fourth feature point are acquired as the third reference position (for example, the reference position (Lx, Ly) in step S10 in FIG. 8),
Among the plurality of photographed images, a sixth photographed image including the fourth feature point formed by the fourth image forming unit (for example, the projector 11-2 adjusts in the process of step S41 in FIG. 11). Further acquiring the camera image 111) of FIG. 9 taken after being selected as the target projector,
In the coordinate system in the sixth photographed image, a deviation amount between the coordinates of the fourth feature point formed by the fourth image forming unit and the third reference position is obtained, and the deviation amount is obtained. The information shown is generated as fourth adjustment information for adjusting the fourth formation position (for example, the processes of steps S42 and S43 in FIG. 11 are executed)
The adjustment unit further adjusts the fourth formation position based on the fourth adjustment information generated by the adjustment information generation unit (for example, executes the process of step S44 in FIG. 11).
Can be.

  According to the present invention, an image forming method corresponding to the image forming apparatus is also provided.

  Next, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows a configuration example of an image forming apparatus to which the present invention is applied.

  In the example of FIG. 1, the image forming apparatus 1 includes projectors 11-1 to 11-12, stack bases 12-1 to 12-12, stack base controllers 13-1 to 13-3, and projector control units 14-1 to 14-14. -3, cameras 15-a to 15-u, a switcher 16, a controller 17, and a screen 18.

  A tiling method and a stacking method are applied to the image forming apparatus 1. Therefore, hereinafter, a tiling method and a stacking method will be described.

  The tiling method refers to a method in which each of a plurality of projectors forms its own image on a screen or the like so as to superimpose a part of the image and a part of another adjacent image. Hereinafter, when the tiling technique is applied, an image formed on a screen or the like by each of a plurality of projectors is referred to as a partial image. That is, a plurality of partial images are formed on a screen or the like by a tiling method, and each of the plurality of partial images is overlapped with a predetermined portion, and as a result, one whole image (hereinafter referred to as a whole image) is formed. It will be formed on a screen or the like. Specifically, for example, in the present embodiment, an entire image 71 composed of three partial images 51 to 53 as shown in FIG. 3 to be described later is formed on the screen 18.

  Hereinafter, a portion where two partial images are overlapped by a tiling method, that is, the above-described part of each of the two partial images is referred to as a blending region. That is, the blending area is a so-called marginal part. Specifically, for example, in the present embodiment, as shown in FIG. 3 described later, a portion 61 where the partial image 51 and the partial image 52 are overlapped, and a partial image 52 and the partial image 53 are overlapped. The portion 62 becomes a blending region.

  In addition, the stacking method is a method in which each of a plurality of projectors forms the same image in the same region such as a screen and superimposes them.

  As described above, the tiling method is an effective method when the size of the entire image formed on the screen (particularly the size in the horizontal direction) is large. The stacking method is an effective method for increasing the brightness (luminance) of an image formed on a screen. For example, in the present embodiment, the screen 18 is a large-sized screen having a lateral width (horizontal length) of about 50 m. That is, the entire image formed on the screen 18 is also large. Therefore, in the present embodiment, the 15 projectors 11-1 to 11-15 use the stacking method and the styling method together so that a large overall image is kept on the screen 18 while maintaining its brightness. It is made to form.

  Specifically, in the present embodiment, for example, four projectors 11-1 to 11-4 are provided to form a partial image (for example, a partial image 51 in FIG. 3 described later) on the left side portion of the screen 18. Is provided. Hereinafter, the partial image formed on the left portion of the screen 18 is particularly referred to as a Left partial image. That is, when the stacking method is applied to the four projectors 11-1 to 11-4, each of the four projectors 11-1 to 11-4 displays almost each of its left partial images on the screen 18. Since it can be formed in the same region, as a result, it is possible to form one Left partial image on the screen 18.

  In this case, a brighter left partial image is formed on the screen 18 than the brightness of the left partial image formed by a predetermined one of the four projectors 11-1 to 11-4. . For example, in the present embodiment, the brightness of one projector 11-1 to 11-12 is set to 15,000 lumens. Then, by applying the stacking method to the four projectors 11-1 to 11-4, the Left partial image is formed on the screen 18 with the same brightness as when a 20,000 lumen projector is adopted. ing.

  The above is the other partial images described below, that is, the partial image formed in the central portion of the screen 18 (hereinafter referred to as the “Center partial image”) or the right portion of the screen 18. The same applies to partial images (hereinafter referred to as right partial images).

  That is, in the present embodiment, the left partial image is formed on the screen 18 by the four projectors 11-1 to 11-4 to which the stacking method is applied, and the four projectors 11-5 to 11 to which the stacking method is applied. The center partial image is formed on the screen 18 by 11-8, and the right partial image is formed on the screen 18 by the four projectors 11-9 to 11-12 to which the stacking method is applied.

  Further, since the tiling technique is applied in the present embodiment, these Left partial images (for example, the partial image 51 in FIG. 3 to be described later), Center partial images (for example, the partial image 52 in FIG. 3), and Right An entire image (for example, the entire image 71 in FIG. 3) composed of the partial images (for example, the partial image 53 in FIG. 3) is formed on the screen 18.

  Each of these projectors 11-1 to 11-12 is fixedly disposed on each of the stack bases 12-1 to 12-12.

  Among the stack bases 12-1 to 12-12, each of the stack bases 12-1 to 12-4 for fixingly arranging the left partial image projectors 11-1 to 11-4 has its pitch angle. The roll angle and the yaw angle are individually controlled by the stack base controller 13-1. In other words, the stack base controller 13-1 individually outputs control commands for controlling the pitch angle, roll angle, and yaw angle to each of the stack bases 12-1 to 12-4. That is, the stack table controller 13-1 individually controls the pitch angle, roll angle, and yaw angle of the stack tables 12-1 to 12-4, and as a result, the projectors 11-1 to 11- Each installation condition of 4 is changed individually.

  Similarly, each of the stack bases 12-5 to 12-8 for fixedly arranging the projectors 11-5 to 11-8 for the center partial image has a stacking pitch angle, roll angle, and yaw angle. It is individually controlled by the table controller 13-2. In other words, the stack base controller 13-2 individually outputs control commands for controlling the pitch angle, roll angle, and yaw angle to each of the stack bases 12-5 to 12-8. That is, the stack base controller 13-2 individually controls the pitch angle, roll angle, and yaw angle of each of the stack bases 12-5 to 12-8. As a result, the projectors 11-5 to 11- Each of the 8 installation conditions is changed individually.

  Further, each of the stack bases 12-9 to 12-12 for fixedly arranging the right partial image projectors 11-9 to 11-12 has a stack angle of the pitch angle, the roll angle, and the yaw angle. It is individually controlled by the controller 13-3. In other words, the stack base controller 13-3 individually outputs control commands for controlling the pitch angle, roll angle, and yaw angle to each of the stack bases 12-9 to 12-12. That is, the stack table controller 13-3 individually controls the pitch angle, roll angle, and yaw angle of the stack tables 12-9 to 12-12, and as a result, the projectors 11-9 to 11- Each of the 12 installation conditions is changed individually.

  The projector control unit 14-1 performs lens shift mechanism control, zoom mechanism control, projection control, and the like for each of the left partial image projectors 11-1 to 11-4. Similarly, the projector control unit 14-2 performs lens shift mechanism control, zoom mechanism control, projection control, and the like for each of the center partial image projectors 11-5 to 11-8. In addition, the projector control unit 14-3 performs lens shift mechanism control, zoom mechanism control, projection control, and the like for each of the right partial image projectors 11-9 to 11-12.

  The lens shift mechanism is a mechanism for moving (shifting) the direction of light (image) emitted from the projector. In other words, the lens shift mechanism is a mechanism that can move the formation position of the image on the screen 18 by the projector. Adjustment of the image formation position on the screen 18 using the lens shift mechanism in this way is hereinafter referred to as adjustment by the lens shift mechanism. That is, as the adjustment of the image forming position on the screen 18, there are the adjustment by the lens shift mechanism and the adjustment of the installation condition of the projector (the adjustment of the stack base).

  Further, each of the projector control units 14-1 to 14-3 can present the result of a projector installation adjustment process and a fine adjustment process, which will be described later, as necessary. Note that the processing results referred to here include not only final results but also intermediate results. For example, as an example of the fine adjustment process, there is a tiling adjustment process of FIG. 8 described later and a stacking adjustment process of FIG. The projector control unit 14-1 can also present the processing results of each step of these tiling adjustment processing and stacking adjustment processing (for example, the results of position detection of various feature points such as step S2).

  By the way, in the present embodiment, as described above, the four left partial images by the four projectors 11-1 to 11-4 are superimposed on the screen 18 by the stacking method, as if one left. A partial image is formed on the screen 18.

However, depending on the installation conditions of the four projectors 11-1 to 11-4 and the difference in adjustment by the lens shift mechanism, each of the four left partial images may be tilted or become an asymmetrical image. There is a case. When such four Left partial images are superimposed on the screen, as a result, a problem arises in that a Left partial image having a low resolution is formed on the screen 18. In addition, Left with poor resolution here
The partial image is, for example, an image in which a predetermined object is visually recognized by an observer as if it overlapped several times.

  Therefore, in order to prevent the occurrence of this problem (to solve the problem), each of the four projectors 11-1 to 11-4 displays its four left partial images on the screen 18. Therefore, it is necessary to appropriately adjust the installation conditions (arrangement positions) and the adjustment by the lens shift mechanism. Since the same problem also occurs in the other center partial image and right partial image, adjustment of installation conditions (arrangement position) of each of the other projectors 11-5 to 11-12 and adjustment by the lens shift mechanism Must be done appropriately.

  Furthermore, in the present embodiment, as described above, the entire image composed of the left partial image, the center partial image, and the right partial image is formed on the screen 18 by the tiling technique. In this case, each of the projectors 11-1 to 11-12, in addition to the adjustment required for the stacking method described above, further adjusts for the tiling method, that is, the Left partial image, the Center partial image, It is also necessary to adjust the blending regions of the right partial image and the right partial image almost accurately.

  As described above, as a conventional adjustment method for adjusting the projector installation conditions and the lens shift mechanism as described above, the adjuster (human) actually visually recognizes the entire image formed on the screen. The first conventional adjustment method of performing adjustment while one camera positioned in front of the screen captures the entire image formed on the screen and performs adjustment based on the captured image of the camera. There are two conventional adjustment methods.

  By the way, in order to form an image on the large-size screen 18 having a width of about 50 m as in the present embodiment, the respective projection distances of the projectors 11-1 to 11-12 (distances between the screens 18). ) Becomes a long distance of about 50 m. Thus, when the projection distance is long, the accuracy required for adjustment of the installation conditions of the projector and adjustment by the lens shift mechanism becomes severe. As a result, simply applying the first conventional adjustment method and the second conventional adjustment method causes the above-mentioned problems in [Problems to be solved by the invention].

  Therefore, in the present embodiment, in order to solve all of these problems, as shown in FIG. 1, a surface facing a projection surface (hereinafter also referred to as a surface) on which the entire image of the screen 18 is formed. Twenty-one cameras 15-a to 15-u are installed on the side (hereinafter referred to as the back side).

  Hereinafter, a method for installing the cameras 15-a to 15-u will be described with reference to FIGS.

  FIG. 2 shows an example of one partial image 41 formed on the screen 18 by a predetermined one of the projectors 11-1 to 11-12.

  This partial image 41 is an image (hereinafter referred to as “adjustment image”) that is used for adjusting the installation conditions of the projector on which the partial image 41 is formed and the adjustment by the lens shift mechanism. In this case, for example, feature points A to I shown in FIG. 2 exist as positions (hereinafter referred to as feature points) where the adjustment image tilt, vertical and horizontal asymmetry can be detected, and the like. The adjustment image 41 includes three lines X1 to X3 parallel to the horizontal direction (width direction) so that the feature points A to I can be visually recognized (so that it can be photographed with a camera), and , Three lines Y1 to Y3 parallel to the vertical direction are included. That is, a predetermined one of the lines X1 to X3 and a predetermined one of the lines Y1 to Y3 are one of the feature points A to I. For example, the intersection point E of the line X2 that is the horizontal center line of the adjustment image 41 and the line Y2 that is the vertical center line of the adjustment image 41, that is, the center point E of the adjustment image 41 is a feature point. It becomes one of.

  When such an adjustment image 41 is formed on the screen 18 as each of the left partial image, the center partial image, and the right partial image, predetermined ones of the feature points A to I of the adjustment image 41 Each of the cameras 15-a to 15-u is arranged so that one point can be detected.

  The following two points should be noted here.

  That is, the first point is that each of the cameras 15-a to 15-u is arranged such that a predetermined one of the feature points A to I of the adjustment image 41 is a predetermined position within the angle of view. However, it is not necessary to be performed with strict accuracy, and it is sufficient that the one feature point is performed with accuracy (rough accuracy) that can be entered at an arbitrary position within the angle of view. That is, the installer (human) who installs the cameras 15-a to 15-u can easily perform the installation.

  In other words, the installer forms each of the cameras 15-a to 15-u with their coordinates on the angle of view (hereinafter also referred to as coordinates on the camera) and a projector such as the adjustment image 41. It is very difficult to install so as to keep the correspondence relationship with the image (hereinafter referred to as projector image) the same. Therefore, as will be described in detail later, a coefficient capable of converting the coordinates on the camera into a 1-dot unit of the projector image is recorded in the setting storage memory 24 of the controller 17 in FIG. Using the coefficients, unit conversion (coordinate conversion) of images taken by the cameras 15-a to 15-u is performed to correct for variations in the installation conditions of the cameras 15-a to 15-u. I have to. For this reason, the installation accuracy of each of the cameras 15-a to 15-u is sufficient (rough accuracy) to such an extent that a predetermined one feature point enters any location within the angle of view. As a result, the installer can easily install each of the cameras 15-a to 15-u.

  The second point to be noticed is that the cameras 15-a to 15-u need only be able to photograph one feature point, so that the camera 15-a to 15-u can be installed close to the screen 18, and as a result, the angle of view and resolution can be reduced. An inexpensive camera that does not have high performance is sufficient.

  Further, in the present embodiment, a tiling technique is applied. Therefore, in the present embodiment, the entire image 71 as shown in FIG. 3 is formed on the screen 18 as the adjustment image.

  That is, the projectors 11-1 to 11-4 to which the stacking method is applied form the left partial image 51 on the screen 18 as an adjustment image. The projectors 11-5 to 11-8 to which the stacking technique is applied cause the center partial image 52 to be formed on the screen 18 as an adjustment image. The projectors 11-9 to 11-12 to which the stacking method is applied cause the right partial image 53 to be formed on the screen 18 as an adjustment image. As a result, an entire image 71 having blending areas 61 and 62 is formed on the screen 18 as an adjustment image.

  However, when the tiling adjustment process of FIG. 8 and the stacking adjustment process of FIG. 11 to be described later are actually executed, the entire image 71 may be formed on the screen 18 as an adjustment image. May be formed on the screen 18 (an image composed of one or two of the left partial image 51 to the right partial image 53).

  Incidentally, the left partial image 51 is provided with nine feature points a to i, and among these, the right three feature points g to i, that is, the three features provided in the blending region 61. Points g to i also serve as feature points on the left side of the adjacent center partial image 52. In other words, the center partial image 52 is provided with nine feature points g to o. Of these, the left three feature points g to i, that is, three feature points provided in the blending region 61 are provided. The feature points g to i also serve as feature points on the right side of the adjacent left partial image 51.

  Similarly, the center partial image 52 is provided with nine feature points g to o. Of these, three feature points m to o on the right side, that is, three feature points provided in the blending area 62 are provided. The feature points m to o also serve as feature points on the left side of the adjacent right partial image 53. In other words, nine feature points m to u are provided in the right partial image 53, and among these, three feature points m to o on the left side, that is, three feature points provided in the blending region 62 are provided. The feature points m to o also serve as feature points on the right side of the adjacent center partial image 52.

  As described above, the entire image 71 includes three partial images, that is, the left partial image 51 to the right partial image 53, and each of the three partial images has nine feature points. Therefore, 27 feature points (= 9 × 3) are necessary for the entire image 71 as a whole. However, in the present embodiment, feature points are provided in the blending region, so that the entire image 71 requires only 21 feature points a to u. That is, 27 cameras are originally required as the camera for photographing the feature points. In the present embodiment, since the feature points are provided in the blending area, 21 cameras 15-a to 15-d are used. It will be over.

  In other words, when the whole image is composed of N partial images having nine feature points as shown in FIG. 2, 9 × N feature points are originally included in the whole image. I need it. On the other hand, as in the present embodiment, by sharing the three feature points in the blending area of each partial image with others, the number of feature points required for the entire image is 9 × N−3 ×. (N-1) pieces. That is, the number of cameras that capture feature points can be reduced by 3 × (N−1). Thus, the reduction in the number of cameras ultimately leads to a reduction in the manufacturing cost of the entire image forming apparatus.

  When the screen 18 is constituted by a sound screen or the like, as shown in FIG. 4, the light (image) 81 emitted from the projectors 11-1 to 11-14 passes through the screen 18 and its back surface. Will reach the side. In such a case, as shown in FIG. 4, the camera 15 -K (K is any alphabet among a to u) may be installed by being shifted from the axis of the light 81 (optical axis).

  The method for installing the cameras 15-a to 15-u has been described above with reference to FIGS.

  Returning to FIG. 1, 21 images captured by each of the 21 cameras 15-a to 15-u (hereinafter referred to as camera images in order to distinguish them from projector images formed on the screen 18), 21 camera images each including one feature point a to u in FIG. 3 are supplied to the switcher 16.

  The switcher 16 is one or more cameras designated by a selection command from the control unit 21 of the controller 17 out of 21 camera images supplied from each of the 21 cameras 15-a to 15-u. The image is supplied to the image processing unit 22 of the controller 17.

  The controller 17 controls the operation of the entire image forming apparatus. For example, the controller 17 executes various processes necessary for adjusting the installation conditions of the projectors 11-1 to 11-12 and adjusting the lens shift mechanism. An example of such various types of processing will be described later with reference to FIGS.

  In order to realize such various processes, the controller 17 is provided with a control unit 21, an image processing unit 22, a calculation unit 23, and a setting storage memory 24. The details of the control unit 21, the image processing unit 22, the calculation unit 23, and the setting storage memory 24 will be described together with the description of various processes to be described later with reference to FIGS.

  As described above, several partial images (for example, the left partial image 51 to the right partial image 53 in FIG. 3 described above) are formed on the screen 18 by the projectors 11-1 to 11-12, respectively. As a result, a whole image (for example, the whole image 71 in FIG. 3 described above) composed of these several partial images is formed.

  Instead of the screen 18, other objects capable of forming images by the projectors 11-1 to 11-12 (hereinafter referred to as “image forming objects”) may be employed. In other words, the screen 18 is not essential as a component of the image forming apparatus. For example, each of the projectors 11-1 to 11-12 directly forms an image on a white wall or the like using a white wall or the like as an image formation target, so that the screen 18 can be omitted. However, it is assumed that the white wall is a wall that transmits light, and the camera 15-a to 15-c can capture a camera image from behind the wall.

  Next, of the processing (operation) of the image forming apparatus having the configuration shown in FIG. 1, the processing necessary for adjusting the installation conditions of the projectors 11-1 to 11-12 and the adjustment by the lens shift mechanism is performed. An example will be described.

  The processing necessary to adjust the installation conditions of the projectors 11-1 to 11-12 and the adjustment by the lens shift mechanism is performed when the projectors 11-1 to 11-12 themselves are first installed. And the second processing performed for the purpose of fine adjustment before the actual image (image other than the adjustment image) is formed on the screen 18 after the installation. Hereinafter, the former first process is referred to as a projector installation adjustment process, and the latter second process is referred to as a fine adjustment process.

  That is, according to the adjustment processing at the time of projector installation that is executed first, the adjustment of the installation conditions of each of the projectors 11-1 to 11-12 and the adjustment by the lens shift mechanism are appropriately performed. Ideally, Subsequent fine adjustment processing should be unnecessary. However, in reality, fine adjustment processing is required depending on the accuracy of the origin of each scanner of the projectors 11-1 to 11-12, the change in temperature, and the like.

  Hereinafter, an example of the adjustment process at the time of projector installation will be described first with reference to FIGS. 5 and 6, and then an example of the fine adjustment process will be described with reference to FIGS. 7 to 11.

  Before the projector installation adjustment process, the installers of the projectors 11-1 to 11-12 select a predetermined one of the projectors 11-1 to 11-4 (here, the projectors) for forming the left partial image. 11-1) is determined as the reference projector. Then, the installer sufficiently performs the installation of the reference projector 11-1, the adjustment of the installation conditions, and the adjustment by the lens shift mechanism using a level or a laser surveying instrument.

  Next, the installer determines a predetermined one of the projectors 11-2 to 11-4 as an adjustment target. For example, it is assumed that the projector 11-2 is determined as an adjustment target.

  Next, as shown in FIG. 5, each of the reference projector 11-1 and the projector 11-2 to be adjusted forms a partial image 41 identical to that in FIG. 2 described above on the screen 18. Hereinafter, the partial image 41 formed on the screen 18 by the reference projector 11-1 is particularly referred to as a reference partial image 41-1. On the other hand, the partial image formed on the screen 18 by the projector 11-K to be adjusted (K in the example of FIG. 1 is any value from 2 to 4 and in this case K = 2). 41 is specifically referred to as a measurement partial image 41-2. That is, the partial image 41 is obtained as a result of superimposing the reference partial image 41-1 and the measured partial image 41-2.

  At this time, each of the cameras 15-a to 15-i is shown in FIG. 5 in the partial image 41 formed on the screen 18 as a result of superimposing the reference partial image 41-1 and the measurement partial image 41-2. Each of the areas 41-A to 41-I is photographed.

  In this case, when the control unit 21 of the controller 17 outputs a selection command for selecting the camera image of the camera 15-a to the switcher 16, the switcher 16 provides, for example, the camera image 91 of FIG. 5 to the image processing unit 22.

  In other words, the camera image 91 is an example of an image obtained as a result of shooting the area 41-A by the camera 15-a. In this camera image 91, a circle image 91-1 is an image indicating the feature point A in the reference partial image 41-1 formed on the screen 18 by the reference projector 11-1. Hereinafter, the circled image 91-1 is referred to as a reference image 91-1. On the other hand, the square mark image 91-2 is an image indicating the feature point A in the measurement partial image 41-2 formed on the screen 18 by the projector 11-2 to be adjusted. Hereinafter, the square mark image 91-2 is referred to as a measurement image 91-2.

  For other camera images to be described later, the circled images are images indicating corresponding feature points in the reference partial image formed on the screen 18 by the reference projector. Hereinafter, such a circle image is also referred to as a reference image. On the other hand, the square mark image is an image indicating a corresponding feature point in the measurement partial image formed on the screen 18 by the projector to be adjusted. Hereinafter, such a square mark image is also referred to as a measurement image.

  Since adjustment of the projector 11-2 to be adjusted, adjustment of its installation conditions, and adjustment by the lens shift mechanism are not performed, generally, the reference partial image 41-1 and the measurement partial image 41-2 are identical. Often not. Therefore, in the camera image 91 of FIG. 5, as shown in the figure, the reference image 91-1 and the measurement image 91-2 often do not match.

  Similarly, when the control unit 21 of the controller 17 outputs a selection command for selecting the camera image of the camera 15-d to the switcher 16, the switcher 16 provides the image processing unit 22 with, for example, the camera image 92 of FIG.

  In other words, the camera image 92 is an example of an image obtained as a result of shooting the area 41-D by the camera 15-d. Also in this case, in the camera image 92 of FIG. 5, the reference image 92-1 and the measurement image 92-2 often do not match.

  Therefore, the image processing unit 22 detects the coordinate values of the reference image 91-1 and the measurement image 91-2 in the coordinate system of the camera itself for the camera image 91, and provides the detected value to the calculation unit 23. The calculator 23 calculates the horizontal difference Δx1 from the coordinate values of the reference image 91-1 and the measurement image 91-2.

  Similarly, for the camera image 92, the image processing unit 22 detects the coordinate values of the reference image 92-1 and the measurement image 92-2 in the coordinate system of the camera itself, and provides the detected value to the calculation unit 23. . The calculator 23 calculates the horizontal difference Δx2 from the coordinate values of the reference image 92-1 and the measurement image 92-2.

  The calculation unit 23 calculates (detects) Δx (upper left) = Δx1 + Δx2 as the difference Δx (upper left) of the upper left side of the measurement partial image 41-2 with respect to the reference partial image 41-1, and the calculation result (Detection result) is provided to the projector control unit 14-1 via the control unit 21. If necessary, the calculation unit 23 sets the unit of the length difference Δx (upper left) of the upper left side of the measurement partial image 41-2 with respect to the reference partial image 41-1 to the coordinate system on the camera 15-a. After the corresponding unit is converted into a unit corresponding to the number of dots such as the projector 11-2, the converted unit is provided to the projector control unit 14-1 through the control unit 21.

  Then, the projector 14-1 presents the calculation result (detection result), that is, the difference Δx (upper left) in the length of the upper left side of the measurement partial image 41-2 with respect to the reference partial image 41-1.

  The other side length differences can also be detected and presented to the installer in exactly the same manner by executing the series of processes described above using the corresponding camera images.

  Further, the image forming apparatus can also detect the horizontal inclination as follows and present it to the installer.

  That is, when the control unit 21 of the controller 17 outputs a selection command for selecting, for example, the respective camera images of the cameras 15-b, 15-e, and 15-h to the switcher 16, the switcher 16 is, for example, the camera of FIG. Each of the images 93, 94, and 95 is provided to the image processing unit 22.

  That is, the camera image 93 is an example of an image obtained as a result of shooting the area 41-B by the camera 15-b. The camera image 94 is an example of an image obtained as a result of shooting the area 41-E by the camera 15-e. The camera image 95 is an example of an image obtained as a result of photographing the area 41-H by the camera 15-h.

  Next, the image processing unit 22 detects the coordinate values of the reference image 93-1 and the measurement image 93-2 in the coordinate system of the camera itself for the camera image 93, and provides it to the calculation unit 23. . Similarly, for the camera image 94, the image processing unit 22 detects the coordinate values of the reference image 94-1 and the measurement image 94-2 in the camera's own coordinate system, and provides them to the calculation unit 23. . The image processing unit 22 detects the coordinate values of the reference image 95-1 and the measurement image 95-2 in the coordinate system of the camera itself for the camera image 95, and provides the detected value to the calculation unit 23.

  Then, the computing unit 23 is based on the coordinate values of the reference image 93-1, the measurement image 93-2, the reference image 94-1, the measurement image 94-2, the reference image 95-1, and the measurement image 95-2. Then, the angle θ as shown in FIG. 6 is calculated (detected) as the inclination in the horizontal direction, and provided to the projector control unit 14-1 through the control unit 21. If necessary, the calculation unit 23 converts the unit of tilt in the horizontal direction from a unit corresponding to the coordinate system on the camera to a unit corresponding to the number of dots of the projector 11-2 and the like, and then controls the projector. Provided to part 14-1.

  Then, the projector 14-1 presents the detection result, that is, the angle θ as the inclination in the horizontal direction to the installer.

  Note that the vertical inclination can also be detected and presented to the installer in exactly the same manner by executing the series of processes described above using the corresponding camera image.

  In this way, various errors with respect to the measurement partial image 41-2 with respect to the reference partial image 41-1, that is, differences in length of each side, horizontal / vertical inclination, and the like are quantified, and the projector control unit 14-1 Will be presented to the installer. As a result, the installer can perform installation of the projector 11-2 to be adjusted, adjustment of the installation conditions, adjustment by the lens shift mechanism, and the like according to those numerical values. Thus, since various errors of the measurement partial image 41-2 with respect to the reference partial image 41-1 are presented to the installer as numerical values, the installer can easily estimate the adjustment amount. In addition, since the installation completion conditions are also clarified, variations in the adjustment accuracy are reduced.

  Also for the other projectors 11-3 and 11-4, the image forming apparatus determines each as an adjustment target and executes the series of processes described above, so that the installer can install them and the installation conditions thereof. Adjustment, adjustment by a lens shift mechanism, and the like can be performed.

  Furthermore, for the projectors 11-5 to 11-8 that form the center partial image and the projectors 11-9 to 11-12 that form the right partial image, the designer determines one projector as the reference projector. Thus, the above-described installation, adjustment of the installation conditions, adjustment by the lens shift mechanism, and the like can be performed. Thereafter, the image forming apparatus determines each of the other projectors as an adjustment target and executes the above-described series of processes, so that the installer can adjust the installation and adjustment of the installation conditions and the lens shift mechanism. Etc. can be performed.

  Here, “the installation person adjusts the installation conditions of the projector and the adjustment by the lens shift mechanism” means the projector control units 14-1 to 14-3, the stack controller 13-1 to 13-3, Alternatively, it means that the installer manually sets various conditions for the projectors 11-1 to 11-12.

  Further, as described above, various errors of the measurement partial image 41-2 with respect to the reference partial image 41-1, that is, errors such as differences in length of each side and horizontal and vertical inclinations are quantified. The control units 14-1 to 14-3 and the like may automatically adjust the installation conditions and the lens shift mechanism for each projector other than the reference projector among the projectors 11-1 to 11-12. It can be easily realized.

  Heretofore, an example of adjustment processing at the time of projector installation has been described. Next, an example of the fine adjustment process will be described with reference to FIGS.

  Here, for ease of explanation, as shown in FIG. 7, numbers 1 to 21 are assigned to the cameras 15-a to 15-u, respectively. Each of -a through 15-u is referred to as each of the first camera 15-a through 21st camera 15-u.

  As described above, the installation conditions of the projectors 11-1 to 11-12 are made uniform by the adjustment processing at the time of projector installation. Therefore, in the fine adjustment process, the installation conditions are not adjusted, and only the adjustment by the lens shift mechanism is performed. That is, the projector image formed on the screen 18 by each of the projectors 11-1 to 11-12 can be translated while maintaining its size by each lens shift mechanism. For this reason, adjustment by the lens shift mechanism is performed by fine adjustment processing so that each projector image is formed at an appropriate position.

  Hereinafter, a fine adjustment process using at least a part of the adjustment image (entire image) 71 of FIG. 3 described above will be described. That is, each of the left partial image 51, the center partial image 52, and the right partial image 53 is formed by four projectors by the stacking method, and the left partial image 51 and the center portion are formed by the tiling method. A fine adjustment process executed to satisfy the projection condition that the entire image 71 is formed from the image 52 and the right partial image 53 will be described.

  Assume that numbers PJ = 1 to 12 are assigned to the projectors 11-1 to 11-12, respectively.

  The projector 11-1 with PJ = 1 among the projectors 11-1 to 11-4 that form the left partial image 51 is set as a reference projector in the adjustment process at the time of projector installation, and similarly in the fine adjustment process. Suppose that it is selected as a reference projector. Hereinafter, the reference projector 11-1 that forms the Left partial image 51 is referred to as a Left reference projector 11-1. Similarly, of the projectors 11-5 to 11-8 that form the center partial image 52, the projector 11-5 with PJ = 5 is set as the reference projector in the adjustment processing at the time of projector installation, and the same applies to the fine adjustment processing. Is selected as the reference projector. The reference projector 11-5 that forms the center partial image 52 is referred to as a center reference projector 11-5. In addition, the projector 11-9 having PJ = 9 among the projectors 11-9 to 11-12 forming the right partial image 53 is set as a reference projector in the adjustment process at the time of projector installation, and similarly in the fine adjustment process. Suppose that it is selected as a reference projector. The reference projector 11-5 that forms the center partial image 53 is referred to as a right reference projector 11-5.

  Fine adjustment processing can be broadly divided into the following first fine adjustment processing and second fine adjustment processing.

  The first fine adjustment processing is to appropriately form each of the left partial image 51, the center partial image 52, and the right partial image 53 constituting the entire image 71 of FIG. This is a process of performing adjustment by the lens shift mechanism of the Left reference projector 11-1, the Center reference projector 11-5, and the Right reference projector 11-9. Hereinafter, the first fine adjustment process is referred to as a tiling adjustment process.

  The second fine adjustment processing is to exclude the reference projector among the four projectors in order to substantially match the formation positions of the same partial images formed by the four projectors by the stacking method. This is a process of adjusting by the lens shift mechanism of the other three projectors. Specifically, of the projectors 11-1 to 11-4 that form the Left partial image 51, the projectors 11-2 to 11-4 other than the Left reference projector 11-1, and the projector 11- that forms the Center partial image 52. Projectors 11-6 to 11-8 other than the Center reference projector 11-5 among 5 to 11-8, and Right reference projector 11- of the projectors 11-9 to 11-12 that form the Right partial image 53. A process of performing adjustment by the respective lens shift mechanisms of the projectors 11-10 to 11-12 excluding 9 is a second fine adjustment process. Hereinafter, the second fine adjustment process is referred to as a stacking adjustment process.

  As described above, generally, the tiling adjustment process is first performed, the adjustment by the lens shift mechanism of each reference projector for forming each partial image is performed, and then the stacking adjustment process is performed. Thus, adjustment is performed by the lens shift mechanism of each of the other projectors. Accordingly, first, an example of the tiling adjustment process will be described with reference to the flowchart of FIG. 8, and then an example of the stacking adjustment process will be described with reference to the flowchart of FIG.

  FIG. 8 is a flowchart for explaining an example of tiling adjustment processing.

  In step S1 of FIG. 8, the control unit 21 of the controller 17 of FIG. 1 selects the Center reference projector 11-5. Thus, the center reference projector 11-5 forms the center partial image 52 on the screen 18 (other partial images are not formed on the screen 18).

  That is, first, adjustment is performed by the lens shift mechanism of the center reference projector 11-5 that forms the center partial image 52. Specifically, for example, as shown in FIG. 9, the center feature point k in the center partial image 52 formed by the center reference projector 11-5 is at a predetermined position on the screen 18. Adjustment by the lens shift mechanism is performed. Therefore, in this case, the camera image 113 including the feature point k photographed by the 11th camera 15-k is used. FIG. 9 shows an example of a camera image used in fine adjustment processing (this tiling adjustment processing and stacking adjustment processing described later). Other camera images will be described later.

  Therefore, the control unit 21 outputs to the switcher 16 a selection command for selecting the camera image 113 including the feature point k photographed by the 11th camera 15-k. Then, the switcher 16 supplies a camera image 113 including the feature point k photographed by the 11th camera 15-k to the image processing unit 22. Thereby, the tiling adjustment process of FIG. 8 proceeds from step S1 to S2.

  In step S2, the image processing unit 22 and the calculation unit 23 detect the position of the feature point k in the coordinate system of the camera image 113 itself.

  Specifically, for example, suppose that the camera image 113 shown in FIG. 10 is supplied from the switcher 16 at the start of the processing in step S2. As described above, the camera image 113 is an image obtained as a result of photographing the vicinity of the center of the entire image (here, the entire image 71 in FIG. 9) formed on the screen 18 by the 11th camera 15-k. .

  Here, predetermined coordinates on the 11th camera 15-k corresponding to the predetermined position in the camera image 113, that is, the central portion of the entire image formed on the screen 18 (the center of the entire image is arranged). Assume that the definition of the coordinates (Cx, Cy) of the 11th camera 15-k corresponding to the position of the power screen 18 as the image center (Cx, Cy) is made in advance.

  In this case, in step S2, the image processing unit 22 and the calculation unit 23 determine the distance from the center (Cx, Cy) of the image to the feature point k in the camera image 113, that is, the center of the image of the feature point k (Cx , Cy) is detected as the position of the feature point k.

  In this case, the intersection of the horizontal line X2 (hereinafter referred to as image line X2) and the vertical line Y2 (hereinafter referred to as image line Y2) included in the camera image 113 is detected as the feature point k as it is. May be. However, in the present embodiment, the feature point k is detected (calculated) as follows, for example.

  That is, as shown in FIG. 10, it is assumed that the X measurement lines XL1 and XL2 and the Y measurement lines YL1 and YL2 are defined in advance in addition to the center (Cx, Cy) of the image described above.

  In this case, the calculation unit 23 obtains an intersection 121 between the X measurement line XL1 and the image line Y2 and an intersection 122 between the X measurement line XL2 and the image line Y2, and a substantially vertical direction connecting the intersection 121 and the intersection 122. Find the approximate straight line.

  Similarly, the calculation unit 23 obtains an intersection 123 between the Y measurement line YL1 and the image line X2 and an intersection 124 between the Y measurement line YL2 and the image line X2, and substantially horizontal direction connecting the intersection 123 and the intersection 124. Find the approximate straight line.

  Then, the computing unit 23 calculates an intersection point k ′ between the approximate vertical line and the approximate horizontal line as the feature point k.

  Thereafter, the calculation unit 23 detects the amount of deviation of the feature point k (= intersection k ′) calculated in this way from the center (Cx, Cy) of the image as the position of the feature point k.

  In the present embodiment, the method for detecting the position of other feature points is the same as the method for detecting the position of feature point k described above with reference to FIG.

  Returning to FIG. 8, when the position of the feature point k is detected in the process of step S <b> 2 in this way, in step S <b> 3, the calculation unit 23 matches the position of the feature point k with the center (Cx, Cy) of the image. It is determined whether or not.

  As shown in FIG. 10 described above, when there is a shift amount of the feature point k (= intersection k ′) with respect to the center (Cx, Cy) of the image, in step S3, the position of the feature point k is the center of the image ( Cx, Cy) is determined not to match, and the process proceeds to step S4.

  In step S4, the control unit 21 calculates the adjustment amount by the lens shift mechanism of the center reference projector 11-5 based on the shift amount of the feature point k (= intersection k ′) with respect to the center (Cx, Cy) of the image. The calculation result is output to the projector control unit 14-2 as a lens shift control command.

  Specifically, as described above, in order to absorb camera installation conditions and lens shift mechanism operation errors, each camera error (deviation amount) is converted into a movement amount of the lens shift mechanism of each projector. Various conversion coefficients are stored in the setting storage memory 24 in advance. Therefore, the control unit 21 reads the corresponding conversion coefficient from the setting storage memory 24, and uses the deviation amount of the feature point k (= intersection point k ′) with respect to the center (Cx, Cy) of the image and the read conversion coefficient. Then, the adjustment amount by the lens shift mechanism of the center reference projector 11-5 is calculated, and the calculation result is output to the projector control unit 14-2 as a lens shift control command.

  In the present embodiment, the calculation method for calculating the adjustment amount by the lens shift mechanism of other projectors is the same as the calculation method in step S4.

  Subsequently, in step S4, the projector control unit 14-2 performs adjustment control by the lens shift mechanism of the center reference projector 11-5 in accordance with the lens shift control command. As a result, the center partial image 52 formed by the center reference projector 11-5 moves, and the feature point k (actually the intersection k ′ described above) included in the partial image 52 is the center (Cx, Cy) of the image. Will be approaching.

  Thereafter, the process returns to step S2, and the subsequent processes are repeated. That is, the loop process of steps S2 to S4 is repeatedly executed until the position of the feature point k included in the center partial image 52 coincides with the center (Cx, Cy) of the image.

  When the position of the feature point k included in the center partial image 52 coincides with the center (Cx, Cy) of the image, the adjustment by the lens shift mechanism of the center reference projector 11-5 is completed. It is determined that the process is YES, and the process proceeds to step S5.

  In step S5, the controller 17 captures the center partial image 52 formed on the screen 18 by the center reference projector 11-5 at that time with the camera images 112 and 17 of FIG. 9 taken by the eighth camera 15-h. The camera image 114 photographed by the number camera 15-q is acquired. Then, the controller 17 acquires the position (CLx, CLy) of the feature point h in the coordinate system of the camera image 112 (hereinafter referred to as the reference position (CLx, CLy)), and the feature point of the camera image 112 in the coordinate system. Get the position of q (CRx, CRy) (hereinafter referred to as the reference position (CRx, CRy)).

  In step S6, the controller 17 selects the Left reference projector 11-1. Accordingly, the Left reference projector 11-1 causes the Left partial image 51 to be formed on the screen 18 (other partial images are not formed on the screen 18).

  That is, this time, adjustment is performed by the lens shift mechanism of the Left reference projector 11-1 that forms the Left partial image 51. Specifically, for example, as shown in FIG. 9, the feature point h in the blending area 61 of the Left partial image 51 formed by the Left reference projector 11-1 is the reference position ( CLx, CLy), that is, adjustment by the lens shift mechanism so that it substantially coincides with the feature point h in the blending area 61 of the center partial image 52 formed by the center reference projector 11-5. Is done. Therefore, in this case, the camera image 112 of FIG. 9 including the feature point h photographed by the eighth camera 15-h is used.

  In step S7, the controller 17 detects the position of the feature point h in the coordinate system of the camera image 112 itself.

  In step S8, the controller 17 determines whether or not the position of the feature point h matches the reference position (CLx, CLy).

  If it is determined in step S8 that the position of the feature point h does not match the reference position (CLx, CLy), the process proceeds to step S9.

  In step S9, the controller 17 calculates an adjustment amount by the lens shift mechanism of the Left reference projector 11-1 based on the shift amount of the feature point h with respect to the reference position (CLx, CLy), and the calculation result is subjected to lens shift control. The command is output to the projector control unit 14-1. The projector control unit 14-1 controls adjustment by the lens shift mechanism of the Left reference projector 11-1 in accordance with the lens shift control command. As a result, the Left partial image 51 formed by the Left reference projector 11-1 moves, and the feature point h included in the partial image 51 approaches the reference position (CLx, CLy).

  Thereafter, the process returns to step S7, and the subsequent processes are repeated. That is, the loop processing of steps S7 to S9 is repeatedly executed until the position of the feature point h included in the Left partial image 51 coincides with the reference position (CLx, CLy).

  When the position of the feature point h included in the Left partial image 51 coincides with the reference position (CLx, CLy), the adjustment by the lens shift mechanism of the Left reference projector 11-1 is completed. If YES, the process proceeds to step S10.

  In step S10, the controller 17 acquires the camera image 111 of FIG. 9 captured by the fifth camera 15-e for the Left partial image 51 formed on the screen 18 at that time by the Left reference projector 11-1. . Then, the controller 17 acquires the position (Lx, Ly) of the feature point e in the coordinate system of the camera image 111 (hereinafter referred to as the reference position (Lx, Ly)). Note that this reference position (Lx, Ly) is adjusted when the lens shift mechanism of the other projectors 11-2 to 11-4 forming the left partial image 51 is adjusted in the stacking adjustment process of FIG. Used.

  In step S11, the controller 17 selects the Right reference projector 11-9. As a result, the Right reference projector 11-9 forms the Right partial image 53 on the screen 18 (other partial images are not formed on the screen 18).

  That is, this time, adjustment is performed by the lens shift mechanism of the Right reference projector 11-9 that forms the Right partial image 53. Specifically, for example, as shown in FIG. 9, the feature point n in the blending area 62 of the right partial image 53 formed by the right reference projector 11-9 is the reference position ( CRx, CRy), that is, adjustment by the lens shift mechanism so as to substantially coincide with the feature point n in the blending area 62 of the center partial image 52 formed by the center reference projector 11-5. Is done. Therefore, in this case, the camera image 114 of FIG. 9 including the feature point n photographed by the 14th camera 15-n is used.

  In step S12, the controller 17 detects the position of the feature point n in the coordinate system of the camera image 114 itself.

  In step S13, the controller 17 determines whether or not the position of the feature point n matches the reference position (CRx, Cry).

  If it is determined in step S13 that the position of the feature point n does not match the reference position (CRx, CRy), the process proceeds to step S14.

  In step S14, the controller 17 calculates the adjustment amount by the lens shift mechanism of the right reference projector 11-9 based on the shift amount of the feature point n with respect to the reference position (CRx, CRy), and the calculation result is subjected to lens shift control. The command is output to the projector control unit 14-3. The projector control unit 14-3 controls the adjustment by the lens shift mechanism of the Right reference projector 11-9 according to the lens shift control command. As a result, the right partial image 53 formed by the right reference projector 11-9 moves, and the feature point n included in the partial image 53 approaches the reference position (CRx, CRy).

  Thereafter, the process returns to step S12, and the subsequent processes are repeated. That is, the loop process of steps S12 to S14 is repeatedly executed until the position of the feature point n included in the right partial image 53 coincides with the reference position (CRx, CRy).

  When the position of the feature point n included in the Right partial image 53 coincides with the reference position (CRx, CRy), the adjustment by the lens shift mechanism of the Right reference projector 11-9 is completed. If YES, the process proceeds to step S15.

  In step S15, the controller 17 acquires the camera image 115 of FIG. 9 captured by the 17th camera 15-q for the Right partial image 53 formed on the screen 18 at that time by the Right reference projector 11-9. . Then, the controller 17 acquires the position (Rx, Ry) of the feature point q in the coordinate system of the camera image 115 (hereinafter referred to as the reference position (Rx, Ry)). The reference position (Rx, Ry) is adjusted when the lens shift mechanism of the other projectors 11-10 to 11-12 that form the right partial image 53 is adjusted in the stacking adjustment process of FIG. Used.

  In this way, when the process of step S15 is finished, the tiling adjustment process itself is finished.

  When this tiling adjustment process is completed, the stacking adjustment process is started this time. An example of such stacking adjustment processing is shown in the flowchart of FIG. Therefore, an example of stacking adjustment processing will be described below with reference to the flowchart of FIG.

  In step S31, the controller 17 selects the Center partial image 52. In other words, the projectors 11-6 to 11-8 other than the center reference projector 11-5 among the projectors 11-5 to 11-8 that form the center partial image 52 are adjusted by the respective lens shift mechanisms. .

  Therefore, in step S32, the controller 17 sets the projector number PJ = 6.

  In step S33, the controller 17 selects the PJ-th projector as a processing target projector (hereinafter also referred to as an adjustment target projector). Thereby, the adjustment target projector forms the center partial image 52 on the screen 18 (other projectors do not form the center partial image 52 on the screen 18).

  That is, in this case, the projector 11-6 is selected as the adjustment target projector, and the adjustment by the lens shift mechanism is performed. Therefore, the center partial image 52 is formed on the screen 18 by the projector 11-6. Specifically, for example, as shown in FIG. 9, the center feature point k of the center partial image 52 formed by the adjustment target projector 11-6 is an image used in the tiling adjustment process of FIG. Is adjusted by the lens shift mechanism so as to coincide with the center (Cx, Cy) of the image, that is, to coincide with the feature point k of the center partial image 52 formed by the center reference projector 11-5. Accordingly, in this case, the camera image 113 of FIG. 9 including the feature point k photographed by the 11th camera 15-k is used.

  In step S34, the controller 17 detects the position of the feature point k (the projector to be adjusted: the feature point k of the center partial image 52 formed by the projector 11-6 in this case) in the coordinate system of the camera image 113 itself. To do.

  In step S35, the controller 17 determines whether or not the position of the feature point k matches the center (Cx, Cy) of the image.

  If it is determined in step S35 that the position of the feature point k does not coincide with the center position (Cx, Cy) of the image, the process proceeds to step S36.

  In step S36, the controller 17 calculates an adjustment amount by the lens shift mechanism of the adjustment target projector (in this case, the projector 11-6) based on the deviation amount of the feature point k with respect to the center (Cx, Cy) of the image. The calculation result is output to the projector control unit 14-2 as a lens shift control command. The projector control unit 14-2 controls the adjustment by the lens shift mechanism of the adjustment target projector according to the lens shift control command. As a result, the center partial image 52 formed by the projector to be adjusted moves, and the feature point k included in the center partial image 52 approaches the center (Cx, Cy) of the image.

  Thereafter, the process returns to step S34, and the subsequent processes are repeated. That is, until the position of the feature point k included in the center partial image 52 formed by the adjustment target projector coincides with the center (Cx, Cy) of the image, the loop processing of steps S34 to S36 is repeatedly executed. .

  When the position of the feature point k included in the center partial image 52 formed by the adjustment target projector coincides with the center (Cx, Cy) of the image, the lens shift of the adjustment target projector (in this case, the projector 11-6). Since the adjustment by the mechanism is completed, it is determined YES in the process of step S35, and the process proceeds to step S37.

  In step S37, the controller 17 increments the projector number PJ by 1 (PJ = PJ + 1).

  In step S38, the controller 17 determines whether or not PJ = 9.

  In this case, since PJ = 7 is updated in the process of step S37, it is determined NO in step S38, the process returns to step S33, and the subsequent processes are repeated. That is, this time, the projector 11-7 is selected as the adjustment target projector, and the adjustment by the lens shift mechanism is performed by the loop processing of steps S34 to S36. When the adjustment is completed, it is determined as YES in the process of step S35, and the process proceeds to step S37 again.

  Then, this time, PJ = 8 is updated in the process of step S37, it is determined NO in step S38, the process returns to step S33, and the subsequent processes are repeated. That is, this time, the projector 11-8 is selected as the adjustment target projector, and the adjustment by the lens shift mechanism is performed by the loop processing of steps S34 to S36. When the adjustment is completed, it is determined as YES in the process of step S35, and the process proceeds to step S37 again.

  Then, PJ = 9 is updated in the process of step S37, and it is determined as YES in step S38, and the process proceeds to step S39. That is, since the adjustment by the lens shift mechanism of all the projectors 11-5 to 11-8 that form the center partial image 52 is completed, the process proceeds to step S39.

  In step S39, the controller 17 selects the Left partial image 51. That is, this time, adjustment is performed by the lens shift mechanisms of the projectors 11-2 to 11-4 other than the Left reference projector 11-1 among the projectors 11-1 to 11-4 that form the Left partial image 51. It will be.

  Therefore, in step S40, the controller 17 sets the projector number PJ = 2.

  In step S41, the controller 17 selects the PJ-th projector as the adjustment target projector. Thereby, the adjustment target projector forms the left partial image 51 on the screen 18 (other projectors do not form the left partial image 51 on the screen 18).

  That is, in this case, the projector 11-2 is selected as the adjustment target projector, and adjustment by the lens shift mechanism is performed. For this reason, the Left partial image 51 is formed on the screen 18 by the projector 11-2. Specifically, for example, as shown in FIG. 9, the feature point e at the center of the Left partial image 51 formed by the adjustment target projector 11-2 is the process in step S <b> 10 of the tiling adjustment process in FIG. 8 described above. Is adjusted by the lens shift mechanism so as to coincide with the reference position (Lx, Ly) acquired in Step 1, that is, to coincide with the feature point e of the Left partial image 51 formed by the Left reference projector 11-1. Is done. Therefore, in this case, the camera image 111 of FIG. 9 including the feature point e photographed by the fifth camera 15-e is used.

  In step S42, the controller 17 detects the position of the feature point e (the adjustment target projector: the feature point e of the Left partial image 51 formed by the projector 11-2 in this case) in the coordinate system of the camera image 111 itself. To do.

  In step S43, the controller 17 determines whether or not the position of the feature point e matches the reference position (Lx, Ly).

  If it is determined in step S43 that the position of the feature point e does not coincide with the reference position (Lx, Ly), the process proceeds to step S44.

  In step S44, the controller 17 calculates the adjustment amount by the lens shift mechanism of the adjustment target projector (in this case, the projector 11-2) based on the deviation amount of the feature point e with respect to the reference position (Lx, Ly). The calculation result is output to projector control unit 14-1 as a lens shift control command. The projector control unit 14-1 controls the adjustment by the lens shift mechanism of the projector to be adjusted according to the lens shift control command. As a result, the Left partial image 51 formed by the adjustment target projector moves, and the feature point e included in the Left partial image 51 approaches the reference position (Lx, Ly).

  Thereafter, the process returns to step S42, and the subsequent processes are repeated. That is, the loop processing of steps S42 to S44 is repeatedly executed until the position of the feature point e included in the Left partial image 51 formed by the adjustment target projector coincides with the reference position (Lx, Ly).

  When the position of the feature point e included in the left partial image 52 formed by the adjustment target projector matches the reference position (Lx, Ly), the lens shift mechanism of the adjustment target projector (in this case, the projector 11-2). Since the adjustment by is completed, it is determined YES in the process of step S43, and the process proceeds to step S45.

  In step S45, the controller 17 increments the projector number PJ by 1 (PJ = PJ + 1).

  In step S46, the controller 17 determines whether or not PJ = 5.

  In this case, since PJ = 3 is updated in the process of step S45, it is determined NO in step S46, the process returns to step S41, and the subsequent processes are repeated. That is, this time, the projector 11-3 is selected as the adjustment target projector, and the adjustment by the lens shift mechanism is performed by the loop processing of steps S42 to S44. When the adjustment is completed, it is determined as YES in the process of step S43, and the process proceeds to step S45 again.

  Then, this time, PJ = 4 is updated in the process of step S45, and it is determined NO in step S46, the process is returned to step S41, and the subsequent processes are repeated. That is, this time, the projector 11-4 is selected as the adjustment target projector, and the adjustment by the lens shift mechanism is performed by the loop processing of steps S42 to S44. When the adjustment is completed, it is determined as YES in the process of step S43, and the process proceeds to step S45 again.

  Then, PJ = 5 is updated in the process of step S45, and it is determined YES in step S46, and the process proceeds to step S47. That is, since the adjustment by the lens shift mechanism of all the projectors 11-1 to 11-4 that form the Left partial image 51 is completed, the process proceeds to step S47.

  In step S47, the controller 17 selects the Right partial image 53. That is, this time, adjustment is performed by the respective lens shift mechanisms of the projectors 11-10 to 11-12 other than the Right reference projector 11-9 among the projectors 11-9 to 11-12 that form the Right partial image 53. It will be.

  Therefore, in step S48, the controller 17 sets the projector number PJ = 10.

  In step S49, the controller 17 selects the PJ-th projector as the adjustment target projector. Thus, the adjustment target projector forms the Right partial image 53 on the screen 18 (other projectors do not form the Right partial image 53 on the screen 18).

  That is, in this case, the projector 11-10 is selected as the adjustment target projector, and the adjustment by the lens shift mechanism is performed. Therefore, the right partial image 53 is formed on the screen 18 by the projector 11-10. Specifically, for example, as shown in FIG. 9, the feature point q at the center of the right partial image 53 formed by the projector 11-10 to be adjusted is the process in step S15 of the tiling adjustment process in FIG. Is adjusted by the lens shift mechanism so as to coincide with the reference position (Rx, Ry) acquired in Step 1, that is, to coincide with the feature point q of the Right partial image 53 formed by the Right reference projector 11-9. Is done. Therefore, in this case, the camera image 115 of FIG. 9 including the feature point q photographed by the 17th camera 15-q is used.

  In step S50, the controller 17 detects the position of the feature point q (the projector to be adjusted: the feature point q of the right partial image 53 formed by the projector 11-10 in this case) in the coordinate system of the camera image 115 itself. To do.

  In step S51, the controller 17 determines whether or not the position of the feature point q matches the reference position (Rx, Ry).

  If it is determined in step 51 that the position of the feature point q does not coincide with the reference position (Rx, Ry), the process proceeds to step S52.

  In step S52, the controller 17 calculates the adjustment amount by the lens shift mechanism of the adjustment target projector (in this case, the projector 11-10) based on the deviation amount of the feature point q with respect to the reference position (Rx, Ry), The calculation result is output to the projector control unit 14-3 as a lens shift control command. The projector control unit 14-3 controls adjustment by the lens shift mechanism of the adjustment target projector in accordance with the lens shift control command. As a result, the right partial image 53 formed by the adjustment target projector moves, and the feature point q included in the right partial image 53 approaches the reference position (Rx, Ry).

  Thereafter, the process returns to step S50, and the subsequent processes are repeated. That is, the loop processing of steps S50 to S52 is repeatedly executed until the position of the feature point q included in the right partial image 53 formed by the adjustment target projector coincides with the reference position (Rx, Ry).

  When the position of the feature point q included in the right partial image 53 formed by the adjustment target projector coincides with the reference position (Rx, Ry), the lens shift mechanism of the adjustment target projector (in this case, the projector 11-10). Since the adjustment by is completed, it is determined YES in the process of step S51, and the process proceeds to step S53.

  In step S53, the controller 17 increments the projector number PJ by 1 (PJ = PJ + 1).

  In step S54, the controller 17 determines whether or not PJ = 13.

  In this case, since PJ = 11 is updated in the process of step S53, it is determined NO in step S54, the process returns to step S49, and the subsequent processes are repeated. That is, this time, the projector 11-11 is selected as the adjustment target projector, and the adjustment by the lens shift mechanism is performed by the loop processing of steps S50 to S52. When the adjustment is completed, it is determined as YES in the process of step S51, and the process proceeds to step S53 again.

  Then, this time, PJ = 12 is updated in the process of step S53, it is determined NO in step S54, the process is returned to step S49, and the subsequent processes are repeated. That is, this time, the projector 11-12 is selected as the adjustment target projector, and the adjustment by the lens shift mechanism is performed by the loop processing of steps S50 to S52. When the adjustment is completed, it is determined as YES in the process of step S51, and the process proceeds to step S53 again.

  Then, PJ = 13 is updated in the process of step S53, and it is determined as YES in step S54, and the stacking adjustment process ends. That is, the adjustment by the lens shift mechanism of all the projectors 11-8 to 11-12 forming the right partial image 53 is finished, and as a result, the adjustment by the lens shift mechanism of all the projectors 11-1 to 11-12 is finished. As a result, the stacking adjustment process ends.

  The tiling adjustment process and the stacking process have been described above as an example of the fine adjustment process.

  Note that the tiling adjustment process and the stacking process are executed in the fine adjustment process in the above-described example, but may be executed as a part of the projector installation adjustment process (a process after the projector installation is completed). .

  Further, as described above, even when the tiling adjustment process and the stacking adjustment process are executed, the image position may actually fluctuate due to the environmental temperature or the like. In such a case, the tiling adjustment process and the stacking adjustment process may be executed again. At this time, the center (Cx, Cy) and the reference positions (Lx, Ly), (Rx, Ry) of the image detected during the first tiling adjustment process and stacking adjustment process are stored in the setting shown in FIG. By storing the data in the memory 24 or the like, re-measurement of the center (Cx, Cy) and the reference positions (Lx, Ly), (Rx, Ry) of the image becomes unnecessary.

  As described above, the image forming apparatus having the configuration shown in FIG. 1 is employed, and the projector installation adjustment process and fine adjustment process described above (the tiling adjustment process in FIG. 8 and the stacking process in FIG. 11) are applied to the image forming apparatus. By executing the adjustment process or the like, the following first effect and second effect can be achieved.

  The first effect is that an image forming apparatus that forms a high-definition large-screen image using a stacking technique and a tiling technique on a screen or the like can be realized at low cost without using a special apparatus (component). It is an effect. The special device is a high-performance camera having a wide angle of view and a high resolution necessary for realizing the invention of the above-described conventional patent document, that is, a large screen image formed on the screen is photographed at a high resolution. It is a camera that can. On the other hand, the camera necessary for realizing the present invention can be installed in the vicinity of the back side of the screen, and only one point (feature point) of the large screen image formed on the screen can be photographed. A simple camera is enough. Therefore, even when a plurality of cameras (21 in the example of FIG. 1) necessary for realizing the present invention are prepared, the total price of them is the same as that of the cameras necessary for realizing the invention of the conventional patent document. Compared to the price of a single unit, it can be kept much lower. In addition, the controller, the projector control unit, and the like can be easily configured with a general-purpose personal computer or the like as shown in FIG. As a result, the image forming apparatus having the configuration shown in FIG. 1 can be realized at low cost.

  The second effect is that it is possible to adjust a large screen image that is difficult to be adjusted only by human manual work under conditions such as automation, time reduction, and small variations in accuracy. In other words, the second effect is that, after all, even a person who does not have special knowledge, experience, technology, or the like, that is, anyone can adjust a large screen image.

  By the way, in the above-mentioned example, the whole image is composed of three partial images by the tiling method. However, the number of partial images constituting the whole image is basically not limited as long as it is two or more. However, the number of cameras, projectors, stack bases, projector control units, stack base controllers, and the like can be varied according to the increase or decrease in the number of partial images. In addition, the number of projectors that form one partial image by the stacking method is four in the above-described example. However, as described above, the number of projectors can be freely changed according to the brightness required for the partial image. It is.

  In the above-described example, the projector is employed. However, as long as the apparatus has a function of forming an image on the screen 18, the implementation form is not limited. Similarly, other components of the image forming apparatus in FIG. 1 may be arbitrary as long as they have a corresponding function without being limited to the example in FIG.

  In addition, the image forming apparatus of FIG. 1 can be configured by storing each component in one casing, or can be configured by storing each component in a separate casing. In other words, in this specification, if the entire apparatus including a plurality of apparatuses and a plurality of processing units is referred to as a system, the image forming apparatus in FIG. 1 can be regarded as an image forming system.

  By the way, the series of processes described above can be executed by hardware, or can be executed by software.

  In this case, the controller 17, projector control units 14-1 to 14-3, etc. in the image forming apparatus of FIG. 1 can be configured by a computer having the configuration shown in FIG. 12, for example.

  In FIG. 12, a CPU (Central Processing Unit) 201 executes various processes according to a program recorded in a ROM (Read Only Memory) 202 or a program loaded from a storage unit 208 to a RAM (Random Access Memory) 203. To do. The RAM 203 also appropriately stores data necessary for the CPU 201 to execute various processes.

  The CPU 201, the ROM 202, and the RAM 203 are connected to each other via the bus 204. An input / output interface 205 is also connected to the bus 204.

  The input / output interface 205 includes an input unit 206 such as a keyboard and a mouse, an output unit 207 including a display, a storage unit 208 including a hard disk, and a communication unit 209 including a modem and a terminal adapter. It is connected. The communication unit 209 performs communication processing with other devices via a network including the Internet.

A drive 210 is also connected to the input / output interface 205 as necessary, and a removable recording medium 211 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately installed, and a computer program read therefrom Are installed in the storage unit 208 as necessary.

When the above-described series of processing is executed by software, various functions can be achieved by installing a program that constitutes the software in a dedicated hardware or by installing various programs. For example, a general-purpose personal computer that can be executed is installed from a network or a recording medium.

  A recording medium including such a program is a package medium distributed to provide a program to a user, that is, a magnetic disk (including a floppy disk), an optical disk (CD) on which the program is recorded. -Removable recording medium (package media) (not shown) consisting of ROM (compact disk-read only memory), DVD (including digital versatile disk), magneto-optical disk (including MD (mini-disk)), or semiconductor memory ), Or a ROM 203 on which a program is recorded and a hard disk included in the storage unit 208 provided to the user in a state of being incorporated in the apparatus main body in advance.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

1 is a block diagram illustrating a configuration example of an image forming apparatus to which the present invention is applied. It is a figure which shows an example of the partial image for adjustment formed on a screen by the one projector of FIG. It is a figure which shows an example of the whole image for adjustment formed on a screen by each projector of FIG. It is a figure explaining an example of the installation position of the camera of FIG. FIG. 2 is a diagram illustrating an example of adjustment processing at the time of projector installation of the image forming apparatus in FIG. 1. FIG. 2 is a diagram illustrating an example of adjustment processing at the time of projector installation of the image forming apparatus in FIG. 1. It is a figure which shows the example of arrangement | positioning of each camera of FIG. 3 is a flowchart for explaining an example of tiling adjustment processing executed by the image forming apparatus in FIG. 1. It is a figure which shows an example of the camera image utilized by the tiling adjustment process etc. of FIG. It is a figure which shows an example of the camera image containing the feature point near the center of the whole image among each camera image of FIG. 3 is a flowchart illustrating an example of stacking adjustment processing executed by the image forming apparatus in FIG. 1. FIG. 2 is a block diagram illustrating a configuration example of a computer that constitutes at least a part of the image forming apparatus in FIG. 1.

Explanation of symbols

  11-1 to 11-12 projector, 12-1 to 12-12 stack base, 13-1 to 13-3 stack base controller, 14-1 to 14-3 projector control unit, 15-a to 15-u camera , 16 switcher, 17 controller, 18 screen, 21 control unit, 22 image processing unit, 23 computing unit, 24 setting storage memory, 51 Left partial image, 52 Center partial image 53, Right partial image, 61, 62 blending area, 71 Whole image

Claims (9)

By superimposing a predetermined part of the first partial image and a predetermined part of the second partial image, an image composed of the first partial image and the second partial image is to be imaged. In the image forming apparatus formed on the first surface,
First image forming means and second image forming means for forming the first partial image on the first surface of the image forming target, and the second partial image of the image forming target. A third image forming means and a fourth image forming means formed on the first surface;
The first partial image or the second portion formed on the first surface of the image formation target by at least one of the first image forming unit to the fourth image forming unit. A plurality of photographing means for photographing each of the plurality of regions in the image from the second surface side facing the first surface of the image forming target and outputting each of the plurality of photographed images obtained as a result When,
First formation of the first partial image by the first image forming unit on the first surface of the image forming target based on the plurality of captured images output from the plurality of imaging units. A second formation position of the first partial image by the second image forming means, a third formation position of the second partial image by the third image forming means, and the fourth An image forming apparatus comprising: adjustment information generating means for generating adjustment information for adjusting at least one of the fourth formation positions of the second partial image by the image forming means. The first partial image includes one or more feature points; the second partial image includes one or more feature points;
Each of the plurality of imaging means images each of the plurality of regions including at least one feature point, and outputs a plurality of the captured images obtained as a result,
The adjustment information generating unit includes at least one of the feature points formed by each of the first image forming unit to the fourth image forming unit included in at least one of the plurality of captured images. The image forming apparatus according to claim 1, wherein the adjustment information is generated based on one. The adjustment information generation unit includes a relative position of each of the feature points formed by each of the first image forming unit to the fourth image forming unit included in at least one of the plurality of captured images. The image forming apparatus according to claim 2, wherein the adjustment information is generated based on a specific positional relationship. The first partial image includes at least a first feature point;
The adjustment information generation unit obtains at least a first captured image including the first feature point formed by the first image forming unit from among the plurality of captured images, and the first captured image In the coordinate system in the image, a deviation amount between the coordinates of the first feature point and the first reference position set in advance is obtained, and information indicating the deviation amount is used to adjust the first formation position. The image forming apparatus according to claim 3, wherein the image forming apparatus generates the first adjustment information. The image forming apparatus according to claim 4, further comprising an adjusting unit that adjusts the first formation position based on the first adjustment information generated by the adjustment information generating unit. The adjustment information generating means includes
A second captured image including the first feature point formed by the second image forming unit among the plurality of captured images is further acquired;
In the coordinate system in the second photographed image, a deviation amount between the coordinates of the first feature point formed by the second image forming unit and the first reference position is obtained, and the deviation amount is obtained. Information to be generated as second adjustment information for adjusting the second formation position,
The image forming apparatus according to claim 5, wherein the adjustment unit further adjusts the second formation position based on the second adjustment information generated by the adjustment information generation unit. The first partial image further includes a second feature point in the predetermined part,
The second partial image includes at least a third feature point at a position corresponding to the arrangement position of the second feature point in the first partial image,
The adjustment information generating means includes
Of the plurality of photographed images, a third photographed image including the second feature point formed by the first image forming means after the first forming position is adjusted by the adjusting means Obtaining the coordinates of the second feature point as a second reference position in the coordinate system in the third captured image;
A fourth captured image including the third feature point formed by the third image forming unit is further acquired, and in the coordinate system in the fourth captured image, the coordinate of the third feature point and Obtaining a deviation amount from the second reference position, and generating information indicating the deviation amount as third adjustment information for adjusting the third formation position;
The image forming apparatus according to claim 6, wherein the adjustment unit further adjusts the third formation position based on the third adjustment information generated by the adjustment information generation unit. The second partial image further includes a fourth feature point,
The adjustment information generating means includes
Of the plurality of photographed images, a fifth photographed image including the fourth feature point formed by the third image forming means after the third formation position is adjusted by the adjusting means Obtaining the coordinate of the fourth feature point formed by the third image forming means as a third reference position in the coordinate system in the acquired fifth captured image;
A sixth photographed image including the fourth feature point formed by the fourth image forming unit among the plurality of photographed images is further acquired;
In the coordinate system in the sixth photographed image, a deviation amount between the coordinates of the fourth feature point formed by the fourth image forming unit and the third reference position is obtained, and the deviation amount is obtained. Information to be generated is generated as fourth adjustment information for adjusting the fourth formation position,
The image forming apparatus according to claim 7, wherein the adjustment unit further adjusts the fourth formation position based on the fourth adjustment information generated by the adjustment information generation unit. By superimposing a predetermined part of the first partial image and a predetermined part of the second partial image, an image composed of the first partial image and the second partial image is to be imaged. An image forming apparatus formed on a first surface,
First image forming means and second image forming means for forming the first partial image on the first surface of the image forming target, and the second partial image of the image forming target. A third image forming means and a fourth image forming means formed on the first surface;
The first partial image or the second portion formed on the first surface of the image formation target by at least one of the first image forming unit to the fourth image forming unit. A plurality of photographing means for photographing each of the plurality of regions in the image from the second surface side facing the first surface of the image forming target and outputting each of the plurality of photographed images obtained as a result When,
In an image forming method of an image forming apparatus comprising:
First formation of the first partial image by the first image forming unit on the first surface of the image forming target based on the plurality of captured images output from the plurality of imaging units. A second formation position of the first partial image by the second image forming means, a third formation position of the second partial image by the third image forming means, and the fourth An adjustment information generation step of generating adjustment information for adjusting at least one of the fourth formation positions of the second partial image by the image forming means.

Images