JP2006304100A - Multi-projection system and monitoring method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a multi-projection system and a monitoring method capable of performing calibration suitably, when the calibration needs to be performed again. <P>SOLUTION: When a relative position detected at the last time by a distance measuring sensor 8 and a relative position detected at this time by the distance measuring sensor 8 are not matched, it is determined that a geometric gap is generated in an image built on a screen 2. Then, one image is reconstructed on the screen 2 using a correction value computed by performing calibration again. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a multi-projection system that constructs one image from images projected by a plurality of projectors, and more particularly to a method for monitoring the constructed image.

  As one of systems that realize a high-definition large screen on a screen using a projector, there is a multi-projection system that constructs one image using a plurality of projectors.

FIG. 8 is a diagram showing an existing multi-projection system.
A multi-projection system 80 shown in FIG. 8 includes a screen 81, four projectors 82 to 85, a personal computer (hereinafter referred to as a PC) 86, an image correction processing device 87, and a calibration camera 88. It is configured.

  The multi-projection system 80 divides the image to be constructed on the screen 81 into the number of projectors, that is, four, and divides each divided image so that the four divided images are arranged in two rows and two rows on the screen 81. Projecting from the projectors 82 to 85 causes the screen 81 to construct an original image. At the end of each divided image, an overlap portion 89 is provided, and the overlap portions 89 are overlapped with each other, so that adjacent divided images can be seamlessly connected on the screen 81.

  In this way, in the multi-projection system 80, since one image is constructed using a plurality of projectors, the installation position of a certain projector is shifted from front to back, left and right, or a certain projector is tilted up and down. If the display size of the projector changes, the relative position between the projector and the screen 81 changes, and there is a problem that a so-called “geometric shift” occurs in which the divided images adjacent to each other on the screen 81 cannot be cleanly connected.

This “geometric misalignment” can be manually adjusted, but the adjustment time becomes enormous as the number of projectors increases.
Therefore, as a method for correcting the “geometric misalignment” in a short time, for example, there is a method using a calibration camera 88 shown in FIG. 8 (see, for example, Patent Document 1).

  First, the PC 86 projects a test pattern having a plurality of dots and cross marks recorded in advance on the PC 86 from the projectors 82 to 85 onto the screen 81 via the image correction processing device 87.

Next, the PC 86 causes the calibration camera 88 to photograph the test pattern projected on the screen 81.
Next, the PC 86 calculates a correction value for correcting “geometric misalignment” based on the captured image, and sends the correction value to the image correction processing device 87.

  The image correction processing device 87 records the sent correction value in the correction value recording unit 90, and corrects each divided image based on the correction value recorded in the correction value recording unit 90 by the correction processing unit 91. Hereinafter, the work from the calculation of the correction value to the correction of the “geometric misalignment” and the geometry, brightness, or color of each divided image using the correction value is referred to as calibration.

As a result, an image having no “geometric misalignment” can be constructed on the screen 81.
JP-A-9-326981

  However, after calibration, the relative positions of the projectors 82 to 85 and the screen 81 change due to humanity (for example, when an operator hooks the projector cord) or non-human (for example, earthquake), and the “geometric misalignment” again. ", It is necessary to perform calibration again. At this time, if the operator who operates the multi-projection system 80 is far from the multi-projection system 80 and cannot confirm the image on the screen 81, for example, the operator does not notice the “geometric misalignment”, the screen is not calibrated again. There is a problem that an image is constructed in 81.

  Therefore, an object of the present invention is to provide a multi-projection system and a monitoring method capable of performing appropriate calibration when it is necessary to perform calibration again.

In order to solve the above problems, the present invention adopts the following configuration.
That is, the multi-projection system of the present invention is a multi-projection system that constructs one image from each image projected by a plurality of projectors, and records the correction value recording means for recording correction values and the correction value recording means. Correction means for correcting each image projected by the plurality of projectors based on a correction value to be detected; detection means for detecting a relative position between the plurality of projectors and projection destinations of the plurality of projectors; and the detection A relative position recording means for recording the relative position detected by the means; a first relative position recorded as a previous comparison in the relative position recording means; and a second relative position currently recorded in the relative position recording means. And the second relative position when the first relative position does not match the second relative position. When the calculation means for calculating the corresponding correction value and the correction value corresponding to the second relative position are calculated, the correction value recorded in the correction value recording means corresponds to the second relative position. Correction value rewriting means for rewriting to a correction value; and relative position rewriting means for rewriting the first relative position to the second relative position when a correction value corresponding to the second relative position is calculated. It is characterized by.

  The multi-projection system of the present invention is a multi-projection system that constructs one image from the images projected by a plurality of projectors, the correction value recording means for recording correction values, and the correction value recording means for recording. Correction means for correcting each image projected by the plurality of projectors based on a correction value to be detected; detection means for detecting a relative position between the plurality of projectors and projection destinations of the plurality of projectors; and the detection A relative position recording means for recording the relative position detected by the means; a first relative position recorded as a previous comparison in the relative position recording means; and a second relative position currently recorded in the relative position recording means. And the first relative position and the previous relative position when the first relative position and the second relative position do not match. Notification means for notifying a user of a message that the second relative position does not match; calculation means for calculating a correction value corresponding to the second relative position based on an instruction from the user; When the correction value corresponding to the second relative position is calculated, the correction value rewriting means for rewriting the correction value recorded in the correction value recording means to the correction value corresponding to the second relative position; And a relative position rewriting means for rewriting the first relative position to the second relative position when a correction value corresponding to the relative position is calculated.

  Further, the multi-projection system includes an imaging unit that captures one image constructed by the plurality of projectors, and the calculation unit is configured such that the first relative position and the second relative position do not coincide with each other. The correction value corresponding to the second relative position may be calculated based on the photographed image photographed by the photographing means.

  The multi-projection system further includes a determination unit that determines whether or not the correction value can be calculated, and the calculation unit can calculate the correction value by the determination unit. If it is determined that the situation is not correct, the correction value may be calculated.

  The multi-projection system includes recording means for recording a plurality of correction values, and the calculating means records the recording means when the first relative position and the second relative position do not match. Correction values corresponding to the relative positions before and after the second relative position are extracted from the plurality of correction values, and the correction values corresponding to the second relative position are determined based on the extracted correction values. You may comprise so that it may calculate.

  The detecting means may be configured to detect a relative position between the plurality of projectors and projection destinations of the plurality of projectors at a timing when the multi-projection system is activated.

The detection means may be configured to detect the relative position at a timing designated by a user.
Further, the detection means may be configured to detect the relative position at a timing at which a detection value detected by a G sensor installed at the projections of the plurality of projectors or the plurality of projectors exceeds a predetermined value. Good.

The detecting means may be configured to detect the relative position using a distance measuring sensor.
Further, the detection means may be configured to detect the relative position using a G sensor installed at the projections of the plurality of projectors or the plurality of projectors.

  The multi-projection system of the present invention is a multi-projection system that constructs one image from the images projected by a plurality of projectors, the correction value recording means for recording correction values, and the correction value recording means for recording. Correction means that corrects each image projected by the plurality of projectors based on the correction value, a G sensor installed at the projection destination of the plurality of projectors or the plurality of projectors, and the plurality of projectors. Photographing means for photographing one constructed image; and calculating means for calculating a correction value based on a photographed image photographed by the photographing means when vibration detected by the G sensor exceeds a predetermined value; When the correction value is newly calculated by the calculating means, the correction value recorded in the correction value recording means is updated. Characterized in that it comprises a correction value rewriting means for rewriting the calculated correction value to.

  The multi-projection system of the present invention is a multi-projection system that constructs one image from the images projected by a plurality of projectors, the correction value recording means for recording correction values, and the correction value recording means for recording. Correction means for correcting each image projected by the plurality of projectors based on the correction value to be taken, photographing means for photographing one image constructed by the plurality of projectors, and previous photographing by the photographing means. Anchor point comparing means for comparing the first anchor point shown in the photographed image with the second anchor point shown in the photographed image photographed this time by the photographing means; the first anchor point and the second anchor point; If the image does not match the anchor point of the Accordingly, a calculation unit that calculates a correction value, and a correction value that rewrites the correction value recorded in the correction value recording unit to the newly calculated correction value when a new correction value is calculated by the calculation unit. And a rewriting means.

  Further, the monitoring method of the present invention is a monitoring method of an image constructed by each image projected by a plurality of projectors, the step of recording a correction value in a correction value recording means, and the plurality of the plurality based on the correction value. Correcting each image projected by the projector, detecting a relative position between the plurality of projectors and projection destinations of the plurality of projectors, recording the relative position, and the correction value recording means Comparing the first relative position recorded for the previous comparison with the second relative position currently recorded in the correction value recording means, the first relative position and the second relative position, If the correction values corresponding to the second relative position are calculated, and the correction value corresponding to the second relative position is calculated, the correction value recording unit stores the correction value corresponding to the second relative position. When the correction value to be recorded is rewritten to the correction value corresponding to the second relative position, and the correction value corresponding to the second relative position is calculated, the first relative position is changed to the second relative position. And rewriting to the relative position.

  According to the present invention, “geometric misalignment” can be automatically detected, so that calibration can be appropriately performed. Thereby, even when one image is constructed using a plurality of projectors, it is possible to construct a good image without any “geometric misalignment” at all times.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing a multi-projection system according to an embodiment of the present invention.
A multi-projection system 1 shown in FIG. 1 includes a screen 2, projectors 3 and 4 that project two divided images including an overlap portion on the screen 2, and construct one image on the screen 2, and a test pattern projection instruction. PC 5 for instructing calibration and calibration, calibration camera 6 for capturing test patterns and divided images projected on the screen 2, and overlapping portions of the divided images projected by the projectors 3 and 4 are seamless. The image correction processing device 7 for correcting “geometric misalignment” and correcting each divided image (geometric correction, luminance correction, or color correction), and the relative positions of the projectors 3 and 4 and the screen 2 are displayed. And a distance measuring sensor 8 for detecting the position. In the multi-projector system 1, two projectors are used to simplify the description. Further, it is assumed that the projectors 3 and 4, the calibration camera 6, and the distance measuring sensor 8 are installed on the gantry 9. Further, the projectors 3 and 4 may be configured to construct an image at a place other than the screen 2.

  The PC 5 includes a CPU 10, a memory 11, a camera I / F 12, a distance measuring sensor I / F 13, an output I / F 14, and a user I / F 15. The user I / F 15 may be a keyboard or a mouse, for example.

  The CPU 10 activates based on an activation instruction sent from the user via the user I / F 15 and activates the distance sensor 8 to detect the relative position via the distance sensor I / F 13. Relative position detection processing for sending an instruction, calculation processing for calculating a correction value, comparison processing for comparing the relative position previously recorded as “comparison relative position” in the memory 11 with the relative position currently recorded in the memory 11, If the relative position does not match the current relative position, the test pattern recorded in the memory 11 is sent to the correction processing unit 16 of the image correction processing device 7 via the output I / F 14 to perform calibration, and the image correction processing device. 7, the correction value recorded in the correction value recording unit 17 is rewritten with the newly calculated correction value, and the “relative position for comparison” is stored in the memory 11 last time Perform such calibration instruction process of rewriting the recorded relative position to the newly recorded relative position this time. Note that the startup process, the relative position detection process, the calculation process, the comparison process, and the calibration instruction process are realized by executing an application recorded in a RAM, a ROM, or the like.

  The feature of the multi-projection system 1 of this embodiment is that the relative positions of the projectors 3 and 4 detected by the distance measuring sensor 8 and the screen 2 last time and the projectors 3 and 4 detected by the current distance measuring sensor 8 If the relative position with respect to the screen 2 does not match, it is determined that “geometric misalignment” has occurred in one image constructed on the screen 2, calibration is performed again, and 1 is calculated using the correction value calculated thereby. The point is to reconstruct two images. In the embodiment shown in FIG. 1, the distance measurement sensor 8 is installed on the mount 9 to detect the relative position of the projectors 3 and 4 with respect to the screen 2. May be configured to detect the relative position of the screen 2 with respect to the installation position of the projectors 3 and 4.

Next, the operation of the multi-projection system 1 will be described.
FIG. 2 is a flowchart showing the operation of the multi-projection system 1. It is assumed that the relative position detection process is performed at the timing when the multi-projection system 1 is activated by the activation process. Further, the relative position between the projectors 3 and 4 and the screen 2 is detected at the previous activation, and the relative position is recorded in the memory 11 as a “relative position for comparison”, and a correction value is also calculated and the correction value is calculated. It is assumed that it is recorded in the correction value recording unit 17.

  First, when the multi-projection system 1 is activated by a user or a timer, the PC 5 causes the distance measuring sensor 8 to detect the relative positions of the projectors 3 and 4 and the screen 2 in step S1.

Next, in step S <b> 2, the PC 5 records the detected relative position in the memory 11.
Next, in step S <b> 3, the PC 5 determines whether or not the previously recorded relative position matches the currently recorded relative position in the memory 11 as a “comparison relative position”.

  When it is determined that the previously recorded relative position matches the currently recorded relative position as “comparison relative position” in the memory 11 (No in step S3), in step S4, the image correction processing device 7 performs the previous correction. The divided image is corrected using the correction value recorded in the value recording unit 17.

  On the other hand, if it is determined that the previously recorded relative position does not match the currently recorded relative position as “comparison relative position” in the memory 11 (Yes in step S3), the PC 5 performs calibration in step S5. .

  That is, the PC 5 causes the calibration camera 6 to capture the test pattern projected from the projectors 3 and 4 and records the captured image in the memory 11 or the like. The PC 5 creates a correction value for correcting the “geometric shift” and the geometry, brightness, or color of each divided image based on the photographed image. When the divided images projected from the projectors 3 and 4 are distorted into trapezoids, the correction values are calculated so that the divided images of the projectors 3 and 4 are inverted trapezoids.

  For example, a lattice pattern image is used as a test pattern, a test pattern built on the screen 2 before correction is used as a test pattern before correction, a test pattern built on the screen 2 after correction is used as a test pattern after correction, and a calibration camera is used. A method for calculating a correction value when the arrangement of the image pickup elements 6 is used as basic coordinates, the arrangement of the output elements of the projector 3 is used as display coordinates, and the divided image of the projector 3 is distorted into a trapezoid due to the installation position of the projector 3 will be described. . Note that the corrected test pattern is constructed inside the maximum projection area of the projector 3.

First, the CPU 10 obtains each coordinate of the basic coordinate corresponding to each intersection of the lattice pattern of the test pattern before correction.
Next, the CPU 10 obtains each coordinate of the basic coordinate corresponding to each intersection of the lattice pattern of the corrected test pattern.

Next, the CPU 10 obtains a relative relationship between each coordinate of the test pattern before correction and each coordinate of the test pattern after correction.
Next, the CPU 10 obtains each coordinate of the display coordinate corresponding to each intersection of the lattice pattern of the test pattern before correction.

  Next, the CPU 10 determines each display coordinate corresponding to each intersection of the lattice pattern of the corrected test pattern based on the relative relationship between the coordinates of the test pattern before correction in the basic coordinates and the coordinates of the test pattern after correction. Find the coordinates.

Then, the CPU 10 sets a relative value between each coordinate of the test pattern before correction in the display coordinates and each coordinate of the test pattern after correction as a correction value.
The calibration is described in detail in JP-A-9-326981 and JP-A-6-141246.

  Next, in step S6, the PC 5 rewrites the previously recorded relative position as the “relative position for comparison” in the memory 11 to the relative position recorded this time, and the correction value recorded in the previous correction value recording unit 17 this time. The calculated correction value is rewritten. Thereby, the relative position detected this time can be compared with the relative position detected next time.

In step S <b> 7, the image correction processing device 7 corrects the image using the correction value recorded in the current correction value recording unit 17.
As described above, when the relative positions of the projectors 3 and 4 and the screen 2 do not coincide with the previously detected relative position, it is determined that the “geometric shift” has occurred, and the “geometric shift” can be automatically detected. Therefore, calibration can be performed as appropriate. Thereby, even when one image is constructed using a plurality of projectors, it is possible to construct a good image without any “geometric misalignment” at all times.

  In addition, since “geometric misalignment” is detected when the multi-projection system 1 is activated, it is possible to cope with a case where “geometric misalignment” occurs while the multi-projection system 1 is stopped.

  In the above embodiment, the calibration is automatically performed when the previous relative position does not match the current relative position. However, when the previous relative position does not match the current relative position, The user may be notified that the “geometric deviation” has occurred, and the calibration may be performed based on the user's instruction.

  FIG. 3 is a flowchart showing the operation of the multi-projection system 1 when performing calibration based on a user instruction. Similar to the flowchart shown in FIG. 2, it is assumed that the relative position detection process is performed at the timing when the multi-projection system 1 is activated by the activation process. Further, the relative position between the projectors 3 and 4 and the screen 2 is detected at the previous activation, and the relative position is recorded in the memory 11 as a “relative position for comparison”, and a correction value is also calculated and the correction value is calculated. It is assumed that it is recorded in the correction value recording unit 17.

  First, when the multi-projection system 1 is started by a user, a timer, or the like, in step ST1, the PC 5 causes the distance measuring sensor 8 to detect the relative positions of the projectors 3 and 4 and the screen 2, and stores the detected relative positions in the memory. 11 is recorded.

  Next, in step ST2, the PC 5 compares the previously recorded relative position with the currently recorded relative position in the memory 11 as the “relative position for comparison”, and the previously recorded relative position and the currently recorded relative position are compared. If they do not match, it is determined that a “geometric misalignment” has occurred. Further, the PC 5 determines that “geometric misalignment” has not occurred when the previously recorded relative position matches the currently recorded relative position.

  When it is determined that “geometric misalignment” has not occurred (No in step ST2), in step ST3, the image correction processing device 7 corrects the image using the correction value recorded in the previous correction value recording unit 17. .

  On the other hand, when it is determined that “geometric misalignment” has occurred (Yes in step ST3), in step ST4, the PC 5 notifies the user that “geometric misalignment” has occurred. For example, a message indicating that “geometric misalignment” has occurred may be displayed on a display provided in the PC 5, or a message indicating that “geometric misalignment” may have been output from a speaker provided in the PC 5.

Next, in step ST5, the PC 5 receives an instruction from the user as to whether or not to perform calibration via the user I / F 15.
When an instruction not to perform calibration is received (No in step ST5), the process proceeds to step ST3.

On the other hand, when an instruction to perform calibration is received (Yes in step ST5), the PC 5 performs calibration in step ST6.
Next, in step ST7, the PC 5 rewrites the previously recorded relative position as the “relative position for comparison” in the memory 11 to the relative position recorded this time, and the correction value recorded in the previous correction value recording unit 17 this time. The calculated correction value is rewritten.

In step ST8, the image correction processing apparatus 7 corrects the image using the correction value recorded in the correction value recording unit 17 this time.
In this way, since the user can determine whether or not to perform calibration, even if the user confirms the image constructed on the screen 2, a “geometric misalignment” that does not require calibration is generated. This function is effective when you do not have time to calibrate.

  In the above embodiment, when the previous relative position and the current relative position do not coincide with each other, it is determined that the “geometric deviation” has occurred, and the calibration is performed again. A plurality of relative positions between the projectors 3 and 4 and the screen 2 are predicted, correction values corresponding to the relative positions are calculated in advance and recorded in the memory 11, and the previous relative position and the current relative position are calculated. Does not match, the correction values respectively corresponding to the relative positions before and after the current relative position are extracted from the plurality of correction values in the memory 11 and correspond to the current relative position based on the extracted correction values. The correction value may be calculated.

  If the previous relative position does not match the current relative position, a correction value corresponding to the current relative position is calculated by performing calibration again, or a plurality of values recorded in the correction value recording unit 17 are recorded. Alternatively, the user may determine whether to calculate a correction value corresponding to the current relative position based on each correction value extracted from the correction values.

  FIG. 4 is a flowchart showing the operation of the multi-projection system 1 when the user selects a correction value calculation method. Similar to the flowchart shown in FIG. 2, it is assumed that the relative position detection process is performed at the timing when the multi-projection system 1 is activated by the activation process. Further, the relative position between the projectors 3 and 4 and the screen 2 is detected at the previous activation, and the relative position is recorded in the memory 11 as the “relative position for comparison”, and the correction value is also calculated and the correction value is calculated. It is assumed that it is recorded in the correction value recording unit 17.

  First, when the multi-projection system 1 is activated by a user or a timer, the PC 5 causes the distance measuring sensor 8 to detect the relative positions of the projectors 3 and 4 and the screen 2 in step STE1.

Next, in step STE2, the PC 5 records the detected relative position in the memory 11.
Next, in step STE3, the PC 5 compares the previously recorded relative position with the currently recorded relative position in the memory 11 as the “relative position for comparison”, and the previously recorded relative position and the currently recorded relative position are compared. If they do not match, it is determined that a “geometric misalignment” has occurred. Further, the PC 5 determines that “geometric misalignment” has not occurred when the previously recorded relative position matches the currently recorded relative position.

  When it is determined that “geometric misalignment” has not occurred (No in Step STE3), in Step STE4, the image correction processing device 7 corrects the image using the correction value recorded in the previous correction value recording unit 17. .

On the other hand, if it is determined that there is a “geometric shift” (step STE3 is Yes), in step STE5, the PC 5 notifies the user that a “geometric shift” has occurred.
Next, in step STE6, the PC 5 inquires of the user whether or not to change the correction value recorded in the correction value recording unit 17.

When an instruction not to change the correction value is received from the user (No in step STE6), the process proceeds to step STE4.
On the other hand, when an instruction to change the correction value is received from the user (Yes in step STE6), in step ST7, the PC 5 inquires of the user whether to perform calibration.

When an instruction to perform calibration is received from the user (Yes in step STE7), in step STE8, the PC 5 performs calibration.
Next, in step STE9, the PC 5 rewrites the previously recorded relative position as the “relative position for comparison” in the memory 11 to the relative position recorded this time, and the correction value recorded in the previous correction value recording unit 17 this time. The calculated correction value is rewritten.

In step ST10, the image correction processing device 7 corrects the image using the correction value recorded in the correction value recording unit 17 this time.
On the other hand, when an instruction not to perform calibration is received from the user (No in step STE7), in step STE11, correction values respectively corresponding to the relative positions before and after the relative position recorded this time are stored in the correction value recording unit 17. A correction value corresponding to the currently recorded relative position is calculated based on each of the extracted correction values, and the process proceeds to step STE9.

  That is, the relative position recorded this time is set to 3.05 [m], and the correction value corresponding to the relative position 3.0 [m] among the plurality of correction values recorded in the correction value recording unit 17 is set to C1. When the correction value corresponding to the position 3.2 [m] is C2, and the correction value corresponding to the relative position recorded this time is C3, for example, C3 is calculated by C3 = 0.75 × C1 + 0.25 × C2. . Thus, C3 may be calculated by weighting the correction values C1 and C2 corresponding to the relative positions before and after the relative position recorded this time.

  As described above, since the calculation method of the correction value is selected by the user, calibration can be prevented from being performed even though “geometric misalignment” actually occurs. This is effective when a “geometric misalignment” that does not require calibration even when the user confirms an image constructed on the screen 2 occurs or when there is no time for calibration.

  In the above embodiment, the calibration is performed based on the judgment of the user. Further, the calibration is performed after confirming whether or not the calibration is possible. Also good.

  FIG. 5 is a flowchart showing the operation of the multi-projection system when the calibration is performed after confirming whether or not the calibration is possible. Similar to the flowchart shown in FIG. 2, it is assumed that the relative position detection process is performed at the timing when the multi-projection system 1 is activated by the activation process. Further, the relative position between the projectors 3 and 4 and the screen 2 is detected at the previous activation, and the relative position is recorded in the memory 11 as the “relative position for comparison”, and the correction value is also calculated and the correction value is calculated. It is assumed that it is recorded in the correction value recording unit 17.

  First, when the multi-projection system 1 is activated by a user or a timer, the PC 5 causes the distance measuring sensor 8 to detect the relative positions of the projectors 3 and 4 and the screen 2 in step STEP1.

Next, in step STEP2, the PC 5 records the detected relative position in the memory 11.
Next, in step STEP 3, the PC 5 compares the previously recorded relative position with the currently recorded relative position in the memory 11 as the “relative position for comparison”, and the previously recorded relative position and the currently recorded relative position are compared. If they do not match, it is determined that a “geometric misalignment” has occurred. Further, the PC 5 determines that “geometric misalignment” has not occurred when the previously recorded relative position matches the currently recorded relative position.

  If it is determined that no “geometric misalignment” has occurred (No in step STEP 3), in step STEP 4, the image correction processing device 7 uses the correction value recorded in the previous correction value recording unit 17 to generate an image. to correct.

On the other hand, when it is determined that “geometric misalignment” has occurred (Yes in step STEP 3), in step STEP 5, the PC 5 notifies the user that there is a “geometric misalignment”.
Next, in step STEP6, the PC 5 determines whether or not the calibration is possible.

  For example, the PC 5 determines whether or not all the projectors (PJ) are normally activated based on the captured image of the calibration camera 6, or the projector is normally activated such as “Active” or “Lamp normal”. The PC 5 may receive and determine that it has been activated. Alternatively, the PC 5 may receive and determine from the optical sensor that the surrounding area is moderately dark.

  If it is determined that the calibration is not possible (No in Step STEP6), the PC 5 stops the calibration in Step STEP7.

Next, in step STEP 8, the image correction processing device 7 corrects the image using the correction value recorded in the previous correction value recording unit 17.
On the other hand, when it is determined that the calibration can be performed (step STEP6 is Yes), the PC5 performs calibration in step STEP9.

  Next, in step STEP 10, the PC 5 rewrites the relative position previously recorded as “comparison relative position” in the memory 11 to the relative position recorded this time, and the correction value recorded in the previous correction value recording unit 17 this time. The calculated correction value is rewritten.

In step STEP 11, the image correction processing device 7 corrects the image using the correction value recorded in the correction value recording unit 17 this time.
In the above embodiment, it is configured to determine whether or not “geometric misalignment” has occurred based on the relative position detected by the distance measuring sensor 8, but G installed on the gantry 9, the screen 2, or the like. Based on the detection value of a sensor (for example, G sensor capable of detecting tilt, movement, or vibration), it may be configured to determine whether or not “geometric deviation” has occurred.

FIG. 6 is a diagram showing a multi-projection system using a G sensor. In addition, the same code | symbol is attached | subjected to the same structure as the structure shown in FIG.
A feature of the multi-projection system 60 shown in FIG. 6 is that the distance measuring sensor 8 shown in FIG. 1 is changed to the G sensor 61 and the distance measuring sensor I / F 12 is changed to the G sensor I / F 62.

The PC 5 operates the G sensor 61 even when the multi-projection system 60 is at rest, and records a log indicating the detection value of the G sensor 61 in the memory 11.
Next, when the multi-projection system 60 is activated, the PC 5 determines whether or not the detection value (tilt, movement, or vibration) of the G sensor 61 is greater than or equal to a predetermined value.

  When it is determined that the detection value of the G sensor 61 is equal to or greater than the predetermined value, the PC 5 performs calibration again and rewrites the correction value recorded in the previous correction value recording unit 17 with the correction value calculated this time.

Then, the image correction processing device 7 corrects the image using the correction value recorded in the correction value recording unit 17 this time.
A relative position between the projectors 3 and 4 and the screen 2 is calculated based on the inclination or movement detected by the G sensor, and correction values respectively corresponding to the relative positions before and after the calculated relative position are calculated as correction value recording units. The correction value corresponding to the calculated relative position may be calculated based on each of the extracted correction values.

  Further, a log indicating the detection value of the G sensor 61 may be recorded in a recording device other than the memory 11, and the log may be transferred from the recording device to the PC 5 when the multi-projection system 60 is activated.

When a plurality of G sensors 61 are used, the PC 5 may determine whether or not “geometric deviation” has occurred based on the maximum value among the plurality of detection values.
As described above, when the detection value of the G sensor 61 is equal to or greater than the predetermined value, it is determined that the “geometric deviation” has occurred. Even if it occurs, after the multi-projection system 60 is activated, an image without “geometric misalignment” can be automatically constructed on the screen 2.

  In the above embodiment, it is configured to determine whether or not “geometric misalignment” has occurred based on the values detected by the distance measuring sensor 8 and the G sensor 61. However, the image captured by the calibration camera 6 is used. Based on the image, it may be configured to determine whether or not “geometric misalignment” has occurred.

For example, the “geometric misalignment” may be detected by comparing the photographed image recorded in the memory 11 with the photographed image recorded in the memory 11 this time.
FIG. 7 is a diagram illustrating an image 70 when one image 70 (broken line) is constructed on the screen 2. It is assumed that the image 70 is constructed by arranging the divided images 71 to 74 projected from the four projectors in two vertical rows and two horizontal rows.

  As shown in FIG. 7, in order to seamlessly overlap each overlap portion 75 of each of the divided images 71 to 74, the maximum projection area 76 (dashed line) by the four projectors is detected and recorded in advance. It is necessary to keep.

  As described above, by storing the projection area 76, the display sizes of the divided images 71 to 74 can be determined so that the image 70 fits in the projection area 76. Can be seamlessly superimposed on each other.

  For example, when the multi-projection system is activated, the positions of the four corners (hereinafter referred to as anchor points) 77 of the projection area 76 are detected and recorded in the memory 11, and the anchor point 77 recorded last time and the anchor point 77 recorded this time are recorded. May not be coincident with each other, it may be determined that “geometric misalignment” has occurred, and the correction value recorded in the correction value recording unit 17 may be changed by performing calibration again.

  In the above-described embodiment, the configuration is such that it is determined whether or not “geometric misalignment” has occurred when the multi-projection systems 1 and 60 are activated, but whether or not “geometric misalignment” has occurred at the timing specified by the user. It may be configured to determine.

  The image constructed on the screen 2 may change in accordance with changes in the temperature in the projector, the type of lamp, or the ambient temperature of the projector. For this reason, it is better to determine whether or not “geometric misalignment” has occurred after the multi-projection systems 1 and 60 are activated and the temperature in the projector and the ambient temperature have stabilized.

  For example, the distance measurement start time and the calibration start time of the distance measurement sensor 8 are sufficiently set to be 20 minutes after the multi-projection systems 1 and 60 are activated or after the projection of the projectors 3 and 4 is completed. It may be performed when the internal temperature or the ambient temperature is stabilized.

  In this way, it is possible to determine whether or not “geometric misalignment” has occurred at a timing when the temperature in the projector and the ambient temperature are stable, so the temperature in the projector, the type of lamp, or the ambient temperature of the projector The “geometric misalignment” can be accurately corrected without being affected by the above.

  Also. It may be configured to determine whether or not “geometric deviation” has occurred at a timing when the detection value (tilt, movement, or vibration) of the G sensor installed on the gantry 9 or the screen 2 exceeds a predetermined value.

It is a figure which shows the multi-projection system of embodiment of this invention. It is a flowchart which shows operation | movement of a multi-projection system. It is a flowchart which shows operation | movement of a multi-projection system. It is a flowchart which shows operation | movement of a multi-projection system. It is a flowchart which shows operation | movement of a multi-projection system. It is a figure which shows the multi-projection system of other embodiment of this invention. It is a figure which shows the image when four projectors are used and one image is constructed | assembled on the screen. It is a figure which shows the existing multiprojection system.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Multi-projection system 2 Screen 3, 4 Projector 5 Personal computer 6 Camera for calibration 7 Image correction processing device 8 Distance sensor 9 Base 10 CPU
11 Memory 12 Camera I / F
13 Distance sensor I / F
14 Output I / F
15 User I / F
16 Correction processing unit 17 Correction value recording unit 60 Multi-projection system 61 G sensor 62 G sensor I / F

Claims (13)

A multi-projection system for constructing one image from images projected by a plurality of projectors,
Correction value recording means for recording the correction value;
Correction means for correcting each image projected by the plurality of projectors based on a correction value recorded in the correction value recording means;
Detecting means for detecting relative positions of the plurality of projectors and projection destinations of the plurality of projectors;
Relative position recording means for recording the relative position detected by the detection means;
A comparison means for comparing the first relative position recorded for comparison in the relative position recording means with the second relative position recorded this time in the relative position recording means;
A calculating means for calculating a correction value corresponding to the second relative position when the first relative position and the second relative position do not match;
When a correction value corresponding to the second relative position is calculated, a correction value rewriting means for rewriting the correction value recorded in the correction value recording means to a correction value corresponding to the second relative position;
When a correction value corresponding to the second relative position is calculated, relative position rewriting means for rewriting the first relative position to the second relative position;
A multi-projection system comprising: A multi-projection system for constructing one image from images projected by a plurality of projectors,
Correction value recording means for recording the correction value;
Correction means for correcting each image projected by the plurality of projectors based on a correction value recorded in the correction value recording means;
Detecting means for detecting relative positions of the plurality of projectors and projection destinations of the plurality of projectors;
Relative position recording means for recording the relative position detected by the detection means;
A comparison means for comparing the first relative position recorded for comparison in the relative position recording means with the second relative position recorded this time in the relative position recording means;
A notification means for notifying a user of a message that the first relative position and the second relative position do not match if the first relative position and the second relative position do not match;
Calculation means for calculating a correction value corresponding to the second relative position based on an instruction from the user;
When a correction value corresponding to the second relative position is calculated, a correction value rewriting means for rewriting the correction value recorded in the correction value recording means to a correction value corresponding to the second relative position;
When a correction value corresponding to the second relative position is calculated, relative position rewriting means for rewriting the first relative position to the second relative position;
A multi-projection system comprising: The multi-projection system according to claim 1 or 2,
A photographing means for photographing one image constructed by the plurality of projectors;
The calculating means calculates a correction value corresponding to the second relative position based on a photographed image photographed by the photographing means when the first relative position and the second relative position do not match. To
Multi-projection system characterized by this. The multi-projection system according to claim 3,
A determination means for determining whether or not the correction value can be calculated;
The calculation unit calculates a correction value when the determination unit determines that the correction value can be calculated.
Multi-projection system characterized by this. The multi-projection system according to claim 1 or 2,
Comprising a recording means for recording a plurality of correction values;
When the first relative position and the second relative position do not match, the calculating means sets a relative position before and after the second relative position from among a plurality of correction values recorded in the recording means. Each corresponding correction value is extracted, and a correction value corresponding to the second relative position is calculated based on each extracted correction value.
Multi-projection system characterized by this. The multi-projection system according to claim 1 or 2,
The detecting means detects the relative position at a timing when the multi-projection system is activated;
Multi-projection system characterized by this. The multi-projection system according to claim 1 or 2,
The detecting means detects the relative position at a timing specified by a user;
Multi-projection system characterized by this. The multi-projection system according to claim 1 or 2,
The detection means detects the relative position at a timing when a detection value detected by a G sensor installed at a projection destination of the plurality of projectors or the plurality of projectors exceeds a predetermined value.
Multi-projection system characterized by this. The multi-projection system according to claim 1 or 2,
The detecting means detects the relative position using a distance measuring sensor;
Multi-projection system characterized by this. The multi-projection system according to claim 1 or 2,
The detection means detects the relative position using a G sensor installed at the projection destinations of the plurality of projectors or the plurality of projectors,
Multi-projection system characterized by this. A multi-projection system for constructing one image from images projected by a plurality of projectors,
Correction value recording means for recording the correction value;
Correction means for correcting each image projected by the plurality of projectors based on a correction value recorded in the correction value recording means;
G sensors installed at the projection destinations of the plurality of projectors or the plurality of projectors;
Photographing means for photographing one image constructed by the plurality of projectors;
Calculating means for calculating a correction value based on a photographed image photographed by the photographing means when the vibration detected by the G sensor exceeds a predetermined value;
A correction value rewriting means for rewriting the correction value recorded in the correction value recording means to the newly calculated correction value when a new correction value is calculated by the calculating means;
A multi-projection system comprising: A multi-projection system for constructing one image from images projected by a plurality of projectors,
Correction value recording means for recording the correction value;
Correction means for correcting each image projected by the plurality of projectors based on a correction value recorded in the correction value recording means;
Photographing means for photographing one image constructed by the plurality of projectors;
Anchor point comparing means for comparing the first anchor point shown in the photographed image previously taken by the photographing means and the second anchor point shown in the photographed image taken this time by the photographing means;
When the first anchor point and the second anchor point do not coincide with each other, a calculation unit that calculates a correction value based on a captured image that is currently captured by the imaging unit;
When a correction value is newly calculated by the calculation means, a correction value rewriting means for rewriting the correction value recorded in the correction value recording means to a newly calculated correction value;
A multi-projection system comprising: An image monitoring method constructed by images projected by a plurality of projectors,
Recording the correction value in the correction value recording means;
Correcting each image projected by the plurality of projectors based on the correction value;
Detecting relative positions of the plurality of projectors and projection destinations of the plurality of projectors;
Recording the relative position;
Comparing the first relative position recorded in the correction value recording means for the previous comparison with the second relative position recorded this time in the correction value recording means;
When the first relative position and the second relative position do not match, calculating a correction value corresponding to the second relative position;
When a correction value corresponding to the second relative position is calculated, rewriting the correction value recorded in the correction value recording means to a correction value corresponding to the second relative position;
When a correction value corresponding to the second relative position is calculated, rewriting the first relative position to the second relative position;
A monitoring method consisting of: