JP2001083949A - Image projecting device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To save the labor of an installation adjustment work of a device for projecting an image on a screen. SOLUTION: In the state where an image projected by a projector 2 arranged obliquely relative to a screen 1 having a free curved surface is observed at a certain viewpoint position 7, a test image is projected, and the test image is photographed by a camera 4 on the viewpoint position 7, and correction data for giving reverse strain beforehand is produced beforehand, and correction treatment of the image required to be projected is executed by the correction data, and the image is projected by the projector 2, and hereby a right image having no strain can be obtained, viewing from the viewpoint position 7.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image projection apparatus for projecting an image on a screen by a projector, an image projection method, and a recording medium on which an image projection program is recorded. Video projection device having a function to correct the image, video projection method,
And a recording medium.

[0002]

2. Description of the Related Art In recent years, the use of video projectors for presenting video images from projectors has been increasing. For example, a presentation device using a notebook PC and a projector for mobile applications, a wide-field screen, a highly realistic device using one or more projectors, and a multi-screen such as the CAVE of the University of Illinois. There is a device for providing a VR environment using a projector. In a presentation device for mobile use, in many cases, a screen and a projector are installed only when used, and then withdrawn after use, and the simplicity of the installation work is required from the use. However, a temporary screen used in such an environment is apt to be loosened, and a fine installation adjustment operation is required to display an image without distortion.

[0003] In an apparatus using a wide-field screen or a multi-sided screen, a permanent screen is often used. In this case, the shape of the screen is often a curved surface such as a spherical surface or a cylindrical shape, or a box shape, and it is necessary to initially install the screen in a shape and position as designed. In particular, in an image presenting apparatus using a plurality of projectors, an installation operation for adjusting the installation positions of the projectors and the screen is required so that the images of the projectors are connected well on the screen. In addition, periodic maintenance work for adjusting the droop of the screen due to aging, the change in the characteristics of the projector, the positional deviation, and the like is required. These operations are troublesome even for specialists, and there is a demand for simplification of these installation operations. Conventionally, as an example of simplifying installation work by reducing distortion of an image projected on a screen, an apparatus having a function of automatically correcting distortion by taking a test image using a camera, Image projection device "
(JP-A-10-200836).

Hereinafter, the first conventional example will be described with reference to the drawings. FIG. 2 is a block diagram of an image projection apparatus as a first conventional example. In FIG.
Is a screen for projecting an image, 102 is a test image, 1
03 is a pattern generating circuit for generating the test image 102;
104, a D / A conversion circuit for converting a video signal from a digital signal to an analog signal; 105, a projector for projecting an image on a screen 101; 106, a test image 102
A switch 107 for switching between a video signal of the camera 106 and an external video signal;
Reference numeral 8 denotes an A / D conversion circuit for converting a video signal from an analog signal to a digital signal; 109, a pattern extraction circuit for extracting image data of only the test image 102; 110, a CPU for calculating a distortion correction amount; , A switch 112 for switching a video signal, 1
Reference numeral 13 denotes a distortion correction circuit that corrects a video signal.

[0005] In the first conventional example, the following is disclosed in the embodiment for the detailed operation. In the first conventional example, the test image only needs to be two line segments having the same length arranged vertically or horizontally and has a rectangle such as a square or a rectangle. In the first conventional example, as a condition for arranging the devices, the normal of the screen and the optical axis of the lens of the projector need not be parallel, but the normal of the screen and the optical axis of the camera are: Must be parallel. In the first conventional example, if the angle between the optical axis of the projector and the normal to the screen is smaller than the angle between the optical axis of the camera and the normal to the screen, a certain correction effect can be obtained. Is obtained.

FIG. 3 is an overall flowchart of the first conventional example. FIG. 4 is a diagram illustrating test images before and after correction in the first conventional example.

First, a pattern generating circuit 103 generates a square test image 102, which passes through a changeover switch 112, a distortion correction circuit 113 without processing, and a D / A conversion circuit 104. 3 is projected on the screen 101 by the projector 105 (FIG. 3).
Step S101). At this time, if the optical axis of the projector 105 is displaced from the normal of the screen 101, FIG.
As shown in (a), the projected image of the test image 102 on the screen 101 is transformed into a trapezoidal shape. Next, the deformed test image 102 is photographed by the camera 106 directed to the screen 101, and the A / D conversion circuit 108
Is input to the pattern extraction circuit 109 (step S102 in FIG. 3). The pattern extraction circuit 109 extracts the image data of only the test image 102, and calculates the distortion amount of the test image 102 and the correction amount for correcting the distortion as C
The calculation is performed by the PU 110, and the correction data is stored in the memory 111 (Step S103 in FIG. 3).

Next, the procedure of calculating the amount of distortion and generating correction data in step S103 will be described. FIG. 5 is a flowchart showing a flow of processing including calculation of the first distortion amount and generation of correction data. Test image 1 extracted
02 from the difference between the length of the upper side and the lower side and the ratio of the distance between the upper side and the lower side.
5, the amount of change per unit interval in the up-down direction is determined, and is set as the amount of distortion in the up-down direction (step S103- in FIG. 5).
1). Similarly, the amount of change per unit interval in the left-right direction is determined from the difference between the length of the left side and the right side of the extracted test image 102 and the ratio of the interval between the left side and the right side, and is set as the amount of distortion in the left-right direction. (Step S103-2 in FIG. 5). From the above-mentioned vertical and horizontal distortion amounts, correction data for pre-distortion is obtained by a linear interpolation method or the like (step S103-3 in FIG. 5).

Next, an external video signal to be projected onto the screen without distortion is input to a distortion correction circuit 113 via a changeover switch 107, an A / D conversion circuit 108, and a changeover switch 112. In the distortion correction circuit 113, according to the distortion correction data stored in the memory 111,
The video signal is corrected (step S104 in FIGS. 4B and 5), and the corrected video signal is input to the projector 105 via the D / A conversion circuit 104. Projector 10
5 is projected onto the screen 101 to obtain an image without distortion (shown in FIG. 4C) (step S105 in FIG. 5). Also,
As another conventional example, in order to display an image projected by a plurality of projectors as one continuous image, a device having a function of overlapping a part of an image to be projected and giving a distortion to the image in advance, Video Display Method and Apparatus "(JP-A-6-178327). Less than,
The second conventional example will be described with reference to the drawings. FIG. 6 is a block diagram of a second conventional example of a high-presence image display method and its apparatus. In FIG.
Reference numerals 1a, 201b, and 201c denote projection means for projecting video signals, 202a, 202b, and 202c denote projection conversion means for correcting image distortion, and 203a, 203b, and 203c denote continuous image conversion for converting a projected image into a continuous one. The means 204 is a screen on which an image is projected.

FIG. 7 is a diagram showing the shape of a projected image. In FIG. 7, reference numerals 205a, 205b, and 205c denote images projected without performing projection transformation, and 206a, 206
b, 206c are images projected after performing projection transformation,
207m and 207n are overlapping portions of the images.

Next, a description will be given of an outline of processing of the above-mentioned second prior art high reality image display method and its apparatus. The input video signal is output from the continuous image conversion unit 2 for the overlapping portions 207m and 207n of the image assumed in advance.
03, the brightness and the like are adjusted so that the two images overlap smoothly, the projective transformation means 202 presupposes the distortion due to oblique projection, and adds the opposite distortion to the image signal to cancel the distortion of the image, 206a in FIG.
By projecting the image subjected to the projection conversion so as to form the rectangles 206b and 206c, it is possible to obtain an image in which a plurality of images projected obliquely to the screen are smoothly continuous without distortion.

[0012]

However, in the above-described structure shown in the first conventional example, a certain correction effect can be expected if the screen is flat.
There is a problem that distortion cannot be accurately corrected for a screen that is not necessarily flat, such as a loose screen.

In the above-described configuration shown in the first conventional example, the viewpoint position of the observer, the camera position, and the projector position must be matched, and the viewpoint position and the projector position must be matched. There has been a problem that it is not possible to freely set the position to provide an image without distortion. Further, in the above-described configuration shown in the first conventional example, although the distortion can be corrected within a certain range, in order to project the size and position of the corrected image on the screen as desired, It is necessary to change the position and orientation of the projector or adjust the optical lens system to generate correction data again, and there is a problem that installation work takes time and effort. Further, in the above-described configuration shown in the first conventional example, after the correction data is generated once, if the shape of the screen changes, it is necessary to perform distortion correction again, and external distortion such as wind and vibration is required. There is a problem that this cannot be used in an environment where the screen shape changes frequently due to factors.

Further, in the above-described configuration shown in the second conventional example, after carefully examining the screen shape and the projector characteristics, the distortion correction data is calculated when designing the installation position, and the distortion correction data is calculated. The data had to be incorporated in the device in advance. For this reason, if the screen shape, the projector position, and the orientation cannot be set strictly according to the design specifications during the installation work of the apparatus, a sufficient effect cannot be obtained, and this installation work requires time and effort. There was a problem that it took. Further, in the above-described configuration shown in the second conventional example, in order to display images from a plurality of projectors as one continuous image on a screen, a part of the image is overlapped and the luminance of the part is adjusted. , So that the seam is not noticeable. For this reason, there is a problem in that a parameter adjustment operation for luminance adjustment is required at the time of installation, and a real-time luminance adjustment process is performed on an overlapping portion of an image at the time of projection.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is possible to easily remove distortion of a free-form screen without checking the screen shape in advance and without strictly adjusting the arrangement of the projector. It is an object of the present invention to provide a video projection device, a video projection method, and a recording medium on which a video projection program is recorded, which can obtain no video. In addition, even if the viewpoint position of the observer, the position of the camera that captures the test image, and the position of the projector are freely set, it is possible to obtain an image without distortion when viewed from the viewpoint position of the observer. It is an object of the present invention to provide a projection device, a video projection method, and a recording medium on which a video projection program is recorded. In addition, an image projection method and an image projection apparatus capable of presenting an image of a desired size at a desired position on a screen without changing a position or an orientation of a projector or a screen while performing distortion correction. And a recording medium on which a video projection program is recorded. It is another object of the present invention to provide a video projection method, a video projection device, and a recording medium on which a video projection program is recorded, which can provide a video without distortion in a state where the screen shape changes frequently. In addition, the present invention provides a video projection method, a video projection device, and a recording medium on which a video projection program is recorded, which can obtain videos from a plurality of projectors as one continuous video without strictly adjusting the arrangement of the projectors. It is intended to be.

[0016]

According to a first aspect of the present invention, there is provided a video projection apparatus for generating a test image, comprising: a test image generating unit configured to generate a test image; Means for photographing a projected image of the projected test image and outputting the photographed image as a photographed image; and comparing the generated test image and the photographed image to calculate a distortion amount of the projected image. Means, correction data generating means for generating correction data for giving an inverse distortion to an image in advance so that an image can be projected from the distortion amount without distortion, and correction data storage means for holding the correction data, It is characterized by having. A video projection device according to a second aspect of the present invention is the video projection device according to the first aspect, wherein: a video input unit that receives a video;
Video correction means for performing a correction process on the received video with the correction data stored in the correction data storage means and outputting the corrected video data to the video projection means. According to a third aspect of the present invention, in the video projection apparatus according to the second aspect, the video correction unit also performs a mask process for lowering the luminance of a part of the pixels constituting the image to be processed. Is a thing,
It is characterized by the following. According to a fourth aspect of the present invention, in the video projection apparatus according to any one of the first to third aspects, the imaging unit captures and captures an entire screen including a projected video of the projected test image. Output as an image, further comprising screen extracting means for extracting geometric information of the screen from the captured image, wherein the distortion amount calculating means generates the test image, the captured image, The distortion amount of the projected image is calculated from the geometric information of the screen.

According to a fifth aspect of the present invention, in the video projection device according to any one of the first to fourth aspects, an area on a screen on which an image after the correction processing is to be projected is set as a projection designated area, Viewpoint, video projection means, imaging means, and input means for inputting at least one of each position and orientation of the screen, the screen shape, and the projection designated area as installation conditions, the distortion amount correction means, The distortion amount of the projected image is calculated in consideration of the installation condition of the input unit.

According to a sixth aspect of the present invention, in the video projection apparatus according to the fifth aspect, the input means displays a graphic representing a screen and a graphic representing a projected image of a test image in a superimposed manner. The user designates a projection designation area on the screen.

According to a seventh aspect of the present invention, in the video projection device according to any one of the second to sixth aspects, the video projection means displays an image corrected by the video correction means on a screen. And projecting the test image of the test image generating means on a screen in a certain wavelength range other than the visible light range. The photographing means photographs a projected image of the projected test image in the above wavelength range. Is characterized in that:

According to an eighth aspect of the present invention, in the video projection apparatus according to any one of the first to seventh aspects, the test image has position information known in advance.
And a plurality of feature points having an identifier.

According to a ninth aspect of the present invention, in the video projector of the eighth aspect, the test image is one in which each feature point is lit one by one or sequentially lit. It is assumed that.

According to a tenth aspect of the present invention, there is provided the image projection apparatus according to the eighth or ninth aspect,
The test image is characterized in that each feature point is of a different color.

According to an eleventh aspect of the present invention, in the video projection apparatus according to any one of the eighth to tenth aspects, the test image is such that each feature point blinks at a different cycle. It is characterized by the following.

According to a twelfth aspect of the present invention, in the video projection apparatus according to any one of the eighth to eleventh aspects, the test image has a plurality of feature points arranged at equal intervals in the vertical and horizontal directions. Is characterized in that:

A video projection method according to a thirteenth aspect of the present invention provides a test image generation step of generating a test image, a video projection step of projecting the image on a screen, and capturing a projected video of the projected test image. A photographing step of outputting as a photographed image; a generated test image; and a distortion amount calculating step of comparing the photographed image with the photographed image to calculate a distortion amount of a projected image. And a correction data generating step of generating correction data for giving a reverse distortion to an image in advance, and a correction data storing step of storing the correction data.

According to a fourteenth aspect of the present invention, in the video projection method according to the thirteenth aspect, an image input step of receiving an image and storing the received image in the correction data storing step. And a video correction step of performing a correction process using the correction data and outputting the result to the video projection step.
An image projection method according to a fifteenth aspect of the present invention is the first aspect of the invention.
5. In the video projection method according to 4, the video correction step includes:
The image processing apparatus further includes a step of also performing a mask process for lowering the luminance of a part of the pixels constituting the image to be processed.

[0027] According to a sixteenth aspect of the present invention, in the video projection method according to any one of the thirteenth to fifteenth aspects, the photographing step includes the steps of: displaying the entire screen including the projected test image of the projected test image; The method further comprises a screen extracting step of taking out the geometrical information of the screen from the photographed image, and outputting the geometric information of the screen from the photographed image, wherein the distortion amount calculating step comprises: The distortion amount of the projected image is calculated from the image and the geometric information of the screen.

According to a seventeenth aspect of the present invention, in the video projection method according to any one of the thirteenth to sixteenth aspects, an area on a screen where an image after the correction processing is to be projected is set as a projection designated area. , Viewpoint, image projection means,
An input step of inputting, as installation conditions, at least one of a photographing unit and each position and orientation of the screen, a screen shape, and a projection designation area, and the distortion correction step includes setting the input step. Considering the conditions,
The distortion amount of the projected image is calculated. An image projection method according to claim 18 of the present invention is the image projection method according to claim 17, wherein the input step includes displaying a graphic representing a screen and a graphic representing a projected image of a test image in a superimposed manner. Wherein the user designates a projection designation area.

[0029] According to a nineteenth aspect of the present invention, in the video projection method according to any one of the fourteenth to eighteenth aspects, the image projection step includes the step of displaying the image corrected in the image correction step on a screen. Projecting, and projecting the test image generated in the test image generation step on a screen in a certain wavelength range other than the visible light range, wherein the shooting step shoots a projected image of the projected test image in the above wavelength range. Is characterized by the following.

[0030] In a video projection method according to a twentieth aspect of the present invention, in the video projection method according to any one of the thirteenth to nineteenth aspects, the test image includes a plurality of test images whose position information is known in advance and which has an identifier. It is characterized by being constituted by characteristic points.

According to a twenty-first aspect of the present invention, in the video projection method according to the twentieth aspect, the test image is such that each feature point is lit one by one or sequentially. It is characterized by the following.

According to a twenty-second aspect of the present invention, in the video projection method according to the twentieth or twenty-first aspect, each of the test images is of a different color. It is.

[0033] In a video projection method according to a twenty-third aspect of the present invention, in the video projection method according to any one of the twentieth to twenty-second aspects, each of the test images blinks at a different cycle. It is characterized by the following.

According to a twenty-fourth aspect of the present invention, in the video projection method according to any one of the twentieth to twenty-third aspects, the test image includes a plurality of feature points at equal intervals in the vertical and horizontal directions. Are characterized by the fact that they are arranged in a row.

According to a twenty-fifth aspect of the present invention, there is provided a recording medium storing a video projecting program, comprising: a procedure for generating a test image; And a distortion amount calculation procedure for calculating the distortion amount of the projected image, and a correction data generation procedure for generating correction data for giving an inverse distortion to the image in advance to project the image from the distortion amount without distortion. And causing the computer to execute the correction data storage procedure for holding the correction data.

According to a twenty-sixth aspect of the present invention, there is provided a recording medium storing a video projection program according to the twenty-fifth aspect, wherein the video projection program corrects a received video with correction data. The image processing apparatus further includes a video correction procedure for correcting the held correction data in the storage procedure and projecting the correction data on a screen.

According to a twenty-seventh aspect of the present invention, there is provided a recording medium storing a video projection program according to the twenty-sixth aspect of the present invention, wherein the video correction procedure comprises the steps of: And a processing procedure for also performing a mask process for lowering the luminance for a part of

According to a twenty-eighth aspect of the present invention, there is provided a recording medium storing a video projection program according to any one of the twenty-fifth to twenty-fourth aspects, wherein the projection image of a projected test image is recorded on the recording medium having the video projection program recorded thereon. A screen extraction procedure for extracting geometric information of the screen from a captured image of the entire screen including the above is added, and the distortion calculation procedure includes the generated test image, the captured image, and the screen. From geometric information,
The distortion amount of the projected image is calculated.

A recording medium storing the video projection program according to claim 29 of the present invention is intended to project the image after the correction processing on the recording medium storing the video projection program according to any one of claims 25 to 28. An input procedure for inputting, as an installation condition, at least one of a viewpoint, a video projecting unit, a photographing unit, and each position and orientation of the screen, a screen shape, and a projection designated region, where a region on the screen is a designated projection region. Wherein the distortion amount correction procedure calculates the distortion amount of the projected image in consideration of the installation conditions as well.

According to a thirty aspect of the present invention, there is provided a recording medium storing a video projection program according to the thirty-ninth aspect, wherein the input procedure is to project a graphic representing a screen and a test image. On a screen on which a graphic representing a video is superimposed and displayed, a user specifies a designated projection area.

According to a thirty-first aspect of the present invention, there is provided a recording medium storing a video projection program according to any one of the twenty-fifth to thirty-fifth aspects, wherein the test image has position information in advance. It is characterized by comprising a plurality of known feature points having an identifier.

A recording medium on which the video projection program according to claim 32 of the present invention is recorded is a recording medium on which the video projection program according to claim 31 is recorded, wherein each test point of the test image is lit one by one, or The lighting is performed sequentially.

According to a thirty-third aspect of the present invention, there is provided a recording medium storing a video projection program according to the thirty-first or thirty-second aspect, wherein the test image has a color different from that of each feature point. Which is characterized in that:

A recording medium on which the video projection program according to claim 34 of the present invention is recorded is a recording medium on which the video projection program according to any one of claims 31 to 33 is recorded. It flashes at a different cycle.

A recording medium storing the video projection program according to claim 35 of the present invention is a storage medium storing the video projection program according to any one of claims 31 to 34, wherein the test image includes a plurality of feature points. Are arranged at equal intervals in the vertical and horizontal directions, respectively.

[0046]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS (Embodiment 1) Hereinafter, an image projection apparatus according to Embodiment 1 of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a device configuration of a video projection device according to Embodiment 1 of the present invention. In FIG. 1, reference numeral 1 denotes a screen for projecting an image, 2 denotes a projector (image projecting means) for projecting onto the screen 1, 3 denotes a projected image projected on the screen 1 by the projector 2,
Denotes a camera (photographing means) for photographing the screen 1 and the projected image 3, 5 denotes a video source (video input means) for outputting a video signal, 6 denotes correction data generated from data from the camera 4, and the generated correction data Video source 5 based on
Video correction device that performs correction processing on video signals from
7 is a viewpoint position of the observer.

Here, the projector 2 is, specifically, a liquid crystal projector, a CRT projector, a DLP
(Digital Light Processing) type projector, overhead projector, etc.
Is a personal computer or CPU
And a one-board microcomputer incorporating a DSP (Digital Signal Processor) and a program incorporated therein. Further, specific examples of the camera 4 include a video camera and a digital still camera. Specific examples of the video source 5 include a video recorder, a video disc player, a broadcast tuner, a video camera, and a personal computer. Note that the video source 5 and the camera 4 may be configured to be included in the video correction device 6. In the first embodiment, the screen 1
Is not necessarily required to be a flat surface, but is assumed to be a free-form surface. Further, the viewpoint position 7 and the camera 4
And the direction coincide with each other. It is assumed that the screen 1 is large enough to display the entire projection image 3.

FIG. 8 is a diagram showing a hardware configuration of the video projection device according to the first embodiment. In the video projection device according to the first embodiment, the video correction device 6 is used.
Video projection processing is performed by using a computer system having a recording medium storing a video projection processing program by the video projection apparatus of the first embodiment. In the figure, reference numeral 301 denotes a keyboard for receiving numerical information, character information, and the like from a user; 302, a mouse for selecting information from the user and receiving positional information on a screen; 303, a storage medium storing programs and data; A main storage device that reads and temporarily stores programs and data from the storage medium 303, and temporarily stores data read from the keyboard 301 and the mouse 302;
Reference numeral 05 denotes a central processing unit that performs processing such as four arithmetic operations and logical operations on data in accordance with individual instructions constituting a program held in the main storage device 304 and controls the operation of the entire computer. A video input memory for temporarily storing signals and accessing data in pixel units as necessary; 307, a video input memory for temporarily storing video signals to be output to the outside; Video output memory that can access data to
08 denotes a keyboard 301, a mouse 302, and a storage medium 30.
3. A bus that connects the main storage device 304, the central processing unit 305, the video input memory 306, and the video output memory 307. Under the control of the central processing unit 305, data and programs are transmitted and received between the devices via this bus. can do. The functions of the video input memory 306 and the video output memory 307 may be shared by the main storage device 304, and the video input memory 306 and the video output memory 307 may not be included in the video correction device 6.

Next, an outline of the operation of the video projector according to the first embodiment will be described. As shown in FIG. 1, the projector 2 is arranged in a direction oblique to the front direction of the screen 1. First, in the video correction device 6, a correction data creation program is read from the recording medium 303 into the main storage device 304 and executed by the central processing unit 305. A test image is generated according to conditions input by the user from the keyboard 301 and the mouse 302, and is output from the video output memory 307 to the projector 2 as a video signal. Here, an optimum test image may be selected from a plurality of test images prepared in advance in the storage medium 303 and output by a program.

The projector 2 converts the input video signal into projection light and outputs it, and a projection image 3 of a test image is formed on the screen 1. At this time, the projection image 3 is a distorted figure due to the fact that the screen 1 and the projector 2 are not directly installed, the viewpoint position 7 is not in front of the screen 1 and the surface shape of the screen 1. I have. At the same position as the viewpoint position 7, a projected image 3 of a test image is photographed by the camera 4 and input to the image input memory 306 of the image correction device 6. At this point, the projection of the test image is stopped. The generated test image is compared with the photographed image input to the video input memory 306 to calculate distortion, and to calculate correction data for giving reverse distortion in advance so that there is no distortion at the time of projection. It is stored in the device 304 or the storage medium 303.

Next, the image correction program is executed by the recording medium 3
03 is read into the main storage device 304 and executed by the central processing unit 305. The video signal output from the video source 5 is sequentially taken into the video input memory 306 for each image frame, and is sequentially converted from the video input memory 306 to the video output memory 307 according to the correction data and stored. The content of the video output memory 307 is sequentially output as a video signal, projected on the screen 1 by the projector 2, and a correct video without distortion as viewed from the viewpoint position 7 is formed.

Next, the block configuration of the video projector according to the first embodiment will be described. FIG. 9 is a block diagram for explaining the configuration of the video projection device according to the first embodiment. In the figure, reference numeral 701 denotes a test image generating means for generating a test image, 702 a video projecting means for inputting a video signal and projecting it on a screen, and 703 a photographing means for photographing a test image projected on the screen and outputting it as a photographed image. , 704 are test image extracting means for inputting the photographed image of the photographing means 703 and extracting information relating to the test image;
Reference numeral 05 denotes a distortion amount calculator for comparing the information on the test image of the test image extracting unit 704 with the test image of the test image generator 701 to calculate the amount of distortion, and 706 inputs the amount of distortion of the distortion amount calculator 705. Then, a correction data (correction table) generating means for calculating correction data (correction table) for correcting the video signal so that a desired video without distortion on the screen is obtained, and 707 holds the correction data (correction table) Correction data (correction table) storage means 708, a video input means for receiving a video signal to be projected, and 709 correction data (correction table) holding the video signal received by the video input means 708 in the correction data storage means 707 Correction processing using the image projection means 7
02 is a video correction unit that outputs the image data to the output unit 02. In the first embodiment, the camera 4 is used as a specific example of the photographing unit 703, and the projector 2 is used as a specific example of the image projection unit 702.

FIG. 10 is a block diagram showing the structure of the image correcting means 709. In FIG.
Sequentially captures and stores video signals in image frame units,
An input frame memory 402 for outputting a pixel value at a designated address, an output frame memory 402 for generating a corrected image by writing a pixel value at a designated address in frame units, and sequentially outputting the same as a video signal, An address generation unit 404 for generating an address of the output frame memory 402 refers to the correction data (correction table) stored in the correction data (correction table) storage unit 707, and an input frame corresponding to the address output by the address generation unit 403. Address conversion means for outputting a plurality of addresses of the memory 401, reference numeral 405 denotes a weight determination means for outputting a weight for each pixel by referring to the correction data in the correction data (correction table) storage means 707, and reference numeral 406 denotes an input frame memory 401. A plurality of pixel values extracted from the From, pixel interpolating means for interpolating calculating a pixel value of interest, the correction data in the correction data (correction table) storage section 707 407 (correction table)
, A mask processing determining means 408 for determining whether or not to perform mask processing on a pixel corresponding to the address output by the address generating means 403;
Mask processing means for performing mask processing on pixels in accordance with the determination result of 07 and outputting the result.

Next, the configuration of the test image according to the first embodiment will be described. FIG. 11 is a configuration diagram of a test image according to the first embodiment. As shown in FIG. 11, the test image includes a background and a plurality of feature points. Here, the plurality of feature points are U at equal intervals in the horizontal direction,
V pieces are arranged at equal intervals in the vertical direction. The vertical and horizontal intervals may be the same or different. Each feature point is composed of one or more pixels.
The pixels constituting each feature point have different pixel values from the pixels constituting the background. In FIG. 11, the rectangle surrounding the feature point is a figure for explaining the outline of the test image, and is not real. In the test image shown in FIG. 11, the feature points are arranged on a grid, but this is not necessarily required. Here, it is important where each feature point has moved after projection (the amount of movement is the amount of distortion). Therefore, the requirements of the test image are that the position of the generated feature point is known, And an identifier that is information for associating with the feature point of the above.

The test image shown in FIG. 11 is an example in which a plurality of feature points are arranged at regular intervals and arranged in a grid, and the relative positional relationship between the plurality of feature points is used as an identifier. . Depending on the condition of the free-form surface of the screen 1, feature points are densely arranged in a certain area of the test image, colors are changed for each feature point, and blinking cycles are changed for each feature point as an identifier. Is also conceivable.

Next, the configuration of the table according to the first embodiment will be described. FIG. 12 is a configuration diagram of a table (correction table) according to the first embodiment. FIG.
In, the table is a two-dimensional table having two indexes, and if an index is determined, a table element can be uniquely specified. Each table element differs depending on the table, and details will be described later.

Next, a coordinate system used in the video projector according to the first embodiment will be described with reference to the drawings. FIG.
FIG. 3 is an explanatory diagram of a coordinate system in an image frame according to the first embodiment. As shown in FIG. 13, the upper left pixel of the image frame is set as the origin O of the coordinate value (0,0), and the X axis and the Y axis are provided. In the video projection device according to the first embodiment, an image frame C is used as a captured image output by the imaging unit 703. The image frame C is composed of CX × CY pixels. Further, the input frame memory 401 of the video correction unit 709 uses the image frame S, and the output frame memory 402 uses the image frame B. Image frame S is SX × SY pixels, and image frame B
Is composed of BX × BY pixels. In the video projection device according to the first embodiment, a table including BX × BY table elements is used as correction table Th.

FIG. 14 is a diagram showing the configuration of the table elements of the correction table Th. As shown in FIG. 14, the table elements of the correction table Th include a set of coordinate values x and y and a weight w.
It consists of 0, w1, w2, w3. In the video projection device according to the first embodiment, a table T0 including CX × CY table elements and a table including BX × BY table elements
Use T1 and T2. FIG. 15 is a diagram illustrating the configuration of the table elements of the tables T0, T1, and T2. As shown in FIG. 15, these table elements are composed of a set of coordinate values x and y. Here, the variables and tables used in the first embodiment are stored in the main storage device 304.

Hereinafter, the naming rules of main symbols in the specification of the present application will be described. An arbitrary pixel P constituting a certain image frame A is denoted by P (A), and in particular, coordinates (x, y)
Is denoted as P (A) [x, y]. An arbitrary feature point Q constituting a test image on a certain image frame A is denoted as Q (A), and in particular, the (i, j) -th feature point
Q is denoted as Q (A) [i, j]. Construct table T
The (i, j) -th table element is denoted as T [i, j].
Further, the image frame C, the image frame S, and the image frame B may be simply described as C, S, B. Similarly, table T0, table T1, table T2, table Th
May be simply expressed as T0, T1, T2, Th.

The operation principle of the first embodiment will be briefly described. FIG. 16 is a diagram illustrating the operation principle of the first embodiment. In FIG. 16, reference numeral 501 denotes a test image generated on the image frame S;
1 is a test image copied unprocessed on an image frame B, 503 is a test image on an image frame C1 obtained by photographing the projected test image with a camera, and 504 is a test image after projecting the test image after correction processing. An ideal test image to be obtained on the image frame C0 by shooting, 505 is an input image before correction processing on the image frame S, 506 is a corrected image obtained by correcting the input image 505, and 507 is a projected image 506. Image frame C obtained by camera shooting
2 above.

First, the principle of operation for generating a correction table will be described. In FIG. 16, the input image 505 is described as being the same as the test image 501. Since the test image 501 is copied onto the test image 502 without conversion, the feature point Q (S) is directly mapped to the feature point Q (B). The feature point Q (B) of the test image 502 is converted to the test image 503 by a certain conversion Tbc1.
Is considered to have been mapped to the feature point Q (C1), and this is expressed by Equation 1.

(Equation 1) Similarly, the feature point Q (B) of the test image 502 is converted
Is mapped to the characteristic point Q (C0) of the test image 504, and this is expressed by Expression 2.

(Equation 2) The feature point Q (S) of the input image 505 is mapped to the feature point Q (B) of the corrected image 506 by the conversion Tsb, and the feature point Q (B) of the corrected image 506 is further converted to the It is considered that the image is mapped to the feature point Q (C2), and this is expressed by Expression 3.

(Equation 3) Since the installation state of the projection device has not been changed, the conversion Tbc1 and the conversion Tbc2 match, and the test image 504 and the projected image 50
7, the conversion Tsb can be determined so that each feature point matches, and can be expressed by Equation 4.

(Equation 4) Equations (1) to (4) are transformations for the feature point Q of the test image. For any pixel P on each image frame, the transformation extended to pixels is calculated by interpolating at surrounding feature points. And can be expressed in the same form as Equation 4.
The conversion Tbs thus formed becomes a correction table to be obtained.

Next, the operation principle at the time of executing the image correction will be described. The input image 505 generates a corrected image 506 by the conversion shown in Expression 5 for each pixel and projects it (Tb
s2) to obtain a projection image 507 without distortion.
Can be obtained.

(Equation 5) The above is the operation principle.

Next, a detailed operation of the video projector according to the first embodiment will be described with reference to a flowchart. 17 to 27 are flowcharts of the detailed operation of the video projection device according to the first embodiment. FIG.
1 is an overall flowchart of the first embodiment, and FIG.
FIG. 8 is a flowchart showing the detailed steps S1-1 to S6 of step S1 in FIG. First, the procedure of projecting and extracting a test image will be described (steps S1 and S1 in FIGS. 17 and 18).
-1 to 6). The test image generation means 701 generates a test image having U × V feature points as shown in FIG.
(Step S1-1 in FIG. 18). The photographing means 703 photographs the screen 1 in a state where the test image is not projected, and sets the photographed image Z0 (step S1-2 in FIG. 18). Image projection means 7
02 projects the test image on the screen 1. Since the surface of the screen is a free-form surface, the projected image 3 of the test image is distorted. In this state, the photographing unit 703
Is shot under the same shooting conditions as before, including the entire test image, and is taken as a shot image Z1 (step S1-
3).

FIG. 28 shows a projected image 3 of a distorted test image.
Is an example of an image Z1 obtained by photographing. However, the manner of distortion changes depending on the positional relationship between the screen 1 and the photographing unit 703, the state of the surface of the screen 1, and the like. FIG. 28
Is the case where the feature points are U × V = 5 × 5. The test image extracting unit 704 generates a feature point image Z10 by extracting a feature point area from the difference between the captured images Z0 and Z1 (step S1-4 in FIG. 18).

FIG. 29 is a diagram showing an example of the feature point image Z10. However, FIG. 29 shows the case where the feature points are U × V = 5 × 5. The test image extracting unit 704 outputs the feature point image Z1
At 0, a group of pixels whose pixel value is larger than a certain threshold SV is extracted as a feature point candidate, and the position (the center of gravity of the group of pixels) is calculated. Here, the number of feature point candidates is U
If the number is less than × V, the threshold value SV is lowered and re-extraction is performed.
When the number of feature point candidates is larger than U × V, U × V feature points are selected in the descending order of the group of pixels, and U × V feature point candidates are determined (step S1--FIG. 18). Five). Subsequently, the feature points and feature point candidates of the generated test image are set to 1
A labeling process for associating one-to-one is performed (step S1-6 in FIG. 18).

Here, as an example, a labeling procedure performed based on the coordinate values of each feature point and their relative positional relationships is described below.
As shown in FIG. First, feature point Q (C) [0,0] is determined in feature point image Z10 shown in FIG. 29 (step S1-6 in FIG. 19).
1). Similarly, feature points Q (C) [1,0] to Q (C) [U-1,0] are sequentially determined (step S1-62 in FIG. 19). Furthermore, feature point Q (C)
[0,1] to Q (C) [U-1, V-1] are determined in order (steps S1-63,64 in FIG. 19).

Next, the procedure for determining the designated projection area will be described (steps S2 and S2-1 to S5 in FIGS. 17 and 20). FIG.
FIG. 7 is a diagram for explaining a process of determining a designated projection area. FIG.
0, the distortion amount calculation means 705 calculates the four feature points Q (C)
Determine the area enclosed by [0,0], Q (C) [0, V-1], Q (C) [U-1, V-1], Q (C) [U-1,0] , A test image area RT. The largest X coordinate value of the feature points constituting the left side of the test image (that is, the X coordinate value of the feature point located on the rightmost side) is set in a variable x0
(Step S2-1 in FIG. 20). Here, the feature points constituting the left side are, as apparent from FIG. 30, Q (C)
[0,0] to Q (C) [0, V-1]. Similarly, the variables x1, y0, y1
(Steps S2-2 to S4 in FIG. 20). Test image area R
A rectangular area inscribed in T is obtained and set as a projection designated area RD (step S2-5 in FIG. 20).

Next, the procedure for generating the correction table Th will be described with reference to FIG. In the generation of the correction table, the correction data generation unit 706 generates a target correction table Th after generating some intermediate tables (steps S3-1 to S4 in FIG. 21).

FIG. 31 is an explanatory diagram of the image frame C0. As shown in FIG. 31, consider an image frame C0 in which a test image is arranged in the designated projection area RD (step S3-11 in FIG. 22). The image frame C0 is an image frame to be obtained when the image is projected after being subjected to correction processing using correction data for creating a test image and photographed by a camera. Steps S3-12 to S15 in FIG. 22 are performed for all the pixels P (C0) [k, l] (k = 0 to CX-1, l = 0 to CY-) on the image frame C0.
By repeating step 1), a table T0 is created.

FIGS. 32 and 33 are diagrams for explaining the process of generating the table T0. In FIG. 32, the target P
If (C0) [k, l] is inside the specified projection area RD, P (C
0) surrounding four feature points Q (C0) [i, j], Q (C0) [i + 1, j], Q (C
0) [i + 1, j + 1] and Q (C0) [i, j + 1] are determined, and the internal division ratio is calculated by Equation 6
Ask from.

(Equation 6) As shown in FIG. 33, these four feature points respectively correspond to feature points Q (B) [i, j], Q (B) [i + 1, j], Q (B) [i +
The coordinate value of P (B) is calculated from Eq. (1, j + 1) and Q (B) [i, j + 1] using equation (7) and stored in T0 [k, l].

(Equation 7) Here, if P (C0) is outside the projection designation area RD, T
An “external flag” is set at 0 [k, l] (step S3 in FIG. 22).
-11 to 16). Here, setting the “external flag” can be realized as a specific example by substituting a coordinate value (eg, a negative number) that is not normally used for the coordinate value of the table element. With the above procedure, the table T0 can be generated.

Steps S3-21 to S24 in FIG. 23 are performed for all pixels P (B) [k, l] (k = 0 to BX-1, l = 0 to BY) on the image frame B.
The table T1 is created by repeating the process of -1). FIG. 34 and FIG. 35 are diagrams illustrating the generation processing of the table T1. In FIG. 34, the pixel of interest P (B)
Feature points Q (B) [i, j], Q (B) [i + 1, j], Q (B) [i
+1 and j + 1] and Q (B) [i, j + 1] are obtained, and the internal division ratio is obtained from Expression 8.

(Equation 8) As shown in FIG. 35, these four feature points respectively correspond to feature points Q (C1) [i, j], Q (C1) on the image frame C1.
From the coordinate values of [i + 1, j], Q (C1) [i + 1, j + 1], Q (C1) [i, j + 1] and the internal division ratio, points on each side Find A, B, C, D. Next, the coordinate value of P (C1), which is the intersection of the line segment AC and the line segment BD, is obtained and stored in the table T1 [k, l] (Step S3--FIG. 23).
21-24). With the above procedure, the table T1 can be generated.

Steps S3-31 to S34 in FIG. 24 are performed for all pixels P (B) [k, l] (k = 0 to BX-1, l = 0 to BY) on the image frame B.
The table T2 is created by repeating the step -1). FIG. 36 is a diagram illustrating the generation process of the table T2. In FIG. 36, the coordinates E (cx, cy) on the image frame C corresponding to the focused P (B) [k, l] are obtained from the table T1 as shown in Expression 9.

(Equation 9) Here, since the coordinate values cx and cy are not always integers but are generally real numbers, the corresponding PN (C) cannot be determined as they are. Therefore, four real pixels P (C) [i, j], P (C) [i + 1, j], P (C) [i + 1, j + surrounding the coordinates E (cx, cy) 1], P (C)
[i, j + 1] is obtained by Expression 10, and the pixel closest to the point E is PN (C).
And In FIG. 36, P (C) [i, j + 1] at the lower left corresponds to PN (C). Point PN (S) on image frame S to which PN (C) corresponds
Are obtained from Equation 11 and stored in the table T2 [k, l].

(Equation 10)

[Equation 11] At this time, if the “external flag” is set at T0 [k1, l1] in Equation 11, the flag is set as is at T2 [k, l].
(Steps S3-31 to S34). With the above procedure, the table T2 can be generated.

Steps S3-41 to S44 in FIG. 25 are performed for all the pixels P (B) [k, l] (k = 0 to BX-1, l = 0 to BY) on the image frame B.
The table Th is created by repeating the step -1). FIG. 37 is a diagram illustrating the generation processing of the table Th. In FIG. 37, the coordinates F (cx, cy) on the image frame S corresponding to the focused P (B) [k, l] are obtained from Expression 12.

(Equation 12) Four pixels P (S) [i, j], P (S) [i + 1, j], P (S) [i +
1, j + 1] and P (S) [i, j + 1] are obtained from Expression 13.

(Equation 13) The reciprocals e0, e1, e2, and e3 of the distance between the point F and each of the above four pixels were obtained, and the proportional weights were normalized by Equation 14, further multiplied by 1024, and converted to an integer by truncation of the decimal part. These are weights w0, w1, w2, w3. Each weight and the coordinate value (x, y) = (i, j) of the upper left pixel P (S) [i, j] of the four pixels are
It is stored in Th [k, l] as one table element (FIG. 25).
Steps S3-41 to 44).

[Equation 14] Here, the reason why the weight is multiplied by 1024 and converted to an integer is that the integer format generally requires a smaller storage area than the decimal format, and as a result, the size of the correction table can be reduced. The reason for multiplying by 1024 at that time is that an exponentiation of 2 can be operated at a higher speed by a general computer than a simple integer, and the point of multiplying by 1024 is particularly limited to this. Instead, the optimum power of 2 may be used in consideration of the number of significant digits of the weight. With the above procedure, the correction table Th can be generated. The correction table Th is stored in the correction data storage unit 707. Here, in FIG. 28 to FIG. 37, the rectangle on the outer periphery is a figure for explaining the area of the image or the image frame, and is not real. Similarly, the dashed lines are figures for explaining various regions, and are not real ones.

Next, the procedure of the image correction processing will be described (steps S4, S4-1 to 5, S4-3 in FIGS. 17, 26 and 27).
1-34). The video input means 708 receives a video signal to be projected. The video correction unit 709 takes one video signal into the input frame memory 401 and sets it as an image frame S (step S4-1 in FIG. 26). 26 steps
S4-2 to S4 are converted to all pixels P (B) [k, l] on the image frame B.
(k = 0 ~ BX-1, l = 0 ~ BY-1)
Generate a corrected image. That is, the address generation unit 403 sequentially outputs the address of the pixel P (B) on the image frame B, and the following processing is repeated. Address translation means 40
4 reads the coordinate values x and y from the correction data storage unit 707, finds four pixels to be processed, and converts them into addresses of four pixels on the image frame S. Weight determining means 4
05 indicates weights w0, w1, w from the correction data storage unit 707.
2, w3 are read, and the pixel interpolation unit 406 performs the operation of Expression 15 on the pixel value of the input frame 401 indicated by the address converted by the address conversion unit 404, and outputs the pixel value.

(Equation 15) The mask processing determination means 407 is used to
7, the weights w0, w1, w2, and w3 are read. If all of them are 0, the mask processing is executed. Then, the pixel value is stored in the pixel on the output frame memory 709 indicated by the address output from the address generating means 403 (Steps S4-2 to S5 and S4-31 to S34 in FIGS. 26 and 27). Here, the mask processing is to store a pixel value of 0 (minimum luminance, that is, extinguished) in a target pixel.

Finally, the image correcting means 709 sequentially outputs the contents of the output frame memory 402 as a video signal. The video signal is projected on the screen 1 by the video projection means 702, and a correct projection video without distortion when viewed from the viewpoint position 7 is obtained (step S4-5 in FIG. 26). In the first embodiment of the present invention, the procedure of projecting and extracting a test image (FIG. 1)
Instead of the steps S1-1 to S1-6 in FIG. 8, the procedure of projecting and extracting the second test image shown below (steps S1-10 in FIG. 38)
1 to S1-105) may be performed. In the detailed procedure of projecting and extracting the second test image, only one feature point is sequentially turned on to sequentially specify the feature points.

FIG. 38 is a flowchart of the projection and extraction of the second test image (steps S1-101 to 105). The photographing unit 703 photographs the screen 1 in a state where the test image is not projected, and sets the screen 1 as a photographed image Z0 (Step S1-101 in FIG. 38). A feature point is specified by repeating steps S-102 to S-105 in FIG. 38 for all feature points Q (C) [x, y] (x = 0 to U-1, y = 0 to V-1). . Test image generation means 7
No. 01 generates a test image in which only the feature point Q (C) [x, y] of interest is turned on, and projects it on the screen 1 by the video projection means 702 (step S1-102). In this state, the photographing unit 703 performs photographing so as to include the entire projected image of the test image under the same photographing conditions as before, and sets it as a photographed image Z1 (step S1-103 in FIG. 38).

The test image extracting means 704 outputs the photographed image Z0
Image of feature points extracted from the difference between Z1 and Z1
Z10 is generated (step S1-104). The test image extracting unit 704 calculates a threshold SV having a pixel value in the feature point image Z10.
A group of larger pixels is extracted as a feature point candidate, and its position (center of gravity of the group of pixels) is calculated. Here, if there are no feature point candidates, the threshold value SV is lowered and re-extraction is performed. If there are a plurality of feature point candidates, the one with the largest collection of pixels is determined as a feature point candidate. Feature point Q (C) that directly focuses on this feature point candidate
[x, y] (Step S1-105 in FIG. 38). Further, as a test image, additional lighting is performed while increasing feature points one by one, and in step S1-104 in FIG. There is also a procedure in which a feature point is sequentially specified by generating a feature point image Z10 in which a feature point area is extracted from the difference from the feature point Z0). The above is the procedure of projecting and extracting the second test image.

In the first embodiment of the present invention, the procedure of projecting and extracting a test image (steps S1-1 to S1-
Instead of 6), the following procedure of projecting and extracting a third test image (steps S1-201 to S1-206 in FIG. 39) may be performed. In the third test image projection and extraction procedure, feature points are specified using test images having different colors for each feature point.

FIG. 39 is a flowchart of the projection and extraction of the third test image (steps S1-201 to 206). The test image generation unit 701 generates a test image in which a different color is set for each feature point (step S1-201 in FIG. 39).
The photographing unit 703 photographs the screen 1 in a state where the test image is not projected, and sets the photographed image Z0 (step S1-202 in FIG. 39). Next, the video projection unit 702 projects the test image on the screen 1. In this state, the photographing unit 703 performs photographing under the same photographing conditions as before, including the entire test image, and sets it as a photographed image Z1 (step S1-203 in FIG. 39). The test image extracting unit 704 calculates the photographed image Z
From the difference between 0 and Z1, a feature point image Z10 in which a feature point area is extracted is generated (step S1-204 in FIG. 39). The test image extracting unit 704 extracts a group of pixels having a pixel value larger than a certain threshold SV in the feature point image Z10 as a feature point candidate, and calculates the position (center of gravity of the group of pixels). Here, when the number of feature point candidates is smaller than U × V, the threshold value SV is lowered and re-extraction is performed. When the number of feature point candidates is larger than U × V, U × V candidates are selected in descending order of the group of pixels, and U × V feature point candidates are determined (step S1 in FIG. 39). -205). Step S-20 in FIG.
6 is repeated for all the feature points Q (C) [x, y] (x = 0 to U-1, y = 0 to V-1) to specify feature points. The test image generation unit 701 determines a feature point candidate having a color closest to the color set as the [x, y] -th feature point by a feature point Q (C).
[x, y] and remove it from the feature point candidates (step S1-20 in FIG. 39).
6). The above is the procedure for projecting and extracting the third test image. Note that, in the first embodiment of the present invention, instead of the test image projection and extraction procedure (steps S1-1 to S1-6 in FIG. 18), the following fourth test image projection and extraction Steps
(Steps S1-301 to S1-306 in FIG. 40) may be performed.

In the fourth procedure for projecting and extracting test images, feature points are specified using test images that blink at different intervals for each feature point. FIG. 40 is a flowchart of projection and extraction of the fourth test image (step S1-301).
306). The test image generation unit 701 generates a test image that blinks at a different cycle for each feature point (step S1-301 in FIG. 40).

The video projection means 702 continuously projects a test image which blinks at a different cycle for each feature point on the screen 1. In this state, the photographing unit 703 performs continuous photographing under the same photographing conditions as before, for at least twice as long as the slowest blinking cycle so as to include the entire test image, to obtain a series of photographed images Z1 (step in FIG. 40). S1-302). Test image extracting means 70
4 extracts a blinking area from a series of photographed images Z1 as a feature point candidate in association with its cycle (step S1-303 in FIG. 40). Step S-304 of FIG.
(C) The feature point is specified by repeating [x, y] (x = 0 to U-1, y = 0 to V-1). Test image generation means 701
However, the feature point candidate closest to the blinking cycle set as the [x, y] -th feature point is set as a feature point Q (C) [x, y] and is excluded from the feature point candidates (step S1-304). ). The above is the procedure for projecting and extracting the fourth test image. In the procedure of projecting and extracting the test image, it is conceivable to combine identifiers such as using both the blinking cycle and the color information as the feature point identifiers.

As described above, in the first embodiment, in the situation where the image projected by the projector 2 arranged obliquely with respect to the screen 1 on the surface of the free-form surface is observed at a certain viewpoint position 7 without correction. Project the test image and set the viewpoint position 7
The camera 4 shoots a test image, generates correction data for giving the reverse distortion in advance, corrects the image to be projected with the correction data, and projects the image with the projector 2 so that the image is viewed from the viewpoint position 7. And correct images can be obtained without distortion. As a result, it is possible to save labor for adjusting the screen and adjusting the arrangement of the projector, which are conventionally troublesome. By storing each weight in the weight table as an integer by multiplying by 2 to the power of 2 and storing it in the table, the size of the correction table can be reduced, and not only can the correction table storage unit 707 be used efficiently, but also the correction table can be efficiently used. As described above, the generation processing and the calculation of the image correction processing can be performed at high speed. Even if the position of the camera 4 and the viewpoint position 7 do not exactly coincide with each other, if the deviation is small, a certain distortion correction effect can be obtained by performing the above procedure.

(Embodiment 2) Hereinafter, an image projection apparatus according to Embodiment 2 of the present invention will be described with reference to the drawings. The second embodiment has a lot in common with the first embodiment, and therefore the following description will focus on the differences. FIG. 41 is a diagram of a device configuration of a video projection device according to Embodiment 2 of the present invention. In FIG. 41, reference numeral 1 denotes a screen for capturing an image,
a and 2b are projectors for projecting an image on the screen 1, 3a and 3b are projection images projected on the screen 1 by the projectors 2a and 2b, 4 is a camera for shooting the screen 1 and the projection image 3, and 5 is an image signal. An output video source 6 is a video correction device that generates correction data from data from the camera 4, corrects a video signal from the video source 5, and outputs it to the projectors 2 a and 2 b. It is. Here, the video source 5 and the camera 4 may be configured to be included in the video correction device 6.

In the second embodiment, as in the first embodiment, the shape of the screen 1 is not necessarily required to be a plane, but is assumed to be a free-form surface. In addition, it is assumed that the position and direction of the viewpoint position 7 and the camera 4 match. The hardware configuration of the video projection device according to the second embodiment of the present invention is the same as that according to the first embodiment shown in FIG. Next, an outline of the operation of the video projection device according to the second embodiment of the present invention will be described with reference to FIG.
This will be described with reference to FIG. As shown in FIG. 41, the projectors 2a and 2b are arranged in a direction oblique to the front direction of the screen 1. In the image correction device 6, a test image is generated by the correction data creation program and output to the projectors 2a and 2b. First, projector 2
When the test image input to the projector 2a is projected while the image b is not projecting an image, only the projected image 3a of the test image is formed on the screen 1. At this time, the projected image 3 is a distorted figure due to the fact that the screen 1 and the projector 2 are not directly opposed, the viewpoint position 7 is not in front of the screen 1 and the surface shape of the screen 1. At the same position as the viewpoint position 7, a projected image 3 a of a test image is photographed by the camera 4 and input to the image input memory 306 of the image correcting means 6. Similarly, in a state where the projector 2a is not projecting an image,
When the test image input to the projector 2b is projected, only the projected image 3b of the test image is formed on the screen 1. The projected image 3b of the test image is also a distorted figure.

At the same position as before, a projected image 3 b of a test image is photographed by the camera 4 and input to the image input memory 306 of the image correcting means 6. At this point, the projection of the test image is stopped. The generated test image is compared with the photographed image stored in the video input memory 306 to calculate distortion, so that there is no distortion at the time of projection, and two projected images 3a and 3b So that it becomes a video,
Correction data for giving reverse distortion is calculated in advance and stored in the recording medium 303 or the main storage device 304. Next, the video signal output from the video source 5 is sequentially taken into the video input memory 306 for each image frame by the video correction program, and is sequentially transferred from the video input memory 306 to the video output memory 307 according to the correction data. Is converted and stored. The content of the video output memory 307 is sequentially output as a video signal,
a, 2b are projected on the screen 1 and the viewpoint position 7
As a result, a continuous image without distortion is formed. Further, the block configuration of the video projection device according to the second embodiment is the same as the detailed configuration of the video projection device according to the first embodiment, and a description thereof will be omitted.

Next, a detailed operation of the video projector according to the second embodiment will be described with reference to a flowchart. FIGS. 42 and 43 are flowcharts of the detailed operation of the video projector according to the second embodiment. In FIG. 42, the projector 2a projects a test image,
An extraction is performed (step S21 in FIG. 42). Subsequently, the projector 2b projects and extracts a test image (FIG. 4).
Step S22). Here, the detailed procedures of steps S21 and S22 are the same as steps S1-1 to S6 of the first embodiment, and a description thereof will be omitted. Next, the procedure for determining the designated projection area will be described (steps S23, S23-1 to S23 in FIGS. 42 and 43).
Five).

FIG. 44 is a diagram for explaining the process of determining the designated projection area. 44, reference numerals 10a and 10b denote temporary projection designation areas RDa0, Rda0, corresponding to the projectors 2a, 2b.
In RDb0, set the upper left and lower right coordinates to (a0x0, a0y
0), (a0x1, a0y1), and (b0x0, b0y0), (b0x1, b0y1)
And 11a and 11b are projection designation areas RDa and RDb corresponding to the projectors 2a and 2b, respectively. b
x1, by1). The temporary projection designation areas RDa0 and RDb0 of the projectors 2a and 2b are determined (steps S23-1, FIG.
S23-2). Here, the detailed procedure of steps S23-1 and S23-2 is
This is the same as steps S2-1 to S5 in the first embodiment, and a description thereof will be omitted. The projection designation areas RDa and RDb are determined from the temporary projection designation areas RDa0 and RDb0 (step S23-3 in FIG. 43). In FIG. 44 (a), the temporary projection designation areas RDa0 and RDb0 are shifted in the vertical direction while partially overlapping. This is shown in FIG.
As shown in (b), the projection designation areas RDa and RDb are determined using Equation 16 so as to form one continuous rectangular area at the same height without overlapping (Steps S23-3 to S23-3 in FIG. 43). Five).

(Equation 16) Subsequent procedures are the same as in the first embodiment. That is, two correction tables corresponding to the projectors 2a and 2b are created, and correction processing is performed on each of the correction tables for the video input by the video input unit 708, and the projectors 2a and 2b are
At the same time, one continuous and distortion-free correct image as viewed from the viewpoint position 7 can be obtained. As described above, in the second embodiment, the images projected by the two projectors arranged obliquely with respect to the screen 1 on the surface of the free-form surface are observed at a certain viewpoint position 7 and the respective projectors are used. A test image without correction is projected, a test image is photographed with the camera 4 at the viewpoint position 7, and correction information for giving reverse distortion in advance and correction information for making two images appear continuously are corrected. Generate data,
The image to be projected is corrected by the correction data and projected by each projector, thereby obtaining a 2
The two projected images can be arranged without any gap and without overlapping, and a continuous and correct image without distortion can be obtained. As a result, it is possible to save labor for adjusting the screen and adjusting the arrangement of a plurality of projectors, which are conventionally troublesome. In addition, since there is no overlap between the two images, special processing such as brightness adjustment for the area is not required. The second embodiment of the present invention is a case where the number of projectors is two. However, even when there are three or more projectors, the projected images of the test images are partially overlapped to form a large designated projection area. By determining a plurality of designated areas corresponding to each projector, the same effect can be obtained.

(Embodiment 3) Hereinafter, an image projection apparatus according to Embodiment 3 of the present invention will be described with reference to the drawings. In the third embodiment, since there are many common parts with the first embodiment, differences will be mainly described. FIG.
FIG. 7 is a diagram showing a device configuration of a video projection device according to a third embodiment of the present invention. In FIG. 45, reference numeral 1 denotes a screen for projecting an image, 2 denotes a projector that projects an image on the screen 1, 3 denotes a projection image projected on the screen 1 by the projector 2, 4 denotes a camera that captures the screen 1 and the projection image 3, and 5 denotes a camera. Denotes a video source that outputs a video signal, 6 generates correction data based on data from the camera 4, performs a correction process on the video signal from the video source 5 based on the generated correction data, and outputs the corrected signal to the projector 2. Video correction devices, 7a and 7b are observer's viewpoint positions,
8 is a normal line of the screen 1. In the third embodiment,
The screen 1 is a rectangular plane, and the viewpoint position 7a
Is located on the normal line of the screen 1 and the viewpoint position 7
A straight line connecting b and the center of the screen 1 forms an angle θ with the normal of the screen 1. The hardware configuration of the video projection device according to the third embodiment of the present invention is the same as that according to the first embodiment shown in FIG.
Description is omitted.

Next, an outline of the operation of the video projector according to the third embodiment of the present invention will be described. As shown in FIG. 45, the projector 2 is arranged in a direction oblique to the front direction of the screen 1. In the image correction device 6, a test image is generated by the correction data creation program and output to the projector 2. The test image input to the projector 2 is projected, and a projected image 3 of the test image is formed on the screen 1. At this time, the projected image 3 is a distorted figure because the screen 1 and the projector 2 are not directly opposed to each other. The degree of distortion varies depending on the angle θ of the viewpoint position 7. The entire screen 1 including the projected image 3 of the test image is photographed by the camera 4 and the image correction device 6
To the video input memory 306. The image correction device 6 extracts a test image and information on the outer shape of the screen. The extracted test image and video input memory 3
Then, the amount of distortion is calculated by comparing the captured image stored in step 06 with the captured image. Based on the amount of distortion, the information on the outer shape of the screen, and the projection conditions input from the keyboard 301 and the mouse 302 as necessary, the projection result when viewed from the viewpoint position 7 is set in advance so that the shape becomes similar to the outer shape of the screen. Correction data for giving distortion is calculated and stored in the recording medium 303 or the main storage device 304. In this correction method, when the external shape of the projected image 3 is similar to the external shape of the screen when observed at an arbitrary camera position, the projected image 3 is a rectangular shape without distortion when viewed from the viewpoint position 7a which is the front of the screen 1. It is based on becoming. Thereafter, as in the first embodiment, the video signal output from the video source 5 by the video correction program is subjected to correction processing for each image frame, and a correct video without distortion is formed on the screen 1 by the projector 2. You.

Next, the block configuration of the video projector according to the third embodiment will be described. FIG. 46 shows Embodiment 3
1 is a block diagram of a video projection device according to the present invention. In FIG. 46, reference numeral 701 denotes a test image generating means for generating a test image, 702 denotes a video projecting means for inputting a video signal and projecting the screen on a screen, and 703 denotes a shooting for projecting the test image projected on the screen and the screen and outputting it as a photographed image. Means 704, a test image extracting means 71 for inputting a photographed image of the photographing means 703 and extracting information relating to the test image;
Reference numeral 0 denotes a screen extracting unit which inputs a photographed image of the photographing unit 703 and extracts information relating to the outer shape of the screen 1.
1 is input means for the user to input projection conditions, 705 is information on the test image of the test image extracting means 704,
A distortion amount calculation unit that compares the test image of the test image generation unit 701 and calculates the amount of distortion in consideration of the information regarding the outer shape of the screen and the projection condition. 706 inputs the distortion amount of the distortion amount calculation unit 705. Correction data generating means for calculating correction data for correcting a video signal so as to obtain a desired video without distortion on the screen; 707, a correction data recording means for holding the correction data; and 708, a video signal to be projected. A video input unit 709 receives the video signal received by the video input unit 708, corrects the video signal using the correction data stored in the correction data recording unit 707, and outputs the video signal to the video projection unit 702.

In the third embodiment, a keyboard 301 and a mouse 3
02 is used. The detailed operation of the video projection device according to the third embodiment will be described using a flowchart.
47, 48, and 49 are flowcharts of the detailed operation of the third embodiment. In the third embodiment,
The procedure for projecting and extracting a test image is described in the first embodiment.
The description is omitted.

Next, the screen is photographed by the camera without projecting the test image, and the outline of the screen is extracted from the photographed image Z0.
7. Steps S11, S11-1, 2 in FIG. Specific examples of the method of extracting the outline of the screen include a method of extracting an edge from a luminance change with a nearby pixel in a captured image Z0, and setting a colored marker in advance at the four corners or the outline of the screen. This can be realized by a method of extracting only pixels having the same color information as the marker from the pixels of the captured image Z0.

Next, the procedure for determining the designated projection area will be described (steps S12 and S12-1 to S7 in FIGS. 47 and 49). FIG.
0 is an explanatory diagram of a process of determining a designated projection area. FIG.
In the area RR, which is similar to the screen area RS and is small
Is assumed in the test image area RT. For this region RR, the maximum region inscribed in the test image region RT is determined while gradually combining enlargement and translation with each other, and the region RR at this time is defined as a projection designation region RD (step in FIG. 49). S
12-1 to 7). The processing after creation of the correction table is the same as the processing in the first embodiment, and a description thereof will be omitted. As described above, even if a test image is photographed at an arbitrary camera position, the projected image 3 becomes a rectangle and a correct image without distortion can be provided to an observer in front of the screen 1. The procedure for determining the designated projection area may be the procedure for determining the designated second projection area shown in FIG.

FIG. 52 shows the screen configuration of the input unit 311 used in the process of determining the second designated area. In FIG. 52, reference numeral 601 denotes a graphic indicating the screen area RS;
Is a graphic indicating the test area RT, 603 is a graphic indicating the designated projection area RD, and 604 is a mouse cursor operated by the user using the mouse 302. The screen of the input means 311 has a screen area RS and a test image area RT in advance.
Are superimposed and displayed (steps S12-10 in FIG. 51). The user operates the mouse cursor 604, designates the figure 603 while referring to the positions and sizes of the figures 601 and 602, and inputs a desired projection designation area RD as the projection condition (step S in FIG. 51).
12-11). At this time, the input unit 311 operates the projection designation area RD.
May be supported by the user so that the user does not come out of the test image designation area RT. Input means 3
Reference numeral 11 may assist the user in inputting work such that the projection designation area RD maintains a similar relationship to the screen area RS. This is the end of the determination of the second designated area. Further, the procedure for determining the designated projection area may be the procedure for determining the designated third projection area shown in FIG.

FIG. 54 shows a screen configuration of the input unit 311 used in the third method for determining a designated projection area. As shown in FIG. 54, the user operates the input
1, two angles θc and θv are input as projection conditions (steps S12-21, S22 in FIG. 53). Next, the projection designation area RD is determined from the relationship between the angles θc and θv.
(Step S12-23 in FIG. 53).

Hereinafter, a specific processing method of step S12-23 will be described. FIG. 55 is a diagram illustrating a positional relationship among the screen 1, each of the viewpoint positions 7 a to 7 e, and the camera 4. In FIG. 55, 8 is a normal line of the screen 1,
Reference numeral 9 denotes an angle between a straight line connecting the optical axis of the camera 4, the line-of-sight positions 7a to 7d and the center of the screen, and an angle between the normal line 8 and θv, and an angle between the optical axis 9 of the camera and the normal line 8 as θc. Viewpoint position 7a
Are on the normal line 8 and the viewpoint position 7c is the same position of the camera 4. FIG. 56 is a diagram showing the relationship between the viewpoint position and the shape of the designated projection area RD. In FIG. 56, an angle θv in each viewpoint direction and a projection designation area RD (shape observed by the camera 2) for obtaining a correct image without distortion in each viewpoint direction.
Are respectively shown. That is, the projection designation area RD is
When θv = θc, the camera position and the viewpoint position coincide with each other, so that the shape is rectangular. When θv = 0, the shape is similar to the shape of the screen region RS. When 0 <θv <θc, the shape changes continuously from the rectangle to the screen region RS. The complemented figure becomes a complemented figure when θv> θc or θv <0. If θc and θv are determined by using the relation of the internal and external complements between θv and the projection designated area RD (that is, the coordinates of the four vertices constituting the area), a rectangle (θv = θc)
And the screen area RS (θv = 0) as a reference figure,
The projection designation area RD inscribed in the test image area RT can be determined. Thus, the determination of the third projection designated area is completed.

As described above, in the third embodiment of the present invention, by determining the projection designation area RD similar to the outer shape of the screen, the camera 4 can be installed at any position.
It is possible to present a correct image without distortion when viewed from the viewpoint position 7a in front of the screen 3. In addition, the input means 311 is provided, and in a state where the screen area RS and the test image area RT are superimposed and displayed on the input screen, the user can freely set the optimum projection designation area RD, and any viewpoint position can be set. It is possible to present a correct image without distortion when viewed from the side. In addition, by inputting the viewpoint position and the relative positional relationship between the camera and the screen, the designated projection region RD can be calculated, and it is possible to present a correct image without distortion when viewed from an arbitrary viewpoint position. Although the system configuration of one projector has been described in the third embodiment, the present invention can be applied to a system including two or more projectors as described in the second embodiment. The same effect can be obtained.

(Embodiment 4) Hereinafter, an image projection apparatus according to Embodiment 4 of the present invention will be described with reference to the drawings. In the fourth embodiment, since there are many common parts with the above-described second embodiment, differences will be mainly described. FIG. 57 is a diagram showing a device configuration of a video projection device according to Embodiment 4 of the present invention. In FIG. 57, reference numeral 1 denotes a screen for displaying an image, 2 denotes a projector that projects an image on the screen 1 with visible light and infrared light, 3 denotes a projection image projected on the screen 1 by the projector 2, and 4 denotes a projection image 3 in red. Camera 5 for photographing with external light, 5 for a video source that outputs a video signal, 6 for generating correction data from data from camera 4, correcting the video signal from video source 5, and outputting it to projector 2 The device 7 is the viewpoint position of the observer. Here, the video source 5 and the camera 4 may be configured to be included in the video correction device 6. In the fourth embodiment, the surface of the screen 1 is not necessarily required to be flat, but is assumed to be a free-form surface. Further, the surface of the screen 1 changes with time. In addition, the viewpoint position 7 and the position of the camera 4 are assumed to match. The hardware configuration of the video projection device according to the second embodiment of the present invention is the same as that according to the first embodiment shown in FIG.

An outline of the operation of the video projection apparatus according to the fourth embodiment of the present invention will be described with reference to FIGS. As shown in FIG. 57, the projector 2 is arranged in a direction oblique to the front direction of the screen 1. In the image correction device 6, a test image is generated by the correction data creation program and output to the projector 2. The test image input to the projector 2 is projected by infrared light, and a projected image 3 is formed on the screen 1. At this time, the projected image 3 is a distorted figure when viewed from the viewpoint position 7 due to the fact that the screen 1 and the projector 2 are not directly installed and the surface shape of the screen 1. Viewpoint position 7
At the same position as above, the projected image 3 of the test image is photographed by the camera 4 with infrared light, and the image input memory 3 of the image
Enter 06. The generated test image is compared with the photographed image input to the video input memory 306 to calculate the distortion of the projected video, and to calculate correction data for giving the reverse distortion in advance so that there is no distortion at the time of projection. And the recording medium 30
3, or stored in the main storage device 304.

Next, the video signal output from the video source 5 by the video correction program is sequentially taken into the video input memory 306 for each image frame, and is transferred from the video input memory 306 to the video output memory 307 in accordance with the correction data. Is sequentially converted and stored. The contents of the video output memory 307 are sequentially output as a video signal and output to the projector 2. At this time, the correction data creation program and the image correction program are executed in parallel, and the projector 2 projects the test image with infrared light and the corrected image with visible light at the same time. In other words, the correction data creation program updates the correction data in real time, and the video correction program corrects the video using the latest correction data, and simultaneously projects two videos on the screen 1. In this way, on the screen 1 having a surface that changes with time, only the corrected image is always formed as a correct image without distortion. Next, the block configuration of the video projection device according to the fourth embodiment of the present invention is the same as the detailed configuration of the first embodiment, and a description thereof will be omitted.

The detailed operation of the video projector according to the fourth embodiment will be described with reference to a flowchart. 58 to 61 are flowcharts of the detailed operation of the video projection device according to the fourth embodiment. FIG. 58 is an overall flowchart of the fourth embodiment. First, a test image is generated and projected from the projector 2 onto the screen 1 with infrared light (steps S41, S41-1, 2 in FIGS. 58 and 59).
Next, the procedure for extracting a test image will be described (FIGS. 58 and 6).
Steps S42 and S42-1 to S6). That is, screen 1
A projected image 3 of a test image projected on the camera with infrared light is photographed by an infrared light camera 4. Only the feature points of the test image are shown in the captured image, and this image is referred to as a feature point image Z1.
It is set to 0 (step S42-1 in FIG. 60). Step S42-2,3 ~
The labeling operation of No. 6 is the same as Steps S1-5 and S6 in Embodiment 1 described above, and the description is omitted.

Subsequently, steps S2 and S in the first embodiment are performed.
In the same procedure as in steps S3 and S4, the projection designation area is determined (step S43 in FIG. 58), and a correction table is generated (step S4 in FIG. 58).
4) Then, the image is corrected (step S45 in FIG. 58). A test image is generated, and a test image of infrared light and a corrected image of visible light are superimposed on each other.
(Steps S46, S46-1, 2 in FIGS. 58 and 61).
The observer at the viewpoint 7 cannot see the test image of infrared light with the naked eye, and can correctly see only the corrected image projected with visible light without distortion.

The test image projected with infrared light
Returning to S42, the image is taken again by the camera, and the correction table is updated.

Thereafter, steps S42 to S46 in FIG. 58 are repeated. As described above, in the fourth embodiment, in a situation where the image projected by the projector 2 arranged obliquely with respect to the screen 1 on the surface of the free-form surface that changes from moment to moment is observed at a certain viewpoint position 7, 2, a test image without correction is projected, a test image is photographed with the camera 4 at the viewpoint position 7, and correction data for giving reverse distortion is continuously generated and updated in advance, and projected with the latest correction data. Correction processing of the image to be performed and projection by the projector 2 make it possible to always obtain a correct image without distortion when viewed from the viewpoint position 7. This makes it possible to always obtain a correct image without distortion even for a screen that changes every moment, such as a screen fluttering in the wind outdoors. In the fourth embodiment, the case where infrared light is used for projecting the test image has been described. However, the light beam used for projecting the test image is in a wavelength range invisible to the observer, that is, in a region other than visible light. Any effect can be used, for example, ultraviolet light can provide the same effect. In addition, the position of the camera 4 and the viewpoint position 7
Even if they do not exactly match, a certain effect can be obtained as long as the deviation is small. In the fourth embodiment, the system configuration of one projector has been described. However, the present invention can be applied to a system including two or more projectors as described in the second embodiment. The same effect can be obtained.

(Embodiment 5) Next, a recording medium on which a program for executing video projection (hereinafter referred to as a video projection program) is described. In FIG. 8, the operation of the program is controlled by the central processing unit 305. The main storage device 304 stores programs and various data. The video projection program is stored in the recording medium 303.
Will be recorded. The recording medium 303 may be any recording medium such as a floppy disk, an MO, or a CD-ROM as long as it can be written and read at least once. Also,
A hard disk, such as a hard disk, may be incorporated in the system in advance and may not be portable. The image projection program is sent to the main storage device 3 via the bus 308 by the central processing unit 305.
04 and performs a predetermined operation. The specific operation of the video projection program is as described above, and the description is omitted.

[0106]

As described above, according to the video projection apparatus according to the first aspect of the present invention, test image generation means for generating a test image, video projection means for projecting an image on a screen, and the projected test Shoot the projected image of the image,
Photographing means for outputting as a photographed image, comparing the generated test image and the photographed image, calculating a distortion amount of a projected image, and projecting the image from the distortion amount without distortion. Correction data generating means for generating correction data for giving the reverse distortion to the image in advance, and correction data storage means for holding the correction data. It is possible to obtain a correct image without distortion when viewed, and there is an effect that labor saving such as adjustment of the screen installation and arrangement of the projector, which has conventionally been troublesome, can be achieved.

According to the video projection device of the present invention, in the video projection device according to the first aspect, a video input means for receiving a video, and the received video is stored in the correction data storage means. Video correction means for performing a correction process with the correction data that has been performed, and outputting the correction data to the video projection means,
The weight table is multiplied by 2 to the power of an integer, converted to an integer, and stored in the table, thereby reducing the size of the correction table.
The correction table storage unit can be used efficiently, and the processing of generating the correction table and the calculation of the image correction processing can be performed at high speed.

According to a third aspect of the present invention, in the video projector according to the second aspect, the video correcting means lowers the luminance of a part of the pixels constituting the image to be processed. Since the mask processing is also performed, it is possible to provide an image having no distortion when viewed from the viewpoint position.

According to a fourth aspect of the present invention, in the video projection apparatus according to any one of the first to third aspects, the photographing means includes a screen including a projected image of the projected test image. The apparatus further includes a screen extracting unit that captures the whole image and outputs the captured image as geometrical information, and extracts geometric information of a screen from the captured image. Since the amount of distortion of the projected image is calculated from the captured image and the geometric information of the screen, a projection designation area having a shape similar to the outer shape of the screen is determined. Thus, even if the camera is set at an arbitrary position, there is an effect that it is possible to present a correct image without distortion when viewed from the viewpoint position in front of the screen.

According to a fifth aspect of the present invention, in the video projection device according to any one of the first to fourth aspects, an area on a screen on which an image after correction processing is to be projected is designated as a projection designation area. And the viewpoint, video projection means,
The camera further comprises: a photographing unit; and an input unit for inputting at least one of each position and each orientation of the screen, a screen shape, and a projection designation area as an installation condition. Calculating the amount of distortion of the projected image by taking into account the above, and calculating the projection designated area by inputting the viewpoint position and the relative positional relationship between the camera and the screen. This has the effect of being able to present a correct image without distortion when viewed from an arbitrary viewpoint position.

According to the video projection device of the present invention, in the video projection device of the fifth aspect, the input means superimposes a graphic representing a screen and a graphic representing a projected image of a test image. The user designates the projection designation area on the screen displayed by the user, so that the screen area and the test image area are superimposed on the input screen and the user performs the optimal projection. It is possible to freely set the designated area, and it is possible to present a correct image without distortion when viewed from an arbitrary viewpoint position.

[0112] According to a video projection apparatus according to claim 7 of the present invention, in the video projection apparatus according to any one of claims 2 to 6, the video projection means converts the image corrected by the video correction means. Along with projecting the test image on the screen, the test image of the test image generating means is projected on the screen in a certain wavelength range other than the visible light range, and the photographing means projects a projected image of the projected test image in the wavelength range. The screen is characterized by being photographed, so that it is possible to always obtain a correct image without distortion when viewed from the viewpoint position, and a screen that changes every moment like a screen that flies in the wind outdoors. Has the effect that a correct image can always be obtained.

[0113] According to an image projection apparatus according to claim 8 of the present invention, in the image projection apparatus according to any one of claims 1 to 7, the test image includes a plurality of test images whose position information is known in advance and which has an identifier. It is possible to grasp where each feature point has moved after projection, and to grasp the amount of distortion based on the movement amount of each of the above feature points. It has the effect that can be done.

According to the video projection device of the ninth aspect of the present invention, in the video projection device of the eighth aspect, the test image is such that each feature point is lit one by one or sequentially lit. The feature is that there is an advantage that a plurality of feature points can be identified.

[0115] According to the video projection apparatus according to the tenth aspect of the present invention, in the video projection apparatus according to the eighth or ninth aspect, each of the test images is of a different color. Therefore, there is an effect that a plurality of feature points can be identified.

[0116] According to the video projection device of the present invention, in the video projection device according to any one of claims 8 to 10, the test image is such that each feature point blinks at a different cycle. , And has an effect that a plurality of feature points can be identified.

According to the image projection apparatus of the present invention, in the image projection apparatus of any one of claims 8 to 11, the test image includes a plurality of feature points at equal intervals in the vertical and horizontal directions. Since they are arranged side by side, the plurality of feature points can be identified by the relative positional relationship between the plurality of feature points.

According to the video projection method of the present invention, a test image generation step of generating a test image, a video projection step of projecting an image on a screen, and shooting of a projected video of the projected test image And a photographing step of outputting as a photographed image, a distortion amount calculating step of comparing the generated test image and the photographed image to calculate a distortion amount of a projected image, and projecting the image from the distortion amount without distortion. As a feature, a correction data generation step of generating correction data for giving a reverse distortion to an image in advance, and a correction data storage step of holding the correction data are provided. It is possible to obtain a correct image without distortion when viewed from the viewpoint, and to save labor such as screen installation adjustment and projector arrangement adjustment, which were conventionally troublesome. It has the effect that it is.

According to a fourteenth aspect of the present invention, in the video projection method according to the thirteenth aspect, an image input step of receiving an image and storing the received image in the correction data storing step. And a video correction step of performing a correction process using the correction data being performed and outputting the result to the video projection step. By saving the size of the correction table, the size of the correction table can be reduced, the correction table storage unit can be used efficiently, and the processing of generating the correction table and the calculation of the image correction processing can be performed at high speed. It has the effect of being able to.

According to the image projection method of the present invention, in the image projection method of the present invention, the image correcting step lowers the luminance of a part of the pixels constituting the image to be processed. Since the method includes a step of also performing a mask process, there is an effect that an image without distortion can be provided when viewed from the viewpoint position.

According to a video projection method according to claim 16 of the present invention, in the video projection method according to any one of claims 13 to 15, the photographing step includes a screen including a projected image of the projected test image. The whole is photographed and output as a photographed image, further comprising a screen extracting step of extracting geometric information of the screen from the photographed image, further comprising the distortion amount calculating step, the generated test image, The distortion amount of the projected image is calculated from the photographed image and the geometric information of the screen, so that a projection designation area similar in shape to the outer shape of the screen is determined. This has the effect that even if the camera is set at an arbitrary position, it is possible to present a correct image without distortion when viewed from the viewpoint position in front of the screen. I do.

According to a video projection method according to claim 17 of the present invention, in the video projection method according to any one of claims 13 to 16, the area on the screen on which the image after the correction processing is to be projected is designated by projection. Each area and direction of the viewpoint, image projection means, imaging means, and screen,
At least one of a screen shape and a designated projection area
One, further comprising an input step of inputting as an installation condition, wherein the distortion amount correction step is to calculate a distortion amount of a projected image, also taking into account the installation condition of the input step. By inputting the viewpoint position and the relative positional relationship between the camera and the screen, the designated projection area can be calculated, and a correct image without distortion can be presented when viewed from any viewpoint position. It has the effect of.

According to the video projection method of the present invention, in the video projection method of the present invention,
The input step is characterized in that a user designates a projection designation area on a screen in which a graphic representing a screen and a graphic representing a projected image of a test image are superimposed and displayed, With the screen area and the test image area superimposed and displayed on the input screen, the user can freely set the optimal projection designation area, and present a correct image without distortion when viewed from any viewpoint position. It has the effect of being able to.

According to a video projection method according to claim 19 of the present invention, in the video projection method according to any one of claims 14 to 18, the video projection step includes the step of correcting the image subjected to the correction processing in the video correction step. Along with projecting the test image on the screen, the test image generated in the test image generating step is projected on the screen in a certain wavelength range other than the visible light range. It is characterized by the fact that it is characterized by the fact that it is always shot from the viewpoint, so that it can always obtain a correct image without distortion, and it changes every moment like a screen fluttering in the wind outdoors. There is an effect that a correct image can always be obtained for the screen.

According to a video projection method according to a twentieth aspect of the present invention, in the video projection method according to any one of the thirteenth to nineteenth aspects, the test image has position information known in advance and has an identifier. Since it is composed of a plurality of feature points, it is possible to grasp where each feature point has moved after projection, and to grasp the amount of distortion by the movement amount of each feature point. It has the effect of being able to.

According to the video projection method of the present invention, in the video projection method of the present invention,
The test image is characterized in that each feature point is turned on one by one or sequentially turned on, so that there is an effect that a plurality of feature points can be identified.

According to a video projection method according to claim 22 of the present invention, in the video projection method according to claim 20 or 21, the test image is characterized in that each feature point is of a different color. Therefore, there is an effect that a plurality of feature points can be identified.

According to a video projection method according to claim 23 of the present invention, in the video projection method according to any one of claims 20 to 22, the test image is such that each feature point blinks at a different cycle. Since there is a certain feature, there is an effect that a plurality of feature points can be identified.

According to a video projection method according to claim 24 of the present invention, in the video projection method according to any one of claims 20 to 23, the test image has a plurality of feature points in the vertical and horizontal directions, respectively. Since the feature points are arranged at equal intervals, the plurality of feature points can be identified based on the relative positional relationship between the plurality of feature points.

According to the recording medium storing the video projection program according to claim 25 of the present invention, a procedure for generating a test image, a photographed image obtained by photographing a projected video of the test image projected on a screen, A distortion amount calculation procedure of comparing the test image with the distortion amount of the projected image, and correction data generation of generating correction data for giving an inverse distortion to the image in advance to project the image without distortion from the distortion amount. Since the procedure and the procedure for storing the correction data for holding the correction data are performed by a computer, it is possible to obtain a correct image without distortion when viewed from the viewpoint position, which is conventionally troublesome. This has the effect of saving labor for operations such as screen installation adjustment and projector arrangement adjustment.

According to a recording medium storing the video projection program according to claim 26 of the present invention, in the recording medium storing the video projection program according to claim 25, the video projection program executes The correction data stored in the correction data storage procedure is corrected,
Since the image correction procedure for projecting the image on the screen is further provided, the size of the correction table is reduced by multiplying the weight table by an exponent of 2 and converting the weight table into an integer. The size of the correction table can be reduced, the correction table storage unit can be used efficiently, and the processing of generating the correction table and the calculation of the image correction processing can be performed at high speed.

According to a recording medium storing a video projection program according to claim 27 of the present invention, in the recording medium storing the video projection program according to claim 26, the video correction procedure comprises the steps of: And a processing procedure that also performs a masking process for lowering the luminance of some of the pixels to be provided, so that it is possible to provide an image having no distortion when viewed from the viewpoint position. Having.

According to a recording medium on which the video projection program according to claim 28 of the present invention is recorded, claims 25 to 2
7. A screen extraction procedure for extracting geometric information of a screen from a photographed image obtained by photographing the entire screen including a projected image of a projected test image in a recording medium recording the image projection program according to any one of 7. The distortion amount calculating step is to calculate a distortion amount of a projected image from the generated test image, the captured image, and the geometric information of the screen. Therefore, even if the camera is set to an arbitrary position, by determining the projection designation area similar in shape to the outer shape of the screen, the correct image with no distortion can be presented when viewed from the viewpoint in front of the screen. It has the effect that can be done.

According to a recording medium on which the video projection program according to claim 29 of the present invention is recorded, claims 25 to 2 are provided.
8. A recording medium on which the video projection program according to any one of 8 is recorded, wherein an area on the screen on which the image after the correction processing is to be projected is defined as a projection designated area, and a viewpoint, a video projection unit, a photographing unit, and positions of the screen And an input procedure for inputting at least one of each orientation, screen shape, and projection designated area as an installation condition,
The distortion amount correction procedure is characterized in that the distortion amount of the projected image is calculated in consideration of the installation conditions as well, so that the viewpoint position and the relative positional relationship between the camera and the screen are input. Thereby, the projection designation area can be calculated, and there is an effect that a correct image without distortion can be presented when viewed from an arbitrary viewpoint position.

According to the recording medium storing the video projection program according to claim 30 of the present invention, in the recording medium storing the video projection program according to claim 29, the input procedure includes: a graphic representing a screen; In the screen on which the graphic representing the projected image of the image is displayed in a superimposed manner, the user designates the projection designation area, so that the screen area and the test image area are superimposed on the input screen. In the displayed state, it is possible for the user to freely set the optimal projection designation area, and it is possible to present a correct image without distortion when viewed from an arbitrary viewpoint position.

According to the recording medium on which the video projection program according to claim 31 of the present invention is recorded, claims 25 to 3 are provided.
0, wherein the test image is constituted by a plurality of feature points whose position information is known in advance and has an identifier. Therefore, it is possible to grasp where each feature point has moved after projection, and it is possible to grasp the amount of distortion based on the movement amount of each feature point.

According to the recording medium storing the video projection program according to claim 32 of the present invention, in the recording medium storing the video projection program according to claim 31, each feature point of the test image is lit one by one. Or, they are turned on sequentially, so that there is an effect that a plurality of feature points can be identified.

According to the recording medium storing the video projection program according to claim 33 of the present invention, in the recording medium storing the video projection program according to claim 31 or 32, each test image has a feature point. Since the colors are different, it is possible to identify a plurality of feature points.

According to a recording medium on which the video projection program according to claim 34 of the present invention is recorded, claims 31 to 3 are provided.
3. In the recording medium on which the video projection program according to any one of (3) is recorded, the test image is characterized in that each characteristic point blinks at a different cycle, so that a plurality of characteristic points are identified. It has the effect that it can be done.

According to a recording medium on which the video projection program according to claim 35 of the present invention is recorded, claims 31 to 3 are provided.
4. In the recording medium on which the video projection program according to any one of 4 is recorded, the test image is characterized in that a plurality of feature points are arranged at equal intervals in the vertical and horizontal directions. There is an effect that the plurality of feature points can be identified based on the relative positional relationship between the plurality of feature points.

[Brief description of the drawings]

FIG. 1 is a diagram showing a device configuration of a video projection device according to a first embodiment of the present invention.

FIG. 2 is a block diagram of a video projection device according to a first conventional example.

FIG. 3 is an overall flowchart of a first conventional example.

FIG. 4 is an explanatory view of a test image before and after correction according to a first conventional example.

FIG. 5 is a flowchart for calculating the amount of distortion and generating correction data according to the first conventional example.

FIG. 6 is a block diagram of a video projection device according to a second conventional example.

FIG. 7 is a diagram showing a shape of a projected image in a second conventional example.

FIG. 8 is a diagram showing a hardware configuration of the video projection device according to the first embodiment of the present invention.

FIG. 9 is a block diagram of the video projection device according to the first embodiment of the present invention.

FIG. 10 is a diagram showing a detailed configuration of a video correction unit according to the first embodiment of the present invention.

FIG. 11 is a diagram showing a configuration of a test image according to the first embodiment of the present invention.

FIG. 12 is a diagram showing a configuration of a table according to the first embodiment of the present invention.

FIG. 13 is an explanatory diagram of a coordinate system of an image frame according to the first embodiment of the present invention.

FIG. 14 is a correction table according to the first embodiment of the present invention.
Diagram showing the configuration of Th table elements

FIG. 15 is a table T0, according to the first embodiment of the present invention;
Diagram showing the configuration of T1 and T2 table elements

FIG. 16 is an explanatory diagram of an operation principle according to the first embodiment of the present invention.

FIG. 17 is an overall flowchart according to the first embodiment of the present invention;

FIG. 18 is a flowchart of test image projection and extraction processing according to the first embodiment of the present invention.

FIG. 19 is a flowchart of a feature point labeling process according to the first embodiment of the present invention.

FIG. 20 is a flowchart of a process of determining a designated projection area according to the first embodiment of the present invention.

FIG. 21 is a flowchart of a correction table generation process according to the first embodiment of the present invention.

FIG. 22 is a flowchart of a table T0 generation process according to the first embodiment of the present invention.

FIG. 23 is a flowchart of a table T1 generation process according to the first embodiment of the present invention.

FIG. 24 is a flowchart of a table T2 generation process according to the first embodiment of the present invention.

FIG. 25 is a correction table T according to the first embodiment of the present invention.
h Generation process flowchart

FIG. 26 is a flowchart of an image correction process according to the first embodiment of the present invention.

FIG. 27 is a flowchart of a pixel value calculation process according to the first embodiment of the present invention.

FIG. 28 is an explanatory diagram of a shot image Z1 of a projected image of a distorted test image according to the first embodiment of the present invention.

FIG. 29 is a feature point image Z in the first embodiment of the present invention.
Illustration of 10

FIG. 30 is an explanatory diagram of processing for determining a designated projection area according to the first embodiment of the present invention.

FIG. 31 is an explanatory diagram of an image frame C0 according to Embodiment 1 of the present invention.

FIG. 32 is an explanatory diagram of a table T0 generation process according to the first embodiment of the present invention.

FIG. 33 is an explanatory diagram of a table T0 generation process according to the first embodiment of the present invention.

FIG. 34 is an explanatory diagram of a table T1 generation process according to the first embodiment of the present invention.

FIG. 35 is an explanatory diagram of a table T1 generation process according to the first embodiment of the present invention.

FIG. 36 is an explanatory diagram of a table T2 generation process according to the first embodiment of the present invention.

FIG. 37 is an explanatory diagram of table Th generation processing according to the first embodiment of the present invention.

FIG. 38 is a flowchart of projection and extraction processing of a second test image according to the first embodiment of the present invention.

FIG. 39 is a flowchart of projection and extraction processing of a third test image according to the first embodiment of the present invention.

FIG. 40 is a flowchart of a process of projecting and extracting a fourth test image according to the first embodiment of the present invention.

FIG. 41 is a diagram showing a device configuration of a video projection device according to a second embodiment of the present invention.

FIG. 42 is an overall flowchart in Embodiment 2 of the present invention.

FIG. 43 is a flowchart of a process of determining a designated projection area according to the second embodiment of the present invention;

FIG. 44 is a diagram illustrating a process of determining a designated projection area according to the second embodiment of the present invention;

FIG. 45 is a diagram showing a device configuration of a video projection device according to a third embodiment of the present invention.

FIG. 46 is a block diagram of a video projector according to Embodiment 3 of the present invention.

FIG. 47 is an overall flowchart according to Embodiment 3 of the present invention;

FIG. 48 is a flowchart of a screen shape extraction process according to the third embodiment of the present invention.

FIG. 49 is a flowchart of a process of determining a designated projection area according to the third embodiment of the present invention;

FIG. 50 is an explanatory diagram of a process of determining a designated projection area according to the third embodiment of the present invention.

FIG. 51 is a flowchart of a process of determining a second designated projection area according to the third embodiment of the present invention;

FIG. 52 is a diagram showing a screen configuration of an input unit used in a second projection designation area determination process according to the third embodiment of the present invention.

FIG. 53 is a flowchart of a process of determining a third designated projection area according to the third embodiment of the present invention;

FIG. 54 is a diagram showing a screen configuration of an input unit used in a third designated projection area determining process according to the third embodiment of the present invention;

FIG. 55 is an explanatory diagram of a positional relationship between a screen, each viewpoint position, and a camera according to the third embodiment of the present invention.

FIG. 56 is a diagram showing a relationship between each viewpoint position and the shape of a designated projection area according to the third embodiment of the present invention.

FIG. 57 is a diagram showing a device configuration of a video projection device according to a fourth embodiment of the present invention.

FIG. 58 is an overall flowchart in Embodiment 4 of the present invention.

FIG. 59 is a flowchart of a test image projection process according to the fourth embodiment of the present invention.

FIG. 60 is a flowchart of a test image extraction process according to the fourth embodiment of the present invention.

FIG. 61 is a flowchart of projection processing of a test image and a corrected image according to the fourth embodiment of the present invention.

[Explanation of symbols]

Reference Signs List 1 screen 2 projector 3 projected image 4 camera 5 image source 6 image correction device 7 observer's line of sight 8 screen normal 9 camera optical axis 10 temporary designated area 11 designated designated area 101 screen 102 test image 103 pattern generation Circuit 104 D / A conversion circuit 105 Projector 106 Camera 107 Changeover switch 108 A / D conversion circuit 109 Pattern extraction circuit 110 CPU 111 Memory 112 Changeover switch 113 Distortion correction circuit 201 Projection means 202 Projection conversion means 203 Continuous image conversion means 204 Screen 205 Image projected without performing projection transformation 206 Image projected after performing projection transformation 207 Overlapping portion of image 301 Keyboard 302 Mouse 303 Storage medium 304 Main storage device 305 Processing device 306 Video input memory 307 Video output memory 308 Bus 401 Input frame memory 402 Output frame memory 403 Address generation means 404 Address conversion means 405 Weight determination means 406 Pixel interpolation means 407 Mask processing determination means 408 Mask processing means 501 Test image 502 Image Test image on frame B 503 Test image on image frame C1 504 Ideal test image to be obtained on image frame C0 505 Test image on image frame S before correction 506 Test after correction on image frame B Image 507 Projected test image 601 on image frame C2 601 Graphic showing screen area 602 Graphic showing test area 603 Graphic showing projection designated area 604 Mouse cursor 701 Test image generating means 02 image projection means 703 imaging unit 704 test image extracting unit 705 distortion amount calculating unit 706 correcting data generating means 707 correction data storage unit 708 image input unit 709 image correction unit 710 screen extracting unit 711 input unit

 ──────────────────────────────────────────────────の Continuing from the front page (72) Inventor Hiroyuki Yoshida 1006 Kadoma Kadoma, Osaka Prefecture Matsushita Electric Industrial Co., Ltd. (72) Inventor Masafumi Yoshizawa 1006 Kazuma Kadoma, Kadoma City, Osaka Matsushita Electric Industrial Co., Ltd.

Claims (35)

[Claims] 1. A test image generating means for generating a test image, a video projecting means for projecting an image on a screen, a photographing means for photographing a projected image of the projected test image and outputting the photographed image as a photographed image. Compare the test image with the photographed image,
Distortion amount calculation means for calculating the distortion amount of the projected image; correction data generation means for generating correction data for giving an inverse distortion to the image in advance so that the image can be projected without distortion from the distortion amount; A video projection device comprising: a correction data storage unit for storing the correction data. 2. The image projection apparatus according to claim 1, wherein the image input means for receiving an image, and a correction process is performed on the received image with correction data stored in the correction data storage means. An image projection device, further comprising: an image correction unit that outputs to the projection unit. 3. The video projection device according to claim 2, wherein said video correction means also performs a mask process for lowering luminance on a part of pixels constituting an image to be processed. Video projection device. 4. The image projection device according to claim 1, wherein the photographing means photographs an entire screen including a projected image of the projected test image and outputs the photographed image as a photographed image. The image processing apparatus further includes a screen extracting unit that extracts screen geometric information from the photographed image, wherein the distortion amount calculating unit includes the generated test image, the photographed image, and the screen geometric information. And calculating the distortion amount of the projected image from the image projection device. 5. The video projection device according to claim 1, wherein an area on a screen on which the image after the correction processing is to be projected is set as a projection designation area, and a viewpoint, an image projection unit, a photographing unit, and a screen are provided. Input means for inputting at least one of each position and each direction, the screen shape, and the projection designated area as installation conditions,
The image projection apparatus, further comprising: a distortion amount correction unit that calculates a distortion amount of a projected image in consideration of an installation condition of the input unit. 6. The image projection device according to claim 5, wherein the input unit specifies a projection designation area on a screen in which a graphic representing a screen and a graphic representing a projected video of a test image are displayed in a superimposed manner. An image projection device, characterized in that: 7. The video projection device according to claim 2, wherein the video projection unit projects an image corrected by the video correction unit onto a screen and a test image generated by a test image generation unit. Is projected on the screen in a certain wavelength range other than the visible light range, the photographing means, the projected image of the projected test image,
An image projection apparatus for capturing an image in the above wavelength range. 8. The video projection device according to claim 1, wherein the test image is constituted by a plurality of feature points whose position information is known in advance and has an identifier. Video projection device. 9. The video projection device according to claim 8, wherein each of the test images is lit one by one or sequentially lit in the test image. 10. The video projection device according to claim 8, wherein each of the test images is of a different color. 11. The video projection apparatus according to claim 8, wherein each of the test images blinks at a different cycle in the test image. 12. The video projection device according to claim 8, wherein the test image is a test image in which a plurality of feature points are arranged at equal intervals in the vertical and horizontal directions. apparatus. 13. A test image generating step of generating a test image, a video projecting step of projecting the image on a screen, a shooting step of shooting a projected video of the projected test image and outputting the shot image as a shot image. A distortion amount calculating step of comparing the test image with the photographed image to calculate a distortion amount of the projected image; and a correction for giving an inverse distortion to the image in advance so that the image can be projected without distortion from the distortion amount. A video projection method, comprising: a correction data generation step of generating data; and a correction data storage step of storing the correction data. 14. The video projection method according to claim 13, wherein a video input step of receiving a video, and a correction process is performed on the received video using the correction data stored in the correction data storage step. An image correcting step of outputting the image to the image projecting step. 15. The image projection method according to claim 14, wherein the image correction step includes a step of also performing a mask process for lowering the luminance on a part of the pixels constituting the image to be processed. Video projection method. 16. The image projecting method according to claim 13, wherein the photographing step photographes the entire screen including a projected image of the projected test image and outputs the photographed image. And a screen extracting step of extracting screen geometric information from the photographed image, wherein the distortion amount calculating step includes generating the test image, the photographed image, and the screen geometric information. And calculating a distortion amount of the projected image from the following. 17. The video projection method according to claim 13, wherein an area on a screen on which an image after the correction processing is to be projected is defined as:
An input step of inputting, as installation conditions, at least one of a position, an orientation, a screen shape, and a projection designated area of each of a viewpoint, a video projecting unit, a photographing unit, and a screen, as a designated designated area; The image projection method, wherein the distortion amount correction step calculates the distortion amount of the projected image in consideration of the installation conditions of the input step. 18. The image projection method according to claim 17, wherein, in the input step, a user designates a projection designation area on a screen in which a graphic representing a screen and a graphic representing a projected video of a test image are displayed in a superimposed manner. An image projection method, which is to be specified. 19. The video projection method according to claim 14, wherein in the video projection step, the image corrected in the video correction step is projected on a screen and generated in a test image generation step. The test image is projected onto a screen in a certain wavelength region other than the visible light region, and the photographing step is to photograph a projected image of the projected test image in the above wavelength region. Projection method. 20. The video projection method according to claim 13, wherein the test image is constituted by a plurality of feature points whose position information is known in advance and has an identifier. Characteristic video projection method. 21. The video projection method according to claim 20, wherein in the test image, each feature point is turned on one by one or sequentially turned on. 22. The video projection method according to claim 20, wherein each of the test images is of a different color. 23. The video projection method according to claim 20, wherein each of the test images blinks at a different cycle in the test image. 24. The video projection method according to claim 20, wherein the test image is obtained by arranging a plurality of feature points at equal intervals in the vertical and horizontal directions. Video projection method. 25. A procedure for generating a test image, and a distortion amount calculation for calculating a distortion amount of the projection image by comparing the photographed image obtained by photographing the projection image of the test image projected on the screen with the generated test image. A correction data generation procedure for generating correction data for giving an inverse distortion to an image in advance in order to project an image without distortion from the distortion amount, and a correction data storage procedure for holding the correction data. A recording medium on which a video projection program to be executed is recorded. 26. A recording medium on which the video projection program according to claim 25 is recorded, wherein said video projection program causes a received video to perform a correction process on correction data stored in a correction data storing procedure, and displays the correction data on a screen. A recording medium storing a video projection program, further comprising a video correction procedure for projecting. 27. A recording medium on which the video projection program according to claim 26 is recorded, wherein said video correction procedure includes a processing procedure for also performing a mask process for lowering luminance on a part of pixels constituting an image to be processed. A recording medium having recorded thereon a video projection program. 28. A recording medium on which the video projection program according to claim 25 is recorded, wherein a geometrical shape of the screen is obtained from a captured image obtained by capturing the entire screen including the projected video of the projected test image. Adding a screen extraction procedure for extracting important information; calculating the distortion amount from the generated test image, the photographed image, and the geometric information of the screen. A recording medium on which a video projection program is recorded. 29. A recording medium on which the video projection program according to claim 25 is recorded, wherein an area on a screen on which an image after the correction processing is to be projected is defined as:
An input procedure for inputting at least one of a viewpoint, a video projecting unit, a photographing unit, and each position and orientation of a screen, a screen shape, and a projection designated region as an installation condition; The distortion amount correction procedure calculates the amount of distortion of a projected image in consideration of the above installation conditions. A recording medium storing an image projection program. 30. A recording medium on which the video projection program according to claim 29 is recorded, wherein the input procedure is such that a user projects on a screen in which a graphic representing a screen and a graphic representing a projected video of a test image are displayed in a superimposed manner. A recording medium for recording a video projection program, which designates a designated area. 31. A recording medium on which the video projection program according to any one of claims 25 to 30 is recorded, wherein the test image is constituted by a plurality of feature points whose position information is known in advance and has an identifier. A recording medium having recorded thereon a video projection program. 32. A recording medium on which the video projection program according to claim 31 is recorded, wherein the test image is one in which each feature point is lit one by one or sequentially lit. The recording medium on which it was recorded. 33. A recording medium on which the video projection program according to claim 31 or 32 is recorded, wherein the test image has a feature point of a different color. recoding media. 34. A recording medium on which the video projection program according to claim 31 is recorded, wherein the test image is one in which each feature point blinks at a different cycle. A recording medium on which a program is recorded. 35. A recording medium on which the video projection program according to claim 31 is recorded, wherein the test image has a plurality of characteristic points arranged at equal intervals in the vertical and horizontal directions. A recording medium on which a video projection program is recorded.