JP3958693B2 - Projection plane information acquisition device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a projection plane information acquisition apparatus that acquires information of a projection plane at an arbitrary projection destination of a projector.
[0002]
[Prior art]
Conventionally, as a method related to a projection plane information acquisition apparatus that acquires information of a projection plane at a projection destination of a projector, a method described in a paper shown in Non-Patent Document 1 below is known.
[0003]
In the method described in this paper, as shown in the figure, the projector, mirror, laser scanner, and camera are used to obtain information about the distance of the projection plane at the projection destination of the computer projector. . That is, as shown in this figure, by reflecting the projection direction of the projector with a mirror, the laser stripe on the projection surface of the laser scanner is acquired by the camera, and the distance to the projection surface is measured. Can do. By such a method, information on the projection plane at the projection destination of the projector is acquired, and projection processing according to the shape of the projection destination is realized.
[0004]
[Non-Patent Document 1]
Piper, B., Ratti, C., and Ishii, H., Illuminating Clay: A 3-D Tangible Interface for Landscape Analysis, in Proceedings of Conference on Human Factors in Computing Systems (CHI '02), (Minneapolis, Minnesota, (USA, April 20-April 25, 2002)
[0005]
[Problems to be solved by the invention]
However, according to the above-described prior art, the area where the distance information can be acquired (projection destination of the projector) is fixed, and it is difficult to change in an arbitrary direction. If this direction is changed arbitrarily, the entire system will be put on a pan head and so on. Further, since the relationship of the optical system is shifted by changing the direction, there is a problem that it is necessary to perform calibration for each direction.
[0006]
The present invention has been made in view of the above problems, and an object of the present invention is to provide a projection plane information acquisition device for easily acquiring information on a projection plane in an arbitrary direction projected from a projector. To do.
[0007]
[Means for Solving the Problems]
In order to achieve such an object, a projection plane information acquisition apparatus according to the present invention includes a computer, a projector, a camera, a range finder, two half mirrors, and at least one axis that operate under the control of a program. a rotating mirror to the rotating shaft, is composed of, the computer, the rotating mirror control means for controlling the direction of the rotational mirror control projects, input of information obtained from the camera and the range finder, and the projection A projection control means for controlling the output of information to be transmitted, the first position where the optical axis from the rotating mirror is transmitted through the first half mirror, and the optical axis from the rotating mirror is the first half. The second position, which is the position reflected by the mirror and reflected by the second half mirror, and the optical axis from the rotary mirror is reflected by the first half mirror and transmitted by the second half mirror. The projector, the camera, and the range finder are arranged so as not to overlap each other at any of the three positions with respect to the third position .
[0008]
At this time, as one configuration of the present invention, the camera is disposed at a first position, the range finder is disposed at a second position, and the projector is disposed at a third position. Yes.
[0009]
As another configuration of the present invention for achieving the above object, the range finder is disposed at a first position, the projector is disposed at a second position, and the camera is disposed at a third position. It is characterized by being.
[0013]
In each projection plane information acquisition apparatus described above, the rotating mirror control means controls the rotational position of the rotating mirror, the camera, an image coincident with the optical axis of the projector projection plane of an arbitrary projection destination while acquiring said range finder is characterized by acquiring a distance image that coincides with the optical axis of the projector projection plane of an arbitrary projection target at the same time.
[0014]
In the present invention, by adopting the configuration as described above, the optical axis of the projector, camera, and range finder is prevented from changing even if the projection direction is arbitrarily changed by controlling the reflecting mirror facing the projection surface. In the processing of data obtained by different devices such as projectors, cameras, and rangefinders, it eliminates the need for correction for alignment during data fusion and eliminates the need for calibration between devices, making it extremely efficient Realize good processing.
[0015]
Furthermore, by adopting the configuration as described above, it is possible to avoid the problem of occlusion due to a shift in the arrangement position of the apparatus, thereby realizing very efficient processing.
[0016]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0017]
A projection plane information acquisition apparatus according to the present invention includes a computer, a projector, a camera, a range finder, at least two half mirrors, and a rotating mirror having at least one or more axes as rotational axes. The computer includes a rotating mirror control unit that controls a rotating mirror and controls a projection direction, a projection control unit that controls input of information obtained from the camera and the range finder, and output of information to be projected. Have.
[0018]
FIG. 1 is a configuration diagram showing an example of the configuration of a projection plane information acquisition apparatus according to an embodiment of the present invention. According to FIG. 1, this projection plane information acquisition apparatus includes a computer 1, a projector 2, a camera 3, a range finder 4, half mirrors 5 and 6, and a rotary mirror 7. , Rotating mirror control means 11 and projection control means 12.
[0019]
The computer evening 1 may be, for example, a personal computer / advanced technology (PC / AT) compatible machine manufactured by IBM Corporation. In the example shown in FIG. 1, the computer 1 is configured as a single computer. Of course, there is no problem even if it is configured as a computer system connected to a single network. At this time, the computers may be connected to the network via a network interface card (NIC), or may be connected by other means such as a wireless LAN.
[0020]
As the projector 2, a liquid crystal projector or the like can be used. This liquid crystal projector is an apparatus that outputs an image by sandwiching liquid crystal between two polarizing filters whose polarization directions intersect at right angles and controlling the light that is passed through and blocked by liquid crystal molecules by turning the voltage on and off. is there.
[0021]
The camera 3 may use a CCD (Charge Coupled Device) camera or the like. This is a camera using a CCD as an image sensor.
[0022]
The range finder 4 is a device that acquires the shape (relative position information) of an object and imports it into the computer 1, and an active illumination method, a time-of-flight measurement method, and the like are known.
[0023]
The half mirrors 5 and 6 are a kind of mirror, and are transparent mirrors that do not reflect all the light hitting the mirror and transmit some part of the light. In addition, it is possible to replace with an optical product having such properties, and a so-called beam splitter may be used.
[0024]
The rotating mirror 7 is a reflecting mirror that can rotate about at least one axis, and the direction of the mirror by the rotational motion is controlled by the rotating mirror control means 11. With respect to the control of the rotation axis in the rotary mirror control means 11, known techniques and methods can be used.
[0025]
The projection control means 12 operated by the computer 1 together with the rotary mirror control means 11 performs processing for controlling input of information obtained from the camera 3 and the range finder 4 and output of information to be projected. It is. This processing procedure will be described with reference to FIG. This processing is performed as follows in the procedure of S1 to S6 (S represents a step) shown in FIG.
[0026]
[Step 1] Input of projection information,
[Step 2] Input of the rotational position of the rotary mirror 7 from the rotary mirror control means 11,
[Step 3] Input of an image taken from camera 3,
[Step 4] Input of the distance image acquired from the range finder 4,
[Step 5] Generation of projection information,
[Step 6] Output information to be projected to the projector 2.
[0027]
In addition, regarding the method for inputting and generating the projection information, processing predetermined by the user is executed. There are various projection information generation processes, such as a video correction process described in Japanese Patent Application Laid-Open No. 2001-61121 “Projector Device”, a color correction process of a projected image based on an image taken from the camera 3, and the like. Various techniques are known and may be used.
[0028]
As shown in FIG. 3, the projector 2 is configured such that the image projected from the projector 2 is reflected by the half mirror 6, and the camera 3 is the camera 3. The range finder 4 is configured such that the distance image acquired by the range finder 4 is transmitted through the half mirror 6. By adopting such a configuration, the optical systems of the different devices of the projector 2, the camera 3, and the range finder 4 are matched, and correction for alignment at the time of data fusion is not necessary, and calibration between devices is necessary. There is an advantage that the problem of occlusion due to the displacement of the arrangement position of the apparatus can be avoided.
[0029]
In addition, the configuration of the projection plane information acquisition apparatus according to another embodiment of the present invention is configured such that the image projected from the projector 2 is reflected by the half mirror 6, as shown in FIG. The camera 3 is configured so that an image captured by the camera 3 is transmitted through the half mirror 6, and the range finder 4 is configured such that the distance image acquired by the range finder 4 is reflected twice by the half mirrors 5 and 6. Configured.
[0030]
In addition, as shown in FIG. 5, the projector 2 is configured such that the image projected from the projector 2 is reflected twice by the half mirrors 5 and 6, as shown in FIG. The camera 3 is configured such that an image captured by the camera 3 is reflected by the half mirror 6, and the range finder 4 is configured so that the distance image acquired by the range finder 4 is transmitted through the half mirror 6. Configured.
[0031]
In addition, as shown in FIG. 6, the projector 2 is configured so that the image projected from the projector 2 is reflected twice by the half mirrors 5 and 6, as shown in FIG. The camera 3 is configured such that an image captured by the camera 3 is transmitted through the half mirror 6, and the range finder 4 is configured such that the distance image acquired by the range finder 4 is reflected by the half mirror 6. Configured.
[0032]
In addition, as shown in FIG. 7, the projector 2 is configured such that an image projected from the projector 2 is transmitted through the half mirror 6, as shown in FIG. 3 is configured such that an image captured by the camera 3 is reflected by the half mirror 6, and the range finder 4 is configured such that the distance image acquired by the range finder 4 is reflected twice by the half mirrors 5 and 6. Configured.
[0033]
In addition, as shown in FIG. 8, the projector 2 is configured such that an image projected from the projector 2 is transmitted through the half mirror 6, as shown in FIG. 3 is configured such that an image photographed by the camera 3 is reflected twice by the half mirrors 5 and 6, and the range finder 4 is configured so that a distance image acquired by the range finder 4 is reflected by the half mirror 6. Configured.
[0034]
In addition, it is possible to realize part or all of the processing functions of the respective units that perform each process shown in FIG. 1 using a computer, or to cause the computer to execute each processing procedure shown in FIG. Needless to say, a computer-readable recording medium, for example, an FD (floppy disk: a program for realizing a processing function of each unit by the computer or a program for causing the computer to execute the processing procedure. (Registered trademark), MO, ROM, memory card, CD, DVD, removable disk, etc., which can be stored, provided, and distributed through a communication network such as the Internet. It is possible to
[0035]
Although the present invention has been specifically described above based on the embodiment, it is needless to say that the present invention is not limited to the above embodiment and can be variously modified without departing from the gist thereof. Absent.
[0036]
【The invention's effect】
According to the present invention, in the processing of data obtained by different apparatuses such as a projector, a camera, and a range finder, correction for alignment during data fusion is not necessary, and calibration between apparatuses is not necessary. As a result, it is possible to achieve an extremely efficient process.
[0037]
Furthermore, according to the present invention, it is possible to avoid the problem of occlusion due to a shift in the arrangement position of the apparatus, and an effect of realizing very efficient processing can be obtained.
[Brief description of the drawings]
FIG. 1 is a configuration diagram showing a configuration of a projection plane information acquisition apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram for explaining an example of an actual processing flow performed in each unit shown in the configuration.
FIG. 3 is a diagram for explaining an example of a configuration according to an embodiment of the present invention.
FIG. 4 is a diagram for explaining an example of a configuration according to an embodiment of the present invention.
FIG. 5 is a diagram for explaining an example of a configuration according to an embodiment of the present invention.
FIG. 6 is a diagram for explaining an example of a configuration according to an embodiment of the present invention.
FIG. 7 is a diagram for explaining an example of a configuration according to an embodiment of the present invention.
FIG. 8 is a diagram for explaining an example of a configuration according to an embodiment of the present invention.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Computer 11 ... Rotary mirror control means 12 ... Projection control means 2 ... Projector 3 ... Camera 4 ... Rangefinder 5 ... Half mirror 6 ... Half mirror 7 ... Rotary mirror

Claims (4)

A projection plane information acquisition device for acquiring information of a projection plane projected from a projector,
A computer that operates under the control of a program, a projector, a camera, a range finder, two half mirrors, and a rotating mirror having at least one axis as a rotation axis;
The computer controls rotating mirrors to control the direction of projection, rotating mirror control means, input of information obtained from the camera and the range finder, and projection control means to control the output of information to be projected, With
The first position where the optical axis from the rotating mirror is transmitted by the first half mirror, and the position where the optical axis from the rotating mirror is reflected by the first half mirror and also reflected by the second half mirror. The projector, the camera, and the range finder have the three positions with respect to the second position and the third position where the optical axis from the rotary mirror is reflected by the first half mirror and transmitted by the second half mirror. A projection plane information acquisition apparatus, wherein the projection plane information acquisition apparatus is arranged so as not to overlap each other at any position . 2. The projection plane information acquisition apparatus according to claim 1, wherein the camera is disposed at a first position, the range finder is disposed at a second position, and the projector is disposed at a third position. . The projection plane information acquisition apparatus according to claim 1, wherein the range finder is disposed at a first position, the projector is disposed at a second position, and the camera is disposed at a third position. . The rotary mirror control means controls the rotational position of the rotary mirror,
The camera acquires an image coincident with the optical axis of the projector on an arbitrary projection destination, and the range finder simultaneously obtains a distance image coincident with the optical axis of the projector on an arbitrary projection destination. To win,
The projection image information acquisition apparatus according to claim 1 , wherein the projection image information acquisition apparatus is a projection image information acquisition apparatus.

Images