JP2003015218A - Projection display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a projection display device in which the positioning, etc., of an image projection means and a photographic means is easy, and a parallax is not caused between a projection image and a photographed image. SOLUTION: The projection display device is provided with a casing 8a to house an image projection means 26 and a photographic means 24, an opening 28 provided in the casing 8a, and a spectroscopic means 29 which allows a projection light emission to a projection plane from the image projection means 26 and an incidence of light reflected from the projection plane or an object to the photographic means 24 through the opening 28. The display device carries out the projection light emission to the projection plane from the image projection means 26, and the incidence of the light reflected from the projection plane or the object to the photographic means 24 from the same opening 28 through the spectral means 29. Thereby, the center of the projection image coincides with the center of the photographic image in projection the image projection and photographing the image and two images are superposed without displacement, and the parallax is not caused in the projection image and the photographed image.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a projection type display device such as a liquid crystal projector for displaying a projected image on a screen.

[0002]

2. Description of the Related Art In recent years, a liquid crystal projector for displaying an image by projecting a display image on a screen has become widespread as a tool capable of giving a more demanding presentation. Such a liquid crystal projector is roughly equipped with a liquid crystal panel that forms an image for display based on an image signal output from a personal computer,
The transmitted light or the reflected light of the liquid crystal panel is enlarged and projected on the screen by the projection lens system.

Here, an example of a conventional liquid crystal projector will be described with reference to FIG. As shown schematically in FIG. 31, a conventional liquid crystal projector 100 includes a light source 101, a transmissive liquid crystal panel 102 arranged in front of the light source 101, and a projection optical lens arranged in front of the liquid crystal panel 102. It is composed of a system 103 and a circuit system 104 for driving the liquid crystal panel 102. An image signal created by a personal computer 105 or the like provided separately from the liquid crystal projector 100 is input to the liquid crystal projector 100, and the image signal is sent to the circuit system 104 via the interface cable 106. By driving the liquid crystal panel 102 by the circuit system 104, an image based on the image signal is displayed on the liquid crystal panel 102. Then, white light emitted from the light source 101 is incident on the liquid crystal panel 102 on which an image based on the image signal is displayed and passes through the liquid crystal panel 102 to generate image light. As it passes through the lens system 103, it becomes projection light and is imaged on the screen 107.

Further, in recent years, a liquid crystal projector has been developed in which handwritten characters can be written on a screen on which an image is projected, another material can be attached, and data inserted later can be recorded. JP-A-8-304751 and JP-A-9-298756.
It is disclosed in Japanese Patent Publication No.

As shown in FIG. 32, Japanese Unexamined Patent Publication No. 8-3047.
In the liquid crystal projector 200 disclosed in Japanese Patent Publication No. 51-51, in addition to the configuration of the liquid crystal projector 100 shown in FIG. 31, a semi-reflection mirror 201 is arranged between a liquid crystal panel 102 and a projection optical lens system 103, and a screen 107 is provided. The reflected image is reflected by the semi-reflective mirror 201 in a direction other than the liquid crystal panel 102, and the reflected light is imaged by the image capturing means 203 via the imaging lens 202 to be converted into a signal. The difference is obtained by comparing with the video signal sent, and the difference signal is amplified and then combined with the original video signal sent to the liquid crystal panel 102 to record or print the combined signal.

Further, as shown in FIG. 33, Japanese Patent Laid-Open No. 9-2
The video display device 300 disclosed in Japanese Patent Publication No. 98756 is
The image projected from the projection enlargement display system 301 onto the screen 302 can be captured by the image pickup device 303, and a plurality of correction waveforms superimposed on the image information based on the image information fetched from the image pickup device 303 are matrix-corrected. Information creation unit 304, memory control unit 30
5, the frame memory 306, the correction signal conversion unit 307, and the like, and the video signal is transmitted to the video circuit 308. The video signal from the video circuit 308 is sent to the projection enlargement display system 301.

In addition, in recent years, the three-dimensional shape (three-dimensional shape) of a subject can be immediately input and used as the performance of the image input device becomes higher and the daily work in the office becomes more diverse and sophisticated. Equipment is expected. In addition, there is an increasing demand for inputting various types of documents as high-definition image information, but by adding a three-dimensional shape as new information to this, there is a movement to enrich document information processing. ing. Therefore, in order to meet these needs and trends, the following devices have been developed and proposed.

For example, as a three-dimensional measuring device, the shape of the object to be measured is measured by the principle of triangulation based on the projection angle of the projected light such as spot light or slit light and the incident angle of the light reflected on the surface of the object to be measured. The device is already on sale.

Further, by providing a measuring means for detecting the three-dimensional position of the original surface and correcting distortion (hereinafter referred to as "curvature distortion") caused by bending using the measuring means, a bent original such as a book can be corrected. Japanese Patent No. 28253 describes a copying machine and a scanner that can record and reproduce by inputting and returning to a plane.
44, JP-A-5-161000, JP-A-5
No. 219323 is disclosed.

[0010]

By the way, according to the liquid crystal projector 200 disclosed in the above-mentioned Japanese Patent Laid-Open No. 8-304751, the incident light incident from the projection optical lens system 103 is photographed by the photographing means 203. Therefore, there are problems that the restrictions on the lens design are increased and that the alignment with the photographing optical system (the imaging lens 202 and the photographing means 203) becomes difficult.

According to the image display apparatus 300 disclosed in the above-mentioned Japanese Patent Laid-Open No. 9-298756, the projection magnifying display system 301 and the image pickup apparatus 303 are provided separately, and the projection magnifying display system 301 is provided. The image projected on the screen 302 from the camera is photographed by the image pickup device 303 and the projection enlarged display system 301 is adjusted.
There is a problem that parallax occurs in the captured image by 3.

On the other hand, a device that can immediately input and use the three-dimensional shape (three-dimensional shape) of a subject is not yet perfect, and there are many problems to be solved. For example, in the case of a conventional three-dimensional measuring device, a light source for projection light and a mechanism for controlling the angle of projection light are required, and the device scale is large. In addition, an output device such as a printing device and a display device for visually recognizing the measured three-dimensional shape is required. These output devices are generally large-scale,
There is a problem that a larger installation space is required.

Further, in the case of a copying machine or a scanner disclosed in Japanese Patent No. 2825344, Japanese Patent Application Laid-Open No. 5-161000, Japanese Patent Application Laid-Open No. 5-219323, etc., the effect of the image distortion correction on the spot can be obtained. In order to confirm or immediately use the image whose distortion has been corrected, an output device such as a printing device or a display device for outputting the image is required separately. Also, these output devices are generally large-scale,
There is a problem that a large installation space is required.

An object of the present invention is to provide a projection type display device in which the position adjustment between the image projection means and the photographing means is easy and the parallax (parallax) does not occur between the projected image and the photographed image. is there.

An object of the present invention is to provide a projection type display device capable of measuring a three-dimensional shape of a subject with high accuracy without inviting an increase in size and cost of the device.

[0016]

The invention according to claim 1 is
An image projecting means for projecting an image on a projection surface with a light source;
In a projection display device comprising: the projection surface and a photographing means for photographing a subject located on the projection surface, a housing for housing the image projection means and the photographing means, and an opening provided in the housing. Section, and the emission of projection light from the image projection means to the projection surface through the opening,
And a spectroscopic unit that allows reflected light from the projection surface or the subject to enter the photographing unit.

Therefore, the emission of the projection light from the image projection means to the projection surface and the incidence of the reflected light from the projection surface or the subject to the photographing means are performed from the same opening through the spectroscopic means. As a result, at the time of image projection and shooting
Since the center of the projected image and the center of the captured image coincide with each other and the two images are superposed without displacement, parallax (parallax) does not occur between the projected image and the captured image. Further, since the optical systems of the image projecting means and the photographing means are independent of each other, designing, position adjustment and the like are facilitated.

According to a second aspect of the present invention, in the projection display apparatus according to the first aspect, the projection of the image projection means onto the projection surface and the photographing means photographing the projection surface or the object are performed. It has a plurality of such operation modes and is provided with a mode selection means capable of selecting these operation modes.

Therefore, for example, in addition to the mode in which projection and photography are performed independently, the mode in which projection and photography are performed simultaneously, the mode in which projection and photography are alternated, and the like,
It becomes possible to switch. As a result, additional information can be recorded on the projected image, which improves usability.

According to a third aspect of the present invention, in the projection display apparatus according to the second aspect, the spectroscopic means emits the projection light from the image projection means to the projection surface through the opening. An optical path switching means capable of switching to any one of an optical path and an incident optical path for forming an image of reflected light from the projection surface or the subject through the opening to the photographing means, the mode selection The optical path is switched according to the operation mode selected by the means.

Therefore, switching between projection and photographing is
This is performed by switching the emission optical path and the incident optical path. This makes it possible to avoid the phenomenon that the amount of light is halved as in the case where a half mirror or the like is used as the spectroscopic means, and flare does not occur.

The invention according to claim 4 is the invention according to claims 1 to 3.
In the projection display device according to any one of 1 to 3, a plurality of images of the subject on the projection surface are captured while the focus position of the image capturing unit is variable and the focus position of the image capturing unit is different. A stereoscopic shape detecting means for detecting a stereoscopic shape of the subject based on the plurality of subject images.

Therefore, it is possible to measure the three-dimensional shape of the object with high accuracy without increasing the size and cost of the apparatus.

The invention according to claim 5 is the invention according to claims 1 to 4.
The projection type display device according to any one of the above 1 through 3 is provided with an optical axis moving means for moving an optical axis of the image projecting means or the photographing means.

Therefore, the projected image can be taken from various directions.

The invention according to claim 6 is the same as claims 1 to 3.
In the projection display device according to any one of items 1 to 3, an optical axis moving unit that moves the optical axis of the image projecting unit or the image capturing unit, and pattern light is applied to the subject on the projection surface by the image projecting unit. And a three-dimensional shape detecting means for moving the optical axis by the optical axis moving means to photograph a plurality of the subjects by the photographing means and detecting a three-dimensional shape of the subject based on the plurality of subject images. Equipped with.

Therefore, it is possible to detect the inclination of the projection surface and the three-dimensional shape of the object on the projection surface by projecting the pattern light on the object on the projection surface and photographing the image from various directions. Become.

The invention according to claim 7 is the invention according to claim 4 or 6.
The projection display device according to the aspect 1 includes a correction unit that corrects the distortion of the subject image based on the three-dimensional shape of the subject detected by the three-dimensional shape detection unit.

Therefore, based on the three-dimensional shape of the subject,
By correcting the distortion of the subject image, it is possible to project the subject image in which the curvature distortion is corrected on the projection surface, so that it is possible to improve the image quality.

According to an eighth aspect of the present invention, in the projection display apparatus according to the seventh aspect, the correction means is in focus from a plurality of subject images photographed with different focal positions of the photographing means. An image obtained by extracting and combining the in-focus areas photographed in (3) is set as a correction target.

Therefore, the pan-focus image generated by combining the focus areas among the plurality of subject images photographed with different focal positions is the correction target, so that the utility value of the corrected image is high. It gets even higher.

The present invention as defined in claim 9 is any one of claims 1 to 8.
In the projection display device according to any one of the above, a support member that positions the casing that stores the image projection unit and the photographing unit above, and a support member that is provided between the support member and the casing, And a rotation member that supports the housing so as to be rotatable in the vertical direction. The projection position by the image projection unit and the photographing position by the photographing unit can be changed.

Therefore, since the projection / shooting position of the image can be changed, the projection / shooting range can be adjusted. As a result, it is possible to solve the problem that the projected image becomes difficult to see due to the motion of the user's hand or the like during projection, and it is possible to use a plurality of projection planes properly and to expand the work area. .

According to a tenth aspect of the present invention, in the projection display device according to the ninth aspect, the turning position of the casing rotatably supported by the rotating member is set, and the housing is stored in the casing. Image position setting means for determining a projected position by the image projection means or a shooting position by the shooting means.

Therefore, the controllability of the projection / shooting range can be improved.

According to an eleventh aspect of the present invention, in the projection display apparatus according to the tenth aspect, the image position setting means is
It has a plurality of image projection / shooting modes, and determines the projection position by the image projection means or the shooting position by the shooting means according to these image projection / shooting modes.

Therefore, it becomes possible to obtain a user interface that is easier to use.

According to a twelfth aspect of the present invention, in the projection display device according to any one of the ninth to eleventh aspects, an inclination detecting means for detecting an inclination amount of at least one of the housing and the projection surface. Equipped with.

Therefore, it becomes possible to easily and highly accurately correct the trapezoidal distortion of the image due to the inclination of the image projection means and the photographing means with respect to the projection surface.

According to a thirteenth aspect of the present invention, in the projection display apparatus according to the tenth aspect, a subject position setting means for setting the position of the subject when the subject is photographed on the projection surface by the photographing means. And a photographing position determining unit that determines the photographing position of the photographing unit by rotating the casing by the image position setting unit according to the position of the subject set by the subject position setting unit. .

Therefore, it is possible to flexibly deal with the case where the position of the object on the projection surface is changed.

According to a fourteenth aspect of the present invention, in the projection display apparatus according to the tenth aspect or the thirteenth aspect, the size of the subject is set when the subject is photographed on the projection surface by the photographing means. A setting unit and a photographing magnification determination unit that determines the photographing magnification of the photographing unit according to the size of the subject set by the subject size setting unit.

Therefore, it is possible to flexibly deal with the case where the size of the subject is changed.

According to a fifteenth aspect of the present invention, in the projection display apparatus according to any one of the first to fourteenth aspects, the light source of the image projecting means is provided in a second casing different from the casing, The housing and the second housing are provided with light guide means that makes it possible to use the light from the light source for projection onto the projection surface.

Therefore, by providing the light source in the second housing which is provided independently of the housing provided with the photographing means and the image projection means, the malfunction of the control system due to the heat generated from the light source is prevented. It becomes possible to reduce.

[0046]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 shows a first embodiment of the present invention.
Or, it demonstrates based on FIG. In this embodiment, as a projection type display device, for example, a handwriting (addition) data on a certain document or a pointing state of a predetermined portion by a pointing stick is photographed, electronic data is filed, and the electronic data is further captured on a photographing plane. It is applied to a liquid crystal projector capable of projecting on.

FIG. 1 is a schematic configuration diagram showing a system including the liquid crystal projector 1 of the present embodiment. As shown in FIG. 1, the liquid crystal projector 1 includes a LAN (Local Area).
Network) 2 is connected, and via this LAN 2,
It can be connected to the server computer 3, the personal computer 4, another liquid crystal projector 5, and the like. This allows the liquid crystal projector 1 to project an image displayed on another display means (the display 3a of the personal computer 3 in FIG. 1). Further, the information written in the projected image from the liquid crystal projector 1 can be transmitted to the personal computer 4 and the additional information can be distributed to the original image. Further, for example, it is possible to project the same image from the liquid crystal projector 1 and the liquid crystal projector 5 at a distant place, and simultaneously project the writing information of each other by the liquid crystal projectors 1 and 5. Furthermore, it is possible to store data in the server computer 3.

Next, the liquid crystal projector 1 of the present embodiment
Will be described. Here, FIG. 2 shows a liquid crystal projector 1.
3 is an external perspective view schematically showing the configuration of FIG. As shown in FIG. 2, the liquid crystal projector 1 is roughly classified into a flat plate-shaped projection surface 6, an image projection / shooting device 8 having both functions of a shooting device and a projection device, and a projection surface of this image projection / shooting device 8. 6
The image forming / capturing device 8 is provided with a support member 7 positioned above the power supply unit 9 and a power supply unit 9 for supplying power to the image projection / imaging device 8. In FIG. 2, a document D is assumed as a subject placed on the projection surface 6, the document D is photographed by the image projecting / capturing apparatus 8, and projected on the projection surface 6 using the image projecting / capturing apparatus 8. is doing. That is, the liquid crystal projector 1 uses the image projecting / capturing device 8 to capture, for example, writing (addition) data on a certain document D or an instruction state with a pointing stick at a predetermined portion, and filing as electronic data, and further The electronic data can be projected on the projection surface 6. The photographing / projection timing can be instructed by the operation of the mechanical instructing means (not shown) such as a switch provided by the user's intention. The image projection / photographing device 8 has a configuration capable of photographing and projecting from the same opening 28 (see FIG. 4), which will be described in detail later.

As shown in FIG. 3, the supporting member 7 of the liquid crystal projector 1 is provided with a rotary bearing 10 which is a rotating member for supporting the casing 8a of the image projecting / photographing device 8 in a vertically rotatable manner. The image projection / photographing device 8 can be rotated around the axis of the rotary bearing 10. Further, the rotary bearing 10 includes the rotary bearing 10
Fixing means 11 is provided which can fix the image projection / imaging device 8 rotated about the axis at the desired position. The fixing means 11 is, for example, by tightening a screw or the like against the shaft of the rotary bearing 10 to bring them into pressure contact with each other.
The rotation of the 0 axis is stopped and fixed. This makes it possible to change the angle θ of the optical axis from the image projection / photographing device 8 with respect to the projection plane 6, and thus the photographing / projection range can be adjusted.

Therefore, according to the liquid crystal projector 1, when the angle between the optical axis from the image projecting / photographing device 8 and the projection surface 6 forms a right angle, when performing a writing operation or a pointing operation by hand during image projection. Due to the effect of the shadow of the hand, the user's line of sight is obstructed and a situation in which it is difficult to see occurs. However, as shown in FIG.
Since it is possible to incline (inclination angle θ in the figure) with respect to, the influence of the hand shadow can be reduced and the visibility can be improved.

In addition, according to the liquid crystal projector 1, as shown in FIG. 3B, the image projecting / photographing device 8 is rotated by the rotary bearing 10 so that its optical axis becomes parallel to the projection surface 6. It can be fixed by the fixing means 11. As a result, a second projection surface (projection screen, whiteboard, wall, etc.) 12 perpendicular to the projection surface 6 (newly formed) 12
Objects such as the documents above can be photographed and projected. Objects such as documents on the second projection surface (projection screen, whiteboard, wall, etc.) 12 are
It is fixed with clips, magnets, adhesive tape, etc.

That is, since the image projection / shooting device 8 is rotated by the rotary bearing 10, the projection / shooting position of the image can be changed, so that the projection / shooting range can be adjusted. As a result, it is possible to solve the problem that the projected image becomes difficult to see due to the motion of the user's hand or the like during projection, and it is possible to use a plurality of projection planes properly and to expand the work area. .

Next, the structure of the liquid crystal projector 1 will be described with reference to FIG. The liquid crystal projector 1
As shown in FIG. 4, an overall control unit 13 having a microcomputer configuration for centrally controlling each unit is provided, and this overall control unit 13 is provided with a CCD (Charge Coupled Device) provided in the image projection / imaging device 8. An image processing unit 15 having 14, an operation unit 16 such as a keyboard, a storage unit 1
7, a communication I / O unit 18 to which the LAN 2 can be connected, a power supply unit 19 having a power supply unit 9, a light source control unit 21 having a light source 20 provided in the image projecting / capturing apparatus 8, and an image projecting / capturing apparatus 8. A liquid crystal controller 23 having a liquid crystal panel 22 is connected. The CCD 14, the image processing unit 15, and a photographing lens 25 provided on the upstream side of the CCD 14 in the light incident direction constitute a photographing unit 24, which includes a light source 20, a light source control unit 21, a liquid crystal panel 22, a liquid crystal controller 23, and a liquid crystal. The image projection means 2 is formed by the projection lens 27 provided on the downstream side of the panel 22 in the light emission direction.
6 are configured.

The image processing unit 15 digitizes the analog signal photoelectrically converted by the CCD 14 and performs automatic white balance, edge enhancement by aperture correction, gradation correction by a γ (gamma) correction circuit, image compression, etc. Processing is performed to generate image data such as JPEG.

The storage unit 17 is composed of an internal memory, a memory card or the like, and stores image data such as JPEG generated by the image processing unit 15.

The light source control section 21 takes in the image projected from the image projecting means 26 from the photographing means 24, judges whether or not there is a difference between the detected illuminance and the set predetermined illuminance. The amount of light projected from 20 is controlled.

The liquid crystal controller 23 reads the image data stored in the storage unit 17 and displays an image based on the image data on the liquid crystal panel 22.

Further, the overall control section 13 causes the image projection means 26 to project the projection surfaces 6 and 12 on the projection planes 6 and 12, and the photographing means 24 to photograph the projection planes 6 and 12 or the document D in accordance with the designation of the operation section 16 or the like. It is provided with a mode selection unit that selects and executes one of a plurality of operation modes related to the execution of. The operation modes include, for example, a mode in which projection and shooting are performed independently, a mode in which projection and shooting are performed simultaneously, and a mode in which projection and shooting are alternately performed.

In addition, as a characteristic configuration of the image projecting / photographing device 8, as shown in FIG. 4, photographing by the photographing means 24 from the same opening 28 and projection from the image projecting means 26 are possible. An optical path switching means 29 is provided. In other words, the optical path switching means 29 emits the projection light from the image projection means 26 to the projection surfaces 6 and 12 and the reflected light from the projection surfaces 6 and 12 or the document D to the imaging means 24 through the opening 28. It functions as a spectroscopic means that allows incident light. The optical path switching means 29 includes a reflecting mirror 30 and a rotating shaft 3 for rotatably holding the reflecting mirror 30.
1 and a drive unit 32 that drives the rotating shaft 31. The drive unit 32 is connected to the overall control unit 13 and is controlled by the overall control unit 13.

Such an optical path switching means 29 is shown in FIG.
As shown in (a), at the time of shooting (shooting mode), the rotating shaft 31 is rotated by the drive of the drive unit 32 to position the reflecting mirror 30 on the light projecting path of the image projecting means 26, and the projection surface. The image of the subject reflected by the image pickup device 6 and the second projection surface 12 is reflected by the reflecting mirror 30 and is formed on the CCD 14 of the photographing means 24.

On the other hand, the optical path switching means 29 is shown in FIG.
As shown in (b), at the time of projection (projection mode), the rotation shaft 31 is rotated by the drive of the drive unit 32 to retract the reflecting mirror 30 from the light projecting path of the image projection unit 26, and the storage unit 17 is provided. The image data stored in is read and an image based on the image data is displayed on the liquid crystal panel 22. Then, the liquid crystal panel 2 on which the image based on the image data is displayed
The light emitted from the light source 20 is incident on the light source 2, and the image light is generated by passing through the liquid crystal panel 22. The image light passes through the projection lens 27 to become the projection light, and the opening portion is formed. An image is formed on the projection surface 6 or the second projection surface 12 via 28.

An example of using the liquid crystal projector 1 having such a configuration will be described with reference to FIG. As shown in FIG. 5A, it is assumed that writing is performed as it is as shown in FIG. 5B on the projection surface 6 onto which the image is projected. When the optical path switching means 29 is switched from the projection mode to the shooting mode in order to leave the written contents as a record, the projected image disappears and only the written contents as shown in FIG. To do. In addition to writing, stop documents on the whiteboard, which is the second projection surface 12,
The same applies when shooting. If the liquid crystal projector 1 is not moved at the time of projecting the image and at the time of shooting, the center of the projected image and the center of the shooting screen coincide, so it is easy to superimpose the two images without misalignment.

Further, as shown in FIG. 5D, the reference mark m is projected on the edge or corner of the screen of the projection image, and when writing, the reference mark m is traced and written, and then the writing screen is photographed. (FIG. 5E) and two sets of corresponding points on the plane (the center of the screen and the reference mark m) are determined, so that the two images can be automatically aligned. The reference mark m may be projected only immediately before shooting. Further, a plurality of projection positions of the reference mark m may be prepared and selected.

In the above description, the optical path switching means 29 is switched from the projection mode to the photographing mode to photograph the subject image excluding the projected image, but it is conceivable that photographing and projection are performed simultaneously. For example, in addition to the mode in which shooting and projection are performed individually, at least one of the mode in which projection and shooting are performed simultaneously or the mode in which projection and shooting are alternated is prepared, and the image is projected. While shooting. Whether to perform the projection and the shooting at the same time or to perform the switching while switching may be selected as needed. As a result, additional information can be recorded on the projected image, which improves usability.

More specifically, as shown in FIG. 4, the reflecting mirror 30 is vibrated at 45 ° to switch the optical path, thereby rapidly switching between photography and projection while repeating photography and projection. Shoot between projections,
The interval between projections is shorter than the time that the afterimage of the human eye remains.

Further, since the mechanism of the optical path switching means 29 becomes complicated at an amplitude of 45 °, as shown in FIG. 6, the photographing means 24 and the image projection means 26 are provided so as to face each other, and the reflecting mirror 30 is provided. It should be able to reflect on both the front and back sides, and the rotary shaft 31 should be provided at the center of the rotary shaft 31 so that
There is also a method of switching the optical path by rotating while stopping 90 ° at the time of projection. With this method, if a motor that rotates in one direction is used as the drive unit 32, the optical path can be switched. If the reflecting mirror 33 is used as shown in FIG. 7,
It is also possible to reduce the size of the liquid crystal projector 1.

Further, as a method which does not use the mechanical optical path switching means 29, as shown in FIG. 8, a method of switching the ratio between the transmittance and the reflectance by using the electrochromic mirror 34 as the spectroscopic means, or As shown in FIG. 9, DMD (Digital Mirror) is used as an optical path switching means.
A method of switching the optical path using the (Device) element 35 may be considered.

Here, the emission of the projection light from the image projection means 26 to the projection surfaces 6 and 12 and the incidence of the reflected light from the projection surfaces 6 and 12 or the document D to the photographing means 24 are optical paths which are spectroscopic means. It is performed from the same opening 28 via the switching means 29. As a result, the center of the projected image and the center of the captured image are the same at the time of image projection and at the time of shooting, and the two images are superposed without displacement, so that parallax (parallax) exists between the projected image and the captured image. Does not occur. Further, since the optical systems of the image projecting means 26 and the photographing means 24 are independent of each other, designing, position adjustment, etc. are facilitated.

Further, the optical path switching means 2 is used as the spectroscopic means.
9 is used to switch between projection and photographing by switching between the outgoing optical path and the incoming optical path, so that the amount of light is halved as in the case where a half mirror or the like is used as the spectroscopic means. Such a phenomenon can be avoided, and flare does not occur.

The liquid crystal projector 1 of the present embodiment
In the above, the image data is stored in the storage unit 17 of the image projection / shooting device 8. However, the present invention is not limited to this, and may be stored in the storage device of the server computer 3 or the personal computer 4, for example. .

Further, the liquid crystal projector 1 of the present embodiment
In the above, the image projecting / capturing device 8 uses one liquid crystal panel 22, but the invention is not limited to this, and a plurality of liquid crystal panels 22 may be used.

A second embodiment of the present invention will be described with reference to FIGS. The same parts as those described in the above-described embodiments are designated by the same reference numerals, and the description thereof will be omitted (same in the following embodiments). In the liquid crystal projector of the present embodiment, the image position setting means for determining the position of the image projection / imaging device 8 rotatable about the axis of the rotary bearing 10 is provided in place of the fixing means 11. This is different from the liquid crystal projector 1 described in the above embodiment.

FIG. 10 is a side view showing the liquid crystal projector 40 of the present embodiment. As shown in FIG. 10, the liquid crystal projector 40 is provided with the rotary bearing 10 similarly to the liquid crystal projector 1 described in the first embodiment, and the image projection / imaging device 8 is mounted on the shaft of the rotary bearing 10. It is designed to rotate around. The rotary bearing 10 is provided with image position setting means 42 for positioning the image projection / imaging device 41 rotated around the axis of the rotary bearing 10 at a predetermined position.

As shown in FIG. 11, the image projecting / photographing apparatus 41 is provided with an overall control section 13 of a microcomputer configuration for centrally controlling each section.
An image position setting means 42 is connected to 3 in addition to the configuration of the liquid crystal projector 1 described in the first embodiment.

Here, the image position setting means 42 will be described in detail. The image position setting means 42 is configured to use, for example, a rotary actuator, and is further provided with a rotation angle detection means (not shown) capable of detecting an angle due to a rotary motion. As a rotary actuator,
AC servo motor, DC servo motor, pulse motor,
A general motor such as a voice coil motor can be used. In the pulse motor, since the rotation angle can be controlled by counting the applied voltage waveform, it is not necessary to separately provide the rotation angle detecting means, and the control circuit for controlling the drive pulse is provided. A rotary encoder such as an optical encoder is used as the rotation angle detecting means. Also,
A magnetic Hall element may be used.

It is necessary to provide the rotary actuator itself with a fixing means for fixing the rotary motion of these rotary actuators at a predetermined position, or to provide a separate means. The fixing means may be any mechanism as long as it can be fixed at a fixed position, and may be the fixing means 11 used in the liquid crystal projector 1 described in the first embodiment.

An example of using the liquid crystal projector 40 having such a configuration will be described with reference to FIG. In general, the liquid crystal projector 40 is provided with a plurality of image projection / shooting modes under the control of the overall control unit 13, and the overall control unit 13 operates the image position setting means 42 according to the image projection / shooting modes. Then, the image projection / imaging device 41 is moved.

As shown in FIG. 12A, when the photographing mode is selected by the operation unit 16 or the like, the overall control unit 1
3 operates the image position setting means 42 to move the image projection / photographing device 41 so that the optical axis and the projection plane 6 (actually, the photographing plane here) are orthogonal to each other. This is because the optical axis from the image projecting / capturing device 41 and the projection surface 6 are at a right angle to eliminate the influence of trapezoidal distortion of the captured image.

Further, as shown in FIG. 12B, when the projection mode is selected by the operation section 16 or the like, the overall control section 13 operates the image position setting means 42 to set the optical axis and the projection plane. The image projection / imaging device 41 is moved so that 6 and 6 are inclined (inclination angle θ in the figure). This is because when the angle between the optical axis from the image projection / photographing device 41 and the projection surface 6 forms a right angle, the shadow of the hand of the user is affected by the hand shadow when performing a writing operation or a pointing operation by hand during image projection. This is because it hinders the line of sight and makes it difficult to see. As a result, it is possible to reduce the influence of the shadow of the hand during projection and improve the visibility. However, during this projection, when the optical axis from the image projecting / capturing device 41 and the projection surface 6 are at a right angle, trapezoidal distortion occurs in which the projected image becomes trapezoidal.
It is also conceivable to make the optical axis from the image projection / photographing device 41 and the projection surface 6 at a right angle and eliminate the trapezoidal distortion by the image processing in the image processing unit 15.

Further, as shown in FIG. 12C, when the wall surface mode is selected by the operation section 16 or the like, the overall control section 13 operates the image position setting means 42 to make it perpendicular to the projection plane 6. The image projection / imaging device 41 is moved so that the second projection plane (projection screen, whiteboard, wall, etc.) 12 is orthogonal to the second projection plane. In this way, by selecting the image projection / shooting mode with the operation unit 16 or the like, the position of the image projection / shooting device 41 can be fixed to the optimum position according to the designated mode, so that the user can The interface is improved and the device can be easily used.

Here, the image position setting means 42 is operated in accordance with the image projection / shooting mode, and the image projection / shooting device 4 is operated.
By moving 1 the controllability of the projection / shooting range can be improved.

A third embodiment of the present invention will be described with reference to FIGS. 13 and 14. The liquid crystal projector of the present embodiment is provided with the tilt detecting means for detecting the tilt amount,
It is different from the liquid crystal projector 40 described in the second embodiment.

FIG. 13 is an external perspective view schematically showing the structure of the liquid crystal projector 50 of the present embodiment. FIG.
As shown in FIG. 5, the liquid crystal projector 50 includes, in addition to the configuration of the liquid crystal projector 40 described in the second embodiment, an image projection / shooting device 51 and an inclination detection unit 52 for obtaining the amount of inclination of the projection surface 6. The image projection / photographing device 51 and the projection surface 6 are provided respectively. Further, such an inclination detecting means 52 can also be used for detecting an inclination change caused by driving a rotary actuator which constitutes the image position setting means 42.

As shown in FIG. 14, the liquid crystal projector 50 is provided with an overall control unit 13 having a microcomputer configuration for centrally controlling each unit.
Includes the liquid crystal projector 4 described in the second embodiment.
In addition to the configuration of 0, the inclination detecting means 52 is connected.

Now, the inclination detecting means 52 will be described in detail. As the inclination detecting means 52, any means that is sensitive to gravitational acceleration and geomagnetism may be used, and a small one such as an acceleration sensor, an inclinometer of the type that detects a liquid surface, or a fluxgate type geomagnetic sensor is used.

An example of using the tilt detecting means 52 in the liquid crystal projector 50 having such a configuration will be described. First, the trapezoidal distortion of the captured image is imaged by using the value of the amount of inclination of the image projection / imaging device 51 and the distance to the subject detected by the inclination detection means 52 under the control of the overall control unit 13. The correction can be easily performed by the image processing in the processing unit 15. Secondly, by providing the inclination detecting means 52 on both the image projection / imaging device 51 and the projection surface 6, the difference between the inclination amounts detected by the inclination detecting means 52 under the control of the overall control unit 13 is detected. By doing so, it is possible to obtain the relative amount of inclination of the two, so that it is possible to reduce the influence of the assembly error between the two and improve the accuracy of correcting the trapezoidal distortion.

By providing the inclination detecting means 52 for detecting the inclination amount of at least one of the image projecting / photographing device 51 and the projection surface 6, the image projecting means 26,
It becomes possible to easily and highly accurately correct the trapezoidal distortion of the image due to the inclination of the photographing means 24 with respect to the projection plane 6.

The fourth embodiment of the present invention will be described with reference to FIG. The liquid crystal projector of the present embodiment positions the image projection / shooting device at an optimum tilt amount according to the position and size of the subject on the projection surface 6 when shooting the subject, and also sets the zoom magnification of the image projection / shooting device. It is different in changing to the optimum one.

The hardware configuration of the liquid crystal projector of the present embodiment is no different from that of the liquid crystal projector 50 described in the third embodiment, and the description thereof will be omitted.

Characteristic processing executed by the overall control unit 13 provided in the liquid crystal projector of the present embodiment is subject position / size detection processing as described below. The position / size detection processing of the subject is performed by, for example, the projection plane 6 (or the second projection plane 1 as shown in FIG.
2) Using the pointing stick P, the upper object (document D) is a, which is the four corners of the object (document D).
The points b, c, and d can be detected by pointing. More specifically, the projection surface 6 (or the second projection surface 12) of the image projection / imaging device 51 is used.
It suffices to capture the above moving image, pattern-recognize the tip of the pointing rod P, and obtain the pointing information by the dwell time of the tip of the pointing rod P. In addition, a, which is the four corners of the subject (Document D),
The means for instructing each point of b, c, d is not limited to the pointing stick P, and any means capable of highly accurately and reproducibly extracting the characteristic points of the image pattern may be used, such as a finger. Absent. The position / size of the subject (document D) is detected based on the pointing information of the points a, b, c, and d that are the four corners of the subject (document D) obtained in this way (subject position Setting means, subject size setting means).

Next, a device movement process for moving the image projection / photographing device 51, which is a characteristic process executed by the overall control unit 13 provided in the liquid crystal projector of the present embodiment, will be described below. When the position of the subject (document D) is detected by the position / size detection processing of the subject, the optimum tilt amount of the image projection / shooting device 51 is obtained based on the position of the subject (document D). Then, the overall control unit 13 operates the image position setting unit 42 to move the image projection / shooting device 51 in accordance with the obtained optimum tilt amount of the image projection / shooting device 51. The image position setting means 42 determines the amount of tilt detected by the tilt detection means 52 as the image projection / imaging device 51.
The overall control unit 13 operates until it matches the optimum tilt amount. Here, the function of the photographing position determining means is executed. This makes it possible to flexibly deal with the case where the position of the subject (document D) on the projection surface 6 changes.

Next, a characteristic process executed by the overall control unit 13 provided in the liquid crystal projector of the present embodiment, that is, a zoom magnification changing process for changing the zoom magnification to the optimum one will be described below. . Position of subject /
When the size of the subject (document D) is detected by the size detection process, the zoom magnification of the digital zoom by the image processing in the image processing unit 15 is changed to the optimum one based on the size of the subject (document D).
Here, the function of the photographing magnification determining means is executed. Also,
Although not shown in particular, even if the zoom lens in the photographing lens 25 of the image projection / photographing device 51 is adjusted based on the detected size of the subject (document D) to change the zoom magnification to the optimum one. good. This makes it possible to flexibly deal with the case where the size of the subject (document D) is changed.

In the present embodiment, the position / size of the subject (document D) is detected based on the pointing information of the points a, b, c, d which are the four corners of the subject (document D). However, the present invention is not limited to this, and the method for obtaining the grayscale difference between the subject (document D) and the background (projection surface 6 (or second projection surface 12)) and the boundary portion of the subject (document D) A marker capable of image recognition may be added to the above, and a method of detecting this marker may be used.

Further, a key or the like for instructing the subject position and the subject size is provided on the operation unit 16 and the like, and the numerical values of the subject position and the subject size can be directly input using the input values from these keys. good.

The fifth embodiment of the present invention will be described with reference to FIGS. 16 to 24. The liquid crystal projector of the present embodiment is not limited to a planar object as a subject photographed by the image projection / photographing device, and may be, for example, a three-dimensional object as a subject photographed by the image projection / photographing device. Further, the liquid crystal projector of the present embodiment is capable of simultaneously measuring an image of a three-dimensional object and measuring the three-dimensional shape of the imaged three-dimensional object.

FIG. 16 is an external perspective view schematically showing the structure of the liquid crystal projector 60 of this embodiment. FIG.
As shown in FIG. 3, the liquid crystal projector 60 is the same as the liquid crystal projector 1 described in the first embodiment in appearance, but the image projection / shooting device 61 is a three-dimensional book-type document. While D can be photographed, the three-dimensional shape of the photographed three-dimensional object can be measured, which will be described in detail later.

As shown in FIG. 17, the liquid crystal projector 60 is provided with an overall control unit 13 having a microcomputer configuration for centrally controlling each unit.
Includes the liquid crystal projector 1 described in the first embodiment.
In addition to the above configuration, the photographing means 24 of the image projection / photographing device 61
The drive circuit 62 and the detection unit 63 provided in the are connected.

The drive circuit 62, under the control of the overall control unit 13, moves the taking lens 25 back and forth in the direction of the optical axis so as to bring the image into focus, and adjusts the focus. For example, it is generally commercially available. It has the same configuration as that mounted on the camera. The detection unit 63 is a part that detects the amount of extension of the taking lens 25, and is configured by, for example, an optical rotary encoder and a circuit that detects the signal thereof. Here, the focus changing means is realized.

By the way, DFF (Depth From Focus) and DFD (Depth From) are obtained by photographing a plurality of images with different focus positions and obtaining the shape of the subject using the plurality of photographed images.
It is generally known that there is a method called Defocus). The DFF detects the distance to the subject by detecting the position of the best focus in each of the obtained images. Further, DFD is a distance measuring method based on a correlation model of image blur amount and distance, and is a method of obtaining a relative blur amount from a plurality of images having different in-focus distances. Matsuyama: "Real-time 3D distance measurement using multi-focus images-Development of multifunctional high-precision sensor for distributed cooperative vision system-"
CVIM-103, 1997 ”.

Therefore, in the present embodiment, the overall control section 13 controls each section based on these methods (three-dimensional shape detection means), and thus the image projection / photographing apparatus 61 is operated.
It is possible to measure the three-dimensional coordinates (three-dimensional shape of the photographed three-dimensional object) of the subject with reference to.

According to the above configuration, the three-dimensional coordinates (the three-dimensional shape of the photographed three-dimensional object) of the subject can be measured with a simple configuration in which the driving circuit 62 and the detection section 63 are additionally provided in the photographing means 24. it can. As a result, it is possible to measure the shape of a subject with high accuracy with a compact and low-cost configuration without causing an increase in size and cost of the device.

In addition, the liquid crystal projector 60 includes an image correction section 64 in the image processing section 15 connected to the overall control section 13. The image correction unit 64 corrects the curvature distortion of the subject image in the captured image based on the three-dimensional coordinates (x, y, z) of the subject surface measured by the processing in the overall control unit 13 as described above. It is a thing.

Here, as shown in FIG. 18, the photographing means 2
The optical system of No. 4 can be approximated by the central projection model in which the center of the image is the optical axis (z axis) and the focal length is f, and FIG.
As shown in, the operation of the image correction unit 64 will be described on the assumption that the subject surface is curved only in the x-axis direction in the photographing means 24. Generally, a document such as a book has a large curvature in one direction and a small curvature in a direction orthogonal to the one direction.

3 of the object plane corresponding to each row on the image
Calculation of Dimensional Coordinates Now, the image coordinates of the j-th (j = 1, 2, ..., N; N: the number of columns) columns are P _j (x _j , y), and the corresponding three-dimensional coordinates are P _j. Let '( _xj ', y ', _zj '). According to the above assumption, x _j ′ and z _j ′ corresponding to the image coordinates in each column are all the same. However, when there are variations in x _j ′ and z _j ′ corresponding to each column due to the influence of noise or the like, the average of them may be obtained, for example. In addition, y ′ corresponding to the y coordinate is

[0105]

[Equation 1]

It may be calculated as follows.

Here, there is a case where no three-dimensional position is assigned to any pixel in the column. In this case, x _j ′ and z _j ′ of the column are calculated by interpolation processing. Figure 20
FIG. 6 is a diagram showing a process of _obtaining a three-dimensional coordinate P _j ′ on the subject plane corresponding to the image coordinate P _j (x _j , y) by using an interpolation process. According to FIG. 20, the calculated three-dimensional coordinates P _j '
Is an intersection of a straight line l that connects the optical center o and the image coordinate P _j with the object plane. Also, the three-dimensional coordinates are known,
Further, it is assumed that the columns closest to the j-th column in the positive and negative directions of the x axis are the columns A and B, respectively, and the three-dimensional coordinates corresponding to these columns are P _A 'and P _B '. At this time, the z coordinate between the point P _A 'and the point P _B ' is determined by, for example, cubic spline approximation.

[0108]

[Equation 2]

If it is expressed as follows, the intersection of the curve of the equation (2) and the straight line l is

[0110]

[Equation 3]

It is obtained by calculating a positive number s that satisfies the above condition.

That is, s obtained by the equation (3) is given by

[0113]

[Equation 4]

By substituting into the three-dimensional coordinates P _j '
Can be asked.

Vertical Decompression of Image As for vertical decompression of an image, as shown in FIG. 21, the converted image is decompressed in the vertical direction, and the bending distortion in the vertical direction is removed. In this expansion processing, the expansion rate is calculated for each column, and the center line x of the image is calculated.
Pixels are mapped vertically from = 0. The expansion rate may be calculated based on the distance value (= z 'coordinate) corresponding to the image coordinate of interest.

[0116]

[Equation 5]

According to the above, the y-coordinate y _j 'of each row and j-th column is rearranged to y _j ''. However, k is a coefficient indicating the magnification of the image. By this rearrangement processing and interpolation processing between each pixel, an image in which vertical distortion is removed is generated.

The horizontal distortion can be removed by horizontally expanding each row of the image deformed by the expansion processing shown in the vertical expansion of the image. That is, as shown in FIG. 22, pixels are rearranged in the row direction and the image is expanded in the horizontal direction according to the distance from the center line y = 0 of the image. The specific method will be described below.

FIG. 23 shows the image coordinates P in a line.₀~ P_Three
Three-dimensional coordinate P corresponding to₀'~ P_Three', And P₀
Is the point on y = 0. The distance between these points
Distance L ₀₁~ L₂₃Ask for. And the pixels to rearrange
Is set as the distance from the center line y = 0 of the image.
It is decided by adding up. For example, P_ThreeIs P ₀
From distance L₀₁+ L₁₂+ L₂₃Position P_ThreeRelocated to
To be done. This decompression process is specifically

[0120]

[Equation 6]

According to the above, the x-coordinate x _j 'of each row and j-th column is set to x
relocate to _j ″. However, the meaning of L _0j is

[0122]

[Equation 7]

It is as follows. k is a coefficient indicating the magnification of the image described above. By this rearrangement processing and interpolation processing between each pixel, an image in which horizontal distortion is removed is generated. The above is the operation (correction means) of the image correction unit 64.

According to the above configuration, the three-dimensional coordinates (x,
Based on y, z), the curvature distortion of the subject image in the captured image can be corrected. As a result, the image data obtained by correcting the shape and curvature distortion of the obtained subject is stored in the storage unit 1.
Can be stored in 7. Further, by projecting the image in which the bending distortion is corrected by the image projection means 26 onto the projection surface 6, the user can immediately confirm the effect of the bending distortion correction without using a special external device, and the bending distortion can be confirmed. It is possible to perform work using a projected image that does not exist.

In addition, the overall control unit 13 uses the photographing means 24.
Control to control the shooting of multiple images with different focus positions, combine the partial areas that are in focus among the multiple shot images, and focus the entire area (hereinafter referred to as "pan-focus image"). It is preferable to correct the bending distortion in the image correction unit 64 after the generation of the ". FIG. 24 shows 3
It shows a method of generating a pan-focus image when one image (images 1 to 3) is obtained. Figure 24
Each image is preliminarily divided into areas A to F, and the hatched portion in each image is the focus area. That is, the image 1 is in the regions A and F,
Image 2 is in areas B and C, and image 3 is in areas C, D and E.
Is in focus. The focus state in each area is
For example, it is possible to perform a frequency analysis such as a two-dimensional Fourier transform in each region and make a determination based on the strength of the high frequency component. Then, a pan-focus image can be generated by extracting and combining focus areas of the images.
By using this pan-focus image as the correction target of the bending distortion, the utility value of the corrected image is further enhanced, which is preferable.

A sixth embodiment of the present invention will be described with reference to FIGS. 25 to 27. The liquid crystal projector according to the present embodiment is, like the liquid crystal projector 60 according to the fifth embodiment, not limited to a planar object as a subject to be imaged by the image projection / shooting device, but is shot by the image projection / shooting device. The subject may be, for example, a three-dimensional object. Further, the liquid crystal projector of the present embodiment is capable of simultaneously measuring an image of a three-dimensional object and measuring the three-dimensional shape of the imaged three-dimensional object.

FIG. 25 is an external perspective view schematically showing the structure of the liquid crystal projector 70 of the present embodiment. Figure 25
As shown in FIG. 7, the liquid crystal projector 70 is similar in appearance to the liquid crystal projector 1 described in the first embodiment, but the image projection / shooting device 71 is a three-dimensional book-type document. While D can be photographed, the three-dimensional shape of the photographed three-dimensional object can be measured, which will be described in detail later.

As shown in FIG. 26, the liquid crystal projector 70 is provided with an overall control section 13 of a microcomputer configuration for centrally controlling each section. This overall control section 13
Includes the liquid crystal projector 1 described in the first embodiment.
Similarly to the image processing unit 15, the operation unit 16, the storage unit 17,
The communication I / O unit 18, the power supply unit 19, the light source control unit 21, the liquid crystal controller 23, and the drive unit 32 are connected.

The reflecting mirror 30, the rotating shaft 31 that holds the reflecting mirror 30 so as to be rotatable, and the drive unit 32 that drives the rotating shaft 31 constitute an optical path switching means 29. The point is the same as that of the liquid crystal projector 1.

In addition, inside the image projection / photographing device 71 of the liquid crystal projector 70 of the present embodiment, the opening 2 is formed.
In the vicinity of 8, a total reflection mirror 72 is arranged in parallel with the reflection mirror 30.

With such a configuration, the overall control unit 13
Drives the drive unit 32 to rotate the reflecting mirror 30 about the rotating shaft 31, and as shown in FIG. 26 (a), the reflecting mirror 30 is projected as shown in FIG. 4 (b). From the position of the hour (projection mode) (the two-dot chain line in FIG. 26A), it is displaced onto the projection path of the image projection means 26,
The subject image reflected from the projection surface 6 or the second projection surface 12 is reflected by the reflecting mirror 30, and the CCD 14 of the photographing means 24 is used.
Image.

Next, the overall control section 13 drives the drive section 32 to drive the reflecting mirror 3 about the rotary shaft 31.
0 to rotate the reflecting mirror 30 to the position (2 in FIG. 26A) during projection (projection mode) as shown in FIG. 4B.
Positioned on the dotted line), the projection plane 6 and the second projection plane 12
Project the image against.

Further, the overall control unit 13 drives the drive unit 32 to center the rotary shaft 31 on the reflecting mirror 3.
0 is rotated, and as shown in FIG.
Is from the position at the time of projection (projection mode) as shown in FIG. 4B (two-dot chain line portion in FIG. 26B) on the projection path of the image projection means 26 and the optical axis of the total reflection mirror 72. To a position (a position parallel to the optical axis of the total reflection mirror 72) that does not interfere with, and the subject image reflected on the projection surface 6 and the second projection surface 12 is reflected by the total reflection mirror 72,
An image is formed on the CCD 14 of the photographing means 24.

With the above operation, the optical axis at the time of photographing can be moved. Therefore, by using image data with an arbitrary pattern (texture such as a lattice pattern) as a projection image, Projection plane 6 and second projection plane 12
It becomes possible to measure the above three-dimensional shape by a method such as a pattern projection method. Since such a pattern projection method is a well-known method as described in, for example, “Optical three-dimensional measurement (new technology communications)”, detailed description thereof will be omitted. Further, the inclination between the projection surface 6 and the second projection surface 12 and the optical axis can be known by such a method, and the tilt distortion of the projected image can be eliminated. Furthermore, the photographing means 2 is used by utilizing the three-dimensional shape of the subject.
The image obtained in 4 can also be corrected. Further, for example, Japanese Patent No. 2825344 and Japanese Patent Laid-Open No. 5-1610.
It is also possible to flatten a subject image such as a book by using the method disclosed in Japanese Patent Laid-Open No. 00, Japanese Patent Laid-Open No. 5-219323, or the like.

In this embodiment, the total reflection mirror 72 is provided as the optical axis moving means for making the projection optical axis and the photographing optical axis different, and the reflecting mirror 30 is rotated at a predetermined timing. However, the present invention is not limited to this. For example, as in the liquid crystal projector 80 shown in FIG. 27, the reflecting mirror 30 may be moved in parallel at a predetermined timing without providing the total reflection mirror 72.

Here, the pattern light is projected onto the subject (document D) on the projection surfaces 6 and 12, and the images thereof are photographed from various directions, whereby the inclination of the projection surfaces 6 and 12 and the projection surfaces 6 and 12 are reduced. It is possible to detect the three-dimensional shape of the subject (document D) above.

The seventh embodiment of the present invention will be described with reference to FIGS. 28 to 30. The liquid crystal projector of the present embodiment is different from the liquid crystal projector 1 described in the first embodiment in that the light source of the image projection / imaging device is independently provided as a light source unit.

FIG. 28 is an external perspective view schematically showing the structure of the liquid crystal projector 90 of the present embodiment. FIG. 28
As shown in FIG.
A flat plate-shaped projection surface 6, an image projection / shooting device 91 having both functions of a shooting device and a projection device, a support member 7 for positioning the image projection / shooting device 91 above the projection surface 6,
It is configured by a power supply unit 9 that supplies power to the image projection / imaging device 8. In FIG. 28, a document D is assumed as a subject placed on the projection surface 6, the document D is photographed by the image projecting / capturing apparatus 91, and projected on the projection surface 6 using the image projecting / capturing apparatus 91. is doing. That is, the liquid crystal projector 90 uses the image projection / photographing device 91 to photograph, for example, writing (addition) data on a certain document D or an instruction state with a pointing stick of a predetermined portion, and filing as electronic data, and further The electronic data can be projected on the projection surface 6.

By the way, as shown in FIG. 28, the image projecting / photographing apparatus 91 as described above includes an apparatus main body 91a,
The light source device 91b is a second housing that is a separate housing from the apparatus main body 91a. As shown in FIG. 29, the light source device 91b has a light source 2 inside.
It has 0. The device main body 91a and the light source device 91b are provided with a connector 92 for electrically connecting the device main body 91a and the light source device 91b.
By connecting the connector 92 of 1a and the connector 92 of the light source device 91b, the light source 20 can be controlled by the light source control unit 21.
It is possible to control the amount of light projected onto the.

Here, FIG. 30 is a perspective view schematically showing the device main body 91a and the light source device 91b. As shown in FIGS. 29 and 30, the device main body 91a is provided with a light guide 93 that functions as a light guide unit for guiding the light from the light source 20 to the liquid crystal panel 22. One end of the light guide 93 is bent toward the liquid crystal panel 22 side,
The other end projects in a convex shape from the apparatus body 91a. As the light guide 93, for example, acrylic is used as a core material, and a flexible large-diameter illumination optical fiber is used. On the other hand, near the light source 20 of the light source device 91b, a hole portion 94 having a diameter substantially the same as the diameter of the light guide 93 and allowing the insertion of the light guide 93 is provided.

Such a device body 91a and light source device 9
1b is provided with connecting portions 95 and 96 by connecting members (not shown) such as screws and nuts. By connecting these connecting portions 95 and 96, the device main body 9
The connector 92 of 1a and the connector 92 of the light source device 91b are connected, and the light guide 93 is inserted into the hole 94 of the light source device 91b.

In this way, the device main body 91a and the light source device 91
By making b independent, heat generated in the light source 20 is transferred to the inside of the apparatus main body 91a, and the occurrence of malfunction of the general control unit 13 of the microcomputer configuration provided in the apparatus main body 91a due to the heat is reduced. It will be possible.

Here, the photographing means 24 and the image projection means 26
By including the light source 20 in the light source device 91b that is provided independently of the device body 91a including the above, it is possible to reduce the occurrence of malfunction of the control system and the like due to the heat generated by the light source 20.

[0144]

According to the first aspect of the present invention, an image projecting means having a light source for projecting an image on a projection surface, and a photographing means for shooting the projection surface and a subject located on the projection surface. A projection type display device comprising: a housing for housing the image projection means and the photographing means; an opening provided in the housing; and the projection surface from the image projection means through the opening. The projection light to the projection surface and the spectroscopic means that allows the reflected light from the projection surface or the subject to enter the photographing means, and the projection light from the image projection means to the projection surface and the projection surface. Alternatively, the reflected light from the subject is incident on the photographing means through the same aperture through the spectroscopic means, so that the center of the projected image and the center of the photographed image are the same when projecting the image and when photographing. Position the two images It is possible to Ku superimposed never parallax in the captured image and the projection image (parallax) occurs. Further, since the optical systems of the image projecting means and the photographing means are independent of each other, the design, position adjustment, etc. can be easily performed.

According to a second aspect of the present invention, in the projection display apparatus according to the first aspect, the projection of the image projection means onto the projection surface and the photographing means photographing the projection surface or the object are performed. By having a plurality of operation modes related to execution and providing a mode selection means capable of selecting these operation modes, for example, in addition to a mode in which projection and shooting are performed independently, projection and shooting are performed simultaneously Since it is possible to switch the mode and the mode in which projection and shooting are alternately performed, it is possible to record additional information with respect to the projected image and improve the usability.

According to the invention of claim 3, in the projection type display device of claim 2, the spectroscopic means irradiates the projection light from the image projection means onto the projection surface through the opening. An optical path switching means capable of switching to either one of an outgoing optical path and an incident optical path for forming an image of reflected light from the projection surface or the subject on the photographing means via the opening, By switching the optical path according to the operation mode selected by the mode selecting means, it is possible to switch between projection and photographing by switching between the outgoing optical path and the incident optical path. It is possible to avoid the phenomenon that the amount of light is halved as in the case of using, and it is possible to prevent flare from occurring.

According to the invention described in claim 4, in the projection type display device according to any one of claims 1 to 3, focus changing means for changing the focus position of the photographing means, and on the projection surface. A large-sized apparatus is provided by including a three-dimensional shape detection unit that captures a plurality of images of the subject with different focus positions of the image capturing unit and detects the three-dimensional shape of the subject based on the plurality of subject images. It is possible to measure a three-dimensional shape of a subject with high accuracy without increasing cost and increasing cost.

According to a fifth aspect of the invention, the projection type display device according to any one of the first to fourth aspects is provided with an optical axis moving means for moving the optical axis of the image projecting means or the photographing means. As a result, the projected image can be captured from various directions.

According to the invention of claim 6, in the projection type display device according to any one of claims 1 to 3, an optical axis moving means for moving the optical axis of the image projection means or the photographing means, The image projection unit irradiates the subject on the projection surface with the pattern light, and the optical axis moving unit moves the optical axis to photograph a plurality of the subjects. A three-dimensional shape detecting means for detecting the three-dimensional shape of the subject based on an image, projecting pattern light onto the subject on the projection surface, and photographing the image from various directions, thereby tilting the projection surface. Also, it is possible to detect the three-dimensional shape of an object on the projection plane.

According to the invention described in claim 7, in the projection type display device according to claim 4 or 6, the distortion of the subject image is corrected based on the three-dimensional shape of the subject detected by the three-dimensional shape detection means. By correcting the distortion of the subject image based on the three-dimensional shape of the subject, it is possible to project the subject image in which the curvature distortion is corrected on the projection surface, thus improving the image quality. it can.

According to an eighth aspect of the invention, in the projection type display apparatus according to the seventh aspect, the correction means is a combination of a plurality of subject images photographed with different focal positions of the photographing means. By extracting the in-focus areas captured in the in-focus state and combining them as the correction target, it is generated by combining the in-focus areas of a plurality of subject images captured with different focus positions. Since the pan-focus image can be the correction target, the utility value of the corrected image can be further increased.

According to a ninth aspect of the invention, in the projection type display device according to any one of the first to eighth aspects, a support for positioning the casing for storing the image projecting means and the photographing means above is provided. A member, and a rotating member that is provided between the supporting member and the housing and that supports the housing so as to be vertically rotatable. Since the shooting position can be changed, the projection and shooting range can be adjusted, so that it is possible to eliminate problems such as the difficulty of viewing the projected image due to the motion of the user's hand during projection, and the multiple It is possible to use different projection planes and expand the work area.

According to the invention of claim 10, claim 9 is provided.
In the projection display device described above, the rotation position of the casing rotatably supported by the rotation member is set, and the projection position by the image projection means or the photographing means stored in the casing is set. By providing the image position setting means for determining the shooting position, the controllability of the projection / shooting range can be improved.

According to the invention of claim 11, claim 1
0. In the projection display device according to 0, the image position setting means has a plurality of image projection / shooting modes, and the projection position by the image projection means or the shooting by the shooting means according to these image projection / shooting modes. By determining the position, a user interface that is easier to use can be obtained.

According to the invention of claim 12, claim 9 is provided.
In the projection display device according to any one of 1 to 11, by including an inclination detection unit that detects an inclination amount of at least one of the housing and the projection surface,
It is possible to easily and highly accurately correct the trapezoidal distortion of the image due to the inclination of the image projection means and the photographing means with respect to the projection surface.

According to the invention of claim 13, claim 1
0. In the projection display device according to item 0, the subject position setting means for setting the position of the subject when the subject is photographed on the projection surface by the photographing means, and the subject set by the subject position setting means. The position of the subject on the projection surface is changed by including the photographing position determining unit that rotates the casing by the image position setting unit according to the position of the photographing position and determines the photographing position by the photographing unit. It can be flexibly dealt with.

According to the invention of claim 14, claim 1
0 or 13, in the projection display device, subject size setting means for setting the size of the subject when the subject is photographed on the projection surface by the photographing means,
By providing a photographing magnification determining unit that determines the photographing magnification of the photographing unit according to the size of the subject set by the subject size setting unit, it is possible to flexibly cope with the case where the size of the subject changes. You can

According to the invention of claim 15, claim 1
15. The projection display device according to any one of claims 1 to 14, wherein the light source of the image projecting means is provided in a second housing different from the housing, and the housing and the second housing are connected to the light source. By providing the light guide means that makes it possible to use this light for projection onto the projection surface, it is possible to reduce the occurrence of malfunction of the control system due to heat generated by the light source.

[Brief description of drawings]

FIG. 1 is a schematic configuration diagram showing a system including a liquid crystal projector according to a first embodiment of the present invention.

FIG. 2 is an external perspective view schematically showing the configuration of a liquid crystal projector.

FIG. 3 is a side view showing an example of use of the liquid crystal projector.

FIG. 4 is a block diagram showing a configuration and an operation of a liquid crystal projector.

FIG. 5 is an explanatory diagram showing a usage example of the liquid crystal projector.

FIG. 6 is a configuration diagram showing a first modification of the liquid crystal projector.

FIG. 7 is a configuration diagram showing a second modification of the liquid crystal projector.

FIG. 8 is a block diagram showing a third modification of the liquid crystal projector.

FIG. 9 is a configuration diagram showing a fourth modification of the liquid crystal projector.

FIG. 10 is a side view showing a liquid crystal projector according to a second embodiment of the present invention.

FIG. 11 is a block diagram showing a configuration of a liquid crystal projector.

FIG. 12 is a side view showing a usage example of the liquid crystal projector.

FIG. 13 is an external perspective view schematically showing the configuration of a liquid crystal projector according to a third embodiment of the present invention.

FIG. 14 is a block diagram showing a configuration of a liquid crystal projector.

FIG. 15 is an explanatory diagram showing an operation at the time of detecting a position / size of a subject by the liquid crystal projector according to the fourth embodiment of the present invention.

FIG. 16 is an external perspective view schematically showing the configuration of a liquid crystal projector according to a fifth embodiment of the present invention.

FIG. 17 is a block diagram showing a configuration of a liquid crystal projector.

FIG. 18 is an explanatory diagram showing an optical system in a photographing means.

FIG. 19 is an explanatory diagram showing a curvature of a subject surface.

FIG. 20 is an explanatory diagram showing processing in the image correction unit.

FIG. 21 is an explanatory diagram showing expansion of an image in the y-axis direction in the image correction unit.

FIG. 22 is an explanatory diagram showing expansion of an image in the x-axis direction in the image correction unit.

FIG. 23 is an explanatory diagram showing extension of an image in the x-axis direction in the image correction unit.

FIG. 24 is an explanatory diagram showing a method of generating an image in focus over the entire area.

FIG. 25 is an external perspective view schematically showing the configuration of a liquid crystal projector according to a sixth embodiment of the present invention.

FIG. 26 is a block diagram showing a configuration and operation of a liquid crystal projector.

FIG. 27 is a block diagram showing a modification of the liquid crystal projector.

FIG. 28 is an external perspective view schematically showing the configuration of a liquid crystal projector according to a seventh embodiment of the present invention.

FIG. 29 is a block diagram showing a configuration of a liquid crystal projector.

FIG. 30 is a perspective view schematically showing a device body and a light source device.

FIG. 31 is a configuration diagram showing an example of a conventional liquid crystal projector.

FIG. 32 is a configuration diagram showing another example of a conventional liquid crystal projector.

FIG. 33 is a block diagram showing still another example of a conventional liquid crystal projector.

[Explanation of symbols]

1, 40, 50, 60, 70, 80, 90 Projection display device 6, 12 Projection surface 7 Support member 8a Housing 10 Rotating member 20 Light source 24 Photographing means 26 Image projecting means 28 Opening 29 Spectral means, optical path switching Means 42 Image position setting means 52 Inclination detecting means 91b Second casing 93 Light guiding means D Subject

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Tomofumi Kitazawa             1-3-3 Nakamagome, Ota-ku, Tokyo Stocks             Company Ricoh (72) Inventor Norihiko Murata             1-3-3 Nakamagome, Ota-ku, Tokyo Stocks             Company Ricoh F-term (reference) 5C022 AC01 AC26 AC42 AC69 AC77                       AC78 CA07

Claims (15)

[Claims] 1. A projection type display device comprising: an image projection means having a light source for projecting an image on a projection surface; and a shooting means for shooting the projection surface and a subject located on the projection surface. A housing that stores the image projection means and the photographing means, an opening provided in the housing, emission of projection light from the image projection means to the projection surface through the opening, and the projection surface. Or a spectroscopic unit that allows reflected light from the subject to enter the photographing unit. 2. A plurality of operation modes relating to execution of projection of the image projection means onto the projection surface and photographing of the projection surface or the subject by the photographing means, and these operation modes can be selected. The projection display apparatus according to claim 1, further comprising a mode selection unit. 3. The spectroscopic means emits a projection light from the image projection means onto the projection surface through the opening, and a reflected light from the projection surface or the subject through the opening. An optical path switching means capable of switching to either one of an incident optical path to be imaged on the photographing means via the optical path, and switching the optical path according to the operation mode selected by the mode selecting means. The projection display device according to claim 2. 4. A focus changing means for changing the focus position of the photographing means and a plurality of images of the subject on the projection surface with different focus positions of the photographing means, and the plurality of subject images. 4. The projection type display device according to claim 1, further comprising a three-dimensional shape detection unit that detects the three-dimensional shape of the subject based on the above. 5. The projection display device according to claim 1, further comprising an optical axis moving unit that moves an optical axis of the image projecting unit or the photographing unit. 6. An optical axis moving means for moving an optical axis of the image projecting means or the photographing means, irradiating the subject on the projection surface with pattern light by the image projecting means, and moving the optical axis. Means for moving the optical axis to take a plurality of images of the subject by the photographing means, and detecting a three-dimensional shape of the subject based on the plurality of subject images. The projection display device according to claim 1. 7. The projection display device according to claim 4, further comprising a correction unit that corrects the distortion of the subject image based on the three-dimensional shape of the subject detected by the three-dimensional shape detection unit. . 8. The correction means extracts an in-focus area photographed in an in-focus state from a plurality of subject images photographed in different focus positions of the image-capturing means, and a combined image is a correction target. The projection display device according to claim 7, wherein: 9. A support member for positioning the casing for accommodating the image projection unit and the photographing unit above, and a support member provided between the support member and the casing for rotating the casing in a vertical direction. 9. A projection mold according to claim 1, further comprising a rotating member movably supported so that a projection position by the image projection means and a shooting position by the shooting means can be changed. Display device. 10. A rotation position of the housing rotatably supported by the rotation member is set, and a projection position by the image projection means or an imaging position by the imaging means stored in the housing is set. 10. The projection display apparatus according to claim 9, further comprising image position setting means for determining. 11. The image position setting means has a plurality of image projection / shooting modes, and determines the projection position by the image projection means or the shooting position by the shooting means according to these image projection / shooting modes. The projection display device according to claim 10, wherein the projection display device is a display device. 12. The projection display device according to claim 9, further comprising an inclination detection unit that detects an inclination amount of at least one of the housing and the projection surface. 13. A subject position setting means for setting the position of the subject when the subject is photographed on the projection surface by the photographing means, and a subject position setting means for setting the subject position set by the subject position setting means. 11. The imaging position determining means for rotating the housing by the image position setting means to determine the imaging position by the imaging means.
The projection display device described. 14. A subject size setting means for setting a size of the subject when the subject is photographed on the projection surface by the photographing means, and a subject size setting means for setting the subject size set by the subject size setting means. And a photographing magnification determining unit that determines a photographing magnification of the photographing unit.
The projection display device according to 0 or 13. 15. The light source of the image projection means is provided in a second housing different from the housing, and the housing and the second housing project light from the light source onto the projection surface. 15. The projection display device according to claim 1, further comprising a light guide means that can be used.