JP2005176226A - Camera, projector system and projecting method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera, a projector system and a projecting method, which enable more real reproduction by making the size of an object an actual size or switching a photographing direction beyond the restriction at the time of usually viewing the object with a small monitor in reproducing a photographed picture. <P>SOLUTION: This projector system is provided with a camera 10 for photographing the object 11, and a projector 30 for projecting an image photographed by the camera 10. A projecting angle at the time of projecting by the projector is decided according to the height of the camera 10 in photographing, the height of the projector 30 in projecting the image of the object 11 photographed by the camera 10, and the distance from the projector 30 to a screen 40. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a camera, a projector system, and a projection method thereof, and more particularly, to an improvement of a projector system for projecting and viewing a captured image.

  As a method for reproducing a photographed image, a method of projecting an image onto a wall surface by a so-called projector in addition to reproduction on a display in addition to printing on photographic paper or the like that has been performed for a long time is known. .

Reproduction of this projector method is a field different from photography, but for example, reproduction of a photographed image so that it looks like that at the time of photographing, as in a technique for obtaining reality by making a projected image of a person life-size. The technique which enabled this is known (for example, refer patent document 1 and patent document 2).
JP-A-8-32948 JP 2000-244484 A

  However, the techniques described in Patent Document 1 and Patent Document 2 described above are techniques for increasing the realism of a video conference using a specific device. Therefore, it was not on the extension of the photographic technology to expand the range of expression method of the captured video.

  In the above-described reproduction technique, the technique of reproducing an image on a large screen with a simple device tends to be overlooked because it is easily limited by the size of paper to be printed and the size of the monitor screen. In recent years, with the widespread use of projectors, small and portable products have been introduced, attracting attention as video display means, and there has been a demand for quick integration with conventional photographic culture.

  Therefore, in the present invention, when a photograph taken is reproduced, it is more realistic to reproduce the photograph by changing the projection direction to the actual size of the subject beyond the limitation of viewing on a small monitor. It is an object of the present invention to provide a camera, a projector system, and a projection method thereof capable of accurately reproducing an object and reproducing the situation regardless of the photographing state, the apparatus, or the state at the time of reproduction.

  According to the first aspect of the present invention, the projection angle at the time of projecting the projector is determined according to the height of the camera at the time of photographing, the height of the projector at the time of projecting the image of the image photographed by the camera, and the distance to the projection screen. It is characterized by that.

  The invention described in claim 2 includes recording means for recording, together with the image data, shooting information for shooting a subject and switching projection conditions when projecting an image shot at the time of shooting. .

  The invention described in claim 3 is the invention described in claim 2, wherein the projection condition to be switched is a projection angle at the time of projecting the image.

  According to a fourth aspect of the present invention, in the second aspect of the present invention, the photographing information recorded in the recording means is a camera angle at the time of the photographing.

  According to a fifth aspect of the present invention, in a projector system including a camera that captures a subject and a projector that projects an image captured by the camera, the angle of the camera at the time of capturing is recorded, The projection angle of the projector at the time of projecting the photographed image is switched according to the angle.

  According to a sixth aspect of the present invention, in a projector system comprising: a camera that captures a subject; and a projector that projects an image captured by the camera onto a projection screen; The projection angle at the time of projection of the projector is determined according to the height of the image taken by the camera when projected by the projector and the distance to the projection screen.

  The invention according to claim 7 is the invention according to claim 6, wherein the camera has recording means for recording, together with image data, shooting information for switching projection conditions at the time of projection by the projector. It is characterized by having.

  The invention according to claim 8 is the invention according to claim 7, wherein the projection condition to be switched is a projection angle during projector projection.

  According to a ninth aspect of the present invention, in the seventh aspect of the present invention, the photographing information recorded in the recording means is a camera angle at the time of photographing with the camera.

  According to a tenth aspect of the present invention, in the projector system including a camera that captures a subject and a projector that projects an image captured by the camera onto a projection screen, the camera determines an angle of the camera at the time of capturing. In the recording, the projector switches a projection angle of the projector when projecting the captured image according to an angle of the camera.

  According to an eleventh aspect of the invention, in the invention according to the tenth aspect, the camera has recording means for recording the angle of the camera at the time of photographing as photographing information together with the image data of the subject. Features.

  A twelfth aspect of the present invention is the projector according to the eleventh aspect, wherein the projector projects the photographed image according to the photographing information recorded in the recording means. The angle is switched.

  The invention according to claim 13 is a projection method of a projector system for photographing a subject and projecting the photographed image, the step of recording the angle of the camera at the time of photographing, and depending on the angle of the camera Switching the projection angle at the time of projecting the photographed image.

  The present invention proposes a photographic display form or a photographic appreciation form with a higher reproducibility effect by using a projector having a large degree of freedom in image size control and a freedom in a reproduction method.

  According to the present invention, when playing back a photograph that has been taken, the actual size of the subject is exceeded or the projection direction is changed over the limitations of viewing on a small monitor. With this technology, it is possible to provide a camera, a projector system, and a projection method thereof that enable reproduction and enables accurate object reproduction and situation reproduction regardless of the shooting state, apparatus, or state at the time of reproduction.

  Embodiments of the present invention will be described below with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing the configuration of the electrical system of the projector system according to the first embodiment of the present invention.

  In FIG. 1, the projector system includes a camera 10 and a projector 30.

  The camera 10 includes a photographing lens 12 for photographing a subject 11, an image sensor 13, an image processing circuit 14, a recording unit 15, a focus control unit 16, a sequence controller 18, and a lens position control (LD). The unit 20 includes a zoom control unit 21, a distance detection circuit 22, a distance calculation unit 23, a shooting information recording unit 24, an operation switch 26, and a display unit 27.

  The projector 30 includes a display control unit 31, a projection lens 32, a projection image forming unit 33, a projection light source 34, a light source control unit 35, and a distance detection unit 36.

  In the camera 10, a subject image formed on the image sensor 13 through the photographing lens 12 is converted into an electrical or digital image signal by the image sensor 13 and the image processing circuit 14. The electrical signal converted here is recorded in the recording unit 15.

  The photographic lens 12 can be zoomed by the zoom control unit 21 in order to obtain a subject image in a good state intended by the photographer, and the focus position is controlled by the lens position control unit 20. It has become. The zoom magnification of the photographing lens 12 is changed by operating the operation switch 26 or the like operated by the photographer.

  The focus position of the photographic lens 12 may be controlled based on the output of the distance detection circuit 22 by the focus control unit 16, or based on the contrast information of the image data obtained from the output of the image processing circuit 14. It may be controlled to be higher.

  As described above, the sequence controller 18 that detects the operation of the photographer and sequentially controls each function, the focus control unit 16 that is a means for calculating and determining various information based on the signals obtained from each function, the distance calculation. The unit 23, the photographing information recording unit 24, and the like are configured by a microcomputer 25.

In contrast type focusing, distance information is calculated by the distance calculation circuit 22 from the zoom position and the position of the focusing lens, and information at the time of shooting is calculated from the zoom position and the calculated distance information. This is the subject distance L _c , the focal length f _c of the photographic lens 12, the usage range y _c of the image sensor 13, etc. in FIG. Such information is recorded in the photographing information recording unit 24.

On the other hand, in the projector 30, the output of the image processing circuit 14 in the camera 10 and the information of the photographing information recording unit 24 are utilized by the display control unit 31 which is a control unit and an image switching unit, and is projected. Each unit in the projector 30 such as the lens 32, the projection image forming unit 33, and the light source control unit 35 is controlled. Thus, the effective part y _p and the zoom magnification f _p and the projection image forming unit 33 of the projection lens 32, the brightness or the like of the projection light source 34 is controlled.

In addition, the projector 30 can detect distance information L _p from the projector 30 to the wall surface or screen 40 projected by the distance detector 36 that is an input means. Therefore, the display control unit 31 may focus the projection lens 32 based on this information. In the figure, reference numeral 11a denotes a screen for displaying a subject image projected on the projection surface 41 such as a wall surface or a screen.

  FIG. 2 is a flowchart for explaining an operation sequence at the time of photographing by the camera configured as described above.

  This photographing operation is performed under the control of the sequence controller 18.

First, in step S1, the zoom position and the imaging surface size y _c at the time of shooting are determined. Next, in step S2, focusing is performed. The distance information L _c is detected from the result of this focusing.

When the captured image processing is performed in step S3, each information of the results (f _c , y _c , L _c ) obtained in steps S1 and S2 described above is recorded in the captured information recording unit 24 in subsequent step S4. The Further, in step S5, an image based on the photographing information is recorded in the recording unit 15.

  The image recorded in the recording unit 15 may be recorded in the photographing information recording unit 24 at the same time as the above photographing information.

  In the projector system having such a configuration, a personal computer 45 may be used as an interface between the camera 10 and the projector 30 as shown in FIG. In this case, the display control unit 31 of FIG. 1 may be provided in the personal computer 45.

  Alternatively, the recording unit 15 in the camera 10 may be taken out and inserted into the personal computer 45, and controlled from this information.

  Further, as shown in FIG. 3B, the camera 10 and the projector 30 may be directly connectable. Also in this case, image information and shooting information may be input to the recording unit 15, and only the memory of the recording unit 15 may be inserted into the projector 30 to perform image projection control that reflects the shooting information.

  In addition, if the light source unit, which has been apt to increase in size in the past, is reduced in size by an LED or the like, the projector 40 can be incorporated in the camera 10 as shown in FIG. In this case, it is conceivable that the optical system (projection lens) 32 of the projector 40 is installed on a part of the body of the camera 10 so that the single device can perform shooting to projection.

  All of the techniques of the present invention can cover such deformation.

  FIG. 4 is a diagram showing an example of a method for appreciating a photographed image in the present embodiment.

  In FIG. 4, the subject 11a in the screen 41 projected by the projector 30 is displayed in a life-size manner. Therefore, the viewer 46 can appreciate a realistic object that is completely different from when viewed on a small monitor or on a print.

  In order to enable such an appreciation method, the camera 10 having the configuration as shown in FIG. 1 is used, and shooting is performed according to the sequence shown in FIG. The reproduction operation may be performed according to the operation sequence shown.

  This reproduction operation is performed under the control of the display control unit 31.

  That is, in step S <b> 11, shooting information acquired by the camera 30 is detected by the display control unit 31. In step S12, image information recorded in the recording unit 15 or the photographing information recording unit 24 is obtained. Furthermore, in step S13, an image based on the acquired image information is controlled by an appropriate method and projected onto a projection surface 41 such as a wall surface or a screen.

  As this control method, a good life-size image can be obtained by the method according to the flowchart of FIG. 6 regardless of the projection position.

  FIG. 6 is a flowchart for explaining such a reproduction switching operation.

  This reproduction switching operation is performed under the control of the display control unit 31.

That is, first in step S21, the projector 30 detects the distance L _p to the projection plane as shown in FIG. Next, in step S22, in addition to the focal length f _c of the photographing lens 12 obtained at the time of photographing, the subject distance L _c , and the usage range y _c of the image sensor 13, the projection surface obtained in step S21 is also obtained. Using the distance L _p, the focal length f _p of the projection lens 32 is determined according to the following equation (1).
_{· f p = f c (L} p / L c) · (y p / y c) ... (1)
Here y _p is the size of the projection image forming unit 33 (see FIG. 1), the size ratio of the camera imaging plane of the y _p / y _c is determined.

Then, at step S23, the zoom position to the focal length f _p is controlled. Here, in step S24, the focal length f _p is whether the zooming range is determined. If it falls within the zoomable range, the process exits this routine and is projected at the zoom position. This is because the image quality is better when the projection image forming unit 33 is used effectively in its size.

However, since there is a limit to the zoomable range, if it cannot be enlarged any more, the process proceeds to step S25, where it is assisted by zooming using a so-called electronic zoom method. At this time, the optical zoom position by the lens is fixed to the maximum value f _pMAX . On the premise of this, the size of the image formed in the projection image forming unit 33 in the subsequent step S26 is enlarged and displayed at a desired magnification n times according to the following equation (2).
n = (f _c / f _pMAX ) · (L _p / L _c ) · (y _p / y _c ) (2)
As described above, the optical zoom is given priority first, and the electronic zoom is used later to assist, so that high-resolution image projection is possible.

Further, as shown in FIG. 7, if a value H _c corresponding to the height of the camera 10 from the floor at the time of taking a picture or the height of the subject 11 can be input, as shown in FIG. In consideration of the height H _p when the projector 30 is installed, the projected image can be adjusted to the actual subject height.

That is, the height H _c corresponding to the subject image of the subject 11, by being projected onto the projection surface 40 of the wall or the like, viewing a captured image as shown in FIG. 4, (realistic) more a reality with powerful It becomes possible.

The difference (H _c −H _p ) between the height H _p of the projector 30 and the height H _c of the camera 10 can be realized by tilting the projection plane upward, for example, by an angle θ. That is, the control of the reproduction angle by the projector 30 is performed according to the flowchart of FIG.

  The reproduction angle control operation is performed under the control of the display control unit 31.

First, in step S31, the respective heights H _c and H _p are input to the camera state or the projector 30. Next, at step S32, the heights H _c and H _p input at step S31 are used, and the projection angle θ is calculated according to the following equation (3) together with the already detected projector distance L _p .
θ = arctan ((H _c −H _p ) / L _p ) (3)
In the subsequent step S33, the projection direction may be shifted by this angle θ. However, since there is a limit if the photographing angle is tilted too much, this angle θ is determined in step S34. That is, if the angle θ is equal to or smaller than the predetermined value θ ₀ , the routine is exited as it is, but if the angle θ exceeds the predetermined value θ ₀ , the process proceeds to step S35 and a warning is given.

  FIG. 10 is a diagram showing an example of the projection direction switching.

In this embodiment, the projection direction of the projector 30 itself is not changed, but the image formed on the projection image forming unit 33 is shifted by Δy as indicated by 33a in FIG. Δy = f _p tan θ), and the center of the screen is shifted upward by an angle θ and projected.

The portion that can actually be displayed on the projection plane is the range indicated by P ₁ in the drawing, and the image of the non-displayable portion indicated by P ₂ in the drawing is lost. Further, since there is no data in the lower portion (indicated by P ₃ in the figure) of the portion shifted by Δy, there is no image, but the image displayed in the image reproduction portion indicated by P ₄ in the figure. 11a is displayed with the same height as the actual subject 11 as shown in FIG. As a result, the viewer 46 can view the subject with a realistic feeling of the height of the subject and the exact face size.

(Second Embodiment)
Next explained is the second embodiment of the invention.

  The projection angle of the projector described above is as shown in FIGS. 11B and 11D in addition to changing the position Δy of the projection image forming unit 33 of the projector 30 as shown in FIG. The angle with respect to the pedestal 48 that supports the projector 30 can be changed even by switching with the motor 49 or the like. This is a technology that can be made easier than a large screen monitor such as a television screen by downsizing the projector.

  In the second embodiment described below, a more realistic reproduction is sought by effectively utilizing such switching of projection methods.

  Since the basic configuration and operation of the second embodiment are the same as those of the first embodiment described above, the same parts as those in FIGS. The illustration and description are omitted, and only different operations will be described.

  That is, when the photographer 50 photographs the subject 11 as shown in FIG. 11A and when the photographer 50 photographs as shown in FIG. 11C, the positional relationship between the photographer 50 and the subject 11 exists. When it changed and the background was abstract, it was sometimes difficult to understand the situation.

  For this reason, in the second embodiment, as shown in FIG. 11A, when the photographer 50 looks down on the subject 11, the viewing is performed as shown in FIG. 11B. The viewer 46 looks up the image and looks at the image as shown in FIG. 11C, and the viewer 46 looks up at the image as shown in FIG. 11D. It can be displayed in such a state.

  As a result, it is possible to enjoy the observation by immediately imagining how the photographer approaches the subject 11. With such a device, the relationship between the person and the background building can be clarified in the scene as shown in FIG. 12, and the size of the building can be reproduced with a stronger force.

  FIGS. 11B and 11D are diagrams showing the positional relationship between the projector 30 and the viewer 46 during reproduction.

As shown in FIG. 11A, when the photographer 50 takes a picture so as to look down at the subject 11 by the angle θ _c , the viewer 46 also has the angle θ _M as shown in FIG. If you just look down, it will be a natural reproduction. Here, the relationship between θ _c and θ _M may be a relationship such as the following equation (4).
θ _c = θ _M (4)
Also, as shown in FIGS. 11B and 11D, there is a difference ΔH between the position of the projector 30 and the eye height of the viewer 46, or there is a difference in the distance to the wall (screen). Then, the following relationship is established, and an appropriate projection angle θ _p is obtained in consideration of the distance L _p between the screen and the projector and the distance L _M between the viewer 46 and the screen.
L _M tan θ _M + ΔH = L _p tan θ _p (5)
In the above equation (5), it may be approximated as ΔH = 0, L _M = L _p . Further, ΔH, L _M , and L _p may be manually input. L _p can also be obtained from the focus control result.

In such an arrangement a projector system, that the camera and the projector is controlled by the flow chart as shown in FIGS. 13 and 14, it is possible to angle theta _p control during image projection by the projector.

  FIG. 13 is a flowchart for explaining a photographing operation at the time of photographing by the camera.

Once in this routine, first, in step S41, when the photographer 50 is photographed, overlooking the subject 11, or look up the angle theta _c it is detected. Next, in step S42, shooting is actually performed.

In step S43, the image data captured in step S42 is recorded in the recording unit 15. Further, in step S44, the detected angle theta _c at the step S41 it is recorded in the recording section 15.

The angle θ _c may be detected by providing a variable resistor with a sliding contact as shown in FIG.

  This variable resistor is configured as follows. That is, the metallic weight 55 having the contact pieces 55a and 55b can be rotated about the fulcrum 56 in the illustrated arrow θ direction. And the resistor 57 and the metal part 58 are provided in circular arc shape so that it may contact each of the said contact pieces 55a and 55b. Electrodes 59 and 60 are connected to the resistor 57 and the metal part 58, respectively.

Now, when the metallic weight 55 having the contact pieces 55a and 55b rotates around the fulcrum 56, the resistor 57 and the metal part 58 are short-circuited through the contact pieces 55a and 55b. Thereby, the resistance value between the electrodes 59 and 60 changes. The change in resistance value by detecting a camera 10, it is possible to determine the angle theta _c.

As described above, when θ _c is input to the projector 30 together with the image data, the projection angle θ _p can be switched in accordance with the θ _c .

  FIG. 14 is a flowchart for explaining the projection operation of the projector 30 that projects an image photographed by the camera according to the flowchart of FIG.

Once in this routine, first, image data is input in step S51, followed by the angle theta _c at step S52 is input to the projector 30. Then, in step S53, a determination is made as angle theta _c are performed.

That is, when the angle theta _c is in between the predetermined angle - [theta] ₁ through? _1, the irradiation of a normal angle are performed proceeds to step S54. Therefore, the angle is reset in the next step S55. Thereafter, the process proceeds to step S57 and image projection is performed.

On the other hand, in the above-mentioned step S53, when the angle θc is outside a predetermined angle - [theta] ₁ through? _1, from equation (4) and (5), theta _p is calculated. Next, in step S56, the irradiation angle θ _p of the projector 30 is switched.

  In addition, about this angle switching, you may rotate a mechanism system as shown to Fig.11 (a), or you may switch electrically as shown to Fig.10 (a). Further, as shown in FIG. 16, three projectors 30a, 30b, and 30c having different projection angles may be switched and controlled.

  That is, in FIG. 16, any one of the three projectors 30a, 30b, and 30c having different projection angles is selected by the switching circuit 62. This switching is controlled by the display control unit 64, and the image output from the image processing circuit 63 is projected from one of the selected projectors 30a to 30c. ing.

  With such a configuration, as shown in FIGS. 11A and 11C, it is possible to reproduce an image in consideration of how the photographer 50 approaches the subject 11. Therefore, the relationship between the subject 11 and the background is clearly displayed, and more realistic image reproduction is possible.

  According to the embodiment described above, it is possible to reproduce a realistic image regardless of shooting conditions and reproduction conditions.

It is a block diagram which shows the structure of the electric system of the projector system which concerns on 1st Embodiment of this invention. 2 is a flowchart for explaining an operation sequence at the time of shooting by the camera having the configuration of FIG. 1. It is the figure which showed the structural example of the projector system by this invention. It is the figure which showed the example of the appreciation method of the picked-up image in 1st Embodiment of this invention. 5 is a flowchart for explaining an image reproduction operation of the projector in the first embodiment. 6 is a flowchart for explaining a reproduction switching operation in the first embodiment. It is a figure explaining the height from the floor of the camera 10 at the time of photography. It is a figure explaining the height at the time of installation of the projector 30 at the time of image projection. It is a flowchart explaining the reproduction | regeneration angle control operation | movement in 1st Embodiment. It is the figure which showed an example of projection direction switching. FIG. 9 is a diagram illustrating a positional relationship between a photographer and a subject at the time of shooting and a positional relationship between a projector and a viewer at the time of image projection, illustrating a second embodiment of the present invention. It is a figure explaining the example of the projection image by 2nd Embodiment of this invention. 10 is a flowchart for explaining a photographing operation at the time of photographing by the camera in the second embodiment. It is a flowchart explaining the projection operation | movement of the projector 30 which projects the image image | photographed with the camera according to the flowchart of FIG. It is the figure which showed the structural example of the variable resistance with a sliding contact piece for detecting the angle (theta) _c of the camera in 2nd Embodiment. It is the figure which showed the other structural example of the projector which switches a projection angle.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Camera, 11 ... Subject, 12 ... Shooting lens, 13 ... Image sensor, 14 ... Image processing circuit, 15 ... Recording part, 16 ... Focus control part, 18 ... Sequence controller, 20 ... Lens position control (LD) part, DESCRIPTION OF SYMBOLS 21 ... Zoom control part, 22 ... Distance detection circuit, 23 ... Distance calculation part, 24 ... Shooting information recording part, 25 ... Microcomputer, 26 ... Operation switch, 27 ... Display part, 30 ... Projector, 31 ... Display control part, 32 ... Projection lens, 33 ... Projection image forming unit, 34 ... Projection light source, 35 ... Light source control unit, 36 ... Distance detection unit, 40 ... Screen, 41 ... Projection plane.

Claims (13)

  A projector system, wherein a projection angle at the time of projection of the projector is determined according to a height of the camera at the time of photographing, a height of the projector at the time of projection of an image photographed by the camera, and a distance to the projection screen.   What is claimed is: 1. A camera, comprising: a recording unit that records photographing information for photographing a subject and switching projection conditions for projecting an image photographed at the time of photographing together with image data.   The camera according to claim 2, wherein the projection condition to be switched is a projection angle at the time of projecting the image.   The camera according to claim 2, wherein the photographing information recorded in the recording means is an angle of the camera at the time of the photographing. In a projector system comprising a camera that captures a subject and a projector that projects an image captured by the camera,
A projector system, wherein an angle of a camera at the time of photographing is recorded, and a projection angle of the projector at the time of projecting the photographed image is switched according to the angle of the camera. In a projector system comprising a camera that captures a subject and a projector that projects an image captured by the camera onto a projection screen,
A projection angle at the time of projection of the projector is determined according to a height at the time of photographing by the camera, a height at the time of projection of the projector by an image photographed by the camera, and a distance to the projection screen. system.   The projector system according to claim 6, wherein the camera has recording means for recording shooting information for switching a projection condition at the time of projection of the projector together with image data during shooting.   The projector system according to claim 7, wherein the projection condition to be switched is a projection angle at the time of projector projection.   8. The projector system according to claim 7, wherein the photographing information recorded in the recording means is a camera angle at the time of photographing with the camera. In a projector system comprising a camera that captures a subject and a projector that projects an image captured by the camera onto a projection screen,
A projector system, wherein the camera records a camera angle at the time of photographing, and the projector switches a projection angle of the projector at the time of projecting the photographed image according to the angle of the camera.   The projector system according to claim 10, wherein the camera includes recording means for recording an angle of the camera at the time of photographing as photographing information together with image data of the subject.   12. The projector system according to claim 11, wherein the projector switches a projection angle of the projector at the time of projecting the photographed image according to the photographing information recorded in the recording unit. A projection method of a projector system for photographing a subject and projecting the photographed image,
Recording the angle of the camera at the time of shooting;
Switching the projection angle at the time of projection of the captured image according to the angle of the camera;
A projection method for a projector system, comprising:

Images