JP5200364B2 - Projector, control method therefor, and program - Google Patents

Description

  The present invention relates to a projector, a control method therefor, and a program.

Presentation content can be projected onto a whiteboard by a projection device (projector), and the content projected on the whiteboard (projected image) and added to the whiteboard for additional explanation (handwritten) A presentation system that can capture images (characters, drawings, etc.) with a digital camera has been proposed (see Patent Document 1).
According to this presentation system, since the projected image and the retouched image are recorded as one image, it is possible to refer to the projected image with the retouched image even after the rewritten image on the whiteboard is erased. This is useful when modifying the content later.

Japanese Patent Laid-Open No. 11-305335

  However, the projection image included in the image (captured image) captured by such a presentation system has a problem that the image quality is deteriorated as compared with the original image (image supplied to the projection device). Yes. In particular, since the surface of a whiteboard often has high reflection characteristics, it is included in the captured image due to the reflection of peripheral objects and the generation of hot spots that cause the light source light of the projector to be locally reflected with high brightness. The projected image may be less visible. Further, when writing on the whiteboard, the surroundings are often brightened, resulting in a state where the contrast of the projected image is lowered. As a result, it has been difficult to capture a projected image with good image quality.

  The present invention has been made in view of the above problems, and an object thereof is to provide a projector capable of reproducing a projected image to be included in a captured image with good image quality, a control method thereof, and a program. is there.

The projector of the present invention includes a display memory for storing input image data based on an input image signal in units of frames,
An image projection unit that projects an image according to the input image data stored in the display memory;
An imaging unit that captures a retouched image of a projection range in which the image is projected, and generates retouched image data representing an imaging result;
An instruction input unit that receives an instruction for causing the imaging unit to perform imaging;
When the instruction input unit receives the instruction, and the image reading unit for reading the input image data stored in the display memory,
When the instruction input unit receives the instruction, an image control unit that projects a plain image having a substantially entire surface from the image projection unit;
An imaging instruction unit that causes the imaging unit to image the retouched image while the image projection unit is projecting the plain image;
And an image synthesizing section for synthesizing the input image data to which the additional writing image data the imaging unit is generated, and the image reading unit has read,
The imaging instruction section, the projection range image corresponding to the input image data is projected recognized based on the state of the projection lens of the image projection section, depending on the state of the recognized the image projection section of the projection lens Then, the imaging range of the retouched image is changed .

According to this projector, when the instruction input unit receives an imaging instruction, the image control unit projects a plain image with a substantially entire surface from the image projection unit, and the imaging instruction unit projects the plain image. The image pickup unit is caused to take an image during For this reason, the retouched image (image image) captured by the imaging unit does not include the projected image projected before receiving the instruction, that is, the image based on the input image signal (input image). Meanwhile, when the instruction input unit receives an image capture command, the image reading unit, for reading the image data from the display memory, the projected image that has been excluded from the captured revision image, reproduced image data by the image reading unit has read It becomes possible. As a result, it is possible to reproduce the projected image that should be included in the retouched captured image with good image quality without being affected by the performance of the imaging unit and the surrounding environment.
Further, according to this projector, since the image synthesizing unit that synthesizes the image data representing the retouched image in the imaging range and the image data capable of reproducing the projection image is provided, the state before receiving the imaging instruction, that is, the input The state when the image is projected can be reproduced as one image.
Further, according to this projector, the imaging instruction unit can change the imaging range of the retouched image according to the state of the projection lens of the image projecting unit. The projection range is recognized based on the state of the projection lens of the image projection section, recognizes the state of the recognized projection lens, because it changes the imaging range of additional writing image in accordance with the result of this, the state of the projection lens The retouched image in the imaging range corresponding to the image can be appropriately acquired, and the state in which the retouched image is superimposed on the projected image can be reproduced as a good image with an appropriate size, position, and range.

  For example, when an image is projected on a writable surface such as a whiteboard and characters and / or figures are added so as to be superimposed on the projected image, the image captured by the imaging unit Characters and figures (retouched images) are included, but projected images are not included. If this projected image is reproduced with the image data read by the image reading unit and combined with the captured image, the state in which the retouched image is superimposed on the projected image can be reproduced with good image quality.

  In the projector, the image projection unit includes a light source, a light modulation device that modulates light emitted from the light source based on the image data, and a projection optical system that projects light modulated by the light modulation device. And a detection unit that detects a projection state of the projection optical system, and an imaging range changing unit that changes the imaging range of the imaging unit based on a detection result by the detection unit.

According to this projector, since the projection state of the projection optical system is detected and the imaging range of the imaging unit is changed according to the detection result, the imaging range corresponding to the projection state can be captured. Become.
Here, the projection optical system is, for example, a projection lens, and the detection unit detects, for example, a zoom state, a focus state, a lens shift state, and the like as the projection state of the projection optical system. The imaging range changing unit changes the imaging range according to these states, so that the projection range can be imaged with an appropriate size.

  The projector control method of the present invention includes a display memory that stores image data based on an input image signal in units of frames, and an image projection unit that projects an image according to the image data stored in the display memory. A projector control method comprising: an imaging unit that captures a projection range in which the image is projected and generates image data representing an imaging result; and an instruction input unit that receives an instruction for causing the imaging unit to perform imaging A step of reading image data stored in the display memory when the instruction input unit receives the instruction; and a step of reading from the image projection unit when the instruction input unit receives the instruction. Projecting a plain image having a substantially entire surface, causing the imaging unit to perform imaging while the image projection unit is projecting the plain image, and The image data image unit has generated, and characterized by comprising a step of synthesizing the image data read from the display memory.

According to this control method, when the instruction input unit receives an imaging instruction, the image projection unit projects a plain image with a substantially entire surface, and the imaging unit performs imaging while the plain image is being projected. . For this reason, the image (captured image) captured by the imaging unit does not include the projected image projected before receiving the instruction, that is, the image (input image) based on the input image signal. On the other hand, when the instruction input unit receives an imaging instruction, the image data is read from the display memory, so that the projection image excluded from the captured image can be reproduced with the read image data. As a result, the projected image to be included in the captured image can be reproduced with good image quality without being affected by the performance of the imaging unit and the surrounding environment.
Further, according to this control method, since the image data representing the captured image and the image data capable of reproducing the projected image are provided, the state before receiving the imaging instruction, that is, the input image is projected. It is possible to reproduce the state at the time as a single image.

  The program of the present invention includes a display memory that stores image data based on an input image signal in units of frames, an image projection unit that projects an image according to the image data stored in the display memory, and the image Is a program for controlling a projector that includes an imaging unit that captures an image of a projection range in which an image is projected and generates image data representing an imaging result, and an instruction input unit that receives an instruction for causing the imaging unit to perform imaging. When the instruction input unit receives the instruction, the computer reads the image data stored in the display memory; and when the instruction input unit receives the instruction, the image projection unit A step of projecting a plain image having a substantially entire surface from the first and a step of causing the imaging unit to perform imaging while the image projection unit is projecting the plain image. And-up, the image data to which the imaging unit is generated, and is characterized in that and a step of synthesizing the image data read from the display memory.

According to this program, when the instruction input unit receives an imaging instruction, the image projection unit projects a plain image having a substantially entire surface, and the imaging unit performs imaging while the plain image is being projected. For this reason, the image (captured image) captured by the imaging unit does not include the projected image projected before receiving the instruction, that is, the image (input image) based on the input image signal. On the other hand, when the instruction input unit receives an imaging instruction, the image data is read from the display memory, so that the projection image excluded from the captured image can be reproduced with the read image data. As a result, the projected image to be included in the captured image can be reproduced with good image quality without being affected by the performance of the imaging unit and the surrounding environment.
Further, according to this program, in order to execute the step of combining the image data representing the captured image and the image data capable of reproducing the projection image, the state before receiving the imaging instruction, that is, the input image was projected. It is possible to reproduce the state at the time as one image.

(First embodiment)
Hereinafter, a projector according to a first embodiment of the invention will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating a schematic configuration of a projector according to the present embodiment.
As shown in FIG. 1, the projector 1 includes an image projection unit 10, a control unit 20, a storage unit 21, an operation unit 22, an operation signal reception unit 23, an image signal input unit 24, an image signal processing unit 25, and a light valve driving unit. 26, an imaging unit 27, an imaging control unit 28, an image composition unit 29, a USB (Universal Serial Bus) interface (I / F) unit 30, a remote controller RC, and the like. The image projection unit 10 includes a light source unit 11. , Three liquid crystal light valves 12R, 12G, and 12B as light modulation devices, a projection lens 13 as a projection optical system, and the like are included.

  The light source unit 11 includes a discharge lamp 11a such as a high-pressure mercury lamp or a metal halide lamp, and a reflector 11b that reflects light emitted from the discharge lamp 11a toward the liquid crystal light bulbs 12R, 12G, and 12B. Light emitted from the light source unit 11 is converted into light having a substantially uniform luminance distribution by an integrator optical system (not shown), and red (R), green (G), which are the three primary colors of light, by a color separation optical system (not shown), After being separated into blue (B) color light components, they are incident on the liquid crystal light valves 12R, 12G, and 12B, respectively.

The liquid crystal light valves 12R, 12G, and 12B are configured by a liquid crystal panel or the like in which liquid crystal is sealed between a pair of transparent substrates. A driving voltage is applied to the inner surface of each transparent substrate for each minute region (pixel) with respect to the liquid crystal. Transparent electrodes (pixel electrodes) that can be applied are formed in a matrix.
The light valve driving unit 26 applies a driving voltage corresponding to an image signal input from the outside to each pixel, so that each pixel is set to a light transmittance corresponding to the image signal. That is, the light emitted from the light source unit 11 is modulated by transmitting through the liquid crystal light valves 12R, 12G, and 12B, and image light corresponding to the image signal is formed for each color light. The formed image light of each color is synthesized for each pixel by a color synthesizing optical system (not shown) and becomes image light representing a color image, and then enlarged by a projection lens 13 onto a whiteboard WB, a screen (not shown) or the like. Projected.

  The control unit 20 includes a CPU (Central Processing Unit), a RAM (Random Access Memory) used for temporary storage of various data, and the like, and functions as a computer. The control unit 20 performs overall control of the operations of the units 21 to 23, 25, and 28 to 30 connected via the bus 31 by operating according to a control program stored in the storage unit 21.

  The storage unit 21 includes a non-volatile memory such as a mask ROM (Read Only Memory), a flash memory, or an FeRAM (Ferroelectric RAM). The storage unit 21 stores various control programs and various data for controlling the operation of the projector 1.

  The operation unit 22 and the remote controller RC are provided with a plurality of operation buttons for receiving various user instructions. The operation buttons provided in the operation unit 22 and the remote controller RC include a “power button” for turning on / off the power, a “menu button” for projecting a setting menu, and a “shutter button” for instructing imaging by the imaging unit 27. And so on. When the user operates various operation buttons of the operation unit 22, the operation unit 22 outputs an operation signal corresponding to the operation content of the user to the control unit 20. When the user operates various operation buttons of the remote controller RC, the remote controller RC generates an infrared operation signal corresponding to the user's operation content, and the operation signal receiving unit 23 receives this and transmits it to the control unit 20.

  The image signal input unit 24 includes various connection terminals for connecting to an external image supply device (not shown) such as a PC (personal computer) or a video reproduction device via a cable. An image signal is input. The image signal input unit 24 converts the image signal into an image signal in a format that can be processed by the image signal processing unit 25, and outputs the converted image signal to the image signal processing unit 25.

  The image signal processing unit 25 performs signal processing on the image signals sequentially input from the image signal input unit 24 in accordance with an instruction from the control unit 20, and applies drive voltages to the respective pixels of the liquid crystal light valves 12R, 12G, and 12B. To generate image data for prescribing. The generated image data is stored in the display memory (frame memory) 25a in frame units (screen units) and output to the light valve driving unit 26 in frame units. Note that the image signal processing unit 25 rewrites the contents of the display memory 25a according to sequentially input image signals so that the screen is switched at a predetermined frame frequency (for example, 60 Hz).

  The light valve driving unit 26 drives the three liquid crystal light valves 12R, 12G, and 12B based on the frame unit image data input from the image signal processing unit 25. As a result, an image (image light) corresponding to the image data stored in the display memory 25a is projected from the image projection unit 10.

  The imaging unit 27 includes, for example, a CCD (Charge Coupled Device) camera, a CMOS (Complementary Metal Oxide Semiconductor) camera, and the like, and images the entire projection range of the projection lens 13 under the control of the imaging control unit 28, and the imaging result (captured image) ) Is generated. The imaging control unit 28 controls the imaging unit 27 based on an instruction from the control unit 20, and outputs the image data generated by the imaging unit 27 to the image composition unit 29.

  Based on an instruction from the control unit 20, the image composition unit 29 synthesizes the image data captured by the image capturing unit 27 and the image data stored in the display memory 25 a to generate composite image data. The generated composite image data is output to the USB interface unit 30.

  The USB interface unit 30 includes a USB terminal (Type A terminal) (not shown) to which a USB connection type device can be connected. The USB interface unit 30 can input / output data to / from an external storage medium (USB storage device) UM connected to the USB terminal based on an instruction from the control unit 20. Then, the composite image data generated by the image composition unit 29 is stored in the storage medium UM.

  The projector 1 according to the present embodiment has the above-described configuration, and projects an image (input image) based on the image signal input to the image signal input unit 24 from the image projection unit 10 onto a screen, a wall surface, or the like. can do. In addition, when an image is projected on a writable surface such as a whiteboard WB, a character or a figure that is rewritten so as to be superimposed on the projected input image (projected image) (hereinafter referred to as a retouched image) Image) can be captured by the imaging unit 27 and stored in the storage medium UM.

  2A and 2B are explanatory views showing a state in which an input image is projected on the whiteboard, where FIG. 2A is a perspective view and FIG. 2B is a plan view seen from above. In this figure, on the writing surface Wp of the whiteboard WB, along with the input image Gp projected by the projector 1, a user (for example, a presenter of the presentation) writes in order to supplement the input image Gp. A retouched image Gh is included.

  2A and 2B, the imaging range Ac of the imaging unit 27 is adjusted to include the projection range Ap of the projector 1, that is, the input image Gp. The user can acquire an image in a state in which the retouched image Gh is superimposed on the input image Gp by operating the shutter button of the operation unit 22 or the remote controller RC. Here, when the projector 1 according to the present embodiment captures an image, the projector 1 captures a captured image that does not include the input image Gp by capturing an image with a white solid image projected instead of the input image Gp. The input image Gp is reproduced from the image data stored in the memory 25a and synthesized with the captured image.

FIG. 3 is a flowchart showing an operation when imaging is performed by the imaging unit 27, and FIG. 4 is an explanatory diagram for explaining this operation.
The control unit 20 monitors the operation signals from the operation unit 22 and the operation signal reception unit 23 while projecting the input image Gp from the image projection unit 10, and an operation signal indicating that the shutter button has been operated. Is input, it operates according to the flow shown in FIG.

  As shown in FIG. 3, when the shutter button is operated and the process proceeds to step S101, the control unit 20 image data for one frame stored in the display memory 25a at that time, that is, the input image Gp being projected. Is output to the image composition unit 29.

  In step S102, the control unit 20 instructs the image signal processing unit 25 to display image data that maximizes the light transmittance of all the pixels of each of the liquid crystal light valves 12R, 12G, and 12B, that is, white solid color. The image data representing the plain image Gs is written in the display memory 25a. As a result, as shown in FIG. 4, a plain image Gs is projected from the image projection unit 10 instead of the input image Gp, and only the retouched image Gh is displayed on the writing surface Wp of the whiteboard WB. .

  In step S <b> 103, the control unit 20 instructs the imaging control unit 28 to perform imaging using the imaging unit 27. In accordance with this instruction, the imaging control unit 28 causes the imaging unit 27 to image the imaging range Ac, and outputs image data representing the captured image to the image composition unit 29.

  In step S104, the control unit 20 instructs the image signal processing unit 25 to write image data based on the image signal from the image signal input unit 24 into the display memory 25a. As a result, the input image Gp is projected on the writing surface Wp of the whiteboard WB, and the state returns to the state shown in FIG.

  In step S105, the control unit 20 instructs the image composition unit 29 to read out the image data (image data representing the captured image) obtained from the imaging unit 27 in step S103 and the display memory 25a in step S101. The combined image data (image data representing the input image Gp) is synthesized. The image synthesis unit 29 performs a process of synthesizing two image data in accordance with this instruction, and generates synthesized image data.

Here, details of the image composition processing in step S105 will be described.
FIGS. 5A to 5E are explanatory diagrams for explaining the composition processing by the image composition unit 29. FIG. 5A is a diagram showing a captured image, and FIGS. 5B and 5C are process progresses. (D) is a figure which shows the image based on the image data read from the display memory 25a, (e) is a figure which shows the image after a synthesis | combination.

  Upon receiving an image composition instruction from the control unit 20, the image composition unit 29 first performs binarization processing on the captured image Gc (see FIG. 5A) as shown in FIG. A binarized image G1 is generated that is divided into a substantially white portion (white portion) and a non-white portion (colored portion) in the captured image Gc. The projection range Ap in the binarized image G1 is divided into a colored portion that represents the retouched image Gh and a white portion that represents a portion where the writing surface Wp of the whiteboard WB is exposed. Note that the white portion in the projection range Ap is a region having uniform luminance in the binarized image G1 even when the image is picked up with uneven luminance due to the occurrence of hot spots or the like. In addition, the image composition unit 29 derives the position (Px, Py) and size (Sx, Sy) of the projection range Ap in the captured image Gc from the generated binarized image G1.

  Thereafter, the image composition unit 29 acquires color information from the captured image Gc using the white portion in the binarized image G1 as a mask. As a result, as shown in FIG. 5C, an intermediate image G2 in which the retouched image Gh having color information is arranged on the white part is generated.

  Subsequently, the image composition unit 29 scales the image data representing the input image Gp read from the display memory 25a (see FIG. 5D) to match the size (Sx, Sy) of the projection range Ap. (Enlargement or reduction) processing is performed, and the input image Gp subjected to scaling processing is combined with the white portion of the intermediate image G2 in accordance with the position (Px, Py) of the projection range Ap. As a result, as shown in FIG. 5E, the color image portion of the intermediate image G2, that is, the composite image data representing the composite image Gw in which the retouched image Gh is superimposed on the input image Gp is generated.

  Returning to FIG. 3, in step S <b> 106, the control unit 20 converts the combined image data generated by the image combining unit 29 into an image format such as a JPEG (Joint Photographic Experts Group) format, and then sends it to the USB interface unit 30. The data is stored (saved) in the connected storage medium UM, and the process ends.

As described above, according to the projector 1 of the present embodiment, the following effects can be obtained.
(1) According to the projector 1 of the present embodiment, when the operation unit 22 or the shutter button of the remote controller RC is operated, the control unit 20 projects the white plain image Gs from the image projection unit 10, While the image Gs is projected, the imaging unit 27 is caused to perform imaging. For this reason, the captured image Gc does not include the projected image projected before receiving the instruction, that is, the image based on the input image signal (input image Gp), and includes only the retouched image Gh. On the other hand, when the operation unit 22 or the shutter button of the remote controller RC is operated, the control unit 20 reads the image data from the display memory, and thus the input image Gp excluded from the captured image Gc is reproduced with the read image data. It becomes possible. As a result, the input image Gp to be included in the captured image Gc can be reproduced with good image quality without being affected by the performance of the imaging unit 27 and the surrounding environment.

  (2) According to the projector 1 of the present embodiment, the image synthesizing unit 29 that synthesizes the image data representing the captured image Gc and the image data representing the input image Gp is provided, and therefore, before the shutter button is operated. The projection state, that is, the state when the input image Gp is being projected, can be reproduced as one image (composite image Gw).

  In the present embodiment, the operation unit 22 and the remote controller RC including a shutter button for instructing imaging are equivalent to the instruction input unit of the present invention. The control unit 20 when executing step S101 corresponds to the image reading unit of the present invention, and the control unit 20 and image signal processing unit 25 when executing step S102 correspond to the image control unit of the present invention. To do. In addition, the control unit 20 and the imaging control unit 28 when executing step S103 correspond to the imaging instruction unit of the present invention.

(Second Embodiment)
Hereinafter, a projector according to a second embodiment of the invention will be described with reference to the drawings.
In the projector 1 according to this embodiment, the projection lens 13 includes a zoom mechanism and a focus mechanism, and zoom (magnification) is performed by changing the positional relationship in the optical axis direction of a plurality of lens groups constituting the projection lens 13. Operation and focusing (focus position adjustment operation) can be performed. Furthermore, the projector 1 of the present embodiment includes a lens shift mechanism that moves the projection position of the image by shifting the projection lens 13 in the direction perpendicular to the optical axis.

FIG. 6 is a block diagram illustrating a schematic configuration of the projector according to the present embodiment.
As shown in FIG. 6, the projector 1 according to the present embodiment includes a lens control unit 41 that controls the operation of the projection lens 13, a lens drive unit 42 that drives the projection lens 13, and a detection unit that detects the state of the projection lens. The lens detection unit 43 is provided.

  The lens drive unit 42 includes a zoom drive unit that drives the zoom mechanism, a focus drive unit that drives the focus mechanism, and a lens shift drive unit that drives the lens shift mechanism (all not shown). The drive unit is constituted by a stepping motor or the like.

  The lens detection unit 43 includes a zoom state detection unit that detects a zoom state, a focus state detection unit that detects a focus state, and a shift state detection unit that detects the state of a lens shift mechanism (all are not shown). 1) detecting each state and outputting a detection signal representing the detection result. As these detection units, detection means such as a rotary encoder or a potentiometer for detecting the rotation amount of a rotary cam mechanism (not shown) for moving a lens (lens group) can be used. It is also possible to use a circuit that detects various states based on the number of steps of the stepping motor of each drive unit.

  Further, the operation unit 22 and the remote controller RC of the present embodiment have various buttons for instructing driving of the projection lens 13, that is, a “zoom button” for changing the zoom state, and a “focus button for changing the focus state”. , And a “lens shift button” for changing the lens shift state. When the user operates these buttons, the control unit 20 controls the lens control unit 41 according to the operation content. Output a signal.

  When the lens control unit 41 receives the control signal from the control unit 20, the lens detection unit 43 detects various states, and the lens control unit 41 moves the projection lens 13 to the lens driving unit 42 until the projection lens 13 is in a state corresponding to the control signal. Drive.

  In addition, the imaging unit 27 of the present embodiment includes an imaging lens 27a including a zoom mechanism and a focus mechanism, and a swing mechanism (not shown) that can change the orientation (imaging direction) of the imaging unit 27. Yes. The imaging control unit 28 includes a driving unit (not shown) for driving these mechanisms, and can change the zoom state, the focus state, and the imaging direction of the imaging unit 27 in accordance with instructions from the control unit 20. it can.

  The projector 1 according to the present embodiment is configured as described above, and when the operation unit 22 or the shutter button of the remote controller RC is operated, the control unit 20 performs imaging in step S103 (see FIG. 3). Prior to this, a detection signal from the lens detection unit 43 is acquired via the lens control unit 41 to recognize the zoom state, focus state, and lens shift state of the projection lens 13. Thereafter, the control unit 20 estimates the position (shift amount from the optical axis) and size (view angle) of the projection range Ap, the distance to the projection plane, and the like based on the recognized states, and the estimation result. Based on, parameters for specifying the zoom state, the focus state, and the imaging direction of the imaging unit 27 are determined so that the projection range Ap is captured in an appropriate size and in focus. When the control unit 20 outputs the determined parameter as a control signal to the imaging control unit 28, the imaging control unit 28 changes the state (zoom state, focus state, imaging direction) of the imaging lens 27a based on the control signal. Thereafter, the control unit 20 instructs the imaging control unit 28 to perform imaging, and causes the imaging unit 27 to capture the projection range Ap in a state where the plain image Gs is projected.

  FIGS. 7A to 7C are explanatory views for illustrating the relationship between the lens state of the projection lens 13 and the imaging range Ac, and are plan views of the projector 1 as viewed from above. In the present embodiment, the imaging range Ac of the imaging unit 27 is made to coincide with the projection range Ap of the image projection unit 10.

FIG. 7A is a diagram illustrating the relationship between the zoom state of the projection lens 13 and the imaging range. The imaging range Ac1 when the zoom state of the projection lens 13 is the wide end and the imaging range Ac2 when the telephoto end is the telephoto end. Is shown.
As shown in FIG. 7A, the imaging range Ac needs to be wider as the zoom state of the projection lens 13 is wider (wide angle side). Therefore, the control unit 20 estimates the size of the projection range Ap from the zoom state detected by the lens detection unit 43 (zoom state detection unit), and changes the zoom state of the imaging unit 27 according to the estimation result. .

FIG. 7B is a diagram showing the relationship between the focus state of the projection lens 13 and the imaging range. The imaging range Ac3 when an image is projected at a relatively long distance and the image are projected at a relatively short distance. The imaging range Ac4 is shown.
As shown in FIG. 7B, the control unit 20 estimates the distance from the focus state of the projection lens 13 detected by the lens detection unit 43 (focus state detection unit) to the projection surface, and according to the estimation result. Thus, the focus state and imaging direction of the imaging unit 27 are changed.

FIG. 7C is a diagram showing the relationship between the lens shift state of the projection lens 13 and the imaging range. The imaging range Ac5 when the image projection position is shifted to the right side, and the case where the projection position is shifted to the left side. Imaging range Ac6.
As shown in FIG. 7C, the control unit 20 estimates the position of the projection range Ap from the lens shift state detected by the lens detection unit 43 (shift state detection unit), and the imaging unit according to the estimation result. 27 changes the imaging direction.

As described above, according to the projector 1 of the present embodiment, in addition to the effects of the first embodiment, the following effects can be obtained.
According to the projector 1 of the present embodiment, since the imaging range Ac and the focus state of the imaging unit 27 are determined according to the lens state (zoom state, focus state, lens shift state) of the projection lens 13, projection is performed. Regardless of the lens state of the lens 13, it is possible to always capture an image of the projection range Ap with an appropriate size and to obtain a high-quality captured image Gc that is in focus.

  Note that the control unit 20 and the imaging control unit 28 of the present embodiment change the imaging range Ac of the imaging unit 27 by changing the zoom state and imaging direction of the imaging unit 27 according to the detection result of the lens detection unit 43. Therefore, it corresponds to the imaging range changing unit of the present invention.

(Modification)
In addition, you may change embodiment of this invention as follows.
In the first and second embodiments, when the image pickup unit 27 performs imaging, the white plain image Gs is projected. However, the projected plain image Gs is not limited to the white plain image, and the retouched image Gh is displayed. Other colors may be used as long as they can be recognized, and they need not be completely solid.

  In the second embodiment, when the imaging unit 27 has a sufficiently large resolution, the imaging range covers a wide range that can cover the projection range in almost all cases (lens state) regardless of the lens state of the projection lens 13. An image may be captured as Ac, and a range corresponding to the zoom state, the focus state, and the lens shift state may be cut out from the captured image Gc after the image capture. In this case, since it is not necessary to provide the image pickup unit 27 with a zoom mechanism or a swing mechanism, the configuration can be simplified and the cost can be reduced.

  In the first and second embodiments, the generated composite image data is stored in the storage medium UM. However, if the projector 1 is configured to be connectable to the printer, the composite image data is output to the printer. By doing so, the synthesized image Gw may be printed. Further, when the projector 1 is configured to be connectable to a network such as a LAN (Local Area Network), the composite image data can be transferred to another device (personal computer, printer, other projector, etc.) via the network. It may be.

  In the first and second embodiments, the transmissive liquid crystal light valves 12R, 12G, and 12B are used as the light modulator, but a reflective light modulator such as a reflective liquid crystal light valve may also be used. Is possible. In addition, it is possible to use a micromirror array device that modulates the light emitted from the light source by controlling the emission direction of the incident light for each micromirror as a pixel.

  In the first and second embodiments, a discharge-type light source lamp is used as the light source unit 11, but a solid light source such as an LED (Light Emitting Diode) light source or other light sources can also be used.

1 is a block diagram showing a schematic configuration of a projector according to a first embodiment. It is explanatory drawing which shows a mode that the input image is projected on a white board, (a) is a perspective view, (b) is the top view seen from the top. The flowchart showing the operation | movement at the time of imaging by an imaging part. Explanatory drawing for demonstrating the operation | movement at the time of imaging by an imaging part. It is explanatory drawing for demonstrating the synthetic | combination process by an image synthetic | combination part, (a) is a figure which shows a captured image, (b) and (c) is a figure for demonstrating process progress, (d) is a figure. The figure which shows the image based on the image data read from the display memory, (e) is a figure which shows the image after a synthesis | combination. The block diagram which shows schematic structure of the projector of 2nd Embodiment. It is explanatory drawing for demonstrating the relationship between the lens state of a projection lens, and an imaging range, (a) is a figure which shows the relationship between the zoom state of a projection lens, and an imaging range, (b) is the focus state of a projection lens. The figure which shows the relationship between an imaging range, (c) is a figure which shows the relationship between the lens shift state of a projection lens, and an imaging range.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Projector, 10 ... Image projection part, 11 ... Light source part, 11a ... Discharge lamp, 11b ... Reflector, 12R, 12G, 12B ... Liquid crystal light valve, 13 ... Projection lens, 20 ... Control part, 21 ... Memory | storage part, 22 DESCRIPTION OF SYMBOLS Operation part 23 ... Operation signal receiving part 24 ... Image signal input part 25 ... Image signal processing part 25a ... Display memory 26 ... Light valve drive part 27 ... Imaging part 27a ... Imaging lens 28 ... Imaging Control unit, 29 ... Image composition unit, 30 ... USB interface unit, 31 ... Bus, 41 ... Lens control unit, 42 ... Lens drive unit, 43 ... Lens detection unit, Ac, Ac1 to Ac6 ... Imaging range, Ap ... Projection range , G2 ... Intermediate image, Gc ... Captured image, Gh ... Additional image, Gp ... Input image, Gs ... Solid image, Gw ... Composite image, RC ... Remote control, UM ... Storage medium, WB ... Why Board, Wp ... writing surface.

Claims (6)

A display memory for storing input image data based on an input image signal in units of frames;
An image projection unit that projects an image according to the input image data stored in the display memory;
An imaging unit that captures a retouched image of a projection range in which the image is projected, and generates retouched image data representing an imaging result;
An instruction input unit that receives an instruction for causing the imaging unit to perform imaging;
When the instruction input unit receives the instruction, and the image reading unit for reading the input image data stored in the display memory,
When the instruction input unit receives the instruction, an image control unit that projects a plain image having a substantially entire surface from the image projection unit;
An imaging instruction unit that causes the imaging unit to image the retouched image while the image projection unit is projecting the plain image;
And an image synthesizing section for synthesizing the input image data to which the additional writing image data the imaging unit is generated, and the image reading unit has read,
The imaging instruction section, the projection range image corresponding to the input image data is projected recognized based on the state of the projection lens of the image projection section, depending on the state of the recognized the image projection section of the projection lens And changing the imaging range of the retouched image. The projector according to claim 1,
The image projection unit includes a light source, a light modulation device that modulates light emitted from the light source based on the image data, and a projection optical system that projects light modulated by the light modulation device,
A detection unit for detecting a zoom state, a focus state, and a lens shift state which are states of a projection lens of the projection optical system;
Based on the detection result by the detection unit, the position, size, and distance to the projection surface of the projection range are estimated, the zoom state, the focus state, and the imaging direction of the imaging unit are specified, and the imaging range of the imaging unit is determined. An imaging range changing unit to be changed;
A projector further comprising: The projector according to claim 1,
The image projection unit includes a light source, a light modulation device that modulates light emitted from the light source based on the image data, and a projection optical system that projects light modulated by the light modulation device,
A detection unit that detects a zoom state, a focus state, and a lens shift state that are states of the projection lens of the projection optical system, and
A projector characterized in that a range corresponding to a state of a projection lens of the projection optical system is cut out from an imaging range to change the imaging range of the retouched image. The projector according to claim 2,
A projector comprising a swing mechanism capable of changing an imaging direction of the imaging unit. A display memory for storing input image data based on an input image signal in units of frames;
An image projection unit that projects an image according to the input image data stored in the display memory;
An imaging unit that captures a retouched image of a projection range in which the image is projected, and generates retouched image data representing an imaging result;
An instruction input unit that receives an instruction for causing the imaging unit to perform imaging;
A projector control method comprising:
When the instruction input unit receives the instruction, reading out the input image data stored in the display memory,
When the instruction input unit receives the instruction, a step of projecting a plain image having a substantially entire surface from the image projection unit;
A step of causing the imaging unit to capture the retouched image while the image projecting unit is projecting the plain image;
A step of combining the retouched image data to which the imaging unit is generated, and the input image data read from the display memory,
With
The step of causing the image pickup, the state of the input to the projection range image corresponding to the image data is projected recognized based on the state of the projection lens of the image projection section, it recognized the image projection section of the projection lens And a step of changing the imaging range of the retouched image. A display memory for storing input image data based on an input image signal in units of frames;
An image projection unit that projects an image according to the input image data stored in the display memory;
An imaging unit that captures a retouched image of a projection range in which the image is projected, and generates retouched image data representing an imaging result;
An instruction input unit that receives an instruction for causing the imaging unit to perform imaging;
A program for controlling a projector equipped with
On the computer,
When the instruction input unit receives the instruction, reading out the input image data stored in the display memory,
When the instruction input unit receives the instruction, a step of projecting a plain image having a substantially entire surface from the image projection unit;
A step of causing the imaging unit to capture the retouched image while the image projecting unit is projecting the plain image;
A step of combining the retouched image data to which the imaging unit is generated, and the input image data read from the display memory,
With
The step of causing the image pickup, the state of the input to the projection range image corresponding to the image data is projected recognized based on the state of the projection lens of the image projection section, it recognized the image projection section of the projection lens The program for executing the step of changing the imaging range of the retouched image by the above.

Images