JP2008298819A - Portable electronic equipment, camera and cellular phone - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide portable electronic equipment, a camera and a cellular phone capable of stabilizing a projection image. <P>SOLUTION: When the image is projected from a projection part 220, operation concerning a projector function is performed based on the change of an image obtained by imaging by an imaging part 120. Since the operation concerning the projector function is performed even though a user does not touch an electronic camera 10 with a PJ, a situation that the position of the electronic camera 10 with the PJ moves to cause deviation of the projecting position of the projection image and convergence of already adjusted focus of the projection image is prevented. Therefore, the projection image is stabilized, and sense of incongruity is prevented from being given to an observer. Icons 172 to 175, 192 and 193 corresponding to operation instructions concerning the projector function are displayed on a liquid crystal display unit 107. Thus, the icons 172 to 175, 192 and 193 become a guide for the user (operator), so that the operability concerning the projector function is improved. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a portable electronic device, a camera, and a mobile phone having an image projection function.

  2. Description of the Related Art A camera equipped with a projector is known as an electronic device equipped with a subject image photographing function and an image projecting function (see, for example, Patent Document 1). The projector is incorporated in the camera body, and is configured to project an image on a screen using a projection optical system for the projector.

JP 2006-222547 A

  However, in order to operate the operation buttons during image projection by the projector, the user must directly touch the camera body placed on a desk or the like, and the position of the camera moves and the projection position of the projection image is shifted. There are problems such as.

(1) A portable electronic device according to a first aspect of the invention includes an imaging device that captures a subject image and outputs an image signal, a projector device that projects an image formed on an optical image forming element, and a change in the image signal. An image change detecting means for detecting, an instruction means for giving an instruction regarding the operation of the projector device in accordance with an area in which a change in the image signal is detected in a photographing range of the imaging device, and an image obtained by imaging with the imaging device It is characterized by comprising a display device capable of display, and display control means for controlling display contents to be displayed on the display device and causing the display device to display a display corresponding to the instruction.
(2) The invention according to claim 2 is the portable electronic device according to claim 1, wherein the display control means causes the display device to display an image obtained by imaging with the imaging device.
(3) The invention according to claim 3 is the portable electronic device according to claim 1, wherein the display control means causes the display device to display the same image as the image formed on the optical image forming element.
(4) According to a fourth aspect of the present invention, in the portable electronic device according to the first aspect, the display control means combines the same image as the image formed on the optical image forming element with the image obtained by the imaging device. And displaying on a display device.
(5) According to a fifth aspect of the present invention, in the portable electronic device according to any one of the first to fourth aspects, the imaging device captures an area including at least a part of an image projected by the projector device. Features.
(6) According to a sixth aspect of the present invention, in the portable electronic device according to the first aspect, the imaging device images a region that does not include an image projected by the projector device.
(7) According to a seventh aspect of the present invention, in the portable electronic device according to any one of the first to sixth aspects, the imaging device includes first and second imaging devices that capture different areas. Features.
(8) A camera according to an eighth aspect of the invention is an image that processes and records an image signal of a subject image obtained by imaging with the portable electronic device according to any one of the first to seventh aspects and an imaging device. Signal processing recording means.
(9) A cellular phone according to a ninth aspect of the invention includes the portable electronic device according to any one of the first to seventh aspects and a communication unit capable of wirelessly communicating with a base station. And

  According to the present invention, a projection image can be stabilized.

  An embodiment of a camera according to the present invention will be described with reference to FIGS. FIG. 1 is a view of an electronic camera with a projector according to the present invention (hereinafter referred to as an electronic camera with a PJ) viewed obliquely from the front. In FIG. 1, a photographing lens 11, an illumination light window 12, and a projector projection window 13 are provided in front of the electronic camera 10 with PJ. A release button 14, a zoom switch 16, a mode switching dial 15, and a main switch 22 are provided on the upper surface of the electronic camera 10 with PJ.

  FIG. 2 is a view of the electronic camera with PJ 10 of FIG. 1 as viewed obliquely from behind. In FIG. 2, a liquid crystal display 17, an operation member 19, and a speaker hole 20 are provided on the back surface of the electronic camera 10 with PJ.

  The electronic camera 10 with a PJ projects projection information such as an image from a built-in projection unit (projector) toward a screen or the like disposed on the front side of the electronic camera 10 with a PJ while being placed on a desk or the like. Projecting from the projection window 13. The electronic camera with PJ 10 has a built-in speaker 21 on the back side of the speaker hole 20, and reproduces information such as sound toward the rear of the electronic camera 10 with PJ.

  The mode switching dial 15 is a mode switching operation member for switching the operation mode of the electronic camera 10 with PJ, such as a shooting mode and a projection mode. The photographing mode is an operation mode in which a subject image is photographed and the photographed image data is saved as an image file in a recording medium constituted by a memory card or the like. The shooting start instruction corresponds to an operation signal output in response to the pressing operation of the release button 14. The PJ-equipped electronic camera 10 has a built-in lighting device that illuminates a subject during shooting. In the photographing mode, the voice is collected by the microphone built in the back side of the speaker hole 20 together with the speaker 21, and the voice data can be stored in a recording medium.

  The projection mode is an operation mode in which captured image data is read from a recording medium (for example, a memory card 150 or an internal memory described later), and a reproduced image based on the image data is projected from the projector projection window 13 by the projection unit. is there. When audio data is recorded, audio reproduction is also performed from the speaker 21. As the projection source, in addition to the data recorded on the recording medium, data recorded on the internal memory can be selected. The projection unit projects a reproduced image based on data selected from the projection source. When a plurality of data are selected, the projection unit sequentially switches the images and projects a reproduced image of the plurality of image data.

  The electronic camera 10 with PJ is provided with a retracting mechanism for retracting the lens barrel P in the camera housing, but the light projected from the projector projection window 13 can be captured by the lens barrel P of the photographing lens 11. It is configured so that there is no.

  FIG. 3 is a block diagram illustrating a circuit configuration of the electronic camera 10 with PJ. In FIG. 3, the electronic camera 10 with PJ includes a projection unit 220, an imaging unit 120, a CPU 101, a memory 102, an operation member 103, a liquid crystal display 104, a speaker 105, a microphone 106, and a power circuit 108. Have A memory card 150 is mounted in a card slot (not shown). The memory card 150 is detachable. A battery 109 is mounted on a battery holder (not shown).

  The CPU 101 sends a control signal to each part of the electronic camera with PJ 10 by performing a predetermined calculation using a signal input from each part constituting the electronic camera with PJ based on the control program. Controls the shooting and projection operations. The CPU 101 is composed of an ASIC (Application Specific Integrated Circuit). The control program is stored in a nonvolatile memory (not shown) in the CPU 101.

  The memory 102 is used as a working memory for the CPU 101. The operation member 103 corresponds to the main switch 22, the release button 14, the zoom switch 16, the mode switching dial 15, and the operation member 19 shown in FIG. The operation member 103 sends an operation signal corresponding to each operation content to the CPU 101.

  The memory card 150 is configured by a non-volatile memory such as a flash memory, and can write, save, and read data of an image captured by the imaging unit 120 according to an instruction from the CPU 101.

  The power supply circuit 108 is turned on / off according to an instruction from the CPU 101. When the power supply circuit 108 is turned on, the voltage from the battery 109 is converted into a voltage required by each circuit, and power is supplied to each unit of the electronic camera 10 with PJ. Note that the CPU 101 is configured to be energized whenever the battery 109 is loaded, regardless of whether the power supply circuit 108 is on or off.

  The liquid crystal display 104 (corresponding to reference numeral 17 in FIG. 2) displays information such as an image in accordance with an instruction from the CPU 101. The liquid crystal display 104 functions as a display monitor that displays an image obtained by imaging and various menu screens, and also functions as an electronic viewfinder that displays an image of a subject (through image) at the time of imaging. The through image is a pre-photographed image that is repeatedly acquired by an image sensor, which will be described later, as a pre-stage of the main photographing. The speaker 105 (corresponding to reference numeral 21 in FIG. 2) reproduces sound based on sound data output from the CPU 101.

  The microphone 106 converts the collected sound into an electrical signal and sends it to the CPU 101. The audio signal data is recorded on the memory card 150 in the shooting mode.

--- Imaging unit ---
The imaging unit 120 includes a photographing optical system 121 (corresponding to reference numeral 11 in FIG. 1), an imaging element 122, a lens driving unit 123, a photographing control circuit 124, and a lens barrel retracting mechanism 125. For example, a CCD is used as the image sensor 122. The imaging control circuit 124 drives and controls the image sensor 122 and the lens driving unit 123 according to an instruction from the CPU 101 and performs predetermined image processing on the image signal (accumulated charge signal) output from the image sensor 122.

  The imaging optical system 121 forms a subject image on the imaging surface of the imaging element 122. The imaging control circuit 124 causes the imaging device 122 to start imaging in response to an imaging start instruction, reads the accumulated charge signal from the imaging device 122 after the imaging is completed, sends the image processing to the CPU 101 as image data.

  The lens driving unit 123 drives a focus lens (not shown) constituting the photographing optical system 121 forward and backward in the optical axis direction based on the focus adjustment signal output from the photographing control circuit 124. The lens driving unit 123 drives the zoom lens (not shown) constituting the photographing optical system 121 to advance and retreat in the optical axis direction (telephoto side or wide angle side) based on the zoom adjustment signal output from the photographing control circuit 124. To do. The focus adjustment amount and the zoom adjustment amount are instructed from the CPU 101 to the photographing control circuit 124.

---- Projection part ---
The projection unit 220 includes a projection optical system 221, a liquid crystal panel 222, an LED (light emitting diode) light source 223, a lens driving unit 224, and a projection control circuit 225. The projection control circuit 225 has a current variable circuit unit, and controls the amount of drive current supplied to the LED light source 223 in accordance with a projection instruction output from the CPU 101. The LED light source 223 illuminates the liquid crystal panel 222 with brightness according to the supply current.

  The projection control circuit 225 further generates a liquid crystal panel drive signal according to the image data sent from the CPU 101, and drives the liquid crystal panel 222 with the generated drive signal. Specifically, a voltage corresponding to the image signal is applied to the liquid crystal layer for each pixel. In the liquid crystal layer to which a voltage is applied, the arrangement of liquid crystal molecules changes, and the light transmittance of the liquid crystal layer changes. Thus, the liquid crystal panel 222 generates (forms) an optical image by modulating the light from the LED light source 223 in accordance with the image signal.

  The projection optical system 221 projects the light image emitted from the liquid crystal panel 222 onto a screen or the like. The lens driving unit 224 drives a focus lens (not shown) constituting the projection optical system 221 to advance and retreat in the optical axis direction based on the focus adjustment signal output from the projection control circuit 225. The lens driving unit 224 further drives a zoom lens (not shown) constituting the projection optical system 221 forward and backward in the optical axis direction based on the zoom adjustment signal output from the projection control circuit 225. The CPU 101 instructs the projection control circuit 225 for the focus adjustment amount and the zoom adjustment amount.

---- About projector function operation using imaging function ---
In the electronic camera with a PJ 10 according to the present embodiment, in addition to the operation of the operation member 103, the user can perform operations related to the projector function as follows by placing a finger or a hand in the imaging range of the imaging unit 120. it can. That is, in the electronic camera with PJ 10 of the present embodiment, the projector function can be operated using the imaging function.

  Prior to specific description of the operation of the projector function using the imaging function, the relationship between the projected image from the projection unit 220 and the imaging range of the imaging unit 120 will be described. FIG. 4 is a diagram illustrating a state in which an image is projected (projected) from the projection unit 220 onto the screen 301 in front of the electronic camera 10 with PJ. In FIG. 4, reference numeral 311 denotes an image (projected image range) projected from the projection unit 220 onto the screen 301.

  5A and 5B are diagrams showing the relationship between the projected image 311 projected on the screen 301 and the imaging range by the imaging unit 120 set on the wide-angle side, and FIG. FIG. 5B is a diagram when viewed from the side of the screen 301, and FIG. 5B is a diagram when viewed from the front of the screen 301. In FIG. 5B, reference numeral 321 denotes an imaging range of the imaging unit 120. As shown in FIGS. 5A and 5B, when set to the wide angle side, the imaging field angle of the imaging unit 120 becomes wider than the projection field angle of the projection unit 220. If the distance 301 is more than a predetermined distance, the imaging unit 120 can capture a wider range than the projected image 311 projected on the screen 301. In the electronic camera 10 with PJ of the present embodiment, since the projector projection window 13 is provided above the lens barrel P, the center position of the projection image 311 is higher than the center position of the imaging range 321. .

  6A and 6B are diagrams showing the relationship between the projected image 311 projected on the screen 301 and the imaging range by the imaging unit 120 set on the telephoto side, and FIG. 6A is the screen. FIG. 6B is a diagram when viewed from the side of the screen 301, and FIG. 6B is a diagram when viewed from the front of the screen 301. As shown in FIGS. 6A and 6B, when set to the telephoto side, the imaging field angle of the imaging unit 120 becomes narrower than the projection field angle of the projection unit 220. Only a range narrower than the projected image 311 can be captured.

  As described above, since the center position of the projected image 311 is higher than the center position of the imaging range 321, if the distance between the electronic camera with PJ 10 and the screen 301 is short (for example, the distance L1 in FIG. 6A). The imaging unit 120 mainly captures an area below the projection image 311. The imaging unit 120 mainly captures the projected image 311 projected on the screen 301 as the distance between the electronic camera with PJ 10 and the screen 301 increases from L1, L2, L3... In FIG. Become. 6B corresponds to the case where the distance between the electronic camera with PJ 10 and the screen 301 is substantially equal to the distance L2 in FIG. 6A.

---- When the field of view is set to the wide-angle side ---
In the electronic camera 10 with PJ of this embodiment, when the mode switching dial 15 is operated to switch to the projection mode and the imaging field angle is set to the wide angle side, the CPU 101 controls each unit as follows. When the CPU 101 determines that the projection mode has been switched based on the output signal from the mode switching dial 15 that is the operation member 103, for example, among the plurality of image data recorded on the memory card 150, for example, Each unit is controlled to read data and project an image from the projection unit 220.

  Further, the CPU 101 activates the imaging unit 120 to image the front of the electronic camera with PJ 10 and causes the liquid crystal display 17 to display an image (through image) obtained by imaging with the imaging unit 120. Further, the CPU 101 instructs the photographing control circuit 124 to drive a zoom lens (not shown) constituting the photographing optical system 121 forward and backward in the optical axis direction based on an output signal from a zoom operation button (not shown) that is the operation member 103. Output a control signal.

  The imaging control circuit 124 outputs a zoom adjustment signal to the lens driving unit 123 based on the control signal received from the CPU 101. The imaging control circuit 124 performs, for example, a known contrast detection AF control calculation and outputs a control signal to the lens driving unit 123 so as to perform focus adjustment. Note that the AF control calculation method is not limited to the contrast detection method, and may be various methods such as a phase difference detection method using an AF distance sensor, and a hybrid method combining the contrast detection method and the phase difference detection method.

  The CPU 101 acquires information regarding the projection angle of view of the projection optical system 221 from the projection control circuit 225. The CPU 101 also obtains information regarding the distance to the subject (for example, the screen 301) obtained by the AF control calculation from the shooting control circuit 124, and the current imaging angle of view of the imaging optical system 121 (hereinafter referred to as the current imaging angle of view A). Get information about. Then, the CPU 101 captures an imaging field angle (hereinafter, calculated imaging) of the imaging optical system 121 capable of capturing the entire image projected on the screen 301 based on the acquired information regarding the projection angle of view and information regarding the distance to the screen 301. (Referred to as an angle of view B).

  The CPU 101 compares the above-described current imaging angle of view A with the calculated imaging angle of view B, and determines whether or not the current imaging angle of view A is greater than the calculated imaging angle of view B by a predetermined angle or more. That is, as shown in FIGS. 5A and 5B, the CPU 101 captures a range wider than the projection image 311 projected on the screen 301 by a predetermined range (a range wider than the projection image 311). It is determined whether or not the image is captured. When the CPU 101 determines that the current imaging angle of view A is larger than the calculated imaging angle of view B by a predetermined angle or more, as shown in FIGS. 7A and 7B, the image obtained by the imaging unit 120 is obtained. 170 and icons 172 to 175 relating to the operation of the projector function are displayed on the liquid crystal display 17 in a superimposed manner.

  An image 170 obtained by imaging with the imaging unit 120 includes a projection image 311 projected on the screen 301 and the periphery of the projection image 311. An image 171 indicates an image of the projection image 311 in the image 170. The icon 172 is a triangular icon which is displayed on the right side of the image 171 and signifies one frame advance of the image projected from the projection unit 220. The icon 173 is a triangular icon that is displayed on the left side of the image 171 and means that one frame of the image projected from the projection unit 220 is returned. The icon 174 is an icon that is displayed on the upper side of the image 171 and signifies enlargement of the image projected from the projection unit 220 (increase in the projected angle of view). The icon 175 is an icon displayed on the lower side of the image 171 and means reduction of the image projected from the projection unit 220 (decrease in the projected angle of view).

  In the electronic camera with PJ 10 according to the present embodiment, when a user's finger is placed in the imaging range of the imaging unit 120 in front of the electronic camera 10 with PJ, as shown in FIG. (Finger F) is imaged by the image sensor 122. Then, the image 179 of the finger F is displayed on the liquid crystal display 17 together with the image 171 of the projection image 311 and the icons 172 to 175.

  In the electronic camera 10 with PJ, when the image 179 of the finger F is displayed in the vicinity of the icon 172 as shown in FIG. 8, only one frame projected from the projection unit 220 is sent. Similarly, when the image 179 of the finger F is displayed in the vicinity of the icon 173, the image projected from the projection unit 220 is returned by one frame. Further, when the image 179 of the finger F is displayed near the icon 174, the image projected from the projection unit 220 is enlarged, and when the image 179 of the finger F is displayed near the icon 175, the image is projected from the projection unit 220. The projected image is reduced.

  That is, the CPU 101 sequentially reads through images obtained by imaging with the image sensor 122 and detects a change in the image signal output from the image sensor 122. Then, the CPU 101 determines whether there is a change in the image on the right side of the projected image 311 projected on the screen 301 based on the detected change in the image signal. For example, when it is determined that there is a change in the area of a predetermined number of pixels or more in the image on the right side of the projected image 311 projected on the screen 301 by placing a finger within the imaging range, the CPU 101 Each unit is controlled so that only one frame of the image projected from the projection unit 220 is sent.

  Similarly, when it is determined that there is a change in an area of a predetermined number of pixels or more in the image on the left side of the projection image 311 projected on the screen 301, the CPU 101 displays the image projected from the projection unit 220. Each part is controlled so that only one frame is returned. When it is determined that there is a change in an area of a predetermined number of pixels or more in the image above the projection image 311 projected on the screen 301, the CPU 101 enlarges the image projected from the projection unit 220. Control each part. If it is determined that there is a change in an area of a predetermined number of pixels or more in the lower part of the projected image 311 projected on the screen 301, the CPU 101 reduces the image projected from the projection unit 220. Control each part.

  Specifically, as illustrated in FIG. 9, the CPU 101 is an area on the right side of the image 171 in the through image obtained by imaging with the imaging element 122 and surrounds the icon 172 with a broken line. A change in the image of the region (shaded portion) 182 is monitored. If the CPU 101 determines that there is a change in an area of a predetermined number of pixels or more in the image of the area 182, it determines that an instruction to send only one image projected from the projection unit 220 is given. Then, for example, when the CPU 101 reads image data from the memory card 150 and projects an image from the projection unit 220, the CPU 101 stores image data that is one frame newer than the currently projected image data from the memory card 150. Each unit is controlled to read and project an image from the projection unit 220. Note that after the CPU 101 determines that the area 182 has changed as described above, the image of the area 182 is restored (for example, the finger F is no longer imaged), and then changes again to the area 182 as described above. If it is determined that there is an image, each unit is controlled to project a new image from the projection unit 220 by one frame.

  Similarly, the CPU 101 monitors the change in the image of the region (shaded portion) 183 in the region on the left side of the image 171 in the through image shown in FIG. 9 and surrounded by a broken line around the icon 173. When the CPU 101 determines that there is a change in an area of a predetermined number of pixels or more in the image of the area 183, the CPU 101 determines that an instruction to return the image projected from the projection unit 220 by one frame is given. For example, when the CPU 101 reads image data from the memory card 150 and projects an image from the projection unit 220, the CPU 101 stores image data that is one frame older than the currently projected image data from the memory card 150. Each unit is controlled to read and project an image from the projection unit 220. Note that the CPU 101 determines that the area 183 has changed as described above, the image of the area 183 is restored (for example, the finger F is no longer imaged), and then changes again to the area 183 as described above. If it is determined that there is an image, each unit is controlled to project an image that is one frame older from the projection unit 220.

  The CPU 101 monitors an image change in an area (shaded portion) 184 that is an area above the image 171 and surrounded by a broken line in the through image shown in FIG. When the CPU 101 determines that there is a change in an area of a predetermined number of pixels or more in the image of the area 184, the CPU 101 determines that an instruction to enlarge the image projected from the projection unit 220 is given. Then, the CPU 101 outputs a control signal (view angle expansion instruction signal) to the projection control circuit 225 so as to widen the projection view angle. Note that the CPU 101 continues to output the angle-of-view expansion instruction signal while it is determined that there is a change in the area 184 having a predetermined number of pixels or more (for example, while the finger F is imaged).

  Similarly, the CPU 101 monitors the change in the image in the region (shaded portion) 185 in the region below the image 171 in the through image shown in FIG. 9 and surrounded by a broken line around the icon 175. If the CPU 101 determines that there is a change in an area of a predetermined number of pixels or more in the image of the area 185, the CPU 101 determines that an instruction to reduce the image projected from the projection unit 220 is given. Then, the CPU 101 outputs a control signal (view angle reduction instruction signal) to the projection control circuit 225 so as to narrow the projection view angle. Note that the CPU 101 continues to output the angle-of-view reduction instruction signal while it is determined that there is a change in the area 185 that is equal to or larger than the predetermined number of pixels (for example, while the finger F is imaged).

  In the above description, it is determined whether or not there is a change in an area having a predetermined number of pixels or more. Note that this is because the projector function is operated against the user's will due to an unexpected slight change in the image in the area around the image 171, for example, when an insect is flying around the projection image 311. You may make it prevent that.

  In the above description, the user (operator) places the finger F within the imaging range on the front side of the electronic camera 10 with PJ while looking at the liquid crystal display 17 disposed on the back surface of the electronic camera 10 with PJ. become. The focus of the imaging unit 120 is adjusted to the screen 301 as a subject or the projected image 311 projected onto the screen 301 by the above-described focus adjustment function. For this reason, if the distance to the screen 301 is short, that is, if the screen 301 is within the reach of the user's finger F, the user can place the finger F on the screen 301. A clear image is captured. Therefore, as described above, the CPU 101 can determine whether or not there is a change in an area having a predetermined number of pixels or more.

  If the distance to the screen 301 is long, that is, if the screen 301 is not within the reach of the user's finger F, the user cannot place the finger F on the screen 301, so the finger F is imaged in a blurred state. The Rukoto. However, even in this case, when the user places the finger F within the imaging range of the imaging unit 120, the regions 182 to 185 of the through image shown in FIG. Can do. Therefore, even if the screen 301 is not within the reach of the user's finger F, as described above, the CPU 101 can determine whether or not there is a change in an area greater than the predetermined number of pixels.

  Thus, in the electronic camera with PJ 10 according to the present embodiment, an operation related to the projector function can be instructed by placing the finger F in front of the electronic camera 10 with PJ. Further, in the electronic camera with PJ 10 of the present embodiment, the display (icons 172 to 175) corresponding to the instruction is displayed on the liquid crystal display 17. That is, since the icons 172 to 175 displayed on the liquid crystal display device 17 and the operation content related to the projector function match, it is easy to intuitively understand the position where the finger F is placed and the operation content.

---- When the field of view is set to the telephoto side ---
In the electronic camera 10 with PJ of the present embodiment, when the mode is switched to the projection mode by operating the mode switching dial 15 and the imaging field angle is set to the telephoto side, the CPU 101 controls each unit as follows. . When the CPU 101 determines that the projection mode has been switched based on the output signal from the mode switching dial 15 that is the operation member 103, the data of a plurality of images recorded in the memory card 150, for example, as described above, is used. Of these, the data of the newest image is read, and each unit is controlled to project the image from the projection unit 220.

  Similarly to the above-described case, the CPU 101 activates the imaging unit 120 to image the front of the electronic camera with PJ 10 and also displays an image (through image) obtained by imaging with the imaging unit 120 on the liquid crystal display. 17 is displayed. Further, the CPU 101 instructs the photographing control circuit 124 to drive a zoom lens (not shown) constituting the photographing optical system 121 forward and backward in the optical axis direction based on an output signal from a zoom operation button (not shown) that is the operation member 103. Output a control signal.

  The imaging control circuit 124 outputs a zoom adjustment signal to the lens driving unit 123 based on the control signal received from the CPU 101 in the same manner as described above. The imaging control circuit 124 performs, for example, a known contrast detection AF control calculation and outputs a control signal to the lens driving unit 123 so as to perform focus adjustment.

  The CPU 101 acquires information regarding the projection angle of view of the projection optical system 221 from the projection control circuit 225. Further, the CPU 101 acquires information regarding the distance to the subject (for example, the screen 301) obtained by the AF control calculation from the photographing control circuit 124 and the current imaging angle of view A. Then, based on the acquired information about the projection angle of view and the information about the distance to the screen 301, the CPU 101, as shown in FIG. 6B, a part of the lower part of the image 311 projected on the screen 301, and the image An imaging field angle (hereinafter referred to as a calculated imaging field angle C) of the imaging optical system 121 capable of imaging a portion below 311 is calculated.

  The CPU 101 compares the above-described current imaging angle of view A with the calculated imaging angle of view C, and determines whether or not the current imaging angle of view A is within a predetermined angle range including the calculated imaging angle of view C. That is, as illustrated in FIG. 6B, the CPU 101 determines whether or not the lower part of the image 311 projected on the screen 301 and the lower part of the image 311 are captured. When the CPU 101 determines that the current imaging angle of view A is within a predetermined angle range including the calculated imaging angle of view C, the image is captured by the imaging unit 120 as shown in FIGS. 10 (a) and 10 (b). The image 170 obtained in this way and the icons 192 and 193 relating to the operation of the projector function are displayed on the liquid crystal display 17 in a superimposed manner.

  FIG. 10B is an enlarged view of a display portion of the liquid crystal display 17 in FIG. Reference numeral 176 denotes an image of a portion below the image 311. The icon 192 is a triangular icon that is displayed in a superimposed manner on the right side of the image 170 and means that one frame of the image projected from the projection unit 220 is forwarded. The icon 193 is a triangular icon that is displayed in a superimposed manner on the right side of the image 170 and means that the image projected from the projection unit 220 is returned by one frame. Reference numeral 194 denotes a center line displayed at the approximate center in the left-right direction of the display portion of the liquid crystal display 17.

  In the electronic camera with PJ 10 according to the present embodiment, when a user's finger is placed in the imaging range of the imaging unit 120 in front of the electronic camera 10 with PJ, as shown in FIG. F is imaged by the image sensor 122. Then, the image 179 of the finger F is displayed on the liquid crystal display 17 together with the image 171 and the icons 192 and 193.

  In the electronic camera with PJ 10, when the image 179 of the finger F is displayed in the area on the right side of the center line 194, only one image projected from the projection unit 220 is sent. Similarly, when the image 179 of the finger F is displayed in the area on the left side of the center line 194, the image projected from the projection unit 220 is returned by one frame.

  Specifically, the CPU 101 sequentially reads through images obtained by imaging with the image sensor 122, and changes to an area of a predetermined number of pixels or more on the right side (through image right area) from the center of the through image. If it is determined that there is an image, it is determined that the projection unit 220 has instructed to send only one frame of the projected image. Then, for example, when the CPU 101 reads image data from the memory card 150 and projects an image from the projection unit 220, the CPU 101 stores image data that is one frame newer than the currently projected image data from the memory card 150. Each unit is controlled to read and project an image from the projection unit 220. Note that the CPU 101 determines that there is a change in the right side area of the through image as described above, the image of the right side area of the through image is restored (for example, the finger F is no longer captured), and then the right side area of the through image again. If it is determined that there is a change as described above, each unit is controlled so that a new image is projected from the projection unit 220 by one more frame.

  Similarly, the CPU 101 sequentially reads through images obtained by imaging with the image sensor 122, and if there is a change in an area equal to or more than a predetermined number of pixels in the left side portion (through image left area) of the through image center. If it is determined, it is determined that the projection unit 220 has instructed to return the image projected by one frame. For example, when the CPU 101 reads image data from the memory card 150 and projects an image from the projection unit 220, the CPU 101 stores image data that is one frame older than the currently projected image data from the memory card 150. Each unit is controlled to read and project an image from the projection unit 220. Note that the CPU 101 determines that there is a change in the left side area of the through image as described above, and then the image of the left side area of the through image returns to the original (for example, the finger F is no longer imaged). When it is determined that there is a change as described above, each unit is controlled to project an image that is one frame older from the projection unit 220.

  As described above, in the electronic camera with PJ 10 according to the present embodiment, even when the imaging angle of view is set to the telephoto side, the finger F is placed in front of the electronic camera 10 with PJ, and so on. The operation can be instructed. Further, in the electronic camera with PJ 10 of the present embodiment, a display (icons 192 and 193) corresponding to the instruction is displayed on the liquid crystal display 17. That is, since the icons 192 and 193 displayed on the liquid crystal display device 17 and the operation content related to the projector function coincide with each other, it is easy to intuitively understand the position where the finger F is placed and the operation content. Furthermore, since the imaging field angle is set to the telephoto side, the imaging range is narrowed. Therefore, even if there is a moving subject on the left and right or above the projected image 311, the projector function is controlled by the movement of the subject. Unintentional operation can be prevented.

  In addition, although the case where the current imaging field angle A is larger than the calculated imaging field angle B by a predetermined angle or the case where the current imaging field angle A is close to the calculated imaging field angle C has been described, in other cases, By operating the operation member 19, frame advance / frame return and enlargement / reduction of the projected image are performed.

The electronic camera 10 with PJ described above has the following operational effects.
(1) When an image is projected from the projection unit 220, an operation related to the projector function is performed based on a change in the image obtained by the imaging unit 120. As a result, operations relating to the projector function can be performed without touching the electronic camera 10 with PJ, so that the position of the electronic camera 10 with PJ moves and the projected position of the projected image and the adjusted projected image are out of focus. It can be prevented. Therefore, it is possible to stabilize the projected image and prevent the viewer from feeling uncomfortable.

(2) The liquid crystal display 107 is configured to display icons 172 to 175, 192, and 193 corresponding to operation instructions related to the projector function. As a result, the icons 172 to 175, 192, and 193 serve as guides for the user (operator), and thus operations related to the projector function can be improved.

(3) An image 311 projected from the projection unit 220 is partially included, and the area around the image 311 is captured by the imaging unit 120, and a finger F or the like is placed in the area around the image 311. It was configured to allow operations related to functions. Accordingly, since an operation related to the projector function can be performed without dropping a shadow such as a finger F on the image 311 projected on the screen 301, the viewer of the image 311 does not feel uncomfortable.

(4) The through image obtained by imaging with the imaging unit 120 and the icons 172 to 175, 192, and 193 are configured to be displayed on the liquid crystal display 107 in a superimposed manner. Thus, by observing the liquid crystal display 107, it is possible to intuitively understand where the operator should place the finger F and how the placed finger F is actually imaged. Operations related to the projector function can be facilitated.

(5) Even when the imaging angle of view is set to the telephoto side, an operation related to the projector function can be instructed by placing a finger F in front of the electronic camera 10 with PJ. By setting the imaging angle of view to the telephoto side, the imaging range is narrowed, so even if there is a moving subject on the left or right or above the projected image 311, the projector function can be controlled by the user depending on the movement of the subject. On the contrary, it can be prevented from being operated.

(6) When the imaging angle of view is set to the telephoto side, the imaging is performed when the lower part of the image 311 projected on the screen 301 and the lower part of the image 311 are imaged. When the finger F is placed on the right half side or the left half side of the image, the projected image is forwarded / backwarded. Thereby, for example, when the surroundings are dark and the position of the finger F is difficult to understand, the finger F can be illuminated by the projection light from the projection unit 220 by slightly putting the finger within the projection field angle of the projection image. , Operability is improved. In addition, since the imaging angle of view is set to the telephoto side, the placed finger F can be displayed largely on the liquid crystal display 107, so that operability is improved.

(7) When a through image obtained by imaging with the image sensor 122 is sequentially read and it is determined that there is a change in the image in a predetermined area or more in a predetermined area of the through image, an instruction related to the projector function It was configured to be judged as having been done. That is, an image of an area that is determined to have almost no change in the image if the finger F is not placed is monitored, and it is determined whether or not there is a change in an area of a predetermined number of pixels or more in the area. It was configured as follows. Accordingly, it is not necessary to perform complicated processing such as specifying an object as in the image analysis processing, so that the processing load on the CPU 101 can be reduced. Therefore, since the processing algorithm can be simplified, the reliability of the processing can be improved. Further, since it is not necessary to employ a CPU with a higher specification than necessary, the manufacturing cost can be suppressed.

---- Modified example ---
(1) In the above description, the operation related to the projector function is performed by placing the finger F in the imaging range of the imaging unit 120, but the present invention is not limited to this. The finger F is an example, and a pen, a pencil, or the like may be placed in place of the finger F, or some object may be placed so that there is a change in a region of a predetermined number of pixels or more captured by the image sensor 122. Further, instead of placing the finger F or the like in the imaging range of the imaging unit 120, an operation related to the projector function may be performed by imaging the light irradiated on the screen 301 with a laser pointer or the like with the imaging element 122. Good. In this case, for example, if the CPU 101 determines that a high-luminance point having a predetermined luminance or higher has appeared in the area 182 shown in FIG. 9, the CPU 101 instructs to send only one image projected from the projection unit 220. For example, it may be determined that an operation related to the projector function is performed by determining the presence or absence of a high-luminance point.

(2) In the above description, it is configured to determine whether or not the finger F or the like is placed in the imaging range of the imaging unit 120, but the present invention is not limited to this. For example, not only the finger F or the like is placed in the imaging range of the imaging unit 120, but also an operation related to the projector function may be performed when it is determined that the finger F or the like has moved for a predetermined time or more. Good. That is, an operation related to the projector function may be performed when a motion of a predetermined number of pixels or more captured by the image sensor 122 is detected for a predetermined time.

(3) In the above description, the projector function can be obtained by placing the finger F in the imaging range of the imaging unit 120 both when the imaging field angle is set to the wide angle side and when the imaging field angle is set to the telephoto side. However, only one of the case where the imaging angle of view is set to the wide angle side and the case where the imaging angle of view is set to the telephoto side may be used.

(4) In the above description, the imaging range is narrowed by setting the imaging angle of view to the telephoto side, but the present invention is not limited to this. For example, even when the imaging field angle is set to the wide-angle side, a part of the image obtained by imaging is cut out and, for example, a liquid crystal display as shown in FIGS. 10 (a) and 10 (b) It may be configured such that an operation related to the projector function is performed in the same manner as in the case where the image display angle is set to the telephoto side.

(5) In the above description, as an example of a projector function that can be operated by placing a finger F or the like in the imaging range of the imaging unit 120, frame advance / frame return and projection image enlargement / reduction are described. However, the present invention is not limited to this. In addition to frame advance / return and projection image enlargement / reduction, for example, a projection start or projection end operation may be performed, and adjustments related to projection functions such as focus adjustment and brightness adjustment of the projection image may be performed. You may comprise so that it may perform.

(6) In the above description, the projection direction of the projection unit 220 in the electronic camera 10 with PJ and the imaging direction of the imaging unit 120 (direction in which the subject exists) are both in front of the electronic camera 10 with PJ. The invention is not limited to this. For example, the projection direction of the projection unit 220 and the imaging direction of the imaging unit 120 may be different. That is, you may comprise so that the imaging part 120 may image | photograph the area | region which does not contain the image which the projection part 220 projects. Even in this case, the operator can perform operations related to the projector function by placing the finger F or the like in the imaging range of the imaging unit 120, and places the liquid crystal display 107 if the operator can visually recognize the liquid crystal display 107. Since it is possible to intuitively understand how the finger F is actually imaged, the same effects as the above-described effects can be obtained.

  In addition, when the projection direction of the projection unit 220 and the imaging direction of the imaging unit 120 are different, auxiliary light may be emitted toward the imaging direction of the imaging unit 120 when an image is projected. By irradiating the auxiliary light toward the imaging direction of the imaging unit 120 at the time of projecting the image, the finger F is clearly imaged even in an environment where the surroundings are dark, so that an operation related to the projector function can be surely performed. In this case, if a light source that emits invisible light having sensitivity of the image sensor 122, such as infrared rays, is used as a light source of auxiliary light in this case, the viewer of the projected image does not feel uncomfortable.

(7) In the above description, the PJ-equipped electronic camera 10 is a so-called compact type digital camera, but may be a single-lens reflex type digital camera. Also, as shown in FIGS. 12 and 13, a so-called swivel type digital camera in which an imaging optical system is rotatable with respect to the camera body may be used. The swivel type digital camera 500 includes a main body 510 and a lens barrel 520. The main body 510 and the lens barrel 520 are rotatably connected by a connection mechanism (not shown). FIG. 12A shows a non-use state in which the lens barrel 520 is not rotated with respect to the main body 510. FIG. 12B shows a photographing / projecting state in which the lens barrel 520 is rotated 90 degrees with respect to the main body 510.

  Usually, the user holds the camera 500 by holding the grip portion of the main body 510, and takes a picture while looking at the liquid crystal display 17 (see FIG. 13) provided on the back of the camera. FIG. 13 is a view showing the back side of the camera 500. In addition to the liquid crystal display 17, operation buttons 502 for performing various operations are provided on the back surface of the main body 510. The camera 500 shown in FIGS. 12 and 13 includes an imaging unit 120 and a projection unit 220 in the lens barrel unit 520. Like the electronic camera 10 with PJ described above, the projection unit 220 captures an object to be imaged by the imaging unit 120. An image is projected (projected) in the same direction as the direction in which it is located. For this reason, the same effects as the above-described effects can be obtained.

  FIG. 14 is a diagram illustrating an appearance of a swivel type digital camera 600 in which the image projection direction of the projection unit 220 is different from that of the camera 500. In the camera 600, the projection unit 220 projects an image in a direction opposite to the direction in which the subject imaged by the imaging unit 120 is located. FIG. 14A is a diagram illustrating a state in which the lens barrel 520 is rotated so as to capture the front of the camera 600 (project an image behind), and FIG. 14B illustrates the rear of the camera 600. 5 is a diagram showing a state in which the lens barrel 520 is rotated so as to image (project an image forward). In the case of the camera 600, the lens barrel 520 is rotated as shown in FIG. 14B, and an image is projected in front of the camera 600 as shown in FIGS. A user located behind the camera 600 can operate the projector function while viewing the display on the liquid crystal display 17. 15A and 15C are diagrams when the camera 600 and the user located behind the camera 600 are viewed from above. FIG. 15B is a diagram showing the display content of the liquid crystal display 17 in the case of FIG. 15A, and FIG. 15D is the display content of the liquid crystal display 17 in the case of FIG. 15C. FIG.

  For example, as shown in FIG. 15A, when the imaging angle of view is set to, for example, the wide-angle side so as to image the abdomen from the user's chest located near the camera 600 behind the camera 600, for example. As shown in FIG. 15B, a mirror image 570 of an image obtained by imaging with the imaging unit 120, icons 192 and 193 related to the operation of the projector function, and a center line 194 are displayed on the liquid crystal display 17 in a superimposed manner. Is done. In the camera 600, as shown in FIGS. 15A and 15B, when the right hand RH displayed in the area on the right side of the center line 194 is moved up and down, for example, the image projected from the projection unit 220 is 1. Only frames are sent. Similarly, as shown in FIGS. 15C and 15D, when the left hand LH displayed in the left area of the center line 194 is moved up and down, for example, one image is projected from the projection unit 220. Only returned.

  Specifically, the CPU 101 sequentially reads through images obtained by imaging with the image sensor 122, and in a left side portion (through image left region) of the through image in a region of a predetermined number of pixels or more in a predetermined time. If it is determined that there is a moving region as described above, it is determined that the projection unit 220 has instructed to send only one frame of the projected image. Then, for example, when the CPU 101 reads image data from the memory card 150 and projects an image from the projection unit 220, the CPU 101 stores image data that is one frame newer than the currently projected image data from the memory card 150. Each unit is controlled to read and project an image from the projection unit 220. Note that after the above determination, the CPU 101 determines that there is no moving area in the image in the left side area of the through image (for example, the right hand RH is not moved), and then it is determined again that the left area in the through image has changed as described above. Then, each unit is controlled to project a new image from the projection unit 220 by one frame.

  Similarly, the CPU 101 sequentially reads through images obtained by imaging with the image sensor 122 and moves to a region on the right side (through image right region) of the through image more than a predetermined number of pixels for a predetermined time or more. If it is determined that there is a region, it is determined that the projection unit 220 has instructed to return the image projected by one frame. For example, when the CPU 101 reads image data from the memory card 150 and projects an image from the projection unit 220, the CPU 101 stores image data that is one frame older than the currently projected image data from the memory card 150. Each unit is controlled to read and project an image from the projection unit 220. Note that after the above determination, the CPU 101 determines that there is no moving area in the image in the right side area of the through image (for example, the left hand LH is not moved), and then it is determined again that the right area in the through image has changed as described above. Then, each unit is controlled to project an image that is one frame older from the projection unit 220.

  Note that an image obtained by imaging with the imaging unit 120 and an image (mirror image 570) displayed on the liquid crystal display 17 are reversed left and right. Therefore, the operation when the CPU 101 determines that there is a change in the area of the predetermined number of pixels or more in the left area of the through image, and the area in the right area of the through image is determined to have a change of the predetermined number of pixels or more. The operation in this case is the reverse of the “when the imaging angle of view is set to the telephoto side” in the above-described embodiment.

  As described above, the camera 600 has the same operational effects as “when the imaging field angle is set to the telephoto side” in the above-described embodiment. Further, in the camera 600, the user may not perform an operation of reaching out and pushing out the front of the camera 600 while looking at the liquid crystal display 17 on the back of the camera 600. In other words, since the projector function can be operated simply by holding and moving the hand where it is easy to carry, such as near the abdomen of the user, the user can easily operate with an easy posture and improve operability.

(8) In the above description, image data is read from the memory card 150 or the internal memory and an image is projected from the projection unit 220, but the present invention is not limited to this. For example, an interface connectable with an external device may be provided, and image data supplied from the outside of the electronic camera with PJ 10 may be projected via this interface.

(9) In the above description, the camera has been described. However, the present invention is not limited to the camera, and any portable electronic device having a subject image capturing function and an image projecting function can be used, for example. The present invention can be applied to various portable electronic devices such as telephones and PDAs. Some mobile phones, PDAs, and the like are provided with a main camera and a sub camera that capture images of different ranges. In the case of such a cellular phone or PDA, an operation related to the projector function may be performed by taking an image of the finger F or the hand with either the main camera or the sub camera. Has the effect of. Further, if it is configured so that an operation related to the projector function can be performed by imaging a finger F or a hand with both the main camera and the sub camera, for example, a user located on the back side of the main body and a front side of the main body, for example Thus, operations related to the projector function can be performed with both the observer located at the position of the projector.

(10) In the above description, the through image (image 170) obtained by imaging with the imaging unit 120 and the icons 172 to 175, 192, and 193 related to the operation of the projector function are displayed on the liquid crystal display 17 in a superimposed manner. However, the present invention is not limited to this. For example, the same image 312 as the image projected from the projection unit 220 shown in FIG. 16A (that is, an image based on the data read from the memory card 150), and icons 172 to 175 shown in FIG. The image may be combined and displayed on the liquid crystal display 17 as shown in FIG. In such a configuration, the through image obtained by imaging by the imaging unit 120 is not displayed on the liquid crystal display 17, and thus the user's finger F or the like is not displayed on the liquid crystal display 17. However, from the positional relationship between the image 312 displayed on the liquid crystal display 17 and the icons 172 to 175, where the finger F should be placed for the operation of the projector function in the vicinity of the projected image 311 on the screen 301. Since it can be understood intuitively, the same operational effects as the above-described operational effects are exhibited.

  Also, an image 170a obtained by deleting the image (image 171) of the projection image 311 as shown in FIG. 17B from the through image (image 170) obtained by imaging with the imaging unit 120 shown in FIG. Generate data for Then, the same image 312 (FIG. 17C) as the image projected from the projection unit 220 is combined with the image 170a on the area where the image 171 was present based on the data read from the memory card 150. To do. In addition, the images of icons 172 to 175 shown in FIG. In this way, as shown in FIG. 17E, an image 312 based on the data read from the memory card 150 is displayed on the liquid crystal display 17 instead of the image (image 171) of the projection image 311. May be. When configured in this way, the region around the projected image 311 is displayed on the liquid crystal display 17 in the through image obtained by imaging with the imaging unit 120. It will be displayed on the display 17. Therefore, there exists an effect similar to the effect mentioned above.

(11) Each embodiment and modification described above may be combined.

  The present invention is not limited to the embodiment described above, and an imaging device that captures a subject image and outputs an image signal, a projector device that projects an image formed on an optical image forming element, An image change detecting means for detecting a change in the image signal, an instruction means for giving an instruction regarding the operation of the projector device in accordance with an area in which a change in the image signal is detected in the imaging range of the imaging device, and an image picked up by the imaging device A display device capable of displaying the obtained image and display control means for controlling display contents to be displayed on the display device, wherein the display control means causes the display device to display a display corresponding to the instruction. Includes portable electronic devices of various structures.

It is the figure which looked at the electronic camera with a projector (electronic camera with PJ) 10 by the present invention from diagonally forward. It is the figure which looked at the electronic camera 10 with PJ from diagonally backward. It is a block diagram explaining the circuit structure of the electronic camera with PJ. It is a figure which shows the state which projected the image from the projection part 220 on the screen 301 of the front of the electronic camera 10 with PJ. It is a figure which shows the relationship between the projection image 311 projected on the screen 301, and the imaging range by the imaging part 120 set to the wide angle side. It is a figure which shows the relationship between the projection image 311 projected on the screen 301, and the imaging range by the imaging part 120 set to the telephoto side. It is a figure explaining the image 170 acquired by the imaging part 120 when the imaging angle of view is set to the wide-angle side, and icons 172 to 175 related to the operation of the projector function. It is a figure explaining operation of a projector function. It is a figure explaining the area | regions 182 to 185 around the icons 172 to 175. It is a figure explaining the image 170 acquired by the imaging part 120, and the icons 192 and 193 regarding operation of a projector function when an imaging field angle is set to a telephoto side. It is a figure explaining operation of a projector function. It is a figure which shows a modification. It is a figure which shows a modification. It is a figure which shows a modification. It is a figure explaining operation of the projector function in a modification. It is a figure which shows a modification. It is a figure which shows a modification.

Explanation of symbols

10 Electronic camera with projector (Electronic camera with PJ)
11 Shooting Lens 13 Projector Projection Window 17 Liquid Crystal Display 101 CPU
DESCRIPTION OF SYMBOLS 120 Image pick-up part 122 Image pick-up element 124 Image pick-up control circuit 150 Memory card 220 Projection part 222 Liquid crystal panel 225 Projection control circuit 172-175,192,193 Icon 500,600 Digital camera (camera)

Claims (9)

An imaging device that captures a subject image and outputs an image signal;
A projector device for projecting an image formed on the optical image forming element;
Image change detecting means for detecting a change in the image signal;
Instructing means for instructing an operation of the projector device in accordance with an area in which a change in the image signal is detected in an imaging range by the imaging device;
A display device capable of displaying an image obtained by imaging with the imaging device;
A portable electronic device comprising: display control means for controlling display contents to be displayed on the display device and causing the display device to display a display corresponding to the instruction. The portable electronic device according to claim 1,
The portable electronic device, wherein the display control means causes the display device to display an image obtained by imaging with the imaging device. The portable electronic device according to claim 1,
The portable electronic device, wherein the display control means causes the display device to display the same image as the image formed on the optical image forming element. The portable electronic device according to claim 1,
The portable electronic device characterized in that the display control means combines the same image as the image formed on the optical image forming element with an image obtained by the imaging device and displays the synthesized image on the display device. In the portable electronic device as described in any one of Claims 1-4,
The portable electronic device, wherein the imaging device captures an area including at least a part of an image projected by the projector device. The portable electronic device according to claim 1,
The portable electronic device, wherein the imaging device captures an area not including an image projected by the projector device. In the portable electronic device as described in any one of Claims 1-6,
The portable electronic device, wherein the imaging device includes first and second imaging devices that capture different areas. A portable electronic device according to any one of claims 1 to 7,
An image signal processing recording means for processing and recording an image signal of the subject image obtained by imaging with the imaging device. A portable electronic device according to any one of claims 1 to 7,
A mobile phone comprising: a communication means capable of wirelessly communicating with a base station.

Images