JP5109853B2 - Electronic camera - Google Patents

Description

  The present invention relates to an electronic camera that images a subject and generates image data.

2. Description of the Related Art Conventionally, devices that recognize a user's actions (gestures) and perform a predetermined operation when a predetermined gesture is performed are known. Such devices are not only controlled by gestures, but when they depend on the characteristics of the device and the contents of the control, the control is performed in the same direction as the gesture direction. Operation becomes possible. For example, Patent Document 1 discloses an apparatus that performs communication via a system or dialogue with the system using a hand pause sign corresponding to a hand gesture.
JP-A-4-260919

  By the way, in many cases, an electronic camera incorporates two optical axis direction control mechanisms such as a focus control mechanism and a variable focal length control mechanism. However, the device described above depends only on the direction of the hand gesture. Therefore, when there are two or more controls in the optical axis direction as in the above-described electronic camera, it is necessary to limit to any one control. To control any of them, either is specified. Separate switching means must be provided, and the operation becomes complicated.

  Accordingly, an object of the present invention is to selectively control an optical system of an electronic camera by an intuitive operation of an operator.

An electronic camera according to a first aspect of the present invention includes a first optical system, a first imaging unit that captures an image of a subject that has passed through the first optical system and generates data of the first image, and the first optical system. A first driving unit that drives, a second optical system, a second imaging unit that captures an image of an operator's finger that has passed through the second optical system, and generates second image data; and the second imaging unit A detection unit that detects finger information of the operator from data of the second image generated by a unit, and a determination unit that determines drive control for the first optical system based on the finger information detected by the detection unit And a control unit that controls the first drive unit based on the drive control determined by the determination unit.
The first optical system includes a focus lens and a zoom lens, and the first drive unit includes a focus drive unit that moves the focus lens in the optical axis direction and a zoom drive that moves the zoom lens in the optical axis direction. The detection unit detects the orientation of the finger and the size of the finger in the second image, and the determination unit determines the size of the finger detected before and after by the detection unit. By comparing, the relative change in the size of the finger is calculated, and the movement direction of at least one of the focus lens and the zoom lens is determined based on the orientation of the finger and the relative change, and the control The unit controls at least one of the focus driving unit and the zoom driving unit based on the moving direction determined by the determining unit.

  Preferably, the display unit further includes a display unit that displays the first image and the second image in an overlapping manner, the detection unit detects the position of the finger in the second image, and the control unit A partial area of the first image corresponding to the position of the finger may be specified according to the position of the finger detected by the detection unit.

An electronic camera of a second invention includes an optical system, an imaging unit that captures an image of a subject that has passed through the optical system and generates image data, a drive unit that drives the optical system, and the imaging unit. The detection unit that detects finger information of the subject from the generated image data, the determination unit that determines drive control for the optical system based on the finger information detected by the detection unit, and the determination unit And a control unit that controls the drive unit based on the drive control. The finger information represents different control instructions depending on whether the finger is on the nail side or on the abdomen side.

  According to the present invention, the optical system of the electronic camera can be selectively controlled by an intuitive operation of the operator.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a view showing an appearance of an electronic camera 1 of the present invention from the back side. As shown in FIG. 1, the second optical system 9, the monitor 16, the operation unit 17, and the lamp 21 are disposed on the back surface portion 31 of the housing 30 of the electronic camera 1. Although not shown in FIG. 1, the first optical system 2 is disposed on the front surface portion of the housing 30. A release button 18 is disposed on the top surface of the housing 30. The electronic camera 1 captures an image of a subject via the first optical system 2 and mainly captures an image of an operator's finger via the second optical system 9.

  FIG. 2 is a block diagram showing the configuration of the electronic camera 1 in the embodiment of the present invention. As shown in FIG. 2, the electronic camera 1 includes a first optical system 2, a zoom drive unit 5, a focus drive unit 6, an image sensor 7, an A / D converter 8, a second optical system 9, an image sensor 11, and an A. / D conversion unit 12, CPU 13, buffer memory 14, flash RAM 15, monitor 16, operation unit 17, release button 18, recording I / F unit 19, recording medium 20, lamp 21, and bus 22.

  The first optical system 2 includes a zoom lens 3, a focus lens 4, a diaphragm (not shown), and the like. The zoom drive unit 5 adjusts the focal length by moving the zoom lens 3 in the optical axis direction under the control of the CPU 13. The focal length determines the range of the subject to be imaged, the so-called angle of view. Note that the angle of view of the first optical system 2 can be adjusted in multiple stages. The focus driving unit 6 moves the focus lens 4 under the control of the CPU 13 to focus on a specific position in the optical axis direction.

  The image sensor 7 photoelectrically converts an object image by the light flux that has passed through the zoom lens 3 and the focus lens 4 and outputs an analog image signal. In the imaging mode, the imaging device 7 captures a recording image (main image) when the release button 18 is fully pressed. Further, the imaging device 7 captures the first through image by thinning readout at predetermined intervals during imaging standby. The output of the image sensor 7 is connected to the A / D converter 8. The A / D conversion unit 8 performs A / D conversion of the output signal of the image sensor 7.

  The second optical system 9 includes an imaging lens 10 and a diaphragm (not shown). By the way, when the operator holds the electronic camera 1, the distance between the second optical system 9 and the operator is almost a fixed value. Therefore, the focal length of the imaging lens 10 is fixed. Further, the focal position of the imaging lens 10 may be fixed at the pan focus position. The image sensor 11 photoelectrically converts an image of the operator's finger by the light beam that has passed through the imaging lens 10 and outputs an analog image signal. In the imaging mode, the imaging device 11 captures the second through image by thinning out reading at predetermined intervals during imaging standby. The output of the image sensor 11 is connected to the A / D converter 12. The A / D converter 12 performs A / D conversion of the output signal of the image sensor 11.

  The CPU 13 is a processor that performs overall control of the electronic camera 1 in accordance with a predetermined sequence program. Further, the CPU 13 performs various image processing (white balance adjustment, color interpolation, gradation conversion processing, contour enhancement processing, etc.) on the data output from the A / D conversion unit 8 and the A / D conversion unit 12. The CPU 13 also executes processing for compressing the image data in the JPEG format before recording the image data on the recording medium 20 and processing for decompressing and restoring the compressed data. Further, the CPU 13 controls a timer for time measurement (not shown). Further, the CPU 13 recognizes the operator's finger from the second through image, and detects finger information including the finger position, the finger direction, and the finger size. Note that the direction of the finger means whether the fingernail side faces the second optical system 9 or the finger side of the finger faces the second optical system 9. Details of detection of finger information will be described later.

  The buffer memory 14 temporarily stores image data in the pre-process and post-process of image processing by the CPU 13. The flash RAM 15 stores image data temporarily stored in the buffer memory 14. The monitor 16 displays various images under the control of the CPU 13. The various images displayed on the monitor 16 include a main image, a first through image, a second through image, an image recorded on the recording medium 20, a menu screen, and the like.

  The operation unit 17 includes an OK button 17a and operation buttons. The operation button receives an operation input on the menu screen or the like from the operator. The release button 18 receives a release instruction input from the operator. The states of the operation unit 17 and the release button 18 are detected by the CPU 13. The recording I / F unit 19 is formed with a connector for connecting the recording medium 20. The recording I / F unit 19 executes data writing / reading with respect to the recording medium 20 connected to the connector. The lamp 21 is configured by an LED or the like, and blinks or lights up based on the output of the CPU 13.

  The outputs of the A / D conversion unit 8 and the A / D conversion unit 12 are connected to the CPU 13 via the bus 22. The outputs of the CPU 13 and the recording I / F unit 19 are connected to the monitor 16 via the bus 22, respectively.

  Here, the optical axis direction of the first optical system 2 will be described. For example, when imaging a scene where a person stands against a landscape, the person is in front and the landscape is in the back with respect to the optical axis direction. For this reason, if the focus is adjusted in the same direction by performing a forward or backward movement with a gesture, the operation becomes intuitive and the operator can easily understand.

  In the above example, the angle of view corresponds to imaging a landscape and a person over a wide range or only within a narrow range, and the operator intuitively approaches or moves away from the subject on the optical axis. It corresponds to. In this case, as described above, if the angle of view is adjusted in the same direction by performing a forward or backward movement with a gesture, an intuitive operation is achieved and the operator can easily understand.

  Therefore, based on the finger information, the CPU 13 controls the focus driving unit 6 to adjust the focus when the finger is on the nail side. On the other hand, when the finger is on the ventral side, the CPU 13 controls the zoom driving unit 5 to adjust the angle of view. Further, the CPU 13 determines whether the finger has approached the second optical system 9 or the finger has moved away from the second optical system 9 based on the relative change in the size of the finger. For example, the CPU 13 determines that the finger has approached the second optical system 9 when the size of the finger has changed greatly. On the other hand, when the size of the finger changes to small, the CPU 13 determines that the finger has moved away from the second optical system 9.

  Then, when the finger is away from the second optical system 9 when the direction of the finger is the nail side, the CPU 13 controls the focus driving unit 6 to move the focus lens 4 closer to the operator, that is, in the short distance direction. Moving. On the other hand, when the finger is close to the second optical system 9 when the finger is on the nail side, the CPU 13 controls the focus driving unit 6 to move away from the operator, that is, to move the focus lens 4 in the long distance direction. Moving.

  Further, when the finger is away from the second optical system 9 when the finger is on the ventral side, the CPU 13 controls the zoom driving unit 5 to move the zoom lens 3 away from the subject, that is, in the wide angle direction. . On the other hand, when the finger is on the ventral side and the finger approaches the second optical system 9, the CPU 13 controls the zoom driving unit 5 to move the zoom lens 3 so as to approach the subject, that is, in the telephoto direction. .

  Accordingly, the CPU 13 can distinguish the direction of the finger and control the movement of the first optical system 2 in the optical axis direction in the same direction as the direction of the finger movement based on the relative change in the finger size. .

  FIG. 3 is a flowchart showing the operation of the CPU 13 during imaging in the electronic camera 1.

  In step S1, the CPU 13 starts an imaging mode. For example, the CPU 13 controls the image sensor 7 to start capturing the first through image, and controls the image sensor 11 to start capturing the second through image. Then, the CPU 13 displays the first through image and the second through image on the monitor 16 so as to overlap each other. For example, the CPU 13 displays a semi-transparent first through image and a semi-transparent second through image in an overlapping manner. Further, the CPU 13 displays a message such as “Please point your finger at the rear lens and point at the subject” on the monitor 16.

  In step S <b> 2, the CPU 13 starts finger recognition by reading a finger template from a memory (not shown) and comparing it with the data of the second through image. The template stores typical shapes of the fingernail side and the ventral side.

  In step S3, the CPU 13 determines whether or not a finger has been recognized from the second through image based on the result of the comparison in step S2. For example, when a finger is recognized (YES), the process proceeds to step S4. On the other hand, if the finger is not recognized (NO), the process returns to step S2. When the CPU 13 returns to step S2, the message such as “No finger is shown” may be displayed on the monitor 16, or the lamp 21 may be blinked. Further, an electronic sound generation unit may be provided to notify the operator by electronic sound. Thereby, the operator can confirm whether or not the finger is imaged via the second optical system 9.

  In step S4, the CPU 13 detects the position of the finger recognized in step S2.

  In step S5, the CPU 13 selects a partial area of the first through image corresponding to the finger position detected in step S4, surrounds the selected area with a frame, turns on the lamp 21, etc. Is selected, and a message such as “Please press the OK button when specifying the subject” is displayed on the monitor 16. Thereafter, the CPU 13 controls each part to perform exposure control suitable for a partial region of the first through image corresponding to the position of the finger, adjustment of the position of the focus lens 4, and the like.

  In step S6, the CPU 13 controls the movement of the first optical system 2 in the optical axis direction with respect to a partial region of the first through image selected in step S5. Details of step S6 will be described later.

  In step S <b> 7, the CPU 13 receives from the operator via the operation unit 17 whether or not to reset a partial region of the first through image selected in step S <b> 5. For example, the CPU 13 displays a message such as “Do you want to reset the subject?” On the monitor 16. When resetting (YES), it returns to step S2 and starts recognizing a finger again. On the other hand, when not resetting (NO), the process proceeds to step S8.

  In step S8, the CPU 13 determines whether or not the release button 18 has been fully pressed. If the release button 18 is fully pressed (YES), the process proceeds to step S9. On the other hand, when the release button 18 is not fully pressed (NO), the process returns to step S6 and the movement of the first optical system 2 in the optical axis direction is controlled again.

  In step S <b> 9, the CPU 13 controls the image sensor 7 to capture the main image.

  In step S10, the CPU 13 performs image processing on the main image data captured in step S9, records the main image data after the image processing on the recording medium 20, and ends the series of processing.

  Next, the control of the movement of the first optical system 2 in the optical axis direction in step S6 of the flowchart of FIG. 3 will be described. FIG. 4 is a flowchart showing the operation of the CPU 13 when controlling the movement of the first optical system 2 in the optical axis direction.

  In step S21, the CPU 13 indicates to the monitor 16 "If you want to adjust the focus, move your finger back and forth with the fingernail side of the finger facing the lens on the back to change the shooting range. "Is displayed. Then, the CPU 13 reads a finger template from the memory (not shown) described above in step S2 and compares it with the data of the second through image to determine whether the finger is on the nail side. For example, a fingernail template may have nail information, and a finger belly template may have fingerprint information. When the direction of the finger is the nail side (YES), the process proceeds to step S22. On the other hand, when the direction of the finger is not the nail side (NO), the process proceeds to step S28 described later.

  In step S22, the CPU 13 starts a timer for time measurement (not shown) and measures the size of the finger. Note that the CPU 13 may display, on the monitor 16, an image obtained by combining the first through image with the second through image in a picture-in-picture in the processing after step S <b> 22. An example of the synthesized image is shown in FIG.

  In step S23, the CPU 13 refers to the timer and determines whether or not the predetermined time has not elapsed. If the predetermined time has not elapsed (YES), the process proceeds to step S24. On the other hand, when the predetermined time has elapsed (NO), the process of FIG. 4 is terminated.

  In step S24, the CPU 13 determines whether or not the size of the finger has changed greatly. For example, the CPU 13 measures the size of the finger and compares it with the size of the finger measured in step S22. If the size of the finger has changed greatly (YES), the process proceeds to step S25. On the other hand, if the finger size has not changed significantly (NO), the process proceeds to step S26.

  In step S25, the CPU 13 controls the focus driving unit 6 to move the focus lens 4 in the long distance direction. Thereafter, the process returns to step S22 to reset the timer.

  If the finger size has not changed significantly in step S24 (NO), in step S26, the CPU 13 determines whether the finger size has changed to small. For example, the CPU 13 measures the size of the finger and compares it with the size of the finger measured in step S22. If the size of the finger has changed to small (YES), the process proceeds to step S27. On the other hand, if the size of the finger has not changed to small (NO), the process returns to step S23 to determine whether or not the predetermined time has not elapsed.

  In step S27, the CPU 13 controls the focus drive unit 6 to move the focus lens 4 in the short distance direction. Thereafter, the process returns to step S22 to reset the timer.

  If the direction of the finger is not the nail side in step S21 (NO), in step S28, the CPU 13 reads the finger template from the memory (not shown) and stores the data of the second through image in step S21. By comparing, it is determined whether the finger is on the ventral side. If the finger is on the ventral side (YES), the process proceeds to step S29. On the other hand, if the finger is not on the ventral side (NO), the process returns to step S21 to determine whether the finger is on the nail side.

  In step S29, the CPU 13 starts a timer and measures the size of the finger.

  In step S30, the CPU 13 refers to the timer and determines whether or not the predetermined time has not elapsed. If the predetermined time has not elapsed (YES), the process proceeds to step S31. On the other hand, when the predetermined time has elapsed (NO), the process of FIG. 4 is terminated.

  In step S31, the CPU 13 determines whether or not the size of the finger has changed greatly. If the size of the finger has changed greatly (YES), the process proceeds to step S32. On the other hand, if the finger size has not changed significantly (NO), the process proceeds to step S33.

  In step S32, the CPU 13 controls the zoom drive unit 5 to move the zoom lens 3 in the telephoto direction. Thereafter, the process returns to step S29 to reset the timer.

  If the finger size has not changed significantly in step S31 (NO), in step S33, the CPU 13 determines whether the finger size has changed to small. If the size of the finger has changed to small (YES), the process proceeds to step S34. On the other hand, if the size of the finger has not changed to small (NO), the process returns to step S30 to determine whether or not the predetermined time has not elapsed.

  In step S34, the CPU 13 controls the zoom driving unit 5 to move the zoom lens 3 in the wide angle direction. Thereafter, the process returns to step S29 to reset the timer.

  In the above embodiment, the example of controlling the movement of the first optical system 2 in the optical axis direction has been described. However, the first embodiment may be applied to the control of the other first optical system 2. For example, the diaphragm aperture of the first optical system 2 may be controlled according to the direction of the finger. For example, the CPU 13 determines whether the finger has fallen to the right side or the left side. When the CPU 13 determines that the finger has fallen to the right side, it opens the aperture opening. On the other hand, if the CPU 13 determines that the finger has fallen to the left side, the aperture opening may be closed. Moreover, you may make it the structure which attaches a tilt to the 1st optical system 2 according to direction of a finger | toe. For example, the CPU 13 determines whether the finger has moved upward or downward. When the CPU 13 determines that the finger has moved upward, the CPU 13 turns the first optical system 2 upward. On the other hand, when it is determined that the finger has moved downward, the CPU 13 may point the first optical system 2 downward.

  Further, assuming the case where a face-to-face shooting, a self-shooting, and a free angle monitor are provided, finger information is detected from the data of the first through image, and the same processing as in the above embodiment may be performed.

  As described above, the electronic camera 1 according to the present embodiment recognizes the operator's finger from the second through image captured through the second optical system 9 and detects finger information. Then, the electronic camera 1 controls the movement of the first optical system 2 in the optical axis direction based on the finger information. Therefore, according to the electronic camera 1 of the present embodiment, the first optical system 2 of the electronic camera 1 can be selectively controlled by an intuitive operation of the operator.

(Supplement of embodiment)
In the above embodiment, the operator's finger is recognized using the finger template stored in the memory in advance in step S2, step S21, and step S28, but the present invention is not limited to this. For example, the operator's finger may be captured in advance and registered in the memory. In this case, for example, a hand in a gloved state may be registered, or a hand with a gloved hand may be registered. As a result, it is possible to deal with cases where the electronic camera cannot be held with bare hands or where the finger is inconvenient.

  In the above embodiment, after the process of step S21, the focus driving unit 6 is controlled when the finger is on the nail side, and the zoom driving unit 5 is controlled when the finger is on the ventral side. Although shown, it is not limited to this. For example, the zoom drive unit 5 may be controlled when the finger is on the nail side, and the focus drive unit 6 may be controlled when the finger is on the ventral side.

  In the above-described embodiment, the example in which the process for controlling the zoom drive unit 5 and the process for controlling the focus drive unit 6 are separated after the process of step S21 is not limited thereto. For example, the CPU 13 may store the determination result in step S21 and control the zoom driving unit 5 or the focus driving unit 6 when the finger size changes after the processing in step S22.

  In addition, the driving speed of the zoom driving unit 5 and the focus driving unit 6 may be changed according to the speed of finger movement. For example, when the CPU 13 detects that the finger is moved all at once, the CPU 13 controls the zoom driving unit 5 to move the zoom lens 3 to the wide-angle side. As described above, based on the change in the measurement time of the timer and the size of the finger, when the change is large, coarse adjustment may be performed, and when the change is small, the fine adjustment may be performed.

  Further, the first through image may be displayed on a display capable of stereoscopic display. In this case, the movement in the optical axis direction of the first optical system 2 may be controlled by associating information on the depth direction of the subject in the first through image with information on the finger position in the second through image. . Thereby, for example, in steps S1 to S5 in FIG. 3, since it is possible to specify a portion that cannot be seen overlapping in the first through image on the plane, it is easier to understand intuitively and controls the movement of the first optical system 2 in the optical axis direction. can do.

It is a figure which shows the external appearance of the electronic camera 1 of this invention from the back side. It is a block diagram which shows the structure of the electronic camera 1 in embodiment of this invention. 3 is a flowchart showing the operation of a CPU 13 during imaging in the electronic camera 1 6 is a flowchart showing the operation of the CPU 13 when controlling the movement of the first optical system 2 in the optical axis direction. It is a figure which shows the example of the synthesized image.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Electronic camera, 2 ... 1st optical system, 3 ... Zoom lens, 4 ... Focus lens, 5 ... Zoom drive part, 6 ... Focus drive part, 7 ... Imaging element, 8 ... A / D conversion part, 9 ... 1st 2 optical systems, 11 ... imaging device, 12 ... A / D converter, 13 ... CPU, 16 ... monitor

Claims (3)

A first optical system;
A first imaging unit that captures an image of a subject that has passed through the first optical system and generates data of the first image;
A first drive unit for driving the first optical system;
A second optical system;
A second imaging unit that captures an image of an operator's finger that has passed through the second optical system and generates second image data;
A detection unit for detecting finger information of the operator from data of the second image generated by the second imaging unit;
A determination unit that determines drive control for the first optical system based on the finger information detected by the detection unit;
A control unit that controls the first drive unit based on the drive control determined by the determination unit ;
The first optical system has a focus lens and a zoom lens,
The first drive unit includes a focus drive unit that moves the focus lens in the optical axis direction and a zoom drive unit that moves the zoom lens in the optical axis direction,
The detection unit detects the direction of the finger and the size of the finger in the second image,
The determination unit calculates a relative change in the size of the finger by comparing the size of the finger detected before and after by the detection unit, and based on the direction of the finger and the relative change. Determining a moving direction of at least one of the focus lens and the zoom lens;
The control unit controls at least one of the focus driving unit and the zoom driving unit based on the moving direction determined by the determining unit. The electronic camera according to claim 1,
A display unit for displaying the first image and the second image in an overlapping manner;
The detection unit detects a position of the finger in the second image;
The electronic camera according to claim 1, wherein the control unit specifies a partial region of the first image corresponding to the position of the finger according to the position of the finger detected by the detection unit. Optical system,
An imaging unit that captures an image of a subject that has passed through the optical system and generates image data;
A drive unit for driving the optical system;
A detection unit for detecting finger information of the subject from data of the image generated by the imaging unit;
A determination unit that determines drive control for the optical system based on the finger information detected by the detection unit;
A control unit that controls the drive unit based on the drive control determined by the determination unit;
2. The electronic camera according to claim 1, wherein the finger information represents different control instructions depending on whether the finger is on the nail side or on the abdomen side .

Images