JP2007072670A - Optical operation device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology for suppressing the useless light emission of a light emitting device as much as possible. <P>SOLUTION: In an S2, a light emission control part 20a compares two new and old received light quantity stored in an RAM 149, and judges whether or not the incident quantity of external rays of light has been increased or decreased to determine whether or not the finger F has been held over a hole 34. When the light emission control part 20a determines that the incident quantity of the external rays of light has been increased, the S2 is shifted to an S3, and in the S3, the light emission control part 20a transmits a command to stop light emission to a light emitting part 124-1. Thus, the detection of the presence/absence of the existence of the finger according to the increase/decrease in the incident quantity of the external rays of light makes it unnecessary to always detect the existence of the finger by emitting the rays of light just like a conventional manner, and possible to suppress power consumption due to useless light emission. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an optical operation device.

  2. Description of the Related Art Conventionally, an operation device that accepts an input operation based on the movement of a feature such as a fingerprint of a finger has been developed. For example, the mobile phone of Patent Document 1 is provided with a motion detection device for controlling the position of the highlight bar on the display screen. The device includes a push button including an imaging surface on which a finger is placed and an indicator ring surrounding the button. The built-in light source illuminates the imaging surface from the back side, the reflected image converges on the photodetecting element array, and the motion sensor generates digital data from the output value. When the user moves his / her finger in any direction, an image such as a fingerprint of the finger is tracked based on the digital data, and an XY increment signal is generated, thereby moving the highlight bar on the display screen. The push button or the indicator ring emits visible light, thereby giving a predetermined notification to the user.

In addition, a technique for suppressing unnecessary light emission from the light emitting means of the operating device has been developed. For example, according to Patent Document 2, the reflectance of light from the light emitting means is detected, and if the reflectance is equal to or less than a reference threshold, the amount of light emission is reduced assuming that no light is hitting the fingertip or the like.
JP 2003-5903 A JP 2002-62984 A

  By the way, since power in portable devices such as mobile phones and digital cameras is limited, it is desirable to avoid even a slight power waste. In this respect, the technique of Patent Document 1 is problematic because it emits light from a light source without limitation. Further, the technique of Patent Document 2 must always perform weak light emission in order to detect reflectance, and is insufficient for preventing unnecessary light emission. The present invention has been made in view of such a problem, and an object of the present invention is to provide a technique capable of suppressing wasteful light emission of a light emitting device as much as possible in an operation detection device by reflection of light.

  In order to solve the above-described problems, an optical operation device according to the present invention includes a light-emitting unit that emits light to a subject having a shape feature, and an image of the subject by receiving reflected light reflected from the light-emitting unit on the subject. An image pickup unit that outputs a signal, an image data conversion unit that converts an image pickup signal output from the image pickup unit into digital image data, and a feature detection unit that detects a shape feature of a subject from the image data converted by the image data conversion unit; , Movement detection unit for detecting the movement, rest or movement direction of the shape feature of the object detected by the feature detection unit, movement of the shape feature of the object detected by the movement detection unit, up, down, An operation recognizing unit that recognizes an input operation for designating left, right, or pressing, and controls the start and stop of light emission of the light emitting unit by determining increase / decrease in the amount of external light received according to image data A light control unit.

  According to the present invention, the increase / decrease in the amount of external light received is determined according to the image data, and the start and stop of light emission of the light emitting unit are controlled based on the result of this determination. Specifically, light emission is stopped when it is determined that the amount of external light received has increased, and light emission is started when it is determined that the amount of external light received has decreased.

  If the user has no intention to perform an input operation, it is considered that the light receiving unit receives external light as it is. At this time, if the light emission is stopped, it is possible to suppress power consumption due to useless light emission that is not used for detecting the input operation.

  The operation recognition unit may recognize an input operation that designates a short press or a long press according to the length of the stationary time of the shape feature of the subject.

  The shape feature of the subject includes the shape of the fingerprint of the finger. However, the subject may be anything as long as it has a shape characteristic, for example, a pen having a specific shape.

  According to the present invention, the increase / decrease in the amount of external light received is determined according to the image data, and the start and stop of light emission of the light emitting unit are controlled based on the result of this determination. Specifically, light emission is stopped when it is determined that the amount of external light received has increased, and light emission is started when it is determined that the amount of external light received has decreased.

  If the user has no intention to perform an input operation, it is considered that the light receiving unit receives external light as it is. At this time, if the light emission is stopped, it is possible to suppress power consumption due to useless light emission that is not used for detecting the input operation.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

  FIG. 1 is a front view of a digital camera (hereinafter abbreviated as a camera) 100 according to a preferred embodiment of the present invention.

  A lens barrel 60 provided in front of the camera 100 includes a photographic lens 101 including a zoom lens 101a and a focus lens 101b, and the focal length is adjusted by moving the zoom lens 101a in the optical axis direction. In addition, focus adjustment is performed by moving the focus lens 101b in the optical axis direction.

  The lens barrel 60 is advanced from the camera body 180 by retracting from the retracted state of the camera body 180 between a wide end that is a preset shortest focal length position and a tele end that is a longest focal length position. Also stored. In this figure, a state in which the lens barrel 60 is retracted into the camera body 180 is shown.

  Further, the camera 100 creates a state in which the imaging lens 101 is protected by covering the front surface of the photographing lens 101 and blocking the imaging lens 101 and the outside world when not photographing, and a lens cover 61 that exposes the imaging lens to the outside environment during imaging. Is provided.

  The lens cover 61 is configured by a mechanism that can be freely opened and closed. The lens cover 61 covers the front surface of the photographing lens 101 in an open state, and exposes the front surface of the photographing lens 101 to the outside in a closed state. The lens cover 61 is opened / closed in conjunction with the power switch 121 being turned on / off. In this figure, the lens cover 61 is open.

  On the upper surface of the camera 100, a mode dial 123 and a power switch 121 provided with a release switch 104 at the center are provided, and a strobe 105a, an AF auxiliary light lamp 105b, a self-timer lamp 105c, and the like are provided on the front. Has been deployed.

  FIG. 2 is a rear view of the camera 100. On the back side of the camera 100, an image display LCD 102 and an optical operation device 124 are provided. The optical operation device 124 includes a guide 125 for placing a thumb having a large surface area, and a hole 34 is formed near the center of the guide 125. The optical operation device 124 is arranged on the upper right side of the back of the camera so that the right thumb can be satisfactorily placed. The optical operation device 124 detects the movement of the user's finger or the like by light emission / light reception through the hole 34. The optical operation device 124 plays a role of an operation system such as a zoom switch, a switching lever, a cross key, and an information position designation key provided in a conventional camera.

  FIG. 3 is a block diagram of the camera 100. The camera 100 is provided with an operation unit 120 for performing various operations when the user uses the camera 100. The operation unit 120 includes a power switch 121 for turning on the power for operating the camera 100, a mode dial 123 for selecting auto shooting, manual shooting, and the like, and an optical operation device 124.

  In addition, the camera 100 is provided with an image display LCD 102 for displaying captured images, reproduced images, and the like, and an operation LCD display 103 for assisting operations.

  The camera 100 is provided with a release switch 104. The release switch 104 transmits a shooting start instruction to the main CPU 20. In this camera 100, switching between photographing and reproduction is freely performed by the optical operation device 124. When photographing, the optical manipulation device 124 is switched to the photographing side by the user, and when reproducing, the optical manipulation device 124 is photographed. Is switched to the playback side. The camera 100 is provided with a flash light emitting device having a flash light emitting tube 105a that emits flash light.

  In addition, the camera 100 includes a photographing lens 101, a diaphragm 131, and a CCD sensor 132 (hereinafter referred to as an image sensor) that converts a subject image formed through the photographing lens 101 and the diaphragm 131 into an analog image signal. Abbreviated as CCD 132). Specifically, the CCD 132 generates an image signal by accumulating charges generated by subject light irradiated on the CCD 132 for a variable charge accumulation time (exposure period). The CCD 132 sequentially outputs image signals for each frame at a timing synchronized with the vertical synchronization signal VD output from the CG unit 136.

  When the CCD 132 is used as the image sensor, an optical low-pass filter 132a that removes unnecessary high-frequency components in the incident light is disposed in order to prevent the generation of color false signals and moire fringes. In addition, an infrared cut filter 132b that absorbs or reflects infrared light in incident light and corrects a sensitivity characteristic unique to the CCD sensor 132 having high sensitivity in a long wavelength region is provided. The specific arrangement of the optical low-pass filter 132a and the infrared cut filter 132b is not particularly limited.

  The camera 100 also adjusts the white balance of the subject image represented by the analog image signal from the CCD sensor 132, adjusts the slope (γ) of the straight line in the gradation characteristics of the subject image, and further amplifies the analog image signal. A white balance / γ processing unit 133 including an amplifier with a variable gain is provided.

  Further, the camera 100 includes an A / D unit 134 for A / D converting an analog signal from the white balance / γ processing unit 133 into digital R, G, B image data, and an R / R from the A / D unit 134. , G, B image data is stored.

  In this embodiment, the A / D unit 134 has an 8-bit quantization resolution, and outputs analog R, G, B image signals output from the white balance / γ processing unit 133 to R, G of levels 0 to 255. , B are converted into digital image data and output. However, this quantization resolution is merely an example and is not an essential value for the present invention.

  Further, the camera 100 includes a CG (clock generator) unit 136, a photometry / ranging CPU 137, a charge / light emission control unit 138, a communication control unit 139, a YC processing unit 140, and a power supply battery 68. It has been.

  The CG unit 136 includes a vertical synchronization signal VD for driving the CCD sensor 132, a drive signal including a high-speed sweep pulse P, a control signal for controlling the white balance / γ processing unit 133, the A / D unit 134, and a communication control unit. A control signal for controlling 139 is output. Further, a control signal from the photometry / ranging CPU 137 is input to the CG unit 136.

  The photometry / ranging CPU 137 measures the distance by controlling the zoom motor 110, the focus motor 111, and the aperture motor 112 for adjusting the aperture to drive the zoom lens 101a, the focus lens 101b, and the aperture 131, respectively. The CG unit 136 and the charge / light emission control unit 138 are controlled. Driving of the zoom motor 110, the focus motor 111, and the aperture motor 112 is controlled by the motor driver 62, and a control command for the motor driver 62 is sent from the photometry / ranging CPU 137 or the main CPU 20.

  The photometry / ranging CPU 137 determines the brightness of the subject based on the image data periodically (every 1/30 seconds to 1/60 seconds) obtained by the CCD 132 when the release switch 104 is half-pressed (S1 is turned on). Photometry (calculation of EV value).

  That is, the AE calculation unit 151 integrates the R, G, and B image signals output from the A / D conversion unit 134 and provides the integrated values to the photometry / ranging CPU 137. The photometry / ranging CPU 137 detects the average brightness (subject brightness) of the subject based on the integrated value input from the AE calculation unit 151, and calculates an exposure value (EV value) suitable for photographing.

  Then, the photometry / ranging CPU 137 determines the exposure value including the aperture value (F value) of the aperture 131 and the electronic shutter (shutter speed) of the CCD 132 based on the obtained EV value according to a predetermined program diagram. (AE operation).

  When the release switch 104 is fully pressed (S2 is turned on), the photometry / ranging CPU 137 drives the aperture 131 based on the determined aperture value, controls the aperture diameter of the aperture 131, and determines the determined shutter speed. Based on the above, the charge accumulation time in the CCD 132 is controlled via the CG 136.

  The AE operation includes an aperture priority AE, a shutter speed priority AE, a program AE, etc. In any case, the subject brightness is measured, and an exposure value determined based on the photometric value of the subject brightness, that is, an aperture value and a shutter. By taking a picture in combination with the speed, control is performed so that an image is taken with an appropriate exposure amount, and it is possible to save troublesome determination of exposure.

  The AF detection unit 150 extracts image data corresponding to the detection range selected by the photometry / ranging CPU 137 from the A / D conversion unit 134. The method of detecting the focal position is performed using the feature that the high frequency component of the image data has the maximum amplitude at the in-focus position. The AF detection unit 150 calculates an amplitude value by integrating the high-frequency component of the extracted image data for one field period. The AF detector 150 is configured such that the photometry / ranging CPU 137 drives and controls the focus motor 110 to move the focus lens 101a within the movable range, that is, between the end point on the infinity side (INF point) and the end point on the near side (NEAR point). When the maximum amplitude is detected, the detection value is transmitted to the photometry / ranging CPU 137 when the maximum amplitude is detected.

  The photometry / ranging CPU 137 obtains this detection value and issues a command to the focus motor 111 to move the focus lens 101b to the corresponding in-focus position. The focus motor 111 moves the focus lens 101b to the in-focus position in accordance with a command from the photometry / ranging CPU 137 (AF operation).

  The photometry / ranging CPU 137 is connected to the release switch 104 through inter-CPU communication with the main CPU 20, and the in-focus position is detected when the release switch 104 is half-pressed by the user. Further, a zoom motor 111 is connected to the photometry / ranging CPU 137, and when the main CPU 20 obtains a zoom command in the TELE direction or WIDE direction from the user by the zoom switch 127, the zoom motor 111 is used. By driving the motor 110, the zoom lens 101a is moved between the WIDE end and the TELE end.

  The charge / light emission control unit 138 is supplied with power from the power supply battery 68 to emit light from the flash light emission tube 105a, charges a flash light emission capacitor (not shown), and controls light emission from the flash light emission tube 105a. .

  The charging / light emission control unit 138 sends various signals such as charging start of the power supply battery 68, a half-press / full-press operation signal of the release switch 104, and signals indicating the light emission amount and the light emission timing to the main CPU 20 and the photometry / ranging CPU 137. Is supplied to the self-timer lamp 105c and the AF auxiliary light 105b, and control is performed so that a desired light emission amount can be obtained at a desired timing.

  Specifically, when a high (H) level signal is input from the main CPU 20 or the photometry / ranging CPU 137 to the charge / light emission control unit 138, the self-timer lamp 105c is energized and lights up. On the other hand, when a low (L) level signal is input to the charge / light emission control unit 138, the self-timer lamp 105c enters a non-energized state and turns off.

  The main CPU 20 or the photometry / ranging CPU 137 changes the luminance (brightness) of the self-timer lamp 105c by changing and setting the ratio (duty ratio) of the output time of the H / L level signal.

  Note that the self-timer lamp 105c may be constituted by an LED, or may be made common with the LED constituting the AF auxiliary light lamp 105b.

  A self-timer circuit 83 is connected to the main CPU 20. When the self-photographing mode is set, the main CPU 20 measures time based on the full-press signal of the release switch 104. During this timing, the main CPU 20 causes the self-timer lamp 105c to blink while gradually increasing the blinking speed in accordance with the remaining time via the photometry / ranging CPU 137. The self-timer circuit 83 inputs a timing completion signal to the main CPU 20 after timing is completed. The main CPU 20 causes the CCD 132 to perform a shutter operation based on the timing completion signal.

  The communication control unit 139 includes a communication port 107. The communication control unit 139 outputs an image signal of a subject photographed by the camera 100 to an external device such as a personal computer equipped with a USB terminal. In addition, by inputting an image signal from such an external device to the camera 100, data communication with the external device is performed. The camera 100 has a function that simulates a function of switching to ISO sensitivity 100, 200, 400, 1600, etc. of a normal camera that takes a photograph in a roll-shaped photographic film, and can be switched to ISO sensitivity 400 or more. In this case, a high sensitivity mode is set in which the amplification factor of the amplifier of the white balance / γ processing unit 133 is set to a high amplification factor exceeding a predetermined amplification factor. The communication control unit 139 stops communication with the external device during shooting in the high sensitivity mode.

  The camera 100 also includes a compression / decompression & ID extraction unit 143 and an I / F unit 144. The compression / decompression & ID extraction unit 143 reads and compresses the image data stored in the buffer memory 135 via the bus line 142 and stores the image data in the memory card 200 via the I / F unit 144. In addition, the compression / decompression & ID extraction unit 143 extracts an identification number (ID) unique to the memory card 200 and reads the image data stored in the memory card 200 when reading the image data stored in the memory card 200. Are decompressed and stored in the buffer memory 135.

  The Y / C signal stored in the buffer memory 135 is compressed in accordance with a predetermined format by the compression / decompression & ID extraction unit 143, and then the removable medium such as the memory card 200 or the hard disk (HDD) 75 via the I / F 144. Are recorded in a predetermined format (for example, an Exif (Exchangeable Image File Format) file). Data recording to the hard disk (HDD) 75 or reading of data from the hard disk (HDD) 75 is controlled by the hard disk controller 74 in accordance with a command from the main CPU 20.

  The camera 100 includes a main CPU 20, an EEPROM 146, a YC / RGB conversion unit 147, and a display driver 148. The main CPU 20 controls the entire camera 100. The EEPROM 146 stores solid data and programs unique to the camera 100. The YC / RGB conversion unit 147 converts the color video signal YC generated by the YC processing unit 140 into RGB signals of three colors, and outputs them to the image display LCD 102 via the display driver 148.

  The CPU 20 displays character and symbol information such as a shutter speed, an aperture value, the number of images that can be shot, a shooting date and time, a warning message, and a graphical user interface (GUI) on an OSD signal generation circuit 148a built in the driver 148. Send a command to generate a signal. The OSD signal generation circuit 148a outputs video information according to this command. The signal output from the OSD signal generation circuit 148 a is mixed with the image signal from the YC / RGB conversion unit 147 as necessary and supplied to the liquid crystal panel 71. As a result, a combined image in which characters and the like are combined with the through image and the reproduced image is displayed.

  In addition, the camera 100 has a configuration in which an AC adapter 48 for obtaining power from an AC power supply and a power supply battery 68 are detachable. The power supply battery 68 is composed of a rechargeable secondary battery such as a nickel-cadmium battery, a nickel metal hydride battery, or a lithium ion battery. The power supply battery 68 may be a single-use primary battery such as a lithium battery or an alkaline battery. The power supply battery 68 is electrically connected to each circuit of the camera 100 by being loaded into a battery storage chamber (not shown).

  When the AC adapter 48 is loaded in the camera 100 and power is supplied from the AC power source to the camera 100 via the AC adapter 48, the power supply battery 68 is preferential even if it is loaded in the battery storage chamber. The power output from the AC adapter 48 is supplied to each part of the camera 100 as driving power. If the AC adapter 48 is not loaded and the power battery 68 is loaded in the battery storage chamber, the power output from the power battery 68 is supplied to each part of the camera 100 as driving power. Is done.

  Although not shown, the camera 100 is provided with a backup battery separately from the power supply battery 68 housed in the battery housing chamber. For example, a dedicated secondary battery is used as the built-in backup battery and is charged by the power supply battery 68. The backup battery supplies power to the basic functions of the camera 100 when the power battery 68 is not loaded in the battery storage chamber, such as when the power battery 68 is replaced or removed.

  That is, when the power supply from the power supply battery 68 or the AC adapter 48 is stopped, the backup battery is connected to the RTC 15 or the like by a switching circuit (not shown) and supplies power to these circuits. As a result, as long as the backup battery 29 does not reach the end of its life, power supply continues to the basic functions such as the RTC 15 without interruption.

  An RTC (Real Time Clock) 15 is a chip dedicated to timekeeping, and continuously operates by receiving power supply from the backup battery even when power supply from the power supply battery 68 or the AC adapter 48 is turned off.

  The image display LCD 102 is provided with a backlight 70 that illuminates the transmissive or transflective liquid crystal panel 71 from the back side. In the power saving mode, the main CPU 20 determines the brightness of the backlight 70 ( Brightness) is controlled through the backlight driver 72, and the power consumption of the backlight 70 is reduced. Further, in the power saving mode, the optical operation device 124 is operated to display a menu screen on the image display LCD 102, and a predetermined operation can be performed on the menu screen so that on / off can be set. Yes.

  FIG. 4 shows a main part configuration around the optical operating device 124 according to the present invention. The optical operation device 124 is a light emitting unit 124 configured by an LED that emits light and an LED driver that controls the amount of current supplied from the power supply battery 68 to the LED, the on / off timing control of the LED, and the light emission amount of the LED. -1, a light receiving unit constituted by an image sensor such as a CCD or a CMOS that captures an image of the finger F or other object as a subject by the reflected light incident from the hole 34 after the light emitted from the light emitting unit 124-1 is reflected by the finger F 124-2. Hereinafter, although it is described that the subject of the light receiving unit 124-2 is the finger F, other objects (such as a pen) having a shape feature may be used.

  The light receiving unit 124-2 photoelectrically converts the reflected light into an imaging signal at every generation timing (for example, every 1/60 seconds) of pulses periodically generated from the CG 136, and outputs it to the white balance / γ processing unit 133-2. To do. The white balance / γ processing unit 133-2 performs white balance / γ adjustment on the imaging signal and outputs the result to the A / D conversion unit 134-2. The A / D conversion unit 134-2 converts the imaging signal from the white balance / γ processing unit 133-2 into digital image data, and outputs the digital image data to the buffer memory 135-2 and the AF detection unit 150-2. The image data output from the A / D conversion unit 134-2 is referred to as finger image data. The finger image data is alternately stored in two areas of the buffer memory 135-2 each time an imaging signal is output from the light receiving unit 124-2. As a result, two finger image data having different shooting times are stored simultaneously, and image data at an old time is rewritten to a new one each time an imaging signal is output. Note that three or more finger image data may be stored simultaneously.

  The AF detection unit 150-2 averages the finger image data for each predetermined divided area of one screen and for each same color component, and further, for each frame, calculates the average of the R, G, and B colors for all areas. Values Ir, Ig, and Ib are calculated. The integrated average values Ir, Ig, and Ib are stored in the RAM 149 as received light amounts. The amount of light received by the RAM 149 is alternately stored in two areas of the RAM 149 every time an imaging signal is output from the light receiving unit 124-2. As a result, two received light amounts having different calculation times are stored simultaneously, and the received light amount at the old time is rewritten to a new one each time an imaging signal is output. Note that three or more received light amounts may be stored simultaneously.

  The CPU 20 determines the movement direction of the finger F on a two-dimensional plane (XY plane) substantially parallel to the light emission control unit 20a, which is a module for controlling the light emission amount and light emission start / end timing of the light emission unit 124-1, and the guide 125. The direction recognizing unit 20b that is a module that recognizes based on image data, the operation recognizing unit 20c that is a module that recognizes an input operation according to the moving direction or stationary time of the finger F, and the time when the finger F is substantially stationary The timer 20d, which is a module that calculates based on the image data and the current time data output from the RTC 15, is executed. The light emission control unit 20a, the direction recognition unit 20b, the operation recognition unit 20c, and the time measurement unit 20d are programs executed by the CPU 20, and are stored in the EEPROM 146.

  FIG. 5 is an image diagram of finger image data. FIG. 5A shows finger image data D1 at a certain time t1, and FIG. 5B shows finger image data D2 at a certain time t2 after the time t1. The finger image data D1 and D2 are stored separately in two areas of the buffer memory 135-2.

  As shown in this figure, the finger image data D1 and D2 include a fingerprint shape as one of the feature amounts of the finger F as data. The direction recognition unit 20b compares the finger image data D1 and D2 to recognize the movement direction of the fingerprint on the XY plane between the times t1 and t2 as the movement direction of the finger F. The direction recognition unit 20b also has a function of recognizing the movement amount of the finger F as the movement amount of the finger F within the predetermined time t1 to t2.

  The timing unit 20d determines whether or not the finger F is stationary depending on whether or not the movement amount of the finger F recognized by the direction recognition unit 20b is substantially zero. When it is determined that the finger F is stationary, the measurement of the stationary time of the finger F is started. In parallel with this, the time measuring unit 20d determines whether or not the finger F has started moving again from the state where the finger F is stationary, and immediately determines that the finger F has started moving again when the finger F has started moving again. Is stopped, and the time from the start to the stop is determined as the rest time of the finger F.

  The light emission control unit 20a compares the two received light amounts of the RAM 149 to determine increase / decrease in the amount of incident external light. If it is determined that the amount of incident external light has decreased, the light emission control unit 20a determines that the finger F is on the guide 125 and instructs the light emitting unit 124-1 to start light emission. On the other hand, if it is determined that the amount of incident external light has increased, the light emission control unit 20a determines that the finger F is not present on the guide 125 and instructs the light emitting unit 124-1 to stop light emission. Thereby, useless power consumption due to light emission when the finger F is not present on the guide 125 can be suppressed.

  The operation recognizing unit 20c recognizes that one of the input operation of up / down / left / right or pressing is performed from the stationary, moving or moving direction of the finger F recognized by the direction recognizing unit 20b, and responds to the recognized input operation. Command the operation control to each block of the camera 100.

  Hereinafter, the flow of the optical input operation recognition operation according to the present invention will be described with reference to the flowchart of FIG.

  In S1, when the power switch 121 of the digital camera 100 is turned on, the AF detection unit 150-2 starts calculating the amount of received light. By repeating the operation of storing the received light amount in the RAM 149, the received light amount at two different times is stored in the RAM 149.

  In S2, the light emission control unit 20a compares the new and old received light amounts stored in the RAM 149, and determines whether the incident amount of external light has increased or decreased, so that the finger F is held over the hole 34. It is determined whether or not. If it is determined that the number has increased, the process proceeds to S3. If it is determined that the number has decreased, the process proceeds to S4.

  If the incident amount of external light simply increases, the process does not proceed to S3 as it is, but further determines whether or not the increase amount is equal to or greater than a predetermined threshold value. You may make it transfer to. Similarly, if the incident amount of external light simply decreases, the process does not proceed to S4 as it is, but further determines whether or not the decrease amount is equal to or greater than a predetermined threshold value, and if this decrease amount is equal to or greater than the predetermined threshold value. You may make it transfer to S4. In this way, it is determined that the finger is held over the hole 34 only for a sudden change in the incident amount, or it is determined that the finger is erroneously detected from a minute change in the incident amount not related to the operation of holding the finger F. It is possible to prevent it from being judged as being held.

  In S3, the light emission control unit 20a sends a command to stop the light emission to the light emitting unit 124-1. When the light emitting unit 124-1 receives this command, the light emitting unit 124-1 stops the light emission of the light emitting means such as the LED.

  In S4, the light emission control unit 20a sends a command to start light emission to the light emitting unit 124-1. Upon receiving this command, the light emitting unit 124-1 causes a light emitting unit such as an LED to emit light at a predetermined light emission amount and at a predetermined light emission timing. The light emission of the light emitting means continues as long as a command to stop the light emission is sent from the light emission control unit 20a (S3).

  In S <b> 5, the light emission control unit 20 a compares the two finger image data respectively stored in the two areas of the buffer memory 135-2 to determine the presence / absence and movement direction of the finger F. If it is determined that the finger is stationary, the process proceeds to S6, and if it is possible to determine the movement and moving direction of the finger, the process proceeds to S8.

  In S6, the time measuring unit 20d measures the rest time of the finger.

  In S7, the operation recognizing unit 20c recognizes that there is an input operation for designating the press according to the stationary time of the finger F being timed by the time measuring unit 20d, and performs control according to this input operation.

  In S8, it is recognized that there has been an input operation for designating up, down, left, and right according to the upward, downward, left, and right movement directions of the recognized finger F, and control is performed according to each input operation. .

  The specific control contents of S7 and S8 are as follows, for example.

  If the movement direction is a positive or negative direction of X, the CPU 20 performs the same control as when the right or left button of the cross key is pressed, for example, the movement display of the cursor of the graphical user interface in the right or left direction. Is sent to the OSD signal generation circuit 148a. Alternatively, the CPU 20 sends a command to the motor driver 62 for extending the lens barrel 60 in the tele direction or the wide direction.

  If the movement direction is a positive or negative direction of Y, the CPU 20 performs the same control as when the up or down button of the cross key is pressed, for example, moving up or down the cursor of the graphical user interface. Is sent to the OSD signal generation circuit 148a.

  Here, as shown in FIG. 7, once the moving direction of the finger F is detected (S8), the moving direction is not detected until a predetermined time N (for example, 3 seconds) elapses. This is because repetition of the upward / downward / left / right movement of the finger F always involves reverse swinging, and the previously detected movement direction and the later-detected movement direction are offset and no input operation is performed. Because it makes sense.

  In S7, different pressing input operations can be recognized according to the length of the stationary time. In FIG. 7, when the stationary time lasts for a predetermined time M (for example, 1 second), it is recognized that the “short press” input operation has been performed, and operation control (for example, menu selection or start of photographing) is performed accordingly. When the stationary time is further continued for a predetermined time T (for example, 1 second) in addition to the predetermined time M, it is recognized that there has been an input operation of “long press” and a corresponding operation control (for example, a specific mode such as a shooting mode) is performed. Mode).

  When the stationary time exceeds the predetermined time M + T, it is regarded that the operation is not performed at all, and is treated as an “invalid operation”, and no special operation control is performed.

  As described above, the light emission control unit 20a compares the new and old received light amounts stored in the RAM 149, and determines whether the incident amount of external light has increased or decreased. It is determined whether or not it is held over. When it is determined that the light has increased, the light emission of the light emitting unit 124-1 is stopped, and when it is determined that the light has decreased, the light emission of the light emitting unit 124-1 is started. In this way, if the presence / absence of the finger is detected by increasing / decreasing the amount of incident external light, it is not necessary to always detect the presence of the finger by emitting light as in the prior art, thereby suppressing power consumption due to unnecessary light emission. be able to.

Front view of digital camera Rear view of digital camera Block diagram of digital camera Main part configuration diagram around optical operation equipment Image of finger image data Flow chart showing flow of optical input operation recognition operation A diagram illustrating the relationship between operation time and input operation

Explanation of symbols

20a: light emission control unit, 20b: direction recognition unit, 20c: operation recognition unit, 20d: timing unit, 124-1: light emission unit, 124-2: light reception unit

Claims (3)

A light emitting unit that emits light to a subject having a shape feature, an imaging unit that receives reflected light reflected by the light from the light emitting unit and outputs an imaging signal of the subject, and an image output from the imaging unit An image data conversion unit for converting a signal into digital image data, a feature detection unit for detecting a geometric feature of the subject from the image data converted by the image data conversion unit, and a shape of the subject detected by the feature detection unit A motion detection unit that detects movement, stillness, or direction of movement of the target feature, and designates up, down, left, right, or press according to the movement, stillness, or direction of movement of the subject detected by the motion detection unit In an optical operation device comprising an operation recognition unit that recognizes an input operation,
An optical operation device including a light emission control unit that controls start and stop of light emission of the light emitting unit by determining increase / decrease in the amount of external light received according to the image data.   The optical operation device according to claim 1, wherein the operation recognizing unit recognizes an input operation that designates a short press or a long press according to a length of a stationary time of a shape feature of the subject.   The optical operation device according to claim 1, wherein the shape feature of the subject includes a fingerprint shape of a finger.

Images