WO2009090862A1 - Imaging device, portable terminal, and camera control method - Google Patents

Imaging device, portable terminal, and camera control method Download PDF

Info

Publication number
WO2009090862A1
WO2009090862A1 PCT/JP2009/000077 JP2009000077W WO2009090862A1 WO 2009090862 A1 WO2009090862 A1 WO 2009090862A1 JP 2009000077 W JP2009000077 W JP 2009000077W WO 2009090862 A1 WO2009090862 A1 WO 2009090862A1
Authority
WO
WIPO (PCT)
Prior art keywords
subject
state
lock
control unit
imaging apparatus
Prior art date
Application number
PCT/JP2009/000077
Other languages
French (fr)
Japanese (ja)
Inventor
Takashi Ishihara
Original Assignee
Panasonic Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Corporation filed Critical Panasonic Corporation
Publication of WO2009090862A1 publication Critical patent/WO2009090862A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B7/00—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly
    • G03B7/08—Control effected solely on the basis of the response, to the intensity of the light received by the camera, of a built-in light-sensitive device
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28—Systems for automatic generation of focusing signals
    • G02B7/36—Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/635—Region indicators; Field of view indicators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time

Definitions

  • the present invention relates to an imaging device, a portable terminal, and a camera control method having an autofocus (hereinafter referred to as AF) function, an automatic exposure adjustment (hereinafter referred to as AE) function, and an automatic white balance (hereinafter referred to as AWB) function.
  • AF autofocus
  • AE automatic exposure adjustment
  • AWB automatic white balance
  • an AF lock operation for holding an AF completion state is performed after optimal focus adjustment is performed on the subject.
  • the AE function is also operated together with the AF function, and after the exposure adjustment is performed by adjusting the aperture and the shutter speed so that the brightness of the subject image becomes the optimum exposure, the AE completion state
  • the AE lock operation for holding is performed.
  • the AWB function is also operated to perform the WB lock operation for maintaining the white balance (hereinafter referred to as WB) of the subject image and maintaining the WB state.
  • WB white balance
  • the AF function operates when the user presses the shutter button halfway when taking an image, and when performing AF / AE lock, AF / AE lock is obtained when the shutter button is pressed halfway. Retained.
  • FIG. 12 is a diagram for explaining the operation of AF / AE lock in the imaging apparatus.
  • FIGS. 12A to 12C show examples of a preview screen that displays a subject image before photographing.
  • FIG. 12A shows an AF / AE locked state for the subject A.
  • FIG. it is assumed that subject A and subject B exist on the preview screen, and the user presses the shutter button halfway while the subject A is aligned with the AF area at the center of the screen, so that AF is performed on subject A.
  • the / AE operation is executed and the AF / AE lock state is entered.
  • FIG. 12B shows a state in which the subject is changed to the subject B while holding the AF / AE lock.
  • subject B is positioned at the center of the screen. The screen is dark (underexposed) or bright (overexposed) because it is out of focus and not well exposed.
  • FIG. 12C shows an AF / AE locked state for the subject B.
  • Patent Document 1 Japanese Patent No. 2557211
  • an operation by the user is required to release the AE lock.
  • a separately provided AE lock release is required. Since the operation of the button is necessary, the operation is complicated. For this reason, there are problems such as poor operability when taking a picture in a hurry, and taking a long time to take a desired subject.
  • the present invention has been made in view of the above circumstances, and is capable of automatically releasing an AF lock or the like without requiring a special operation, and can improve the operability. It aims to provide a method.
  • the imaging apparatus includes an autofocus control unit that automatically focuses on a subject, a subject state detection unit that detects the state of the subject, and the subject after the focus is fixed by the autofocus control unit. And a function control unit that releases the fixed state when a change in the state of the subject is detected based on the detection result of the state detection unit.
  • the present invention is the above-described imaging device, comprising an automatic exposure control unit that automatically adjusts exposure to a subject, and the function control unit fixes the exposure by the automatic exposure control unit,
  • the fixed state is released.
  • the exposure can be automatically released and the AE lock can be released without any special operation. Can be improved.
  • the AE control can be quickly followed to the current state of the subject, and the time until the next shooting can be shortened.
  • the present invention is the above-described imaging apparatus, further comprising a white balance control unit that adjusts a white balance of a subject image, wherein the function control unit fixes the white balance after the white balance control unit fixes the subject.
  • the white balance control unit fixes the white balance after the white balance control unit fixes the subject.
  • the present invention is the above imaging device, wherein the subject state detection unit detects a face in a subject image and acquires a position of a face region, and the function control unit includes the face This includes a case where the fixed state is released when the position of the region changes by a predetermined amount or more.
  • the locked state can be automatically released without requiring a special operation by releasing the fixed state such as the focus, improving operability. it can.
  • AF control or the like can be made to follow the current state of the subject, and the time until the next shooting can be shortened.
  • the present invention is any one of the above imaging devices, wherein the subject state detection unit detects a movement of the subject, and the function control unit detects the movement of the subject more than a predetermined amount. And those that release the fixed state. Accordingly, when the movement of the subject is detected by a predetermined amount or more, the locked state can be automatically released without requiring a special operation by releasing the fixed state such as the focus, and the operability can be improved. In addition, AF control or the like can be made to follow the current state of the subject, and the time until the next shooting can be shortened.
  • the present invention is the imaging apparatus according to any one of the above, wherein the subject state detection unit detects an exposure condition of the subject image, and the function control unit determines that the exposure condition of the subject image is a predetermined amount or more. When it changes, the thing which cancels
  • the exposure condition of the subject image changes by a predetermined amount or more
  • the locked state can be automatically released without requiring a special operation by releasing the fixed state such as exposure, and the operability can be improved. It is also possible to shorten the time until the next shooting by making the AE control or the like follow the current state of the subject.
  • the present invention includes the above-described imaging device including a notification unit that notifies the user of the fixed state or the release of the fixed state.
  • a notification unit that notifies the user of the fixed state or the release of the fixed state.
  • the present invention provides a mobile terminal including any one of the above imaging devices.
  • the present invention provides an autofocus control step of automatically focusing on a subject, a subject state detection step of detecting the state of the subject, and after fixing the focus by the autofocus control, And a function control step for releasing the fixed state when a change in the state of the subject is detected based on the detection result.
  • an imaging device a portable terminal, and a camera control method that can automatically release AF lock or the like without requiring a special operation and can improve operability.
  • 6A and 6B illustrate AF / AE lock and unlock operations of the imaging apparatus according to the embodiment of the present invention.
  • 1 is a block diagram showing a schematic configuration of an imaging apparatus according to an embodiment of the present invention.
  • 6A and 6B illustrate AF / AE lock and unlock operations of the imaging apparatus according to the first embodiment.
  • 6 is a flowchart illustrating a procedure of AF / AE lock and unlock operations of the imaging apparatus according to the first embodiment.
  • 6A and 6B are diagrams for explaining AF / AE lock and unlock operations of the imaging apparatus according to the second embodiment.
  • 8 is a flowchart illustrating a procedure of AF / AE lock and unlock operations of the imaging apparatus according to the second embodiment.
  • FIG. 8 is a flowchart illustrating a procedure of AF / AE lock and unlock operations of the imaging apparatus according to the third embodiment.
  • the block diagram which shows the structure of the mobile telephone apparatus containing the imaging device which concerns on 4th Embodiment. 6A and 6B illustrate an AF / AE lock operation in the imaging apparatus.
  • FIG. 1 is a diagram for explaining AF / AE locking and unlocking operations of an imaging apparatus according to an embodiment of the present invention.
  • FIG. 1A and 1B show examples of a preview screen that displays a subject image before photographing.
  • FIG. 1A shows an AF / AE lock state with respect to the subject A.
  • subject A and subject B exist on the preview screen, and when the user operates the AF button while subject A is aligned with the AF area 31 at the center of the screen, this operation input is received and AF An AF / AE operation (autofocus (automatic focus adjustment) and automatic exposure adjustment operation) is performed on the subject A in the area 31 to set the AF / AE lock state.
  • autofocus automatic focus adjustment
  • automatic exposure adjustment operation is performed on the subject A in the area 31 to set the AF / AE lock state.
  • FIG. 1B shows a state in which the imaging target is changed from the subject A to the subject B.
  • the imaging target is changed from the subject A to the subject B as shown in FIG. 1B from the AF / AE locked state in FIG. 1A, and the user positions the subject B in the center of the screen, the subject is subject to predetermined conditions.
  • a change in the state is determined, and the AF / AE lock is automatically released.
  • Predetermined conditions for determining the change in the state of the subject include a change in the image in the AF area 31 (a change in the position of the face area), a movement of the subject in the AF area 31 locked in AF, a change in the exposure condition of the subject image, and the like. Use. By releasing the AF / AE lock in this way, an AF / AE operation for a new subject can be performed without performing a special operation.
  • FIG. 2 is a block diagram showing a schematic configuration of the imaging apparatus according to the embodiment of the present invention.
  • the imaging apparatus of the present embodiment includes a lens 11, an imaging element 12, a lens driving unit 13, an image processing unit 14, and an AF control unit (autofocus control unit) 15 as a camera unit.
  • the image sensor 12 is composed of a CCD, a CMOS type sensor, etc., and photoelectrically converts the subject image formed by the lens 11 and outputs an electrical signal of the captured image.
  • the lens driving unit 13 includes a voice coil motor or the like, and performs focus adjustment by driving the lens 11 in the optical axis direction based on a control signal from the AF control unit 15.
  • the image processing unit 14 performs various processes on the output signal of the image sensor 12, and generates and outputs an image signal obtained by imaging the subject.
  • the image processing unit 14 has a function of an AE control unit (automatic exposure control unit), and performs exposure adjustment so that the brightness of the subject image becomes an optimum exposure.
  • the subject image is set to an appropriate brightness by adjusting the aperture and shutter speed provided in the imaging optical system.
  • Some camera units mounted on mobile phone devices or the like do not have a movable diaphragm. With such a configuration, the sensitivity of the image sensor 12 is adjusted by the shutter speed and gain of the electronic shutter in the image sensor 12. Or adjusting the exposure level by adjusting the level of the imaging signal. After the exposure adjustment is completed, the AE control state is fixed and the AE lock is performed.
  • the AF control unit 15 determines the in-focus state based on the imaging signal output from the image processing unit 14 based on the contrast of the obtained captured image, and the lens driving unit 13 is adjusted so that the blur of the captured image is minimized. A control signal for controlling is output. After the focus adjustment is completed, the AF control state is fixed and AF lock is performed.
  • the image processing unit 14 and the AF control unit 15 realize each function by performing processing based on a predetermined program by a processor such as a DSP or a microcomputer.
  • the CPU 16 has a control function for the entire imaging apparatus, and operates based on a predetermined program to control each unit.
  • the CPU 16 has a control function for AF / AE lock and unlock operation as a characteristic feature of the present embodiment. That is, the CPU 16 realizes the functions of the subject state detection unit and the function control unit.
  • the function of the subject state detection unit may be realized in the image processing unit 14 or the like.
  • the memory 17 stores a control program for each unit, captured image data, and the like.
  • AF / AE lock under the control of the CPU 16, after AF / AE lock is performed by AF / AE operation, a change in the state of the subject is determined from the captured image according to a predetermined condition, and the AF / AE lock is automatically released.
  • the predetermined conditions for releasing the AF / AE lock include (1) face area position change by face detection, (2) subject motion detection, (3) exposure condition (image brightness) change, and the like.
  • processing such as determination of unlocking conditions and unlocking instructions may be performed by the image processing unit 14 instead of by the CPU 16.
  • the AF / AE lock can be released without requiring a special operation.
  • the AF control unit 15 When the AF / AE lock is released, the AF control unit 15 returns the lens 11 to the initial position by a control signal to the lens driving unit 13 and enables AF control again. Note that AF control may be performed immediately on the subject in the AF area in the current subject image without returning to the initial position after the AF / AE lock is released.
  • the AE control function by the image processing unit 14 is returned to the AE operation that follows the brightness of the current subject image.
  • FIG. 3 is a diagram for explaining AF / AE lock and unlock operations of the imaging apparatus according to the first embodiment.
  • FIG. 3A and 3B show examples of a preview screen that displays a subject image before photographing.
  • FIG. 3A shows the AF / AE lock state for the face area.
  • the image processing unit 14 detects a human face area in a subject image using a known face detection technique, and uses the detected face area 32 as an AF area.
  • the AF control unit 15 performs AF control on the face area 32 to set the AF lock state.
  • the image processing unit 14 performs AE control on the face area 32 and sets the AE lock state.
  • FIG. 3B shows the AF / AE lock release state.
  • the CPU 16 acquires the coordinates of the detected face area 32 and detects the position of the face area.
  • the position of the face area changes by a predetermined amount or more, that is, when the subject including the face area moves by a predetermined amount or more, Release AF / AE lock.
  • the lock state such as AF lock or AE lock is indicated by the color of the object in the screen such as the frame of the AF area, and is notified to the user. It is also possible. For example, as a user interface (notification means) indicating a locked state, the AF frame is displayed in green in the locked state, and the AF frame color is displayed in achromatic color (white, black, gray, etc.) in the unlocked state. change. Further, when the AF operation fails, the AF frame may be displayed in red. By providing such notification means, the user can easily identify the locked state / unlocked state of AF or AE.
  • FIG. 4 is a flowchart showing a procedure of AF / AE locking and unlocking operations of the imaging apparatus according to the first embodiment.
  • face detection is performed in the image processing unit 14 (step S11), and AF / AE control is performed on the detected face area by the image processing unit 14 and the AF control unit 15, and the AF / AE lock state is set after the control is completed. (Step S12).
  • the CPU 16 detects the coordinates of the face area and acquires the coordinates (X, Y) of the subject including the face area (step S13).
  • the CPU 16 determines whether or not the coordinates of the subject including the face area have changed by a predetermined amount or more (step S14).
  • the detection of the face area and the determination of the position change are performed constantly or periodically at predetermined time intervals.
  • the AF / AE lock is automatically released (step S15).
  • FIG. 5 is a diagram for explaining AF / AE lock and lock release operations of the imaging apparatus according to the second embodiment.
  • FIGS. 5A and 5B show examples of a preview screen that displays a subject image before photographing.
  • FIG. 5A shows the AF / AE lock state for the subject.
  • the image processing unit 14 and the AF control unit 15 perform AF / AE control on the AF area such as the center of the image to set the AF / AE locked state.
  • the CPU 16 uses the AF area as the correlation determination area 33 to detect the movement of the subject.
  • FIG. 5B shows the AF / AE lock release state.
  • the CPU 16 determines the correlation value of the image in the correlation determination area 33, and when the correlation value exceeds a predetermined threshold, that is, the correlation value has changed by a predetermined amount or more due to the movement of the subject that has previously performed the AF / AE operation. In this case, the AF / AE lock is released.
  • FIG. 6 is a flowchart showing a procedure of AF / AE locking and unlocking operations of the imaging apparatus according to the second embodiment.
  • the AF / AE control is performed on the AF area by the image processing unit 14 and the AF control unit 15, and the AF / AE lock state is set after the control is completed (step S21).
  • the CPU 16 sets the AF area as a correlation determination area (step S22).
  • the CPU 16 continues to compare the image of the correlation determination area with the image at the time of AF / AE lock, and determines whether or not the correlation value of the correlation determination area has changed by a predetermined amount or more (step S23).
  • the correlation value is calculated based on a difference between pixel values in the correlation determination area.
  • the determination of the correlation value is performed constantly or periodically every predetermined time.
  • the correlation value of the correlation determination area exceeds a predetermined threshold, it is determined that the subject has moved due to a change in the image content of the correlation determination area, and the AF / AE lock is automatically released (step S24).
  • the AF / AE lock is automatically released.
  • FIG. 7 is a diagram showing a case where an unintended subject crosses on the preview screen displaying the subject image
  • FIG. 8 is a diagram showing an example of a correlation value change in the AF / AE lock releasing operation.
  • the state of the target subject has changed if it is an instantaneous change within a predetermined time even if it is greater than or equal to a predetermined amount.
  • the AF / AE lock state is maintained by ignoring it as if it were not present.
  • the correlation value change 52 is a predetermined amount or more and is a continuous change, it is determined that the state of the subject has changed after a predetermined time td has elapsed. Release AF / AE lock.
  • the correlation value change 52 is a predetermined amount or more and is a continuous change
  • FIG. 9 is a diagram for explaining AF / AE lock and unlock operations of the imaging apparatus according to the third embodiment.
  • FIGS. 9A and 9B show examples of a preview screen that displays a subject image before photographing.
  • FIG. 9A shows the AF / AE lock state for the subject.
  • the image processing unit 14 and the AF control unit 15 perform AF / AE control on the AF area such as the center of the image to set the AF / AE locked state.
  • the CPU 16 detects a change in the brightness of the subject image as a change in the subject exposure condition.
  • FIG. 9B shows the AF / AE lock release state.
  • the CPU 16 calculates the average brightness of the subject image to detect the brightness of the image, and releases the AF / AE lock when the brightness of the subject image changes by a predetermined value or more. If the brightness of the subject image changes from when AF / AE is locked, and overexposure or underexposure occurs, the exposure conditions change compared to the previous AF / AE operation, and the subject Since it is considered that the camera has moved or the direction of the camera has changed and the state of the subject has changed, the AF / AE lock is released.
  • FIG. 10 is a flowchart showing a procedure of AF / AE locking and unlocking operations of the imaging apparatus according to the third embodiment.
  • the AF / AE control is performed on the AF area by the image processing unit 14 and the AF control unit 15, and the AF / AE lock state is set after the control is completed (step S31).
  • the CPU 16 detects the brightness of the subject image (step S32).
  • the CPU 16 determines whether or not the brightness of the subject image has changed by a predetermined amount or more (step S33).
  • the brightness of the subject image is calculated based on the average luminance or the like. This determination of brightness is always performed or periodically at predetermined time intervals. If the brightness of the subject image changes by a predetermined amount or more and a change in exposure condition is detected, the AF / AE lock is automatically released (step S34). By determining the change in the exposure condition after the AF / AE lock is thus performed, it is possible to determine that the state of the subject has changed, and to automatically release the AF / AE lock.
  • the unlocking function described in the above embodiment can be applied not only to AF control and AE control, but also to white balance control.
  • the image processing unit 14 or the like has a function of a white balance control unit.
  • the white balance control the image processing unit 14 estimates the color temperature of the light source in the captured image based on the R, G, and B color signals output from the image sensor 12, and captures the image based on the color temperature information. By applying appropriate gains to the R, G, and B color signals from the element 12, the white balance of the captured image is adjusted.
  • the image processing unit 14 releases the white balance lock when the state of the subject changes to satisfy a predetermined unlock condition. Then, the white balance can be adjusted again according to the current subject image.
  • the white balance lock can be automatically released when the state of the subject changes.
  • FIG. 11 is a block diagram illustrating a configuration of a mobile phone device including an imaging device according to the fourth embodiment.
  • the mobile phone device includes a wireless unit 121, a control unit 122, an audio processing unit 123, an antenna 101, an input unit 102, a speaker 103, and a microphone 104.
  • the main display unit 105, the sub display unit 106, the notification LED 107, the display driver 128, the data memory 124, the program memory 125, the sound source unit 126, the amplifier 127, and the speaker 109 are provided, and data communication, content reproduction, mail transmission / reception, etc.
  • the function of the portable information terminal is realized.
  • the imaging apparatus includes an image processing unit 129, an imaging element 130, an imaging lens 132, an AF / AE control unit 131, and a flash LED 108.
  • the wireless unit 121 performs processing related to transmission / reception of wireless communication, and performs modulation / demodulation of a signal transmitted / received by the antenna 101.
  • the control unit 122 controls each unit, and includes a communication data processing unit 151, a system memory 152, and a CPU 153.
  • the communication data processing unit 151 performs communication data processing such as encoding / decoding of signals transmitted / received by the wireless unit 121.
  • the system memory 152 stores a basic system program such as an OS.
  • the CPU 153 operates according to a program stored in the system memory 152 and executes operation control of each part of the apparatus.
  • the input unit 102 includes various input devices for operation such as a key switch such as a numeric keypad, a push button switch such as a camera key, a shutter key, and an AF lock key, and inputs an operation instruction from a user.
  • the voice processing unit 123 performs input / output processing of voice signals processed by the communication data processing unit 151, and performs input / output of call voice and the like between the speaker 103 and the microphone 104.
  • the data memory 124 stores various data generated or acquired by the apparatus, such as content data such as address book data, mail data, and image data.
  • the program memory 125 stores various application programs executed in this apparatus, and stores a camera application, an image processing application, and the like.
  • the sound source unit 126 stores and outputs sound signal waveforms such as notification sounds and operation sounds of the apparatus, and a sound signal output from the sound source unit 126 is amplified by the amplifier 127 and reproduced and output from the speaker 109.
  • the display driver 128 drives the main display unit 105, the sub display unit 106, the notification LED 107, and the flash LED 108, and performs display control of each display unit and LED.
  • the image sensor 130 is composed of a CCD, a CMOS sensor, etc., and photoelectrically converts the subject image formed by the imaging lens 132 and outputs an electrical signal of the captured image.
  • the image processing unit 129 is configured by a DSP or the like, and executes various image signal processes in the imaging apparatus such as white balance adjustment, ⁇ correction, color correction, contour enhancement, data compression / decompression, and the image data is output as captured image output. Output to the memory 124.
  • the AF / AE control unit 131 performs AF control and AE control according to the contrast and brightness of the captured image based on the output of the image processing unit 129.
  • a control signal is output to a lens driving unit (not shown), and focus adjustment is performed by moving the imaging lens 132 in the optical axis direction.
  • a control signal is output to the image sensor 130 and the image processing unit 129, and the sensitivity and the like are adjusted by the shutter speed and gain of the image sensor 12, and the level of the image signal is adjusted by the image processing unit 129. Adjust the exposure.
  • the image processing unit 129 may have an AE control function.
  • a change in the state of the subject in the captured image is detected by the control unit 122 in the same manner as in the first to third embodiments, and AF lock, AE Control lock states such as lock and white balance lock can be automatically released. At this time, the control lock state can be released without requiring a special operation from the input unit 102.
  • a change in the state of the subject is detected based on a change in the position of the face area, a movement of the subject, a change in the exposure condition, and the like.
  • the lock can be released automatically. This eliminates the need for a user's special operation, and the control lock state can be released when the subject state changes, so that AF control and AE control following the new subject state can be quickly executed. At this time, blurring, overexposure, underexposure, etc. when the subject state changes can be eliminated, operability related to the unlocking of the control can be improved, and the time until the next shooting can be shortened.
  • the present invention can automatically release AF lock or the like without requiring a special operation, and has an effect of improving operability, and has an auto focus (AF) function and automatic exposure adjustment (AE). It is useful as an imaging device having a function, a portable terminal, a camera control method, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Optics & Photonics (AREA)
  • Studio Devices (AREA)
  • Focusing (AREA)
  • Automatic Focus Adjustment (AREA)
  • Exposure Control For Cameras (AREA)

Abstract

An AF lock or the like can be automatically released to improve the operability without requiring any special operation. If the user operates an AF button in the state in which a subject (A) is focused on an AF region (31) in the center of the screen, an AF/AE action is executed to the subject (A) in the AF region (31) to bring the subject (A) into an AF/AE locked state in response to the operation input. If the user changes an object to be imaged from the subject (A) to a subject (B) and positions the subject (B) in the center of the screen, a change in the state of the subject is determined under a predetermined condition to automatically release the AF/AE lock from the AF/AE locked state. A positional change in a face region, the movement of a subject, a change in an exposure condition of a subject image, or the like is used as the predetermined condition.

Description

撮像装置、携帯端末及びカメラ制御方法Imaging apparatus, portable terminal, and camera control method
　本発明は、オートフォーカス（以下、ＡＦ）機能や自動露出調整（以下、ＡＥ）機能、自動ホワイトバランス（以下、ＡＷＢ）機能を持つ撮像装置、携帯端末及びカメラ制御方法に関する。 The present invention relates to an imaging device, a portable terminal, and a camera control method having an autofocus (hereinafter referred to as AF) function, an automatic exposure adjustment (hereinafter referred to as AE) function, and an automatic white balance (hereinafter referred to as AWB) function.
　カメラ等の静止画を撮像する撮像装置においてＡＦ機能を動作させた場合、被写体に対して最適なフォーカス調整が行われた後、ＡＦ完了状態を保持するＡＦロック動作が行われる。また、この種の撮像装置では、ＡＦ機能と合わせてＡＥ機能も動作し、被写体画像の明るさが最適な露出となるよう絞りやシャッタスピードの調整によって露光調整が行われた後、ＡＥ完了状態を保持するＡＥロック動作が行われる。また、ＡＷＢ機能も動作し被写体画像のホワイトバランス（以下、ＷＢ）が最適になるように動作しＷＢ状態を保持するＷＢロック動作を行なう場合もある。また、以降では、これらのＡＦロックとＡＥロックを合わせて行うことをＡＦ／ＡＥロックと称することにする。 When an AF function is operated in an imaging apparatus that captures a still image such as a camera, an AF lock operation for holding an AF completion state is performed after optimal focus adjustment is performed on the subject. Further, in this type of imaging apparatus, the AE function is also operated together with the AF function, and after the exposure adjustment is performed by adjusting the aperture and the shutter speed so that the brightness of the subject image becomes the optimum exposure, the AE completion state The AE lock operation for holding is performed. In some cases, the AWB function is also operated to perform the WB lock operation for maintaining the white balance (hereinafter referred to as WB) of the subject image and maintaining the WB state. In the following, performing these AF lock and AE lock together will be referred to as AF / AE lock.
　一般のフィルムカメラやデジタルスチルカメラでは、ユーザが撮像する際にシャッタボタンを半押しするとＡＦ機能が動作し、ＡＦ／ＡＥロックを行う場合はシャッタボタンの半押し状態でＡＦ／ＡＥロックとなって保持される。 In general film cameras and digital still cameras, the AF function operates when the user presses the shutter button halfway when taking an image, and when performing AF / AE lock, AF / AE lock is obtained when the shutter button is pressed halfway. Retained.
　図１２は撮像装置におけるＡＦ／ＡＥロックの動作を説明する図である。図１２（ａ）～（ｃ）は撮影前の被写体画像を表示するプレビュー画面の例を示すものである。図１２（ａ）は被写体Ａに対するＡＦ／ＡＥロック状態を示している。ここでは、プレビュー画面に被写体Ａと被写体Ｂとが存在しているものとし、被写体Ａを画面中央のＡＦ領域に合わせた状態でユーザがシャッタボタンを半押しすることで、被写体Ａに対してＡＦ／ＡＥ動作が実行され、ＡＦ／ＡＥロック状態となる。 FIG. 12 is a diagram for explaining the operation of AF / AE lock in the imaging apparatus. FIGS. 12A to 12C show examples of a preview screen that displays a subject image before photographing. FIG. 12A shows an AF / AE locked state for the subject A. FIG. Here, it is assumed that subject A and subject B exist on the preview screen, and the user presses the shutter button halfway while the subject A is aligned with the AF area at the center of the screen, so that AF is performed on subject A. The / AE operation is executed and the AF / AE lock state is entered.
　図１２（ｂ）はＡＦ／ＡＥロックを保持したまま被写体Ｂに変更した状態を示している。図１２（ａ）のＡＦ／ＡＥロックを保持した状態から、図１２（ｂ）のように撮像対象を被写体Ａから被写体Ｂに変更し、被写体Ｂを画面中央に位置させた場合、被写体Ｂにはフォーカスが合っておらず、また露出も合っていないので画面が暗い状態（露出アンダー）または明るい状態（露出オーバー）になる。図１２（ｃ）は被写体Ｂに対するＡＦ／ＡＥロック状態を示している。図１２（ｂ）のフォーカス及び露出が外れた状態から、ユーザがシャッタボタンの半押しを解除すると、ＡＦ／ＡＥロックが解除される。そして、再度ユーザがシャッタボタンを半押しすることで、ＡＦ領域にある被写体Ｂに対してＡＦ／ＡＥ動作が実行され、ＡＦ／ＡＥロック状態となる。 FIG. 12B shows a state in which the subject is changed to the subject B while holding the AF / AE lock. When the imaging target is changed from subject A to subject B as shown in FIG. 12B from the state where the AF / AE lock shown in FIG. 12A is held, subject B is positioned at the center of the screen. The screen is dark (underexposed) or bright (overexposed) because it is out of focus and not well exposed. FIG. 12C shows an AF / AE locked state for the subject B. When the user releases half-press of the shutter button from the state where the focus and exposure are out of FIG. 12B, the AF / AE lock is released. Then, when the user again presses the shutter button halfway, the AF / AE operation is performed on the subject B in the AF area, and the AF / AE lock state is set.
　なお、ＡＦロックの解除機能を有するカメラとしては、特許文献１、特許文献２等に開示されているものが知られている。
特開昭６２－２０９４２２号公報 特許第２５５７２１１号明細書 As cameras having an AF lock releasing function, those disclosed in Patent Document 1, Patent Document 2, and the like are known.
JP-A-62-209422 Japanese Patent No. 2557211
　上述したように、一旦ＡＦ／ＡＥロックをかけた後にこれを解除するには、通常、ユーザの操作が必要である。シャッタボタンの半押しによってＡＦ機能の実行及びロックをする一般のカメラでは、シャッタボタンの半押し解除によってＡＦ／ＡＥロックが解除される。また、携帯電話装置等に搭載されるカメラユニットでは、シャッタボタンの半押しによるＡＦロック機能は設けられていない場合もあり、別途設けたＡＦ操作用のボタンを操作することにより、ＡＦロックやＡＦロック解除が行われる。このようなカメラユニットの場合、ＡＥロックを解除するために、ＡＥロック解除ボタンの操作が必要である。 As described above, it is usually necessary for the user to operate the AF / AE lock after releasing it once. In a general camera that executes and locks the AF function by half-pressing the shutter button, the AF / AE lock is released by releasing the shutter button half-press. In addition, camera units mounted on mobile phone devices or the like may not have an AF lock function by half-pressing the shutter button. By operating a separately provided AF operation button, AF lock or AF Unlocking is performed. In the case of such a camera unit, it is necessary to operate the AE lock release button in order to release the AE lock.
　したがって、従来の撮像装置では、ＡＥロック解除を行うためにユーザによる操作が必要であり、特にシャッタボタンの半押しによるＡＦロック機能が無い携帯電話装置等のカメラでは、別途設けられたＡＥロック解除ボタンの操作が必要であるため、操作が煩雑であった。このため、急いで撮像する場合などに操作性があまり良くなかったり、所望の被写体を撮像するまでに時間がかかるなどの課題があった。 Therefore, in the conventional imaging apparatus, an operation by the user is required to release the AE lock. In particular, in a camera such as a mobile phone device that does not have an AF lock function by half-pressing the shutter button, a separately provided AE lock release is required. Since the operation of the button is necessary, the operation is complicated. For this reason, there are problems such as poor operability when taking a picture in a hurry, and taking a long time to take a desired subject.
　本発明は、上記事情に鑑みてなされたもので、特別の操作を必要とせずにＡＦロックなどを自動解除することができ、操作性を向上させることが可能な撮像装置、携帯端末及びカメラ制御方法を提供することを目的とする。 The present invention has been made in view of the above circumstances, and is capable of automatically releasing an AF lock or the like without requiring a special operation, and can improve the operability. It aims to provide a method.
　本発明の撮像装置は、被写体に対して自動的に焦点を合わせるオートフォーカス制御部と、前記被写体の状態を検出する被写体状態検出部と、前記オートフォーカス制御部により焦点を固定した後に、前記被写体状態検出部の検出結果により被写体の状態の変化を検出した場合、前記固定状態を解除する機能制御部と、を備えるものである。
　これにより、オートフォーカス制御部により焦点を固定した後に被写体の状態が変化した場合、焦点の固定を自動的に解除することが可能となり、特別の操作を必要とせずにＡＦロック解除できるため、操作性を向上できる。また、現在の被写体の状態にＡＦ制御を素早く追従させ、次の撮影までの時間を短縮することが可能となる。 The imaging apparatus according to the present invention includes an autofocus control unit that automatically focuses on a subject, a subject state detection unit that detects the state of the subject, and the subject after the focus is fixed by the autofocus control unit. And a function control unit that releases the fixed state when a change in the state of the subject is detected based on the detection result of the state detection unit.
As a result, if the subject's state changes after the focus is fixed by the autofocus control unit, it becomes possible to automatically cancel the focus fixing, and the AF lock can be released without requiring any special operation. Can be improved. Also, the AF control can be quickly followed to the current state of the subject, and the time until the next shooting can be shortened.
　また、本発明は、上記の撮像装置であって、被写体に対して自動的に露出を調整する自動露出制御部を備え、前記機能制御部は、前記自動露出制御部により露出を固定した後に、前記被写体状態検出部の検出結果により被写体の状態の変化を検出した場合、前記固定状態を解除するものを含む。
　これにより、自動露出制御部により露出を固定した後に被写体の状態が変化した場合、露出の固定を自動的に解除することが可能となり、特別の操作を必要とせずにＡＥロック解除できるため、操作性を向上できる。また、現在の被写体の状態にＡＥ制御を素早く追従させ、次の撮影までの時間を短縮することが可能となる。 Further, the present invention is the above-described imaging device, comprising an automatic exposure control unit that automatically adjusts exposure to a subject, and the function control unit fixes the exposure by the automatic exposure control unit, When the change in the state of the subject is detected based on the detection result of the subject state detection unit, the fixed state is released.
As a result, when the state of the subject changes after the exposure is fixed by the automatic exposure control unit, the exposure can be automatically released and the AE lock can be released without any special operation. Can be improved. In addition, the AE control can be quickly followed to the current state of the subject, and the time until the next shooting can be shortened.
　また、本発明は、上記の撮像装置であって、被写体画像のホワイトバランスを調整するホワイトバランス制御部を備え、前記機能制御部は、前記ホワイトバランス制御部によりホワイトバランスを固定した後に、前記被写体状態検出部の検出結果により被写体の状態の変化を検出した場合、前記固定状態を解除するものを含む。
　これにより、ホワイトバランス制御部によりホワイトバランスを固定した後に被写体の状態が変化した場合、ホワイトバランスの固定を自動的に解除することが可能となり、特別の操作を必要とせずにホワイトバランスロック解除できるため、操作性を向上できる。また、現在の被写体の状態にホワイトバランス制御を素早く追従させ、次の撮影までの時間を短縮することが可能となる。 Further, the present invention is the above-described imaging apparatus, further comprising a white balance control unit that adjusts a white balance of a subject image, wherein the function control unit fixes the white balance after the white balance control unit fixes the subject. When the change in the state of the subject is detected based on the detection result of the state detection unit, the state in which the fixed state is released is included.
As a result, when the state of the subject changes after the white balance is fixed by the white balance control unit, the white balance can be automatically released and the white balance lock can be released without requiring any special operation. Therefore, operability can be improved. In addition, the white balance control can be quickly followed to the current state of the subject, and the time until the next shooting can be shortened.
　また、本発明は、上記いずれかの撮像装置であって、前記被写体状態検出部は、被写体画像中の顔検出を行って顔領域の位置を取得するもので、前記機能制御部は、前記顔領域の位置が所定量以上変化した場合に、前記固定状態を解除するものを含む。
　これにより、被写体画像中の顔領域の位置が所定量以上変化した場合に、焦点等の固定状態を解除することで、特別の操作を必要とせずにロック状態を自動解除でき、操作性を向上できる。また、現在の被写体の状態にＡＦ制御等を追従させ、次の撮影までの時間を短縮することが可能となる。 Further, the present invention is the above imaging device, wherein the subject state detection unit detects a face in a subject image and acquires a position of a face region, and the function control unit includes the face This includes a case where the fixed state is released when the position of the region changes by a predetermined amount or more.
As a result, when the position of the face area in the subject image changes by a predetermined amount or more, the locked state can be automatically released without requiring a special operation by releasing the fixed state such as the focus, improving operability. it can. In addition, AF control or the like can be made to follow the current state of the subject, and the time until the next shooting can be shortened.
　また、本発明は、上記いずれかの撮像装置であって、前記被写体状態検出部は、被写体の動きを検出するもので、前記機能制御部は、前記被写体の動きを所定量以上検出した場合に、前記固定状態を解除するものを含む。
　これにより、被写体の動きを所定量以上検出した場合に、焦点等の固定状態を解除することで、特別の操作を必要とせずにロック状態を自動解除でき、操作性を向上できる。また、現在の被写体の状態にＡＦ制御等を追従させ、次の撮影までの時間を短縮することが可能となる。 Further, the present invention is any one of the above imaging devices, wherein the subject state detection unit detects a movement of the subject, and the function control unit detects the movement of the subject more than a predetermined amount. And those that release the fixed state.
Accordingly, when the movement of the subject is detected by a predetermined amount or more, the locked state can be automatically released without requiring a special operation by releasing the fixed state such as the focus, and the operability can be improved. In addition, AF control or the like can be made to follow the current state of the subject, and the time until the next shooting can be shortened.
　また、本発明は、上記いずれかの撮像装置であって、前記被写体状態検出部は、被写体画像の露出条件を検出するもので、前記機能制御部は、前記被写体画像の露出条件が所定量以上変化した場合に、前記固定状態を解除するものを含む。
　これにより、被写体画像の露出条件が所定量以上変化した場合に、露出等の固定状態を解除することで、特別の操作を必要とせずにロック状態を自動解除でき、操作性を向上できる。また、現在の被写体の状態にＡＥ制御等を追従させ、次の撮影までの時間を短縮することが可能となる。 Further, the present invention is the imaging apparatus according to any one of the above, wherein the subject state detection unit detects an exposure condition of the subject image, and the function control unit determines that the exposure condition of the subject image is a predetermined amount or more. When it changes, the thing which cancels | releases the said fixed state is included.
Thus, when the exposure condition of the subject image changes by a predetermined amount or more, the locked state can be automatically released without requiring a special operation by releasing the fixed state such as exposure, and the operability can be improved. It is also possible to shorten the time until the next shooting by making the AE control or the like follow the current state of the subject.
　また、本発明は、上記の撮像装置であって、前記固定状態または前記固定状態の解除をユーザに通知する通知手段を備えるものを含む。
　これにより、ＡＦ制御等の固定状態／固定解除状態をユーザが容易に認識できるようになり、さらに操作性や使い勝手を向上できる。 In addition, the present invention includes the above-described imaging device including a notification unit that notifies the user of the fixed state or the release of the fixed state.
Thereby, the user can easily recognize the fixed state / fixed state of AF control or the like, and the operability and usability can be further improved.
　また、本発明は、上記いずれかの撮像装置を備える携帯端末を提供する。 Also, the present invention provides a mobile terminal including any one of the above imaging devices.
　また、本発明は、被写体に対して自動的に焦点を合わせるオートフォーカス制御ステップと、前記被写体の状態を検出する被写体状態検出ステップと、前記オートフォーカス制御により焦点を固定した後に、前記被写体状態の検出結果により被写体の状態の変化を検出した場合、前記固定状態を解除する機能制御ステップと、を有するカメラ制御方法を提供する。 Further, the present invention provides an autofocus control step of automatically focusing on a subject, a subject state detection step of detecting the state of the subject, and after fixing the focus by the autofocus control, And a function control step for releasing the fixed state when a change in the state of the subject is detected based on the detection result.
　本発明によれば、特別の操作を必要とせずにＡＦロックなどを自動解除することができ、操作性を向上させることが可能な撮像装置、携帯端末及びカメラ制御方法を提供できる。 According to the present invention, it is possible to provide an imaging device, a portable terminal, and a camera control method that can automatically release AF lock or the like without requiring a special operation and can improve operability.
本発明の実施形態に係る撮像装置のＡＦ／ＡＥロック及びロック解除動作を説明する図6A and 6B illustrate AF / AE lock and unlock operations of the imaging apparatus according to the embodiment of the present invention. 本発明の実施形態に係る撮像装置の概略構成を示すブロック図1 is a block diagram showing a schematic configuration of an imaging apparatus according to an embodiment of the present invention. 第１の実施形態における撮像装置のＡＦ／ＡＥロック及びロック解除動作を説明する図6A and 6B illustrate AF / AE lock and unlock operations of the imaging apparatus according to the first embodiment. 第１の実施形態における撮像装置のＡＦ／ＡＥロック及びロック解除動作の手順を示すフローチャート6 is a flowchart illustrating a procedure of AF / AE lock and unlock operations of the imaging apparatus according to the first embodiment. 第２の実施形態における撮像装置のＡＦ／ＡＥロック及びロック解除動作を説明する図6A and 6B are diagrams for explaining AF / AE lock and unlock operations of the imaging apparatus according to the second embodiment. 第２の実施形態における撮像装置のＡＦ／ＡＥロック及びロック解除動作の手順を示すフローチャート8 is a flowchart illustrating a procedure of AF / AE lock and unlock operations of the imaging apparatus according to the second embodiment. 被写体画像を表示するプレビュー画面において意図しない被写体が横切った場合を示す図The figure which shows the case where the unintended subject crosses in the preview screen which displays a subject image ＡＦ／ＡＥロック解除動作における相関値の変化例を示す図The figure which shows the example of a change of the correlation value in AF / AE lock cancellation | release operation | movement 第３の実施形態における撮像装置のＡＦ／ＡＥロック及びロック解除動作を説明する図6A and 6B illustrate AF / AE lock and unlock operations of the imaging apparatus according to the third embodiment. 第３の実施形態における撮像装置のＡＦ／ＡＥロック及びロック解除動作の手順を示すフローチャート8 is a flowchart illustrating a procedure of AF / AE lock and unlock operations of the imaging apparatus according to the third embodiment. 第４の実施形態に係る撮像装置を含む携帯電話装置の構成を示すブロック図The block diagram which shows the structure of the mobile telephone apparatus containing the imaging device which concerns on 4th Embodiment. 撮像装置におけるＡＦ／ＡＥロックの動作を説明する図6A and 6B illustrate an AF / AE lock operation in the imaging apparatus.
符号の説明Explanation of symbols
　１１　レンズ
　１２　撮像素子
　１３　レンズ駆動部
　１４　画像処理部
　１５　ＡＦ制御部
　１６　ＣＰＵ
　１７　メモリ
　１０１　アンテナ
　１０２　入力部
　１０３　スピーカ
　１０４　マイク
　１０５　メイン表示部
　１０６　サブ表示部
　１０７　報知用ＬＥＤ
　１０８　フラッシュ用ＬＥＤ
　１０９　スピーカ
　１２１　無線部
　１２２　制御部
　１２３　音声処理部
　１２４　データメモリ
　１２５　プログラムメモリ
　１２６　音源部
　１２７　アンプ
　１２８　表示ドライバ
　１２９　画像処理部
　１３０　撮像素子
　１３１　ＡＦ／ＡＥ制御部
　１３２　撮像レンズ
　１５１　通信データ処理部
　１５２　システムメモリ
　１５３　ＣＰＵ DESCRIPTION OF SYMBOLS 11 Lens 12 Image pick-up element 13 Lens drive part 14 Image processing part 15 AF control part 16 CPU
17 Memory 101 Antenna 102 Input Unit 103 Speaker 104 Microphone 105 Main Display Unit 106 Sub Display Unit 107 Notification LED
108 Flash LED
DESCRIPTION OF SYMBOLS 109 Speaker 121 Radio | wireless part 122 Control part 123 Audio | voice process part 124 Data memory 125 Program memory 126 Sound source part 127 Amplifier 128 Display driver 129 Image processing part 130 Image pick-up element 131 AF / AE control part 132 Imaging lens 151 Communication data processing part 152 System memory 153 CPU
　まず、本発明の実施形態に係る撮像装置の動作の概要を説明する。図１は本発明の実施形態に係る撮像装置のＡＦ／ＡＥロック及びロック解除動作を説明する図である。 First, an outline of the operation of the imaging apparatus according to the embodiment of the present invention will be described. FIG. 1 is a diagram for explaining AF / AE locking and unlocking operations of an imaging apparatus according to an embodiment of the present invention.
　図１（ａ）、（ｂ）は撮影前の被写体画像を表示するプレビュー画面の例を示すものである。図１（ａ）は被写体Ａに対するＡＦ／ＡＥロック状態を示している。ここでは、プレビュー画面に被写体Ａと被写体Ｂとが存在しているものとし、被写体Ａを画面中央のＡＦ領域３１に合わせた状態でユーザがＡＦボタンを操作すると、この操作入力を受けて、ＡＦ領域３１内にある被写体Ａに対してＡＦ／ＡＥ動作（オートフォーカス（自動焦点調整）及び自動露出調整動作）を実行し、ＡＦ／ＡＥロック状態とする。 1A and 1B show examples of a preview screen that displays a subject image before photographing. FIG. 1A shows an AF / AE lock state with respect to the subject A. Here, it is assumed that subject A and subject B exist on the preview screen, and when the user operates the AF button while subject A is aligned with the AF area 31 at the center of the screen, this operation input is received and AF An AF / AE operation (autofocus (automatic focus adjustment) and automatic exposure adjustment operation) is performed on the subject A in the area 31 to set the AF / AE lock state.
　図１（ｂ）は撮像対象を被写体Ａから被写体Ｂに変更した状態を示している。図１（ａ）のＡＦ／ＡＥロック状態から、図１（ｂ）のように撮像対象を被写体Ａから被写体Ｂに変更し、ユーザが被写体Ｂを画面中央に位置させた場合、所定条件によって被写体の状態の変化を判定し、ＡＦ／ＡＥロックを自動的に解除する。前記被写体の状態の変化を判定する所定条件としては、ＡＦ領域３１内の画像の変化（顔領域の位置変化）、ＡＦロックしたＡＦ領域３１の被写体の動き、被写体画像の露出条件の変化などを用いる。このようにＡＦ／ＡＥロックを解除することで、特別な操作を行うことなく、新たな被写体に対するＡＦ／ＡＥ動作が可能になる。 FIG. 1B shows a state in which the imaging target is changed from the subject A to the subject B. When the imaging target is changed from the subject A to the subject B as shown in FIG. 1B from the AF / AE locked state in FIG. 1A, and the user positions the subject B in the center of the screen, the subject is subject to predetermined conditions. A change in the state is determined, and the AF / AE lock is automatically released. Predetermined conditions for determining the change in the state of the subject include a change in the image in the AF area 31 (a change in the position of the face area), a movement of the subject in the AF area 31 locked in AF, a change in the exposure condition of the subject image, and the like. Use. By releasing the AF / AE lock in this way, an AF / AE operation for a new subject can be performed without performing a special operation.
　図２は本発明の実施形態に係る撮像装置の概略構成を示すブロック図である。本実施形態の撮像装置は、カメラユニットして、レンズ１１、撮像素子１２、レンズ駆動部１３、画像処理部１４、ＡＦ制御部（オートフォーカス制御部）１５を備えている。撮像素子１２は、ＣＣＤ、ＣＭＯＳ型センサ等により構成され、レンズ１１によって結像された被写体像を光電変換して撮像画像の電気信号を出力する。レンズ駆動部１３は、ボイスコイルモータ等により構成され、ＡＦ制御部１５からの制御信号に基づき、レンズ１１を光軸方向に駆動してフォーカス調整を行う。 FIG. 2 is a block diagram showing a schematic configuration of the imaging apparatus according to the embodiment of the present invention. The imaging apparatus of the present embodiment includes a lens 11, an imaging element 12, a lens driving unit 13, an image processing unit 14, and an AF control unit (autofocus control unit) 15 as a camera unit. The image sensor 12 is composed of a CCD, a CMOS type sensor, etc., and photoelectrically converts the subject image formed by the lens 11 and outputs an electrical signal of the captured image. The lens driving unit 13 includes a voice coil motor or the like, and performs focus adjustment by driving the lens 11 in the optical axis direction based on a control signal from the AF control unit 15.
　画像処理部１４は、撮像素子１２の出力信号の各種処理を行い、被写体を撮像した撮像信号を生成して出力する。この画像処理部１４は、ＡＥ制御部（自動露出制御部）の機能を有しており、被写体画像の明るさが最適な露出となるよう露光調整を行う。ＡＥ制御においては、撮像光学系に設ける絞りやシャッタスピードを調整することで、被写体画像を適切な明るさにする。なお、携帯電話装置等に搭載されるカメラユニットにおいて、可動絞りが設けられないものもあり、このような構成では、撮像素子１２における電子シャッタのシャッタスピードやゲインによって撮像素子１２の感度などを調整したり、撮像信号のレベル調整等を行うことによって露出調整を行う。露出調整完了後は、ＡＥ制御状態を固定してＡＥロックする。 The image processing unit 14 performs various processes on the output signal of the image sensor 12, and generates and outputs an image signal obtained by imaging the subject. The image processing unit 14 has a function of an AE control unit (automatic exposure control unit), and performs exposure adjustment so that the brightness of the subject image becomes an optimum exposure. In the AE control, the subject image is set to an appropriate brightness by adjusting the aperture and shutter speed provided in the imaging optical system. Some camera units mounted on mobile phone devices or the like do not have a movable diaphragm. With such a configuration, the sensitivity of the image sensor 12 is adjusted by the shutter speed and gain of the electronic shutter in the image sensor 12. Or adjusting the exposure level by adjusting the level of the imaging signal. After the exposure adjustment is completed, the AE control state is fixed and the AE lock is performed.
　ＡＦ制御部１５は、画像処理部１４から出力される撮像信号に基づき、得られる撮像画像のコントラストなどによって合焦状態を判断し、撮像画像のボケが最小となるように、レンズ駆動部１３を制御するための制御信号を出力する。フォーカス調整完了後は、ＡＦ制御状態を固定してＡＦロックする。ここで、画像処理部１４及びＡＦ制御部１５は、ＤＳＰやマイコン等のプロセッサにより所定のプログラムに基づいて処理を行うことによって、各機能が実現される。 The AF control unit 15 determines the in-focus state based on the imaging signal output from the image processing unit 14 based on the contrast of the obtained captured image, and the lens driving unit 13 is adjusted so that the blur of the captured image is minimized. A control signal for controlling is output. After the focus adjustment is completed, the AF control state is fixed and AF lock is performed. Here, the image processing unit 14 and the AF control unit 15 realize each function by performing processing based on a predetermined program by a processor such as a DSP or a microcomputer.
　ＣＰＵ１６は、撮像装置全体の制御機能を有しており、所定のプログラムに基づいて動作して各部の制御を行う。このＣＰＵ１６は、本実施形態に特徴的な機能として、ＡＦ／ＡＥロック及びロック解除動作の制御機能を備えている。すなわち、ＣＰＵ１６は、被写体状態検出部及び機能制御部の機能を実現する。なお、画像処理部１４等において被写体状態検出部の機能を実現するようにしてもよい。メモリ１７は、各部の制御プログラム、撮像した画像データ等を格納する。 The CPU 16 has a control function for the entire imaging apparatus, and operates based on a predetermined program to control each unit. The CPU 16 has a control function for AF / AE lock and unlock operation as a characteristic feature of the present embodiment. That is, the CPU 16 realizes the functions of the subject state detection unit and the function control unit. The function of the subject state detection unit may be realized in the image processing unit 14 or the like. The memory 17 stores a control program for each unit, captured image data, and the like.
　本実施形態では、ＣＰＵ１６の制御により、ＡＦ／ＡＥ動作によりＡＦ／ＡＥロックした後、撮像画像から所定条件によって被写体の状態の変化を判定し、ＡＦ／ＡＥロックを自動的に解除する。このＡＦ／ＡＥロック解除の所定条件の具体例としては、（１）顔検出による顔領域の位置変化、（２）被写体の動き検出、（３）露出条件（画像の明るさ）の変化などを用いる。なお、ロック解除条件の判定、ロック解除指示などの処理は、ＣＰＵ１６で行う代わりに、画像処理部１４で行うようにしてもよい。このように所定のロック解除条件によってＡＦ／ＡＥロックを自動解除する機能を備えることで、特別の操作を必要とせずにＡＦ／ＡＥロック解除可能にする。 In the present embodiment, under the control of the CPU 16, after AF / AE lock is performed by AF / AE operation, a change in the state of the subject is determined from the captured image according to a predetermined condition, and the AF / AE lock is automatically released. Specific examples of the predetermined conditions for releasing the AF / AE lock include (1) face area position change by face detection, (2) subject motion detection, (3) exposure condition (image brightness) change, and the like. Use. It should be noted that processing such as determination of unlocking conditions and unlocking instructions may be performed by the image processing unit 14 instead of by the CPU 16. As described above, by providing the function of automatically releasing the AF / AE lock according to a predetermined lock release condition, the AF / AE lock can be released without requiring a special operation.
　ＡＦ／ＡＥロックを解除した場合は、ＡＦ制御部１５はレンズ駆動部１３への制御信号によってレンズ１１を初期位置に復帰させ、再度ＡＦ制御を可能にする。なお、ＡＦ／ＡＥロックの解除後、初期位置に戻さずに直ちに現在の被写体画像内のＡＦ領域にある被写体に対してＡＦ制御を行うようにしてもよい。また、ＡＦ／ＡＥロックを解除した場合、画像処理部１４によるＡＥ制御機能については、現在の被写体画像の明るさに追従するＡＥ動作に復帰させる。 When the AF / AE lock is released, the AF control unit 15 returns the lens 11 to the initial position by a control signal to the lens driving unit 13 and enables AF control again. Note that AF control may be performed immediately on the subject in the AF area in the current subject image without returning to the initial position after the AF / AE lock is released. When the AF / AE lock is released, the AE control function by the image processing unit 14 is returned to the AE operation that follows the brightness of the current subject image.
　（第１の実施形態）
　第１の実施形態では、ロック解除条件の第１例として、顔検出による顔領域の位置変化を用いた場合の動作を説明する。図３は第１の実施形態における撮像装置のＡＦ／ＡＥロック及びロック解除動作を説明する図である。 (First embodiment)
In the first embodiment, as a first example of the unlock condition, an operation in the case of using a change in the position of the face area by face detection will be described. FIG. 3 is a diagram for explaining AF / AE lock and unlock operations of the imaging apparatus according to the first embodiment.
　図３（ａ）、（ｂ）は撮影前の被写体画像を表示するプレビュー画面の例を示すものである。図３（ａ）は顔領域に対するＡＦ／ＡＥロック状態を示している。第１の実施形態の撮像装置は、画像処理部１４において、公知の顔検出技術を用いて被写体画像の中の人物の顔領域を検出し、検出した顔領域３２をＡＦ領域とする。ＡＦ制御部１５は、この顔領域３２に対してＡＦ制御を行い、ＡＦロック状態とする。また、画像処理部１４は顔領域３２に対してＡＥ制御を行い、ＡＥロック状態とする。 3A and 3B show examples of a preview screen that displays a subject image before photographing. FIG. 3A shows the AF / AE lock state for the face area. In the imaging apparatus according to the first embodiment, the image processing unit 14 detects a human face area in a subject image using a known face detection technique, and uses the detected face area 32 as an AF area. The AF control unit 15 performs AF control on the face area 32 to set the AF lock state. In addition, the image processing unit 14 performs AE control on the face area 32 and sets the AE lock state.
　図３（ｂ）はＡＦ／ＡＥロックの解除状態を示している。ここでは、被写体が画面中央から移動してＡＦ／ＡＥロックが解除された様子を示している。ＣＰＵ１６は、検出された顔領域３２の座標を取得して顔領域の位置を検出し、顔領域の位置が所定量以上変化した場合、すなわち顔領域を含む被写体が所定量以上移動した場合に、ＡＦ／ＡＥロックの解除を行う。 FIG. 3B shows the AF / AE lock release state. Here, a state in which the subject has moved from the center of the screen and the AF / AE lock has been released is shown. The CPU 16 acquires the coordinates of the detected face area 32 and detects the position of the face area. When the position of the face area changes by a predetermined amount or more, that is, when the subject including the face area moves by a predetermined amount or more, Release AF / AE lock.
　ここで、撮像装置のモニタやファインダ等に表示する被写体画像のプレビュー画面において、ＡＦロックやＡＥロックなどのロック状態を、ＡＦ領域の枠などの画面内のオブジェクトの色で示してユーザに通知することも可能である。例えば、ロック状態を示すユーザインタフェース（通知手段）として、ロック状態の場合にＡＦ枠を緑で表示し、ロック解除状態の場合にＡＦ枠の色を無彩色（白、黒、グレーなど）に表示変更する。また、ＡＦ動作が失敗した場合にＡＦ枠を赤で表示するようにしてもよい。このような通知手段を設けることにより、ＡＦやＡＥのロック状態／ロック解除状態をユーザが容易に識別することが可能になる。 Here, on the subject image preview screen displayed on the monitor, finder, etc. of the imaging device, the lock state such as AF lock or AE lock is indicated by the color of the object in the screen such as the frame of the AF area, and is notified to the user. It is also possible. For example, as a user interface (notification means) indicating a locked state, the AF frame is displayed in green in the locked state, and the AF frame color is displayed in achromatic color (white, black, gray, etc.) in the unlocked state. change. Further, when the AF operation fails, the AF frame may be displayed in red. By providing such notification means, the user can easily identify the locked state / unlocked state of AF or AE.
　図４は第１の実施形態における撮像装置のＡＦ／ＡＥロック及びロック解除動作の手順を示すフローチャートである。まず、画像処理部１４において顔検出を行い（ステップＳ１１）、画像処理部１４及びＡＦ制御部１５により、検出した顔領域に対してＡＦ／ＡＥ制御を行い、制御完了後にＡＦ／ＡＥロック状態とする（ステップＳ１２）。そして、ＣＰＵ１６において、顔領域の座標を検出して、顔領域を含む被写体の座標（Ｘ，Ｙ）を取得する（ステップＳ１３）。 FIG. 4 is a flowchart showing a procedure of AF / AE locking and unlocking operations of the imaging apparatus according to the first embodiment. First, face detection is performed in the image processing unit 14 (step S11), and AF / AE control is performed on the detected face area by the image processing unit 14 and the AF control unit 15, and the AF / AE lock state is set after the control is completed. (Step S12). Then, the CPU 16 detects the coordinates of the face area and acquires the coordinates (X, Y) of the subject including the face area (step S13).
　その後、ＣＰＵ１６において、顔領域を含む被写体の座標が所定量以上変化したか否かを判定する（ステップＳ１４）。この顔領域の検出及び位置変化の判定は、常時または所定の時間毎に定期的に行う。ここで、所定量以上の被写体の座標変化が検出され、顔領域が所定量以上移動したと判定した場合は、ＡＦ／ＡＥロックを自動解除する（ステップＳ１５）。このようにＡＦ／ＡＥロックした顔領域の位置変化を判定することによって、被写体の状態が変化したことを判断し、ＡＦ／ＡＥロックを自動解除することができる。 Thereafter, the CPU 16 determines whether or not the coordinates of the subject including the face area have changed by a predetermined amount or more (step S14). The detection of the face area and the determination of the position change are performed constantly or periodically at predetermined time intervals. Here, if a change in the coordinates of the subject over a predetermined amount is detected and it is determined that the face area has moved over the predetermined amount, the AF / AE lock is automatically released (step S15). Thus, by determining the position change of the AF / AE-locked face area, it is possible to determine that the state of the subject has changed and to automatically release the AF / AE lock.
　（第２の実施形態）
　第２の実施形態では、ロック解除条件の第２例として、被写体の動き検出を用いた場合の動作を説明する。図５は第２の実施形態における撮像装置のＡＦ／ＡＥロック及びロック解除動作を説明する図である。 (Second Embodiment)
In the second embodiment, an operation when motion detection of a subject is used as a second example of the unlocking condition will be described. FIG. 5 is a diagram for explaining AF / AE lock and lock release operations of the imaging apparatus according to the second embodiment.
　図５（ａ）、（ｂ）は撮影前の被写体画像を表示するプレビュー画面の例を示すものである。図５（ａ）は被写体に対するＡＦ／ＡＥロック状態を示している。第２の実施形態の撮像装置は、画像処理部１４及びＡＦ制御部１５により、画像中央部等のＡＦ領域に対してＡＦ／ＡＥ制御を行ってＡＦ／ＡＥロック状態とする。そして、ＣＰＵ１６は、このＡＦ領域を相関判定エリア３３として、被写体の動き検出を行う。 FIGS. 5A and 5B show examples of a preview screen that displays a subject image before photographing. FIG. 5A shows the AF / AE lock state for the subject. In the imaging apparatus according to the second embodiment, the image processing unit 14 and the AF control unit 15 perform AF / AE control on the AF area such as the center of the image to set the AF / AE locked state. Then, the CPU 16 uses the AF area as the correlation determination area 33 to detect the movement of the subject.
　図５（ｂ）はＡＦ／ＡＥロックの解除状態を示している。ここでは、被写体が移動して他の被写体が画面中央に位置し、ＡＦ／ＡＥロックが解除された様子を示している。ＣＰＵ１６は、相関判定エリア３３における画像の相関値を判定し、相関値が所定の閾値を超えた場合、すなわち以前にＡＦ／ＡＥ動作を行った被写体が移動して相関値が所定量以上変化した場合に、ＡＦ／ＡＥロックの解除を行う。 FIG. 5B shows the AF / AE lock release state. Here, a situation is shown in which the subject has moved and another subject has been positioned at the center of the screen, and the AF / AE lock has been released. The CPU 16 determines the correlation value of the image in the correlation determination area 33, and when the correlation value exceeds a predetermined threshold, that is, the correlation value has changed by a predetermined amount or more due to the movement of the subject that has previously performed the AF / AE operation. In this case, the AF / AE lock is released.
　図６は第２の実施形態における撮像装置のＡＦ／ＡＥロック及びロック解除動作の手順を示すフローチャートである。まず、画像処理部１４及びＡＦ制御部１５によってＡＦ領域に対してＡＦ／ＡＥ制御を行い、制御完了後にＡＦ／ＡＥロック状態とする（ステップＳ２１）。そして、ＣＰＵ１６において、ＡＦ領域を相関判定エリアとして設定する（ステップＳ２２）。 FIG. 6 is a flowchart showing a procedure of AF / AE locking and unlocking operations of the imaging apparatus according to the second embodiment. First, the AF / AE control is performed on the AF area by the image processing unit 14 and the AF control unit 15, and the AF / AE lock state is set after the control is completed (step S21). Then, the CPU 16 sets the AF area as a correlation determination area (step S22).
　その後、ＣＰＵ１６において、相関判定エリアの画像をＡＦ／ＡＥロック時の画像と比較し続け、相関判定エリアの相関値が所定量以上変化したか否かを判定する（ステップＳ２３）。ここで、相関値は、相関判定エリア内の画素値の差分などによって算出する。この相関値の判定は、常時または所定の時間毎に定期的に行う。ここで、相関判定エリアの相関値が所定の閾値を超えた場合は、相関判定エリアの画像の内容が変化して被写体が移動したものと判定し、ＡＦ／ＡＥロックを自動解除する（ステップＳ２４）。このようにＡＦ／ＡＥロックしたＡＦ領域の相関値を判定し、被写体の動きを検出することによって、被写体の状態が変化したことを判断し、ＡＦ／ＡＥロックを自動解除することができる。 Thereafter, the CPU 16 continues to compare the image of the correlation determination area with the image at the time of AF / AE lock, and determines whether or not the correlation value of the correlation determination area has changed by a predetermined amount or more (step S23). Here, the correlation value is calculated based on a difference between pixel values in the correlation determination area. The determination of the correlation value is performed constantly or periodically every predetermined time. Here, when the correlation value of the correlation determination area exceeds a predetermined threshold, it is determined that the subject has moved due to a change in the image content of the correlation determination area, and the AF / AE lock is automatically released (step S24). ). Thus, by determining the correlation value of the AF area in which AF / AE is locked and detecting the movement of the subject, it is possible to determine that the state of the subject has changed, and the AF / AE lock can be automatically released.
　ここで、図７及び図８を用いて、目的とする被写体の前などに意図しない被写体が横切った場合の処理を説明する。図７は被写体画像を表示するプレビュー画面において意図しない被写体が横切った場合を示す図、図８はＡＦ／ＡＥロック解除動作における相関値の変化例を示す図である。 Here, processing when an unintended subject crosses in front of a target subject will be described with reference to FIGS. FIG. 7 is a diagram showing a case where an unintended subject crosses on the preview screen displaying the subject image, and FIG. 8 is a diagram showing an example of a correlation value change in the AF / AE lock releasing operation.
　図７（ａ）に示すように目的の被写体に対してＡＦ／ＡＥ制御を行ってＡＦ／ＡＥロック状態とした後、図７（ｂ）に示すように意図しない被写体が前を通過して横切った場合を想定する。このような場合、本実施形態の撮像装置では、ＣＰＵ１６によるＡＦ／ＡＥロック解除の判定において、ヒステリシスを持たせるようにする。したがって、相関判定エリアの相関値を判定する際、所定時間以内の瞬時の被写体変化である場合は、ＡＦ／ＡＥロック状態を保持する。 As shown in FIG. 7A, after subjecting the target subject to AF / AE control to be in the AF / AE locked state, an unintended subject passes through and crosses the front as shown in FIG. 7B. Assuming that In such a case, in the imaging apparatus of the present embodiment, hysteresis is provided in the determination of the AF / AE lock release by the CPU 16. Therefore, when determining the correlation value of the correlation determination area, the AF / AE lock state is held if the subject change is instantaneous within a predetermined time.
　例えば、図８（ａ）に示すように、相関値の変化５１があった場合に、所定量以上であっても所定時間以内の瞬時変化である場合は、目的の被写体の状態が変化していないとみなして無視し、ＡＦ／ＡＥロック状態を保持する。また、図８（ｂ）に示すように、相関値の変化５２が所定量以上でかつ継続的な変化である場合は、所定時間ｔｄが経過した後に被写体の状態が変化したことを判定してＡＦ／ＡＥロックを解除する。このように、被写体の瞬時の変化についてはＡＦ／ＡＥロックを保持することで、意図しない被写体が横切った場合などにＡＦ／ＡＥロックが自動解除されることを抑止できる。 For example, as shown in FIG. 8A, when there is a change 51 in the correlation value, the state of the target subject has changed if it is an instantaneous change within a predetermined time even if it is greater than or equal to a predetermined amount. The AF / AE lock state is maintained by ignoring it as if it were not present. Also, as shown in FIG. 8B, when the correlation value change 52 is a predetermined amount or more and is a continuous change, it is determined that the state of the subject has changed after a predetermined time td has elapsed. Release AF / AE lock. As described above, by holding the AF / AE lock for the instantaneous change of the subject, it is possible to prevent the AF / AE lock from being automatically released when an unintended subject crosses.
　（第３の実施形態）
　第３の実施形態では、ロック解除条件の第３例として、露出条件の変化を用いた場合の動作を説明する。図９は第３の実施形態における撮像装置のＡＦ／ＡＥロック及びロック解除動作を説明する図である。 (Third embodiment)
In the third embodiment, an operation when a change in exposure condition is used as a third example of the unlocking condition will be described. FIG. 9 is a diagram for explaining AF / AE lock and unlock operations of the imaging apparatus according to the third embodiment.
　図９（ａ）、（ｂ）は撮影前の被写体画像を表示するプレビュー画面の例を示すものである。図９（ａ）は被写体に対するＡＦ／ＡＥロック状態を示している。第３の実施形態の撮像装置は、画像処理部１４及びＡＦ制御部１５により、画像中央部等のＡＦ領域に対してＡＦ／ＡＥ制御を行ってＡＦ／ＡＥロック状態とする。そして、ＣＰＵ１６は、被写体の露出条件の変化として、被写体画像の明るさの変化を検出する。 FIGS. 9A and 9B show examples of a preview screen that displays a subject image before photographing. FIG. 9A shows the AF / AE lock state for the subject. In the imaging apparatus according to the third embodiment, the image processing unit 14 and the AF control unit 15 perform AF / AE control on the AF area such as the center of the image to set the AF / AE locked state. Then, the CPU 16 detects a change in the brightness of the subject image as a change in the subject exposure condition.
　図９（ｂ）はＡＦ／ＡＥロックの解除状態を示している。ここでは、被写体を人物から風景に変更してＡＦ／ＡＥロックが解除された様子を示している。ＣＰＵ１６は、被写体画像の平均輝度を算出して画像の明るさを検出し、被写体画像の明るさが所定値以上変化した場合に、ＡＦ／ＡＥロックの解除を行う。被写体画像の明るさがＡＦ／ＡＥロック時から変化し、過露光や露光不足などの状態になった場合は、以前にＡＦ／ＡＥ動作を行ったときと比べて露出条件が変化し、被写体が移動したりカメラの向きが変化したと考えられ、被写体の状態が変化しているとみなすことができるので、ＡＦ／ＡＥロックを解除する。 FIG. 9B shows the AF / AE lock release state. Here, a state in which the subject is changed from a person to a landscape and the AF / AE lock is released is shown. The CPU 16 calculates the average brightness of the subject image to detect the brightness of the image, and releases the AF / AE lock when the brightness of the subject image changes by a predetermined value or more. If the brightness of the subject image changes from when AF / AE is locked, and overexposure or underexposure occurs, the exposure conditions change compared to the previous AF / AE operation, and the subject Since it is considered that the camera has moved or the direction of the camera has changed and the state of the subject has changed, the AF / AE lock is released.
　図１０は第３の実施形態における撮像装置のＡＦ／ＡＥロック及びロック解除動作の手順を示すフローチャートである。まず、画像処理部１４及びＡＦ制御部１５によってＡＦ領域に対してＡＦ／ＡＥ制御を行い、制御完了後にＡＦ／ＡＥロック状態とする（ステップＳ３１）。そして、ＣＰＵ１６において、被写体画像の明るさを検出する（ステップＳ３２）。 FIG. 10 is a flowchart showing a procedure of AF / AE locking and unlocking operations of the imaging apparatus according to the third embodiment. First, the AF / AE control is performed on the AF area by the image processing unit 14 and the AF control unit 15, and the AF / AE lock state is set after the control is completed (step S31). Then, the CPU 16 detects the brightness of the subject image (step S32).
　その後、ＣＰＵ１６において、被写体画像の明るさが所定量以上変化したか否かを判定する（ステップＳ３３）。ここで、被写体画像の明るさは平均輝度などによって算出する。この明るさの判定は、常時または所定の時間毎に定期的に行う。ここで、被写体画像の明るさが所定量以上変化し、露出条件の変化が検出された場合は、ＡＦ／ＡＥロックを自動解除する（ステップＳ３４）。このようにＡＦ／ＡＥロックした後の露出条件の変化を判定することによって、被写体の状態が変化したことを判断し、ＡＦ／ＡＥロックを自動解除することができる。 Thereafter, the CPU 16 determines whether or not the brightness of the subject image has changed by a predetermined amount or more (step S33). Here, the brightness of the subject image is calculated based on the average luminance or the like. This determination of brightness is always performed or periodically at predetermined time intervals. If the brightness of the subject image changes by a predetermined amount or more and a change in exposure condition is detected, the AF / AE lock is automatically released (step S34). By determining the change in the exposure condition after the AF / AE lock is thus performed, it is possible to determine that the state of the subject has changed, and to automatically release the AF / AE lock.
　なお、上記実施形態において説明したロック解除機能は、ＡＦ制御やＡＥ制御だけでなく、ホワイトバランス制御にも適用可能である。この場合、画像処理部１４等においてホワイトバランス制御部の機能を有するようにする。ホワイトバランス制御は、画像処理部１４において、撮像素子１２から出力されるＲ，Ｇ，Ｂの各色信号に基づいて撮像画像における光源の色温度を推測し、その色温度の情報に基づいて、撮像素子１２からのＲ，Ｇ，Ｂの各色信号に各々適切なゲインをかけることで、撮像画像のホワイトバランスを調整する。画像処理部１４は、ホワイトバランス制御状態を固定した後、被写体の状態が変化して所定のロック解除条件となった場合に、ホワイトバランスロックを解除する。そして、現在の被写体画像に合わせて再度ホワイトバランス調整を可能にする。このホワイトバランスロックの解除において、上述した第１～第３の実施形態を適用することで、被写体の状態が変化した場合に自動解除することができる。 Note that the unlocking function described in the above embodiment can be applied not only to AF control and AE control, but also to white balance control. In this case, the image processing unit 14 or the like has a function of a white balance control unit. In the white balance control, the image processing unit 14 estimates the color temperature of the light source in the captured image based on the R, G, and B color signals output from the image sensor 12, and captures the image based on the color temperature information. By applying appropriate gains to the R, G, and B color signals from the element 12, the white balance of the captured image is adjusted. After fixing the white balance control state, the image processing unit 14 releases the white balance lock when the state of the subject changes to satisfy a predetermined unlock condition. Then, the white balance can be adjusted again according to the current subject image. In the release of the white balance lock, by applying the first to third embodiments described above, the white balance lock can be automatically released when the state of the subject changes.
　（第４の実施形態）
　第４の実施形態として、撮像装置を携帯電話装置に搭載した場合の構成例を示す。図１１は第４の実施形態に係る撮像装置を含む携帯電話装置の構成を示すブロック図である。　　　 (Fourth embodiment)
As a fourth embodiment, a configuration example when an imaging device is mounted on a mobile phone device is shown. FIG. 11 is a block diagram illustrating a configuration of a mobile phone device including an imaging device according to the fourth embodiment.
　携帯電話装置は、無線部１２１、制御部１２２、音声処理部１２３、アンテナ１０１、入力部１０２、スピーカ１０３、マイク１０４を備えている。また、メイン表示部１０５、サブ表示部１０６、報知用ＬＥＤ１０７、表示ドライバ１２８、データメモリ１２４、プログラムメモリ１２５、音源部１２６、アンプ１２７、スピーカ１０９を備え、データ通信、コンテンツ再生、メール送受信などの携帯情報端末の機能を実現している。また、撮像装置として、画像処理部１２９、撮像素子１３０、撮像レンズ１３２、ＡＦ／ＡＥ制御部１３１、フラッシュ用ＬＥＤ１０８を備えている。 The mobile phone device includes a wireless unit 121, a control unit 122, an audio processing unit 123, an antenna 101, an input unit 102, a speaker 103, and a microphone 104. The main display unit 105, the sub display unit 106, the notification LED 107, the display driver 128, the data memory 124, the program memory 125, the sound source unit 126, the amplifier 127, and the speaker 109 are provided, and data communication, content reproduction, mail transmission / reception, etc. The function of the portable information terminal is realized. In addition, the imaging apparatus includes an image processing unit 129, an imaging element 130, an imaging lens 132, an AF / AE control unit 131, and a flash LED 108.
　無線部１２１は、無線通信の送受信に関する処理を行うもので、アンテナ１０１により送受信される信号の変調／復調等を行う。制御部１２２は、各部の制御を行うもので、通信データ処理部１５１、システムメモリ１５２、ＣＰＵ１５３を有している。通信データ処理部１５１は、無線部１２１により送受信される信号の符号化／復号化等、通信データの処理を行う。システムメモリ１５２は、ＯＳなどの基本システムプログラムを記憶する。ＣＰＵ１５３は、システムメモリ１５２に記憶されたプログラムにしたがって動作し、装置各部の動作制御などを実行する。 The wireless unit 121 performs processing related to transmission / reception of wireless communication, and performs modulation / demodulation of a signal transmitted / received by the antenna 101. The control unit 122 controls each unit, and includes a communication data processing unit 151, a system memory 152, and a CPU 153. The communication data processing unit 151 performs communication data processing such as encoding / decoding of signals transmitted / received by the wireless unit 121. The system memory 152 stores a basic system program such as an OS. The CPU 153 operates according to a program stored in the system memory 152 and executes operation control of each part of the apparatus.
　入力部１０２は、テンキー等のキースイッチ、カメラキー、シャッタキー、ＡＦロックキーなどの押しボタンスイッチなど、操作用の各種入力デバイスにより構成され、ユーザからの操作指示を入力する。音声処理部１２３は、通信データ処理部１５１で処理される音声信号の入出力処理を行うもので、スピーカ１０３、マイク１０４との間で通話音声等の入出力を行う。 The input unit 102 includes various input devices for operation such as a key switch such as a numeric keypad, a push button switch such as a camera key, a shutter key, and an AF lock key, and inputs an operation instruction from a user. The voice processing unit 123 performs input / output processing of voice signals processed by the communication data processing unit 151, and performs input / output of call voice and the like between the speaker 103 and the microphone 104.
　データメモリ１２４は、アドレス帳データ、メールデータ、画像データなどのコンテンツデータ等、本装置で生成または取得した各種データを記憶する。プログラムメモリ１２５は、本装置において実行する各種アプリケーションプログラムを記憶するもので、カメラアプリケーションや画像処理アプリケーションなどを格納している。音源部１２６は、本装置の報知音、動作音などの音信号波形を記憶、出力するもので、音源部１２６から出力される音信号がアンプ１２７で増幅され、スピーカ１０９より再生出力される。 The data memory 124 stores various data generated or acquired by the apparatus, such as content data such as address book data, mail data, and image data. The program memory 125 stores various application programs executed in this apparatus, and stores a camera application, an image processing application, and the like. The sound source unit 126 stores and outputs sound signal waveforms such as notification sounds and operation sounds of the apparatus, and a sound signal output from the sound source unit 126 is amplified by the amplifier 127 and reproduced and output from the speaker 109.
　表示ドライバ１２８は、メイン表示部１０５、サブ表示部１０６、報知用ＬＥＤ１０７、フラッシュ用ＬＥＤ１０８を駆動するもので、それぞれの表示部やＬＥＤの表示制御を行う。 The display driver 128 drives the main display unit 105, the sub display unit 106, the notification LED 107, and the flash LED 108, and performs display control of each display unit and LED.
　撮像素子１３０は、ＣＣＤ、ＣＭＯＳ型センサ等により構成され、撮像レンズ１３２によって結像された被写体像を光電変換して撮像画像の電気信号を出力する。画像処理部１２９は、ＤＳＰなどによって構成され、ホワイトバランス調整、γ補正、色補正、輪郭強調、データ圧縮／伸張など、撮像装置における各種画像信号処理を実行し、撮像画像出力として画像データをデータメモリ１２４に出力する。 The image sensor 130 is composed of a CCD, a CMOS sensor, etc., and photoelectrically converts the subject image formed by the imaging lens 132 and outputs an electrical signal of the captured image. The image processing unit 129 is configured by a DSP or the like, and executes various image signal processes in the imaging apparatus such as white balance adjustment, γ correction, color correction, contour enhancement, data compression / decompression, and the image data is output as captured image output. Output to the memory 124.
　ＡＦ／ＡＥ制御部１３１は、画像処理部１２９の出力に基づき、撮像画像のコントラストや明るさなどに応じてＡＦ制御、ＡＥ制御を行う。ＡＦ制御においては、図示しないレンズ駆動部に制御信号を出力し、撮像レンズ１３２を光軸方向に移動させてフォーカス調整を行う。ＡＥ制御においては、撮像素子１３０や画像処理部１２９に制御信号を出力し、撮像素子１２のシャッタスピードやゲインで、感度などを調整したり、画像処理部１２９において撮像信号のレベル調整等を行うことによって露出調整を行う。なお、画像処理部１２９にＡＥ制御機能を備えるようにしてもよい。 The AF / AE control unit 131 performs AF control and AE control according to the contrast and brightness of the captured image based on the output of the image processing unit 129. In the AF control, a control signal is output to a lens driving unit (not shown), and focus adjustment is performed by moving the imaging lens 132 in the optical axis direction. In the AE control, a control signal is output to the image sensor 130 and the image processing unit 129, and the sensitivity and the like are adjusted by the shutter speed and gain of the image sensor 12, and the level of the image signal is adjusted by the image processing unit 129. Adjust the exposure. The image processing unit 129 may have an AE control function.
　このような構成の携帯電話装置に設けられる撮像装置においても、上記第１～第３の実施形態と同様にして、制御部１２２で撮像画像における被写体の状態の変化を検出し、ＡＦロック、ＡＥロック、ホワイトバランスロックなどの制御ロック状態を自動解除することが可能である。この際、入力部１０２からの特別な操作を必要とせず、制御ロック状態を解除できる。 Also in the imaging device provided in the mobile phone device having such a configuration, a change in the state of the subject in the captured image is detected by the control unit 122 in the same manner as in the first to third embodiments, and AF lock, AE Control lock states such as lock and white balance lock can be automatically released. At this time, the control lock state can be released without requiring a special operation from the input unit 102.
　上述したように、本実施形態では、顔領域の位置変化、被写体の動き、露出条件の変化などによって被写体の状態の変化を検出し、所定量以上変化した場合に、ＡＦ／ＡＥロックやホワイトバランスロックを自動解除することができる。これにより、ユーザの特別な操作を不要とし、被写体状態が変化した場合に制御ロック状態を解除できるので、新たな被写体の状態に追従したＡＦ制御やＡＥ制御を素早く実行できる。この際、被写体状態変化時のピンぼけや露出オーバー、アンダーなどを解消できるとともに、制御ロック解除に関する操作性を向上でき、次の撮影までの時間を短縮することができる。 As described above, in this embodiment, a change in the state of the subject is detected based on a change in the position of the face area, a movement of the subject, a change in the exposure condition, and the like. The lock can be released automatically. This eliminates the need for a user's special operation, and the control lock state can be released when the subject state changes, so that AF control and AE control following the new subject state can be quickly executed. At this time, blurring, overexposure, underexposure, etc. when the subject state changes can be eliminated, operability related to the unlocking of the control can be improved, and the time until the next shooting can be shortened.
　なお、本発明は上記の実施形態において示されたものに限定されるものではなく、明細書の記載、並びに周知の技術に基づいて、当業者が変更、応用することも本発明の予定するところであり、保護を求める範囲に含まれる。 It should be noted that the present invention is not limited to those shown in the above-described embodiments, and those skilled in the art can also make changes and applications based on the description in the specification and well-known techniques. Yes, included in the scope of protection.
　本出願は、２００８年１月１７日出願の日本特許出願（特願２００８－００７９７１）、に基づくものであり、その内容はここに参照として取り込まれる。 This application is based on a Japanese patent application (Japanese Patent Application No. 2008-007971) filed on January 17, 2008, the contents of which are incorporated herein by reference.
　本発明は、特別の操作を必要とせずにＡＦロックなどを自動解除することができ、操作性を向上させることが可能となる効果を有し、オートフォーカス（ＡＦ）機能や自動露出調整（ＡＥ）機能を持つ撮像装置、携帯端末及びカメラ制御方法等として有用である。 The present invention can automatically release AF lock or the like without requiring a special operation, and has an effect of improving operability, and has an auto focus (AF) function and automatic exposure adjustment (AE). It is useful as an imaging device having a function, a portable terminal, a camera control method, and the like.

Claims (9)

  1. 　被写体に対して自動的に焦点を合わせるオートフォーカス制御部と、
    　前記被写体の状態を検出する被写体状態検出部と、
    　前記オートフォーカス制御部により焦点を固定した後に、前記被写体状態検出部の検出結果により被写体の状態の変化を検出した場合、前記固定状態を解除する機能制御部と、
    を備える撮像装置。     An autofocus controller that automatically focuses on the subject;
    A subject state detection unit for detecting the state of the subject;
    A function control unit that releases the fixed state when a change in the state of the subject is detected based on the detection result of the subject state detection unit after the focus is fixed by the autofocus control unit;
    An imaging apparatus comprising:
  2. 　請求項１に記載の撮像装置であって、
    　被写体に対して自動的に露出を調整する自動露出制御部を備え、
    　前記機能制御部は、前記自動露出制御部により露出を固定した後に、前記被写体状態検出部の検出結果により被写体の状態の変化を検出した場合、前記固定状態を解除する撮像装置。     The imaging apparatus according to claim 1,
    It has an automatic exposure control unit that automatically adjusts the exposure for the subject.
    The function control unit is an imaging device that releases the fixed state when the change of the state of the subject is detected based on the detection result of the subject state detection unit after the automatic exposure control unit fixes the exposure.
  3. 　請求項１に記載の撮像装置であって、
    　被写体画像のホワイトバランスを調整するホワイトバランス制御部を備え、
    　前記機能制御部は、前記ホワイトバランス制御部によりホワイトバランスを固定した後に、前記被写体状態検出部の検出結果により被写体の状態の変化を検出した場合、前記固定状態を解除する撮像装置。     The imaging apparatus according to claim 1,
    A white balance control unit that adjusts the white balance of the subject image
    The function control unit is an imaging device that cancels the fixed state when the white balance is fixed by the white balance control unit and then a change in the state of the subject is detected based on the detection result of the subject state detection unit.
  4. 　請求項１～３のいずれかに記載の撮像装置であって、
    　前記被写体状態検出部は、被写体画像中の顔検出を行って顔領域の位置を取得するもので、
    　前記機能制御部は、前記顔領域の位置が所定量以上変化した場合に、前記固定状態を解除する撮像装置。     The imaging apparatus according to any one of claims 1 to 3,
    The subject state detection unit performs face detection in the subject image to acquire the position of the face region,
    The function control unit is an imaging device that releases the fixed state when the position of the face region changes by a predetermined amount or more.
  5. 　請求項１～３のいずれかに記載の撮像装置であって、
    　前記被写体状態検出部は、被写体の動きを検出するもので、
    　前記機能制御部は、前記被写体の動きを所定量以上検出した場合に、前記固定状態を解除する撮像装置。     The imaging apparatus according to any one of claims 1 to 3,
    The subject state detection unit detects the movement of the subject,
    The function controller is configured to release the fixed state when the movement of the subject is detected by a predetermined amount or more.
  6. 　請求項１～３のいずれかに記載の撮像装置であって、
    　前記被写体状態検出部は、被写体画像の露出条件を検出するもので、
    　前記機能制御部は、前記被写体画像の露出条件が所定量以上変化した場合に、前記固定状態を解除する撮像装置。     The imaging apparatus according to any one of claims 1 to 3,
    The subject state detection unit detects an exposure condition of the subject image,
    The function controller is configured to release the fixed state when an exposure condition of the subject image changes by a predetermined amount or more.
  7. 　請求項１に記載の撮像装置であって、
    　前記固定状態または前記固定状態の解除をユーザに通知する通知手段を備える撮像装置。     The imaging apparatus according to claim 1,
    An imaging apparatus comprising notification means for notifying a user of the fixed state or the release of the fixed state.
  8. 　請求項１～７のいずれかに記載の撮像装置を備える携帯端末。 A mobile terminal comprising the imaging device according to any one of claims 1 to 7.
  9. 　被写体に対して自動的に焦点を合わせるオートフォーカス制御ステップと、
    　前記被写体の状態を検出する被写体状態検出ステップと、
    　前記オートフォーカス制御により焦点を固定した後に、前記被写体状態の検出結果により被写体の状態の変化を検出した場合、前記固定状態を解除する機能制御ステップと、
    を有するカメラ制御方法。     An autofocus control step for automatically focusing on the subject;
    A subject state detecting step for detecting the state of the subject;
    A function control step for releasing the fixed state when a change in the state of the subject is detected based on the detection result of the subject state after the focus is fixed by the autofocus control;
    A camera control method.
PCT/JP2009/000077 2008-01-17 2009-01-09 Imaging device, portable terminal, and camera control method WO2009090862A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2008-007971 2008-01-17
JP2008007971A JP2009171301A (en) 2008-01-17 2008-01-17 Imaging apparatus, portable terminal and camera control method

Publications (1)

Publication Number Publication Date
WO2009090862A1 true WO2009090862A1 (en) 2009-07-23

Family

ID=40885254

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2009/000077 WO2009090862A1 (en) 2008-01-17 2009-01-09 Imaging device, portable terminal, and camera control method

Country Status (2)

Country Link
JP (1) JP2009171301A (en)
WO (1) WO2009090862A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8988507B2 (en) * 2009-11-19 2015-03-24 Sony Corporation User interface for autofocus
JP2011234015A (en) 2010-04-26 2011-11-17 Kyocera Corp Terminal device
JP5800498B2 (en) 2010-12-17 2015-10-28 キヤノン株式会社 Automatic focus adjustment device and lens device having the same
US9007508B2 (en) 2012-03-29 2015-04-14 Sony Corporation Portable device, photographing method, and program for setting a target region and performing an image capturing operation when a target is detected in the target region
JP6199065B2 (en) * 2013-04-22 2017-09-20 株式会社ザクティ Electronic camera
JP6188474B2 (en) * 2013-07-31 2017-08-30 キヤノン株式会社 Zoom control device, control method for zoom control device, control program for zoom control device, and storage medium
JP6179569B2 (en) 2015-08-20 2017-08-16 カシオ計算機株式会社 Image processing apparatus, image processing method, and program

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08251466A (en) * 1995-03-10 1996-09-27 Canon Inc Automatic focusing device for composite camera
JP2004173151A (en) * 2002-11-22 2004-06-17 Minolta Co Ltd Digital camera
JP2005049854A (en) * 2003-07-15 2005-02-24 Omron Corp Object decision device and imaging device
JP2005284156A (en) * 2004-03-30 2005-10-13 Fuji Photo Film Co Ltd Camera with automatic focusing function and automatic focusing method of camera
JP2006157819A (en) * 2004-12-01 2006-06-15 Matsushita Electric Ind Co Ltd Digital camera device
JP2007208886A (en) * 2006-02-06 2007-08-16 Konica Minolta Photo Imaging Inc Digital camera

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08251466A (en) * 1995-03-10 1996-09-27 Canon Inc Automatic focusing device for composite camera
JP2004173151A (en) * 2002-11-22 2004-06-17 Minolta Co Ltd Digital camera
JP2005049854A (en) * 2003-07-15 2005-02-24 Omron Corp Object decision device and imaging device
JP2005284156A (en) * 2004-03-30 2005-10-13 Fuji Photo Film Co Ltd Camera with automatic focusing function and automatic focusing method of camera
JP2006157819A (en) * 2004-12-01 2006-06-15 Matsushita Electric Ind Co Ltd Digital camera device
JP2007208886A (en) * 2006-02-06 2007-08-16 Konica Minolta Photo Imaging Inc Digital camera

Also Published As

Publication number Publication date
JP2009171301A (en) 2009-07-30

Similar Documents

Publication Publication Date Title
JP4761146B2 (en) Imaging apparatus and program thereof
JP4325599B2 (en) Imaging apparatus and display control method
JP4872797B2 (en) Imaging apparatus, imaging method, and imaging program
US10542216B2 (en) Apparatus and method for storing moving image portions
US7606476B2 (en) Imaging device and imaging method
WO2009090862A1 (en) Imaging device, portable terminal, and camera control method
JP5015677B2 (en) Imaging apparatus and control method thereof
JP2005311699A (en) Imaging apparatus and display control method
JP2006145629A (en) Imaging apparatus
JP2010287919A (en) Imaging device
KR20150022531A (en) Photographing apparatus and method
JP4879127B2 (en) Digital camera and digital camera focus area selection method
JP4717840B2 (en) Imaging apparatus and control method thereof
JP4170194B2 (en) Imaging device
JP4818130B2 (en) Imaging apparatus and control method thereof
JP2010062987A (en) Imaging apparatus and method
JP2006222794A (en) Photographing device
JP5355124B2 (en) Imaging apparatus and scene discrimination method thereof
JP2008054130A (en) Imaging apparatus and program thereof
KR101323731B1 (en) Method for display exposure area
JP6645612B1 (en) Imaging device and electronic equipment
KR20130104437A (en) Device and method for capturing image in wireless terminal
JP2017139577A (en) Photometric device and imaging device including the same
JP2009071494A (en) Imaging apparatus, image processing apparatus, and program
JP2006033752A (en) Digital camera

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09701781

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 09701781

Country of ref document: EP

Kind code of ref document: A1