US8004596B2 - Apparatus for processing a digital image to automatically select a best image from a plurality of images and method of controlling the apparatus - Google Patents

Apparatus for processing a digital image to automatically select a best image from a plurality of images and method of controlling the apparatus Download PDF

Info

Publication number
US8004596B2
US8004596B2 US12/218,380 US21838008A US8004596B2 US 8004596 B2 US8004596 B2 US 8004596B2 US 21838008 A US21838008 A US 21838008A US 8004596 B2 US8004596 B2 US 8004596B2
Authority
US
United States
Prior art keywords
image
focus
images
input
input images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US12/218,380
Other versions
US20090128642A1 (en
Inventor
Sung-shik Koh
Kazuhiko Sugimoto
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Assigned to SAMSUNG TECHWIN CO., LTD. reassignment SAMSUNG TECHWIN CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KOH, SUNG-SHIK, SUGIMOTO, KAZUHIKO
Publication of US20090128642A1 publication Critical patent/US20090128642A1/en
Assigned to SAMSUNG DIGITAL IMAGING CO., LTD. reassignment SAMSUNG DIGITAL IMAGING CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SAMSUNG TECHWIN CO., LTD.
Assigned to SAMSUNG ELECTRONICS CO., LTD. reassignment SAMSUNG ELECTRONICS CO., LTD. MERGER (SEE DOCUMENT FOR DETAILS). Assignors: SAMSUNG DIGITAL IMAGING CO., LTD.
Application granted granted Critical
Publication of US8004596B2 publication Critical patent/US8004596B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H04N23/676—Bracketing for image capture at varying focusing conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/635—Region indicators; Field of view indicators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H04N23/675—Focus control based on electronic image sensor signals comprising setting of focusing regions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681—Motion detection
    • H04N23/6811—Motion detection based on the image signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/71—Circuitry for evaluating the brightness variation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/743—Bracketing, i.e. taking a series of images with varying exposure conditions

Definitions

  • the present invention relates to an apparatus for processing a digital image and a method of controlling the apparatus, and more particularly, to an apparatus for processing a digital image that can capture an image input through an image pickup device by pressing a shutter-release button, and a method of controlling the apparatus.
  • examples of apparatuses for processing a digital image include all devices that process images or use an image recognition sensor, such as a digital camera, a personal digital assistant (PDA), a phone camera, and a personal computer (PC) camera.
  • a digital camera such as a digital camera, a personal digital assistant (PDA), a phone camera, and a personal computer (PC) camera.
  • PDA personal digital assistant
  • PC personal computer
  • An apparatus for processing a digital image such as a camera, can display images input through an image pickup device.
  • the apparatus for processing the digital image can capture a desired image and store the captured image as an image file.
  • the apparatus for processing the digital image may be shaken due to the user's hand shake, resulting in blurry and unclear images and a failure in photographic quality.
  • the apparatus for processing the digital image As the apparatus for processing the digital image has recently become smaller and slimmer, the apparatus for processing the digital image has become more affected by hand shake caused when the shutter-release button is pressed. In addition, as the apparatus for processing the digital image has been developed to offer higher magnification and higher resolution, the risk of shaking the apparatus for processing the digital image due to hand shake caused when the shutter-release button is pressed has increased.
  • a hand shake sensor may be used.
  • the hand shake sensor can measure the amount of hand shake and correct for it. However, the hand shake sensor is then additionally required.
  • the present invention provides an apparatus for processing a digital image that can capture an image with a reduced hand shake effect without using a hand shake sensor.
  • an apparatus for processing a digital image comprising: an image input unit receiving a plurality of input images from the outside; and a control unit receiving the plurality of input images when a shutter-release button select signal is input from the outside, selecting a clearest image from among the input images as a best image, and capturing the best image.
  • the control unit may select specific regions of the input images as detection regions, and select an image with a clearest detection region as a best image.
  • a human region including the person may be selected as the detection region.
  • the shutter-release button select signal may comprise a first signal generated when a shutter-release button is pressed to a first step, and a second signal generated when the shutter-release button is pressed to a second step.
  • the apparatus may further comprise a focus lens moved along an optical axis in response to the first signal and receiving a plurality of focus images, wherein the focus lens is controlled by the control unit to be located at a position where a clearest focus image is obtained.
  • control unit may select the best image from among the input images in response to the second signal.
  • an apparatus for processing a digital image comprising: an image input unit receiving a plurality of input images from the outside, when a shutter-release button select signal is input from the outside; a detection region detecting unit detecting specific regions of the input images as detection regions; a raw data generating unit generating raw data of the detection regions from the input images; a luminance value calculating unit calculating luminance values corresponding to respective pixels from the raw data; a focus value calculating unit calculating focus values of the input images from the luminance values; and a best image selecting unit selecting an input image with a highest focus value among the input images as a best image.
  • a method of controlling an apparatus for processing a digital image comprising: receiving a plurality of input images from the outside; detecting human regions of the input images as detection regions; receiving raw data of the detection regions; calculating luminance values corresponding to respective pixels from the raw data; calculating focus values of the input images from the luminance values; and selecting an input image with a highest focus value among the input images as a best image.
  • FIG. 1 is a rear view of an apparatus for processing a digital image, e.g., a digital camera, according to an embodiment of the present invention
  • FIG. 2 is a block diagram of a control device of an apparatus for processing a digital image according to an embodiment of the present invention
  • FIG. 3 is a block diagram of an apparatus for processing a digital image according to another embodiment of the present invention.
  • FIG. 4 is a pictorial representation that illustrates auto-focusing performed by the control device of FIG. 2 and/or FIG. 3 ;
  • FIG. 5 is a pictorial representation that illustrates an input image input to the control device of FIG. 2 and/or FIG. 3 ;
  • FIGS. 6A-6C are pictorial representations that illustrate human regions of input images which are continuously received in an auto-focusing mode
  • FIG. 7 is a graph illustrating focus values of the human regions of the input images of FIGS. 6A through 6C which are continuously received when a second signal is input and there is a user's hand shake;
  • FIG. 8 is a flowchart illustrating a method of controlling an apparatus for processing a digital image according to an embodiment of the present invention.
  • FIG. 9 is a flowchart illustrating a best image generating operation in the method of controlling the apparatus for processing the digital image of FIG. 5 according to an embodiment of the present invention.
  • FIG. 1 is a rear view of an apparatus for processing a digital signal, e.g., a digital camera 100 , according to an embodiment of the present invention.
  • the digital camera 100 includes a direction button 21 , a menu-OK button 22 , a wide angle-zoom button W, a telephoto-zoom button T, and a display panel 25 on the back.
  • the direction button 21 may include an up button 21 a , a down button 21 b , a left button 21 c , and a right button 21 d .
  • the direction button 21 and the menu-OK button 22 are pressed to execute a variety of menu items for operations of the digital camera 100 .
  • the wide angle-zoom button W or the telephoto-zoom button T is pressed to widen or narrow the angle of view.
  • the wide angle-zoom button W or the telephoto-zoom button T may be used to change the size of an exposed area.
  • the size of the selected area may be decreased, and when the telephoto-zoom button T is pressed, the size of the selected area may be increased.
  • the display panel 25 may be an image display device such as a liquid crystal display (LCD).
  • the digital camera 100 may include a shutter-release button 26 , a flash (not shown), a power switch (not shown), and a lens unit (not shown) on the front or the top.
  • the digital camera 100 may further include an ocular lens and an objective lens of a view finder 27 on the front and the back.
  • the shutter-release button 26 opens and closes to expose an image pickup device, such as a charge coupled device (CCD), or a film to light for a predetermined period of time.
  • the shutter-release button 26 works together with an aperture (not shown) to properly expose a photographed object and record an image on the image pickup device.
  • the shutter-release button 26 may be pressed to two steps. When the shutter-release button 26 is pressed to a first step, a first signal may be generated, and when the shutter-release button 26 is pressed to a second step, a second signal may be generated.
  • the first signal is input to the digital camera 100 .
  • various values for photographing and auto-focusing for setting an optimal position of a focus lens may be set.
  • a plurality of input images may be received in the state where the position of the focus lens is fixed, and a clearest image from among the input images may be captured and stored.
  • the shutter-release button 26 is pressed to the second step, the clearest image from among the plurality of input images can be captured even though there is a user's hand shake. That is, the best image with the least hand shake can be captured without using a hand shake sensor.
  • FIG. 2 is a block diagram of a control device 200 of an apparatus for processing a digital image according to an embodiment of the present invention.
  • the control device 200 may be mounted in the digital camera 100 of FIG. 1 .
  • an optical system OPS including a lens unit and a filter unit optically processes light reflected from a photographed object.
  • the lens unit of the optical system OPS includes a zoom lens, a focus lens, and a compensation lens.
  • the microcontroller 212 controls a lens driving unit 210 in order to drive a zoom motor M Z such that the zoom lens is moved. Accordingly, when the wide angle-zoom button W is pressed, the focal length of the zoom lens is shortened and the angle of view is widened. When the telephoto-zoom button T is pressed, the focal length of the zoom lens is lengthened and the angle of view is narrowed.
  • a main controller embedded in a digital signal processor (DSP) 207 controls the lens driving unit 210 using the microcontroller 212 , to drive a focus motor M F . That is, the focus motor M F is driven to move the focus lens to a position where a clearest image can be captured.
  • DSP digital signal processor
  • the auto-focusing mode may be actuated in response to a first signal which is generated when a shutter-release button is pressed to a first step and which is input through the user input unit INP.
  • the focus lens is moved along an optical axis to receive a plurality of input images, and a position of the focus lens which allows a clearest image from among the plurality of input images is obtained.
  • Reference numeral M A denotes a motor for driving an aperture (not shown).
  • An optical low pass filter included in the filter unit of the optical system OPS removes high frequency optical noise, and an infrared cut filter included in the filter unit of the optical system OPS cuts off an infrared component of incident light.
  • An optoelectric converting unit OEC may include an image pickup device, such as a CCD or a complementary metal-oxide-semiconductor (CMOS).
  • CMOS complementary metal-oxide-semiconductor
  • An analogue-digital converting unit may include a correlation double sampler and analogue-to-digital converter (CDS-ADC) 201 .
  • the analogue-digital converting unit processes an analogue signal output from the optoelectric converting unit OEC, removes high frequency noise, adjusts the amplitude, and converts the analogue signal into a digital signal.
  • the DSP 207 controls a timing circuit 202 to control the operations of the optoelectric converting unit OEC and the analogue-digital converting unit 201 .
  • a real-time clock (RTC) 203 provides time information to the DSP 207 .
  • the DSP 207 processes the digital signal output from the CDS-ADC 201 and generates a digital image signal divided into luminance (Y) and chrominance (R, G, B) signals.
  • a light emitting unit LAMP which is driven by the microcontroller 212 under the control of the main controller embedded in the DSP 207 may include a self-timer lamp, an automatic focus lamp, a mode indicating lamp, and a flash-ready lamp.
  • the user input unit INP may include a direction button 21 , the wide angle-zoom button W, and the telephoto-zoom button T.
  • the digital image signal output from the DSP 207 is temporarily stored in a dynamic random access memory (DRAM) 204 .
  • An algorithm and set data, such as a booting program and a key input program, needed for the operation of the DSP 207 is stored in an electrically erasable and programmable read only memory (EEPROM) 205 .
  • EEPROM electrically erasable and programmable read only memory
  • a removable memory card may be inserted into a memory card interface (MCI) 206 .
  • the digital image signal output from the DSP 207 is input to a display panel driving unit 214 , and an image is displayed on a display panel 25 .
  • the digital image signal output from the DSP 207 may be transmitted in a serial communication through a universal serial bus (USB) connection unit 31 a , or an RS232C interface 208 and a connection unit 31 b thereof, or may be transmitted as a video signal through a video filter 209 and a video output unit 31 c .
  • the microcontroller 212 may be embedded in the DSP 207 .
  • An audio processor 213 outputs an audio signal output from a microphone MIC to the DSP 207 or a speaker SP, and outputs an audio signal output from the DSP 207 to the speaker SP.
  • the control device 200 may include an image input unit and a control unit.
  • the image input unit receives input images from the outside.
  • the control unit captures a best image according to a shutter-release button select signal input from the outside.
  • the image input unit may include the optical system OPS, the optoelectric converting unit OEC, and the CDS-ADC 201 .
  • the control unit receives a plurality of input images when a shutter-release button select signal is input, selects a clearest image from among the plurality of input images as a best image, and captures the best image.
  • the focus lens for making focus adjustment of the input images may be included in the image input unit.
  • the control unit may include the DSP 207 and/or the microcontroller 212 .
  • the shutter-release button select signal may include a first signal and a second signal.
  • the first signal is generated when the shutter-release button is pressed to a first step
  • the second signal is generated when the shutter-release button is pressed to a second step.
  • FIG. 4 illustrates auto-focusing performed by the control device 200 of FIG. 2 .
  • Input images which are received by the image input unit may be displayed as live view images on the display panel 25 .
  • the shutter-release button is pressed to a first step, a first signal is generated, and auto-focusing is performed in response to the first signal.
  • the focus lens is moved along an optical axis to receive a plurality of focus images 41 , 42 , and 43 as shown in FIG. 4 .
  • the control unit controls the focus lens to be located at a focus position where a clearest focus image is obtained.
  • the focus position is obtained by calculating focus values from the focus images 41 , 42 , and 43 , and determining a position of the focus lens when a focus image with a highest focus value is input as a focus position.
  • the focus values may be obtained by detecting face regions of the respective focus images 41 , 42 , and 43 , detecting edges of the respective face regions, and summing up the edges. That is, a focus image with a greatest edge value may become a focus image with a highest focus value.
  • the focus images 41 , 42 , and 43 have focus values FV 0 a , FV 0 b , and FV 0 c with respect to focus lens positions FPa, FPb, and FPc, respectively.
  • the focus image 42 in FIG. 4 has the focus value FV 0 b which is the highest, and the position FPb of the focus lens when the focus image 42 has the focus value FV 0 b becomes an optimal focus position.
  • a face region may be detected using a face region detection algorithm. For example, a region where flesh tone intensity is high may be searched for in an overall image and detected as a face region.
  • a detection region according to the present invention is not limited to the face region, and may be a human region including a face.
  • central regions of the images may be detected as focus regions and focus values of the focus regions may be calculated to obtain a clearest image.
  • FIG. 5 illustrates an input image input to the control device 200 of FIG. 2 .
  • FIGS. 6A through 6C illustrate human regions of input images which are continuously received in an auto-focusing mode.
  • FIG. 7 is a graph illustrating focus values of the human regions of the input images of FIGS. 6A through 6C which are continuously received when a second signal S 2 is input and there is a user's hand shake.
  • a second signal is generated, and a best image with the least hand shake may be selected in response to the second signal.
  • a best image from among input images may be selected in response to the second signal.
  • a specific region is selected as a detection region, an image with a clearest detection region among the input images may be selected as a best image. If a person exists in each of the input images, a face region or a human region 50 including the person may be selected as a detection region.
  • a face may be detected from each of the input images, a torso portion constructing the human region 50 together with the face may be traced from a position of the face, and the human region 50 may be detected and selected as a detection region.
  • a face region may be detected using a typical face region detection algorithm. For example, a region where flesh tone intensity is high is searched for in the images and detected as a face region.
  • a central region of each of the input images may be selected as a detection region.
  • hand shake effect may be analyzed by using overall photograph information.
  • a best image with the least hand shake is selected by calculating only focus values of main subject regions, not calculating focus values of all regions, a best image can be selected in a short time.
  • the reliability of hand shake correction when a human region is selected as a detection region can be higher than that when only a face region is selected as a detection region. Also, high reliability of hand shake correction can be ensured even when images are input at a defocus state.
  • the control unit When a second signal is input, the control unit continuously receives a plurality of input images, detects human regions of the respective input images, and obtains luminance values, such as Y or G values, from raw data of the human regions. Focus values are obtained from the luminance values of the human regions of the input images, and an image with a highest focus value is selected as a best image.
  • luminance values such as Y or G values
  • the raw data may be data received through the image pickup device, such as CCD or CMOS, of the optoelectric converting unit OEC, and the luminance values may be Y or G values corresponding to respective pixels.
  • the image pickup device such as CCD or CMOS
  • the luminance values may be Y or G values corresponding to respective pixels.
  • the focus values may be obtained by detecting edges in the human regions and summing up the edges. That is, an image with a greatest edge value in the human region becomes an image with a highest focus value among the input images, and accordingly becomes a clearest image.
  • the images of FIGS. 6A through 6C have focus values FV 1 , FV 2 , and FV 3 as shown in FIG. 7 .
  • the focus value FV 3 is the highest, and thus the input image of FIG. 6C is a clearest image and is selected as a best image. Accordingly, the input image of FIG. 6C having the focus value FV 3 which is the highest becomes an image with the least hand shake.
  • the input images 41 , 42 , and 43 may be received at the positions FPa, FPb, and FPc of the focus lens, respectively.
  • the images of FIGS. 6A through 6C may become detection regions 41 a , 42 a , and 43 a of the input images 41 , 42 , and 43 from which the focus values FV 0 a , FV 0 b , and FV 0 c can be calculated.
  • the focus values FV 0 a , FV 0 b , and FV 0 c of the detection regions 41 a , 41 b , and 41 c may be obtained, and the position FPb of the focus lens with the highest focus value may be obtained.
  • the position FPb of the focus lens with the highest focus value allows a clearest image.
  • control unit may receive a plurality of input images and set the positions of the focus lens.
  • control unit may receive a plurality of images at preset time intervals at the positions of the focus lens, and capture and store an image with the least hand shake from among the input images.
  • a plurality of input images can be received and a clearest image can be captured even though there is a user's hand shake. That is, an optimal image with the least hand shake can be captured without using a hand shake sensor.
  • control device 200 can capture an image with the least hand shake by pressing the shutter-release button 26 to a second step to capture and store an image, hand shake can be corrected in a short time that the user cannot recognize.
  • a best image can be automatically selected without manipulating buttons while watching a plurality of images.
  • FIG. 3 is a block diagram of an apparatus 300 for processing a digital image according to another embodiment of the present invention.
  • the apparatus 300 may use the control device 200 of FIG. 2 . Also, all or some elements of the apparatus 300 may be realized in the DSP 207 and/or the microcontroller 212 of the control device FIG. 2 .
  • the apparatus 300 includes an image input unit 310 , a detection region detecting unit 320 , a raw data generating unit 330 , a luminance value calculating unit 340 , a focus value calculating unit 350 , and a best image selecting unit 360 .
  • the image input unit 310 receives a plurality of input images from the outside.
  • the detection region detecting unit 320 detects specific regions on the input images as detection regions.
  • the raw data generating unit 330 generates raw data of the detection regions from the input images.
  • the luminance value calculating unit 340 calculates luminance values corresponding to respective pixels from the raw data.
  • the focus value calculating unit 350 calculates focus values of the input images from the luminance values.
  • the best image selecting unit 360 selects an input image with a highest focus value among the input images as a best image.
  • the shutter-release button select signal may include a first signal and a second signal.
  • the first signal is generated when a shutter-release button is pressed to a first step
  • the second signal is generated when the shutter-release button is pressed to a second step.
  • the apparatus 300 is moved along an optical axis in response to the first signal to receive a plurality of focus images.
  • a focus lens that is controlled to be located at a position where a clearest image is obtained may be further included in the image input unit 310 .
  • the focus lens is controlled to be located at a position where a face region with a highest focus value is obtained by auto-focusing performed in the method of FIG. 4 .
  • the image input unit 310 may include an optical system OPS, an optoelectric converting unit OEC, and a CDS-ADC 201 .
  • the focus lens for making focus adjustment of the input images may be included in the image input unit 310 .
  • the image input unit 310 sequentially receives a plurality of input images in response to a second signal. Human regions of the sequentially input images are shown in FIGS. 6A through 6C .
  • the detection region detecting unit 320 may select a human region 50 including the person as a detection region as shown in FIG. 5 .
  • a face may be detected from each of the input images, a torso portion constructing the human region 50 together with the face may be traced from a position of the face, and the human region 50 may be selected as a detection region.
  • the human regions of the plurality of input images may be the images shown in FIGS. 6A and 6C .
  • a central region of each of the input images may be selected as a detection region.
  • hand shake effect may be analyzed by using overall photograph information.
  • Raw data generated by the raw data generating unit 330 may be data received through an image pickup device, such as a CCD or a CMOS, of the optoelectric converting unit OEC.
  • the luminance value calculating unit 340 calculates luminance values such as Y or G values corresponding to pixels.
  • the focus value calculating unit 350 may calculate focus values FV 1 , FV 2 , and FV 3 of the input images as shown in FIG. 7 from the luminance values of the input images.
  • a plurality of images may be received in preset time intervals, and focus values FV 1 , FV 2 , and FV 3 of the respective images may be calculated.
  • images are received at a first time T 1 , a second time T 2 , and a third time T 3 , which are preset, when the focus lens is located at the preset focus position FPb, and focus values FV 1 , FV 2 , and FV 3 of the respective images are calculated.
  • the focus value FV 3 of the image input at the third time T 3 is the highest among the focus values FV 1 , FV 2 , and FV 3 of the images obtained when the focus lens is located at the focus position FPb. Accordingly, the image input at the third time T 3 of FIG. 6C may become an image with the least hand shake.
  • FIG. 8 is a flowchart illustrating a method S 800 of controlling an apparatus for processing a digital signal according to an embodiment of the present invention.
  • FIG. 9 is a flowchart illustrating a best image selecting operation S 900 in the method S 800 of FIG. 8 .
  • the method S 800 may be performed by the control device 200 and the apparatus of FIG. 2 and/or FIG. 3 .
  • the method S 800 includes displaying input images as a live view images in operation S 810 , performing auto-focusing in operations S 820 and S 830 , selecting a best image in operations S 840 and S 900 , and capturing and storing the best image in operation S 850 .
  • the method S 800 may be performed in response to a shutter-release button select signal.
  • the shutter-release button select signal may include a first signal and a second signal. The first signal is generated when a shutter-release button is pressed to a first step, and the second signal is generated when the shutter-release button is pressed to a second step.
  • operation S 810 input images are displayed as live view images on a display device.
  • operations S 820 and S 830 when a first signal S 1 is input, a focus lens is moved along an optical axis, a plurality of focus images are received, and the focus lens is controlled to be located at a position where a clearest focus image is obtained.
  • the best image with the least hand shake is captured, converted and compressed into a file, and stored in a storage medium such as a memory card.
  • the best image generating operation S 900 includes receiving input images in operations S 910 , S 970 , and S 980 , detecting human regions in operation S 920 , obtaining raw data in operation S 930 , calculating luminance values in operation S 940 , calculating focus values in operation S 950 , and selecting a best image in operation S 960 .
  • a plurality of input images are received from the outside.
  • human regions of the input images are detected as detection regions.
  • raw data of the detection regions are received.
  • luminance values corresponding to respective pixels are calculated from the raw data.
  • focus values of the input images are calculated from the luminance values.
  • an image with a highest focus value among the input images is selected as a best image.
  • a predetermined number of input images are sequentially received from the outside in operations S 910 , S 970 , and S 980 .
  • next input image is stored as an image with the least hand shake and the previously stored image is removed.
  • a memory space can be reduced.
  • the method S 800 can capture an optimal image with the least hand shake without using a hand shake sensor.
  • the apparatus for processing the digital image and the method of controlling the apparatus according to the present invention can capture an image with reduced hand shake effect without using a hand shake sensor.
  • the present invention may be described in terms of functional block components and various processing steps. Such functional blocks may be realized by any number of hardware and/or software components configured to perform the specified functions.
  • the present invention may employ various integrated circuit components, e.g., memory elements, processing elements, logic elements, look-up tables, and the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices.
  • the elements of the present invention are implemented using software programming or software elements the invention may be implemented with any programming or scripting language such as C, C++, Java, assembler, or the like, with the various algorithms being implemented with any combination of data structures, objects, processes, routines or other programming elements.
  • the present invention could employ any number of conventional techniques for electronics configuration, signal processing and/or control, data processing and the like.
  • the word mechanism is used broadly and is not limited to mechanical or physical embodiments, but can include software routines in conjunction with processors, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Automatic Focus Adjustment (AREA)

Abstract

An apparatus and appertaining method for controlling the apparatus are provided for processing a digital image, which can capture an image with reduced hand shake effect without using a hand shake sensor. The apparatus includes: an image input unit receiving a plurality of input images from the outside; and a control unit receiving the plurality of input images when a shutter-release button select signal is input from the outside, selecting a clearest image from among the input images as a best image, and capturing the best image.

Description

CROSS-REFERENCE TO RELATED PATENT APPLICATION
This application claims the benefit of Korean Patent Application No. 10-2007-0119295, filed on Nov. 21, 2007, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference.
BACKGROUND
1. Field of the Invention
The present invention relates to an apparatus for processing a digital image and a method of controlling the apparatus, and more particularly, to an apparatus for processing a digital image that can capture an image input through an image pickup device by pressing a shutter-release button, and a method of controlling the apparatus.
2. Description of the Related Art
In general, examples of apparatuses for processing a digital image include all devices that process images or use an image recognition sensor, such as a digital camera, a personal digital assistant (PDA), a phone camera, and a personal computer (PC) camera.
An apparatus for processing a digital image, such as a camera, can display images input through an image pickup device. When a user presses a shutter-release button, the apparatus for processing the digital image can capture a desired image and store the captured image as an image file.
When the user presses the shutter-release button, however, the apparatus for processing the digital image may be shaken due to the user's hand shake, resulting in blurry and unclear images and a failure in photographic quality.
As the apparatus for processing the digital image has recently become smaller and slimmer, the apparatus for processing the digital image has become more affected by hand shake caused when the shutter-release button is pressed. In addition, as the apparatus for processing the digital image has been developed to offer higher magnification and higher resolution, the risk of shaking the apparatus for processing the digital image due to hand shake caused when the shutter-release button is pressed has increased.
To solve the problem that a desired image cannot be captured due to hand shake caused when a user presses a shutter-release button, a hand shake sensor may be used. The hand shake sensor can measure the amount of hand shake and correct for it. However, the hand shake sensor is then additionally required.
SUMMARY
The present invention provides an apparatus for processing a digital image that can capture an image with a reduced hand shake effect without using a hand shake sensor.
Various embodiments are described below. According to an aspect of the present invention, there is provided an apparatus for processing a digital image, the apparatus comprising: an image input unit receiving a plurality of input images from the outside; and a control unit receiving the plurality of input images when a shutter-release button select signal is input from the outside, selecting a clearest image from among the input images as a best image, and capturing the best image.
The control unit may select specific regions of the input images as detection regions, and select an image with a clearest detection region as a best image.
If a person exists in each of the input images, a human region including the person may be selected as the detection region.
The shutter-release button select signal may comprise a first signal generated when a shutter-release button is pressed to a first step, and a second signal generated when the shutter-release button is pressed to a second step.
The apparatus may further comprise a focus lens moved along an optical axis in response to the first signal and receiving a plurality of focus images, wherein the focus lens is controlled by the control unit to be located at a position where a clearest focus image is obtained.
In the state where the focus lens is fixed to the position where the clearest focus image is obtained, the control unit may select the best image from among the input images in response to the second signal.
According to another aspect of the present invention, there is provided an apparatus for processing a digital image, the apparatus comprising: an image input unit receiving a plurality of input images from the outside, when a shutter-release button select signal is input from the outside; a detection region detecting unit detecting specific regions of the input images as detection regions; a raw data generating unit generating raw data of the detection regions from the input images; a luminance value calculating unit calculating luminance values corresponding to respective pixels from the raw data; a focus value calculating unit calculating focus values of the input images from the luminance values; and a best image selecting unit selecting an input image with a highest focus value among the input images as a best image.
According to another aspect of the present invention, there is provided a method of controlling an apparatus for processing a digital image, the method comprising: receiving a plurality of input images from the outside; detecting human regions of the input images as detection regions; receiving raw data of the detection regions; calculating luminance values corresponding to respective pixels from the raw data; calculating focus values of the input images from the luminance values; and selecting an input image with a highest focus value among the input images as a best image.
BRIEF DESCRIPTION OF THE DRAWINGS
The above and other features and advantages of the present invention will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings in which:
FIG. 1 is a rear view of an apparatus for processing a digital image, e.g., a digital camera, according to an embodiment of the present invention;
FIG. 2 is a block diagram of a control device of an apparatus for processing a digital image according to an embodiment of the present invention;
FIG. 3 is a block diagram of an apparatus for processing a digital image according to another embodiment of the present invention;
FIG. 4 is a pictorial representation that illustrates auto-focusing performed by the control device of FIG. 2 and/or FIG. 3;
FIG. 5 is a pictorial representation that illustrates an input image input to the control device of FIG. 2 and/or FIG. 3;
FIGS. 6A-6C are pictorial representations that illustrate human regions of input images which are continuously received in an auto-focusing mode;
FIG. 7 is a graph illustrating focus values of the human regions of the input images of FIGS. 6A through 6C which are continuously received when a second signal is input and there is a user's hand shake;
FIG. 8 is a flowchart illustrating a method of controlling an apparatus for processing a digital image according to an embodiment of the present invention; and
FIG. 9 is a flowchart illustrating a best image generating operation in the method of controlling the apparatus for processing the digital image of FIG. 5 according to an embodiment of the present invention.
 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
The present invention will now be described more fully with reference to the accompanying drawings, in which exemplary embodiments of the invention are shown and described below.
FIG. 1 is a rear view of an apparatus for processing a digital signal, e.g., a digital camera 100, according to an embodiment of the present invention.
Referring to FIG. 1, the digital camera 100 includes a direction button 21, a menu-OK button 22, a wide angle-zoom button W, a telephoto-zoom button T, and a display panel 25 on the back.
The direction button 21 may include an up button 21 a, a down button 21 b, a left button 21 c, and a right button 21 d. The direction button 21 and the menu-OK button 22 are pressed to execute a variety of menu items for operations of the digital camera 100.
The wide angle-zoom button W or the telephoto-zoom button T is pressed to widen or narrow the angle of view. In particular, the wide angle-zoom button W or the telephoto-zoom button T may be used to change the size of an exposed area. When the wide angle-zoom button W is pressed, the size of the selected area may be decreased, and when the telephoto-zoom button T is pressed, the size of the selected area may be increased. The display panel 25 may be an image display device such as a liquid crystal display (LCD).
The digital camera 100 may include a shutter-release button 26, a flash (not shown), a power switch (not shown), and a lens unit (not shown) on the front or the top. The digital camera 100 may further include an ocular lens and an objective lens of a view finder 27 on the front and the back.
The shutter-release button 26 opens and closes to expose an image pickup device, such as a charge coupled device (CCD), or a film to light for a predetermined period of time. The shutter-release button 26 works together with an aperture (not shown) to properly expose a photographed object and record an image on the image pickup device.
The shutter-release button 26 may be pressed to two steps. When the shutter-release button 26 is pressed to a first step, a first signal may be generated, and when the shutter-release button 26 is pressed to a second step, a second signal may be generated.
Once the first signal is input to the digital camera 100, various values for photographing and auto-focusing for setting an optimal position of a focus lens may be set. Once the second signal is input to the digital camera 100, a plurality of input images may be received in the state where the position of the focus lens is fixed, and a clearest image from among the input images may be captured and stored.
Accordingly, although the shutter-release button 26 is pressed to the second step, the clearest image from among the plurality of input images can be captured even though there is a user's hand shake. That is, the best image with the least hand shake can be captured without using a hand shake sensor.
A digital camera and a method and apparatus for controlling the same to which the present invention can be applied are disclosed in U.S. Patent Publication No. 2004/0130650, entitled “Method of Automatically Focusing Using Quadratic Function in Camera”, filed by the present applicant and herein incorporated by reference. Since the disclosure of U.S. Patent Publication No. 2004/0130650 is incorporated in the specification of the present invention, a detailed explanation thereof will not be given.
FIG. 2 is a block diagram of a control device 200 of an apparatus for processing a digital image according to an embodiment of the present invention. The control device 200 may be mounted in the digital camera 100 of FIG. 1.
Referring to FIG. 2, an optical system OPS including a lens unit and a filter unit optically processes light reflected from a photographed object. The lens unit of the optical system OPS includes a zoom lens, a focus lens, and a compensation lens. When a user presses a wide angle-zoom button W or a telephoto-zoom button T included in a user input unit INP, a corresponding signal is input to a microcontroller 212.
The microcontroller 212 controls a lens driving unit 210 in order to drive a zoom motor MZ such that the zoom lens is moved. Accordingly, when the wide angle-zoom button W is pressed, the focal length of the zoom lens is shortened and the angle of view is widened. When the telephoto-zoom button T is pressed, the focal length of the zoom lens is lengthened and the angle of view is narrowed.
In an auto-focusing mode, a main controller embedded in a digital signal processor (DSP) 207 controls the lens driving unit 210 using the microcontroller 212, to drive a focus motor MF. That is, the focus motor MF is driven to move the focus lens to a position where a clearest image can be captured.
The auto-focusing mode may be actuated in response to a first signal which is generated when a shutter-release button is pressed to a first step and which is input through the user input unit INP. At this time, the focus lens is moved along an optical axis to receive a plurality of input images, and a position of the focus lens which allows a clearest image from among the plurality of input images is obtained.
Since the compensation lens compensates for an overall refractive index, the compensation lens is not separately driven. Reference numeral MA denotes a motor for driving an aperture (not shown).
An optical low pass filter included in the filter unit of the optical system OPS removes high frequency optical noise, and an infrared cut filter included in the filter unit of the optical system OPS cuts off an infrared component of incident light.
An optoelectric converting unit OEC may include an image pickup device, such as a CCD or a complementary metal-oxide-semiconductor (CMOS). The optoelectric converting unit OEC converts light output from the optical system OPS into an electrical analogue signal.
An analogue-digital converting unit may include a correlation double sampler and analogue-to-digital converter (CDS-ADC) 201. The analogue-digital converting unit processes an analogue signal output from the optoelectric converting unit OEC, removes high frequency noise, adjusts the amplitude, and converts the analogue signal into a digital signal. The DSP 207 controls a timing circuit 202 to control the operations of the optoelectric converting unit OEC and the analogue-digital converting unit 201.
A real-time clock (RTC) 203 provides time information to the DSP 207. The DSP 207 processes the digital signal output from the CDS-ADC 201 and generates a digital image signal divided into luminance (Y) and chrominance (R, G, B) signals.
A light emitting unit LAMP which is driven by the microcontroller 212 under the control of the main controller embedded in the DSP 207 may include a self-timer lamp, an automatic focus lamp, a mode indicating lamp, and a flash-ready lamp. The user input unit INP may include a direction button 21, the wide angle-zoom button W, and the telephoto-zoom button T.
The digital image signal output from the DSP 207 is temporarily stored in a dynamic random access memory (DRAM) 204. An algorithm and set data, such as a booting program and a key input program, needed for the operation of the DSP 207 is stored in an electrically erasable and programmable read only memory (EEPROM) 205. A removable memory card may be inserted into a memory card interface (MCI) 206.
The digital image signal output from the DSP 207 is input to a display panel driving unit 214, and an image is displayed on a display panel 25.
The digital image signal output from the DSP 207 may be transmitted in a serial communication through a universal serial bus (USB) connection unit 31 a, or an RS232C interface 208 and a connection unit 31 b thereof, or may be transmitted as a video signal through a video filter 209 and a video output unit 31 c. The microcontroller 212 may be embedded in the DSP 207.
An audio processor 213 outputs an audio signal output from a microphone MIC to the DSP 207 or a speaker SP, and outputs an audio signal output from the DSP 207 to the speaker SP.
The control device 200 may include an image input unit and a control unit. The image input unit receives input images from the outside. The control unit captures a best image according to a shutter-release button select signal input from the outside.
The image input unit may include the optical system OPS, the optoelectric converting unit OEC, and the CDS-ADC 201. The control unit receives a plurality of input images when a shutter-release button select signal is input, selects a clearest image from among the plurality of input images as a best image, and captures the best image.
The focus lens for making focus adjustment of the input images may be included in the image input unit. The control unit may include the DSP 207 and/or the microcontroller 212.
The shutter-release button select signal may include a first signal and a second signal. The first signal is generated when the shutter-release button is pressed to a first step, and the second signal is generated when the shutter-release button is pressed to a second step.
FIG. 4 illustrates auto-focusing performed by the control device 200 of FIG. 2.
Input images which are received by the image input unit may be displayed as live view images on the display panel 25. In this state, if the shutter-release button is pressed to a first step, a first signal is generated, and auto-focusing is performed in response to the first signal. To this end, the focus lens is moved along an optical axis to receive a plurality of focus images 41, 42, and 43 as shown in FIG. 4.
The control unit controls the focus lens to be located at a focus position where a clearest focus image is obtained. The focus position is obtained by calculating focus values from the focus images 41, 42, and 43, and determining a position of the focus lens when a focus image with a highest focus value is input as a focus position. The focus values may be obtained by detecting face regions of the respective focus images 41, 42, and 43, detecting edges of the respective face regions, and summing up the edges. That is, a focus image with a greatest edge value may become a focus image with a highest focus value.
The focus images 41, 42, and 43 have focus values FV0 a, FV0 b, and FV0 c with respect to focus lens positions FPa, FPb, and FPc, respectively. The focus image 42 in FIG. 4 has the focus value FV0 b which is the highest, and the position FPb of the focus lens when the focus image 42 has the focus value FV0 b becomes an optimal focus position.
In general, when a person exists in a photograph, the person is often a main subject of the photograph. Since a focus position is obtained by calculating only focus values of main subject regions, not calculating focus values of all regions, a best image can be obtained in a short time.
A face region may be detected using a face region detection algorithm. For example, a region where flesh tone intensity is high may be searched for in an overall image and detected as a face region. A detection region according to the present invention is not limited to the face region, and may be a human region including a face.
When images in which a face does not exist are input, central regions of the images may be detected as focus regions and focus values of the focus regions may be calculated to obtain a clearest image.
FIG. 5 illustrates an input image input to the control device 200 of FIG. 2. FIGS. 6A through 6C illustrate human regions of input images which are continuously received in an auto-focusing mode. FIG. 7 is a graph illustrating focus values of the human regions of the input images of FIGS. 6A through 6C which are continuously received when a second signal S2 is input and there is a user's hand shake.
When the shutter-release button is pressed to a second step, a second signal is generated, and a best image with the least hand shake may be selected in response to the second signal. In the state where the focus lens is fixed to the position where a clearest image is obtained, a best image from among input images may be selected in response to the second signal.
In order to select the best image with the least hand shake, a specific region is selected as a detection region, an image with a clearest detection region among the input images may be selected as a best image. If a person exists in each of the input images, a face region or a human region 50 including the person may be selected as a detection region.
When the human region 50 is selected as a detection region as shown in FIG. 5, a face may be detected from each of the input images, a torso portion constructing the human region 50 together with the face may be traced from a position of the face, and the human region 50 may be detected and selected as a detection region. Here, a face region may be detected using a typical face region detection algorithm. For example, a region where flesh tone intensity is high is searched for in the images and detected as a face region.
If a person does not exist in each of the input images, a central region of each of the input images may be selected as a detection region. Alternatively, if a person does not exist in each of the input images, hand shake effect may be analyzed by using overall photograph information.
In general, when a person exists in a photograph, the person is often a main subject of the photograph. Since a best image with the least hand shake is selected by calculating only focus values of main subject regions, not calculating focus values of all regions, a best image can be selected in a short time.
The reliability of hand shake correction when a human region is selected as a detection region can be higher than that when only a face region is selected as a detection region. Also, high reliability of hand shake correction can be ensured even when images are input at a defocus state.
When a second signal is input, the control unit continuously receives a plurality of input images, detects human regions of the respective input images, and obtains luminance values, such as Y or G values, from raw data of the human regions. Focus values are obtained from the luminance values of the human regions of the input images, and an image with a highest focus value is selected as a best image.
The raw data may be data received through the image pickup device, such as CCD or CMOS, of the optoelectric converting unit OEC, and the luminance values may be Y or G values corresponding to respective pixels.
The focus values may be obtained by detecting edges in the human regions and summing up the edges. That is, an image with a greatest edge value in the human region becomes an image with a highest focus value among the input images, and accordingly becomes a clearest image.
The images of FIGS. 6A through 6C have focus values FV1, FV2, and FV3 as shown in FIG. 7. The focus value FV3 is the highest, and thus the input image of FIG. 6C is a clearest image and is selected as a best image. Accordingly, the input image of FIG. 6C having the focus value FV3 which is the highest becomes an image with the least hand shake.
While the focus lens is moved from the first position FPa to the third position FPc, the input images 41, 42, and 43 may be received at the positions FPa, FPb, and FPc of the focus lens, respectively. The images of FIGS. 6A through 6C may become detection regions 41 a, 42 a, and 43 a of the input images 41, 42, and 43 from which the focus values FV0 a, FV0 b, and FV0 c can be calculated.
Accordingly, the focus values FV0 a, FV0 b, and FV0 c of the detection regions 41 a, 41 b, and 41 c may be obtained, and the position FPb of the focus lens with the highest focus value may be obtained. The position FPb of the focus lens with the highest focus value allows a clearest image.
When a first signal S1 is input, by obtaining the focus values FV0 a, FV0 b, and FV0 c of the detection regions 41 a, 41 b, and 41 c of FIGS. 6A through 6C, the position FPb of the focus lens where the clearest image can be obtained when there is no hand shake may be obtained.
In this way, the control unit may receive a plurality of input images and set the positions of the focus lens. When a photographing start signal is input, the control unit may receive a plurality of images at preset time intervals at the positions of the focus lens, and capture and store an image with the least hand shake from among the input images.
Accordingly, when the shutter-release button 26 is pressed to a second step to take shots, a plurality of input images can be received and a clearest image can be captured even though there is a user's hand shake. That is, an optimal image with the least hand shake can be captured without using a hand shake sensor.
Since the control device 200 can capture an image with the least hand shake by pressing the shutter-release button 26 to a second step to capture and store an image, hand shake can be corrected in a short time that the user cannot recognize.
Also, a best image can be automatically selected without manipulating buttons while watching a plurality of images.
FIG. 3 is a block diagram of an apparatus 300 for processing a digital image according to another embodiment of the present invention. The apparatus 300 may use the control device 200 of FIG. 2. Also, all or some elements of the apparatus 300 may be realized in the DSP 207 and/or the microcontroller 212 of the control device FIG. 2.
Accordingly, the same description of the apparatus 300 as that of the control device 200 of FIG. 2 will not be repeated.
Referring to FIG. 3, the apparatus 300 includes an image input unit 310, a detection region detecting unit 320, a raw data generating unit 330, a luminance value calculating unit 340, a focus value calculating unit 350, and a best image selecting unit 360.
When a shutter-release button select signal is input from the outside, the image input unit 310 receives a plurality of input images from the outside. The detection region detecting unit 320 detects specific regions on the input images as detection regions. The raw data generating unit 330 generates raw data of the detection regions from the input images.
The luminance value calculating unit 340 calculates luminance values corresponding to respective pixels from the raw data. The focus value calculating unit 350 calculates focus values of the input images from the luminance values. The best image selecting unit 360 selects an input image with a highest focus value among the input images as a best image.
The shutter-release button select signal may include a first signal and a second signal. The first signal is generated when a shutter-release button is pressed to a first step, and the second signal is generated when the shutter-release button is pressed to a second step.
The apparatus 300 is moved along an optical axis in response to the first signal to receive a plurality of focus images. A focus lens that is controlled to be located at a position where a clearest image is obtained may be further included in the image input unit 310. The focus lens is controlled to be located at a position where a face region with a highest focus value is obtained by auto-focusing performed in the method of FIG. 4.
The image input unit 310 may include an optical system OPS, an optoelectric converting unit OEC, and a CDS-ADC 201. The focus lens for making focus adjustment of the input images may be included in the image input unit 310.
In the state where the focus lens is fixed to the focus position where the clearest image is obtained, the image input unit 310 sequentially receives a plurality of input images in response to a second signal. Human regions of the sequentially input images are shown in FIGS. 6A through 6C.
If a person exists in each of the input images, the detection region detecting unit 320 may select a human region 50 including the person as a detection region as shown in FIG. 5. In detail, a face may be detected from each of the input images, a torso portion constructing the human region 50 together with the face may be traced from a position of the face, and the human region 50 may be selected as a detection region.
The human regions of the plurality of input images may be the images shown in FIGS. 6A and 6C.
If a person does not exist in each of the input images, a central region of each of the input images may be selected as a detection region. Alternatively, if a person does not exist in each of the input images, hand shake effect may be analyzed by using overall photograph information.
Raw data generated by the raw data generating unit 330 may be data received through an image pickup device, such as a CCD or a CMOS, of the optoelectric converting unit OEC. The luminance value calculating unit 340 calculates luminance values such as Y or G values corresponding to pixels.
The focus value calculating unit 350 may calculate focus values FV1, FV2, and FV3 of the input images as shown in FIG. 7 from the luminance values of the input images.
In the state where the focus lens is located at the position FPb of the focus lens where the clearest photograph can be obtained when there is no hand shake, a plurality of images may be received in preset time intervals, and focus values FV1, FV2, and FV3 of the respective images may be calculated.
In FIG. 7, images are received at a first time T1, a second time T2, and a third time T3, which are preset, when the focus lens is located at the preset focus position FPb, and focus values FV1, FV2, and FV3 of the respective images are calculated.
The focus value FV3 of the image input at the third time T3 is the highest among the focus values FV1, FV2, and FV3 of the images obtained when the focus lens is located at the focus position FPb. Accordingly, the image input at the third time T3 of FIG. 6C may become an image with the least hand shake.
FIG. 8 is a flowchart illustrating a method S800 of controlling an apparatus for processing a digital signal according to an embodiment of the present invention. FIG. 9 is a flowchart illustrating a best image selecting operation S900 in the method S800 of FIG. 8. The method S800 may be performed by the control device 200 and the apparatus of FIG. 2 and/or FIG. 3.
Accordingly, the same description of the method S800 as that of the control device 200 and the apparatus 300 will not be repeated.
Referring to FIG. 8, the method S800 includes displaying input images as a live view images in operation S810, performing auto-focusing in operations S820 and S830, selecting a best image in operations S840 and S900, and capturing and storing the best image in operation S850.
The method S800 may be performed in response to a shutter-release button select signal. The shutter-release button select signal may include a first signal and a second signal. The first signal is generated when a shutter-release button is pressed to a first step, and the second signal is generated when the shutter-release button is pressed to a second step.
In operation S810, input images are displayed as live view images on a display device. In operations S820 and S830, when a first signal S1 is input, a focus lens is moved along an optical axis, a plurality of focus images are received, and the focus lens is controlled to be located at a position where a clearest focus image is obtained.
In operations S840 and S900, when a second signal S2 is input, in the state where the focus lens is fixed to the position where the clearest focus image is obtained, a plurality of input images are received from the outside and a clearest image from among the plurality of input images is selected as a best image with the least hand shake.
In operation S850, the best image with the least hand shake is captured, converted and compressed into a file, and stored in a storage medium such as a memory card.
When the second signal S2 is input is operation S840, a best image generating operation S900 is performed. The best image generating operation S900 includes receiving input images in operations S910, S970, and S980, detecting human regions in operation S920, obtaining raw data in operation S930, calculating luminance values in operation S940, calculating focus values in operation S950, and selecting a best image in operation S960.
In operations S910, S970, and S980, a plurality of input images are received from the outside. In operation S920, human regions of the input images are detected as detection regions. In operation S930, raw data of the detection regions are received.
In operation S940, luminance values corresponding to respective pixels are calculated from the raw data. In operation S950, focus values of the input images are calculated from the luminance values. In operation S960, an image with a highest focus value among the input images is selected as a best image.
A predetermined number of input images are sequentially received from the outside in operations S910, S970, and S980.
Once the input images are received, human regions of the input images are detected and focus values are calculated using edge information in the human regions. Only data of an image with a highest focus value among the input images input by this time may be stored as data of a best image with the least hand shake.
However, when a focus value of a next input image is higher than that of the best image that is previously stored, the next input image is stored as an image with the least hand shake and the previously stored image is removed. Hence, since only information of the image with the least hand shake is stored, a memory space can be reduced.
The method S800 can capture an optimal image with the least hand shake without using a hand shake sensor.
As described above, the apparatus for processing the digital image and the method of controlling the apparatus according to the present invention can capture an image with reduced hand shake effect without using a hand shake sensor.
For the purposes of promoting an understanding of the principles of the invention, reference has been made to the preferred embodiments illustrated in the drawings, and specific language has been used to describe these embodiments. However, no limitation of the scope of the invention is intended by this specific language, and the invention should be construed to encompass all embodiments that would normally occur to one of ordinary skill in the art.
The present invention may be described in terms of functional block components and various processing steps. Such functional blocks may be realized by any number of hardware and/or software components configured to perform the specified functions. For example, the present invention may employ various integrated circuit components, e.g., memory elements, processing elements, logic elements, look-up tables, and the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices. Similarly, where the elements of the present invention are implemented using software programming or software elements the invention may be implemented with any programming or scripting language such as C, C++, Java, assembler, or the like, with the various algorithms being implemented with any combination of data structures, objects, processes, routines or other programming elements. Furthermore, the present invention could employ any number of conventional techniques for electronics configuration, signal processing and/or control, data processing and the like. The word mechanism is used broadly and is not limited to mechanical or physical embodiments, but can include software routines in conjunction with processors, etc.
The particular implementations shown and described herein are illustrative examples of the invention and are not intended to otherwise limit the scope of the invention in any way. For the sake of brevity, conventional electronics, control systems, software development and other functional aspects of the systems (and components of the individual operating components of the systems) may not be described in detail. Furthermore, the connecting lines, or connectors shown in the various figures presented are intended to represent exemplary functional relationships and/or physical or logical couplings between the various elements. It should be noted that many alternative or additional functional relationships, physical connections or logical connections may be present in a practical device. Moreover, no item or component is essential to the practice of the invention unless the element is specifically described as “essential” or “critical”. Numerous modifications and adaptations will be readily apparent to those skilled in this art without departing from the spirit and scope of the present invention.

Claims (16)

1. An apparatus for processing a digital image, the apparatus comprising:
an image input unit for receiving a plurality of input images from the outside; and
a control unit for:
receiving a plurality of focus images when a first shutter-release button select signal is input from the outside as a focus lens moves along an optical axis, selecting a clearest image from among the focus images as a first best image, and determining a position of the focus lens for the clearest image of the focus images; and
receiving the plurality of input images when a second shutter-release button select signal is input from the outside with the focus lens at the determined position, selecting a clearest image from among the input images as a second best image, and capturing the second best image.
2. The apparatus of claim 1, wherein the control unit selects specific regions of the input images as detection regions, and selects an image with a clearest detection region as a second best image.
3. The apparatus of claim 2, wherein, if a person exists in each of the input images, a human region including the person is selected as the detection region.
4. The apparatus of claim 3, wherein a face in each of the input images is detected, and a torso portion constructing a human region together with the face is traced from a position of the face, and the human region is detected as the detection region.
5. The apparatus of claim 2, wherein, if a person does not exist in each of the input images, a central region of each of the input images is selected as the detection region.
6. The apparatus of claim 1, wherein the shutter-release button select signal comprises the first signal generated when a shutter-release button is pressed to a first step, and the second signal generated when the shutter-release button is pressed to a second step.
7. The apparatus of claim 6, wherein the focus lens is moved along the optical axis in response to the first signal and receiving the plurality of focus images, wherein the focus lens is controlled by the control unit to be located at a position where the clearest focus image is obtained.
8. The apparatus of claim 1, wherein the receiving of the plurality of focus images is performed in a no hand shake situation, and the receiving of the plurality of input images is performed in a hand shake situation.
9. An apparatus for processing a digital image, the apparatus comprising:
a focus lens that moves along an optical axis in response to a first shutter-release button select signal to receive a plurality of focus images, and is controlled to be located at a position where a clearest image is obtained from the plurality of focus images;
an image input unit for receiving a plurality of input images from the outside when a second shutter-release button select signal is input from the outside while the focus lens remains at the located position;
a detection region for detecting unit detecting specific regions of the input images as detection regions;
a raw data generating unit for generating raw data of the detection regions from the input images;
a luminance value calculating unit for calculating luminance values corresponding to respective pixels from the raw data;
a focus value calculating unit for calculating focus values of the input images from the luminance values; and
a best image selecting unit for selecting an input image with a highest focus value among the input images as a best image.
10. The apparatus of claim 9, wherein, if a person exists in each of the input images, a human region including the person is selected as the detection region, and if a person does not exist in each of the input images, a central region of each of the input images is selected as the detection region.
11. The apparatus of claim 10, wherein a face in each of the input images is detected, a torso portion constructing a human region together with the face is traced from a position of the face, and the human region is detected as the detection region.
12. The apparatus of claim 9, wherein the shutter-release button select signal comprises the first signal generated when a shutter-release button is pressed to a first step, and the second signal generated when the shutter-release button is pressed to a second step.
13. The apparatus of claim 12, wherein the image input unit receives the input images in response to the second signal.
14. A method of controlling an apparatus for processing a digital image, the method comprising:
receiving a plurality of focus images from the outside as a focus lens moves along an optical axis;
determining a position of the focus lens for the clearest image of the focus images;
receiving a plurality of input images from the outside while the focus lens remains at the determined position;
detecting human regions of the input images as detection regions;
receiving raw data of the detection regions;
calculating luminance values corresponding to respective pixels from the raw data;
calculating focus values of the input images from the luminance values; and
selecting an input image with a highest focus value among the input images as a best image.
15. The method of claim 14, further comprising:
generating a first signal when a shutter-release button is pressed to a first step;
generating a second signal when the shutter-release button is pressed to a second step; and
controlling the focus lens, which is moved along the optical axis in response to the first signal to receive the plurality of focus images.
16. The method of claim 15, wherein, in the state where the focus lens is fixed to the position where the clearest focus image is obtained, the input images are received in response to the second signal.
US12/218,380 2007-11-21 2008-07-15 Apparatus for processing a digital image to automatically select a best image from a plurality of images and method of controlling the apparatus Expired - Fee Related US8004596B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2007-0119295 2007-11-21
KR1020070119295A KR101398475B1 (en) 2007-11-21 2007-11-21 Apparatus for processing digital image and method for controlling thereof

Publications (2)

Publication Number Publication Date
US20090128642A1 US20090128642A1 (en) 2009-05-21
US8004596B2 true US8004596B2 (en) 2011-08-23

Family

ID=39718231

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/218,380 Expired - Fee Related US8004596B2 (en) 2007-11-21 2008-07-15 Apparatus for processing a digital image to automatically select a best image from a plurality of images and method of controlling the apparatus

Country Status (4)

Country Link
US (1) US8004596B2 (en)
KR (1) KR101398475B1 (en)
CN (1) CN101442614A (en)
GB (2) GB2454957B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8855360B2 (en) * 2008-07-23 2014-10-07 Qualcomm Technologies, Inc. System and method for face tracking
US8289400B2 (en) 2009-06-05 2012-10-16 Apple Inc. Image capturing device having continuous image capture
EP2507764A4 (en) * 2009-11-30 2013-06-19 Hewlett Packard Development Co Stabilizing a subject of interest in captured video
US8810686B2 (en) * 2011-11-23 2014-08-19 Mediatek Inc. Method, device, and machine readable medium for image capture and selection
US9712738B2 (en) 2012-04-17 2017-07-18 E-Vision Smart Optics, Inc. Systems, devices, and methods for managing camera focus
US20150195482A1 (en) * 2014-01-08 2015-07-09 Nvidia Corporation Method, system and smartphone that chooses optimal image to reduce shutter shake
WO2015124166A1 (en) * 2014-02-18 2015-08-27 Huawei Technologies Co., Ltd. Method for obtaining a picture and multi-camera system
CN104683692B (en) * 2015-02-04 2017-10-17 广东欧珀移动通信有限公司 A kind of continuous shooting method and device
CN106210496B (en) * 2015-05-06 2019-12-13 小米科技有限责任公司 Photo shooting method and device
CN106506973B (en) * 2016-12-06 2020-02-04 Oppo广东移动通信有限公司 Focusing control method and device, electronic equipment and terminal equipment

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6342922B1 (en) * 1995-06-15 2002-01-29 Canon Kabushiki Kaisha Image pickup apparatus having normal and high resolution modes
JP2003348429A (en) 2002-05-27 2003-12-05 Nikon Corp Electronic camera, and image processing program
US20040130650A1 (en) 2002-10-09 2004-07-08 Samsung Techwin Co., Ltd. Method of automatically focusing using a quadratic function in camera
JP2005284203A (en) 2004-03-31 2005-10-13 Fuji Photo Film Co Ltd Digital still camera and its control method
US20050259175A1 (en) 2004-05-21 2005-11-24 Nikon Corporation Digital still camera and image processing system
US20060028579A1 (en) 2004-08-05 2006-02-09 Yutaka Sato Image pickup apparatus, method of controlling image pickup and program
US20060239672A1 (en) 2005-04-22 2006-10-26 Jason Yost Correlated auto-focus stabilization method and digital camera
JP2006295242A (en) 2005-04-05 2006-10-26 Olympus Imaging Corp Digital camera
US20070076922A1 (en) * 2005-09-30 2007-04-05 Sony United Kingdom Limited Object detection
US20070104472A1 (en) 2005-11-08 2007-05-10 Shuxue Quan Skin color prioritized automatic focus control via sensor-dependent skin color detection
EP1798961A1 (en) 2005-12-19 2007-06-20 BRITISH TELECOMMUNICATIONS public limited company Method for focus control
US20070216796A1 (en) * 2004-03-25 2007-09-20 Lenel Ursula R Focussing of a Digital Camera
US20070269196A1 (en) * 2006-05-16 2007-11-22 Fujifilm Corporation System for and method of taking image
US20080136958A1 (en) * 2006-12-11 2008-06-12 Pentax Corporation Camera having a focus adjusting system and a face recognition function
US7456874B1 (en) * 1999-06-04 2008-11-25 Fujifilm Corporation Image selecting apparatus, camera, and method of selecting image

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4274592B2 (en) * 1997-05-13 2009-06-10 オリンパス株式会社 Image processing device
US7027087B2 (en) * 1998-08-21 2006-04-11 Nikon Corporation Electronic camera
JP2006025311A (en) * 2004-07-09 2006-01-26 Konica Minolta Photo Imaging Inc Imaging apparatus and image acquisition method
JP4579169B2 (en) * 2006-02-27 2010-11-10 富士フイルム株式会社 Imaging condition setting method and imaging apparatus using the same
JP4182117B2 (en) * 2006-05-10 2008-11-19 キヤノン株式会社 IMAGING DEVICE, ITS CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6342922B1 (en) * 1995-06-15 2002-01-29 Canon Kabushiki Kaisha Image pickup apparatus having normal and high resolution modes
US7456874B1 (en) * 1999-06-04 2008-11-25 Fujifilm Corporation Image selecting apparatus, camera, and method of selecting image
JP2003348429A (en) 2002-05-27 2003-12-05 Nikon Corp Electronic camera, and image processing program
US20040130650A1 (en) 2002-10-09 2004-07-08 Samsung Techwin Co., Ltd. Method of automatically focusing using a quadratic function in camera
US20070216796A1 (en) * 2004-03-25 2007-09-20 Lenel Ursula R Focussing of a Digital Camera
JP2005284203A (en) 2004-03-31 2005-10-13 Fuji Photo Film Co Ltd Digital still camera and its control method
US20050259175A1 (en) 2004-05-21 2005-11-24 Nikon Corporation Digital still camera and image processing system
US20060028579A1 (en) 2004-08-05 2006-02-09 Yutaka Sato Image pickup apparatus, method of controlling image pickup and program
JP2006295242A (en) 2005-04-05 2006-10-26 Olympus Imaging Corp Digital camera
US20060239672A1 (en) 2005-04-22 2006-10-26 Jason Yost Correlated auto-focus stabilization method and digital camera
US20070076922A1 (en) * 2005-09-30 2007-04-05 Sony United Kingdom Limited Object detection
US20070104472A1 (en) 2005-11-08 2007-05-10 Shuxue Quan Skin color prioritized automatic focus control via sensor-dependent skin color detection
EP1798961A1 (en) 2005-12-19 2007-06-20 BRITISH TELECOMMUNICATIONS public limited company Method for focus control
US20070269196A1 (en) * 2006-05-16 2007-11-22 Fujifilm Corporation System for and method of taking image
US20080136958A1 (en) * 2006-12-11 2008-06-12 Pentax Corporation Camera having a focus adjusting system and a face recognition function

Also Published As

Publication number Publication date
KR20090052676A (en) 2009-05-26
GB2454957A (en) 2009-05-27
CN101442614A (en) 2009-05-27
KR101398475B1 (en) 2014-05-26
GB2454957B (en) 2013-01-02
GB0812579D0 (en) 2008-08-13
GB2492269A (en) 2012-12-26
GB201216559D0 (en) 2012-10-31
US20090128642A1 (en) 2009-05-21
GB2492269B (en) 2013-02-20

Similar Documents

Publication Publication Date Title
US8004596B2 (en) Apparatus for processing a digital image to automatically select a best image from a plurality of images and method of controlling the apparatus
US20060092297A1 (en) Method and apparatus for removing hot pixels in a digital camera
US20100123801A1 (en) Digital image processing apparatus and method of controlling the digital image processing apparatus
US20070132877A1 (en) Auto-focusing method using variable noise level and digital image processing apparatus using the same
KR101594291B1 (en) Apparatus for processing digital image and method for controlling thereof
KR101510101B1 (en) Apparatus for processing digital image and method for controlling thereof
KR20090097005A (en) Apparatus for processing digital image and method for controlling thereof
KR101378335B1 (en) Apparatus for processing digital image and method for controlling thereof
KR101411912B1 (en) Apparatus for processing digital image and method for controlling thereof
US20030117508A1 (en) Image-pickup apparatus, control method applied to the image-pickup apparatus, control program for operating computer used for the image-pickup apparatus
KR101396333B1 (en) Apparatus for processing digital image and method controlling thereof
JP6929145B2 (en) Imaging equipment, imaging methods and programs
KR101387407B1 (en) Apparatus of controlling digital image processing apparatus and method thereof
JP2008052022A (en) Imaging apparatus and imaging method
KR101510106B1 (en) Apparatus for processing digital image and method for controlling thereof
KR101444101B1 (en) Apparatus for processing digital image and method for controlling thereof
KR100468872B1 (en) Digital camera providing scale value and its deviation range, and control method thereof
KR101336924B1 (en) Apparatus for processing digital image and method for controlling thereof
KR20090077486A (en) Apparatus for processing digital image and method for controlling thereof
KR101537950B1 (en) Apparatus for processing digital image and method for controlling thereof
KR101436323B1 (en) Apparatus for processing digital image and method for controlling thereof
KR20100096521A (en) Apparatus for processing digital image and method for controlling thereof
KR101658034B1 (en) Digital Image Portable electronic apparatus and focus information display method thereof
KR101288914B1 (en) Method of controlling digital image processing apparatus and apparatus thereof
KR101436834B1 (en) Apparatus for processing digital image and method for controlling thereof

Legal Events

Date Code Title Description
AS Assignment

Owner name: SAMSUNG TECHWIN CO., LTD., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KOH, SUNG-SHIK;SUGIMOTO, KAZUHIKO;REEL/FRAME:021487/0052

Effective date: 20080523

AS Assignment

Owner name: SAMSUNG DIGITAL IMAGING CO., LTD., KOREA, REPUBLIC

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SAMSUNG TECHWIN CO., LTD.;REEL/FRAME:022951/0956

Effective date: 20090619

Owner name: SAMSUNG DIGITAL IMAGING CO., LTD.,KOREA, REPUBLIC

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SAMSUNG TECHWIN CO., LTD.;REEL/FRAME:022951/0956

Effective date: 20090619

AS Assignment

Owner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OF

Free format text: MERGER;ASSIGNOR:SAMSUNG DIGITAL IMAGING CO., LTD.;REEL/FRAME:026128/0759

Effective date: 20100402

ZAAA Notice of allowance and fees due

Free format text: ORIGINAL CODE: NOA

ZAAB Notice of allowance mailed

Free format text: ORIGINAL CODE: MN/=.

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20230823