JP4178017B2 - Image processing method and digital camera - Google Patents

Image processing method and digital camera Download PDF

Info

Publication number
JP4178017B2
JP4178017B2 JP2002313089A JP2002313089A JP4178017B2 JP 4178017 B2 JP4178017 B2 JP 4178017B2 JP 2002313089 A JP2002313089 A JP 2002313089A JP 2002313089 A JP2002313089 A JP 2002313089A JP 4178017 B2 JP4178017 B2 JP 4178017B2
Authority
JP
Japan
Prior art keywords
brightness
image
exposure
processing
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2002313089A
Other languages
Japanese (ja)
Other versions
JP2004153315A (en
Inventor
浩一 坂本
Original Assignee
富士フイルム株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士フイルム株式会社 filed Critical 富士フイルム株式会社
Priority to JP2002313089A priority Critical patent/JP4178017B2/en
Publication of JP2004153315A publication Critical patent/JP2004153315A/en
Application granted granted Critical
Publication of JP4178017B2 publication Critical patent/JP4178017B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image processing method and a digital camera that perform brightness correction using a face extraction technique.
[0002]
[Prior art]
In recent years, digital cameras are equipped with functions such as AE (automatic exposure) and AF (automatic focus adjustment) so that photographing can be performed more easily. Center-weighted metering is generally known as a metering method in this AE. However, in center-weighted metering, when shooting with a composition in which the main subject is not in the center, an appropriate exposure according to the main subject can be obtained. There is no problem. For example, in a composition in which the person who is the main subject is placed at the end of the frame, and the center of the background is white, the AE controls exposure according to the white color, so the amount of light is reduced and the person's face appears dark. Exposure failure such as end.
[0003]
As a means for solving the disadvantages of center-weighted metering, exposure control by so-called multi-pattern metering in which the amount of light is measured at a plurality of points is also performed. According to multi-pattern photometry, average exposure control is performed over the entire frame, and thus the problem in the case where the person who is the main subject is not in the center as described above is somewhat solved. However, for example, when a person is photographed with backlight, the AE is judged to be bright overall and exposure control is performed to reduce the amount of light regardless of the composition. The problem of being captured is not solved.
[0004]
[Problems to be solved by the invention]
As described above, center-weighted metering, multi-pattern metering, or a digital camera that can arbitrarily select them cannot perform exposure control so that the brightness of the face is appropriate depending on the situation at the time of shooting. However, in general photography where the subject of photography is a person or landscape, the person's face, especially the person's face, rather than the landscape, affects the quality of the photograph (or image data). It is desired that the part is appropriately brightened.
[0005]
The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an image processing method and a digital camera that make a person's face have good brightness (luminance) by correcting the brightness of the image.
[0006]
[Means for Solving the Problems]
The image processing method of the present invention is an image processing method of a digital camera that performs exposure and focus adjustment by half-pressing a shutter button, and acquires and records a recorded image after exposure and focus adjustment by fully pressing the shutter button. Detecting a half-press to obtain a reduced image after exposure and focus processing; detecting the full-press and analyzing the reduced image after exposure and focus processing to extract a human face region; and Calculating a difference value between the brightness value of the extracted face area and the brightness value at an appropriate brightness of the face as a correction amount at which the brightness of the extracted face area is an optimum value; and based on the correction amount, And correcting the brightness of the recorded image when pressed.
[0008]
The digital camera of the present invention detects half-press in a digital camera that performs exposure and focus adjustment by half-pressing the shutter button, and acquires and records a recorded image after exposure and focus adjustment by full-pressing the shutter button. Means for acquiring a reduced image after exposure and focus processing, means for detecting the full press and analyzing the reduced image after exposure and focus processing to extract a human face region, and Means for calculating a difference value between the brightness value and the brightness value at the appropriate brightness of the face as a correction amount at which the brightness of the extracted face area is an optimum value; and the recording at the time of full pressing based on the correction amount it is intended and means for correcting the brightness of the image.
[0009]
According to the above-described invention, the brightness of the recorded image is corrected based on the correction amount at which the brightness of the face area extracted from the image is an optimum value, so that the face portion of the person can be recorded with good brightness (luminance). An image is obtained.
[0010]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a digital camera according to an embodiment of the present invention. Mainly, a lens 101, a CCD 102, an analog signal processing unit 103, an A / D converter 104, a TG (timing generator) 105, and a control unit. 106, a digital signal processing unit 107, a memory 108, a compression / decompression unit 109, an LCD 110, a recording unit 111, a shutter button 112, an operation switch 113, a face extraction processing unit 114, and a correction amount calculation unit 115.
[0011]
Specifically, the lens 101 is a zoom lens (focal length variable lens) having an AF (automatic focus adjustment) mechanism, and the AF mechanism and the zoom mechanism of the lens 101 are driven by a drive circuit (not shown). Instead of the zoom lens, a focal length configuration lens having only an AF mechanism may be used.
[0012]
The CCD 102 is an optical sensor having a large number of light receiving elements arranged in a matrix or honeycomb, and is arranged at a position inside the camera body corresponding to the focal position of the lens 101.
[0013]
The analog signal processing unit 103 performs predetermined analog processing on the image signal output from the CCD 102, and outputs it as R, G, and B signals for each pixel. The analog signal processing unit 103 includes a CDS (correlated double sampling) circuit, an AGC (auto gain control) circuit, and the like. The CDS circuit reduces noise of the image signal, and the AGC circuit adjusts the gain of each image signal by adjusting the gain. Level adjustment is performed.
[0014]
The A / D converter 33 converts the R, G, and B signals sequentially added from the analog signal processing unit 32 into digital R, G, and B signals and outputs them.
[0015]
The timing generator 105 gives timing signals to the CCD 102, the analog signal processing unit 103, and the A / D converter 104, and the circuits are synchronized by the timing signals.
[0016]
The control unit 106 controls the operation of each unit connected by the bus and performs overall control related to the imaging operation of the digital camera. Also, it functions as a control means for controlling AF (automatic focus adjustment), AE (automatic exposure), AW (auto white balance), and the like based on inputs from the shutter button 112 and other operation switches 113. The control unit 106 performs various functions in software as well as data transfer with the peripheral configuration and timing control.
[0017]
The digital signal processing unit 107 performs various processes such as white balance correction, gamma (γ) correction, contour correction, color correction, and YC processing on the input image data. Further, brightness correction is performed based on a brightness correction amount that optimizes the brightness of the face described later. Image data converted into a luminance signal (Y signal) and a color difference signal (Cr, Cb signal) by the digital signal processing unit 107 is stored in a memory 108 for temporary storage of image data via a bus. The YC signal is compressed in accordance with a predetermined format by the compression / decompression unit 109 and then recorded on a recording medium such as a memory card via the recording unit 111.
[0018]
The memory 108 is constituted by a DRAM or the like, and functions as a buffer memory that temporarily stores acquired image data. In order to perform various processes, the image data is read out to each unit connected via the bus, and is written again after the process.
[0019]
The compression / decompression unit 109 compresses the image data stored in the memory 108 by a predetermined compression method such as the JPEG method and records the compressed image data on a recording medium loaded in the recording unit 111 or reads the image data from the recording medium. Or stretch. Image data when the compression / decompression unit 109 performs compression processing is converted into luminance data Y and color difference data Cr and Cb (YC separation processing) and stored in the memory 37. On the other hand, when the image data recorded on the recording medium is reproduced and displayed, the luminance signal and color difference signal generated by YC separation are converted into RGB signals.
[0020]
The LCD 110 is a display for image display, and is driven by an LCD driver (not shown) based on RGB signals. The image data temporarily stored in the memory 108 is transferred to the LCD 110 after predetermined processing, and a color image is displayed. At the time of shooting, the shooting range can be accurately determined by using the LCD as a viewfinder.
[0021]
The recording unit 111 records the acquired image data and tag information for each image data on a recording medium such as a memory card. When recording is instructed by pressing the shutter button 112 fully (that is, acquisition of image data), the specific processing of recording is the thumbnail image of the image stored in the memory 108 after completion of the series of image processing and the JPEG method. A compressed image compressed by the above is generated, and both images together with tag information (frame number, exposure value, shutter speed, compression rate, shooting date, flash on / off data at the time of shooting, scene information, etc.) relating to the shot image Is recorded on the recording medium.
[0022]
The recording medium is not limited to a memory card such as a semiconductor recording medium, but an optical recording medium such as a DVD-RAM, DVD-RW, or CD-RW, a magnetic recording medium such as a floppy disk, or a magneto-optical such as MO. A recording medium or the like can also be used, and is not limited to an external recording medium, and may be a built-in recording medium such as a hard disk.
[0023]
The shutter button 112 is a switch for instructing the digital camera to start shooting. The shutter button 112 is a two-stage switch that can detect a half-pressed state and a fully-pressed state. Adjustment) control, AE (automatic exposure) control, and acquisition of an image for face area extraction are performed. When the shutter button 112 is fully pressed, shooting, brightness correction processing (to be described later), and image data recording are performed.
[0024]
In the AE control, a shutter speed and an aperture are automatically set based on luminance detection and luminance determination. In the luminance detection, the luminance values of the respective color components of the image data given by R, G, and B are summed over the entire image using the image data captured by the CCD 101 at predetermined intervals and stored in the memory 108. On average. The shutter speed and aperture setting are determined based on the determination result of the brightness of the subject based on the luminance determination.
[0025]
In the AF control, focusing is performed by moving the lens 101 while obtaining an approximate contrast value of the entire image data as an AF evaluation value. For example, the AF motor drive circuit drives the AF motor so that the high-frequency component of the G signal is maximized when the shutter button is half-pressed, and the lens is moved to the in-focus position to perform autofocus.
[0026]
The face area extraction processing unit 114 has a memory that holds image data acquired by half-pressing the shutter button 112, and a face extraction function that extracts an area corresponding to a human face present in the image from the image data. . The face extraction processing is performed on image data that has undergone processing such as contour correction by the digital signal processing unit 107. A known technique (Japanese Patent Laid-Open No. 9-101579) can be used as a method for extracting a face region.
[0027]
The correction amount calculation unit 115 calculates the brightness (luminance value) of the extracted face area, and calculates a correction value from the difference between the calculated brightness and the appropriate brightness.
[0028]
The face extraction process and the correction amount calculation process are not performed in a period after a half-press of the shutter button, which requires a short process, because the processing time is relatively long. Perform in the period after full pressing.
[0029]
Next, the operation of the digital camera according to the embodiment of the present invention will be described with reference to the flowchart shown in FIG.
[0030]
When the power switch of the digital camera is on (step S101) and the “shooting” mode is on (step S102), the control unit 106 detects half-pressing (S1) of the shutter button 112 (step S103). .
[0031]
When half-pressing of the shutter button 112 is detected, AE and AF are executed in accordance with an instruction from the control unit 106 (step S104), and the image data acquired by determining the in-focus and proper exposure by the AE and AF is obtained. Stored in the memory 108. The same image data is also stored in the memory in the face area extraction processing unit 114 for face area extraction (step S105). The stored image data is a reduced image (for example, an image size of about VGA) thinned out in the CCD thinning mode.
[0032]
Next, the control unit 106 detects full press (S2) of the shutter button 112 (step S106). If the shutter button 112 has not been pressed, the elapse of the predetermined time is determined in step S107, and if the predetermined time has not elapsed, the return detection in step S106 is repeated. If the predetermined time has elapsed, it is determined that the shooting operation is not performed, and the process returns to step S103.
[0033]
When the full press of the shutter button 112 is detected in step S106, brightness correction processing including image recording and brightness correction is performed according to an instruction from the control unit 106 (step S108).
[0034]
FIG. 3 is a flowchart showing the procedure of brightness correction processing performed on an image acquired for recording. When the full press of the shutter button 112 is detected, the control unit 106 performs image recording and brightness correction processing.
[0035]
In order to perform brightness correction processing, the face area extraction processing unit 114 performs face area extraction processing on the image data stored in the memory in the face area extraction processing unit in step S105 (step S201). Next, when the subject of the image data is a person and a face area exists, the brightness value of the extracted face area is calculated (step S202).
[0036]
Next, a correction value for performing brightness correction processing performed on image data acquired for recording is calculated (step S203). The correction value is a difference value between the luminance value calculated in step S202 and the luminance value at the appropriate brightness of the face.
[0037]
As described above, an image for recording is acquired from the CCD 102 simultaneously with the full press of the shutter button 112 in step S204, and the image data subjected to signal processing is temporarily stored in the memory 108. The recording image data temporarily stored in the memory 108 is read again to the digital signal processing unit 107, and the digital gain is adjusted based on the correction value calculated in step S203, and brightness correction image processing is performed. (Step S205).
[0038]
Returning to the flowchart of FIG. 2, the image data that has been subjected to the brightness correction process is temporarily stored again in the memory 108, and after performing necessary processes such as YC processing and compression processing, the recording unit 111 performs recording processing. To be recorded. In addition, an image is displayed on the LCD 110 as necessary (step S109).
[0039]
Through the above processing, the image data acquired for recording is recorded in a state where the brightness of the face of the subject is appropriately corrected. As a result, the subject is not at the center of the frame (in the case of center-weighted metering) or is backlit, and exposure control is not performed according to the subject's face, and the face is not captured when shooting (when acquiring image data). Even if the image data has an inappropriate brightness, when it is stored in the recording medium, it is automatically corrected so that the brightness of the face is appropriate.
[0040]
In the above processing, when a plurality of face regions are extracted by the face region extraction process (that is, when a plurality of persons are imaged as subjects), a luminance value is obtained in the plurality of regions and an average is calculated. Alternatively, appropriate condition setting is performed as appropriate, such as setting the luminance value of only a region having a large area as a representative value.
[0041]
Further, the face area extraction process does not always have to be performed at the time of shooting. For example, the face area extraction process is executed only at the time of shooting when a mode for shooting a person (for example, portrait shooting mode) is set. You may do it. By controlling on / off of the face area extraction processing unit in the mode setting, unnecessary operations such as performing face area extraction processing on image data in which a person has not been photographed are prevented, thereby reducing power consumption. be able to.
[0042]
【The invention's effect】
As described above, according to the present invention, the brightness of a person's face is improved by correcting the brightness of the recorded image based on the correction amount at which the brightness of the face area extracted from the image is an optimum value. A recorded image of (luminance) can be obtained.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a configuration of a digital camera according to an embodiment of the present invention.
FIG. 2 is a flowchart showing a procedure of image processing in the digital camera.
FIG. 3 is a flowchart showing a procedure of brightness correction in image processing.
[Explanation of symbols]
101 Lens 102 CCD
103 Analog processing unit 104 A / D converter 105 Timing generator 106 Control unit 107 Digital signal processing unit 108 Memory 109 Compression / decompression unit 110 LCD
111 Recording unit 112 Shutter button 113 Operation switch 114 Face extraction processing unit 115 Correction amount calculation unit

Claims (2)

  1. In the image processing method of a digital camera that performs exposure and focus adjustment by half-pressing the shutter button, and acquires and records a recorded image after exposure and focus adjustment by fully pressing the shutter button.
    Detecting the half-press to obtain a reduced image after exposure and focus processing; detecting the full-press and analyzing the reduced image after exposure and focus processing to extract a human face region; Calculating a difference value between the brightness value of the extracted face area and the brightness value at the appropriate brightness of the face as a correction amount at which the brightness of the extracted face area is an optimum value, and based on the correction amount And correcting the brightness of the recorded image when fully pressed.
  2. In a digital camera that performs exposure and focus adjustment by half-pressing the shutter button, and acquires and records the recorded image after exposure and focus adjustment by fully pressing the shutter button.
    Means for detecting the half-press to obtain a reduced image after exposure and focus processing; and means for detecting the full-press and analyzing the reduced image after exposure and focus processing to extract a human face area; Calculating a difference value between the brightness value of the extracted face area and the brightness value at the appropriate brightness of the face as a correction amount at which the brightness of the extracted face area is an optimum value, and based on the correction amount A digital camera comprising means for correcting the brightness of the recorded image when fully pressed.
JP2002313089A 2002-10-28 2002-10-28 Image processing method and digital camera Active JP4178017B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2002313089A JP4178017B2 (en) 2002-10-28 2002-10-28 Image processing method and digital camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2002313089A JP4178017B2 (en) 2002-10-28 2002-10-28 Image processing method and digital camera

Publications (2)

Publication Number Publication Date
JP2004153315A JP2004153315A (en) 2004-05-27
JP4178017B2 true JP4178017B2 (en) 2008-11-12

Family

ID=32457803

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2002313089A Active JP4178017B2 (en) 2002-10-28 2002-10-28 Image processing method and digital camera

Country Status (1)

Country Link
JP (1) JP4178017B2 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7636123B2 (en) 2005-04-26 2009-12-22 Canon Kabushiki Kaisha Image capturing apparatus with light emission controlling mechanism and method of controlling the image capturing apparatus
JP4537255B2 (en) * 2005-04-28 2010-09-01 富士フイルム株式会社 Imaging apparatus and imaging method
CN100553295C (en) * 2006-07-07 2009-10-21 奥林巴斯映像株式会社 The image processing method of camera, camera
JP5319078B2 (en) * 2006-07-07 2013-10-16 オリンパスイメージング株式会社 Camera, camera image processing method, program, and recording medium
JP2009063674A (en) * 2007-09-04 2009-03-26 Canon Inc Imaging apparatus and flash control method
JP5040830B2 (en) * 2008-06-27 2012-10-03 株式会社ニコン Imaging device
JP2010226416A (en) * 2009-03-24 2010-10-07 Nikon Corp Digital camera
JP4678060B2 (en) * 2009-03-25 2011-04-27 株式会社ニコン Imaging apparatus and image processing program
US10735664B2 (en) 2017-02-28 2020-08-04 Mitsubishi Electric Corporation Image shooting control device for vehicle, driver monitoring device, image shooting control method for vehicle, and driver monitoring method

Also Published As

Publication number Publication date
JP2004153315A (en) 2004-05-27

Similar Documents

Publication Publication Date Title
US7796831B2 (en) Digital camera with face detection function for facilitating exposure compensation
JP3427454B2 (en) Still camera
JP4567593B2 (en) Imaging apparatus and imaging method
JP4305598B2 (en) Camera aperture control method and apparatus, and camera
JP4532813B2 (en) Strobe device and camera
US8014661B2 (en) Imaging device and imaging method
US7317481B2 (en) Image data correction processing based on sensitivity
US7158182B2 (en) Camera that engages in a focusing operation through a contrast method
US8346073B2 (en) Image taking apparatus
JP4127491B2 (en) Camera with auto focus function
JP4543602B2 (en) camera
JP4588583B2 (en) Imaging apparatus and focus control method
JP4657052B2 (en) Digital camera, shooting method, and shooting control program.
US7817915B2 (en) Image taking system
US7295241B2 (en) Image capturing apparatus, image capturing method, and computer-readable medium storing a program for an image capturing apparatus
US8284264B2 (en) Imaging apparatus, method, and program
JP4200428B2 (en) Face area extraction method and apparatus
US7362370B2 (en) Image capturing apparatus, image capturing method, and computer-readable medium storing program using a distance measure for image correction
US8797423B2 (en) System for and method of controlling a parameter used for detecting an objective body in an image and computer program
US6636263B2 (en) Digital camera having a continuous photography mode
EP1992160B1 (en) Imaging apparatus and exposure control method
JP4008778B2 (en) Imaging device
US20030063211A1 (en) Camera
JP5025532B2 (en) Imaging apparatus, imaging apparatus control method, and imaging apparatus control program
US20020122121A1 (en) Digital camera

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20050215

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20060325

A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A712

Effective date: 20061124

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20070621

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20070627

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20070827

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20070919

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20071120

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20080409

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20080508

A911 Transfer of reconsideration by examiner before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20080620

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20080806

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20080825

R150 Certificate of patent or registration of utility model

Ref document number: 4178017

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110829

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110829

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120829

Year of fee payment: 4

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120829

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130829

Year of fee payment: 5

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250