JP2013171433A - Digital camera, and image processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize, when performing color correction of an image of a characteristic part of a subject's face, suitable color correction while suppressing discomfort to the entire image.SOLUTION: A digital camera comprises: an imaging unit that photographs a subject image and creates an image; a detection unit that detects a face part of the subject person; an analysis unit that analyzes color distribution of parts of the image except the face part; and image processing unit that performs color correction of the image of a characteristic part of the face part detected by the detection unit. The image processing unit determines a representative color that represents parts except the face part on the basis of an analysis result of the analysis unit, and changes at least one of color tone, color saturation, and brightness included in correction conditions of color correction.

Description

  The present invention relates to a digital camera and an image processing program.

  Conventionally, a technique for performing various image processing on a digital image by image processing has been considered. For example, the image processing method disclosed in Patent Document 1 described below improves the appearance of a woman in an output image by extracting parts such as lips from input image data and performing color correction.

JP 2001-2108020 A

  However, in the image processing method of Patent Document 1 described above, color correction is performed based on the color of the part that is subject to color correction. There were times when it became an image.

  The present invention has been made in view of the above problems, and an object of the present invention is to realize a suitable color correction while suppressing a sense of incongruity of the entire image when performing color correction of an image on a facial feature of a subject. And

  The digital camera of the present invention includes an imaging unit that captures a subject image to generate an image, a detection unit that detects a face portion of a subject person from the image, and a portion of the image excluding the face portion. An analysis unit that analyzes a color distribution; and an image processing unit that performs color correction of an image on a feature portion of the face portion detected by the detection unit, the image processing unit based on an analysis result by the analysis unit Thus, a representative color representing the portion excluding the face portion is obtained, and at least one of hue, saturation, and lightness included in the correction condition of the color correction is changed according to the representative color.

  The image processing unit may divide the portion excluding the face portion into a plurality of regions based on the analysis result, and may use the color of the region with the largest occupied area as the representative color.

  Further, the image processing unit divides a portion excluding the face portion into a plurality of regions based on the analysis result, determines a representative region according to an in-focus state of each region, and sets the color of the representative region. The representative color may be used.

  Further, the image processing unit may obtain an average value of colors of portions excluding the face portion, and may use a color corresponding to the average value as the representative color.

  Further, the image processing unit divides a portion excluding the face portion into a plurality of regions based on the analysis result, and divides the region based on at least one of a color, an occupied area, and an in-focus state of each region. It is also possible to determine the weight of each of the regions, and obtain the representative color in consideration of the weight.

  In addition, a display unit that displays the image, a reception unit that receives a user operation, and a plurality of color candidates that differ in at least one of hue, saturation, and brightness as the correction condition candidates based on the analysis result A selection unit that displays the plurality of color candidates, and the reception unit receives a user operation for selecting any one of the plurality of color candidates, and the image The processing unit may change at least one of hue, saturation, and lightness included in the correction condition in accordance with a color candidate selected by the user via the reception unit.

  The image processing unit stores color candidates selected by the user via the receiving unit, and at least one of hue, saturation, and brightness included in the correction condition according to the selection frequency of each color candidate. You may change one.

  In addition, the image processing unit changes at least one of hue, saturation, and brightness included in the correction condition in consideration of at least one of information on a date and time when the image is generated and information on a place. May be.

  In addition, a configuration obtained by converting the configuration related to the above invention into an image processing program for realizing image processing for image data to be processed is also effective as a specific aspect of the present invention.

  According to the present invention, it is possible to realize suitable color correction while suppressing a sense of incongruity of the entire image when performing color correction of an image on a feature portion of a face of a subject.

It is a functional block diagram of the digital camera of this embodiment. It is a flowchart which shows operation | movement of the control part 7 when an imaging instruction | indication is performed. It is a flowchart which shows operation | movement of the control part 7 at the time of performing makeup processing. It is a figure which shows an example of a to-be-photographed object. It is a figure explaining HSV color space. It is a figure explaining the definition of "light red." It is a figure explaining the definition of "dark blue". It is a figure which shows another example of a to-be-photographed object. It is another flowchart which shows operation | movement of the control part 7 at the time of performing makeup processing. It is a figure which shows the example of a display of the candidate conditions of color correction. It is another figure which shows the example of a display of the candidate conditions of color correction.

  Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing the configuration of the digital camera 1 according to the first embodiment of the present invention. As shown in FIG. 1, the digital camera 1 includes an imaging lens 2, an imaging device 3, an A / D conversion unit 4, a buffer memory 5, an image processing unit 6, a control unit 7, a display unit 8, an operation unit 9, and a memory 10. A recording I / F unit 11, a recording medium 12, a connection unit 13, a communication unit 14, and a bus 15.

  The imaging lens 2 forms a subject image on the imaging surface of the imaging element 3. The imaging lens 2 may be an imaging optical system including a plurality of lenses such as a zoom lens and a focus lens. The imaging element 3 photoelectrically converts the subject light that has passed through the imaging lens 2 and outputs analog image signals corresponding to R, G, and B colors. The imaging device 3 performs thinning-out reading at predetermined intervals during non-imaging, and acquires a through image (image for composition confirmation). Thereafter, the image sensor 3 acquires the main image when a release button 18 described later is fully pressed.

  An image signal output from the image sensor 3 is input to the A / D converter 4. The A / D conversion unit 4 performs A / D conversion on the analog image signal output from the image sensor 3 and changes it to a digital image signal. The digital image signals are collected into one frame and recorded in the buffer memory 5 as image data. The buffer memory 5 temporarily records image data in the pre-process and post-process of image processing by the image processing unit 6.

  The image processing unit 6 performs image processing on the image data recorded in the buffer memory 5. Examples of the image processing include well-known white balance adjustment, color interpolation, gradation conversion processing, and contour enhancement processing. The image processing unit 6 also executes a process of compressing in JPEG (Joint Photographic Experts Group) format or the like before recording an image file on the recording medium 12, and a process of decompressing and restoring the compressed data.

  Further, the image processing unit 6 corrects the color of the characteristic part (eyebrow, eyes, mouth, etc.) in the face as a makeup process. For example, the image processing unit 6 performs color correction for increasing the bluish color for the upper eyelid color and color correction for increasing the red color for the lip color. Thereby, since the effect of point makeup such as eye shadow and lipstick is obtained, the appearance of a woman as a subject can be improved. Specific processing is known from Japanese Patent Application Laid-Open No. 2001-218020. Note that the image processing unit 6 may also adjust the shape of the feature portion of the face during the makeup process. For example, the image processing unit 6 may perform correction for increasing the size of the eyes or correction for reducing the width of the nose.

  In addition to this, the image processing unit 6 may perform the following processing. These processes are examples of so-called skin beautification processes.

  For example, the image processing unit 6 performs exposure correction for correcting the exposure of the image to the over side. Thereby, a preferable image in which the skin of the subject is expressed white can be obtained.

  The image processing unit 6 performs soft focus processing. The soft focus process is performed using, for example, a filter showing a predetermined soft focus effect, a low-pass filter, or the like. Note that soft focus processing may be performed by generating a mask image from the original image and combining the image after filtering and the original image based on the generated mask image. By such soft focus processing, when the subject is a woman, femininity is emphasized, and a preferable soft image can be obtained. In addition, it is possible to obtain a preferable image in which wrinkles of the subject, unevenness such as acne, rough skin, and the like are hardly noticeable.

  Further, the image processing unit 6 may correct the saturation parameter and the brightness parameter to express the skin white, reduce the dullness of the skin color, and the like.

  Further, the image processing unit 6 performs correction to make the person included in the image look slim. For example, the image processing unit 6 changes the aspect ratio of the image to be slightly long and then cuts out a person portion and adjusts the size of the image. Alternatively, the image processing unit 6 may correct the outline of the face and make the cheek look thin as disclosed in Japanese Patent Application Laid-Open No. 2004-264893. Also, the outline of the face may be enhanced by sharpening processing, or the angle of the mouth corner and the outline of the chin may be corrected using a distortion correction technique.

  Further, the image processing unit 6 may reduce the shine that is likely to occur due to strong light such as flashing by performing highlight suppression processing. Moreover, you may perform the correction | amendment which makes skin look fresh by emphasizing a part partially.

  In addition to the above-described processing, the image processing unit 6 may perform processing such as dynamic range expansion, dark portion correction, edge unsharp mask processing, and noise processing.

  Such skin beautification processing is useful not only for improving the appearance of a woman but also for a subject such as a man or a child because his face can be brightly photographed.

  The control unit 7 performs overall control of the digital camera 1 according to a predetermined sequence program, and executes various calculations (AF, AE, etc.) necessary for imaging. The control unit 7 has the function of the face detection unit 16.

  The face detection unit 16 extracts feature points from the through image, the main image, and the image recorded on the recording medium 12, and detects the face area, the size of the face area (face area), and the like. For example, the face detection unit 16 extracts a face region by a feature point extraction process described in Japanese Patent Application Laid-Open No. 2001-16573. Examples of the feature points include eyebrow, eye, nose, and lip end points, face contour points, head apexes, and chin lower end points. Then, the face detection unit 16 specifies the position information of the face area. For example, the face detection unit 16 calculates the X coordinate and the Y coordinate of the pixels included in the face area, with the horizontal direction of the image as the X axis and the vertical direction as the Y axis. Furthermore, the face detection unit 16 determines the race, age, gender, and the like of the detected person by arithmetic processing using feature points described in Japanese Patent Application Laid-Open No. 2004-222118.

  The display unit 8 displays various images under the control of the control unit 7. Various images displayed on the display unit 8 include a through image, a main image, an image recorded on the recording medium 12, a menu image, and the like. The display unit 8 includes a touch panel 17. The touch panel 17 detects a position where a finger or a stylus is touched on the panel, a dragged direction, and the number of times the drag is performed. The state of the touch panel 17 is detected by the control unit 7. Note that the touch panel 17 is configured by a transparent panel having a size equivalent to that of the display unit 8 because the touch panel 17 is stacked on the entire surface of the display unit 8. Moreover, in the example of this embodiment, the touch panel 17 is comprised with the electrostatic capacitance type panel which senses the electrical signal by static electricity. Not only the capacitance type, but also a resistive film type panel that detects a change in voltage due to pressure may be used.

  The operation unit 9 includes a release button 18, a cross key 19, and the like. The release button 18 is operated by the user during imaging. The cross key 19 is operated on the above menu image or the like. The states of the release button 18 and the cross key 19 are detected by the control unit 7, and a sequence based on the detected button state is executed. The recording I / F unit 11 includes a connector for connecting the recording medium 12. When the recording I / F unit 11 and the recording medium 12 are connected, data writing / reading is executed on the recording medium 12.

  The connection unit 13 includes input / output terminals and the like, and is connected to an external device of the digital camera 1 to input / output image data and the like. The communication unit 14 communicates with a device external to the digital camera 1 by wireless or wired. The bus 15 connects the buffer memory 5, the image processing unit 6, the control unit 7, the display unit 8, the memory 10, and the recording I / F unit 11 to execute data and signal input / output.

  The digital camera 1 having the above-described configuration has a makeup processing mode in which the makeup processing described above is performed on an image generated by imaging. The makeup processing mode is provided independently of existing scene modes such as portrait mode and landscape mode. That is, the makeup processing mode is a mode that can be set in addition to the existing scene mode. The makeup processing mode is automatically set by the control unit 7. Further, existing scene modes such as portrait mode and landscape mode are set by user designation via the operation unit 9 or the touch panel 17.

  In addition to the automatic setting by the control unit 7, the makeup processing mode may be set by user designation via the operation unit 9 or the touch panel 17. When the user designates, a dedicated button or the like may be provided on the operation unit 9 or a menu screen or the like may be displayed on the display unit 8. Further, the makeup processing mode may be provided as one of existing scene modes.

  The operation of the control unit 7 when the above-described makeup processing mode is set and an imaging instruction is given by a user operation via the release button 18 will be described with reference to the flowchart shown in FIG.

  In step S <b> 1, the control unit 7 determines shooting conditions for shooting a subject image, as in the known technique. The control unit 7 may determine a preferable shooting condition when the makeup processing mode is set. For example, exposure, shooting sensitivity, and the like may be conditions suitable for the makeup processing mode.

  In step S <b> 2, the control unit 7 controls the imaging lens 2, the imaging device 3, the A / D conversion unit 4, and the like to capture a subject image and generate an image.

  In step S3, the controller 7 causes the face detector 16 to perform face detection and face recognition on the image generated in step S2. Furthermore, the control unit 7 may perform face recognition processing based on a face image of a specific person registered in advance. For example, based on the face feature points detected by the face detection described above, the position of the face feature points, the size of each face part, the relative distance of each feature point, etc. included in the image generated in step S2 are calculated. To do. Then, the calculation result and the image data of the face image of the specific person registered in advance are compared to obtain the similarity. The image processing unit 6 determines that the specific person registered in advance is matched when the obtained similarity exceeds a predetermined threshold. Further, the same face detection and face recognition may be performed at the time of shooting a through image, and the result may be used. However, high-speed processing is required during shooting of a through image. Therefore, more simplified face detection and face recognition may be performed when a through image is captured. Furthermore, a configuration may be adopted in which facial expression recognition is performed based on the results of face detection and face recognition performed during the shooting of a through image, and the imaging timing is controlled based on the recognition results. For example, the face detection unit 16 recognizes the facial expression of the main subject based on the above-described face detection and face recognition results. Then, the control unit 7 reduces the possibility of shooting failure by performing imaging at a timing when the recognized facial expression is in a predetermined state such as a state where the eyes are not blinking or a state of smile, and preferable imaging is performed. Can be realized. For facial expression recognition, for example, the face detection unit 16 can use techniques described in Japanese Patent Application Laid-Open Nos. 2004-272933 and 2001-51338.

  In step S4, the control unit 7 controls the image processing unit 6 to perform a makeup process on the image generated in step S2 based on the results of face detection and face recognition performed in step S3. Details of the makeup process will be described later. Note that the control unit 7 may record information indicating the contents of the makeup process in the Exif information (supplementary information) of the image generated in step S2. By recording such information, the user can confirm what makeup processing has been performed at the time of image reproduction. Note that the information indicating the contents of the makeup process may be recorded as a separate file associated with the image instead of being recorded as supplementary information.

  In step S5, the control unit 7 records the image subjected to the make process in step S4 on the recording medium 12 via the recording I / F unit 11, and ends the series of processes.

  Next, the makeup process described in step S4 of the flowchart of FIG. 2 will be described with reference to the flowchart shown in FIG.

  In step S11, the control unit 7 determines a condition for the makeup process. Based on the results of face detection and face recognition performed in step S3 in FIG. 2, the control unit 7 extracts feature portions (eyebrows, eyes, mouth, etc., hereinafter referred to as “parts”) in the face, and each of them. Determine the conditions for makeup processing of parts. The conditions for makeup processing include conditions for color correction of each part, conditions for shape adjustment, and the like. These conditions are performed in the same manner as known technology via the display unit 8, the operation unit 9, the touch panel 17, and the like. Further, the makeup processing conditions may be performed in advance prior to shooting.

  In the following, a case where only one person is included in the target image as shown in FIG. 4 will be described as an example. In the following, a case where the color of the lip portion L in the face region F in FIG. 4 is corrected will be described as an example. When a plurality of persons are included in the target image, the same processing may be performed sequentially or the same processing may be performed collectively. The same processing is sequentially performed for parts other than the lips (eg, eyebrows, eyes, cheeks).

  In the present embodiment, the HSV color space is used when expressing colors. As shown in FIG. 5, the HSV color space includes “hue (H)” indicating the type of color, “saturation (S)” indicating the vividness of the color, and “brightness (V)” indicating the brightness of the color. It consists of three elements. Hue (H) is indicated by a value from 0 to 360, and saturation (S) and lightness (V) are indicated by a value from 0 to 100.

  Here, description will be made assuming that the condition for correcting the color of the lip portion L in the face region F in FIG. 4 to “light red” is determined as the color correction condition. As shown in FIG. 6, “light red” is a color defined by hue (H) = 0, saturation (S) = 33, and lightness (V) = 100.

  In step S12, the control unit 7 analyzes the color distribution of the region excluding the face detected by the face detection performed in step S3 of FIG. In the example of FIG. 4, the control unit 7 analyzes the color distribution of the area excluding the face area F.

  In step S13, the control unit 7 obtains a representative value of the region excluding the face based on the analysis result of the color distribution performed in step S12. In this case, the “region excluding the face” includes all the regions excluding the face region F. For example, the representative color is selected in consideration of the color of the clothes worn by the person and the color of the hair. Can be sought. As an example, taking clothes worn by a person as an example, the complexion may appear dull only when wearing certain clothes. In such a case, a color contrast phenomenon is involved. For example, in saturation contrast, a color surrounded by high saturation colors appears to be duller than it actually is. Therefore, by obtaining the representative value by the method described above, it is possible to obtain a representative color considering such a color contrast phenomenon.

  The control unit 7 obtains the representative value by any of the following methods.

  (1) A method of dividing a region excluding a face into a plurality of regions based on colors and obtaining a representative value using a color of a region having the largest occupied area as a representative color.

  In the example of FIG. 4, the control unit 7 selects the empty region B1 having the largest occupied area from the empty region B1, the sea region B2, and the sandy beach region B3 having the largest occupied area among the regions other than the face region F. A representative value is obtained using a color as a representative color.

  By obtaining the representative value by this method, the representative color can be obtained in consideration of the color included in the background and the area occupied by each region.

  (2) A method in which a region excluding a face is divided into a plurality of regions based on colors, and a representative value is obtained using a color in a region with the best focus state as a representative color.

  The control unit 7 selects a region with the best in-focus state based on the frequency component of each region, AF information at the time of shooting, and the like. In the example of FIG. 4, the control unit 7 is present in the foreground among the regions other than the face region F, and thus obtains a representative value using the color of the palm leaf region B4 in the best focus state as the representative color. .

  By obtaining the representative value by this method, the representative color can be obtained in consideration of the color included in the background and the in-focus state of each region.

  (3) A method of obtaining a representative value using the average color of the region excluding the face as a representative color.

  In the example of FIG. 4, the control unit 7 obtains an average color of an area excluding the face area F, and obtains a representative value using this color as a representative color.

  By obtaining the representative value by this method, the representative color can be easily obtained.

  (4) The area excluding the face is divided into a plurality of areas based on the color. Then, the weight of each region is determined based on at least one of the area occupied by each region and the in-focus state. Then, a method for obtaining a representative value by considering the determined weight and obtaining a representative value using the color of the representative region as a representative color.

  The control unit 7 determines the weight of each region by a predetermined method based on the occupied area described in (1) and the in-focus state described in (2). Then, for example, the representative value is obtained by calculating the average value described in (3) with the weight added.

  By obtaining the representative value by this method, the representative color corresponding to the detailed color distribution of the background can be obtained.

  In addition, you may obtain | require a representative color combining 2 or more methods among the methods demonstrated by said (1) to (4). In the following description, a case where a representative value is obtained using the color of the sky region B1 (“dark blue”) as a representative color will be described as an example. “Dark blue” is a color defined by hue (H) = 200, saturation (S) = 100, brightness (V) = 66, as shown in FIG.

  In step S14, the control unit 7 changes the color correction condition among the makeup conditions determined in step S11 based on the representative value obtained in step S13.

  The color correction conditions determined in step S11 are “light red” with hue (H) = 0, saturation (S) = 33, and lightness (V) = 100. The representative value obtained in step S13 is the hue. “Dark blue” with (H) = 200, saturation (S) = 100, and lightness (V) = 66.

  Of the color correction conditions, the control unit 7 changes the hue so as to approach the representative value by a predetermined value (for example, 20). That is, the hue (H) = 0 (= 360) of the color correction condition is brought close to the hue (H) = 200 of the representative value, and the hue (H) = 340 of the color correction condition after the change is set. As a result of this change, the color correction condition for the makeup after the change is changed to a more bluish color.

  The control unit 7 may change the saturation (S) and the lightness (V) in the color correction conditions instead of changing the hue (H). For example, the saturation (S) = 33 and the lightness (V) = 100 of the color correction condition are changed by a predetermined value (for example, 5) to the saturation (S) = 100 and the lightness (V) = 66 of the representative value. The saturation (S) = 38 and lightness (V) = 95, which are the color correction conditions after the change, are set. With this change, the color correction condition after the change is changed to a darker tone color.

  In step S15, the control unit 7 determines whether or not the color correction conditions have been changed for all parts. If the control unit 7 determines that the color correction conditions have been changed for all parts, the process proceeds to step S16. On the other hand, if it is determined that the color correction conditions have not been changed for all parts, the control unit 7 returns to step S11, and performs the processes in and after step S11 for the parts for which the color correction conditions have not been changed.

  In step S <b> 16, the control unit 7 controls the image processing unit 6 to perform color correction, and ends the makeup process. At this time, the image processing unit 6 performs color correction according to the color correction conditions changed in step S14. Further, as described above, when the condition for adjusting the shape of each part is determined as the makeup process, the image processing unit 6 performs these processes continuously or simultaneously.

  In the flowchart of FIG. 3, as illustrated in FIG. 4, the case where the background is a dark blue background such as the sky or the sea has been described as an example. However, for example, as shown in FIG. 8, in the case of a bright red background such as a cherry blossom, a change to a reddish color or a change to a bright tone is performed in step S14. By changing the makeup color correction condition to be close to the representative color of the background, it is possible to improve the color balance of the entire image or to suppress the uncomfortable feeling of the entire image.

  In addition, when changing the color correction conditions, the change contents may be configured to be confirmed by the user using the display unit 8 or the like.

  The width to be changed (the above-mentioned “predetermined value” width) may be configured to be specified by the user. For example, the hue (H) is an annular element in FIG. 5, and when it is changed by 36 degrees or more (the width of the “predetermined value” is set to 36 or more), it is clearly changed to another color area. This makes the user feel a great sense of incongruity. Therefore, when it is possible to specify by the user, it is preferable to set an upper limit value.

  By the way, in the flowchart of FIG. 3, the case where the color correction condition is automatically changed has been described. However, the user's preferences and requests may be more reflected. A modification of the makeup process described in FIG. 3 will be described with reference to a flowchart shown in FIG.

  In step S21 to step S23, the control unit 7 performs the same processing as in step S11 to step S13 of FIG.

  In step S24, the control unit 7 selects candidate conditions for color correction among the makeup conditions determined in step S11 based on the representative value obtained in step S23.

  The control unit 7 performs the same process as step S14 in FIG. 3 and selects some candidate conditions for color correction. For example, the color correction condition obtained by performing the same processing as in step S14 in FIG. 3 has a predetermined width for at least one of hue (H), saturation (S), and brightness (V), and is a candidate. Select a condition.

  In step S25, the control unit 7 displays the color correction candidate conditions selected in step S24 on the display unit 8. FIG. 10 shows a display example of candidate conditions for color correction. In the example of FIG. 10, the selected candidate conditions for color correction are displayed on the display unit 8 as a color palette C1. By performing such display, the user can easily select a desired candidate condition by an operation via the operation unit 9 or the touch panel 17. In order to further improve the operability and convenience for the user, a configuration may be adopted in which candidate conditions are collectively determined and displayed for a plurality of parts. For example, as shown in FIG. 11, a color palette C2 including color correction candidate conditions for a plurality of parts (in FIG. 11, “eye color” for eyes, “teak” for cheeks, “lip” for lips) is displayed. You may display on the part 8.

  The color palette C2 may have a configuration in which one horizontal row (for example, E1 in FIG. 11) can be selected at once, or a favorite candidate condition can be selected for each part. If it is difficult to display all candidate conditions at once, a so-called scroll icon or the like indicating that additional candidate conditions exist in the vertical and horizontal directions may be displayed on the display unit 8. FIGS. 10 and 11 are display examples of candidate conditions for color correction, and the display contents are not limited to this example. For example, character information or voice information may be used.

  In step S26, the control unit 7 determines whether any candidate condition is selected from the candidate conditions displayed in step S25. The control unit 7 waits until any candidate condition is selected. If the control unit 7 determines that any candidate condition is selected, the control unit 7 sets the selected candidate condition as a color correction condition, and proceeds to step S27.

  In step S27, the control unit 7 determines whether or not color correction conditions have been determined for all parts. If the control unit 7 determines that the color correction conditions have been determined for all parts, the process proceeds to step S28. On the other hand, if it is determined that the color correction conditions have not been determined for all parts, the control unit 7 returns to step S21, and performs the processes after step S21 for the parts for which the color correction conditions have not been determined.

  In step S28, the control unit 7 performs color correction by controlling the image processing unit 6 in the same manner as in step S16 of FIG. At this time, the image processing unit 6 performs color correction in accordance with the color correction candidate conditions selected in step S26. Further, as described above, when the condition for adjusting the shape of each part is determined as the makeup process, the image processing unit 6 performs these processes continuously or simultaneously.

  Note that a learning function may be employed for the selection by the user described in step S26. For example, every time a candidate condition is selected by the user in step S26, the frequency may be stored, and the color correction candidate condition described in step S24 may be selected according to the stored selection frequency. .

  As described above, according to the present embodiment, the imaging unit that captures the subject image and generates the image, the detection unit that detects the face portion of the person of the subject from the image, and the face portion of the image. An analysis unit that analyzes the color distribution of the excluded portion, and an image processing unit that performs color correction of an image on a feature portion in the face portion detected by the detection unit. Then, based on the analysis result by the analysis unit, a representative color representing the portion excluding the face portion is obtained, and at least one of hue, saturation, and brightness included in the color correction correction condition is determined according to the representative color. change. Therefore, it is possible to realize suitable color correction according to the color distribution of the background while suppressing a sense of incongruity of the entire image by suppressing the color tone of the portion subjected to color correction from floating.

  Further, according to the present embodiment, the portion excluding the face portion is divided into a plurality of regions based on the analysis result, and the color of the region with the largest occupied area among the regions is set as the representative color. Therefore, it is possible to realize color correction according to the color of the portion of the background that has a large visual influence.

  Further, according to the present embodiment, based on the analysis result, the part excluding the face part is divided into a plurality of areas, the representative area is determined according to the focus state of each area, and the color of the representative area is set as the representative color. And Therefore, it is possible to realize color correction according to the color of the portion of the background that has a large visual influence.

  Further, according to the present embodiment, the average value of the color of the part excluding the face part is obtained, and the color corresponding to the average value is set as the representative color. Therefore, color correction according to the background color distribution can be realized by simple processing.

  Further, according to the present embodiment, based on the analysis result, the portion excluding the face portion is divided into a plurality of regions, and based on at least one of the color, occupied area, in-focus state, and frequency component of each region. Thus, the weight of each divided area is determined, and the representative color is obtained by taking the weight into consideration. Therefore, suitable color correction according to the background color distribution can be realized.

  Further, according to the present embodiment, a display unit that displays an image, a reception unit that receives a user operation, and a plurality of different hue conditions, saturations, and brightness values as candidates for correction conditions based on the analysis result. And a selection unit that selects color candidates. The display unit displays a plurality of color candidates, the reception unit receives a user operation for selecting one of the plurality of color candidates, and the image processing unit is received by the user via the reception unit. According to the selected color candidate, at least one of hue, saturation, and lightness included in the correction condition is changed. Therefore, the user can realize suitable color correction only by performing a simple operation.

  In the present embodiment, the color candidate selected by the user via the reception unit is stored, and at least one of hue, saturation, and brightness included in the correction condition is changed according to the selection frequency of each color candidate. To do. Therefore, user operability can be improved, and color correction reflecting the user's preference can be realized.

  In this embodiment, when changing the color correction conditions described in step S14 in FIG. 3 and when selecting the color correction candidate conditions described in step S24 in FIG. 9, a target image is generated. Information on the date and time and information on the location may be taken into account.

  For example, the control unit 7 acquires information such as the season and shooting time from the shooting date of the shooting information, or acquires information such as the shooting location, region, and country from the GPS information. Then, in consideration of these pieces of information, the color correction conditions can be changed, or the color correction candidate conditions can be selected. When seasons are taken into account, for example, in summer (June to August) and winter (December to February), bluishness is enhanced, and in spring (March to May) and autumn (September to In November), the yellow will be strengthened. In addition, when taking the shooting time into account, for example, the lightness is lowered (lightened) in the morning, the lightness is lowered (lightened) in the daytime, and the saturation is increased (lightly) at night. Do). In addition, when country information is taken into account as a shooting location, a color scheme preference caused by the race or culture of each country may be added. In this way, by adding at least one of hue, saturation, and lightness included in the correction condition in consideration of information on the date and time when the image was generated, information on the location, and the like, there is a more atmosphere and art. A highly specific image can be generated.

  Further, in the present embodiment, the case where only the hue (H) or the saturation (S) and the lightness (V) is changed as the color correction condition has been described as an example. However, the present invention is limited to this example. Not. For example, in the case of the HSV color space, the same effect as that of the present embodiment can be obtained by changing at least one element of hue (H), saturation (S), and brightness (V). Which element is changed may be configured to be settable by the user.

  In this embodiment, the case where the HSV color space is used when expressing the color has been described as an example. However, the present invention is not limited to this example. For example, even when a color space other than the HSV color space, such as a YCbCr color space, is used, the same processing as in the present invention can be performed and the same effect can be obtained.

  In this embodiment, the case where the color correction condition is changed in a direction approaching the representative color of the background has been described as an example. However, the present invention is not limited to this example. For example, a configuration may be used in which the color correction condition is changed in a direction away from the background representative color for the purpose of a contrast effect on expression.

  Further, the series of processing described in the present embodiment may be performed when a recorded image is reproduced. For example, the processing (including the flowcharts of FIGS. 3 and 9) described in steps S3 and S4 in the flowchart of FIG. 2 may be performed when the target image is reproduced.

  In the present embodiment, the digital camera 1 has been described as an example, but the present invention is not limited to this example. For example, the present invention can be similarly applied to a digital camera having a configuration other than that shown in FIG. Further, the present invention can be similarly applied to a digital camera capable of capturing a moving image. Furthermore, the present invention can be similarly applied to a digital camera mounted on a mobile phone or the like.

  Moreover, it is good also as a structure which implement | achieves a part or all of the process which the control part 7 of this embodiment performed with a computer. In this case, an image processing program for executing part or all of the processing (FIGS. 2, 3, and 9) performed by the control unit 7 of the present embodiment is stored in the computer, and the image processing program Thus, by performing the same processing, it is possible to obtain the same effect as the present embodiment. Note that, when the image processing program is used, each process may be performed based on incidental information such as Exif information.

DESCRIPTION OF SYMBOLS 1 ... Digital camera, 3 ... Image sensor, 6 ... Image processing part, 7 ... Control part, 16 ... Face detection part

Claims (9)

An imaging unit that captures a subject image and generates an image;
A detection unit for detecting a face portion of a subject person from the image;
An analysis unit that analyzes a color distribution of a part of the image excluding the face part;
An image processing unit that performs color correction of an image on the feature portion of the face portion detected by the detection unit;
The image processing unit obtains a representative color representing a portion excluding the face portion based on an analysis result by the analysis unit, and according to the representative color, hue and saturation included in the correction condition of the color correction A digital camera characterized by changing at least one of brightness and brightness. The digital camera according to claim 1, wherein
The image processing unit divides a portion excluding the face portion into a plurality of regions based on the analysis result, and a color of a region having the largest occupied area among the regions is set as the representative color. Digital camera. The digital camera according to claim 1, wherein
The image processing unit divides a portion excluding the face portion into a plurality of regions based on the analysis result, determines a representative region according to an in-focus state of each region, and sets the color of the representative region to the representative region A digital camera characterized by color. The digital camera according to claim 1, wherein
The image processing unit obtains an average value of colors of portions excluding the face portion, and uses a color corresponding to the average value as the representative color. The digital camera according to claim 1, wherein
The image processing unit divides a portion excluding the face portion into a plurality of regions based on the analysis result, and divides the regions based on at least one of a color, an occupied area, and an in-focus state of each region. A digital camera characterized in that a weight of each region is determined, and the representative color is obtained in consideration of the weight. The digital camera according to claim 1, wherein
A display unit for displaying the image;
A reception unit for receiving user operations;
A selection unit that selects a plurality of color candidates having at least one of hue, saturation, and brightness as the correction condition candidates based on the analysis result;
The display unit displays a plurality of the color candidates,
The reception unit receives a user operation for selecting any one of the plurality of color candidates,
The image processing unit changes at least one of hue, saturation, and brightness included in the correction condition according to a color candidate selected by a user via the reception unit. . The digital camera according to claim 6, wherein
The image processing unit stores color candidates selected by the user via the receiving unit, and at least one of hue, saturation, and lightness included in the correction condition according to the selection frequency of each color candidate. A digital camera characterized by changing. The digital camera according to any one of claims 1 to 7,
The image processing unit changes at least one of hue, saturation, and lightness included in the correction condition in consideration of at least one of information on a date and time when the image is generated and information on a place. A featured digital camera. An acquisition step of acquiring an image;
A detection step of detecting a face portion of the person of the subject from the image acquired in the acquisition step;
An analysis step of analyzing a color distribution of a portion of the image excluding the face portion;
An image processing program characterized in that an image processing step for performing color correction of an image on a feature portion in the face portion detected in the detection step is realized by a computer,
In the image processing unit step, based on the analysis result in the analysis step, a representative color representing a portion excluding the face portion is obtained, and the hue and saturation included in the correction condition for the color correction are determined according to the representative color. An image processing program that changes at least one of brightness and brightness.

Images