JP6859611B2 - Image processing equipment, image processing methods and programs - Google Patents

Description

The present invention relates to an image processing apparatus, an image processing method and a program.

Conventionally, there is known a technique of detecting a human face in a captured image and performing a skin beautifying process such as smoothing the skin or whitening the color of the face region. For example, there is one that infers the age and sex of a human and controls the skin beautification process (see, for example, Patent Document 1).

JP-A-2007-280291

However, in Patent Document 1, since changes in the skin condition in the face due to makeup and physical condition are not taken into consideration, there is a possibility that the skin beautifying treatment cannot be properly performed due to the influence of makeup and physical condition.

Therefore, an object of the present invention is to provide an image processing device, an image processing method, and a program capable of appropriately performing facial skin beautification processing.

In order to solve the above problems, the image processing apparatus according to the present invention is
A detection means for detecting the position of the human face region and the facial organs in the human face region from an image including a human as a subject.
A setting means for setting a predetermined range as a skin measurement area based on the position of a facial organ in a human face area detected by the detection means, and a setting means.
A calculation means for calculating the skin condition index from the level of noise obtained by performing a two-dimensional Fourier transform on the skin measurement region set by the setting means for each frequency.
A conversion means for converting the skin condition index calculated by the calculation means into the processing intensity of the skin beautification treatment, and
A skin-beautifying treatment means that applies a smoothing filter treatment to a human face region detected by the detection means with a treatment intensity converted by the conversion means.
With
A plurality of types of filter sizes for the smoothing filter processing in the skin-beautifying treatment are prepared according to a plurality of skin-beautifying modes.
The setting means is characterized in that a measurement area corresponding to a skin-beautifying mode selected from the plurality of skin-beautifying modes is set from a plurality of measurement candidate areas defined to be configurable in the face area. It is supposed to be.

According to the present invention, it is possible to properly perform the skin-beautifying treatment of the face.

It is a block diagram which shows the schematic structure of the image pickup apparatus of one Embodiment to which this invention is applied. It is a figure which shows an example of the processing content table stored in the image pickup apparatus of FIG. It is a figure which shows an example of the processing strength information in the processing content table of FIG. It is a flowchart which shows an example of the operation which concerns on the image generation processing by the image pickup apparatus of FIG. It is a flowchart which shows an example of the operation which concerns on the skin beautification process in the image generation process of FIG. It is a figure which shows typically an example of the image which concerns on the image generation processing of FIG.

Hereinafter, a specific aspect of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

FIG. 1 is a block diagram showing a schematic configuration of an image pickup apparatus 100 according to an embodiment to which the present invention is applied.
As shown in FIG. 1, specifically, the image pickup apparatus 100 of the present embodiment includes a central control unit 1, a memory 2, an image pickup unit 3, an image pickup control unit 4, a table storage unit 5, and image processing. A unit 6, a storage medium control unit 7, a display unit 8, and an operation input unit 9 are provided.
Further, the central control unit 1, the memory 2, the imaging unit 3, the imaging control unit 4, the table storage unit 5, the image processing unit 6, the storage medium control unit 7, and the display unit 8 are connected via the bus line 10. There is.

The central control unit 1 controls each unit of the image pickup apparatus 100. Specifically, although not shown, the central control unit 1 includes a CPU (Central Processing Unit) and the like, and performs various control operations according to various processing programs (not shown) for the image pickup apparatus 100.

The memory 2 is composed of, for example, a DRAM (Dynamic Random Access Memory) or the like, and temporarily stores data or the like processed by the central control unit 1, the imaging unit 3, the image processing unit 6, or the like.

The imaging unit 3 captures a predetermined subject (for example, a human being) to generate a frame image.
Specifically, the imaging unit 3 includes a lens unit 3a, an electronic imaging unit 3b, and the like.

The lens unit 3a is composed of a plurality of lenses such as a zoom lens and a focus lens, for example.
The electronic image pickup unit 3b is composed of, for example, an image sensor (imaging element) such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-oxide Semiconductor). Then, the electronic imaging unit 3b converts the optical image that has passed through the various lenses of the lens unit 3a into a two-dimensional image signal.
In addition to the lens unit 3a and the electronic imaging unit 3b, the imaging unit 3 may include a diaphragm (not shown) for adjusting the amount of light passing through the lens unit 3a.

The image pickup control unit 4 controls the image pickup of the subject by the image pickup unit 3. That is, the image pickup control unit 4 includes a timing generator, a driver, and the like, although not shown. Then, the image pickup control unit 4 scans and drives the electronic image pickup unit 3b by the timing generator and the driver, and the electronic image pickup unit 3b converts the optical image that has passed through the lens unit 3a into a two-dimensional image signal at predetermined intervals. , The frame image for each screen is read out from the imaging region of the electronic imaging unit 3b and output to the image processing unit 6.
Further, the image pickup control unit 4 may perform adjustment control of conditions for photographing a subject such as AF (automatic focusing process), AE (automatic exposure process), and AWB (automatic white balance).

The table storage unit 5 stores the processing content table T (see FIG. 2) used in the image generation processing (described later).
As shown in FIG. 2, the processing content table T includes a "skin condition measurement method" representing the processing content of the skin condition measurement processing by the skin condition measurement unit 6d (described later) for each of the plurality of skin-beautifying modes, and the skin-beautifying unit. It represents the conversion information of the "skin-beautifying method" that represents the processing content of the skin-beautifying treatment by 6f (described later) and the overall processing strength (overall parameter value) that changes according to the skin condition by the overall processing strength control unit 6e (described later). It is associated with "processing strength information".

As the skin-beautifying mode, for example, "skin-beautifying mode (default)" set as the default, "makeup-priority skin-beautifying mode" for reducing the influence of makeup and applying skin-beautifying treatment, and skin-beautifying mode for reducing the influence of physical condition. Examples include a "physical condition priority skin-beautifying mode" for applying a make-up treatment.
Here, reducing the influence of makeup means that, for example, when makeup is applied so as to weaken the impression of parts of the face that are not desired to stand out (for example, wrinkles, blemishes, freckles, etc.), makeup is applied. Dark (thick makeup) is different from the original skin condition and color of the skin. In addition, it may be difficult to make relatively large wrinkles and spots inconspicuous with makeup. Therefore, in order to perform a more natural skin-beautifying treatment, it is necessary to specify the original skin condition and color of the skin, which is less affected by makeup. Further, it is preferable to make relatively large wrinkles and stains inconspicuous.
In addition, reducing the influence of physical condition means that, for example, when the physical condition is poor, such as the face on which the dark circles of the eyes are represented, the skin condition and color are different from the original skin condition. Therefore, in order to perform a more natural skin-beautifying treatment, it is necessary to specify the original skin condition and color of the skin, which is less affected by the physical condition. Further, it may be difficult to make the dark circles of the eyes inconspicuous with the above-mentioned makeup. In this case, it is preferable to make the dark circles of the eyes inconspicuous.
On the other hand, in the "Beautiful skin mode (default)" set as the default, the influence of makeup and physical condition is not reduced, but for example, when the makeup is light (light makeup) or the physical condition is not bad (bad physical condition appears on the face). In such cases, it is considered acceptable to apply the skin-beautifying treatment with relatively little effect on makeup and physical condition.

Examples of the "skin condition measurement method" include a "skin condition measurement area" representing the skin condition measurement area A1 (see FIG. 6), and an object to be processed (for example, wrinkles, spots, etc.) defined according to the skin-beautifying mode. The "target frequency" that represents the frequency of the two-dimensional Fourier transformed image corresponding to freckles, moles, dark circles, etc.) is defined.
The "skin condition measurement area" includes, for example, "skin condition measurement area: whole" in which the skin condition measurement area A1 is the entire face area F, and "skin condition measurement area: 1" in which the specific part in the face area F is defined. , "Skin condition measurement area: 2" and the like. The specific setting method of the skin condition measurement area A1 will be described later.

Examples of the "skin-beautifying method" include a "skin color measurement area" representing the skin color measurement area A2 (see FIG. 6), and an object to be processed (for example, wrinkles, spots, freckles, etc.) defined according to the skin-beautifying mode. A "filter size" or the like indicating the size of an image processing filter (for example, a smoothing filter or the like) used for filter processing corresponding to moles, dark circles, etc. is defined.
Examples of the "skin color measurement area" include "skin color measurement area: whole" in which the skin color measurement area A2 is the entire face area F, "skin color measurement area: 1" and "skin color measurement" in which the specific part in the face area F is defined. Area: 2 ”and the like. The specific setting method of the skin color measurement area A2 will be described later.

The "treatment strength information" defines the correspondence between the skin condition index and the total treatment strength (overall parameter value) of the skin beautification treatment (see FIG. 3).
FIG. 3 schematically shows an example of the correspondence between the skin condition index and the overall treatment intensity of the skin beautification treatment.
The skin condition index represents the skin condition specified by the skin condition measurement process by the skin condition measuring unit 6d (described later). For example, the skin condition becomes higher as the rough skin becomes larger (severe). ..
As the "processing intensity information", a plurality of processing intensity conversion data (for example, "processing intensity conversion data: 1", "processing intensity conversion") having different correspondences between the skin condition index and the total processing intensity of the skin beautification treatment are used. Data: 2 ”,“ Processing intensity conversion data: 3 ”, etc.). Further, these processing intensity conversion data are different for each of the plurality of skin-beautifying modes, that is, depending on the combination of the skin condition measuring method by the skin condition measuring unit 6d and the skin-beautifying method by the skin-beautifying unit 6f. That is, the table storage unit 5 corresponds to each of a plurality of combinations of the "skin condition measurement method" by the skin condition measurement unit 6d and the "skin beautification method" by the skin beautification processing unit 6f, and the overall processing strength control unit 6e A plurality of "processing intensity information" representing conversion information of the total processing intensity that changes according to the skin condition according to (described later) is stored.

It should be noted that, as in the above-mentioned "processing intensity information", for example, the skin condition index does not need to store a plurality of processing intensity conversion data by differently relating the skin condition index and the overall processing intensity of the skin beautification treatment. And the overall processing strength may be normalized and only one associated data may be stored. Further, for example, when the correspondence relationship between the skin condition index and the overall treatment intensity of the skin beautification treatment is linear, only the conversion ratio data may be stored.

Further, the above-mentioned skin-beautifying mode is an example and is not limited to these, and can be arbitrarily changed, for example, an individual skin-beautifying mode in which wrinkles, blemishes, freckles and the like are preferentially removed.
Furthermore, the contents of the "skin condition measurement method", "skin-beautifying method", and "processing intensity information" associated with each skin-beautifying mode are also examples and are not limited to these, and can be arbitrarily changed as appropriate. It is possible.

As described above, as the storage means, the table storage unit 5 has a skin condition measurement method by the skin condition measurement unit 6d, a skin beautification method by the skin beautification processing unit 6f, and parameters according to the skin condition by the overall processing intensity control unit 6e. It is stored in association with the value conversion information.

The image processing unit 6 performs a process of converting the analog data of the frame image transferred from the electronic imaging unit 3b into digital data, a process of adjusting the white balance, a color process process, and the like, and performs the brightness signal Y of the digital value and the color difference. Signals Cb and Cr are generated. Specifically, the image processing unit 6 includes an image acquisition unit 6a, a face detection unit 6b, a measurement area setting unit 6c, a skin condition measurement unit 6d, an overall processing intensity control unit 6e, and a skin beautification unit 6f. A skin color specifying unit 6g, a partial processing intensity control unit 6h, and a composite image generation unit 6i are provided.
Each part of the image processing unit 6 is composed of, for example, a predetermined logic circuit, but the configuration is an example and is not limited to this.

The image acquisition unit 6a acquires an image to be processed in the image generation process (described later).
That is, the image acquisition unit (acquisition means) 6a acquires the image captured by the image pickup unit 3 as a processing target of the image generation process. Specifically, the image acquisition unit 6a is, for example, an image data (RGB) according to a predetermined color filter array (for example, a Bayer array) of an image (original image I) output and input from the electronic imaging unit 3b. Data) is acquired. Further, the image acquisition unit 6a generates a duplicate of the RGB data of the original image I, and performs, for example, white balance adjustment processing, color process processing, and the like to generate and acquire YUV data of the original image I.
Here, when the composite image generation unit 6i, which will be described later, does not generate the composite skin-beautifying image, the image acquisition unit 6a does not necessarily have to duplicate the image data of the original image I.
The image acquisition unit 6a may acquire the image data of the image stored in the storage medium M as a processing target.

The face detection unit 6b performs face detection processing.
That is, the face detection unit (detection means) 6b performs a predetermined face detection process on the image data of the original image I acquired by the image acquisition unit 6a, and includes a human face from within the original image I. The face area F (see FIG. 6) is detected. Then, the face detection unit 6b detects the positions of major facial organs such as eyes, nose, mouth, eyebrows, and facial contours by processing using, for example, AAM (Active Appearance Model). In the following description, the face region F refers to a region mainly flesh-colored surrounded by the facial contour and the hair.
Further, since the above-mentioned face detection process and AAM are known techniques, detailed description thereof will be omitted here. In addition, the facial organs are detected using AAM, but this is only an example and is not limited to this. For example, edge extraction processing, anisotropic diffusion processing, template matching, etc. can be arbitrarily changed. is there.

The measurement area setting unit 6c sets the skin condition measurement area A1 (see FIG. 6).
That is, the measurement area setting unit (setting means) 6c measures the skin condition by the skin condition measurement unit 6d at a specific portion in the human face region F detected by the face detection unit 6b with reference to the position of the facial organ. Area A1 is set. Specifically, among the plurality of skin-beautifying modes defined in the processing content table T, any one of the skin-beautifying modes is automatically specified based on a predetermined operation of the operation input unit 9 by the user or as a default. Then, the measurement area setting unit 6c refers to the "skin condition measurement area" in the column of the "skin condition measurement method" corresponding to the designated skin-beautifying mode, and the human face detected by the face detection unit 6b. The entire area F or a specific part based on the position of the facial organ in the face area F is set as the skin condition measurement area A1. That is, a skin condition measurement candidate that can be set in the face area F for each combination of the skin condition measurement method by the skin condition measurement unit 6d corresponding to each of the plurality of skin beautification modes and the skin beautification method by the skin beautification processing unit 6f. The area is defined, and the measurement area setting unit 6c corresponds to the skin condition measurement area (skin condition measurement method and skin beautification method) corresponding to the designated skin-beautifying mode from among these measurement candidate areas. Area in face area F) A1 is set.
Here, for example, as shown in FIG. 6, when the substantially central portion of the face area F is the skin state measurement area A1, the measurement area setting unit 6c is the position of the nose as a facial organ in the face area F. The skin condition measurement area A1 is set with a predetermined range based on the above as a specific part. Although not shown, when the forehead portion of the face region F is the skin condition measurement region A1, the left and right eye positions are used as a reference, and similarly, the cheek portion of the face region F is the skin condition. When the measurement area A1 of the above is used, the position of the mouth is used as a reference, and similarly, when the cheek portion of the face area F is used as the measurement area A1 of the skin condition, a plurality of faces such as eyes, nose, and mouth are used. A predetermined range (specific part) based on the position of the organ is the measurement area A1 of the skin condition.

The measurement area setting unit 6c sets the skin condition measurement area A1 by referring to the "skin condition measurement area" in the "skin condition measurement method" column according to the designated skin-beautifying mode. However, this is only an example, and the present invention is not limited to this. For example, depending on the skin condition measurement method by the skin condition measurement unit 6d or the skin beautification method by the skin beautification unit 6f, the facial organs in the face region F A specific portion based on the position may be set as the skin condition measurement area A1. That is, the skin condition measurement region A1 may be determined based on at least one of the skin condition measurement method and the skin beautification method.

Further, the measurement area setting unit 6c sets the skin color measurement area A2 (see FIG. 6).
That is, when any one of the skin-beautifying modes specified in the processing content table T is specified, the measurement area setting unit 6c sets the "skin color" corresponding to the designated skin-beautifying mode. Refer to the "skin color measurement area" in the "Measurement method" column, and set the entire human face area F detected by the face detection unit 6b or a specific part based on the position of the facial organ in the face area F as the skin color. Set as the measurement area A2.
The method of setting the skin color measurement area A2 in the face area F is almost the same as the method of setting the skin condition measurement area A1 described above, and detailed description thereof will be omitted.

Further, the measurement area setting unit 6c sets the skin color measurement area A2 by referring to the "skin color measurement area" in the "skin color measurement method" column according to the designated skin-beautifying mode. This is an example and is not limited to this. For example, the position of the facial organ in the face region F is used as a reference according to the skin condition measurement method by the skin condition measurement unit 6d or the skin beautification method by the skin beautification unit 6f. The specific portion to be designated may be set as the skin color measurement area A2.
That is, the measurement area setting unit (setting means) 6c was detected by the face detection unit 6b based on at least one of the skin condition measurement method by the skin condition measurement unit 6d and the skin beautification method by the skin beautification processing unit 6f. The skin color measurement region A2 is set in a specific portion of the human face region F with reference to the position of the facial organ.

In addition, although FIG. 6 exemplifies an example in which the skin condition measurement area A1 and the skin color measurement area A2 are arranged at the same position, the present invention is not limited to this, and the positions are different from each other. You may.

The skin condition measuring unit 6d measures the skin condition of the human face region F.
That is, the skin condition measuring unit (measuring means) 6d measures the skin condition of the human face region F detected by the face detecting unit 6b by a predetermined measuring method. For example, the skin condition measuring unit 6d performs a two-dimensional Fourier transform on the face region F of the original image I detected by the face detecting unit 6b, and calculates the level for each noise frequency. Then, the skin condition measuring unit 6d calculates the skin condition index by multiplying (weighting) and integrating a predetermined weight according to the calculated frequency level of the noise.
Specifically, the skin condition measurement unit 6d calculates the above-mentioned skin condition index for the skin condition measurement area A1 in the face area F set by the measurement area setting unit 6c. Further, the skin condition measuring unit 6d has a "target frequency" in the "skin condition measuring method" column corresponding to any one of the plurality of skin-beautifying modes specified in the processing content table T. , And specify the frequency of the two-dimensional Fourier transformed image corresponding to the object to be processed (for example, wrinkles, spots, freckles, moles, dark circles, etc.). Then, the skin condition measuring unit 6d calculates the skin condition index by relatively increasing the weighting value at the time of weighting for the noise of the specified frequency.
As described above, the skin condition measuring method by the skin condition measuring unit 6d includes a plurality of measuring methods having different skin condition measuring methods.

The above-mentioned skin condition measurement method is an example and is not limited to this, and can be arbitrarily changed as appropriate. That is, the skin condition measurement unit 6d may measure the skin condition by using, for example, a known image noise measurement process.

The overall processing intensity control unit 6e controls the overall processing intensity of the image processing by the skin beautifying unit 6f.
That is, the overall processing intensity control unit (control means) 6e controls the overall processing intensity (overall parameter value) of the image processing by the skin beautifying unit 6f according to the skin condition measured by the skin condition measuring unit 6d.
Specifically, when any one of the skin-beautifying modes specified in the processing content table T is specified, the overall processing intensity control unit 6e is set to the designated skin-beautifying mode. With reference to the "processing intensity conversion data" (for example, "processing intensity conversion data: 1", etc.) in the corresponding "processing intensity information" column, the skin condition index calculated by the skin condition measuring unit 6d is used as the skin condition index. It is converted into the processing intensity of the image processing by 6f, and is determined as the overall processing intensity of the image processing by the skin-beautifying processing unit 6f corresponding to the entire human face region F.
Here, examples of the overall processing intensity of the image processing include a filter coefficient representing the weight of a filter (for example, a smoothing filter) used for image processing by the skin-beautifying unit 6f.

The skin-beautifying unit 6f performs skin-beautifying treatment on the human face region F.
That is, the skin-beautifying unit (skin-beautifying means) 6f performs image processing corresponding to a predetermined skin-beautifying method on the human face region F detected by the face detecting unit 6b. For example, the skin-beautifying unit 6f removes noise in the face area F by performing a filter process (for example, smoothing process) on the face area F of the original image I detected by the face detection unit 6b.
Specifically, the skin-beautifying unit 6f has a "filter" in the "skin-beautifying method" column corresponding to any one of the skin-beautifying modes specified in the processing content table T. With reference to "size", the size of the image processing filter (for example, smoothing filter, etc.) corresponding to the object to be processed (for example, wrinkles, spots, freckles, moles, dark circles, etc.) is specified. Subsequently, the skin-beautifying unit 6f uses an image processing filter of a specified size, and uses an image processing filter of a specified size to obtain an overall processing intensity (for example, a filter coefficient or the like) determined by the overall processing intensity control unit 6e, and the face region F of the original image I. By performing a filter process (for example, a smoothing process, etc.) on the face region F, noise in the entire face region F is removed. Then, the skin-beautifying unit 6f performs, for example, white balance adjustment processing, color process processing, and the like to generate YUV data of the entire skin-beautifying processing image.
As described above, the skin-beautifying method by the skin-beautifying unit 6f includes a plurality of skin-beautifying methods in which the image processing related to the skin-beautifying is different.

The above-mentioned skin-beautifying method is an example and is not limited to this, and can be arbitrarily changed as appropriate. That is, the skin-beautifying unit 6f may perform the skin-beautifying treatment by using, for example, a known image noise removing process.

The skin color specifying portion 6g specifies the skin color corresponding to the human face region F.
That is, the skin color specifying unit (specific means) 6g specifies the skin color corresponding to the human face region F in the original image I detected by the face detecting unit 6b. Specifically, when any one of the skin-beautifying modes specified in the processing content table T is specified, the skin color specifying unit 6g is set by the measurement area setting unit 6c. The basic color of the skin (for example, the average value or the median value of the hue H) is specified based on the pixel value of each pixel in the skin color measurement area A2 in the human face region F.
Since the identification of the skin color is a known technique, detailed description thereof will be omitted here, but for example, the HSV data obtained by converting the image data of the original image I into the HSV color space may be used. However, it may be performed on the YUV data converted into the YUV color space.

The partial processing intensity control unit 6h controls the partial processing intensity of image processing by the skin-beautifying processing unit 6f.
That is, the partial processing intensity control unit (control means) 6h is used for each predetermined portion (for example, a pixel) of the human face region F detected by the face detection unit 6b according to the skin color specified by the skin color identification unit 6g. Every etc.), the partial processing intensity (partial parameter value) of the image processing by the skin-beautifying unit 6f is determined.
Specifically, the partial processing intensity control unit 6h uses the basic color of each pixel in the skin color measurement region A2 specified by the skin color identification unit 6g as a reference for each pixel of the human face region F of the original image I. A face map is generated in which a predetermined color range is represented by a predetermined gradation (for example, 8 bits [0 to 255], etc.). The gradation value of this face map is the ratio of the composition of the entire skin-beautifying image and the original image I by the composite image generation unit 6i described later, that is, alpha blending with respect to the original image I for each pixel of the overall skin-beautifying image. It represents the weight when doing. For example, the pixels of the overall skin-beautifying image corresponding to the gradation value of the face map of "255" have a transmittance of 0% with respect to the original image I, and the overall skin-beautifying process corresponding to the gradation value of the face map of "0". The image pixels have a transmittance of 100% with respect to the original image I.
That is, the ratio of the composition of the entire skin-beautifying image and the original image I corresponding to the skin changes depending on the gradation value of the face map, and as a result, the skin-beautifying unit 6f determines each pixel of the human face region F. The partial processing intensity (partial parameter value) of the image processing will change.

The composite image generation unit 6i generates a composite skin-beautifying image by synthesizing the entire skin-beautifying image and the original image I.
That is, the composite image generation unit 6i generates the entire skin-beautifying image generated by the skin-beautifying unit 6f and the original image I acquired by the image acquisition unit 6a by the partial processing intensity control unit 6h, and the face region F The image data of the composite skin-beautifying image is generated by synthesizing using the face map in which the transmittance is set. For example, the composite image generation unit 6i transmits the pixels having the gradation value (transparency) of "0" set in the face map to the original image I for each pixel of the entire skin-beautifying processed image, and the gradation. Pixels with a value of "255" overwrite the pixels of the original image I with the pixel values of the corresponding pixels of the overall skin-beautifying image, and pixels with a gradation value of "1-254" correspond to the transmission rate. The pixel value of the pixel of the entire skin-beautifying image and the pixel value of the corresponding pixel of the original image I are blended (alpha blending).
Since the above-mentioned alpha blending is a known technique, detailed description thereof will be omitted here.

The storage medium control unit 7 is configured so that the storage medium M can be attached and detached, and controls reading of data from the attached storage medium M and writing of data to the storage medium M.
The storage medium M is composed of, for example, a non-volatile memory (flash memory) or the like, but the storage medium M is not limited to this as an example, and can be arbitrarily changed as appropriate.

The display unit 8 includes a display panel 8a and a display control unit 8b.
The display panel 8a displays an image in the display screen. Examples of the display panel 8a include, but are not limited to, a liquid crystal display panel and an organic EL display panel.

The display control unit 8b reads out the image data for display temporarily stored in the memory 2, and displays a predetermined image on the display panel 8a based on the image data of a predetermined size decoded by the image processing unit 6. Controls the display on the display screen. Specifically, the display control unit 8b includes a VRAM (Video Random Access Memory), a VRAM controller, a digital video encoder, and the like (all of which are not shown). Then, the digital video encoder transmits the luminance signal Y and the color difference signals Cb and Cr decoded by the image processing unit 6 and stored in the VRAM from the VRAM via the VRAM controller at a predetermined reproduction frame rate (for example, 30 fps). It is read out, a video signal is generated based on these data, and the video signal is output to the display panel 8a.

The operation input unit 9 is for performing a predetermined operation of the image pickup apparatus 100. Specifically, the operation input unit 9 includes a shutter button for an imaging instruction of a subject, a selection determination button for a selection instruction such as an imaging mode and a function, a zoom button for an adjustment instruction of a zoom amount, and the like (all not shown). The operation unit is provided, and a predetermined operation signal is output to the central control unit 1 in response to the operation of each button of the operation unit.

<Image generation processing>
Next, the image generation process by the image pickup apparatus 100 will be described with reference to FIGS. 4 to 6.
FIG. 4 is a flowchart showing an example of an operation related to the image generation process.

As shown in FIG. 4, first, for example, when an image pickup instruction is input based on a predetermined operation of the shutter button of the operation input unit 9 by the user, the CPU of the central control unit 1 issues an image pickup control command to the image pickup control unit 4. The image pickup control unit 4 controls the image pickup unit 3 to capture an image of the subject. Then, the image acquisition unit 6a of the image processing unit 6 acquires image data (RGB data) according to a predetermined color filter array (for example, Bayer array) of the original image I captured by the image pickup unit 3 (step). S1). Further, the image acquisition unit 6a generates a duplicate of the RGB data of the original image I, and performs, for example, a white balance adjustment process, a color process process, or the like to generate YUV data of the original image I.
In the image generation processing, for example, the image stored in the storage medium M may be processed.

Next, the face detection unit 6b performs a predetermined face detection process on the image data of the original image I acquired by the image acquisition unit 6a (step S2), and the face including the human face from within the original image I. It is determined whether or not the region F is detected (step S3).
Further, in step S2, the face detection unit 6b also performs a process of detecting the positions of major facial organs such as eyes, nose, mouth, eyebrows, and facial contours in the face area F by, for example, a process using AAM. Do.

When it is determined in step S3 that the face area F has been detected (step S3; YES), the image processing unit 6 inputs an operation by the user in the plurality of skin-beautifying modes defined in the processing content table T. Based on the predetermined operation of Part 9, or any one of the skin-beautifying modes automatically designated as the default is specified (step S4).
Here, the skin-beautifying mode itself may be specified before the image of the subject, or may be specified at a predetermined timing (for example, after the detection of the face region F) after the image of the subject.
Then, the image processing unit 6 refers to the processing content table T and specifies each of the “skin condition measurement method”, the “skin beautification method”, and the “processing intensity information” corresponding to the specified skin-beautifying mode (step). S5).

Next, the measurement area setting unit 6c was detected by the face detection unit 6b with reference to the "skin condition measurement area" in the column of the "skin condition measurement method" corresponding to the specified skin-beautifying mode in the processing content table T. The skin condition measurement region A1 is set in the human face region F (step S6). Subsequently, the skin condition measurement unit 6d corresponds to the specified skin-beautifying mode in the processing content table T for the skin condition measurement area A1 in the face area F of the original image I set by the measurement area setting unit 6c. The skin condition is measured by the "skin condition measurement method" and the skin condition index is calculated (step S7). For example, the skin condition measurement unit 6d refers to the "target frequency" in the "skin condition measurement method" column corresponding to the specified skin-beautifying mode, and refers to the target to be processed (for example, wrinkles, stains, freckles, moles, eyes). The frequency of the two-dimensional Fourier transformed image corresponding to the bear, etc.) is specified, and the skin condition index is calculated by weighting the noise of the specified frequency with a relatively large weight value.

Next, the overall processing intensity control unit 6e determines the overall processing intensity (for example, filter coefficient) of the image processing by the skin beautifying unit 6f according to the skin condition index calculated by the skin condition measuring unit 6d (step). S8). For example, the overall processing intensity control unit 6e may perform "processing intensity conversion data" (for example, "processing intensity conversion data: 1" or the like) in the "processing intensity information" column corresponding to the specified skin-beautifying mode in the processing content table T. The total processing intensity of the image processing by the skin-beautifying unit 6f corresponding to the entire human face region F is determined according to the skin condition index calculated by the skin condition measuring unit 6d.
After that, the image processing unit 6 performs a skin-beautifying treatment (see FIG. 5) on the human face region F (step S9).

On the other hand, if it is determined in step S3 that the face region F has not been detected (step S3; NO), the storage medium control unit 7 acquires the image data of the original image I from the image processing unit 6 and obtains the image data of the original image I. The image is stored in a predetermined storage area of the storage medium M (step S10), and the image generation process is completed.

<Beautiful skin treatment>
The skin-beautifying treatment will be described below with reference to FIG. FIG. 5 is a flowchart showing an example of the operation related to the skin beautification process.

As shown in FIG. 5, first, the skin-beautifying unit 6f has an overall processing intensity (for example, a filter coefficient or the like) determined by the overall processing intensity control unit 6e by the "skin-beautifying process" corresponding to the specified skin-beautifying mode. The skin-beautifying process of the face region F of the original image I is performed in step 2 to generate an overall skin-beautifying image (step S11). For example, the skin-beautifying unit 6f refers to the "filter size" in the "skin-beautifying method" column corresponding to the specified skin-beautifying mode in the processing content table T, and refers to the target to be processed (for example, wrinkles, stains, freckles, etc.). The size of the image processing filter (for example, smoothing filter, etc.) corresponding to freckles, eye bears, etc. is specified, and the overall processing intensity control unit 6e determines the size of the image processing filter of the specified size. The face region F of the original image I is filtered (for example, smoothing) based on the overall processing intensity (for example, filter coefficient). As a result, the skin-beautifying unit 6f removes the noise of the entire face region F and generates YUV data of the entire skin-beautifying processing image.

Next, the CPU of the central control unit 1 determines whether or not the specified skin-beautifying mode is the "skin-beautifying mode (default)" defined as the default (step S12). Here, the "skin-beautifying mode (default)" is a skin-beautifying mode in which the processing intensity is not changed for each pixel of the face area F, and the other skin-beautifying modes (for example, "makeup-priority skin-beautifying mode") are the face area F. This is a skin-beautifying mode in which the processing intensity is changed for each pixel.

If it is determined in step S12 that it is not the "skin-beautifying mode (default)" (step S12; NO), the measurement area setting unit 6c is "skin-colored measuring method" corresponding to the specified skin-beautifying mode in the processing content table T. The skin color measurement area A2 is set in the human face area F detected by the face detection unit 6b with reference to the “skin color measurement area” in the column (step S13). Subsequently, the skin color specifying unit 6g specifies the basic color (skin basic color) of each pixel in the skin color measuring area A2 in the human face area F of the original image I set by the measuring area setting unit 6c (skin color specifying unit 6g). Step S14). Next, the partial processing intensity control unit 6h gradationally expresses a predetermined color range based on the basic skin color specified by the skin color specifying unit 6g for each pixel of the human face region F of the original image I. Generate a face map (step S15).

Then, the composite image generation unit 6i uses the face map generated by the partial processing intensity control unit 6h for the entire skin-beautifying image generated by the skin-beautifying unit 6f and the original image I acquired by the image acquisition unit 6a. To generate a synthetic skin-beautifying processed image (step S16). Specifically, the composite image generation unit 6i synthesizes the entire skin-beautifying image and the original image I by alpha blending based on the gradation value (transmittance) set in the face map, and synthesizes skin-beautifying processing. Generate image data of an image.
After that, the storage medium control unit 7 acquires the image data of the synthetic skin-beautifying image from the image processing unit 6 and stores it in a predetermined storage area of the storage medium M (step S17), and ends the image generation process.

On the other hand, if it is determined in step S3 that the "skin-beautifying mode (default)" is set (step S12; YES), the storage medium control unit 7 acquires the image data of the entire skin-beautifying image from the image processing unit 6. Then, the image is stored in a predetermined storage area of the storage medium M (step S18), and the image generation process is completed.

In the image generation process described above, the process is branched according to the specified skin-beautifying mode (step S12; see FIG. 5), but this is only an example and is not limited to this. The desired skin-beautifying mode (for example, "makeup-priority skin-beautifying mode") can be set as the default, and when the subject is imaged, the composite skin-beautifying image is automatically generated in the skin-beautifying mode set as the default. You can do it.
In addition, in the skin-beautifying mode for generating a composite skin-beautifying image, the entire skin-beautifying image is also stored in association with the generated composite skin-beautifying image so that the user can compare these images. Is also good.

As described above, according to the image pickup apparatus 100 of the present embodiment, the parameter value of the image processing corresponding to the skin beautification method is controlled according to the skin condition of the human face region F, and within the human face region F. Since the skin condition measurement area A1 determined based on the skin condition measurement method and the skin beautification method is set in a specific part based on the position of the facial organ, for example, the skin condition is affected by the influence of makeup and physical condition. Even if it changes, it is possible to properly measure the original skin condition by considering the skin condition measurement method and skin beautification method, and by doing so, the skin condition that changes due to the influence of makeup and physical condition can be taken into consideration. It is possible to properly perform the skin-beautifying treatment of the face.

In addition, the processing content table T is associated with the "skin condition measurement method", the "skin beautification method", and the conversion information "processing intensity information" of the parameter values of the image processing corresponding to the skin beautification method according to the skin condition. By simply referring to the processing content table T, for example, it is possible to appropriately perform the skin-beautifying treatment of the face in consideration of the skin condition that changes due to the influence of makeup, physical condition, and the like. In particular, the "skin condition measurement method" associated with any one of the skin-beautifying modes by simply specifying one of the skin-beautifying modes by memorizing each of the plurality of skin-beautifying modes. , "Skin beautification method" and "Treatment intensity information" can be used to properly perform facial skin beautification treatment.
Specifically, since the content of the "processing intensity information" differs depending on the combination of the "skin condition measurement method" and the "skin beautification method", the "skin condition measurement method" and the "skin beautification method" are used. For each combination, for example, the overall processing intensity (overall parameter value) of the image processing corresponding to the skin beautification method can be appropriately converted according to the skin condition that changes due to the influence of makeup, physical condition, and the like.

In addition, among a plurality of measurement methods having different skin condition measurement methods and a plurality of skin beautification methods having different image processing related to skin beautification, a predetermined measurement method and an area in the face area F corresponding to the skin beautification method are defined. , Since it is set as the skin condition measurement area A1, by associating the skin condition measurement method and the skin beautification method with the area in the face area F set as the skin condition measurement area A1, the skin condition The measurement area A1 can be set appropriately.
Further, since the skin condition measurement area A1 is changed in the human face area F based on the skin condition measurement method and the skin beautification method, for example, even if the skin condition changes due to the influence of makeup or physical condition, the skin It is possible to properly measure the original skin condition of the skin in consideration of the condition measurement method and the skin beautification method.
Further, by setting the skin condition measurement area A1 from the measurement candidate areas that can be set in the human face area F according to the combination of the "skin condition measurement method" and the "skin beautification method", for example. Even when the skin condition changes due to the influence of makeup, physical condition, etc., the skin condition measurement area A1 can be appropriately set, and as a result, the original skin condition of the skin can be appropriately measured.

Further, by determining the overall processing intensity (overall parameter value) of the image processing by the skin-beautifying unit 6f corresponding to the entire human face region F according to the measured skin condition, for example, the skin-beautifying treatment is performed. However, when the influence of makeup and physical condition is considered to be relatively small and acceptable, it is not necessary to change the processing intensity in a part of the face area F (for example, for each pixel), and the skin beautifying treatment is performed. The load on the surface can be relatively reduced.
Further, the skin color corresponding to the human face area F is specified, and the partial processing intensity (part) of the image processing by the skin beautifying unit 6f for each predetermined part of the human face area F according to the specified skin color. By determining the parameter value), for example, the facial skin beautification treatment can be appropriately performed in consideration of the skin condition that changes due to the influence of makeup, physical condition, etc. for each predetermined portion of the face region F. In particular, based on the skin condition measurement method and the skin beautification method, the skin color measurement area A2 is set in a specific part based on the position of the facial organ in the human face area F, and the set skin color measurement area is set. By specifying the skin color in A2, for example, even when the skin color changes due to the influence of makeup or physical condition, the skin color measurement area A2 can be set appropriately, and as a result, the skin itself can be set. The color of the skin can be measured properly.

The present invention is not limited to the above embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, in the above embodiment, the processing content table T is used to set the skin condition measurement area A1, but the present invention is not limited to this, and is based on the skin condition measurement method and the skin beautification method. It is not always necessary to use the processing content table T as long as the method can set the measurement area A1 of the skin condition.

Further, the configuration of the image pickup apparatus 100 is merely an example of the configuration illustrated in the above embodiment, and is not limited thereto. For example, an image captured by an external imaging means may be acquired and an image generation process may be performed.

In addition, in the above embodiment, the functions as the detection means, the skin-beautifying means, the measuring means, the control means, and the setting means are performed by the face detection unit 6b and the skin-beautifying treatment under the control of the CPU of the central control unit 1. The configuration is realized by driving the unit 6f, the skin condition measurement unit 6d, the overall processing strength control unit 6e, and the measurement area setting unit 6c, but the configuration is not limited to this, and a predetermined program is provided by the central control unit 1. The configuration may be realized by executing the above.
That is, a program including a detection processing routine, a skin-beautifying processing routine, a measurement processing routine, a control processing routine, and a setting processing routine is stored in a program memory (not shown) for storing the program. Then, the CPU of the central control unit 1 may be made to function as a means for detecting the positions of the human face region F and the facial organs from the image (original image I) by the detection processing routine. Further, the CPU of the central control unit 1 may be made to function as a means for performing image processing corresponding to a predetermined skin-beautifying method on the detected human face region F by the skin-beautifying routine. Further, the CPU of the central control unit 1 may be made to function as a means for measuring the detected skin condition of the human face region F by a predetermined measurement method by the measurement processing routine. Further, the CPU of the central control unit 1 may be made to function as a means for controlling the parameter value of the image processing corresponding to the predetermined skin beautification method according to the measured skin condition by the control processing routine. In addition, at least one of the skin condition measurement method and the skin beautification method is applied to the CPU of the central control unit 1 by the setting processing routine in a specific part based on the position of the facial organ in the detected human face area F. It may be made to function as a means for setting the measurement area A1 of the skin condition determined based on.

Similarly, the specific means may be configured to be realized by executing a predetermined program or the like by the CPU of the central control unit 1.

Further, as a computer-readable medium containing a program for executing each of the above processes, a non-volatile memory such as a flash memory and a portable storage medium such as a CD-ROM are applied in addition to a ROM and a hard disk. Is also possible. A carrier wave is also applied as a medium for providing program data via a predetermined communication line.

Although some embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and the equivalent scope thereof.
The inventions described in the claims originally attached to the application of this application are added below. The claims in the appendix are as specified in the claims originally attached to the application for this application.
[Additional Notes]
<Claim 1>
A detection means for detecting the position of a human facial region and facial organs from within an image,
A skin-beautifying means that performs image processing corresponding to a predetermined skin-beautifying method on a human face region detected by the detection means, and a skin-beautifying means.
A measuring means for measuring the skin condition of the human face region detected by the detecting means by a predetermined measuring method, and a measuring means.
A control means for controlling the parameter value of image processing by the skin-beautifying processing means according to the skin condition measured by the measuring means, and a control means.
A setting means for setting a skin condition measurement area by the measurement means in a specific portion based on the position of a facial organ in the human face area detected by the detection means, and a setting means.
With
The image processing apparatus is characterized in that the measurement area is determined based on at least one of a skin condition measuring method by the measuring means and a skin beautifying method by the skin beautifying means.
<Claim 2>
Further provided is a storage means for storing the skin condition measurement method by the measuring means, the skin beautifying method by the skin beautifying means, and the conversion information of the parameter value according to the skin condition by the control means in association with each other. The image processing apparatus according to claim 1.
<Claim 3>
The conversion information of the parameter value according to the skin condition by the control means is characterized by being different depending on the combination of the skin condition measurement method by the measurement means and the skin beautification method by the skin beautification treatment means. The image processing apparatus according to claim 2.
<Claim 4>
The storage means converts the parameter values according to the skin condition by the control means in correspondence with each of a plurality of combinations of the skin condition measurement method by the measurement means and the skin beautification method by the skin beautification treatment means. The image processing apparatus according to claim 2 or 3, wherein a plurality of pieces of information are stored.
<Claim 5>
The storage means corresponds to each of a plurality of skin-beautifying modes, and has a skin condition measuring method by the measuring means, a skin-beautifying method by the skin-beautifying treatment means, and a parameter value according to the skin condition by the control means. The image processing apparatus according to any one of claims 2 to 4, wherein a plurality of image processing devices are stored in association with the conversion information of the above.
<Claim 6>
The setting means is a predetermined measurement method and skin beautification method among a plurality of measurement methods having different skin condition measurement methods by the measurement means and a plurality of skin beautification methods having different image processing related to skin beautification by the skin beautification treatment means. The image processing apparatus according to any one of claims 1 to 5, wherein a region in the face region corresponding to the conversion method is set as a skin condition measurement region by the measuring means.
<Claim 7>
The setting means is based on at least one of the skin condition measuring method by the measuring means and the skin beautifying method by the skin beautifying means, and the skin by the measuring means in the human face region detected by the detecting means. The image processing apparatus according to any one of claims 1 to 5, wherein the measurement area of the state is changed and set.
<Claim 8>
The setting means is associated with each of a plurality of combinations of the skin condition measuring method by the measuring means and the skin beautifying method by the skin beautifying means, and can be set within the human face region detected by the detecting means. The image processing apparatus according to any one of claims 1 to 7, wherein a measurement area for a skin condition by the measurement means is set from among the measurement candidate areas.
<Claim 9>
The control means determines an overall parameter value of image processing by the skin-beautifying means corresponding to the entire human face region detected by the detection means according to the skin condition measured by the measuring means. The image processing apparatus according to any one of claims 1 to 8.
<Claim 10>
Further provided with specific means for identifying the skin color corresponding to the human face region detected by the detection means.
The control means determines a partial parameter value in image processing by the skin-beautifying means for each predetermined portion of a human face region detected by the detection means according to the skin color specified by the specific means. The image processing apparatus according to any one of claims 1 to 9.
<Claim 11>
The setting means further
A specific portion based on the position of a facial organ in the human face region detected by the detection means based on at least one of the skin condition measurement method by the measurement means and the skin beautification method by the skin beautification treatment means. Set the skin color measurement area to
The image processing apparatus according to claim 10, wherein the specific means identifies a skin color in a skin color measurement region set by the setting means in a human face region detected by the detection means. ..
<Claim 12>
This is an image processing method using an image processing device.
Steps to detect the position of the human facial area and facial organs from within the image,
A step of performing image processing corresponding to a predetermined skin beautification method on the detected human face area, and
Steps to measure the detected skin condition of the human face area by a predetermined measurement method,
A step to control the parameter value of image processing corresponding to a predetermined skin beautification method according to the measured skin condition, and
A step of setting a measurement area for skin condition in a specific part based on the position of a facial organ in the detected human face area, and
Including
An image processing method characterized in that the measurement area is determined based on at least one of a skin condition measurement method and a skin beautification method.
<Claim 13>
The computer of the image processing device,
A detection means for detecting the position of a human facial region and facial organs in an image,
A skin-beautifying means for performing image processing corresponding to a predetermined skin-beautifying method on a human face region detected by the detection means.
A measuring means that measures the skin condition of the human face region detected by the detecting means by a predetermined measuring method.
A control means that controls a parameter value of image processing by the skin-beautifying processing means according to the skin condition measured by the measuring means.
A setting means for setting a skin condition measurement area by the measurement means in a specific portion based on the position of a facial organ in the human face area detected by the detection means.
To function as
The measurement area is a program determined based on at least one of a skin condition measuring method by the measuring means and a skin beautifying method by the skin beautifying means.

100 Imaging device 1 Central control unit 3 Imaging unit 5 Table storage unit 6 Image processing unit 6a Image acquisition unit 6b Face detection unit 6c Measurement area setting unit 6d Skin condition measurement unit 6e Overall processing intensity control unit 6f Skin-beautifying unit 6g Skin color identification unit 6h Partial processing intensity control unit 6i Composite image generation unit T Processing content table

Claims (9)

A detection means for detecting the position of the human face region and the facial organs in the human face region from an image including a human as a subject.
A setting means for setting a predetermined range as a skin measurement area based on the position of a facial organ in a human face area detected by the detection means, and a setting means.
A calculation means for calculating the skin condition index from the level of noise obtained by performing a two-dimensional Fourier transform on the skin measurement region set by the setting means for each frequency.
A conversion means for converting the skin condition index calculated by the calculation means into the processing intensity of the skin beautification treatment, and
A skin-beautifying treatment means that applies a smoothing filter treatment to a human face region detected by the detection means with a treatment intensity converted by the conversion means.
With
A plurality of types of filter sizes for the smoothing filter processing in the skin-beautifying treatment are prepared according to a plurality of skin-beautifying modes.
The setting means is characterized in that a measurement area corresponding to a skin-beautifying mode selected from the plurality of skin-beautifying modes is set from a plurality of measurement candidate areas that can be set in the face area. Image processing device. The frequency of the two-dimensional Fourier transform image corresponding to the target of the skin beautification treatment in the human face region , the filter size of the smoothing filter processing, and the skin condition index in association with each of the plurality of skin beautification modes. The image processing apparatus according to claim 1, further comprising a storage means for storing processing intensity information indicating a correspondence relationship between the skin-beautifying treatment and the processing intensity of the skin-beautifying treatment. The second aspect of the present invention is characterized in that a plurality of the processing intensity information is stored in the storage means so as to be different depending on the combination of the frequency of the two-dimensional Fourier transform image and the filter size of the smoothing filter processing. The image processing apparatus described. The storage means corresponds to each of the plurality of skin-beautifying modes, and has the frequency of the two-dimensional Fourier transform image, the filter size of the smoothing filter processing, the skin condition index, and the processing intensity of the skin-beautifying treatment. The image processing apparatus according to claim 2 or 3, wherein the processing intensity information indicating the correspondence relationship is stored in association with each other. The image processing apparatus according to any one of claims 1 to 4, wherein the processing intensity is the processing intensity of the skin-beautifying treatment for the entire human face region. From definitive the skin measurement area of the detected face area of the person it was by the detection means, specifying means for specifying the basic color of the skin of the human face area,
The skin-beautifying treatment means includes a partial treatment intensity determining means that determines to change the treatment intensity for each predetermined portion of the human face region according to the basic color of the skin specified by the specific means.
The image processing apparatus according to any one of claims 1 to 5, further comprising. The specifying means, image processing according to claim 6, characterized in that to identify the basic color of the skin skin measurement region of a predetermined range based on the location of the face part set by the setting means apparatus. This is an image processing method using an image processing device.
A detection step of detecting the position of the human face region and the facial organs in the human face region from the image including a human as a subject, and a detection step.
A setting step of setting a predetermined range based on the position of a facial organ in the human face region detected in the detection step as a skin measurement region, and a setting step.
A calculation step of calculating the skin condition index from the frequency level of noise obtained by performing a two-dimensional Fourier transform on the skin measurement region set in the setting step, and a calculation step.
A conversion step for converting the skin condition index calculated in the above calculation step into the processing intensity of the skin beautification treatment, and
A skin-beautifying treatment step of applying a smoothing filter treatment to the human face region detected in the detection step with the treatment intensity converted in the conversion step.
Including
A plurality of types of filter sizes for the smoothing filter processing in the skin-beautifying treatment are prepared according to a plurality of skin-beautifying modes.
The setting step is characterized in that a measurement area corresponding to a skin-beautifying mode selected from the plurality of skin-beautifying modes is set from a plurality of measurement candidate areas defined to be configurable in the face area. Image processing method. The computer of the image processing device,
A detection means for detecting the position of the human face region and the facial organs in the human face region from an image including a human as a subject.
A setting means for setting a predetermined range as a skin measurement area based on the position of a facial organ in a human face area detected by the detection means.
A calculation means for calculating the skin condition index from the level of noise obtained by performing a two-dimensional Fourier transform on the skin measurement region set by the setting means for each frequency.
A conversion means for converting the skin condition index calculated by the calculation means into the processing intensity of the skin beautification treatment,
A skin-beautifying treatment means that applies a smoothing filter treatment to a human face region detected by the detection means with a treatment intensity converted by the conversion means.
To function as
A plurality of types of filter sizes for the smoothing filter processing in the skin-beautifying treatment are prepared according to a plurality of skin-beautifying modes.
The setting means is characterized in that a measurement area corresponding to a skin-beautifying mode selected from the plurality of skin-beautifying modes is set from a plurality of measurement candidate areas defined to be configurable in the face area. Program to be.

Images