JP2014182673A - Image processing device, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve expressiveness of eyes in a face image generated by binarization processing.SOLUTION: An imaging device 100 comprises: an image acquisition unit 6a that acquires a processed face image generated by performing binarization processing on an original image with a predetermined threshold; an eye detection unit 6c that detects an eye in the original image; and an iris-and-pupil drawing unit 6f that newly draws an iris-and-pupil area relatively larger than the iris and pupil of the detected eye in the processed image on the basis of the detection result of the eye.

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

  2. Description of the Related Art Conventionally, there is known a portrait creation device that creates a portrait using feature points of facial parts such as eyes, nose, mouth, ears, and face contour (see, for example, Patent Document 1).

JP 2004-145625 A

  By the way, a technique for generating a portrait image by performing binarization processing etc. on a photographic image is also known, but in this case, the ratio of the size of the black eye to the face area becomes substantially equal to the actual face. There is a possibility that the eyes in the portrait image cannot be properly expressed.

  Therefore, an object of the present invention is to provide an image processing apparatus, an image processing method, and a program capable of improving the expressiveness of eyes in a face image generated by binarization processing.

In order to solve the above problems, an image processing apparatus according to the present invention provides:
First acquisition means for acquiring an original image, second acquisition means for acquiring a processed face image generated by performing binarization processing on the original image with a predetermined threshold, and the first Based on the eye detection means for detecting eyes in the original image acquired by the acquisition means and the size of the black eye area detected by the eye detection means, it is relatively larger than the detected black eye area. A black eye drawing unit for newly drawing a black eye region in the processed image acquired by the second acquisition unit.

The image processing method according to the present invention includes:
An image processing method using an image processing apparatus, the step of acquiring an original image, and a processed face image generated by performing binarization processing on the original image with a predetermined threshold And a step of detecting eyes in the acquired original image, and processing the black eye area relatively larger than the detected black eye area based on the size of the detected black eye area. And a step of newly drawing in the image.

The program according to the present invention is
First acquisition means for acquiring an original image, a second acquisition for acquiring a processed face image generated by subjecting the original image to a binarization process with a predetermined threshold. Means based on the size of the black eye area detected by the eye detection means based on the size of the black eye area detected by the eye detection means. A relatively large black eye area is functioned as black eye drawing means for newly drawing in the processed image acquired by the second acquisition means.

  According to the present invention, it is possible to improve the expressiveness of eyes in a face image generated by binarization processing.

It is a block diagram which shows schematic structure of the imaging device of one Embodiment to which this invention is applied. 3 is a flowchart illustrating an example of an operation related to an image generation process performed by the imaging apparatus in FIG. 1. It is a figure for demonstrating the image generation process of FIG. It is a figure for demonstrating the image generation process of FIG. It is a figure for demonstrating the image generation process of FIG.

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus 100 according to an embodiment to which the present invention is applied.
As shown in FIG. 1, the imaging device 100 according to the present embodiment specifically includes an imaging unit 1, an imaging control unit 2, an image data generation unit 3, a memory 4, an image recording unit 5, and an image. A processing unit 6, a display control unit 7, a display unit 8, an operation input unit 9, and a central control unit 10 are provided.
The imaging unit 1, the imaging control unit 2, the image data generation unit 3, the memory 4, the image recording unit 5, the image processing unit 6, the display control unit 7, and the central control unit 10 are connected via a bus line 11. Yes.

  Note that a known device can be applied to the imaging apparatus 100, and not only a digital camera having a main function as an imaging function, but also a mobile phone having an imaging function that is not a main function as in the present embodiment. And mobile terminals such as smartphones.

  The imaging unit 1 captures a predetermined subject and generates a frame image as an imaging unit. Specifically, although not shown, the imaging unit 1 includes a lens unit such as a zoom lens and a focus lens, and electronic imaging such as a CCD (Charge Coupled Device) and a CMOS (Complementary Metal-oxide Semiconductor). And a lens driving unit that moves the zoom lens and the focus lens in the optical axis direction.

The imaging control unit 2 controls the imaging of the subject by the imaging unit 1. That is, the imaging control unit 2 includes a timing generator, a driver, and the like, although not illustrated. Then, the imaging control unit 2 scans and drives the electronic imaging unit with a timing generator and a driver, and converts the optical image that has passed through the lens unit into a two-dimensional image signal with a predetermined period by the electronic imaging unit. A frame image for each screen is read from the imaging area of the imaging unit and output to the image data generation unit 3.
Further, the imaging control unit 2 may perform adjustment control of conditions when imaging an object such as AF (automatic focusing process), AE (automatic exposure process), AWB (automatic white balance), and the like.

The image data generation unit 3 appropriately adjusts the gain for each RGB color component with respect to the analog value signal of the frame image transferred from the electronic imaging unit of the imaging unit 1, and then performs sample holding by a sample hold circuit (not shown). The A / D converter (not shown) converts it into digital data, and the color process circuit (not shown) performs color process processing including pixel interpolation processing and γ correction processing. Color difference signals Cb and Cr (YUV data) are generated.
The luminance signal Y and the color difference signals Cb and Cr output from the color process circuit are DMA-transferred to a memory used as a buffer memory via a DMA controller (not shown).

  The memory 4 is composed of, for example, a DRAM (Dynamic Random Access Memory) or the like, and temporarily stores data processed by the image processing unit 6 or the central control unit 10.

The image recording unit 5 is configured by, for example, a non-volatile memory (flash memory) or the like, and is recorded by a coding unit (not shown) of the image processing unit 6 in a predetermined compression format (for example, JPEG format). Record image data for use. The image recording unit 5 records, for example, the image data of the portrait image P1 in association with the image data of the original image as the processing target image of the image generation process.
The image recording unit 5 may be configured, for example, such that a recording medium (not shown) is detachable, and controls reading of data from the loaded recording medium and writing of data to the recording medium.

The image processing unit 6 includes an image acquisition unit 6a, a portrait image generation unit 6b, an eye detection unit 6c, a mask generation unit 6d, a range setting unit 6e, and a black eye drawing unit 6f.
Note that each unit of the image processing unit 6 is configured by, for example, a predetermined logic circuit, but the configuration is an example and is not limited thereto.

The image acquisition unit 6a acquires an image to be processed in the image generation process.
That is, the image acquisition unit (first acquisition unit) 6a acquires image data of an original image (for example, a photographic image; not shown). Specifically, the first image acquisition unit 6a duplicates the image data (RGB data or YUV data) of the original image generated by the image data generation unit 3 by imaging the subject by the imaging unit 1 and the imaging control unit 2. A copy of the image data of the original image acquired from the memory 4 or recorded in the image recording unit 5 is acquired.
The image acquisition unit (second acquisition unit) 6a acquires image data of the portrait image (processed face image) P1 (see FIG. 3A). Specifically, the image acquisition unit 6a acquires, for example, a copy of the image data of the portrait image P1 generated by the portrait image generation unit 6b and recorded in the image recording unit 5.
Each process by the image processing unit 6 to be described later may be performed on the image data itself of the original image or the portrait image P1, or the image data of the original image or the portrait image P1 is converted to a predetermined ratio as necessary. This may be performed on the reduced image data of a predetermined size (for example, VGA size, etc.) reduced in step (b).

The portrait image generating unit 6b generates a portrait image P1 that schematically represents the face.
In other words, the portrait image generation unit 6b performs a binarization process on the original image (not shown) with a predetermined threshold to generate a portrait image (processed face image) P1. Specifically, for example, the portrait image generation unit 6b performs smoothing processing, blurring processing, and the like on the original image (for example, a photographic image), and then performs binarization processing with a predetermined threshold value to perform binarization processing. Generate a digitized image. Next, the portrait image generation unit 6b detects a face area from the binarized image by a predetermined face detection process, for example, and then performs a fine part extraction process on the face area, for example, eyes, nose, mouth Then, a fine face portion image (not shown) in which the face constituting portions such as the eyebrows, the hair, and the face contour are represented by lines is generated. Then, the caricature image generation unit 6b represents the main face such as eyes, nose, mouth, and eyebrows, for example, with lines representing the face constituent part existing in the face contour in the face region and the face constituent part in contact with the contour. A face component image (not shown) including a part image of the component is generated. After that, the portrait image generation unit 6b specifies a position where the part image of each face component is superimposed on the inner side of the face outline of the predetermined hairstyle image, and superimposes the part image of each face component on the position. Then, the image data of the portrait image P1 schematically representing the original image with the portrait is generated.
Here, the portrait image generation unit 6b may generate an image represented by adding a predetermined color to a predetermined portion of the portrait image P1 (for example, a face component such as eyes, mouth, and eyebrows).
Note that the smoothing process, the blurring process, the binarization process, the face detection process, and the like described above are known techniques, and thus detailed description thereof is omitted here.

The eye detection unit 6c detects the eye E in the portrait image P1.
That is, the eye detection unit (eye detection means) 6c detects the eye E in the original image acquired by the image acquisition unit 6a. Specifically, the eye detection unit 6c identifies and detects the black eye Ea, the upper eyelid Eb, and the lower eyelid Ec that constitute the eye E in the original image, for example, by processing using an AAM (Active Appearance Model).
Here, AAM is a technique for modeling a visual event, and is a process for modeling an image of an arbitrary face region. For example, the eye detection unit 6c uses predetermined registration means for statistical analysis results of positions and pixel values (for example, luminance values) of predetermined feature parts (for example, eyes, nasal heads, face lines, etc.) in a plurality of sample face images. Register with. Then, the eye detection unit 6c sets a shape model representing the shape of the face and a texture model representing “Appearance” in the average shape with reference to the position of the characteristic part, and using these models, the face region Model the image. Thereby, the black eye Ea, the upper eyelid Eb, and the lower eyelid Ec constituting the eye E in the original image are modeled (see FIG. 3B).
The black eye is a region corresponding to an iris that adjusts the amount of light entering the retina by adjusting the size of the pupil, that is, a region other than the white eye of the eye E. In addition, for example, in the case of so-called blind eyes in which the color of the iris is other than black, the region other than the white of the eyes is represented by black pixels by the binarization process, and hence it is formally referred to as a black eye.

The mask generation unit 6d generates a mask image M that covers a region other than the eyes E in the portrait image P1.
That is, the mask generation unit (generation unit) 6d generates a mask image M that covers a region other than the eyes E detected by the eye detection unit 6c in the portrait image (processed face image) P1. Specifically, for example, the mask generation unit 6d generates, for each of the left and right eyes E, a mask image M having a mask region Ma having the upper eyelid Eb and the lower eyelid Ec as the outline of the eye E (FIG. 4A )reference).
The mask image M generated by the mask generation unit 6d is a portrait image so that the center of the left and right mask areas Ma (for example, the center of the portion corresponding to the black eye) substantially matches the center of the corresponding black eye Ea of the eye E. By being applied to P1, all the regions other than the eyes E of the portrait image P1 are covered with the mask image M (see FIG. 4B).

The range setting unit 6e sets a filled range A in the portrait image P1.
That is, the range setting unit (setting unit) 6e uses the mask image M generated by the mask generation unit 6d to fill in a predetermined color in the portrait image (processed face image) P1 (predetermined range). Set A. Specifically, the range setting unit 6e uses the mask image M to prevent the left and right eyes E detected by the eye detection unit 6c from protruding from the contours of the eyes E (upper eye Eb and lower eyelid Ec). In this way, the filling range A is set (see FIG. 4B).
For example, the range setting unit 6e calculates, for each of the left and right eyes E detected by the eye detection unit 6c, the coordinate position of the center of the black eye Ea and the size (for example, radius) of the black eye Ea in the portrait image P1. To do. Then, the range setting unit 6e applies the mask image M to the portrait image P1 so that the center of each mask area Ma substantially coincides with the center of the black eye Ea of the corresponding eye E, and then the black eye in the mask area Ma. A circular fill range A is set with the radius being a length obtained by multiplying the radius of the black eye Ea by a predetermined coefficient (for example, 1.3) with the coordinate position of the center of Ea as the center.
The predetermined coefficient multiplied by the radius of the black eye Ea in order to calculate the radius of the filled area A is an example and is not limited to this, and the area in which the filled area A does not protrude from the mask area Ma. It can be arbitrarily changed within the scope. Further, the shape of the filling range A is not limited to the circular shape, and may be, for example, an elliptical shape.

The black eye drawing unit 6f changes the size of the black eye region A1 to be relatively large in the portrait image P1.
That is, the black eye drawing unit (black eye drawing unit) 6f creates a black eye region A1 having a relatively large size in the portrait image (processed face image) P1 based on the detection result of the eye E by the eye detection unit 6c. Draw a new one. That is, the black eye drawing unit 6f newly adds a black eye region A1 that is relatively larger than the detected black eye Ea to the portrait image P1 based on the size of the black eye Ea of the eye E detected by the eye detection unit 6c. To draw.
Specifically, the black-eye drawing unit 6f fills a filled range (predetermined range) A with a predetermined color based on a predetermined position (for example, the center) of the black-eye region A1 in the portrait image P1, and the black-eye region A1. New drawing is performed so that the size of is relatively large. For example, the black eye drawing unit 6f relatively enlarges the size of the black eye area A1 in the portrait image P1 by painting the inside of the painting range A in the portrait image P1 with a predetermined color (for example, black) ( (See FIG. 5).

The display control unit 7 performs control to read display image data temporarily stored in the memory 4 and display it on the display unit 8.
Specifically, the display control unit 7 includes a VRAM (Video Random Access Memory), a VRAM controller, a digital video encoder, and the like. The digital video encoder reads the luminance signal Y and the color difference signals Cb and Cr read from the memory 4 and stored in the VRAM (not shown) under the control of the central control unit 10 through the VRAM controller. Are periodically read out, and a video signal is generated based on these data and output to the display unit 8.

  The display unit 8 is, for example, a liquid crystal display panel, and displays an image captured by the imaging unit 1 based on a video signal from the display control unit 7 on a display screen. Specifically, the display unit 8 sequentially updates a plurality of frame images generated by imaging the subject by the imaging unit 1 and the imaging control unit 2 at a predetermined frame rate in the still image capturing mode and the moving image capturing mode. While displaying the live view image. The display unit 8 displays an image (rec view image) recorded as a still image or an image being recorded as a moving image.

  The operation input unit 9 is for performing a predetermined operation of the imaging apparatus 100. Specifically, the operation input unit 9 includes a shutter button related to an imaging instruction of a subject, a selection determination button related to an instruction to select an imaging mode and a function, a zoom button related to an instruction to adjust the zoom amount, and the like (all not shown). And outputs a predetermined operation signal to the central control unit 10 in accordance with the operation of each button of the operation unit.

  The central control unit 10 controls each unit of the imaging device 100. Specifically, although not shown, the central control unit 10 includes a CPU (Central Processing Unit) and the like, and performs various control operations according to various processing programs (not shown) for the imaging apparatus 100.

<Image generation processing>
Next, image generation processing by the imaging apparatus 100 will be described with reference to FIGS.
FIG. 2 is a flowchart illustrating an example of an operation related to the image generation process.

The image generation process is performed when the central control unit 10 is instructed to select an image generation mode from a plurality of operation modes displayed on the menu screen based on a predetermined operation of the selection determination button of the operation input unit 9 by the user. This process is executed by each unit of the imaging apparatus 100, particularly the image processing unit 6 under the control of the above.
Further, it is assumed that the image data of the original image and the portrait image P1 to be processed in the image generation process are recorded in the image recording unit 5 in advance.

As shown in FIG. 2, first, the image acquisition unit 6 a generates an image based on a predetermined operation of the operation input unit 9 by the user among the image data of the plurality of portrait images P <b> 1 recorded in the image recording unit 5. Image data designated as a processing target is read out from the image recording unit 5 and acquired (step S1; see FIG. 3A). Further, the image acquisition unit 6a reads out and acquires the image data of the original image associated with the portrait image P1 from the image recording unit 5.
Next, the eye detection unit 6c performs a predetermined eye detection process (for example, AAM or the like) on the image data of the original image acquired by the image acquisition unit 6a, so that the black eye Ea and upper eye Eb and lower eyelid Ec are detected (step S2; see FIG. 3B). Subsequently, the mask generation unit 6d generates a mask image M having a mask area Ma having the upper eye Eb and the lower eyelid Ec as the outline of the eye E for each of the left and right eyes E detected by the eye detection unit 6c ( Step S3; see FIG. 4 (a)).

  Next, the range setting unit 6e calculates the coordinate position of the center of the black eye Ea and the size (for example, radius, etc.) of the black eye Ea for each of the left and right eyes E detected by the eye detection unit 6c (step S4). . Subsequently, the range setting unit 6e applies the mask image M to the portrait image P1 so that the center of each mask area Ma substantially coincides with the center of the black eye Ea of the corresponding eye E, and fills in the mask area Ma. A range A is set (step S5; see FIG. 4B). Specifically, the range setting unit 6e sets a circular filled range A with the radius being the length obtained by multiplying the radius of the black eye Ea by a predetermined coefficient around the coordinate position of the center of the black eye Ea. .

Thereafter, the black-eye drawing unit 6f generates a black-eye enlarged image P2 in which a relatively large black-eye region A1 is newly drawn by filling the inside of the filling range A with a predetermined color (for example, black) in the portrait image P1. (Step S6; see FIG. 5). Thereafter, the image recording unit 5 acquires and records the image data of the black-eye enlarged image P2.
Thereby, the image generation process is terminated.

  As described above, according to the imaging apparatus 100 of the present embodiment, a portrait image (processed face image) generated by performing binarization processing at a predetermined threshold based on the detection result of the eye E. Since the black eye area A1 that is relatively enlarged in P1 is newly drawn, the eye E in the portrait image P1 is not enlarged as a whole, but the black eye area A1 is made relatively larger than the white eye area. It is possible to improve the expressive power of the eyes E in the face image generated by the binarization process. That is, since the portrait image P1 is generated by performing the binarization process, the ratio of the size of the black eye to the face area becomes substantially equal to the actual face, so the degree of completeness of the portrait image P1 decreases. However, there is a possibility that the viewer's satisfaction with the portrait image P1 may be reduced, but it is generated by binarization processing by newly drawing a black eye area A1 that is relatively larger than the white eye area. The expressive power of the eyes E in the portrait image P1 can be improved and the completeness of the portrait image P1 can be improved.

Also, since the painted range (predetermined range) A based on the predetermined position of the black eye area A1 in the portrait image P1 is filled with a predetermined color, and the black eye area A1 is newly drawn to be relatively large, the black eye The size of the area A1 can be appropriately changed by simple processing.
Specifically, using the mask image M that covers a region other than the eyes E in the portrait image P1, a fill range A is set in the portrait image P1, and the set fill range A is set to a predetermined range. By painting with colors, a relatively enlarged black eye area A1 can be newly drawn. In particular, since the fill area A is set so as not to protrude from the outline of the eye E using the mask image M, the fill area A can be set appropriately and the size of the black eye area A1 can be changed appropriately. Can be done.

The present invention is not limited to the above-described embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, in the above embodiment, the size of the black eye area A1 is relatively increased in the portrait image P1 by filling the fill range A set in the portrait image P1 with a predetermined color. However, this is an example of a method for changing the size of the black eye area A1, and is not limited to this, and can be arbitrarily changed as appropriate. For example, the size of the black eye region A1 may be relatively increased by relatively reducing the size of the white eye region other than the black eye region A1 in the portrait image P1.

  In the above embodiment, the portrait image P1 does not need to be an image representing the front face. For example, the portrait image P1 may be a portrait image P1 whose face is tilted around a predetermined axis. good. In this case, an image in which the face of the portrait image P1 is deformed so that the face faces the front may be generated and used.

Furthermore, in the above embodiment, the portrait image generating unit 6b that generates the portrait image P1 schematically representing the face is provided. However, the embodiment is not limited to this example, and the portrait is not necessarily limited thereto. It is not necessary to include the image generation unit 6b.
In the above embodiment, the portrait image P1 is exemplified as the processing target image of the image generation process. However, the image is not limited to this example. For example, an image before processing to process the portrait, That is, an image captured by the imaging unit 1 may be used. In addition, when the portrait image P1 is generated from the pre-processed image to be processed into a portrait, the black eye region A1 may be newly drawn so as to be relatively large.

  Furthermore, in the said embodiment, although the portrait image P1 was illustrated as a processed face image, it is an example and it is not restricted to this, A binarization process is performed by a predetermined threshold value. The generated face image can be arbitrarily changed as appropriate.

  In addition, the configuration of the imaging apparatus 100 is merely an example illustrated in the above embodiment, and is not limited thereto. Further, although the imaging apparatus 100 has been exemplified as the image processing apparatus, the present invention is not limited to this, and any configuration may be used as long as the image processing according to the present invention can be executed.

In addition, in the above embodiment, the functions of the first acquisition unit, the second acquisition unit, the eye detection unit, and the black eye drawing unit are controlled under the control of the CPU of the central control unit 10 by the image acquisition unit 6a, The configuration is realized by driving the eye detection unit 6c and the black eye drawing unit 6f. However, the configuration is not limited to this, and is realized by executing a predetermined program or the like by the CPU of the central control unit 10. It is good also as a structure.
That is, a program including a first acquisition processing routine, a second acquisition processing routine, an eye detection processing routine, and a black eye drawing processing routine is stored in a program memory (not shown) that stores the program. Then, the CPU of the central control unit 10 may function as means for acquiring the original image by the first acquisition processing routine. Further, the CPU of the central control unit 10 is caused to function as means for acquiring a processed face image generated by performing binarization processing on the original image with a predetermined threshold by the second acquisition processing routine. Anyway. Further, the CPU of the central control unit 10 may function as a means for detecting the eye E in the acquired original image by the eye detection processing routine. Further, the CPU of the central control unit 10 in the black eye drawing processing routine newly creates a black eye area A1 relatively larger than the black eye area of the detected eye E in the processed face image based on the detection result of the eye E. You may make it function as a means to draw in.

  Similarly, the generation unit and the setting unit may be realized by a predetermined program executed by the CPU of the central control unit 10.

  Furthermore, as a computer-readable medium storing a program for executing each of the above processes, a non-volatile memory such as a flash memory or a portable recording medium such as a CD-ROM is applied in addition to a ROM or a hard disk. Is also possible. A carrier wave is also used as a medium for providing program data via a predetermined communication line.

Although several embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
First acquisition means for acquiring an original image;
Second acquisition means for acquiring a processed face image generated by performing binarization processing on the original image with a predetermined threshold;
Eye detection means for detecting eyes in the original image acquired by the first acquisition means;
Based on the size of the black eye region detected by the eye detection unit, a black eye region relatively larger than the detected black eye region is newly added to the processed image acquired by the second acquisition unit. Black eye drawing means for drawing;
An image processing apparatus comprising:
<Claim 2>
The black eye drawing means further includes:
In the processed face image, a predetermined range based on a predetermined position of the black eye region is filled with a predetermined color, and a new drawing is performed so that the size of the black eye region is relatively increased. The image processing apparatus according to claim 1.
<Claim 3>
Generating means for generating a mask image covering a region other than the eyes detected by the eye detecting means in the processed face image;
Setting means for setting the predetermined range in the processed face image using the mask image generated by the generation unit;
The black eye drawing means
The image processing apparatus according to claim 2, wherein the predetermined range set by the setting unit is filled with a predetermined color.
<Claim 4>
The setting means further includes:
The image processing apparatus according to claim 3, wherein the predetermined range is set using the mask image so as not to protrude from the outline of the eye detected by the eye detection unit.
<Claim 5>
The image processing apparatus according to claim 1, wherein the processed face image includes a portrait image that schematically represents a face.
<Claim 6>
An image processing method using an image processing apparatus,
Obtaining an original image;
Obtaining a processed face image generated by subjecting the original image to a binarization process at a predetermined threshold;
Detecting an eye in the acquired original image;
Based on the size of the detected black eye region, newly drawing a black eye region that is relatively larger than the detected black eye region in the processed image;
An image processing method comprising:
<Claim 7>
The computer of the image processing device
First acquisition means for acquiring an original image;
Second acquisition means for acquiring a processed face image generated by performing binarization processing on the original image with a predetermined threshold;
Eye detection means for detecting eyes in the original image acquired by the first acquisition means;
Based on the size of the black eye area detected by the eye detection means, a black eye area relatively larger than the detected black eye area is newly added to the processed image acquired by the second acquisition means. Black eye drawing means for drawing,
A program characterized by functioning as

DESCRIPTION OF SYMBOLS 100 Imaging device 1 Imaging part 5 Image recording part 6 Image processing part 6a Image acquisition part 6c Eye detection part 6d Mask generation part 6e Range setting part 6f Black eye drawing part 10 Central control part

Claims (7)

First acquisition means for acquiring an original image;
Second acquisition means for acquiring a processed face image generated by performing binarization processing on the original image with a predetermined threshold;
Eye detection means for detecting eyes in the original image acquired by the first acquisition means;
Based on the size of the black eye region detected by the eye detection unit, a black eye region relatively larger than the detected black eye region is newly added to the processed image acquired by the second acquisition unit. Black eye drawing means for drawing;
An image processing apparatus comprising: The black eye drawing means further includes:
In the processed face image, a predetermined range based on a predetermined position of the black eye region is filled with a predetermined color, and a new drawing is performed so that the size of the black eye region is relatively increased. The image processing apparatus according to claim 1. Generating means for generating a mask image covering a region other than the eyes detected by the eye detecting means in the processed face image;
Setting means for setting the predetermined range in the processed face image using the mask image generated by the generation unit;
The black eye drawing means
The image processing apparatus according to claim 2, wherein the predetermined range set by the setting unit is filled with a predetermined color. The setting means further includes:
The image processing apparatus according to claim 3, wherein the predetermined range is set using the mask image so as not to protrude from the outline of the eye detected by the eye detection unit.   The image processing apparatus according to claim 1, wherein the processed face image includes a portrait image that schematically represents a face. An image processing method using an image processing apparatus,
Obtaining an original image;
Obtaining a processed face image generated by subjecting the original image to a binarization process at a predetermined threshold;
Detecting an eye in the acquired original image;
Based on the size of the detected black eye region, newly drawing a black eye region that is relatively larger than the detected black eye region in the processed image;
An image processing method comprising: The computer of the image processing device
First acquisition means for acquiring an original image;
Second acquisition means for acquiring a processed face image generated by performing binarization processing on the original image with a predetermined threshold;
Eye detection means for detecting eyes in the original image acquired by the first acquisition means;
Based on the size of the black eye area detected by the eye detection means, a black eye area relatively larger than the detected black eye area is newly added to the processed image acquired by the second acquisition means. Black eye drawing means for drawing,
A program characterized by functioning as