JPH10255017A - Method and device for generating likeness - Google Patents

Abstract

PROBLEM TO BE SOLVED: To automatically generate an emphasized face image to be the substantial features of a likeness by arranging face parts so as to emphasize the features of the face. SOLUTION: A contour image extracting means 6 extracts the contour of a face as a graphic surrounded by a hair style and the outline of a jaw. Plural kinds of face part images are stored in a part image storing means 7 and these part images are properly selected in accordance with a selected featured value inputted from a featured valve extracting means 3 and outputted to a part arrangement means 8. The means 7 changes the value of a selecting parameter in accordance with the evaluation result of the selecting featured value inputted from the means 3. Parts corresponding to the selecting parameter are prepared as part images and outputted to the means 8. An output from the means 8 is a face image obtained by synthesizing the part images and contour images. A face image output means 9 visibly outputs the face image.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portrait creating method and apparatus for automatically creating a portrait based on a face image of a target person obtained by, for example, a video camera or an electronic still camera. In particular, the relative positional relationship between the face part images, and the size and shape of the face part images themselves,
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a caricature creation method and apparatus capable of automatically creating an exaggerated face image which is an essential feature of a caricature by exaggerating a measured value of a face of a target person.

[0002]

2. Description of the Related Art Conventionally, as an apparatus used for creating a face image such as a portrait, for example, Japanese Patent Application Laid-Open No. Hei 6-324671 is disclosed.
A "graphic display device" described in Japanese Patent Application Laid-Open Publication No. H10-209,985 is known.
In this apparatus, in short, an appropriate part image is selected from an image database of face parts such as eyebrows, eyes, nose, and mouth, and the selected part image is displayed on a plain face image without face parts. It is to be arranged in.

That is, in the apparatus, a parameter D indicating the direction of a portrait in which a portrait is inserted in the background, an enlargement ratio M for performing enlargement / reduction processing of the portrait, a portrait in the background. Are respectively selected to indicate the position at which the is inserted. Then, the portrait synthesis result data is synthesized with the position indicated by the position parameter Cn on the background data and displayed on the display device. Thereby, the portrait is input from the front, and then the portrait data of a different angle is automatically generated simply by selecting the direction parameter D corresponding to the display angle data d, and the portrait is easily matched with the content of the background data. In addition, the size of each figure is appropriately adjusted.

However, in such a conventional apparatus, since the position of the figure with respect to the background is determined as Cn, it is necessary to adjust the position of the face parts and automatically synthesize a face in which the face is emphasized. Can not.

[0005] In addition, in such a conventional device,
There is a problem that many face part images must be prepared in advance so as to be able to handle various human face parts.

[0006]

As described above, in the conventional apparatus, the place where the face part image is arranged is the same as the place of the fixed or real part, so that the exaggeration, which is an essential feature of the portrait, is used. There is a problem that a face image cannot be created.

[0007] In addition, in such a conventional device,
There is a problem that many face part images must be prepared in advance so as to be able to handle various human face parts.

The present invention has been made in view of such a conventional problem.
It is an object of the present invention to provide a portrait creating method and apparatus capable of automatically creating an exaggerated face image which is an essential feature of a portrait.

Another object of the present invention is to provide a portrait creating method and apparatus which can eliminate the need to prepare many facial parts in advance even when corresponding to various human facial parts. It is in.

Another object of the present invention is to provide a caricature creation method and apparatus that can be enjoyed by disguising a caricature that is an exaggerated face image.

Still another object of the present invention is to provide a portrait creating method and apparatus which can easily and repeatedly create a portrait based on a favorite face photograph or the like.

[0012]

According to a first aspect of the present invention, there is provided a face image input means for inputting a face image, and a face image input from the face image input means by analyzing the face image. A face feature amount extraction unit that extracts a face feature amount that is a feature amount related to the shape and arrangement of the part; a face part data storage unit that stores a plurality of face part data for each type of the face part;
A face part data extraction unit that extracts, from the face part data storage unit, face part data corresponding to the shape feature amount for each type of face part by using a feature amount related to the shape of the face part; Change parameter input means for inputting a change parameter for controlling a change of a position at which the face part represented by the face part data is arranged; and a placement feature of the face part in the face feature based on the change parameter. And a face part arranging means for arranging a face part pattern corresponding to the face part data extracted by the face part data extracting means at a position indicated by the corrected arrangement feature amount. Is in the portrait drawing device.

Here, the "arrangement feature amount" means a feature position at which an arrangement can be made or a feature amount at which an arrangement position can be generated. In an embodiment described later, X1, Y
1, Eye height and the like correspond to this.

According to the first aspect of the present invention, it is possible to arrange face parts so as to emphasize the features of the face, so that an exaggerated face image which is an essential feature of a portrait is automatically generated. Can be created.

In the invention described in claim 2 of the present application, the face part arranging means adjusts the correction amount of the arrangement feature based on the gender of the person whose portrait is to be created or whether it is an adult. The portrait drawing apparatus according to claim 1, characterized in that:

According to the second aspect of the present invention, a more exaggerated caricature can be automatically created according to gender and adult children.

According to a third aspect of the present invention, there is provided a face feature amount extracting step of analyzing a given face image to extract a face feature amount which is a feature amount related to the shape and arrangement of a face part. From a plurality of pieces of face part data stored in advance for each type of part, face part data corresponding to the shape feature amount is extracted for each type of face part by using a feature amount related to the shape of the face part. A face part data extraction step; a change parameter input step for inputting a change parameter for controlling a change of a position at which a face part represented by the extracted face part data is arranged; and the face feature based on the change parameter. The position feature amount of the face part in the quantity is corrected, and the face part pattern corresponding to the face part data extracted in the face part data extraction step is indicated by the corrected placement feature amount. To anda facial component placement step of placing, in the portrait creation method characterized by.

According to the third aspect of the present invention, it is possible to arrange the face parts so as to emphasize the features of the face, so that the exaggerated face image, which is an essential feature of the portrait, is automatically generated. Can be created.

According to a fourth aspect of the present invention, in the face part arranging step, the correction amount of the arrangement feature amount is adjusted based on the gender of the person whose portrait is to be created or whether or not it is an adult. The portrait drawing creation method according to claim 3, characterized in that:

According to the fourth aspect of the present invention, it is possible to arrange the face parts so as to emphasize the features of the face, so that the exaggerated face image, which is an essential feature of the portrait, is automatically generated. Can be created.

According to a fifth aspect of the present invention, there is provided a face image inputting means for inputting a face image, and a face part characteristic amount extracting means for extracting a characteristic amount of a face part from the input face image. A parameter generating means for generating a parameter for converting the size or shape of the face part used in the portrait based on the feature amount of the face part, and a face storing a plurality of face parts used in the portrait for each type of the face part Part data storage means, and a portrait synthesizing means for synthesizing a portrait using a face part obtained by converting the size or shape of the face part read from the face part data storage means by the parameter. The feature is in the portrait creation device.

According to the fifth aspect of the present invention, the shape and size of the face part can be changed and exaggerated.
An impressive portrait can be created, and the storage amount of the face part image can be reduced.

The invention according to claim 6 of the present application is characterized in that the parameter generating means determines the parameter based on the gender of the person whose portrait is to be created or whether it is an adult. Item 5 is a portrait drawing creation apparatus.

According to the present invention, a child-like face, a feminine face, and the like can be easily created.

According to a seventh aspect of the present invention, there is provided a face part feature amount extracting step of analyzing a given face image to extract a face part feature amount, and a portrait based on the face part feature amount. A parameter generation step of generating a parameter for converting the size or shape of the face part used in the step, and the size or size of the face part read out from a plurality of face part data stored in advance for each type of face part A portrait synthesizing step of synthesizing a portrait using a face part obtained by converting a shape using the parameter.

According to the seventh aspect of the present invention, the shape and size of the face part can be changed and exaggerated.
An impressive portrait can be created, and the storage amount of the face part image can be reduced.

According to an eighth aspect of the present invention, in the parameter generating step, the parameters are determined based on the sex of the person whose portrait is to be created or whether the person is an adult. Item 7 is a portrait drawing creation method.

According to the eighth aspect of the present invention, a child-like face, a feminine face, and the like can be easily created.

According to a ninth aspect of the present invention, there is provided a computer, comprising: a computer for analyzing a face image input means for inputting a face image; And a face feature amount extraction unit that extracts a face feature amount that is a feature amount related to the arrangement, a face part data storage unit that stores a plurality of face part data for each type of face part,
A face part data extraction unit that extracts, from the face part data storage unit, face part data corresponding to the shape feature amount for each type of face part by using a feature amount related to the shape of the face part; Change parameter input means for inputting a change parameter for controlling a change of a position at which the face part represented by the face part data is arranged; and a placement feature of the face part in the face feature based on the change parameter. And a face part arranging means for arranging a face part pattern corresponding to the face part data extracted by the face part data extracting means at a position indicated by the corrected arrangement feature amount. Is recorded on a recording medium.

According to the ninth aspect of the present invention, it is possible to arrange the face parts so as to emphasize the features of the face, so that the exaggerated face image, which is an essential feature of the portrait, is automatically generated. Can be created.

According to a tenth aspect of the present invention, a computer is provided with a face image input means for inputting a face image, and a face part feature quantity for extracting a face part feature quantity from the input face image. Extraction means, parameter generation means for generating a parameter for converting the size or shape of the face part used in the portrait based on the feature amount of the face part, and a plurality of face parts used in the portrait for each type of face part Face part data storage means for storing, and a portrait synthesis means for synthesizing a portrait using a face part obtained by converting the size or shape of the face part read from the face part data storage means by the parameter, It is on a recording medium on which a program for functioning is recorded.

According to the tenth aspect of the present invention, since the shape and size of the face part can be changed and exaggerated, an impressive portrait can be created, and the storage amount of the face part image for that purpose can be reduced. You can save money.

[0033] According to an eleventh aspect of the present invention, there is provided a portrait creating means for creating a portrait image corresponding to an input face image, and a background storing a plurality of background part images to be background parts of the portrait. A part image storage unit, a selection unit for selecting a background part image stored in the background part image storage unit, a background part image selected by the selection unit, and a portrait created by the portrait creation unit There is provided a portrait drawing apparatus comprising: an image synthesizing unit for synthesizing an image; and an output unit for displaying or printing out the image synthesized by the image synthesizing unit.

According to the eleventh aspect of the present invention, it is possible to make use of a caricature that is an exaggerated face image and further enjoy the disguise.

According to a twelfth aspect of the present invention, there is provided a portrait creating step of creating a portrait image corresponding to an input face image, and selecting a plurality of background part images stored as background parts of the portrait. A selecting step for selecting a desired background part image; an image synthesizing step for synthesizing the selected background part image with the created portrait image; and displaying or printing out the synthesized image. And an image output step.

According to the twelfth aspect of the present invention, it is possible to make use of a caricature that is an exaggerated face image and to further enjoy in a disguise.

According to a thirteenth aspect of the present invention, a computer stores a portrait creating means for creating a portrait image corresponding to an input face image, and a plurality of background part images to be background parts of the portrait. The background part image storage means, the selection means for selecting the background part image stored in the background part image storage means, and the background part image selected by the selection means and the portrait image creation means An image synthesizing unit for synthesizing the caricature image thus obtained, and an output unit for displaying or printing out the image synthesized by the image synthesizing unit are provided on a recording medium storing a program for causing the image to function.

According to a fourteenth aspect of the present invention, a first portrait creating means for creating a portrait image corresponding to an input face image, and information about portrait parts constituting the portrait and the arrangement thereof are generated. Component information generating means, information recording means for recording the component information on a predetermined recording medium, information reading means for reading the component information from the recording medium, and And a second portrait creation unit for creating the portrait image based on the portrait image.

According to the fourteenth aspect of the present invention, it is possible to easily and repeatedly create a portrait based on a favorite face photograph or the like.

The invention according to claim 15 of this application provides a first portrait creation step for creating a portrait image corresponding to an input face image, and generates information relating to portrait parts constituting the portrait and the arrangement thereof. A component information generating step, an information recording step for recording the component information on a predetermined recording medium, an information reading step for reading the component information from the recording medium, and And a second portrait creation step of creating the portrait image based on the portrait image.

According to the fifteenth aspect, a portrait based on a favorite face photograph or the like can be easily and repeatedly generated.

The invention according to claim 16 of the present application relates to a first portrait creating means for creating a portrait image corresponding to an input face image, a portrait part constituting the portrait, and an arrangement thereof. Component information generating means for generating information; information recording means for recording the component information on a predetermined recording medium; information reading means for reading the component information from the recording medium; and A second portrait creation means for creating the portrait image based on the part information is provided on a recording medium storing a program for causing the portrait image to function.

[0043]

Preferred embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

FIG. 1 shows the overall configuration of a portrait creating apparatus according to a preferred embodiment (first embodiment) of the present invention, and FIG. 2 is a flowchart for explaining the operation procedure.

As shown in FIG. 1, the portrait creating apparatus includes a data input unit 1, an image input unit 2, a feature extraction unit 3, a feature storage unit 4, a nonlinear function creation unit 5, Contour image extraction means 6 and component image storage means 7
, Component arrangement means 8 and face image output means 9. These means 1 to 9 are specifically configured as follows.

The data input means 1 is used by a user to input a person parameter and an exaggeration degree parameter to be described later, and is constituted by an input device such as a keyboard and a mouse. Here, in this example,
The value of the person parameter (Person_para) is an integer, and specifically, 0 (adult male), 1 (adult female),
(Child). In this example, the distinction between an adult and a child is 15 years or older as an adult and a child under 15 years as a child.

The image input means 2 is for taking in a color face image of a target person into the apparatus. Specifically, the image input means 2 can be constituted by, for example, a video camera, an electronic still camera, or the like. The captured color face image is stored in some storage medium (eg, floppy disk, MO
(A disc, a DVD, or the like), a reproducing apparatus that reproduces a color face image from such a recording medium may be used.

The feature value extracting means 3 is for extracting the feature value of the face of the target person from the color face image input by the image input means 2. Here, the feature amounts include a selection feature amount, an arrangement feature amount, and a scaling ratio (Scale_rati
o). The feature amount for selection includes eye size (Eye_size), eye shape (Eye_shape), nose shape (Nose_shape), mouth size (Mouth_size), mouth shape (Mouth_shape), and eyebrow depth (Brow_thickness) )It is included. The feature amount for arrangement includes the feature amount (X1,
Y1), eye height (Eye_height), eye-nose distance (Eye_no)
se), distance between nose and mouth (Nose_mouth), distance between eyes (Eye_mouth)
space), eye-brow spacing (Eye_brow).
The above-mentioned feature quantity for selection is used for selecting a component image stored in the component image storage means 7, and the feature quantity for placement is used for synthesizing the component image on the contour image. Can be

Hereinafter, a specific method of obtaining the selection feature, the placement feature, and the enlargement / reduction ratio performed by the feature extraction means 3 will be described in detail.

First, a method for obtaining a feature point of a face contour will be described. Here, the feature points of the face outline (the vertex P of the head)
1, the lower end point P2 of the jaw, the right end point P3 of the jaw, and the left end point P4 of the jaw) are defined as shown in FIG. In order to obtain such feature points, first, the input image (RGB)
Is converted to HSV, and a flesh color region is extracted. Next, the jaw edge is detected by searching the flesh color area from below, and the lowest point of the jaw edge is set to P2. Next, the right end point of the skin color area is set to P3, and the left end point is set to P4. Then
A black area is extracted from the HSV-converted face image, and the highest point is set to P1. After obtaining the above four points (P1 to P4), the face image is converted into a gray shade image.

Next, the characteristic points (P1
To P4), a method of obtaining the feature points X1 and Y1 of the face contour will be described. xpi is the X coordinate of feature point i, ypi is the feature point i
, The characteristic points X1 and Y1 of the face contour are represented by the following equation (Equation 1).

[0052]

(Equation 1) Next, a description will be given of a method for obtaining characteristic points of the inner and outer eyes, the nose head, the left end of the nose, the right end of the nose, the left end of the mouth, and the right end of the mouth. here,
These feature points (right eye corner P5, right eye corner P6, left eye corner P6)
7, left eye corner P8, nose head P9, nose right end P10, nose left end P1
1, the right end P12 and the left end P13) are defined as shown in FIG. These feature points are obtained by template matching of the image around the feature points including the feature points. As a template matching method, for example, a normalized density correlation method can be cited. In the normalized density correlation method, a gray shade image is used. That is, the change pattern of the gray density is compared between the target image and the template image, and the more similar the change pattern of the gray density, the greater the degree of matching match.
Then, the point having the highest degree of matching in the search range is extracted as a feature point. At this time, as the template, image data obtained by averaging gray densities in the vicinity of each feature point of the face images of a plurality of persons is used. FIG. 19 shows an example of a specific matching result by template matching.

Next, the feature quantity for eye selection (Eye_size, Eye_s
hape) and a method for obtaining the arrangement feature amount (Eye_height, Eye_space) will be described with reference to FIG. Although only the left eye will be described here, the right eye can be obtained in a similar manner. In FIG. 4, the coordinate value (xp7, yp7) of the inner corner P7 and the coordinate value (xp8, y
p8) has already been given. In the case of the right eye, it is assumed that the inner corner P5 and the outer corner P6 are given.

The plotting conventions in FIG. 4 are as follows (a) to (nu).

(A) The vertical center line of the eye is parallel to the Y axis, and the horizontal center line of the eye is parallel to the X axis. (B) The X coordinate of the vertical center line of the eye = (X coordinate value of the inner corner of the eye + X coordinate of the outer corner of the eye) (Value) / 2 (c) Y coordinate of horizontal center line of eye = (Y coordinate value of inner corner of eye + Y coordinate value of outer corner of eye) / 2 (d) EyeSearchArea_X = Y1 × 0.02 (e) EyeSearchArea_Y = Y1 × 0. 1 (f) Addition brightness at Y coordinate = sum of brightness at corresponding Y coordinate in EyeSearchArea_X (g) Difference of addition brightness at Y coordinate = addition brightness at Y coordinate−brightness at (Y−1) coordinate ( G) D1 = the maximum value of the added brightness existing at a position below the horizontal center line of the eye and closest to the horizontal center line. (I) D2 = The position of the maximum above the horizontal center line of the eye and closest to the horizontal center line (3) D3 = 0.7 × min (D1, D2) where the above formula is used. In, first, the decimal point is truncated (the coordinate value is an integer value). First, the reference horizontal line of the eye and the reference vertical line of the eye are obtained.
Here, the reference horizontal line of the eye is determined as a straight line parallel to the X axis passing through the point of (yp7 + yp8) / 2, and the reference vertical line of the eye is determined along the Y axis through (xp7 + xp8) / 2. Obtained as parallel straight lines. Next, the search range in the X and Y directions of the eyes is determined according to the following equation (Equation 2).

[0056]

(Equation 2) Next, FIG. 4 shows (EyeSearchArea_X × EyeSearch
The luminance values are summed at each Y coordinate within the range of (Area_Y). However, the luminance value is 255-density value. In this example, the density of black pixels is 255, and the density of white pixels is 0. Then, at each Y coordinate, ｛(xp7 + xp8) /
2- (EyeSearchArea_X / 2)｝ ～ ｛(xp7 + xp8) / 2 +
(EyeSearchArea_X / 2) The brightness value in the range of｝ is defined as “additional brightness,” and the defined addition brightness is defined as ｛(yp7 +
yp8) / 2- (EyeSearchArea_Y / 2)｝-｛(yp7 + yp
8) Determine for each Y coordinate within the range of / 2 + (EyeSearchArea_Y / 2)｝. Here, the reason for obtaining the added brightness without using the brightness of one pixel is to prevent the influence of noise. Next, FIG. 4 shows (EyeSearchArea_X × EyeSe
For each Y coordinate within the range of (archArea_Y), the above difference in the added brightness is obtained. The difference obtained at this time is the difference between the added brightnesses of adjacent Y coordinates, as shown in the following equation (Equation 3).

[0057]

(Equation 3) Next, values D1, D2, and D3 shown in FIG. 4 are obtained.
Here, D1 is the value of the maximum point of the added brightness existing below the reference horizontal line and closest to the reference horizontal line, and D2 is the value of the added brightness existing above the reference horizontal line and closest to the reference horizontal line. The value of the maximum point, D3, is a value obtained by multiplying the smaller value of D1 and D2 by 0.7, ie,
D3 = 0.7 × min (D1, D2). Then
A search is made upward from the horizontal center line of the eye to find a point where the added brightness is greater than D3, and a straight line passing through this point and parallel to the X axis is set as EyeLineTop2. Next, a search is made downward from the horizontal center line of the eye to find a point where the added brightness becomes larger than D3, and a straight line passing through this point and parallel to the X axis is defined as EyeLineBot2. Next, a search is made in the vertical direction within a range of Y1 × 0.03 from the straight line EyeLineTop2 to find the maximum point of the difference in brightness. A straight line that passes through the maximum point and is parallel to the X axis is defined as EyeLineTop1. Then, the straight line EyeLineBo
A search is made in the range of Y1 × 0.03 in the vertical direction from t2 to find the maximum point of the difference in brightness. A straight line passing through the maximum point and parallel to the X axis is defined as EyeLineBot1. Next, the distance between two parallel lines, EyeLineTop1 and EyeLineBot1, is set to Left_Eye
Width_Y. Then, Left EyeW is calculated by the following equation (Equation 4).
Find idth_X.

[0058]

(Equation 4) Next, for the right eye, Right_EyeWidth_X and Right_EyeWidth_Y are similarly obtained, and the left and right values are averaged according to the following equation (Equation 5).

[0059]

(Equation 5) Next, the feature quantity for eye selection is obtained by calculation according to the following equation (Equation 6).

[0060]

(Equation 6) Next, an eye arrangement feature amount is obtained by calculation according to the following equation (Equation 7).

[0061]

(Equation 7) Next, the nose selection feature quantity Nose_shape and the placement feature quantity
A method for obtaining Eye_nose will be described. In this case, as shown in the following equation (Equation 8), the left and right inner corners P5,
Right Eye_nose, Lef using Y coordinate value of P7 and nasal head P9
t Find Eye_nose. Next, the calculated Right Eye_no
The se and Left Eye_nose are averaged to obtain Y4. Then
Eye_nose is obtained from the left and right nose end points P10 and P11 and the previously obtained Y4 using Nose_shape and Y2.

[0062]

(Equation 8) Next, a method for obtaining the mouth selection feature amounts Mouth_size and Mouth_shape and the arrangement feature amount Nose_mouth will be described with reference to FIG. First, the eye features EyeLineTop1, EyeLin
MouthLineTop1, MouthLine
Ask for Bot1. Next, straight lines MouthLineTop parallel to each other
The distance between 1 and MouthLineBot1 is MouthWidth_Y. Next, MouthWidth_X is calculated using the following equation (Equation 9).

[0063]

(Equation 9) Then, using the following equation (Equation 10), the feature amount for mouth selection Mo
Find uth_size and Mouth_shape.

[0064]

(Equation 10) Next, using the following equation (Equation 11), the mouth arrangement feature amount No.
Ask for se_mouth. In Equation 11, ymc is MouthLi
This is the Y coordinate of a straight line that is parallel to neTop1 and MouthLineBot1 and passes through the middle of these straight lines.

[0065]

[Equation 11] Next, a method of obtaining the eyebrow selection feature amount Brow_thickness and the arrangement feature amount Eye_brow will be described with reference to FIG.
Here, only the case of the left eyebrow will be described, but the same can be obtained for the right eyebrow. First, a search is made on the reference vertical line of the eye upward from the upper line EyeLineTop1 of the eye to find a point at which the luminance becomes minimum. This point is the darkest part and becomes the center of the eyebrows. Next, a straight line that passes through the above minimum point and is parallel to the X axis is obtained, and this is set as a reference horizontal line of the eyebrows. The reference vertical line of the eyebrows is a line obtained by extending the reference vertical line of the eye. Next, BrowLineTop1 and BrowLineBot1 are obtained in the same manner as when eye characteristic amounts EyeLineTop1 and EyeLineBot1 are obtained. Then
The distance between the straight lines BrowLineTop1 and BrowLineBot1 that are parallel to each other is determined, and this is defined as Left_BrowWidth_Y. Similarly, Right_Browwidth_Y is obtained for the right eyebrow. Next, according to the following equation (Equation 12), the selection feature amount Brow_thi
ckness is required.

[0066]

(Equation 12) Next, the arrangement feature quantity is obtained according to the following equation (Equation 13). In the following equation, ybL is BrowL of the left eyebrow
Y coordinate value of ineBot1, ybR is Y coordinate value of BrowLineBot1 of right eyebrow, yeL is Y coordinate of EyelineTop1 of left eye, yeR is Eye of right eye
This is the Y coordinate of lineTop1.

[0067]

(Equation 13) Next, an enlargement / reduction ratio Scale_ratio is obtained according to the following equation (Equation 14). In the following equation, Scale_base is an integer value set in advance.

[0068]

[Equation 14] FIG. 7 shows the structure of data output from the feature amount extracting means 3 described above to the feature amount storing means 4, the component image storing means 7, and the component arranging means 8.

As is clear from the figure, the feature amount extracting means 3 sends the feature amount storing means 4 the Eye_height, Eye_s
Pace, Eye_nose, Eye_mouth, Eye_brow are output. In addition, from the feature amount extraction means 3 to the part image storage means 7, Eye_size, Eye_shape, Nose_shape, Mouth_size, Mouth
_shape, Brow_thickness are output. Further, the feature amount extraction means 3 sends the Scale_rati
o, Eye_height, Eye_space, Eye_nose, Nose_mouth, Eye_bro
w, X1, and Y1 are output.

Next, the configuration of the feature amount storage means 4 will be described. The input of this means is a person parameter Person_para and a feature amount for arrangement, and the output is a data string of (person parameter, feature amount for arrangement). The feature amount storage unit 4 stores a pair of a person parameter Person_para and an arrangement feature amount. FIG. 8 shows the structure of each data stored in the feature amount storage unit 4. As shown in FIG. 3, the above-mentioned Person_para, Eye_height, Eye
_space, Eye_nose, Nose_mouth, Eye_brow are stored.

Next, the configuration of the nonlinear function creating means 5 is shown in FIG.
This will be described with reference to the flowchart of FIG. The input of the non-linear function creating means 5 is a data string of the person parameters and the arrangement feature values, and the output is a non-linear function.
Here, the non-linear function is used by the component arranging means 8 to exaggerate the positional relationship between the face contour and the component and the positional relationship between the component and the component. The input of this non-linear function is an arrangement feature obtained from a real object, and the output is a distance parameter between parts of a face image to be created. As the non-linear function, for example, a function such as a curve shown in FIG. 10 in which the value of the distance parameter between components tends to rapidly increase when the arrangement feature value exceeds a certain value is used. As the nonlinear function used in this example, a fuzzy inference rule is adopted. FIG. 11 shows an example of the fuzzy inference rule. In this example, the value of the consequent part of the fuzzy inference rule is set to be properly used depending on the value of the person parameter, and in the same manner as in the feature amount database, for the adult male, for the adult female, and for the child. Are prepared. Fig. 1 shows an example of the value of the consequent part
1 is shown at the right end. As for fuzzy labels, SMALL, MEDIUM,
Three types of BIG are prepared. Each fuzzy inference rule has one input and one output. The input values of the fuzzy inference are the feature amounts (Eye_height, Eye_space, Eye_nose, Nose_mouth, Eye_b) obtained by the feature amount extraction means 3.
row). In the mathematical expressions described later, X used as an input value refers to these feature amounts (Eye_
height, Eye_space, Eye_nose, Nose_mouth, Eye_brow). The output value of the fuzzy inference is a parameter between components.

A method for determining a membership function for each fuzzy label will be described below with reference to the flowchart in FIG. 9 as appropriate. First, an adult man, an adult woman, and a child are stored in the feature amount storage means 4 (step 9).
02 to 905), a data group of the arrangement feature amount is read (step 901), and then each of them is read (step 9031,
9035, 9036), the minimum value MIN, the average value AVE,
The maximum value MAX is obtained (step 9032). Then
Minimum value MIN, average value AVE, maximum value MA obtained above
Using X, each numerical value LEFT,
RIGHT is obtained by calculation (step 9033).

[0073]

(Equation 15) Next, using the values of the minimum value MIN, average value AVE, maximum value MAX, LEFT, and RIGHT determined above, SM
All, MEDIUM, and BIG membership functions are obtained (step 9034). In the flowchart of FIG. 9, I is a person parameter, and data of an adult male when I = 0, an adult female when I = 1, and a child when I = 2 is processed. Also,
J indicates the type of feature amount, and when J = 0, Eye_height,
Eye_space when J = 1, Eye_nose when J = 2,
When J = 3, processing is performed on the feature amount of Nose_mouth, and when J = 4, processing is performed on the feature amount of Eye_brow.

That is, when the input value is X and the output value is μs (X), the SMALL membership function is obtained by the following equation (Equation 16).

[0075]

(Equation 16) The MEDIUM membership function is obtained by the following equation (Equation 17) when the input value is X and the output value is μm (X).

[0076]

[Equation 17] In addition, the BIG membership function uses input values X,
When the output value is μb (X), it is obtained by the following equation (Equation 18).

[0077]

(Equation 18) Next, the configuration of the contour image extracting means 6 will be described. The input of the contour image extracting means 6 is a color face image, and the output is a binary face contour image. First, the contour image extracting means 6 extracts a skin color area of a color face image. Next, the contour image extracting means 6 binarizes the color face image. Next, the contour image extracting means 6 sets the density value inside the area corresponding to the skin color area to 0 in the binarized face image. Some examples of face contours extracted by the contour image extracting means 6 are shown in FIG. As can be seen from the figure, the contour image extracting means 6 can extract the face contour as a figure surrounded by the hairstyle and the contour of the chin for each of the target persons.

Next, the configuration of the component image storage means 7 will be described. The component image storage means 7 stores a plurality of types of right eyebrows, left eyebrows,
Images of facial parts for the right eye, left eye, nose, and mouth are stored as an image database, and these part images are appropriately selected according to the value of the selecting feature amount input from the feature amount extracting unit 3, It is output to the component placement means 8. here,
The part image is a binary image. In addition, the component image storage unit 7 evaluates the value of the selection feature amount input from the feature amount extraction unit 3 using the boundary shown in FIG. 12, and according to the evaluation result, selects the selection feature amount as follows. Change the value of a parameter.

If the value of the feature value for selection ≦ the boundary 1, the parameter value for selection = 0. If the boundary 1 <the value of the feature value for the selection ≦ boundary 2, the parameter value for selection = 1 the boundary 2 <the feature value for the selection. If the value is a selection parameter value = 2, a component corresponding to the selection parameter is prepared as the component image, and the component corresponding to the selection parameter is output to the component placement unit 8. That is, as eyebrow parts, three parts are prepared for three selection parameters of Brow_thickness. However, a total of six parts are used for the left eyebrow and the right eyebrow, and the left and right part shapes are targeted for the Y axis. In addition, Eye_size 3
Nine parts are prepared for a combination of three selection parameters and three selection parameters of Eye_shape. However, a total of 18 parts are used for the left eye and the right eye, and the shapes of the left and right parts are targeted with respect to the Y axis. Also,
As nose parts, three parts are prepared for three selection parameters of Nose_shape. In addition, the mouth part has three selection parameters of Mouth_size and
Nine parts are prepared for combinations of three selection parameters of Mouth_shape.

Next, the configuration of the component placement means 8 will be described with reference to the flowchart of FIG. The input of the component arranging means 8 is an arrangement feature amount, an enlargement / reduction ratio, a component image, a contour image, a nonlinear function, a person parameter, and an exaggeration degree parameter. The output of the component arranging means 8 is a face image obtained by synthesizing the component image and the contour image. That is, the component placement unit 8 reads the person parameter and the exaggeration degree parameter from the data input unit 1 (step 1301), and reads the contour image from the contour image extraction unit 6 (step 13).
02), the component image is read from the component image storage means 7 (step 1303), and finally the arrangement feature quantity and the enlargement / reduction ratio are read from the feature quantity extraction means 3 (step 1).
304). Then, based on the read data, the component placement parameters are obtained by inference using fuzzy inference rules (step 1305).

The fuzzy inference method will be described below. When the component placement rules shown in FIG. 11 are generalized, each location is represented by three rules expressed by the following equation (Equation 19).

[0082]

[Equation 19] Here, the output values of the SMALL, MEDIUM, and BIG membership functions are represented by μs (X), μm (X),
When μb (X) is used, the inter-component distance parameter FZ, which is an output value of fuzzy inference, is represented by a function using W1, W2, and W3 expressed by the following equation (Equation 20).

[0083]

(Equation 20) However, FZ, which is a component placement parameter, is FA for eye height, FB for eyebrow and eye spacing, FC for eye and nose spacing, FD for nose and mouth spacing, FD, left and right. Is the FE, the real value (YY2, YY3, YY4, XX2) for component placement is obtained using these values.

Next, the form of the nonlinear function is changed according to the value of the exaggeration degree parameter (step 1306). When the value of the exaggeration degree parameter is Exaggerate_para, the values of W1 and W3 in the component placement rule are changed. When the values of W1 and W3 before the change are W1_old and W3_old, and the values after the change are W1_new and W3_new, the relationship between the two is expressed by the following equation (Equation 21).

[0085]

(Equation 21) It should be noted here that in the previous equation, Exaggerate_para
Is different between the two formulas. So, Exaggera
The greater the value of te_para, the greater the degree of exaggeration.

Next, each component image is enlarged or reduced using the value Scale_ratio of the enlargement / reduction parameter of the feature amount (step 1307). A point (x,
If y) is scaled to change its position to point (X, Y), a relationship represented by the following equation (Equation 22) is established between the two. It should be noted that a person skilled in the art can easily understand a specific conversion method by referring to the description in the reference document “Practical image processing learned in C language” (Ohmsha).

[0087]

(Equation 22) Next, based on the component distance parameters and X1, Y1,
Real values (YY2, YY2) for component placement shown in FIG.
3, YY4, XX2) is obtained by the following equation (Equation 23) (step 1306). However, FA, FB, FC, F
D and FE are inter-component distance parameters which are output values of fuzzy inference.

[0088]

(Equation 23) Next, based on the obtained real values for component placement, component images are placed as shown in FIG. 14 (step 1308). However, the components are arranged such that the representative point of each component shown in FIG. That is, the coordinates at which the representative point of each part is arranged are given by
4). The image created here is 2
It is a value image.

[0089]

(Equation 24) Next, the configuration of the face image output means 9 will be described. The face image output means 9 visually outputs the face image synthesized as described above, and specifically, a printing device for outputting a hard copy of a binary image as a face image or a display device for displaying an image. And the like. Some examples of face images output in this manner are shown in FIGS.
Shown in As is apparent from these figures, by exaggerating the relative positional relationship between the face part images using the measured values of the face of the target person, the exaggerated face image, which is an essential feature of the portrait, is automatically generated. It will be understood that it is made in.

According to the first embodiment,
(1) By exaggerating the positional relationship of parts, an exaggerated face image, which is an essential feature of a portrait, can be automatically created. (2) The face image does not resemble the face of the subject. It has an extraordinary effect such as the ability to prevent excessive exaggeration.

Next, FIG. 20 shows an overall configuration of a portrait creating apparatus according to another preferred embodiment (second embodiment) of the present invention, and FIG. 21 is a flowchart for explaining the operation procedure. Shown in

As shown in FIG. 20, this caricature creation device comprises a data input means 101 and an image input means 102
, Feature amount extraction means 103, feature amount storage means 104
A component exaggeration nonlinear function creating unit 105, an arrangement exaggeration nonlinear function creating unit 106, and a contour image extracting unit 10.
7, component image storage means 108, component exaggeration means 109
And a part arranging unit 110 and a face image outputting unit 111. These means 101 to 111 are specifically configured as follows.

The data input means 101 is used by a user to input a person parameter, an exaggerated portion selection parameter, an exaggeration degree parameter, etc., which will be described later, and is constituted by an input device such as a keyboard and a mouse. ing.

Here, in this example, the person parameter (Pe
rson_para) is an integer, specifically, 0
(Adult male), 1 (Adult female), 2 (Child). In this example, the distinction between an adult and a child is 15 years or older as an adult and a child under 15 years as a child.

The exaggerated part selection parameter (Parts_se
lect_para) is also an integer value. Specifically,
1 (eye size), 2 (eye shape), 3 (nose shape),
4 (size of mouth), 5 (shape of mouth), 6 (thickness of eyebrows),
7 (eye height), 8 (eye and nose interval), 9 (nose and mouth interval), 10 (left and right eye interval), 11 (eye and eyebrow interval)
It has been decided.

Further, the value of the exaggeration degree parameter is a real value. Specifically, the value of Exaggerate_para, the value of R1, R2
And the case exists.

The image input means 102 is for taking in a color face image of a target person into the apparatus. Specifically, the image input means 102 can be constituted by, for example, a video camera, an electronic still camera, or the like. The captured color face image is stored on some storage medium (for example, floppy disk,
(MO disk, DVD, etc.), a reproducing apparatus for reproducing a color face image from such a recording medium may be used.

The feature amount extracting means 103 is provided with the image input means 2
This is for extracting the feature amount of the face of the target person from the color face image input at. The feature amount here is
It is composed of a feature amount for component exaggeration, a feature amount for arrangement exaggeration, and a scaling ratio (Scale_ratio).

The feature amount for component exaggeration includes an eye size (Eye_
size), eye shape (Eye_shape), nose shape (Nose_shap
e), mouth size (Mouth_size), mouth shape (Mouth_sha
pe), and the depth of the eyebrows (Brow_thickness).

The feature amount for layout exaggeration includes the feature amount of the face outline (X1, Y1), the eye height (Eye_height), the distance between eyes and nose (Eye_nose), the distance between nose and mouth (Nose_mouth), the eyes and eyes. (Eye_space) and the distance between eyes and eyebrows (Eye_brow) are included.

The above-described feature amount for component exaggeration and the feature amount for placement exaggeration are stored in the feature amount storage unit 104. Among them, the feature amount for component exaggeration is used to exaggerate the size and shape of the component image, and the feature amount for placement exaggeration determines the positional relationship between the component images when the component image is synthesized on the outline image. Used to exaggerate.

Hereinafter, a specific method for obtaining the feature amount for component exaggeration, the feature amount for layout exaggeration, and the enlargement / reduction ratio performed by the above-described feature amount extraction means 103 will be described in detail. Note that this description will partially overlap with the first embodiment described above, but will be repeated dare to facilitate understanding of the second embodiment.

First, a method for obtaining a feature point of a face contour will be described. Here, the feature points of the face outline (the vertex P of the head)
1, the lower end point P2 of the jaw, the right end point P3 of the jaw, and the left end point P4 of the jaw) are defined as shown in FIG. In order to obtain such feature points, first, the input image (RG
B) is converted to HSV, and a flesh color region is extracted. Then
The jaw edge is detected by searching the skin color region from below, and the lowest point of the jaw edge is set to P2. Next, the right end point of the skin color area is set to P3, and the left end point is set to P4. Next, a black area is extracted from the HSV-converted face image, and the highest point is set to P1. After obtaining the above four points (P1 to P4), the face image is converted into a gray shade image.

Next, the characteristic points (P1
To P4), a method of obtaining the feature points X1 and Y1 of the face contour will be described. xpi is the X coordinate of feature point i, ypi is the feature point i
, The characteristic points X1 and Y1 of the face contour are represented by the following equation (Equation 25).

[0105]

(Equation 25) Next, a description will be given of a method for obtaining characteristic points of the inner and outer eyes, the nose head, the left end of the nose, the right end of the nose, the left end of the mouth, and the right end of the mouth. here,
These feature points (right eye corner P5, right eye corner P6, left eye corner P6)
7, left eye corner P8, nose head P9, nose right end P10, nose left end P1
1, the right end P12 and the left end P13) are defined as shown in FIG. These feature points are obtained by template matching of the image around the feature points including the feature points. As a template matching method, for example, a normalized density correlation method can be cited. In the normalized density correlation method, a gray shade image is used. That is,
The change pattern of the gray density is compared between the target image and the template image, and the more similar the change pattern of the gray density is, the higher the matching degree is. Then, the point having the highest degree of matching in the search range is extracted as a feature point. At this time, as the template, image data obtained by averaging gray densities in the vicinity of each feature point of the face images of a plurality of persons is used. FIG. 1 shows an example of a specific matching result by template matching.
9

Next, the feature quantity for eye exaggeration (Eye_size, E
ye_shape) and layout exaggeration features (Eye_height, Eye_s
The method for determining pace) will be described with reference to FIG. Although only the left eye will be described here, the right eye can be obtained in a similar manner. FIG.
In 3, the coordinate value (xp7, yp7) of the inner corner P7 and the outer corner P8
It is assumed that the coordinate values (xp8, yp8) have already been given. In the case of the right eye, it is assumed that the inner corner P5 and the outer corner P6 are given.

The drawing conventions in FIG. 23 are as follows (a) to (nu).

(A) The vertical center line of the eye is parallel to the Y axis, and the horizontal center line of the eye is parallel to the X axis. (B) The X coordinate of the vertical center line of the eye = (X coordinate value of the inner corner of the eye + X coordinate of the outer corner of the eye) Value) / 2 (c) Y coordinate of horizontal center line of eye = (Y coordinate value of inner corner of eye + Y coordinate value of outer corner of eye) / 2 (d) EyeSearchArea_X = Y1 × 0.02 (e) EyeSearchArea_Y = Y1 × 0. 1 (f) Addition brightness at Y coordinate = sum of brightness at corresponding Y coordinate in EyeSearchArea_X (g) Difference of addition brightness at Y coordinate = addition brightness at Y coordinate−brightness at (Y−1) coordinate ( G) D1 = the maximum value of the added brightness existing at a position below the horizontal center line of the eye and closest to the horizontal center line. (I) D2 = The position of the maximum above the horizontal center line of the eye and closest to the horizontal center line. (3) D3 = 0.7 × min (D1, D2) However, in the above formula, First, a reference horizontal line of the eye and a reference vertical line of the eye are obtained.
Here, the reference horizontal line of the eye is determined as a straight line parallel to the X axis passing through the point of (yp7 + yp8) / 2, and the reference vertical line of the eye is determined along the Y axis through (xp7 + xp8) / 2. Obtained as parallel straight lines. Next, the search range in the X and Y directions of the eyes is determined according to the following equation (Equation 26).

[0109]

(Equation 26) Next, FIG. 23 shows (EyeSearchArea_X × EyeSear
The luminance values are summed at each Y coordinate within the range of (chArea_Y). However, the luminance value is 255-density value. In this example, the density value of a black pixel is 255, and the density value of a white pixel is 0.
And Next, at each Y coordinate, ｛(xp7 + xp
8) / 2- (EyeSearchArea_X / 2)｝-｛(xp7 + xp8)
/ 2 + (EyeSearchArea_X / 2)} is defined as “additional brightness”, and the defined additional brightness is {(yp7 + yp8) / 2− (EyeSearchArea_Y / 2)} ~
It is determined for each Y coordinate within the range of {(yp7 + yp8) / 2 + (EyeSearchArea_Y / 2)}. Here, the reason for obtaining the added brightness without using the brightness of one pixel is to prevent the influence of noise.

Next, FIG. 23 shows (EyeSearchAre
a_X × EyeSearchArea_Y)
A difference between the above added brightnesses is obtained. The difference obtained at this time is, as shown in the following equation (Equation 27), the difference between adjacent Y
It is the difference in the added brightness of the coordinates.

[0111]

[Equation 27] Next, values D1, D2, and D3 shown in FIG. 23 are obtained. Here, D1 is the value of the maximum point of the added brightness existing at a position below the reference horizontal line and closest to the reference horizontal line, D2
Is the value of the maximum point of the added brightness existing at a position above the reference horizontal line and closest to the reference horizontal line, and D3 is a value obtained by multiplying the smaller value of D1 and D2 by 0.7, that is, , D3 = 0.7 × min (D1, D2).

Next, a search is made upward from the horizontal center line of the eye to find a point where the added brightness becomes larger than D3, and a straight line passing through this point and parallel to the X axis is defined as EyeLineTop2.

Next, a search is made downward from the horizontal center line of the eye to find a point where the added brightness becomes larger than D3, and a straight line passing through this point and parallel to the X axis is defined as EyeLineBot2.

Next, a search is made in the vertical direction within a range of Y1 × 0.03 from the straight line EyeLineTop2 to find the maximum point of the difference in brightness. A straight line passing through this maximum point and parallel to the X axis is Ey
eLineTop1.

Next, a search is made in the vertical direction within a range of Y1 × 0.03 from the straight line EyeLineBot2 to find the maximum point of the difference in brightness. A straight line passing through this maximum point and parallel to the X axis is Ey
eLineBot1.

Next, two parallel straight lines EyeLineTop1
And the distance between EyeLineBot1 and Left_EyeWidth_Y.

Next, Left_EyeWi is obtained by the following equation (Equation 28).
Find dth X.

[0118]

[Equation 28] Next, for the right eye, Right_EyeWidth_X and Right_EyeWidth_Y are similarly obtained, and the left and right values are averaged according to the following equation (Equation 29).

[0119]

(Equation 29) Next, feature values for eye part exaggeration (Eye_size, Eye_shape)
Is calculated by the following equation (Equation 30).

[0120]

[Equation 30] Next, the feature amount for eye placement exaggeration (Right_Eye_height, Lef
t_Eye_height, Y2, Eye_height, Eye_space)
It is determined by calculation according to 1).

[0121]

(Equation 31) Next, a method for obtaining the nose part exaggeration feature amount Nose_shape and the arrangement exaggeration feature amount Eye_nose will be described. In this case, as shown in the following equation (Equation 32), Right_Eye_Right_Eye_Right is obtained using the Y coordinate values of the left and right inner corners P5 and P7 and the nose head P9.
Find nose and Left_Eye_nose.

Next, the calculated Right_Eye_nose, Left_
Y4 is obtained by averaging Eye_nose.

Next, using the Nose_shape and Y2, the left and right nose end points P10 and P11 and the previously obtained Y4 are used.
Ask for Eye_nose.

[0124]

(Equation 32) Next, a method for obtaining the mouth part exaggeration feature amounts Mouth_size and Mouth_shape and the arrangement exaggeration feature amount Nose_mouth will be described with reference to FIG. First, EyeLineT
MouthLineTop in the same way as op1 and EyeLineBot1
1. Find MouthLineBot1.

Next, straight lines MouthLineTop1 parallel to each other
And the distance between MouthLineBot1 and MouthWidth_Y. Next, MouthWidth_X is obtained using the following equation (Equation 33).

[0126]

[Equation 33] Next, the mouth part exaggeration feature amounts Mouth_size and Mouth_shape are obtained using the following equation (Equation 34).

[0127]

(Equation 34) Next, the mouth arrangement exaggeration feature amount Nose_mouth is obtained using the following equation (Equation 35). In Equation 35, ymc is Mou
This is the Y coordinate of a straight line that is parallel to thLineTop1 and MouthLineBot1 and that passes through the middle of these straight lines.

[0128]

(Equation 35) Next, a method for obtaining the eyebrow component exaggeration feature amount Brow_thickness and the arrangement exaggeration feature amount Eye_brow will be described with reference to FIG. Here, only the case of the left eyebrow will be described, but the same can be obtained for the right eyebrow. First, a search is made on the reference vertical line of the eye upward from the upper line EyeLineTop1 of the eye to find a point at which the luminance becomes minimum. This point is the darkest part and becomes the center of the eyebrows.

Next, a straight line that passes through the above minimum point and is parallel to the X axis is obtained, and this is set as a reference horizontal line of the eyebrows. The reference vertical line of the eyebrows is a line obtained by extending the reference vertical line of the eye.

Next, the eye features EyeLineTop1, EyeLineB
BrowLineTop1, BrowLine
Ask for Bot1.

Next, a straight line BrowLineTop1 parallel to each other
Find the distance to BrowLineBot1 and call this Left_BrowWidth_
Let it be Y. Similarly for the right eyebrow, Right_Browwi
dth_Y is determined.

Next, the feature amount Brow_thickness for component exaggeration is calculated according to the following equation (Equation 36).

[0133]

[Equation 36] Next, the arrangement exaggeration feature amount is calculated by the following equation (Expression 37).
Is required in accordance with In the following equation, ybL is the left eyebrow B
Y coordinate value of rowLineBot1, ybR is Y of BrowLineBot1 of right eyebrow
The coordinate value, yeL, is the Y coordinate of EyelineTop1 of the left eye, and yeR is the Y coordinate of EyelineTop1 of the right eye.

[0134]

(37) Next, an enlargement / reduction ratio Scale_ratio is obtained according to the following equation (Equation 38). In the following equation, Scale_base is an integer value set in advance.

[0135]

(38) From the feature amount extracting means 103 described above, the feature amount storing means 104, the component exaggeration means 109, and the component arranging means 1
FIG. 26 shows the structure of the data output to 10.

As is apparent from FIG. 14, Eye_heig is transmitted from the feature amount extracting means 103 to the feature amount storing means 104.
ht, Eye_space, Eye_nose, Nose_mouth, Eye_brow, Eye_siz
e, Eye_shape, Nose_shape, Mouth_size, Mouth_shape, Brow
_thickness is output.

[0137] The feature amount extraction means 103 sends the Eye_size, Eye_shape, Nose_shap
e, Mouth_size, Mouth_shape, Brow_thickness are output.

Further, the feature amount extraction means 103 sends the Scale_ratio, Eye_height, Eye
_space, Eye_nose, Nose_mouth, Eye_brow, X1, Y1 are output.

Next, the configuration of the feature amount storage means 104 will be described. The input of this means is a person parameter Person_para, a component exaggeration feature amount, and an arrangement exaggeration feature amount.

The output is output from the component exaggeration nonlinear function creating means 105 and the arrangement exaggeration nonlinear function creating means 1.
06. Here, the output to the component exaggeration nonlinear function creating unit 105 is a person parameter and a component exaggeration feature amount. The output to the arrangement exaggeration nonlinear function creating means 106 is a person parameter and an arrangement exaggeration feature amount.

The feature quantity storage means 104 stores a person parameter Person_para, a feature quantity for component exaggeration, and a feature quantity for layout exaggeration. FIG. 27 shows the structure of each data stored in the feature amount storage unit 104. As shown in FIG.
_para, Eye_height, Eye_space, Eye_nose, Nose_mouth, Eye
_brow, Eye_size, Eye_shape, Nose_shape, Mouth_size, Mou
th_shape and Brow_thickness are stored.

Next, the part exaggeration nonlinear function creating means 10
The configuration of FIG. 5 will be described with reference to the flowcharts of FIG. 28 (when the non-linear function is a fuzzy rule expression) and FIG. 29 (when the non-linear function is a mathematical expression).

This part exaggeration nonlinear function creating means 105
Is a data string of a person parameter and a feature amount for part exaggeration, and its output is a non-linear function and a feature value intermediate value (when the non-linear function is a mathematical expression). here,
The non-linear function is used by the part exaggerating means 109 to exaggerate the shape and size of the face part.
The input of this non-linear function is the feature amount for part exaggeration obtained from the real thing, and the output thereof is the part exaggeration parameter (enlargement / reduction ratio of the image) of the face part to be created. As the nonlinear function, for example, as shown in the curves in FIGS. 32 and 33, when the input component exaggeration feature amount x exceeds a certain value, the output component exaggeration parameter f (x) rapidly increases. Are used which have an S-shaped tendency to increase.

The non-linear functions used in this example are:
There are a case where a fuzzy inference rule is used and a case where a mathematical expression is used. FIG. 34 shows an example of a fuzzy inference rule for parts exaggeration. In this example, the value of the consequent part of the fuzzy inference rule is set to be properly used depending on the value of the person parameter, and in the same manner as in the feature amount database, for the adult male, for the adult female, and for the child. Are prepared. An example of the value of the consequent part is shown at the right end of FIG. As for fuzzy labels, SMALL, MEDIUM, BI
G types are prepared. Each fuzzy inference rule has one input and one output. The input value of the fuzzy inference is the feature amount for component exaggeration (Eye_size, Eye_shape, Nose_shape, Mouth_
size, Mouth_shape, Brow_thickness). In the mathematical expressions described later, X used as an input value refers to these feature amounts (Eye_size, Eye_shape, Nose_sh
ape, Mouth_size, Mouth_shape, Brow_thickness). The output value of the fuzzy inference is a component exaggeration parameter.

Next, the configuration of the component exaggeration non-linear function creating means 105 when the non-linear function is a fuzzy rule expression will be described with reference to the flow chart of FIG. 28, particularly focusing on a method of determining a membership function for each fuzzy label. It will be explained while doing.

First, for each of the adult male, the adult female, and the child from the feature amount storage means 104 (step 28)
02 to 2805), the data group of the feature amount for component exaggeration is read (step 2801), and then each of them is read (step 28).
031, 28035, and 28036), the minimum value MIN, the average value AVE, and the maximum value MAX are obtained (step 2803).
2).

Next, using the minimum value MIN, average value AVE, and maximum value MAX obtained above, the numerical values LEFT and RIGHT are obtained by calculation according to the following equation (Equation 39) (step 28033).

[0148]

[Equation 39] Next, using the values of the minimum value MIN, average value AVE, maximum value MAX, LEFT, and RIGHT determined above, SM
The membership functions of ALL, MEDIUM, and BIG are obtained (step 28034). That is, SMAL
The membership function of L is defined as X for input value and μs for output value.
In the case of (X), it is obtained by the following equation (Equation 40).

[0149]

(Equation 40) The MEDIUM membership function is obtained by the following equation (Equation 41) when the input value is X and the output value is μm (X).

[0150]

[Equation 41] In addition, the BIG membership function uses input values X,
When the output value is μb (X), it can be obtained by the following equation (Equation 42).

[0151]

(Equation 42) Then, the non-linear function of the fuzzy rule expression obtained in this manner is sent to the component exaggeration means 109, and is subjected to component exaggeration processing described later (step 280).
6).

Next, the configuration of the component exaggeration non-linear function creating means 105 when the non-linear function is a mathematical expression will be described with reference to FIG.
This will be described with reference to the flowchart of FIG.

First, for each of an adult male, an adult female, and a child (step 29
02 to 2905), a data group of the feature amount for component exaggeration is read (step 2901), and then each of them is read (step 29).
031, 29035, and 29036) are obtained (step 29032).

Next, using the minimum value MIN and the maximum value MAX obtained above, a feature amount intermediate value MID is obtained by calculation according to the following equation (Equation 43) (step 2903).
3).

[0155]

[Equation 43] Next, using the feature value minimum value MIN, feature value maximum value MAX, feature value intermediate value MID, and values of the constants R1 and R2, the current values of I and J are calculated according to the following equation (Equation 44). For the corresponding feature amount, the coefficient a of the nonlinear function is obtained by calculation (step 29034). Here, I is a person parameter, and it is assumed that data is processed for adult male when I = 0, adult female when I = 1, and child when I = 2. J is the type of the feature amount.
If Eye = 0, Eye_size, If J = 1, Eye_shape, J
= 2 for Nose_shape, J = 3 for Mouth_size,
Mouth_shape when J = 4, Brow_thic when J = 5
It is assumed that the kness feature amount is processed.

[0156]

[Equation 44] When the intermediate value of the feature data group is input,
This means that a coefficient a such that the output of the nonlinear function f (x) becomes 1 is obtained. That is, when the intermediate value MID is input, the size and shape of the component image are not exaggerated.

Here, a method of realizing a nonlinear function using a mathematical expression will be described theoretically. For example, the non-linear function having the S-shape shown in FIGS. 32 and 33 is generally represented by the following equation (Equation 45).

[0158]

[Equation 45] Here, the values of R1, R2, and a are different between the case of the feature amount for component exaggeration described here and the case of the feature amount for arrangement exaggeration described later. The initial values of R1 and R2 are default values, but the degree of exaggeration can be adjusted by changing these values. For example, when a default value is used, when a = 10, the maximum value of the nonlinear function f (x) is 1.2 and the minimum value is 0.8. Also,
As described above, the value of the coefficient a is obtained by calculation according to the equation (Equation 44).

Then, the non-linear function of the mathematical expression obtained in this way is sent to the component exaggeration means 109, and is subjected to a component exaggeration process described later (step 2906).

Next, the arrangement exaggeration nonlinear function creating means 10
The configuration of FIG. 6 will be described with reference to the flowcharts of FIG. 30 (when the nonlinear function is a fuzzy rule expression) and FIG. 31 (when the nonlinear function is a mathematical expression).

The arrangement exaggeration nonlinear function creating means 106
Is a data string of a person parameter and a feature amount for layout exaggeration, and its output is a non-linear function and a feature value intermediate value (when the non-linear function is a mathematical expression). here,
The non-linear function is used by the component arranging means 110 to exaggerate the positional relationship between the face contour and the component, the positional relationship between the components, and the like. The input of this non-linear function is the layout exaggeration feature quantity obtained from the real thing, and its output is the layout exaggeration parameter between the parts of the face image to be created. As the nonlinear function, for example, as shown in the curves in FIGS. 32 and 33, when the input layout exaggeration feature quantity x exceeds a certain value, the output layout exaggeration parameter f
Those having an S-shaped tendency in which the value of (x) rapidly increases are used.

The non-linear functions used in this example include:
There are a case where a fuzzy inference rule is used and a case where a mathematical expression is used. An example of a fuzzy inference rule for layout exaggeration is shown in FIG. In this example, the value of the consequent part of the fuzzy inference rule is set to be properly used depending on the value of the person parameter, and in the same manner as in the feature amount database, for the adult male, for the adult female, and for the child. Are prepared. An example of the value of the consequent is shown at the right end of FIG. As for fuzzy labels, SMALL, MEDIUM, BI
G types are prepared. Each fuzzy inference rule has one input and one output. The input values of the fuzzy inference are the layout exaggeration feature amounts (Eye_height, Eye_brow, Eye_nose, Nose_mo
uth, Eye_space). In the mathematical expressions described later, X used as an input value refers to these feature amounts (Eye_height, Eye_brow, Eye_nose, Nose_mouth, Eye_mouth).
space). The output value of the fuzzy inference is an arrangement exaggeration parameter.

Next, the configuration of the arrangement exaggeration non-linear function creating means 106 when the non-linear function is a fuzzy rule expression will be described with reference to the flow chart of FIG. 30 particularly focusing on the method of determining the membership function for each fuzzy label. It will be explained while doing.

First, an adult man, an adult woman, and a child are stored in the feature amount storage means 104 (step 30).
02 to 3005), a data group of the layout exaggeration feature amount is read (Step 3001), and then each of them is read (Step 30).
031, 30035, and 30036), the minimum value MIN, the average value AVE, and the maximum value MAX are obtained (step 3003).
2).

Next, using the minimum value MIN, average value AVE, and maximum value MAX obtained above, each numerical value LEFT, RIGHT is obtained according to the equation (Equation 39) cited earlier in the description of the means for creating a nonlinear function for component exaggeration. Is obtained by calculation (step 28033).

Next, using the values of the minimum value MIN, average value AVE, maximum value MAX, LEFT, and RIGHT determined above, the respective membership functions of SMALL, MEDIUM, and BIG are determined (step 28034).

That is, when the input value is X and the output value is μs (X), the SMALL membership function can be obtained by the equation (Equation 40) cited earlier in the description of the component exaggeration nonlinear function creating means. .

When the input value is X and the output value is μm (X), the membership function of MEDIUM can be obtained by the equation (Equation 41) cited earlier in the description of the component exaggeration nonlinear function creating means. .

Furthermore, the membership function of BIG is:
Assuming that the input value is X and the output value is μb (X), the value is obtained by the equation (Equation 42) cited earlier in the description of the component exaggeration nonlinear function creating means.

The non-linear function of the fuzzy rule expression thus obtained is sent to the component arranging means 110, and is subjected to a component exaggeration process described later (step 3006).

Next, the configuration of the arrangement exaggeration nonlinear function creating means 106 when the nonlinear function is a mathematical expression will be described with reference to FIG.
1 will be described with appropriate reference to the flowchart.

First, for each of an adult man, an adult woman, and a child (step 31)
02 to 3105), the data group of the layout exaggeration feature amount is read (step 3101), and then each of them is read (step 31).
031, 31035, 31036) is obtained (step 31032).

Then, using the minimum value MIN and the maximum value MAX obtained above, a feature value intermediate value MID is obtained by calculation in accordance with the equation (Equation 43) cited earlier in the description of the component exaggeration nonlinear function creating means. (Step 3103
3).

Next, the feature value minimum value MIN obtained above,
Feature amount maximum value MAX, feature amount intermediate value MID, constant R1,
Using the value of R2, according to the equation (Equation 44) cited earlier in the description of the component exaggeration nonlinear function creating means, the current I
The coefficient a of the non-linear function is obtained by calculation for the feature amount corresponding to the values of and J (step 31034). Here, I is a person parameter, and it is assumed that data is processed for adult male when I = 0, adult female when I = 1, and child when I = 2. J is the type of the feature amount. Eye_height when J = 0, Eye_space when J = 1, Eye_nose when J = 2, Nose_mouth when J = 3, Eye_brow when J = 4. It is assumed that the feature amount is processed.

The above equation (Equation 44) indicates that when the intermediate value of the feature amount data group is input, the output of the nonlinear function f (x) is 1
This means that a coefficient a such that That is, when the intermediate value MID is input, the component arrangement is not exaggerated.

Here, the theoretical description of the method of realizing the non-linear function using the mathematical formula is omitted because it is the same as the case of the component exaggeration feature amount described above.

The non-linear function of the mathematical expression thus obtained is sent to the component exaggeration means 109, and is subjected to a component exaggeration process described later (step 3106).

Next, the configuration of the contour image extracting means 107 will be described. The input of the contour image extracting means 107 is a color face image, and the output is a binary face contour image. First, the contour image extracting unit 107 extracts a skin color area of a color face image. Next, the contour image extracting means 107
Converts a color face image into a binary image. Next, the contour image extracting unit 107 sets the density value inside the area corresponding to the skin color area to 0 in the binarized face image.

As described in the first embodiment, some examples of face contours extracted by the contour image extracting means 6 are shown in FIG. As can be seen from the drawing, the contour image extracting means 107 can extract the contour of the face as a figure surrounded by the hairstyle and the contour line of the chin for each of the target persons.

The contour image extracted by the contour image extracting means 107 is output to the component arranging means 110.

Next, the configuration of the component image storage means 108 will be described. In the part image storage unit 108, images of the face parts of the right eyebrow, the left eyebrow, the right eye, the left eye, the nose, and the mouth are stored as an image database for each value of the person parameter (I = 0, 1, 2). These component images are appropriately selected according to the value of the person parameter I input from the data input unit 101, and output to the component exaggeration unit 109. Here, the component image is a binary image.

Next, the structure of the component exaggeration means 109 is shown in FIG.
This will be described with reference to the flowchart of FIG. The input of the component exaggeration means 109 includes the feature quantity for component exaggeration coming from the feature quantity extraction means 103 and the non-linear function creation means 10 for component exaggeration.
5, a non-linear function and a feature amount intermediate value, a component image from the component image storage unit 108, a person parameter, an exaggerated portion selection parameter, and an exaggeration degree parameter from the data input unit 101. The output of the component exaggeration means 109 is a component image whose size or shape has been changed.

That is, the part exaggeration means 109 reads a person parameter, an exaggerated part selection parameter, and an exaggeration degree parameter from the data input means 101 (step 3601), and reads a part image from the part image storage means 108 (step 3602). Finally, the feature amount for component exaggeration is read from the feature amount extraction means 103 (step 3603).

Thereafter, a component exaggeration parameter is obtained by using a non-linear function based on the read data (step 3604). At this time,
The value of the consequent part of the part exaggeration rule shown in FIG. 34 is properly used depending on the value of the person parameter.

A fuzzy inference method will be described below. When the parts exaggeration rules shown in FIG. 34 are generalized, each arrangement location is expressed by three rules expressed by the following equation (Equation 46).

[0186]

[Equation 46] Here, the output values of the SMALL, MEDIUM, and BIG membership functions are represented by μs (X), μm (X),
When μb (X) is used, the component exaggeration parameter FZ which is an output value of fuzzy inference is expressed by W expressed by the following equation (Equation 47).
1, W2, and W3.

[0187]

[Equation 47] However, FZ, which is a part exaggeration parameter, is FA for eye size, FB for eye shape, FC for nose shape, FD for mouth size, and FD for mouth shape. F
In the case of E and the thickness of the eyebrows, the value is FF, and the size and shape of the part are changed using these values.

When the exaggerated portion selection parameter and the exaggeration degree parameter are input to the data input means 101, the form of the nonlinear function is changed in accordance with those values (step 3604). That is, the non-linear function of the feature specified by the exaggerated portion selection parameter is modified.

The exaggeration degree parameter and the deformation method are different between a case where the nonlinear function is expressed by fuzzy rules and a case where it is expressed by a mathematical expression.

When the non-linear function is represented by a fuzzy rule, the processing proceeds as follows. When the value of the exaggeration degree parameter input by the user is Exaggerate_para, the values of W1 and W3 in the component placement rule are changed. The values of W1 and W3 before the change are W1_old and W, respectively.
If 3_old and the changed values are W1_new and W3_new,
The relationship between the two is represented by the following equation (Equation 48).

[0191]

[Equation 48] It should be noted here that in the previous equation (Equation 48), Exagge
The sign of rate_para is different between the two formulas. Therefore, the greater the value of Exaggerate_para, the greater the degree of exaggeration.

When the non-linear function is represented by a mathematical expression, the processing proceeds as follows. In this case, as described above, the nonlinear function is expressed by the following equation (Equation 49).

[0193]

[Equation 49] In the above equation, the values of the exaggeration degree parameter input by the user are R1 and R2. Depending on these values, the function is directly transformed to change the degree of exaggeration. However, it is necessary to change the value of the coefficient a using the feature amount intermediate value MID. The change of the value of the coefficient a is performed according to the following equation (Equation 50).

[0194]

[Equation 50] Next, a method of changing the size and shape of the component using the output value of the nonlinear function will be described below. Assuming that the point (x, y) on the component image is scaled to change its position to the point (X, Y), the change in size and shape is expressed by the following equation (Equation 51).

[0195]

(Equation 51) Here, if the enlargement / reduction ratios in the x direction and the y direction are equal, the component image is similarly enlarged / reduced, and the x direction and the y direction
If the enlargement / reduction ratio in the direction is different, the component image is deformed. It should be noted that a person skilled in the art can easily understand a specific method of converting the size and shape of an image by referring to the description in the reference document “Practical image processing learned in C language” (Ohm). Should be.

Next, the structure of the component arranging means 110 is shown in FIG.
This will be described with reference to the flowchart of FIG. The input of the component arranging means 10 includes an arrangement exaggeration feature quantity and an enlargement / reduction rate coming from the feature quantity extraction means 103, a nonlinear function and a feature quantity intermediate value coming from the arrangement exaggeration nonlinear function creating means 106, a component exaggeration means A component image arriving from 109, a contour image arriving from the contour image extracting means 107,
Person parameters input from the data input means 101,
An exaggerated portion selection parameter and an exaggeration degree parameter. The output of the component arranging means 110 is a face image obtained by synthesizing the component image and the contour image.

That is, the component placement means 110 reads the person parameter, the exaggerated portion selection parameter, and the exaggeration degree parameter from the data input means 1 (step 3701), and reads the contour image from the contour image extracting means 107 (step 3702). The component image is read from the component exaggeration means 109 (step 3703). Finally, the feature amount for arrangement exaggeration and the enlargement / reduction ratio are read from the feature amount extraction means 103 (step 3704). Thereafter, based on the read data, a placement exaggeration parameter is obtained using a nonlinear function (step 370).
5). At this time, the value of the consequent part of the layout exaggeration rule shown in FIG. 35 is properly used depending on the value of the person parameter.

A fuzzy inference method will be described below. When the layout exaggeration rules shown in FIG. 35 are generalized, each layout location is expressed by three rules expressed by the following formula (Equation 52).

[0199]

(Equation 52) Here, the output values of the SMALL, MEDIUM, and BIG membership functions are represented by μs (X), μm (X),
When μb (X) is set, the arrangement exaggeration parameter FZ which is the output value of the fuzzy inference is expressed by W
1, W2, and W3.

[0200]

(Equation 53) However, the layout exaggeration parameter FZ is FG for eye height, FH for eyebrow and eye spacing, FI for eye to nose spacing, FJ for nose and mouth spacing, FJ for left and right. In the case of the eye interval, FK is used, and real values (YY2, YY3, YY4, XX2) for component placement are obtained using these values.

When the exaggerated portion selection parameter and the exaggeration degree parameter are input to the data input means 101, the nonlinear function is changed according to the values in the same manner as in the case of the component exaggeration means 109 described above. The shape is changed (step 3705). That is, when the value of the exaggeration degree parameter input by the user is Exaggerate_para, the values of W1 and W3 in the component placement rule are changed. The values of W1 and W3 before the change are W1_old and W3_ol, respectively.
Assuming that d and the changed values are W1_new and W3_new, the relationship between the two is represented by the equation (Equation 48) cited earlier.

It should be noted here that in Expression (48), the sign of Exaggerate_para differs between the two expressions. Therefore, the greater the value of Exaggerate_para, the greater the degree of exaggeration.

Next, in order to adjust the size of each component image to the size of the face outline image, the value Sc of the scaling parameter is set.
Each part image is enlarged or reduced using ale_ratio (step 3707). A point (x, y) on the part image
Is scaled to change the position to the point (X, Y), a relationship represented by the following equation (Equation 54) is established between the two.
It should be noted that a person skilled in the art can easily understand a specific conversion method by referring to the description in the reference document “Practical image processing learned in C language” (Ohmsha).

[0204]

(Equation 54) Next, based on the arrangement exaggeration parameters and X1, Y1,
Real values (YY2, YY2) for component placement shown in FIG.
3, YY4, XX2) is obtained by the following equation (Equation 55) (step 3706). However, FG, FH, FI, F
J and FK are inter-component distance parameters which are output values of fuzzy inference.

[0205]

[Equation 55] Next, based on the obtained real values for component placement, component images are placed as shown in FIG. 38 (step 3708). However, the components are arranged such that the representative point of each component shown in FIG. 39 is at the position shown by the following equation (Equation 56). That is, the coordinates at which the representative point of each part is arranged are expressed by the following equation (Equation 5).
6). The image created here is 2
It is a value image.

[0206]

[Equation 56] Next, the configuration of the face image output unit 111 will be described.
The face image output unit 111 visually outputs the face image synthesized as described above, and specifically, a printing device that outputs a hard copy of a binary image, which is a face image, or a display device that displays an image. And the like.

Then, according to the second embodiment,
(1) It is possible to automatically create an exaggerated and impressive face image, which is an essential feature of a portrait, by exaggerating not only the positional relationship of the parts but also the shape and size of the parts. (3) that it is possible to prevent excessive exaggeration such that the face image does not resemble the face of the target person, and (4) the degree of exaggeration according to the user's preference. Can be adjusted, and the like.

Next, FIG. 40 shows the overall configuration of a portrait creating apparatus with a disguise simulation function according to another preferred embodiment (third embodiment) of the present invention, and the operation procedure thereof will be described. The flowchart of FIG. 41
42 and FIG.

As shown in FIG. 40, the portrait creating apparatus includes a data input unit 201 and a portrait creating unit 20.
2, a component image storage unit 203, a selection menu storage unit 204, an image synthesis unit 205, and a display unit 206
And printing means 207. These means 201 to 207 are specifically configured as follows.

First, the data input means 201 stores the attribute number and the part number input by the user into the part image storage means 2.
03 or an instruction input from the user such as deformation or position adjustment of parts to the image synthesizing means 205, and is configured by an input device such as a keyboard and a mouse. ing.

[0211] When the user selects "P. print" from a selection menu described later using the data input means 201, the image synthesized by the image synthesizing means 205 is sent to the printing means 207. Is output. This selection operation is performed, for example, by inputting the letter “P” from a keyboard,
Alternatively, it is performed by moving the mouse cursor to the “P. print” portion on the screen and clicking the mouse button.

When the user selects “Q. end” from a selection menu described later using the data input unit 201, the image synthesized by the image synthesizing unit 205 is sent to the printing unit 207. Is output. This selection operation is performed, for example, by inputting a letter “Q” from a keyboard,
Alternatively, the user can move the mouse cursor to the “Q. end” portion on the screen and click the mouse button.

Next, the basic configuration of the portrait creating means 202 is the same as the first configuration described with reference to FIG. 1 or FIG.
Alternatively, it is almost the same as that in the second embodiment, and creates a portrait based on the feature amount extracted from the face photograph. However, the output of the portrait creating means 202 is not a synthesized portrait image, but information on the preceding stage, that is, selected and exaggerated portrait parts (face parts), part image coordinate data, and positional relationship data. This is slightly different from that of the first or second embodiment.

Here, the portrait parts (face parts) include:
In this example, left and right eyebrows, left and right eyes, nose, and mouth are used. Further, as the component image coordinate data, the coordinates of the representative points of the components indicated by the crosses in FIG. 15 in the first embodiment and FIG. 39 in the second embodiment are used. In the case of the first embodiment, the positional relationship data is shown in FIG.
Y2 (eye height), Y3 (eyebrow and eye distance), Y4 (eye and nose distance), Y5 (nose and mouth distance), and X2 (left and right eye distance) are used. In the case of the second embodiment, YY2 (eye height), YY3 shown in FIG.
(Interval between eyebrows and eyes), YY4 (interval between eyes and nose), YY5
(Interval between nose and mouth) and XX2 (Interval between left and right eyes)
Is used.

Next, in the part image storage means 203, background parts for synthesizing, for example, a disguise simulation by synthesizing with face parts corresponding to portraits, that is, face outline parts, hairstyle parts, body parts, eyeglass parts, beards, etc. A plurality of patterns of parts and the like are stored. FIG. 43 shows an example of these background component images. In addition, the size of each part is unified, and the face parts (left and right eyebrows, left and right eyes, nose, and
Mouth) and can be combined without discomfort.

Each part is assigned a category symbol and a part number. The category symbol is a symbol for selecting the category of the background component that the user wants to combine, for example,
The face outline part is determined as “A”, the hairstyle part as “B”, and the body part as “C”. The part number is a number (positive integer value) assigned to each part, and is used when the user selects one part from a plurality of patterns of the same kind.

When a category symbol is input by the user, a list of all the component images included in the type indicated by the category symbol is read out from the component image storage means 203 together with the associated component number, and displayed. Sent to the means 206. As a result, the user can select and instruct a part image to be combined from within the category using the part number. When a user inputs a part number, the part image indicated by the part number is read from the part image storage unit 203 and sent to the image combining unit 205.

The image synthesizing means 205 is added to each background part image.
The reference points are determined so that they can be aligned with each other and synthesized. FIG. 43 shows an example of reference points assigned to each background component. That is, as shown in FIG.
Four reference points consisting of 1, P2, P3, and P4 are shown (a in the figure), one reference point consisting of a point Q at the upper center of the hairstyle part is shown (b in the figure), and the body part has the same reference point. One reference point consisting of a point Q at the center of the neck (c in the figure), one reference point consisting of the center point Q of the eyeglass part (d in the figure), and the upper part of the beard part One reference point consisting of the central point Q has been determined (FIG. 9E). Also, corresponding to these reference points, the following coordinate value data is attached to each background component. That is, the coordinate values of the four reference points P1 to P4 are set for the face outline part, the relative coordinate values of the reference point Q with respect to the reference point P1 of the face outline part are set for the hairstyle part, and the reference values of the face outline part are set for the body part. The relative coordinate value of the reference point Q with respect to the point P2, the relative coordinate value of the reference point Q with respect to the left-eye reference point E shown in FIG. Relative coordinate values of the reference point Q with respect to the shown beard part reference point M are additionally stored.

Next, the selection menu storage means 204 stores
The category name of the background component that can be selected by the user is stored as a character string. Here, as the background parts, for example, “face contour”, “hairstyle”, “body”, “glasses”,
"Whiskers" and the like.

From this selection menu storage means 204,
Each of the above-mentioned category names is read with a part symbol added to the head thereof, and sent to the display means 206, for example, "A. face outline", "B. hairstyle". Thus, the user can select and instruct the category of the background part desired to be used in the disguise using the category symbol.

In the selection menu, a guide item "P. print" for receiving a print instruction from the user and a guide item "Q. end" for receiving a program end instruction from the user. Is provided.

Next, the image synthesizing means 205 synthesizes the portrait image obtained from the portrait creating means 202 and the background part image obtained from the part image storing means 203 to generate a portrait image subjected to background synthesis. Then, the display means 206 or the display means 206 is sent to the printing means 207.

In the background synthesizing process, a portrait image is generated by arranging a portrait part (face part) obtained from the portrait creation means 202 in the selected face outline image (see FIG. 43A). And a second process of arranging background parts (see FIGS. 43 (b), (c), (d), and (e)) on the generated portrait image to generate a background composite (disguise) portrait image And

Since the first process for generating a portrait image is almost the same as the component arrangement process in the first and second embodiments described above, the first process is performed by referring to the description of the corresponding portion. It will be easily understood by those skilled in the art. However, as shown in FIG. 43 (a), each of the face contour parts has four reference points (P
1, P2, P3, P4)
By using these coordinate values, synthesis of the face outline part and the portrait part (face part) is performed. In addition, since the face outline part is used as a base at the time of synthesis, it is necessary to first set the face outline part selection mode before selecting another category part.

The second process for generating a portrait image subjected to background synthesis (disguise) is performed as follows. That is, as described above, FIG.
Each of the hairstyle, torso, glasses, and beard parts images shown in FIG. 43 (e) is provided with reference points Q, and these reference points are reference points of the face contour parts (P1 in FIG. 43 (a)). , P2
P3, P4) or the reference point of the portrait part (FIG. 44)
Relative coordinate values with respect to E in (a) and M) in FIG. 44 (b) are given. Then, by using these relative coordinate values, the disguise parts are arranged.

That is, for the hairstyle part shown in FIG. 43B, the reference point Q of the hairstyle part and the reference point P of the face contour
Parts arrangement is performed so that 1 matches.

As for the body part shown in FIG. 43 (c), the relative coordinate value (dx, dy) of the reference point Q of the body part to the reference point P2 (Xp2, Yp2) of the face contour part is attached to the body. The stored components are arranged such that the coordinate value (Xq, Yq) of the synthesized reference point Q is expressed by the following equation (Equation 57).

[0228]

[Equation 57] With respect to the eyeglass part shown in FIG. 43D, the relative coordinate value (dx, dy) of the reference point Q of the eyeglass part with respect to the reference point E (Xe, Ye) at the inner corner of the left eye is stored along with the eyeglass part. And the coordinate values of Q after synthesis (Xq, Y
The components are arranged so that q) becomes the following equation (Equation 58).

[0229]

[Equation 58] As for the beard part shown in FIG. 43 (e), the relative coordinate value (dx, dy) of the reference point Q of the beard part with respect to the reference point M (Xm, Ym) of the mouth is stored along with the beard part. ,
The components are arranged such that the coordinates (Xq, Yq) of the combined Q become the following equation (Equation 59).

[0230]

[Equation 59] By such processing, each component is arranged at a position based on the reference point. However, the user can change the component size or the position on the image by an operation using a keypad or a mouse. This feature is available for graphical user
It can be easily realized by using the function of the interface.

Once a part has been synthesized, it may be desirable to replace that part with a different part of the same category.
In this case, it is preferable to provide the following functions. That is, a selected flag is provided for each category.
The initial values of all the selected flags are “0” (off). Once a category is selected, the value of the selected flag of that category is set to "1" (ON). When the same category is selected again while the selected flag is on, the parts of the corresponding category that have already been synthesized are deleted,
Synthesize a new part.

To make it possible to delete a component already synthesized, a layer structure used in a drawing tool such as a personal computer may be used. For example, by arranging parts for each layer, such as a face outline part on Layer 1, a portrait part on Layer 2, a hairstyle part on Layer 3,..., It is possible to delete the synthesized part.

Next, the display means 206 displays a selection menu,
It displays a component image list, a composite image, and the like, and can be configured by a display device such as a liquid crystal display, a CRT, and a plasma display.

Finally, the image printing means 207 is for generating a hard copy of the portrait image subjected to background synthesis (disguise) processing and the like, and is implemented by various color or monochrome printer devices such as a laser beam printer. Can be configured.

Next, a flow of a series of operations of the portrait creating apparatus with the disguise simulation function described above will be systematically described with reference to the flowcharts of FIGS. 41 and 42. When the user activates the apparatus, a face image of the user is read by an electronic camera or the like, and then the first
In addition, through the process described in detail in the second embodiment, a facial feature amount extraction process, a portrait part (face part) selection process, a portrait part exaggeration process, and a positional relationship data creation process are executed. (Step 4101).

Next, on the screen of the display device,
A list of face part images is displayed, and the apparatus enters a state of waiting for a user to select a face contour (step 4102). In this state, when the part number of the face outline part is received from the user (step 4103), the processing of synthesizing the face outline part of the designated number and the portrait part (face part) is performed, and the portrait is completed. (Step 4104).

Thereafter, a state of waiting for an input operation by the user is entered (step 4105), and in accordance with the input operation (step 4106), an image synthesizing process (step 4107), an image printing process (step 4108), or an end process is performed. Is executed.

As shown in FIG. 42, in the image synthesizing process (step 4107), first, the contents of the selected flag of the relevant category are determined (step 4201). If this is off (step 4201 off), After the selected flag of the corresponding category is turned on (step 4202), a list of background part images corresponding to the category symbols is displayed on the screen of the display device (step 4204), and the selection operation of the user is performed. It will be in a state of waiting. On the other hand, if the selected flag of the corresponding category is on (step 4201 on),
After the background component of the corresponding category that has already been combined is deleted from the combined image (step 4203), a list of component images corresponding to the category symbols is displayed on the screen of the display device (step 4204), and It is in a state of waiting for a selection operation.

In this state, when the part number is received from the user (step 4203), the process of synthesizing the background part corresponding to the part number and the portrait is performed (step 4204). Displayed on the screen of the device. Thereafter, when the user performs an operation of changing the component size or position with the mouse, the background synthesis (disguise) portrait is corrected accordingly, and a desired disguise portrait is completed (step 4205).

Thereafter, when the user gives a print instruction (step 4106), the completed disguise portrait is printed out in color or monochrome from the printer device (step 4108), whereby a hard copy of the disguise portrait is obtained. Become.

As described above, according to the portrait creating method and apparatus with the disguise simulation function according to the third embodiment, while using a portrait created by automatically exaggerating an actual face image, By performing a disguise simulation by appropriately attaching background parts to this, a more interesting portrait can be created.

Next, FIG. 45 shows an overall configuration of a portrait creating apparatus having a simple creating function according to another preferred embodiment (fourth embodiment) of the present invention, and an operation procedure thereof will be described. Are shown in FIGS. 46, 47 and 48.

As shown in FIG. 45, the portrait creating apparatus includes a portrait creating section 301 and a background image synthesizing section 3.
02, display means 303, and component code connection means 304
Encoding means 305, image barcode combining means 306, printing means 307, decoding means 309,
And a bar code reading means 308.

The basic configuration of the portrait creating means 301 is as follows.
This is almost the same as that in the first or second embodiment described above with reference to FIG. 1 or FIG. 20, and creates a portrait based on the feature amount extracted from the face photograph. However, the output of the portrait creating means 302 is not only a portrait image obtained by exaggerating the face image according to a certain rule, but also information on the preceding stage, that is, a portrait part code, a placement code, and The output of the component coordinate data is slightly different from that of the first or second embodiment.

Here, the portrait part code in this example is a code relating to face parts such as eyes, nose, mouth, and eyebrows. FIG. 51 shows an example of a portrait part code when the portrait part is an eye. As shown in the figure, the size of the eyes is determined to be small (1), normal (2), and large (3). Regarding the shape of the eyes, it is determined to be thin (1), normal (2), and round (3). Further, regarding the inclination of the eyes, a falling eye (1), a horizontal eye (2), and an rising eye (3) are determined. Therefore, for example, assuming that the features of the eyes are small, ordinary shapes, and falling eyes, the caricature part code relating to the eyes is (121). The facial part codes relating to the nose, mouth, and eyebrows are similarly generated by converting the respective characteristic items into numerical values, for example.

The arrangement code codes the positional relationship among the eyes, nose, mouth, and eyebrows. For example, assuming that the distance between the eye and the eyebrow is 325 pixels, the code related to the positional relationship between the eye and the eyebrow is (325). Similarly,
The positional relationship between the face outline and the eyes, the right eye and the left eye, the eyes and the nose, and the nose and the mouth are coded, respectively, and by connecting these individual mutual positional relationship codes, a target arrangement code is finally generated. .

Further, as the component coordinate data, for example, the coordinates of a representative point of each component indicated by a cross in FIG. 15 in the first embodiment and FIG. 39 in the second embodiment are used. .

Next, the background image synthesizing means 302 generates a portrait image with the background synthesized by synthesizing the background image with the portrait obtained from the portrait creating means 301.
Although illustration is omitted to avoid complication,
The background image synthesizing unit 302 shown in FIG. 302 includes the data input unit 201 and the component image storage unit 20 shown in FIG. 40 referred to earlier in the description of the third embodiment.
3. It should be understood that the selection menu storage means 204 is included. Therefore, the background image combining means 302
As described above in the third embodiment, the background image synthesizing process described in, and the portrait information and the part coordinate data obtained from the portrait creating means 301 and the user select the interactive image processing while viewing the menu on the screen. This is performed by synthesizing the background component image. The portrait image combined with the background is sent to the display unit 303.

Next, the display means 303 is a liquid crystal type, CRT
It is composed of a color or monochrome display device such as a display type, a plasma display type, and the like, and the display means 303 appropriately displays a portrait image combined with a background and various operation menu images.

Next, the part code linking means 304 is a portrait part (face part) obtained from the portrait creation means 301.
Code and arrangement code, and background image synthesizing means 302
By generating a code string having a predetermined format by linking the background part code obtained from the above.
The code string thus obtained is sent to the encoding means 305.

Next, the encoding unit 305 converts the code string sent from the component code linking unit 304 into a corresponding bar code. The barcode information thus obtained is sent to the image barcode combining means 306.

Next, the image barcode synthesizing unit 306 synthesizes the background synthesized image and the barcode based on the background synthesized image obtained from the background image synthesizing unit 302 and the barcode information obtained from the encoding unit 305. Create image data. The image data thus created is sent to the printing unit 307.

Next, the printer constituting the printing means 307 executes a printing process based on the image data obtained from the image barcode synthesizing means 306, so that an example of the printing result is shown in the lower right of FIG. As described above, an image obtained by synthesizing the background composite image and the barcode 310 is printed out on a predetermined or arbitrary sheet in color or monochrome.

Next, the bar code reading means 308
It has a function of reading the barcode 310 attached to the background composite image from the paper on which the background composite image has been printed out, and can be realized by a known barcode reader. The bar code thus read is sent to the decoding means 309.

Next, the decoding means 309 decodes and converts the bar code sent from the bar code reading means 308 to generate and output a portrait part code (face part) code, an arrangement code, and a background part code. . The portrait part code and the arrangement code thus obtained are sent to the portrait creation means 301, and the background part code is sent to the background image synthesis means 302.

[0256] Thereafter, the portrait creating means 301 uses a predetermined simple technique based on the portrait part code and the arrangement code obtained from the decoding means 309, without relying on the face image of the user such as a face photograph. Execute the creation process. The details of the portrait creation process using this simplified method will be described later in detail with reference to FIG. Further, the background image synthesizing unit 302 executes a background image synthesizing process based on the background part code obtained from the decoding unit 309.

Next, the flowcharts of FIGS.
The operation of the portrait creating apparatus with a simple creation function according to the fourth embodiment will be systematically described with reference to the processing step explanatory diagrams of FIGS. 49 and 50.

As shown in the flowchart of FIG. 46, by performing a predetermined mode designating operation (step 4601), a normal mode for creating a portrait from a photograph (step 4602) and a simple mode for creating a portrait from a bar code (step 4601). Step 4603) can be selectively executed.

The details of the processing in the normal mode for creating a portrait from a photograph are shown in the flowchart of FIG. 47 and the processing step explanatory diagram of FIG. 49. As shown in the flowchart of FIG. 47, when the processing is started, first, the portrait creating unit 301 creates a portrait based on the feature amount extracted from the face photograph (step 4701). That is, as shown in the process step explanatory diagram of FIG. 49, a feature extraction process (4
901) is executed to extract various feature amounts related to the face, and a component selection process (490) is performed according to these feature amounts.
2) is executed to obtain the eye / nose / mouth part codes. Further, the arrangement exaggeration processing (4
903) is executed to determine the eye / nose / mouth arrangement code.

Next, the background image synthesizing means 302 creates a background synthesized image obtained by synthesizing the portrait and the background component (step 4702). That is, the background part synthesizing process (490) is performed based on the portrait image and the part arrangement coordinate data obtained from the portrait creating means 301 and the background part image (body, glasses, etc.) separately specified by the user.
4) is executed to generate a background composite image, and this background composite image is displayed on the screen of the display device constituting the display unit 303.

Next, in the part code linking means 304, a portrait part (face part) code, an arrangement code,
In addition, processing for linking each of the background codes is executed (step 4703). That is, for the eye / nose / mouth part code, the part code connection processing (4905)
However, the arrangement code connection processing (4906) is executed for the eye / nose / mouth arrangement code, and the background code connection processing (4907) is executed for the background part code such as the body and glasses. A code connection process is performed for each of the backgrounds. Furthermore, their part codes
Consolidation processing for arrangement code / background code (4908)
Is executed, and finally a portrait code is generated.

Next, the encoding means 305 performs a process of converting the portrait code composed of the linked code sequence into a portrait bar code (step 4704). That is, the conversion process from the portrait code to the portrait barcode (4909) is executed, and the portrait barcode is output.

Next, the image barcode synthesizing means 306 synthesizes image data obtained by synthesizing the background synthesized image and the barcode, and sends this image data to the printing means 307 (step 4705).

Finally, the printing means 307 executes a printing process based on the image data obtained from the image bar code synthesizing means 306 to print out the image in which the background synthesized image and the bar code are synthesized. (Step 4706).

The details of the processing in the simple mode for creating a portrait from a barcode are shown in the flowchart of FIG. 48 and the processing step explanatory diagram of FIG. As shown in the flowchart of FIG. 48, when the process is started,
First, the barcode reading unit 308 reads a barcode from the hard copy 311 of the portrait image printed out earlier (step 4801).

Next, in the decoding means 309,
The read barcode is converted into a portrait part code, an arrangement code, and a background part code (step 4802). That is, as shown in FIG. 50, the bar code read by the bar code reading means 308 is subjected to a code decomposition process (50).
01) is executed to generate eye / nose / mouth part codes, eye / nose / mouth arrangement codes, and body / glasses background codes.

Next, the portrait creating means 301 selects a part corresponding to the portrait part code and creates a portrait image based on the arrangement code (step 480).
3). That is, as shown in the processing step explanatory diagram of FIG. 50, the part selection processing (5
002), the arrangement exaggeration process (5003) is executed by the arrangement codes of the eyes, nose, and mouth, and a portrait image is created.

Next, in the background image synthesizing means 302, as shown in FIG.
Background component synthesis processing (500
4) is executed to create a portrait image with background synthesis (steps 4804, 4805, 4806, 480).
7). At this time, the user is allowed to change the background image. That is, if the user does not select to change the background image (step 4804 is not changed), the background component corresponding to the background component code is selected (step 4805), and the background synthesis processing is executed. If the user selects to change the background image (step 4804) (step 4807), the user waits until the user selects another background (step 4806).
A background synthesis process is performed using the newly selected background component (step 4807).

Next, the image barcode synthesizing means 306 creates image data obtained by synthesizing the background synthesized image and the barcode (step 4808). That is,
Prior to that, in the part code coupling means 304,
Component selection processing (5002), placement exaggeration processing (500
3) and a code linking process (50) for generating a portrait code by linking the component code, the arrangement code, and the background code used in the background component synthesizing process (5004).
05), and the encoding means 305 executes a code conversion process (5006) from the portrait code to the portrait barcode. Then, the portrait bar code is combined with the portrait combined with the background.

As described above, according to the portrait creating method and apparatus with the simple creating function according to the fourth embodiment,
While using a portrait created by automatically exaggerating the actual face image, by appropriately attaching background components to it and performing a disguise simulation, it is possible to create a more interesting portrait, Moreover, by reading the barcode attached to the hard copy of the portrait into the apparatus, a portrait image created from a favorite face photograph can be repeatedly and easily created.

The above first, second, third, and
In the fourth embodiment, each function realizing means shown in FIG. 1, FIG. 20, FIG. 40, and FIG. 45 can be realized by a computer program. floppy disk,
It will be provided stored in a portable storage medium such as a CD or DVD, and will generally be installed and executed in an auxiliary storage device (such as a hard disk) of a computer.

[0272]

As is apparent from the above description, according to the present invention, an exaggerated face image, which is an essential feature of a portrait, can be automatically created. Further, according to the present invention, it is possible to reduce the amount of face parts required for synthesizing a portrait. Further, according to the present invention, a disguise simulation can be performed on the created portrait.
Further, according to the present invention, it is possible to easily create a portrait by a favorite face photograph many times.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating an overall configuration of a face image creation device according to a first embodiment of the present invention.

FIG. 2 is a flowchart schematically showing an operation of the face image creating device according to the first embodiment of the present invention.

FIG. 3 is a diagram for explaining feature points of a face in the face image creating apparatus according to the first embodiment of the present invention.

FIG. 4 is a diagram for explaining a method of extracting an eye feature amount in the face image creating apparatus according to the first embodiment of the present invention.

FIG. 5 is a diagram for explaining a method of extracting a feature amount of a mouth in the face image creating device according to the first embodiment of the present invention.

FIG. 6 is a diagram illustrating a method for extracting a feature amount of eyebrows in the face image creating device according to the first embodiment of the present invention.

FIG. 7 is a diagram showing a structure of data output from a feature amount extracting unit to another unit in the face image creating apparatus according to the first embodiment of the present invention.

FIG. 8 is a diagram showing a structure of each data of a feature amount database in the face image creating device according to the first embodiment of the present invention.

FIG. 9 is a flowchart for explaining a configuration of a nonlinear function creating unit in the face image creating apparatus according to the first embodiment of the present invention.

FIG. 10 is a graph for explaining an example of input / output characteristics of a nonlinear function in the face image creating device according to the first embodiment of the present invention.

FIG. 11 is a diagram for explaining a fuzzy inference rule in the face image creating device according to the first embodiment of the present invention.

FIG. 12 is a diagram for explaining a boundary with respect to a feature for selection in the face image creating apparatus according to the first embodiment of the present invention.

FIG. 13 is a flowchart illustrating a configuration of a component arranging unit in the face image creating device according to the first embodiment of the present invention.

FIG. 14 is a diagram for explaining a method of arranging face parts in the face image creating apparatus according to the first embodiment of the present invention.

FIG. 15 is a diagram showing a position of a face part representative point in a face part arrangement in the face image creation device according to the first embodiment of the present invention.

FIG. 16 is a diagram for explaining an example of a plain whole face image in the face image creation device according to the first embodiment of the present invention.

FIG. 17 is a diagram showing some examples of output images in the face image creation device according to the first embodiment of the present invention.

FIG. 18 is a diagram illustrating some examples of output images in the face image creation device according to the first embodiment of the present invention.

FIG. 19 is a diagram showing an example of a feature point extraction result by template matching in the face image creation device according to the first embodiment of the present invention.

FIG. 20 is a block diagram showing an overall configuration of a face image creation device according to a second embodiment of the present invention.

FIG. 21 is a flowchart schematically showing an operation of the face image creating device according to the second embodiment of the present invention.

FIG. 22 is a diagram for explaining feature points of a face in the face image creation device according to the second embodiment of the present invention.

FIG. 23 is a diagram for explaining a method of extracting an eye feature amount in the face image creating device according to the second embodiment of the present invention.

FIG. 24 is a diagram for explaining a method for extracting a feature amount of a mouth in the face image creating device according to the second embodiment of the present invention.

FIG. 25 is a diagram for explaining a method of extracting a feature amount of eyebrows in the face image creating device according to the second embodiment of the present invention.

FIG. 26 is a diagram showing a structure of data output from a feature amount extracting unit to another unit in the face image creating apparatus according to the second embodiment of the present invention.

FIG. 27 is a diagram showing a structure of each data of a feature amount database in the face image creating device according to the second embodiment of the present invention.

FIG. 28 is a flowchart for explaining a configuration of a component exaggeration nonlinear function creating unit (when the nonlinear function is a fuzzy rule expression) in the face image creating apparatus according to the second embodiment of the present invention.

FIG. 29 is a flowchart illustrating a configuration of a component exaggeration nonlinear function creating unit (when the nonlinear function is expressed by a mathematical expression) in the face image creating apparatus according to the second embodiment of the present invention.

FIG. 30 is a flowchart for explaining a configuration of a layout exaggeration nonlinear function creating unit (when the nonlinear function is a fuzzy rule expression) in the face image creating apparatus according to the second embodiment of the present invention.

FIG. 31 is a flowchart illustrating a configuration of a layout exaggeration nonlinear function creating unit (when the nonlinear function is expressed by a mathematical expression) in the face image creating apparatus according to the second embodiment of the present invention.

FIG. 32 is a diagram illustrating an example of a nonlinear function in the face image creating device according to the second embodiment of the present invention.

FIG. 33 is a diagram for explaining another example of the nonlinear function in the face image creating device according to the second embodiment of the present invention.

FIG. 34 is a diagram illustrating an example of a fuzzy rule for exaggerating parts in the face image creating apparatus according to the second embodiment of the present invention.

FIG. 35 is a diagram for explaining an example of a fuzzy rule for layout exaggeration in the face image creation device according to the second embodiment of the present invention.

FIG. 36 is a flowchart for describing a configuration of a component exaggeration unit in the face image creation device according to the second embodiment of the present invention.

FIG. 37 is a flowchart for explaining a configuration of a component arranging unit in the face image creating apparatus according to the second embodiment of the present invention.

FIG. 38 is a diagram for explaining a method of arranging face parts in the face image creating apparatus according to the second embodiment of the present invention.

FIG. 39 is a diagram showing the position of a face part representative point in the face part arrangement in the face image creation device according to the second embodiment of the present invention.

FIG. 40 is a block diagram showing an overall configuration of a face image creation device according to a third embodiment of the present invention.

FIG. 41 is a flowchart schematically showing an operation of the face image creating device according to the third embodiment of the present invention.

FIG. 42 is a flowchart illustrating details of image synthesis processing according to the third embodiment of the present invention.

FIG. 43 is a diagram for explaining a relationship between a background component and its reference point in the face image creation device according to the third embodiment of the present invention.

FIG. 44 is a diagram for describing reference points of face parts in the face image creation device according to the third embodiment of the present invention.

FIG. 45 is a block diagram showing an overall configuration of a face image creation device according to a fourth embodiment of the present invention.

FIG. 46 is a flowchart schematically showing an operation of the face image creating device according to the fourth embodiment of the present invention.

FIG. 47 is a flowchart illustrating details of a portrait creation process from a photograph according to the fourth embodiment of the present invention.

FIG. 48 is a flowchart illustrating details of a process for creating a portrait from a barcode according to the fourth embodiment of the present invention.

FIG. 49 is a block diagram for explaining contents of processing steps of a portrait creation process from a photograph according to the fourth embodiment of the present invention.

FIG. 50 is a block diagram for explaining the contents of processing steps of a portrait creation process from a portrait barcode according to the fourth embodiment of the present invention.

FIG. 51 is a diagram illustrating the contents of a component code in the case of an eye component according to the fourth embodiment of the present invention.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 data input means 2 image input means 3 feature quantity extraction means 4 feature quantity storage means 5 nonlinear function creation means 6 contour image extraction means 7 part image storage means 8 component placement means 9 face image output means 101 data input means 102 image input means 103 Feature Amount Extracting Means 104 Feature Amount Storage Means 105 Component Exaggeration Nonlinear Function Creation Means 106 Placement Exaggeration Nonlinear Function Creation Means 107 Contour Image Extraction Means 108 Component Image Storage Means 109 Component Exaggeration Means 110 Component Placement Means 111 Face Image Output Means 201 Data input means 202 Caricature creation means 203 Part image storage means 204 Selection menu storage means 205 Image synthesis means 206 Display means 207 Printing means 301 Portrait creation means 302 Background image synthesis means 303 Display means 304 Component code connection means 305 Encoding Hardcopy stage 306 image bar code synthesizing means 307 print unit 308 bar code reading means 309 decode unit 310 bar code 311 Background synthesized portrait image

[Procedure amendment]

[Submission date] August 28, 1997

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] Claims

[Correction method] Change

[Correction contents]

[Claims]

A portrait creation means for creating a portrait image 9. corresponding to the input face image, and the background component image storing means and the background component image to the background component of the portrait is more stored, the background component image Selection means for selecting the background part image stored in the storage means, image synthesis means for synthesizing the background part image selected by the selection means and the portrait image created by the portrait creation means, An output means for displaying or printing out the image synthesized by the image synthesizing means.

10. A portrait creation step of creating a portrait image corresponding to an input face image, and a step of selecting a desired background part image from a plurality of background part images stored as a plurality of background parts of the portrait. A selecting step, an image synthesizing step of synthesizing the selected background part image and the created portrait image, and an image outputting step of displaying or printing out the synthesized image. A unique portrait creation method.

11. A first portrait generation means for generating a portrait image corresponding to the input face image, and the portrait parts and component information generation means for generating information relating to the arrangement constituting the portrait, the component information Information recording means for recording the part information on a predetermined recording medium, information reading means for reading the part information from the recording medium, and a second method for creating the portrait image based on the read part information. And a portrait creating means.

12. A first portrait creation step for creating a portrait image corresponding to an input face image, a portrait information generation step for generating information about portrait parts constituting the portrait and their arrangement, and the component information. An information recording step of recording the part information on a predetermined recording medium, an information reading step of reading the part information from the recording medium, and a second step of creating the portrait image based on the read part information. A portrait creation method, comprising: a portrait creation step.

[Procedure amendment 2]

[Document name to be amended] Statement

[Correction target item name] 0029

[Correction method] Deleted

[Procedure amendment 3]

[Document name to be amended] Statement

[Correction target item name] 0030

[Correction method] Deleted

[Procedure amendment 4]

[Document name to be amended] Statement

[Correction target item name] 0031

[Correction method] Deleted

[Procedure amendment 4]

[Document name to be amended] Statement

[Correction target item name] 0032

[Correction method] Deleted

[Procedure amendment 5]

[Document name to be amended] Statement

[Correction target item name] 0033

[Correction method] Change

[Correction contents]

According to a ninth aspect of the present invention, there is provided a portrait creating means for creating a portrait image corresponding to an input face image, and a background storing a plurality of background part images to be background parts of the portrait. A part image storage unit, a selection unit for selecting a background part image stored in the background part image storage unit, a background part image selected by the selection unit, and a portrait created by the portrait creation unit There is provided a portrait drawing apparatus comprising: an image synthesizing unit for synthesizing an image; and an output unit for displaying or printing out the image synthesized by the image synthesizing unit.

[Procedure amendment 6]

[Document name to be amended] Statement

[Correction target item name] 0034

[Correction method] Change

[Correction contents]

According to the ninth aspect of the present invention, it is possible to make use of the exaggerated face image, which is a face image, and further enjoy the disguise.

[Procedure amendment 7]

[Document name to be amended] Statement

[Correction target item name] 0035

[Correction method] Change

[Correction contents]

According to a tenth aspect of the present invention, there is provided a portrait creating step of creating a portrait image corresponding to an input face image, and selecting a plurality of background part images stored as background parts of the portrait. A selecting step for selecting a desired background part image; an image synthesizing step for synthesizing the selected background part image with the created portrait image; and displaying or printing out the synthesized image. And an image output step.

[Procedure amendment 8]

[Document name to be amended] Statement

[Correction target item name] 0036

[Correction method] Change

[Correction contents]

According to the tenth aspect of the present invention, it is possible to make use of the exaggerated face image, which is an exaggerated face image, and further enjoy the disguise.

[Procedure amendment 9]

[Document name to be amended] Statement

[Correction target item name] 0037

[Correction method] Deleted

[Procedure amendment 10]

[Document name to be amended] Statement

[Correction target item name] 0038

[Correction method] Change

[Correction contents]

[0038] The invention according to claim 11 of the present application is a first portrait creation means for creating a portrait image corresponding to an input face image, and generates information about portrait parts constituting the portrait and the arrangement thereof. Component information generating means, information recording means for recording the component information on a predetermined recording medium, information reading means for reading the component information from the recording medium, and And a second portrait creation unit for creating the portrait image based on the portrait image.

[Procedure amendment 11]

[Document name to be amended] Statement

[Correction target item name] 0039

[Correction method] Change

[Correction contents]

According to the eleventh aspect, it is possible to easily and repeatedly create a portrait based on a favorite face photograph or the like.

[Procedure amendment 12]

[Document name to be amended] Statement

[Correction target item name] 0040

[Correction method] Change

[Correction contents]

According to a twelfth aspect of the present invention, a first portrait creating step for creating a portrait image corresponding to an input face image, and information on portrait parts constituting the portrait and the arrangement thereof are generated. A component information generating step, an information recording step for recording the component information on a predetermined recording medium, an information reading step for reading the component information from the recording medium, and And a second portrait creation step of creating the portrait image based on the portrait image.

[Procedure amendment 13]

[Document name to be amended] Statement

[Correction target item name] 0041

[Correction method] Change

[Correction contents]

According to the twelfth aspect of the present invention, it is possible to easily and repeatedly create a portrait based on a favorite face photograph or the like.

[Procedure amendment 14]

[Document name to be amended] Statement

[Correction target item name] 0042

[Correction method] Deleted

 ────────────────────────────────────────────────── ─── Continued on the front page (72) Inventor Masato Kawade 10th Hanazono Todocho, Ukyo-ku, Kyoto-shi, Kyoto O Inside the Mron Corporation (72) Inventor Tsutomu Ishida 10th Hanazono-Todocho, Ukyo-ku, Kyoto-shi Kyoto (72) Inventor Yoshiro Tasaka In Kyoto, Kyoto Prefecture

Claims (16)

[Claims] 1. A face image input means for inputting a face image, and a face image input from the face image input means is analyzed to extract a face feature quantity which is a feature quantity related to a shape and an arrangement of a face part. A face feature amount extraction unit, a face part data storage unit that stores a plurality of face part data for each type of face part, and a feature amount related to the shape of the face part from the face part data storage unit. A face part data extraction unit for extracting face part data corresponding to the shape feature amount for each type of face part; and a change parameter for controlling a change of a position at which a face part represented by the extracted face part data is arranged. Change parameter input means for inputting, correcting the arrangement feature amount of the face part in the face feature amount based on the change parameter, corresponding to the face part data extracted by the face part data extraction means That a face component placement means a face part patterns arranged at a position indicated by the placement feature value said modified comprises a composite picture editing device, characterized in that. 2. The apparatus according to claim 1, wherein the face part arranging means adjusts a correction amount of the arrangement feature amount based on a sex of the portrait creation target person or an adult. Caricature creation device. 3. A face feature amount extraction step of analyzing a given face image to extract a face feature amount that is a feature amount related to the shape and arrangement of the face part, and a plurality of face feature amounts stored in advance for each type of face part. From among the facial part data of the above, using a feature amount related to the shape of the facial part,
A face part data extraction step of extracting face part data corresponding to the shape feature amount for each type of face part; and a change parameter for controlling a change of a position at which a face part represented by the extracted face part data is arranged. And a modification parameter inputting step for inputting a facial component, and correcting the arrangement feature of the face part in the face feature based on the change parameter to correspond to the face part data extracted in the face part data extracting step. A face part arranging step of arranging a face part pattern at a position indicated by the corrected arrangement feature amount. 4. The face part arranging step according to claim 3, wherein the face part arranging step adjusts a correction amount of the arrangement feature amount based on a gender of the portrait creation target person or whether the person is an adult. How to create a portrait. 5. A face image input unit for inputting a face image, a face part feature amount extraction unit for extracting a feature amount of a face part from the input face image, and a feature amount of the face part. Parameter generation means for generating a parameter for converting the size or shape of the face part used in the portrait, face part data storage means for storing a plurality of face parts for each type of the face part used in the portrait, the face part data A portrait synthesizing means for synthesizing a portrait using a facial part obtained by converting the size or shape of the facial part read from the storage means using the parameter; 6. The caricature creation apparatus according to claim 5, wherein the parameter generation means determines the parameters based on the sex of the caricature creation target person or whether the caricature is an adult. 7. A face part feature amount extracting step of analyzing a given face image to extract a feature amount of the face part, and determining a size or shape of the face part used in the portrait based on the feature amount of the face part. A parameter generation step of generating a parameter for conversion, and a size or shape of a face part read out from a plurality of face part data stored in advance for each type of face part, obtained by converting the size or shape using the parameter. A portrait synthesizing step of synthesizing a portrait using a face part. 8. The method according to claim 5, wherein in the parameter generating step, the parameters are determined based on the gender of the person whose portrait is to be created or whether the person is an adult.
Caricature creation method described in. 9. A computer, comprising: a face image input unit for inputting a face image; and a face feature amount which is a feature amount relating to the shape and arrangement of the face part by analyzing the face image input from the face image input unit. A facial feature data extracting means for extracting a plurality of facial component data for each type of facial component; and a feature quantity relating to the shape of the facial component from the facial component data storing means. A face part data extracting means for extracting face part data corresponding to the shape feature amount for each type of face part, and controlling a change of a position at which a face part represented by the extracted face part data is arranged. A change parameter input unit for inputting a change parameter; and a face extracted by the face part data extraction unit by correcting a placement feature of the face part in the face feature based on the change parameter. A face part arranging means for arranging a face part pattern corresponding to the part data at a position indicated by the corrected arrangement feature quantity, and a recording medium storing a program for causing the part to function. 10. A face image input unit for inputting a face image, a face part feature amount extraction unit for extracting a feature amount of a face part from the input face image, and a feature amount of the face part. Parameter generating means for generating a parameter for converting the size or shape of the face part used in the portrait based on the face part; face part data storage means for storing a plurality of face parts used in the portrait for each type of the face part; A portrait synthesizing means for synthesizing a portrait using a face part obtained by converting the size or shape of the face part read out from the face part data storage means by the parameter, and a recording medium storing a program for functioning as a portrait . 11. A caricature creating means for creating a caricature image corresponding to an input face image, a background part image storage means for storing a plurality of background part images to be background parts of the caricature, and the background part image Selection means for selecting the background part image stored in the storage means, image synthesis means for synthesizing the background part image selected by the selection means and the portrait image created by the portrait creation means, An output means for displaying or printing out the image synthesized by the image synthesizing means. 12. A caricature creating step of creating a caricature image corresponding to an input face image, and selecting a desired background part image from a plurality of stored background part images as background parts of the caricature. A selecting step, an image synthesizing step of synthesizing the selected background part image and the created portrait image, and an image outputting step of displaying or printing out the synthesized image. A unique portrait creation method. 13. A caricature creating means for creating a caricature image corresponding to an input face image, a background part image storage means for storing a plurality of background part images to be background parts of the caricature, Selecting means for selecting the background part image stored in the background part image storage means; and image synthesis for synthesizing the background part image selected by the selecting means and the portrait image created by the portrait creating means. Means for displaying and printing or outputting the image synthesized by the image synthesizing means. 14. A first caricature creating means for creating a caricature image corresponding to an input face image, a caricature part constituting the caricature and a part information generating means for generating information relating to the arrangement thereof, and the part information Information recording means for recording the part information on a predetermined recording medium, information reading means for reading the part information from the recording medium, and a second method for creating the portrait image based on the read part information. And a portrait creating means. 15. A first portrait creation step for creating a portrait image corresponding to an input face image, a portrait information generation step for generating information about portrait parts constituting the portrait and their arrangement, and the component information. An information recording step of recording the part information on a predetermined recording medium, an information reading step of reading the part information from the recording medium, and a second step of creating the portrait image based on the read part information. A portrait creation method, comprising: a portrait creation step. 16. A first computer which generates a portrait image corresponding to an input face image.
Caricature creation means, caricature parts forming the caricature parts, and component information generation means for generating information on their arrangement, information recording means for recording the part information on a predetermined recording medium, and on the recording medium A recording medium for recording a program for functioning as information reading means for reading the part information from the computer; and second portrait creating means for generating the portrait image based on the read part information.