JP3478255B2 - Face image creation device and face image creation control method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a face image forming apparatus and a face image forming control method.

[0002]

2. Description of the Related Art Conventionally, a graphic display device using, for example, a microcomputer is used to create a face image. In this device, each part (eg,
A portrait image is created by combining parts images for each part (eye, eyebrow, mouth, etc.). Specifically, hairstyle,
It has a parts memory that stores each type of face contour, eyes, eyebrows, nose, mouth, etc. as multiple types of bitmap images.The individual part images are selectively called by key input operation and displayed on the display. An arbitrary portrait image is created by synthesizing and displaying.

[0003]

However, in the case of creating a face image with the conventional graphic display device, if there are few kinds of the part images stored in the parts memory in advance, a portrait image similar to the actual face is created. There is a problem that you cannot do it. Therefore, for example, it is also possible to create a portrait image that is similar to the actual face by giving many types of images for each part in the parts memory, but too many parts images are created. As the number of types increases, it takes a lot of time to select each part image, and it is difficult to determine one of the approximated plural images as an appropriate image.

On the other hand, in order to solve such a problem, the applicant of the present invention has previously proposed a technique of judging one of a plurality of similar parts images as an appropriate parts image (special feature). Kaihei 6-187410). In this technique, an image portion or a partial image representing each part of the input face image is collated with a plurality of types of part images stored in the part memory in advance, and for example, the image matching degree is the highest. By selecting and combining the parts images of each high part and combining them, a portrait image similar to the actual face is created. However, in this method, each of the part images that make up the portrait image created in this way is mechanically and automatically uniquely selected, so that a more realistic face is selected. It was not possible to create a caricature image close to.

[0005] The present invention, without laborious to selection operation of the part image, when a portrait image is very similar to the real face can be produced easily and rapidly Tomo
Quickly create the created portrait image and personal data.
A face image creation device that enables quick and reliable confirmation and
And a face image creation control method .

[0006]

To achieve these objects, the present invention is characterized by having the following constitution.
A face image creating apparatus according to the present invention according to claim 1 stores face image storing means for storing a face image and the face image storing means.
Enter the data about the person corresponding to the stored face image.
Memorizing personal data storage means and hair, eyes,
A parts image storage unit that stores a plurality of types of parts images for each part such as a nose and a mouth, a plurality of types of parts images stored in the parts image storage unit, and the face image storage unit A collating means for collating the image part of each part of the face image for each part, and a part image for each part stored in the part image storage means according to the matching result by the matching part. , A first portrait creation means for creating a first portrait image corresponding to the face image, and a first portrait created by the first portrait creation means.
Of at least a part of each of the part images forming the portrait image of the other part image is replaced with another part image stored in the part image storage means, and the part is not replaced with the replaced other part image. A second portrait creation means for creating a second portrait image by combining the image and the second portrait creation means.
Of the created second portrait image and the second portrait image
For the individual corresponding to the face image matched for
Display control hand that controls to display in association with the data
And a step .

[0007] The face image creation device according to the present invention according to claim 2, the face image storing means for storing a face image, the
An individual corresponding to a face image stored in the face image storage means
Personal data storage means for storing data relating to : a parts image storage means for storing a plurality of types of parts images having different shapes for each part of the face, such as hair, eyes, nose, mouth, and the like; Of the face images stored in the face image storage means, at least partial images corresponding to the eyes, nose, and mouth, and at least the same parts as the eyes, nose, and mouth parts are stored in the part image storage means. A collating unit that collates a plurality of types of part images and determines the degree of coincidence, and, as a result of collation by the collating unit, the part image with the highest degree of coincidence among the plurality of types of part images First portrait drawing means for creating a portrait image corresponding to the face image by combining the read out part images of the respective parts, and the first portrait creation At least a part of the part images constituting the first portrait image created by the step is replaced with another part image stored in the part image storage means, and the replaced other part image is replaced. A second portrait creation means for creating a second portrait image by combining the parts image and the parts image that has not been replaced, and a second portrait created by the second portrait creation means .
For creating the second portrait image and the second portrait image
Data about the individual corresponding to the combined face image
And a display control means for controlling the display in association with each other.

[0008] The face image creation device according to the present invention according to claim 3, the face image storing means for storing a face image, the
An individual corresponding to a face image stored in the face image storage means
Personal data storage means for storing data relating to the facial image, and image parts for each part of the face extracted and stored from the face image stored in the face image storage means. A first storage unit that stores position data for each part, a second storage unit that stores a plurality of types of parts images for each part of the face, and a plurality of units stored in the second storage unit. A collation unit that collates each type of part image with the image portion of each part of the face image stored in the face image storage unit, and the second storage based on the collation result by this collation unit. The part image for each part stored in the means is arranged at a position corresponding to the position data stored in the first storage means, and the part image for each part thus arranged is combined to obtain the face image. The portrait image corresponding to At least a part of the first portrait image creating means to be formed and each of the part images constituting the first portrait image created by the first portrait image creating means are stored in the part image storage means. And a second portrait image creating means for creating a second portrait image by replacing the replaced other part image with the replaced other part image and combining the replaced other part image with the non-replaced part image . The second created by the portrait creation means
Collate to create a portrait image and the second portrait image
The data related to the individual corresponding to the face image
Display control means for controlling so as to display in response to each other.

According to a fourth aspect of the present invention, there is provided a face image creating apparatus, which includes face image storing means for storing a face image.
An individual corresponding to a face image stored in the face image storage means
Data storing means for storing data relating to face, parts storing means for storing a plurality of part images representing face constituent elements for each part, and an image representing each part of the face from the face image targeted for the portrait image A plurality of parts stored in the parts storage means, which is extracted by the extraction means, and the image parts extracted by the extraction means and the parts images stored in the parts storage means are collated for each part. Of the images, a selecting means for selecting a part image that is closest to the image portion extracted by the extracting means, and a part image selected by the selecting means correspond to the extracted image portion for each part. Display position adjusting means for adjusting the display position of the part image so that the part image is displayed at the position to be displayed, and the part image of each part displayed by the display position adjusting means. At least one of first display control means for displaying a first portrait image composed of a combination and each part image constituting the first portrait image displayed by the control of the first display control means. The part image of the set is replaced with another part image stored in the part image storage means, and the replaced other part image and the part image not replaced are combined to create a second portrait image. The second portrait creation means and the second portrait created by the second portrait creation means.
Collate to create a portrait image and the second portrait image
The data related to the individual corresponding to the face image
Display control means for controlling so as to display in response to each other. The face image creation device according to the present invention described in claim 5, the face image storing means for storing the face image pairs to the face images stored in the face image storing means
A personal data memorizer that stores data about the responding individual.
A step, a parts image storage means for storing a plurality of types of parts images having different shapes for each part such as hair, eyes, nose, mouth, etc., which constitute each part of the face, and the face image storage means. Individual extraction means for individually extracting each image portion corresponding to at least eyes, nose, and mouth from the face image, and an image portion corresponding to at least eyes, nose, and mouth extracted by this individual extraction means Collating means for collating each part with a plurality of types of part images stored in the part image storage means, and as a result of collation by this collating means, a part image having a high degree of coincidence for each part is obtained for each part. A first portrait creation means for creating a portrait image corresponding to the face image by combining the read out part images for each part and created by the first portrait creation means At least a part of the part images forming the first portrait image is replaced with another part image stored in the part image storage means, and is replaced with the replaced other part image. A second portrait creating means for creating a second portrait image by combining with a part image which is not included, and this second portrait image.
The second portrait image created by the portrait creating means and
The face image collated to create a second caricature image
Correspondingly displayed with the personal data corresponding to
And a display control unit for controlling as described above .

[0010]

In the present invention, the following actions are performed. Claim 1
According to the described face image creating apparatus of the present invention, a part for storing a plurality of types of parts images for each part of the face, such as hair, eyes, nose, mouth, etc. The image storage means is accessed, and a plurality of types of parts images stored in the parts image storage means and the image portion of each portion of the face image stored in the face image storage means are collated for each portion. Check with. Then, according to the collation result by the collating means, the part images for each part stored in the part image storing means are combined,
A first portrait image creating unit creates a first portrait image corresponding to the face image. Replacing means for replacing at least a part of the part images of the respective part images forming the first portrait image created by the first portrait drawing means with another part image stored in the part image storing means. Replace with. Then, the second portrait image is created by the second portrait creating unit by combining the other part image replaced by the replacing unit and the part image that is not replaced. This second portrait creation means
Second portrait image created by the above and the second portrait painting
An individual corresponding to the face image matched for creating the image
It is controlled to display in association with the data about
It

According to the face image creating apparatus of the present invention as defined in claim 2, the face image storing means for storing the face image and the shape of each part such as hair, eyes, nose, mouth, etc. constituting each part of the face are formed. By accessing a part image storage unit that stores a plurality of different types of part images, and among the face images stored in the face image storage unit, at least partial images corresponding to eyes, nose, and mouth, and at least this partial image. The plurality of types of parts images stored in the parts image storage means at the same parts as the eyes, nose, and mouth are compared, and the matching degree is determined by the matching means. Then, as a result of the matching by the matching means, the part image having the highest degree of matching among the plurality of types of part images is read out from the part image storage means for each part, and the read part image for each part is read. In combination with each other, a portrait image corresponding to the face image is created by the first portrait creating means. After that, at least a part of the part images constituting the first portrait image created by the first portrait creating means is replaced with another part image stored in the part image storing means. Replace with replacement means. Then, the second portrait image is created by the second portrait creating unit by combining the other part image replaced by the replacing unit and the part image that is not replaced. Create this second caricature
The second portrait image created by the means and the second portrait image.
Corresponds to the face image that has been matched to create a face image.
It is controlled so that it is displayed in association with the data about the individual
Controlled. The face image creating apparatus according to the present invention described in the other claims also has the same operation.

[0012]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a first embodiment of a face image creating apparatus and a face image data storage apparatus according to the present invention. In particular, the present invention is applied to an electronic notebook, which is a portable electronic device carried by a user. It is a front view of the electronic notebook in the case of doing. In FIG. 1, the electronic notebook 1 is a pair of main bodies 1
It shows a state in which a and 1b are respectively opened to the left and right. A CCD camera unit (input image data reading means) 2 is arranged above the main body 1b of the electronic notebook 1. The CCD camera unit 2 is aimed at the face of an operator (operator) existing almost in front of the electronic organizer 1, takes an image of the face of the operator to generate image data, and reads the image data to read the main bodies 1a, 1b. Output to a Y / C separation unit 23a shown in FIG. That is, the CCD camera unit 2 has an image pickup unit and a data unit that processes a captured image and reads it as image data. The input image data reading means is not limited to the CCD camera, but a video camera, an image scanner, an electronic still camera, or the like may be used. Alternatively, an image signal from another device may be used.

A second display portion 3 and a data input key 4 are sequentially arranged below the CCD camera portion 2 in the main body 1b of the electronic notebook 1. The second display unit 3 is composed of, for example, an LCD (liquid crystal display device), and displays the face image 2a captured by the CCD camera unit 2, so that the captured face image 2a can be displayed as it is. Has become.
The second display unit 3 is an LCD capable of displaying a monochrome screen.
Alternatively, it may be an LCD capable of displaying a color screen. The data input key 4 is for inputting various data necessary for operating the electronic notebook 1, for example, "1",
Numeric key consisting of "2", ... "9", "0",
Operation keys such as "-", "+", ..., "A",
It has alphabetic keys consisting of "B", ... "Y", "Z". By using these numerical keys, calculation keys, and alphabet keys, various data about a person who is a target person of face image creation is input, or data other than the image is input.

Below the main body 1b of the electronic notebook 1, a printing unit (see FIG. 2 described later) capable of printing the label tape 4 is built in. In the example of FIG. 1, the face image displayed on the first display unit 11 is displayed. The state where 11a is printed on the label tape 4 and taken out is illustrated. The label tape 4 is attached to the label tape 4 on which a face image is printed at an appropriate position by the adhesive action of the adhesive layer by peeling off the release sheet provided on the back side of the label tape so as to be removable via the adhesive layer. It is possible. Further, not only an image but also a sentence can be printed on the label tape 4. It should be noted that not only the face image 11a displayed on the first display unit 11 but also an image displayed on the second display unit 3 described later can be printed on the label tape 4 and taken out. The printing material may be plain paper instead of label tape.

On the other hand, the main body 1a of the electronic notebook 1 is provided with a first display portion 11, an input switch portion 12, an on / off key 13, and a site key 14 from the upper side. First display unit 1
Reference numeral 1 denotes, for example, an LCD, which displays various images and a composite face image at the stage of electronically creating a face image, and displays necessary data (for example, data such as a person's name). The first display unit 11 may be an LCD capable of displaying a monochrome screen or an LCD capable of displaying a color screen. In the example of FIG. 1, a face image 11 of a person
The name, address, telephone number, and age are displayed as data relating to a and the person. Of course, data other than these may be used. Input switch unit 12
Is for performing various operations necessary for creating a face image of a person using the electronic notebook 1, and specifically, the following keys are provided. For the following keys, for example, thin sheet type key switches are used. "Matching" means
When comparing and matching the part data corresponding to the partial image of the face stored as the read data of the CCD camera unit 2 and the plurality of types of part images for each part of the face stored as the part image The key to operate.
“Display” is a key operated when displaying an image on the first display unit 11. Alternatively, the operation may be performed when the image is displayed on the second display unit 3. “Print” is a key operated when printing an image or text on the label tape 4.

The "individual" is a key operated when displaying data relating to an individual, for example, data relating to an individual such as name, address, telephone number, etc., on the first display section 11. “Enlarge” is a key operated when enlarging a part of the face image displayed on the first display unit 11. The "image input" is a key operated when the face image 2a captured by the CCD camera unit 2 is fixed and displayed. “Position correction” means the first display 11
This is a key to be operated when correcting the position of the part of the face image displayed in. The “correction” is a key operated when correcting the face image displayed on the first display unit 11. “Δ ▽” is a selection key that is operated when selecting a desired part image from a face part or a plurality of parts, and performs so-called increment / decrement operations. △
Is for up and ▽ is for down. “End” is a key operated when ending the processing of the face image displayed on the first display unit 11. “Register” is a key operated when registering the face image displayed on the first display unit 11. "Face direction"
Is a key operated when changing the direction of the face image displayed on the first display unit 11 (for example, displaying a side face). The on / off key 13 is operated when the power of the electronic notebook 1 is turned on / off. The part key 14 is operated when designating each part of the face (for example, hair, eyes, nose, mouth, etc.), and a desired part is designated by pressing a graphic type key imitating each part. To be done. It should be noted that the body, hands, feet, etc. of the person are simply displayed graphically,
The function as a switch is omitted.

Next, FIG. 2 is a block diagram showing the configuration of the face image creating apparatus in the electronic notebook. In FIG. 2, the face image creating apparatus includes a CPU 21, a key input unit 22, an image data input unit 23, an image matching unit 24, a print drive unit 25, a print unit 26, a display drive unit 27, an input image memory 28, a basic position memory. 29, parts image ROM 30,
It is configured to include the ROM 31, the work RAM 32, and the first display unit 11 and the second display unit 3 described above. The key input unit 22 includes the data input key 4, the input switch unit 12, the on / off key 13 and the part key 14 shown in FIG. 1, and the key operation signal from the key input unit 22 is the CPU 2
Input to 1. The CPU 21 controls the operation of each part of the circuit according to the portrait image creating program stored in the ROM 31 based on the key operation signal from the key input unit 22, and the CPU 21 inputs the image data in addition to the key input unit 22 and the ROM 31. Unit 23, image matching unit 24, print driving unit 25, display driving unit 27, input image memory 28, basic position memory 29, parts image ROM 30,
The ROM 31 and the work RAM 32 are connected.
The CPU 21 and the ROM 31 together with the data comparison means 10
1. An image synthesizing unit 102 and a time measuring unit 103 are configured. Further, the CPU 21 realizes the functions of the comparing unit and the synthesizing unit together with the ROM 31 so as to correspond to the inventions of claims 4 to 7.

The image data input unit 23 is a unit for inputting a face image of a portrait (for example, the face image 2a shown in FIG. 1) of a portrait image imaged by the CCD camera unit 2 as a video signal (for one field). Then, the image data input unit 23 includes the Y / C separation unit 23a and the A / D conversion unit 2
3b. The Y / C separation unit 23a is a CCD
Only the luminance signal Y is separated and extracted from the luminance signal Y and the color difference signal C included in the video signal from the camera unit 2.
The video signal from the A / C separation unit 23a is converted into the A / D conversion unit 23.
b. The A / D converter 23b is the Y / C separator 2
Video luminance signal Y for one field supplied from 3a
Is converted into a black-and-white binary digital signal in synchronization with a preset sampling clock, and the A / D conversion unit 2
The image data converted into digital data via 3b is transferred to and stored in the input image memory 28. That is, the input image memory (face image data storage means) 28 stores face image data captured as a portrait image target person as bitmap data. The face image data stored in the input image memory 28 is the "nose" of the face.
The image area in which is stored is set in the center of the storage area and stored.

The basic position memory 29 is the input image memory 28.
The basic memory locations of face images in hair, eyebrows, eyes, nose,
The face image data stored in the input image memory 28 according to the address value stored in the basic position memory 29 is stored as the address value divided for each part such as the mouth and the ear. Face image data captured as a person is read for each part such as hair, eyebrows, eyes, nose, mouth, and ears. A parts image ROM (parts image storage means) 30 divides each part of the face into parts such as hair, eyebrows, eyes, nose, mouth, and ears, and assigns a plurality of kinds of parts images to predetermined storage positions for each part. Are stored as bitmap data, and by combining one part image for each part stored in the part image ROM 30, one by one,
A portrait image is constructed.

Here, an example of a part image of each part of the face stored in the part image ROM 30 is shown in FIG. In FIG. 3, for each part of the face, there are a plurality of part images corresponding to the orientation of the face, such as front (A), right side (B), and diagonal right side (N). It is set. Then, for each surface (A) to (N), a plurality of types of each part of the face are prepared by dividing into parts images such as the contour of the face, hairstyle, right eye, ...
The face part is not limited to the example shown in FIG. 3, but other parts such as eyebrows and nose are prepared, though not shown. Further, other face parts may be prepared.

On the other hand, as a part image of each part of the face,
A plurality of types (here, 50 types) indicated by the part image numbers [01], [02], ... [50] are provided in advance, and the contour, hairstyle, right eye, ...
Prepared and stored for both feet. Further, the position data of each part image of each part is attached as coordinates [x, y] and stored in a predetermined area. Therefore, each part has multiple parts images,
It will have the position data of each part image together. Further, in the part image ROM 30, the number of matching matching dots with the face image data corresponding portion stored in the input image memory 28 corresponding to each of the part images [01] to [50] provided in plural for each part. And a rank register for storing rank numbers in descending order of the number of matching dots stored in the match frequency register. FIG. 4 shows, as an example, a stored state of a part image corresponding to one of the facial parts, that is, the "nose", and particularly shows the number of matching matching dots and the order number.

The work RAM (parts data storage means, parts image designation data storage means) 32 extracts a partial image for each part of the face from the face image data stored in the input image memory 28, and stores the extracted partial image. The orientation data and the position data for each part are stored. The image matching unit 24 sequentially collates (compares) the part data corresponding to the partial image stored in the work RAM 32 with a plurality of types of part images for each part of the face stored in the part image ROM 31,
The number of matching dots corresponding to the number of image matching points is calculated. The number of matching matching dots for each of the multiple part images for each part of the face image data is stored in the above-described matching frequency register and the order of the matching frequencies is determined. Is stored in the above-mentioned rank register.

When the number of matching dots for each part of the face image data and its order number are stored for all of the plurality of part images for each part in the part image ROM 30, the first rank is set for each part. The part images of are read out and displayed in combination corresponding to each position data.
The display drive unit 27 drives the first display unit 11 and the second display unit 3 based on the output of the CPU 21 to display the processed image. Further, the print driving unit 25 drives the printing unit 26 based on the output of the CPU 21, and the printing unit 26 causes the label tape 4
Print processed images and characters on. The display drive unit 27 and the first display unit 11 form a display unit.

Next, the operation will be described. First, electronic notebook 1
When the main bodies 1a and 1b are opened to the left and right and the on / off key 13 is pressed, power is supplied to the electronic notebook 1 and the operation starts. After that, by executing the program described later, the personal data is input and the portrait image creation process is performed. FIG. 5 is a flow chart showing a processing program when inputting / registering personal data using the electronic notebook 1 of this embodiment. When this program starts,
First, in step S10, it is determined whether or not the personal key is pressed. The personal key is an “individual” key in the input switch unit 12, and is operated when displaying data relating to the individual, for example, data relating to the individual such as name, address, and telephone number on the first display unit 11. is there. If the individual key has not been pressed, the process stays in step S10. If the individual key has been pressed, the process proceeds to step S12, and it is determined whether or not the individual data has been input.

The personal data is input by using the data input key 4, and it is possible to input personal data such as name, address and telephone number. In this case, if personal data has not been input, the process jumps to step S16. If the personal data is input, the process proceeds to step S14, and the input personal data is stored in the work RAM 3
Store in 2. As a result, the CPU 21 causes the work RAM to
The input personal data stored in 32 is read and output to the display drive unit 27, and the display drive unit 27 drives the first display unit 11, whereby the input personal data is displayed on the first display unit 11. . Next, in step S16, it is determined whether or not the registration key is turned on. If it is not turned on, the process returns to step S12 and steps S12 to S1.
Repeat the loop of 6. When the registration key is turned on in step S16, the input personal data is registered and the present routine is terminated. As a result, the personal data is stored in the predetermined registration area of the work RAM 32, and can be subsequently taken out as registered personal data.

FIGS. 6 and 7 are flowcharts showing a program for portrait image creation processing. When this program starts, it is first determined in step S100 whether the display switch is on. The display switch is a display key in the input switch unit 12, and when the display switch is turned on, the first display unit 11 is activated to display an image, and the process proceeds to step S102 and is already created. A process of selecting and displaying a portrait image is performed. If the display switch is not turned on, step S10
The process branches to 4 and the process of creating a portrait image from an actual person image is executed. A. Routine of portrait image selection processing First, the routine of portrait image selection processing will be described. In step S102, it is determined whether search data has been input. The search data is data for selecting the created portrait image, and is, for example, personal data. If no search data is input, the process returns to step S100,
When the search data is input, the process proceeds to step S106, and the corresponding data is searched from the personal data in the work RAM 32 by the search data and displayed on the first display unit 11.

Here, FIG. 8 shows a storage example of the work RAM 32. For example, the facial features of each person correspond to the personal data of the person, the face direction, the part image number of each part of the face, The position data (parts data) of each part is stored in a predetermined area as a parameter. Also, in this case, the orientation of the face (that is, the front surface, the right side surface, ...
... The part image numbers such as contour, hair, right eye, ... corresponding to the oblique right side surface) are, for example, [50] and [0, respectively.
2], [50], ... Are stored in predetermined areas, and the position data of parts such as contour, hair, right eye, ... Are respectively [x1, y].
1], [x2, y2], [x3, y3], ..., And stored in a predetermined area. [X1,
The values y1], [x2, y2], [x3, y3], ... Are coordinate values that specify the position on the screen, and are difference data from the absolute position according to the position correction. . If the position is not corrected, the coordinate value is [0,0].

Then, for example, a part image number of each part and a position data of each part of the face image corresponding to the orientation of the face (that is, the front surface, the right side surface, ..., the oblique right side surface) are combined and synthesized. By doing so, one montage image is created. Therefore, if the input search data is personal data, the corresponding personal data is collated and the matching person's data is selected.
It will be displayed on the display unit 11. For example, if any of personal name: A, address: ○○, telephone number: ○○, blood type: ○, hobby: ○○ is input, the first person in FIG. The personal data of the person stored in the area is selected and displayed on the first display unit 11. As personal data, in addition to the example of the person A, the following person data is stored. Further, other person data may be stored. Name: B Address: ○○ Phone number: ○○ Blood type: ○ Hobbies: ○○

Next, one face image data in the area of the work RAM 32 in which the montage image (that is, a portrait image) corresponding to the personal data retrieved in step S108 is stored is read out on the first display unit 11. indicate. As a result, one of the portrait images already created based on the personal data is picked up and displayed. For example, when the data relating to the person's instep as described above is input as personal data, the orientation of the face corresponding to the person's instep shown in FIG. 8, the part image number for each part of the face,
One portrait image based on the position data (parts data) of each part is displayed. Therefore, although there are a plurality of portrait images corresponding to the instep of the person depending on the direction of the face and the like, one of them is selected and displayed.

Then, in step S110, the selection key (Δ
Determine whether or not the ▽ key) is turned on. If the selection key is on, it is determined that another portrait image is requested to be selected even if the personal data is the same, and the work R is selected in step S112.
Other face image data in the AM 32 area is selected.
Then, the process returns to step S108 and the same loop is repeated. Thereby, for example, when the data related to the person A is input as the personal data as described above,
Another portrait image corresponding to the person A is selected and displayed on the first display unit 11.

At this time, if the desired portrait image of the human instep corresponding to the search data is not displayed on the first display portion 11, the selection key (Δ ▽ key) is further operated (for example, the Δ key). Incrementally select a portrait image, or by operating the ▽ key to decrement a portrait image). Next, in step S114, it is determined whether or not the end switch (end key) is turned on. If the end switch is not turned on, the process returns to step S110 and the same loop is repeated. Then, finally, the desired portrait image corresponding to the search data is displayed on the first display unit 11. After the desired portrait image corresponding to the search data is displayed on the first display unit 11, the process proceeds to step S114 and if it is detected that the end switch is turned on, the portrait image selection process is terminated and the step is completed. Return to S100.

B. The routine of portrait image creation processing branches from step S100 to step S104, and image data is input in step S104. That is, when the image input key of the input switch unit 12 is turned on, the face image data of the operator captured by the CCD camera unit 2 as the target of the portrait image is supplied to the image data input unit 23 as a video signal. As a result, the video signal for one field supplied to the image data input unit 23 is converted from the Y / C separation unit 23a to the digital image data for one screen through the A / D conversion unit 23b. Next, in step S116, image data correction is performed. This is to correct the one screen of face image data converted into digital image data by erasing extra image data existing in the background portion.
Next, in step S118, the input image data is CP
The image data is transferred from U21 to the input image memory 28, stored in the input image memory 28, and displayed on the second display unit 3. As a result, the face image of the operator captured by the CCD camera unit 2 is displayed on the second display unit 3. The input image displayed on the second display unit 3 is as shown in FIG. 9 (A), for example.

Next, in step S120, it is determined whether or not the face direction has been input. This is the input switch unit 12
Judgment is made based on whether or not the face direction key of is turned on. If the face direction key is not turned on, the process returns to step S100. If the face direction key is turned on, the process proceeds to step S122, and the work RA for storing the face image of the corresponding personal data.
Specify the M32 area. As a result, the face image data corresponding to the face direction at that time is stored in the work RAM 32. For example, when the face direction in the front is imaged, and when the direction is OK, the face in the front direction as shown in FIG. 9A is stored in the work RAM 32 as an input image.

Next, moving to FIG. 7, it is determined in step S124 whether or not the part key of the input switch unit 12 is turned on. If the part key is turned on, the input image corresponding to the part selected in step S126 is input. Display the cursor on the data. For example, as shown in FIG. 9B, when the part key is turned on and "nose" is designated, the cursor C is displayed on the second display unit 3 at the part "nose". On the other hand, if the region key is not turned on, the process jumps to step S126 and proceeds to step S128. In this way, each part of the face is extracted as a partial image from the captured face image, and the orientation data of the extracted partial image and the position data of each part are stored in the part image ROM 30 in advance as described below. By comparing and collating with, the similar portrait image to the captured image is combined and displayed by the combination for each part.

Then, in step S128, it is determined whether or not the position correction key of the input switch section 12 is turned on. This is to determine whether to correct the position of the part displayed by the cursor C on the second display unit 3.
If the position correction key is on, the display position of the cursor is moved in step S130. As a result, for example, as shown in FIG.
As shown in (B), when the body part key is turned on and the "nose" is designated, the display position of the cursor designating the "nose" moves, and the "nose" is slightly different on the screen. Move to a place. On the other hand, if the position correction key is not turned on, the process jumps to step S130 and proceeds to step S132.

In step S132, the input switch unit 12
It is determined whether or not the enlargement key of is turned on. This is the second
It is to determine whether to enlarge the size of the part displayed by the cursor C on the display unit 3. If the enlargement key is turned on, the part designated by the cursor C is enlarged and displayed in step S136. As a result, for example, as shown in FIG. 9C, when the region key is turned on and the "nose" is designated, the "nose" is enlarged at a predetermined magnification and displayed as an enlarged image K on the screen. . By enlarging and displaying the designated part in this way, it is easy to correct the enlarged part, and as a result it is possible to create a portrait image (montage image) that is closer to the real thing while showing the characteristics of the part Become. On the other hand, if the enlargement key is not turned on, the process jumps to step S134 and proceeds to step S136.
In step S136, it is determined whether or not the matching key of the input switch section 12 is turned on. This is to compare and collate the part in the captured image displayed by the cursor C on the second display part 3 with the part image stored in the part image ROM 30 in advance, and rank the matching frequency. By repeating the matching process for each part, it is possible to compositely display the portrait image that is theoretically the closest to the captured image.

If the matching key is turned on, the part image of the part designated by the cursor C is read from the part image ROM 30 in step S138. For example, in FIG.
As shown in (B), if the part key is turned on and "nose" is specified, the part image "nose" is read from the part image ROM 30. Next, the number of matching dots between the part image read in step S140 and the image of the part designated by the cursor is counted. For example, if the part key is turned on and "nose" is designated, the image data of "nose" in the captured image read from the input image memory 28 and the "nose" read from the parts image ROM 30 are displayed. The first part image is collated, and the number of coincident dots corresponding to the coincident point of the part image is counted. For example, in FIG.
In the above example, the parts images of “nose” are [01], [0
2], ..., [50] such as 50 types are prepared in advance, so that as the first part image, the one designated by the part image number [01] is read and “ It is collated with the image data of "nose". The number of matching matching dots between the “nose” image data in this image data and the pre-registered “nose” first part image is
Parts image ROM3 corresponding to the first part image of the "nose"
It is stored in the match frequency register within 0.

Next, in step S142, the next part image to be matched (for example, the second part image of "nose").
It is determined whether or not there is. If there is a next part image, the process returns to step S138 and the next (second) "nose" part image (second part image) is read from the part image ROM 30.
Is read, and thereafter, the number of matching dots in the image of the part designated by the cursor and the second part image similarly read in step S140 are counted. For example,
If the part image of the "nose" is being collated, the second part image designated by the part image number [02] is read out and collated with the image data of the "nose" in the captured image. The matching match dot number of the “nose” image data in this image data and the second part image of the “nose” registered in advance is the matching frequency in the part image ROM 30 corresponding to the second part image of the “nose”. Stored in register.

Similarly, by repeating the loop of steps S138 to S142, the image data of the "nose" in the face image stored in the input image memory 28 as the portrait image object and the part image ROM 30 are registered in advance. The matching process of each "nose" part with each part image is sequentially repeated, and the number of matching match dots for each part is stored in the matching frequency register corresponding to each part image. Then, when the matching process with all the "nose" part images is completed, it is determined in step S142 that there is no next part image, the determination result is NO, and step S
It branches to 144. In step S144, the parts images are ranked according to the number of matching dots. That is, based on the number of matching dots matched with the “nose” image data stored in the matching frequency register corresponding to each part image,
A rank number is given from the highest matching frequency, and the rank numbers are stored in the corresponding rank registers. For example, as for the part image corresponding to "nose" which is one of the face parts, the number of matching matching dots and the order number are stored as shown in FIG. In this case, the number of matching dots =
[25] is the rank = [1], and the following is the number of matching matching dots =
[20] is stored in the corresponding rank register with a rank number from the highest matching frequency, such as rank = [2] ,.

Next, in step S146, the coordinates of the designated part are stored in the corresponding part area of the work RAM 32. Next, in step S148, it is determined whether or not the above matching and ranking processing has been completed for all the parts. The above is the matching and ranking process for the part image corresponding to one of the face parts, "nose", as an example. When the "nose" ends, the next moves to the "mouth" and the "mouth" image. The matching process with all "mouth" part images for the data and the ranking process of the matching frequency are executed. If the matching process and the matching frequency ranking process have not been completed for all parts, the process returns to step S124 to repeat the above loop. When the matching process and the matching frequency ranking process as described above are completed for all parts, the process proceeds to step S150. In this way, the matching process and the matching frequency ranking process are all repeated for each part, so that the parts image is compared with the image data of all parts of the face image data stored in the input image memory 28. All the part images stored in the ROM 30 are collated for each part, and the matching frequency is ranked.

In step S150, the montage image is displayed on the first display section 11 by the parts image of the highest rank.
That is, when the order register of the face image data of each part image is stored in the order register of each part of the part image ROM 30, the highest of each part (contour, hair, right eye, ... Mouth) is stored. The part images of the order are read from the part image ROM 30, and the image data of all the parts of the face image data stored in the input image memory 28 are first compared with the face image data stored in the part image ROM 30. A montage image is displayed on the first display unit 11 as a portrait image approximated at the first stage. That is, when the operator operates the image input key of the input switch unit 12 and the face image data of the portrait image target person input to the CPU 21 via the image data input unit 23 is stored in the input image memory 28, this face is stored. Each part (outline, hair, right eye, left eye, ...
・ Mouth) The part image most similar to each part image is the part image ROM based on the above image matching processing.
It is automatically read out from 31 and is combined and displayed on the first display unit 11.

When it is desired to correct or change the portrait image while the portrait image most approximate to the face image data of the portrait image target person is displayed on the first display unit 11, the input switch is pressed. The correction key of the section 12 is operated. This process is executed after step S152.
That is, it is determined whether or not the correction key of the input switch unit 12 is turned on in step S152. This is what will be manipulated when modifying the first montage as the next step. If the correction key is on, step S1
54. On the other hand, if the correction key is not turned on, it is determined that a sufficient montage image can be created at this stage,
In step S168, it is determined whether the registration key is turned on.

Although the above-mentioned portrait image is displayed on the first display portion 11, when the correction key is operated, the name of the part (contour, hair, right eye, left eye, ... .. (mouth) may be displayed. In that case, for example, the contour is initially set, and each time the correction key is operated, the display is changed to "hair" → "right eye" → "left eye" → ... In step S154, it is determined whether or not the part key is turned on. This is to determine the corrected portion. If the part key is not turned on, the process jumps to step S168. If the part key is turned on, the process advances to step S156 to display the cursor on the part of the part corresponding to the selected part. Thereby, the operator can confirm the designation of the corrected portion on the screen of the first display unit 11. Next, in step S158, it is determined whether or not the selection key (Δ ▽ key) of the input switch unit 12 is turned on. If the selection key is on, step S1
Proceeding to step 60, the next-ranked part is read out from the part image ROM 30 and is displayed in place of the part currently shown.
As a result, a differently shaped part image is displayed at the position of the selected part.

Here, for example, when the part image nose to be corrected is selected and displayed by pressing the part key and the part image selection key (up key) is operated, a plurality of nose parts in the part image ROM 30 are selected. Based on the image collation order stored in the order register corresponding to the image, the nose part image of the second order is designated and read out, and is replaced with the nose part image of the first order in the currently displayed portrait image to be synthesized and displayed. In this case, the part image designated as the correction target is replaced and corrected with the part image of the next rank every time the part image selection key (△ key for up) is operated.
Also, every time the parts image selection key (down key for down) is operated, the parts image of the previous order is replaced and corrected. On the other hand, if the selection key is not turned on, the process jumps to step S160 and proceeds to step S162. At this time, the shape of the part image of the selected part does not change.

Then, in step S162, it is determined whether or not the position correction key of the input switch section 12 is turned on. If the position correction key is turned on, the process proceeds to step S164 to move the part display position. Then, step S166.
The coordinates stored in the area of the corresponding portion of the work RAM 32 are changed with. Thereby, for example, when “nose” is selected as the part, the position of “nose” is moved and displayed on the first display unit 11. Then, step S16
Go to 8. On the other hand, if the position correction key is not turned on, the process skips steps S164 and S166 and proceeds to step S168. In step S168, it is determined whether or not the registration key of the input switch unit 12 is turned on. If the registration key is not turned on, the process returns to step S154 and the same loop is repeated. For example, the shape and position of parts other than the "nose" are corrected as necessary. When the correction is completed and the registration key is turned on, step S
Proceeding to 170, the corrected image is recorded in the work RAM 32. Then, the process returns to the first step S100.

As described above, the operator designates an arbitrary part to be corrected with respect to the portrait image displayed on the first display section 11 and replaces the part image with a desired part image or moves the position. For example, when the registration key is operated with the portrait image corrected, the numbers of the respective part images forming the portrait image in the current display state are written and registered in the work RAM 32 as portrait image data. Therefore, thereafter, by designating the personal data, the portrait image data can be read from the work RAM 32 and displayed on the first display unit 11. In that case, for example, when the front face portrait image data is read, a montage image as shown in FIG. 10A is obtained. When the face orientation is changed and the portrait image data on the right side is read, a montage image as shown in FIG. 10B is obtained. Further, when the print key is operated after the portrait image data is registered in the work RAM 32, each corresponding portrait image parts image is read from the parts image ROM 30 in accordance with the registered portrait image data,
The portrait image data obtained by combining these portrait image part images is sent to the print drive unit 25. Therefore, the portrait image corresponding to this portrait image data is printed by the printing unit 26.
Thus, the label tape 4 is printed.

As described above, in this embodiment, the image data of the face is picked up and read by the CCD camera unit 2, the read face image data is temporarily stored in the input image memory 28, and the face image data is stored from the stored face image data. A partial image is extracted for each part, the orientation data of the extracted partial image and the position data for each part are stored in the work RAM 32, and each part of the face is previously stored in the parts image ROM 30 such as hair, eyes, nose, mouth, etc. A plurality of types of part images are stored separately for each part, and the part data corresponding to the partial image stored in the work RAM 32 and each part of the face stored in the part image ROM 30 are stored. It compares and collates multiple types of parts images, ranks the matching frequencies, and repeats the matching process for combining each position data for each part. And by, it is performed to synthesize displaying the portrait image that best theoretical approximate the captured image of the CCD camera unit 2. Therefore, when creating a portrait image corresponding to the input captured image of the face (actual face), it does not take time and effort to select each part image, and a portrait image more closely resembling the actual one can be easily created. be able to.

Next, FIGS. 11 to 16 are views showing a second embodiment of the face image forming apparatus and the face image data storage apparatus according to the present invention. FIG. 11 is a front view of an electronic notebook when the present invention is applied to the electronic notebook. In FIG. 11, the electronic notebook 51 shows a state in which the pair of main bodies 51a and 51b are opened to the left and right respectively. A CCD camera section (input image data reading means) 52 is arranged above the main body 51b of the electronic notebook 51 as in the first embodiment.
A second display section 53 and a data input key 54 are provided below the CCD camera section 52 in the main body 51b of the electronic notebook 51.
Are arranged in sequence. The contents of the second display portion 53 and the data input key 54 are the same as in the case of the first embodiment. The second display section 53 shows the face image 52a captured by the CCD camera section 2. Main body 51 of electronic notebook 51
Although not shown in the figure below b, a printing unit capable of printing a label tape is built in as in the case of the first embodiment.

On the other hand, on the main body 51a of the electronic notebook 51, a first display portion 61, an input switch portion 62, and an on / off key 63 are arranged from the upper side. The contents of the first display portion 61 and the on / off key 63 are the same as in the first embodiment. It should be noted that the first display unit 61 displays on the face image 61 during image processing.
a is shown. The input switch section 62 is the electronic notebook 5
1 is for performing various operations necessary for creating a portrait image of a person, specifically, "personal",
"Start", "Image input", "Display", "End" 5
There are two keys. For these keys, for example, thin sheet type key switches are used. Of each key,
The functions of "individual", "image input", "display" and "end" are the same as in the first embodiment. The "start" key is an operation switch for starting a moving image that moves over time. Although the block diagram showing the configuration of the face image creating apparatus of the second embodiment is similar to that of the above embodiment and is not shown in the figure, the CPU shows moving face images for each face orientation and each face part over time. By sequentially registering in the form of part numbers, position data, etc., it is possible to reconstruct a face image by combining the part images prepared in advance based on the registered part number data etc. Perform processing. Further, the parts image ROM stores the parts image of each part with the contents as shown in FIG. 3 as in the above embodiment.

Next, the operation will be described. First, electronic notebook 5
1 main body 51a, 51b open to the left and right respectively on /
When the off key 63 is pressed, power is supplied to the electronic notebook 51 and the operation starts. After that, by executing the program described later, the personal data is input and the portrait image creation process is performed. FIG. 12 is a flow chart showing a program for portrait image creation processing using the electronic notebook 51 of this embodiment. When this program starts, it is first determined in step S200 whether the display switch is on. The display switch is a display key in the input switch section 62. When the display switch is on,
The first display unit 61 is activated to be able to display an image, and the process proceeds to step S202 to perform the process of selecting and displaying the portrait image that has already been created. If the display switch is not turned on, the process branches to step S204, and a process of creating a portrait image from an actual person image is executed. A. Routine of portrait image selection processing First, the routine of portrait image selection processing will be described.
In step S202, it is determined whether search data has been input. The search data is data for selecting the created portrait image, and is, for example, personal data. If search data has not been input, the process returns to step S200, and if search data has been input, the process proceeds to step S206 and the corresponding data is searched from the personal data in the work RAM by the search data and displayed on the first display unit 61. indicate.

Here, FIG. 13 shows an example of the storage of the work RAM. For example, the facial features of each person corresponding to the personal data of the person are the elapsed time at the time of photographing the face (that is, the first photographing). T1 to Tn, each face image (A) corresponding to each elapsed time T1 to Tn, face image (B) to face image (N), and a part image for each part of the face The number and the position data (parts data) of each part are stored as parameters in predetermined areas. Further, in this case, the part image numbers such as contour, hair, eyes, ... Corresponding to the elapsed times T1 to Tn at the time of imaging are, for example, [50], [02], [50] ,. Thus, the position data of parts such as contours, hairs, eyes, ... Are stored in a predetermined area in this way, for example, [x1, y1], [x2, y2], [x3, y
3], ..., And stored in a predetermined area. [X1, y1], [x2, y2], [x3,
Each value of y3], ... Therefore, when the position is not corrected, the coordinate value is [0,0].

Then, for example, by combining and synthesizing each part image as a face part having the part image number of each part of the face image (A) corresponding to the elapsed time T1 and the position data of each part, One montage picture is created. Therefore, if the input search data is personal data, the corresponding personal data is collated and the matching person's data is selected.
It will be displayed on the display unit 61. For example, the name as personal data: Address A: Phone number: ○ Blood type:
○ Hobby: When any of ○○ is input, the personal data of the person A who is stored in the first area of FIG. 13 is selected and displayed on the first display unit 61 as the corresponding person. .

Next, in step S208, the register T in the CPU 21 which stores the elapsed time during the image pickup of the face (that is, the elapsed time after the first image pickup is started) is cleared to "0", and the flag K is set. Set to "1". The flag K is set when personal data is input, and reset when the end key is pressed. Next, the designated face image data in the area of the work RAM in which the face image (montage image: that is, a portrait image) corresponding to the personal data retrieved in step S210 is stored is read out, and the first display unit 61 is read. To display.
As a result, one of the portrait images already created based on the personal data is picked up and displayed. For example, when the data relating to the human instep as described above is input as the personal data, the elapsed time at the time of imaging corresponding to the instep, the face image, and the part image number for each part of the face are input. , One portrait image based on the position data (parts data) of each part is displayed as an image. Therefore, there are a plurality of portrait images corresponding to the human instep depending on the elapsed time at the time of image capturing, the face direction, etc.
Will be selected and displayed. Next, in step S212, it is determined whether or not the end switch (end key) is turned on. If the end switch is not turned on, the process returns to step S200 and the same loop is repeated. Finally, the desired portrait image corresponding to the search data is displayed on the first display unit 61. When the desired portrait image corresponding to the search data is displayed on the first display unit 61, the process proceeds to step S214, the flag K is reset to "0", and the process returns to step S200.

B. From the routine step S200 of the portrait image creating process, the process branches from step S200 to step S204, and the image data is input in step S204. That is, by turning on the image input key of the input switch unit 62, the face image data of the operator captured by the CCD camera unit 52 as a portrait image target is supplied to the image data input unit 23 as a video signal. As a result, the video signal for one field supplied to the image data input section is converted from the Y / C separation section 23a to digital image data for one screen through the A / D conversion section 23b. Next, in step S216, image data correction is performed.
As a result, with respect to the one-screen face image data converted into digital image data, the extra image data existing in the background portion is erased and corrected. Next, in step S218, the input image data is transferred from the CPU 21 to the input image memory 28, stored in the input image memory 28, and displayed on the second display unit 53. As a result, the face image of the operator captured by the CCD camera unit 52 is displayed on the second display unit 53.

Next, in step S220, it is determined whether or not the start key (start switch) of the input switch section 62 is turned on. If the start key is on, the flag P is set to "1" in step S222. Flag P
Is for starting the operation of capturing the imaged face image of the operator. Further, in the same step S222, the register T in the CPU 21 that stores the elapsed time at the time of imaging is stored.
Is cleared to "0". Then, it progresses to step S224. On the other hand, if the start key is not turned on in step S220, step S222 is jumped to step S222.
Proceed to 224.

In step S224, the elapsed time T during image pickup is
Is determined to be a predetermined maximum value (max) or not. The maximum value (max) regulates the elapsed time at the time of imaging the face to a predetermined value, and is set to a value corresponding to the final elapsed time Tn after the first imaging is started, for example. If the elapsed time T at the time of imaging is not equal to the maximum value (max) in step S224, the process returns to step S100 and the same loop is repeated. As a result, the operator's face image data captured by the CCD camera unit 52 is supplied to the image data input unit 23 as a video signal at regular time intervals and converted into digital image data for one screen.
The corrected image is stored in the input image memory 28, and the image in the meantime is displayed on the second display section 53. And step S
When the elapsed time T at the time of imaging becomes equal to the maximum value (max) in 224, the process proceeds to step S226, the flag P is cleared to "0", and the process returns to step S200. This allows CC
The capture of the operator's face image data captured by the D camera unit 52 ends.

FIG. 14 is a flow chart showing a program for the interrupt 1 processing. This program displays montage images that move over time,
It is repeated at regular intervals by interruption. When this interrupt routine starts, it is first determined in step S250 whether or not the flag K is set to "1".
Flag K is set when personal data is entered,
Since it is reset when the end key is pressed, if personal data is input, K = 1 and the process proceeds to step S252, and if the end key is pressed, K = 0.
And this routine is finished. Step S252
Then, the elapsed time T of image display is incremented by [1]. Then, in step S254, the elapsed time in the area corresponding to the specified personal data in the work RAM 32 is searched. For example, when data related to the person A is input as personal data, the elapsed time in the area is searched for the person A shown in FIG. Work RAM3
2 stores each data as shown in FIG. 13,
If the data related to the person A is input as personal data, this time, the elapsed time T1 to T
n items will be searched.

Then, in step S256, it is determined whether or not there is the same elapsed time (that is, T1 to Tn) as the elapsed time T of image display. That is, the elapsed time T of image display
Is equal to any of T1 to Tn. If the elapsed time T of image display is equal to any of T1 to Tn, the corresponding face image data is designated in step S258. For example, when the elapsed time T of image display is equal to T1, the face image data corresponding to the elapsed time T1 in the area of the person A shown in FIG. It is sent to the drive unit 25. As a result, the elapsed time T1 for the person A
The portrait image corresponding to is displayed on the second display unit 63.
Further, a portrait image corresponding to the elapsed time T1 of the person A can be printed if necessary. Step S
After 258, the process proceeds to step S260. If the elapsed time T of image display is not equal to any of T1 to Tn in step S256, the process jumps to step S258 and proceeds to step S260.

In step S260, it is determined whether the elapsed time T of image display has reached a predetermined maximum value (max). The maximum value (max) regulates the elapsed time of image display to a predetermined value, and is set to a value corresponding to the final elapsed time Tn shown in FIG. 13, for example. Step S2
If the elapsed time T of image display is not equal to the maximum value (max) at 60, the routine of this time is ended, the routine is repeated waiting for the next interrupt timing. As a result, in the next routine, the face image data corresponding to the elapsed time T2 is designated, taken out by the CPU 21, and sent to the display drive unit 27 or the print drive unit 25.
Then, when the elapsed time T of image display becomes equal to the maximum value (max) in step S260, the process proceeds to step S262, T is returned to "0", the routine of this time is ended, and the next interrupt timing is awaited. Therefore, for example, when the data related to [Name: A] is input as the personal data, the elapsed times T1 to Tn in the area are sequentially searched for the person A shown in FIG. 13 and corresponding to the respective elapsed times T1 to Tn. The image data to be designated is sequentially designated and taken out, and the portrait images corresponding to the person's instep are sequentially displayed on the second display section 63. Further, the portrait images corresponding to the elapsed times T1 to Tn of the human instep can be sequentially printed as needed.

FIG. 15 is a flow chart showing a program for the interrupt 2 processing. This program creates montage images that move over time,
It is repeated at regular intervals by interruption. When this interrupt routine starts, it is first determined in step S300 whether or not the flag P is set to "1".
Since the flag P is for starting the operation of capturing the face image of the operator who has been imaged, when P = 0, this routine is ended and the next interrupt timing is awaited. On the other hand, when P = 1, the process advances to step S302 to correspond to the part image of the face image and the current timer time T
(That is, the measured value of this time) is stored in a predetermined area of the work RAM 32. The timer time T is to measure the elapsed time each time the interrupt routine is executed in order to match the elapsed times T1 to Tn in the area shown in FIG.

Next, in step S303, the timer time T is incremented by [1]. The incremented value [1] is, for example, a value corresponding to the repetition time of this interrupt routine. As a result, in the first routine, T = [1], and the process of creating a face image corresponding to the elapsed time T1 in the area is performed. Next, in step S304, the pointer N designating the face part is set to [1]. Next, in step S306, the Nth part in the image data displayed on the first display unit 61 is designated.
Therefore, at first, the hair contour is designated by the contour of the face corresponding to the pointer N = [1], and thereafter, the pointer N is incremented in step S320 to be described.
The eyes are designated as ... Next, in step S308, the part image and specific coordinates (coordinates of position data) of the N-th part are read from the part image ROM 30.

In the first routine, the part image number (for example, [50]) and position data (for example, [x1, y1] as shown in FIG. 13 corresponding to the pointer N = [1] for the contour of the face. ]) Is read. Next, in step S310, the coordinates corresponding to the specific coordinates in the designated part of the image data are detected. As a result, the current pointer N =
The coordinates of the portion called the contour designated by [1] are detected. Next, in step S312, the coordinates of the part image and the part of the image data are matched, and the number of matching dots is counted. As a result, the current pointer N =
In the routine [1], the number of dots in the portion where the contour part image read from the area of FIG. 13 and the contour image of the image data match is counted.

Then, in step S314, the difference between the number of coincident dots and the coordinates is stored in the work RAM 32. As a result, in the routine of the pointer N = [1] this time, the number of coincident dots between the contour part image and the contour image of the image data and the difference in coordinates corresponding to the difference between each position of the contour part image and the image data are determined. It is stored in the work RAM 32. Next, in step S316, the number (NO.) Of the part image having a large number of matching dots is stored in the work RAM 32. As a result, in the routine of the pointer N = [1] this time, the part image number of the contour most similar to the contour image of the image data is stored in the work RAM 32, and the portion called the contour when creating the portrait image is stored. The part image has been selected.

Next, in step S318, it is determined whether or not the designation of all parts has been completed. If not completed, the process proceeds to step S320, the pointer N is incremented by [1], the process returns to step S306, and the same loop is repeated. Therefore, in the next loop, N = [2] is set and the part called the hairstyle is specified. In the same manner as above, the part image number of the hairstyle most similar to the hairstyle image is stored in the work RAM 32, and the portrait image is displayed. A process of selecting a part image of a part called a hairstyle when creating is performed. Similarly, the part image numbers of the parts most similar to the images of all the parts of the face are stored in the work RAM 32 in the same manner as N = [3] eyes, ...
The process of selecting the part images of all the parts when creating the portrait image is performed.

When the selection of the part images of all the parts is completed, the determination result of step S318 is YES, the interrupt routine is ended, and the next interrupt timing is waited for. Then, in the next interruption routine, in step S302, T = corresponding to the part image of the face image.
[2] is reached, and the processing for creating a face image corresponding to the elapsed time T2 in the area is performed. Thereafter, similarly, each time the interrupt routine is executed, T = [3], T = [4], ... T
= [N] in this order, the elapsed time T2, T3 in the area,
A process of creating each face image corresponding to T4, ... Tn is performed. As described above, in the second embodiment, the moving face image of the operator is captured and sequentially registered in the form of the face orientation, the part number of each part of the face, the position data, etc. as time passes. Then, at the time of reproduction, a part image prepared in advance based on the data such as registered part numbers is combined to be restored as a face image. Therefore, Iwayu moving montage can be reproduced.

For example, as shown in FIG. 16 (A), a moving face image of an operator is captured as a front image, for example, as a front image at a time T1 from the start of image capturing, and the orientation of the face and the face at that time with respect to the captured image. The part number, position data, etc. for each part are obtained and registered together with the elapsed time T1. Similarly, when the elapsed time T2 has elapsed from the start of imaging, a moving face image of the operator is captured, for example, as a front image, and the orientation of the face at that time with respect to the captured image, the part number of each part of the face, position data, and the like are displayed. It is obtained and registered together with the elapsed time T2. Further, at the elapsed time T3, a moving face image of the operator is captured, for example, as a front image, and the orientation of the face at that time with respect to the captured image, the part number of each part of the face, position data, and the like are obtained. It is registered together with the elapsed time T3. When the operator turns sideways, for example, it is captured as a side image, and the face orientation at that time with respect to the captured image, the part number for each part of the face, position data, etc. are obtained in the same manner. It is registered together with the elapsed time Tx.

On the other hand, when the montage image is reproduced, the orientation of the registered face corresponding to the elapsed time from the start of image capturing for the first time T1 is corresponded to the work RAM 32 such as the part number of each part of the face and the position data. The parts images are read out from the area to be combined, and the parts images are combined to be restored as a front montage image as shown in FIG. Thereafter, similarly, the registered face orientation corresponding to the elapsed time T2, the part number of each part of the face, the position data, etc. are read from the corresponding area of the work RAM 32 and the part images are combined, It is restored as a front montage image as shown in FIG. When the elapsed time is T3, the corresponding registered face orientation,
The work number such as the part number and position data for each face part
The parts images are read out from the corresponding areas of the AM 32, combined, and restored as a front montage image as shown in FIG. Therefore, the moving face image of the operator is restored by combining the parts images prepared in advance based on the data such as the registered part numbers and the like over time, and a so-called moving montage image can be reproduced.

As described above, the face image forming apparatus according to the present embodiment reads the input image data reading means for reading the image data of the face and the face image data read by the input image data reading means for each part of the face. Part data storage means for extracting and storing partial images, and at least position data for each part of the extracted partial image, and part image storage means for storing a plurality of types of part images for each part of the face Data comparison means for comparing the partial image of each part stored in the part data storage means with a plurality of types of part images of each part of the face stored in the part image storage means, and this data Based on the comparison result by the comparison means, the part image for each part stored in the part image storage means is stored in the position data storage means. By combining in response to,
And an image synthesizing unit that creates a face image.

As a preferred mode, the input image data reading means includes a time measuring means for measuring the time at which the face image data is read, and the part data storing means is read by the input image data reading means. When a partial image is extracted for each part of the face from the face image data and the partial image is stored, the time at which the face image data measured by the time measuring means is read may be stored together. Good. In addition, the face image creation device,
You may make it further have a means to display or print the face image produced by the said image synthesizing means.

Further, a face image data storage device according to another embodiment is a face image data storage means for storing input face image data, and a plurality of types of part images representing each part of the face. And a part image storage unit for storing the part, each part image stored in the part image storage unit, and each partial image forming the image data stored in the face image data storage unit for each part. And a part storing the part image designation data for designating each corresponding part image when the respective part images correspond to the respective partial images as a result of the comparison by the comparing means. Image designation data storage means,
It is characterized by having. As a preferred mode, each part image designating data stored in the part image designating data storage means is read out and stored in the part image storing means based on the read out part image designating data. It is also possible to provide a synthesizing means for reading out and synthesizing the respective part images, and a display means for displaying a face image composed of the respective part images synthesized by the synthesizing means.

Further, a face image data storage device according to another embodiment includes face image data storage means for storing sequentially input face image data together with time data indicating the time when the face image was input. , A plurality of types of part images representing each part of the face and a part image storage unit that stores the part, and each part image stored in the part image storage unit and the face image data storage unit Comparing means for comparing each partial image constituting the image data being processed for each part, and as a result of the comparison by this comparing means, when the respective part images correspond to the respective partial images, the corresponding respective And a part image designation data storage unit for storing the part image designation data for designating a part image together with the time data. As a preferred aspect, each part image designating data and time data stored in the part image designating data storage means are read out and stored in the part image storage means based on the read out each part image designating data. A synthesizing means for sequentially reading and synthesizing each of the part images being displayed in accordance with the time indicated by the read time data; and a display means for displaying a face image composed of the respective part images sequentially synthesized by the synthesizing means. , May be provided.

According to this embodiment having such a configuration, the image data of the face is input and read by the input image data reading means (for example, the CCD camera section), and each face part is read from the read face image data. The partial image is extracted and stored in, and at least the position data for each part of the extracted partial image is stored in the parts data storage means. on the other hand,
Each part of the face is divided into parts such as hair, eyes, nose, and mouth in the parts image storage means, and a plurality of types of parts images are stored for each part. The partial images stored in the parts data storage means. And the plurality of types of parts images for each part of the face stored in the parts image storage means are compared by the comparison means, and each part stored in the parts image storage means according to the comparison result. The face image is created by combining the part images of each of the parts corresponding to the position data stored in the part data storage means. Therefore, when creating a portrait image corresponding to the input face image (actual face), it does not take time and effort to select each part image, and it is possible to easily create a portrait image that is closer to the actual product. It will be possible. In another embodiment, the moving face image is registered in order as time passes, for example, the orientation of the face, the part number of each part of the face, the position data, and the like are registered in order. The face images are restored by combining the part images prepared in advance based on the data such as the respective part numbers and positions. Therefore, a so-called moving montage picture can be reproduced.

Further, in another embodiment, the input face image data is not stored as it is, but instead of the input face image data, each part image corresponding to the face image data is designated. The part image designation data (for example, each part image number or each position data) is stored. Therefore, the description capacity of the data used when displaying a face very similar to the input face image is reduced. Further, in another embodiment, a face very similar to the face image input using the part image designation data having an extremely small storage capacity is displayed. Furthermore, in another embodiment, instead of storing the face image data sequentially input as they are, instead of the input face image data, each part image (for example, each part) corresponding to the face image data is stored. The image number or each position data) is stored together with the time data representing the time when the image of the face is input. Therefore,
The description capacity of the data used when displaying faces that are very similar to the sequentially input face images over time becomes extremely small. Furthermore, in another embodiment, the face image very similar to the sequentially input face images is displayed over time by using the part image designating data and the time data having an extremely small storage capacity.

According to the present embodiment, the image data of the face is picked up and read by the input image data reading means, the partial image is extracted and stored for each part of the face from the read face image data, and at least extracted. The position data of each part of the partial image is stored in the part data storage means, and each part of the face is divided into parts such as hair, eyes, nose, and mouth in advance in the part image storage means, and a plurality of parts are stored for each part. Various types of part images are stored, the part data corresponding to the partial image is stored in the part data storage unit, and a plurality of types of part images for each part of the face stored in the part image storage unit are stored. Are compared and collated, and in accordance with the comparison result, the part image for each part stored in the part image storage means is combined in correspondence with the position data stored in the part data storage means to create a face image. Therefore, when creating a portrait image corresponding to the input face image (real face), it does not take time and effort to select each part image, and it is easy to create a portrait image that is closer to the actual product. it can. According to another embodiment, moving face images are sequentially registered in the form of, for example, the orientation of the face, the part number of each part of the face, the position data, etc., in accordance with the passage of time. Part images prepared in advance based on registered part numbers, position data, etc. can be combined and restored as a face image, and so-called moving montage images can be easily reproduced.

Further, according to another embodiment, the input face image data is not stored as it is, but instead of the input face image data, each part image corresponding to the face image data is stored. Since the part image designation data for designating (for example, each part image number or each position data in the above embodiment) is stored, when displaying a face very similar to the input face image. The description capacity of the data used can be made extremely small. According to the invention of claim 5, it is possible to display a face very similar to the face image input using the part image designation data having an extremely small storage capacity. Further, according to another embodiment, instead of storing the face image data sequentially input as they are, instead of the input face image data, each part image corresponding to the face image data (for example, In the above embodiment, each part image number or each position data) is stored together with the time data representing the time when the face image is input. The description capacity of data used when displaying over time can be made extremely small. Further, according to another embodiment, it is possible to display a face very similar to a sequentially input face image with the lapse of time by using the part image designating data and the time data having an extremely small storage capacity.

[0076]

According to the present invention, in creating a portrait image corresponding to a face image (for example, a real face image),
Each part image corresponding to the image part of each part of the face image that is the target of the portrait image is automatically arranged, and a first portrait image is created by combining the arranged part images, and thereafter, At least one part image of each part image of the first portrait image is replaced with another part image, and the second part image is combined with the replaced part image and the part image that has not been replaced.
It is supposed to create a portrait image of. On the other hand, this
Of the created second portrait image and the second portrait image
For the individual corresponding to the face image matched for creation,
The data to be displayed is associated and displayed.
It Therefore, unlike the conventional case, it does not take time and effort to select each part image, and it is not only possible to easily and quickly create a caricature image that more closely resembles a real face, but also the first created image . 2 portrait images and the second
Of the face images matched to create the caricature image of
Data about the responding individual (eg name, address, phone)
Number, age) can be displayed in association with each other .
What kind of caricature image is a caricature image, and its caricature
What kind of person is the target of the pictorial image?
It is possible to quickly and surely confirm whether or not it is .

[Brief description of drawings]

FIG. 1 is a front view of a first embodiment of an electronic notebook to which a face image creating apparatus and a face image creating method according to the present invention are applied.

FIG. 2 is a block diagram showing a configuration of a face image creating apparatus of the embodiment.

FIG. 3 is a diagram showing an example of a part image of each part of the face stored in a part image ROM of the embodiment.

FIG. 4 is a diagram showing a matching match dot number and a rank number of a part image of the embodiment.

FIG. 5 is a flow chart showing a processing program for inputting / registering personal data according to the embodiment.

FIG. 6 is a flowchart showing a part of a program for portrait image creation processing of the embodiment.

FIG. 7 is a flowchart showing a part of a program for portrait image creation processing of the embodiment.

FIG. 8 is a diagram showing an example of stored contents of a work RAM of the same embodiment.

FIG. 9 is a diagram showing an example of a face image of the same embodiment.

FIG. 10 is a diagram showing an example of a face image of the same embodiment.

FIG. 11 is a front view of a second embodiment of an electronic notebook to which the face image creating device and the face image creating method according to the present invention are applied.

FIG. 12 is a flowchart showing a program of portrait image creation processing of the embodiment.

FIG. 13 is a diagram showing an example of stored contents of a work RAM of the same embodiment.

FIG. 14 is a flowchart showing a program for interrupt 1 processing of the same embodiment.

FIG. 15 is a flowchart showing a program for an interrupt 2 process of the same embodiment.

FIG. 16 is a diagram showing an example of a face image of the embodiment.

[Explanation of symbols]

1, 51 Electronic notebook 2, 52 CCD camera section (face image acquisition means) 3, 53 Second display section 4 Data input key 11 First display section 12 Input switch section 13 On / off key 14 Site key 21 CPU 21 Key input section 23 Image Data Input Unit (Face Image Acquisition Unit) 24 Image Matching Unit (Verification Unit) 26 Printing Unit 28 Input Image Memory (Face Image Storage Unit) 29 Basic Position Memory 30 Parts Image ROM (Parts Storage Unit, Second Storage Unit) ) 31 ROM 32 Work RAM (parts storage means, first storage means)

Continuation of the front page (56) Reference JP-A-5-28237 (JP, A) Mitsuo Shiono, Satoshi Takeda, Tomohiko Murayama, portrait drawing system from facial images, Journal of the Television Society of Japan, Japan Television Society, December 20, 1988, Vol. 42 No. 12, p1380-1386 (58) Fields investigated (Int.Cl. ⁷ , DB name) G06T 11/60-13/00 G06F 17/30

Claims (16)

(57) [Claims] 1. A face image storage unit for storing a face image, and a face image stored in the face image storage unit.
Personal data storage means for storing data relating to an individual, parts image storage means for storing a plurality of types of parts images for each part of the face such as hair, eyes, nose, mouth, etc., and this parts image storage means Collating means for collating a plurality of types of part images stored in the face image with the image portion of each part of the face image stored in the face image storing means, and a collating means according to the collating result by the collating means. A first portrait creation unit that creates a first portrait image corresponding to the face image by combining the part images for each part stored in the parts image storage unit; and the first portrait creation unit. Replace at least a part of the part images of each of the part images forming the first portrait image created by the above with another part image stored in the part image storage means, and perform the replacement. It was combined with the part image that have not been replaced by other parts image, and the second portrait creation means for creating a second portrait image, a second portrait created by the second image editing means
Matched to create the picture image and the second portrait image
Corresponds with the data related to the individual corresponding to the face image
And a display control means for controlling so that the portrait is displayed . 2. A face image storing means for storing a face image and a face image stored in the face image storing means.
Personal data storage means for storing data relating to an individual, and parts image storage means for storing a plurality of types of parts images having different shapes for each part such as hair, eyes, nose, mouth, etc., which constitute each part of the face, Of the face images stored in the face image storage means, at least partial images corresponding to the eyes, nose, and mouth, and at least the same parts of the eyes, nose, and mouth are stored in the parts image storage means. The matching means for matching the plurality of types of part images and determining the degree of matching, and the result of the matching by the matching means, the part image having the highest degree of matching among the plurality of types of part images First portrait drawing means for creating a portrait image corresponding to the face image by combining the read part images of each part, which is read from the part image storage means, and the first portrait image Of each part image forming the first portrait image created by the creating means, at least a part of the part images is replaced with another part image stored in the part image storing means, and the replaced part image is replaced. by combining the part images that have not been replaced by part image, and the second portrait creation means for creating a second portrait image, a second portrait created by the second image editing means
Matched to create the picture image and the second portrait image
Corresponds with the data related to the individual corresponding to the face image
And a display control means for controlling so that the portrait is displayed . 3. A face image storing means for storing a face image and a face image stored in the face image storing means.
And personal data storing means for storing data relating to individual stores the face image storing unit image portions extracted and from the stored face images for each face part in, for each site of this extracted image portion First storage means for storing position data, second storage means for storing a plurality of types of parts images for each part of the face, and a plurality of types of parts stored in the second storage means A collation unit that collates the image with the image portion of each part of the face image stored in the face image storage unit, and stores the collation unit in the second storage unit based on the collation result by the collation unit. The parts images of the respective parts thus arranged are respectively arranged at the positions corresponding to the position data stored in the first storage means, and the parts images of the respective parts thus arranged are combined to correspond to the face image. Caricature image And at least a part of the part images constituting each of the first portrait images created by the first portrait image creating means in the part image storage means. Second portrait creation means for creating a second portrait image by replacing the stored other part image and combining the replaced other part image and the non-replaced part image . Second portrait created by the portrait creation means
Matched to create the picture image and the second portrait image
Corresponds with the data related to the individual corresponding to the face image
And a display control means for controlling so that the face image is created. 4. A face image storage means for storing a face image and a face image stored in the face image storage means.
Personal data storage means for storing data related to an individual, parts storage means for storing a plurality of parts images representing face components for each part, and each part of a face from a face image targeted for a portrait image Extraction means for extracting an image portion, and the image portion extracted by this extraction means and the part image stored in the parts storage means are collated for each part, and a plurality of parts stored in the parts storage means are collated. Of the part images, a selecting means for selecting a part image that is closest to the image portion extracted by the extracting means, and a part image selected by the selecting means, for each part, in the extracted image portion. Display position adjusting means for adjusting the display position of the parts image so that the parts image is displayed at a corresponding position, and parts for each part displayed by the display position adjusting means At least one of first display control means for displaying a first portrait image composed of a combination of images, and at least part images constituting the first portrait image displayed by the control of the first display control means. A part of the part image is replaced with another part image stored in the part image storage means, and the replaced other part image and the part image not replaced are combined to create a second portrait image. a second composite picture editing means, the second portrait created by the second image editing means
Matched to create the picture image and the second portrait image
Corresponds with the data related to the individual corresponding to the face image
And a display control means for controlling so that the face image is created. 5. A face image storage means for storing a face image, and a face image stored in the face image storage means.
Personal data storage means for storing data relating to an individual, and parts image storage means for storing a plurality of types of parts images having different shapes for each part such as hair, eyes, nose, mouth, etc., which constitute each part of the face, Individual extraction means for individually extracting image portions corresponding to at least eyes, nose, and mouth from the face images stored in the face image storage means for each part, and at least eyes extracted by the individual extraction means, nose,
Collating means for collating the image portion corresponding to the mouth with a plurality of types of part images stored in the part image storage means for each part, and as a result of collation by this collating means, parts having a high degree of coincidence for each part An image is read from the part image storage means for each part, and the read part images for each part are combined to create a portrait image corresponding to the face image. Of at least a part of the part images constituting the first portrait image created by the portrait image creating means, the other part images stored in the part image storing means are replaced with each other. and in combination with other parts images that have not been replaced by part image, and the second portrait creation means for creating a second portrait image, the second image editing hand Second portrait created by
Matched to create the picture image and the second portrait image
Corresponds with the data related to the individual corresponding to the face image
And a display control means for controlling so that the face image is created. 6. The portrait creation device according to claim 1, further comprising output means for displaying or printing out at least one of the face image and the portrait image. Face image creation device. 7. The face image creation device according to claim 1, further comprising an image acquisition unit that acquires the face image, wherein the face image storage unit is acquired by the image acquisition unit. A face image creating apparatus, comprising: a storage unit that stores the face image. 8. The face image creating apparatus according to claim 7, wherein the image acquiring unit is any one of a CCD camera, a video camera, an image scanner, an electronic still camera, and another device. Image creation device 9. A face image storage means for storing a face image and a parts image storage means for storing a plurality of types of parts images for each part of the face such as hair, eyes, nose, mouth, etc. are accessed. A collating step of collating the plural types of part images stored in the part image storage means with the image portion of each part of the face image stored in the face image storage means for each part; A first portrait creation step of creating a first portrait image corresponding to the face image by combining the part images for each part stored in the part image storage means according to the matching result by Another part image in which at least a part of the part images constituting the first portrait image created by the first portrait drawing step is stored in the part image storage means. And replacing, by combining the part images that have not been replaced by the replaced other part image, and the second composite picture editing step of creating a second portrait image, created by the second image editing step Second
Collate to create a portrait image and the second portrait image
The data related to the individual corresponding to the face image
And a display control step of performing control so that the portrait is displayed corresponding to the portrait creation control method. 10. A face image storage means for storing a face image and a part image storage for storing a plurality of types of parts images having different shapes for respective parts such as hair, eyes, nose, mouth, etc. which constitute each part of the face. Means, and of the face image stored in the face image storage means, at least an image portion corresponding to the eyes, nose, and mouth, and the part image at least at the same portions as the eyes, nose, and mouth. A collation step of collating a plurality of types of part images stored in the storage means and determining the degree of coincidence, and a result of the collation by this collating step, the part image having the highest degree of coincidence among the plurality of types of part images. Is read from the part image storage means for each part, and the read part images for each part are combined to create a portrait image corresponding to the face image. Replacing at least some of the part images of each of the part images forming the first portrait image created by the first portrait creating step with another part image stored in the part image storage means. , A second portrait drawing step of creating a second portrait image by combining the replaced other part image and the non-replaced part image, and the second portrait drawing step created by the second portrait drawing step . of
Collate to create a portrait image and the second portrait image
The data related to the individual corresponding to the face image
And a display control step of performing control so that the portrait is displayed corresponding to the portrait creation control method. 11. A first part for extracting and storing an image part for each part of the face from the face image stored in the face image storing means, and storing position data for each part of the extracted image part. The storage means and the second storage means that stores a plurality of types of part images for each part of the face are accessed, and the plurality of types of part images and the face image stored in the second storage means are accessed. The collation step of collating the image portion of each part of the face image stored in the storage means for each part, and the second step based on the collation result of this collating step.
The part images for each part stored in the storage means are respectively arranged at positions corresponding to the position data stored in the first storage means, and the part images for each arranged part are combined, A first portrait drawing step of creating a portrait image corresponding to a face image, and at least a part image of each of the part images constituting the first portrait image created by the first portrait drawing step Is replaced with another part image stored in the part image storage means, and the replaced other part image and the non-replaced part image are combined to create a second portrait image. The creation step and the second portrait created by the second portrait creation step
Collate to create a portrait image and the second portrait image
The data related to the individual corresponding to the face image
A face image creation control method , comprising: a display control step of controlling the display according to the response . 12. An extraction step of extracting an image portion representing each part of a face from a face image which is a target of a portrait image, and the image portion extracted by the extraction step and the face image stored in the parts storage means. A selection step of comparing each of the plurality of part images of each part with a part image most approximate to the image part extracted by the extraction step among the plurality of part images stored in the part storage means. And a display position adjusting step of adjusting the display position of the part image so that the part image selected by this selecting step is displayed at a position corresponding to the extracted image part for each part, A first display control step for displaying a first portrait image composed of a combination of parts images for each part displayed by the position adjusting step. And at least some of the part images constituting each of the first portrait images displayed by the control of the first display control step are stored in the part image storing step. replaced by part image, created by combining the part images that have not been replaced by the replaced other part image, and the second composite picture editing step of creating a second portrait image, this second portrait preparation step The second
Collate to create a portrait image and the second portrait image
The data related to the individual corresponding to the face image
A face image creation control method , comprising: a display control step of controlling the display according to the response . 13. An individual extraction step of individually extracting, for each part, an image portion corresponding to at least eyes, nose, and mouth from the face images stored in the image storage means, and the individual extraction step. At least the eyes,
A collation step of collating the image parts corresponding to the nose and mouth with a plurality of types of part images stored in the part image storage means for each part, and the result of the collation by this collating step is that the parts have a high degree of coincidence. A first portrait creation step of creating a portrait image corresponding to the face image by reading out a part image for each part from the part image storage means and combining the read part images for each part. At least a part of the part images constituting the first portrait image created by the first portrait creating step is replaced with another part image stored in the part image storage means, and this replacement is performed. It was a combination of the parts images that have not been replaced with other parts image, and the second of the portrait creating step of creating a second portrait image, this Second created by the second image editing step
Collate to create a portrait image and the second portrait image
The data related to the individual corresponding to the face image
A face image creation control method , comprising: a display control step of controlling the display according to the response . 14. The portrait creation control method according to claim 9, further comprising an output step of displaying or printing out at least one of the face image and the portrait image. Face image creation control method. 15. The face image creation control method according to claim 9, further comprising an image acquisition step of acquiring the face image, wherein the face image storage means acquires the image by the image acquisition step. A face image creation control method comprising: a storage unit that stores the generated face image. 16. The face image creation control method according to claim 15, wherein the image acquisition step is any one of a CCD camera, a video camera, an image scanner, an electronic still camera and other devices. A facial image creation control method characterized by the following.