JPH0944643A - Device and method for generating composite face data and displaying composite face image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To comparatively speedily composite the face image of object. SOLUTION: Image data expressing the components (such as eyes and nose) of face are stored in data bases 18a-18n. The face of object is photographed by a camera 11 and any image data expressing the components most approximate to the respective components of the face of object are extracted from the data bases 18a-18n. The selected components are arranged at the same positions as the components of the face of object and displayed on a display device 23 while using a console 21. Identification data of components and data showing display positions are stored in a card cd. By reading the identification data and display position data out of the card cd, the image expressing the face of object can be reproduced and the owner of card cd can be confirmed.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and method for combining and displaying a plurality of constituent elements to display and synthesize a face image, and an apparatus and method for generating face-synthesized data for such combined display.

[0002]

BACKGROUND OF THE INVENTION In many cases, such as credit cards and ID cards, a photograph of the owner of the card is attached to prevent misuse of the card. By attaching the photograph of the owner of the card to the card, it is possible to prevent anyone other than the owner from using the card. However, if the photograph attached to the card is replaced, it becomes difficult to identify the true owner, and misuse of the card may occur.

For this purpose, the image representing the face of the card holder is converted into data and magnetically recorded on the card, and the image converted into data is displayed on a display device when the card is used, so that the card user can use the card. There is a system to confirm that you are the true owner. However, in such a system, since all the images showing the face of the owner of the card are converted into data and recorded on the card, the amount of data becomes relatively large. Since it takes a relatively long time to process the data, it is relatively difficult to quickly reproduce the face of the owner of the card.

[0004]

DISCLOSURE OF THE INVENTION An object of the present invention is to make it possible to synthesize a face image of a subject relatively quickly.

A face image configuration display device according to the first invention is
Face component image data storing means for storing a plurality of face component image data representing face components for each type of component having different characteristics, a face representing a face image by photographing a face of a subject Image capturing means for outputting image data, face component image data extracting means for extracting component image data representing face components of the subject from face image data output from the image capturing means, face component image data extraction Comparing the extracted constituent element represented by the constituent element image data extracted by the means with the constituent element stored in the face constituent image data storage means and of a type corresponding to the extracted constituent element;
Selective output for selecting and outputting face component image data representing a component closest to the extracted component among the components represented by the face component image data stored in the face component image data storage means. Means, a display device for displaying a selected face constituent represented by the face constituent image data output from the selection output means,
And a display position adjusting means for adjusting the display position of the selected face constituent element so that the selected face constituent element displayed on the display device is displayed at a desired position for each type. .

The first invention also provides a method suitable for a face image configuration display device. In other words, face component image data representing face components are stored for each of a plurality of components having different characteristics, a face of a subject is photographed, and face image data representing a face image is stored. Extraction component represented by the component image data extracted by the face component image data extraction process by extracting component image data representing the component of the face of the subject from the face image data obtained by the photographing And a component stored in advance that is of a type corresponding to the extracted component and compared to the extracted component among the components represented by the face component image data stored in advance. A face component image which is output by selecting and outputting face component image data representing a similar component The selected face constituent represented by the data is displayed, and the display position of the selected face constituent is adjusted so that the selected face constituent displayed on the display device is displayed at a desired position for each type. Characterize.

According to the first aspect of the invention, face component image data representing face components is stored in advance for each type of component. When a face of a subject is photographed, face component image data representing face components is extracted from face image data representing the face of the subject. The component represented by the extracted face component image data and the component represented by the face component image data stored in advance are compared for each component of the same type, and the face representing the most approximate component is compared. The component image data is selected from the stored face component image data and output. The components represented by the output face component image data are displayed and their positions are adjusted. The face of the subject can be displayed based on the face component image data stored in advance.

In the above, in addition to the selected face component, the face of the subject obtained by photographing may be represented. This makes it possible to compare the actual face of the subject with the face image obtained based on the face component image data stored in advance.

Further, in the above, in addition to the face component image data representing the component closest to the extracted component, the selective output process represents another component of the same type that is similar to the extracted component. The face component image code is selected and output, and the display position adjustment process is performed by selecting a desired component from the components of the same type displayed on the display device and selecting the selected component. The display may be adjusted so as to be displayed at a desired position.

This makes it possible to bring the face of the subject or the image of the subject closer to the face of the actual subject when constructing the image of the face.

It is preferable that an identification code representing the face component image data output by the selective output process and a display position code representing the display position adjusted by the display position adjusting process are stored in a storage medium. As a result, the image of the face of the subject can be reproduced by reading the identification data and the display position data stored in the storage medium.

A device for performing such reproduction specifically represents a face constituent element, and the face constituent image data identified by the face constituent identification code is divided into a plurality of constituent elements having different characteristics. Face component image data storage means for storing each type, face component image data in which the face component identification code is stored for each face component and identified by the stored face component identification code From the storage medium in which the display position code indicating the display position of the face component represented by
Reading means for reading the face constituent identification data and the display position data, face constituent image data corresponding to the face constituent identification code read from the storage medium by the reading means, the face constituent image data storage means The face constituent image data selecting means selectively read from the face constituent element and the face constituent element represented by the face constituent image data selecting means are displayed at the position specified by the display position code read by the reading means. A display control means is provided.

From the point of view of the method, face component image data representing face components and identified by a face component identification code are stored for each type of component having different characteristics. The face component identification code is stored for each face component, and a display indicating the display position of the face component represented by the face component image data specified by the stored face component identification code is displayed. Face component element image data corresponding to the face component identification code read from the storage medium by reading the face component identification data and the display position data from a storage medium storing a position code. Is selectively read from the face component image data stored in advance, and the face component image data selection processing is performed. The I and the face components, and displaying the position specified by the display position code read by said reading process.

According to the present invention, the face component identification data and the display position data are stored in the storage medium. When the face component identification data and the display position data are read from the storage medium, an image representing the face is reproduced and displayed based on these data.

Such an indication may be a credit card, I
It is used to confirm the identity of the person using the D card. For example, a magnetic stripe is attached to a credit card, an ID card, etc., and the face component identification data and the display position data are recorded on the magnetic stripe. When these data are read, the credit card,
The face of the true owner such as an ID card is displayed, and the owner can be confirmed. Since the card user and the owner can be checked when the card is used, misuse of the card can be prevented.

[0016] The face of the owner of the storage medium can be confirmed without attaching a photograph to the storage medium. Further, not all the images of the owner's face are converted into data and stored in the storage medium, but only the face component identification data and the display position data are stored in the storage medium, so the amount of data to be stored is small. Complete.

[0017]

DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 shows an embodiment of the present invention and is a block diagram showing an electrical configuration of a face synthesis data creating apparatus.

The face-synthesized-data creating apparatus shown in FIG. 1 stores face-component image data representing face components (eyes, eyebrows, nose, mouth, etc.) in advance for each component, and captures it by photographing. The face component image data representing the face component most approximate to the obtained face image of the subject is selected from the face component image data stored in advance, and is displayed by the selected face component image data. The image of the face composed of the respective constituent elements is created and displayed on the display device. The face-synthesized-data creating apparatus shown in FIG. 1 can also record data representing a face image displayed on the display device in the card cd. The face image can be reproduced by reading the data from the card cd in which the data representing the face image is recorded.

The face-synthesized-data creating apparatus shown in FIG. 1 is provided with a component bank 17 for storing face-component image data representing face components. The component bank 17 is provided with a plurality of databases 18a-18n. In each of the plurality of databases 18a to 18n, one type of facial component is assigned to each database, and a plurality of components having different characteristics are stored. Each component is specified by the identification data. The first data base 18a stores a large number of image data representing the eyebrows among the facial components (see FIG. 2A). The second data base 18b stores a large number of image data representing the eyes among the facial components (FIG. 2 (B)).
reference). The other data bases 18c to 18n also store a large number of image data having different characteristics for each face constituent.

In the face synthesizing data creating apparatus shown in FIG. 1, when an image representing the face of a subject is to be displayed on the display device, first, the face of the subject is photographed by the video camera 11. By this photographing, an analog video signal representing the face of the subject is output from the video camera 11 and given to the analog / digital conversion circuit 12. Analog / digital conversion processing is performed in the analog / digital conversion circuit 12, and digital image data representing the face of the subject is output. This digital image data is given to the contour extracting circuit 13 and the image layout determining circuit 20.

The contour extraction circuit 13 is a circuit for extracting image data representing the face of the subject from the image data supplied from the analog / digital conversion circuit 12 and outputting the image data. The contour extracting circuit 13 can be configured by using, for example, a differentiating circuit. The image data representing the face of the subject detected by the contour extraction circuit 13 is given to the face center determination circuit 14 and the component extraction circuit 15.

The face center determining circuit 14 is a circuit for determining the center position of the face of the subject extracted by the contour extracting circuit 13. The center position of the face may be the center of gravity of the image representing the face, or may be on the center line in the left-right direction of the face and slightly above the center of the face in the up-down direction. In any case, since the face has an elliptical shape or a shape close to it, the center position of the face can be determined relatively easily. Data representing the center position of the face is given to the component extraction circuit 15.

The constituent element extracting circuit 15 is a circuit for extracting data representing each constituent element of the face from the data representing the image of the face. The human face is almost symmetrical. Also, the positions of the facial components are almost fixed. For example, the eyes are in the upper part of the face, the nose is in the center of the face, and the mouth is in the lower part of the face. Therefore, if the center of the face is known, the positions of the constituent elements of the face are automatically known. In the face-synthesized-data creating apparatus shown in FIG. 1, data representing the center of the image of the subject obtained by photographing by the face-center determining circuit 14 is given.
It is recognized that the eyes are located diagonally above and to the left of the center of the face image, the nose is near the center, and the mouth is below the center. Based on these recognitions, image data representing each component is extracted in the component extraction circuit 15 and given to the component comparison circuit 16 for each component.

The component comparison circuit 16 reads the image data corresponding to the component represented by the image data supplied from the component extraction circuit 15 from the data bases 18a to 18n together with the identification data, and stores the component bank 17 in the component bank 17. Given through. In the component comparison circuit 16, the image data, which is given from the component extraction circuit 15 and represents the components obtained by photographing, and the components stored in the data bases 18a to 18n, which are given from the component bank 17, are shown. The degree of approximation with the represented image data is compared for each component.

Data representing the result of comparison in the component comparison circuit 16 is applied to the component selection output circuit 19. The component selection output circuit 19 is also supplied with image data representing the components from the component bank 17. The component selection output circuit 19 selects, for each component, the component image data that is the closest to the face component of the subject among the components represented by the component image data given from the component bank 17. Is output. The constituent element image data output from the constituent element selection output circuit 19 is applied to the image layout determination circuit 20.

The image placement determining circuit 20 includes a video camera 11
Image data representing a subject image obtained by photographing using is displayed, the subject image obtained by photographing is displayed on a part of the display screen of the display device 23, and the other of the display screen of the display device 23 is displayed. The image layout is determined so that the subject image generated by the component element image data given from the component element selection output circuit 19 is partially displayed. Display 23
Since two images will be displayed on the display screen of,
The image arrangement determining circuit 20 performs image reduction or enlargement processing as necessary.

The image data output from the image layout determining circuit 20 is applied to the display device 23 and the card writer 22.

FIG. 3 shows an example of the display screen of the display device 23.

As shown in FIG. 3, on the display screen 24, an area 26 for displaying a subject image obtained by shooting with the video camera 11 and the constituent element image data output from the constituent element selection output circuit 19 are displayed. An area 27 for displaying the image represented by is included.

An operation console (keyboard, mouse, etc.) 21 is connected to the image layout determining circuit 20. The operator
Using this operation console 21, adjustment is made so that each constituent element in the image displayed in the area 27 is at a position corresponding to each constituent element in the image obtained by the photographing displayed in the area 26. This makes it possible to obtain an image in which the shape, size, and position of each component match the face image of the subject.

When the image represented by the constituent element image data output from the constituent element selection output circuit 19 matches the image of the subject's face obtained by photographing, as shown in FIG. The identification data representing the most similar component and the data representing its position are
Each component is given to the card writer 22. As a result, the identification data and the data indicating the display position of the component are recorded on the card cd mounted on the card writer 22.

In the above-mentioned embodiment, image data representing the components most approximate to the components of the face of the subject are
Data base 18a determined by using the component comparison circuit 16
Although the image is selected by selecting from 18 to 18n, the operator may determine the component closest to the component of the face of the subject to generate the image representing the face of the subject. In this case, as shown in FIG. 3, a component display area 25 is provided above the display screen 24 of the display device 23, and a plurality of components of the same type are read from the data bases 18a to 18n. Show components in 25. The operator compares the displayed constituent elements with the constituent elements of the image displayed in the area 26 and obtained by photographing, and the operator himself selects the most approximate constituent element. Also in this case, the identification data and the display position data representing the selected component can be recorded in the card cd.

By reading the respective data from the card cd in which the identification data of the components and the data representing the display position are recorded, the image representing the face of the subject can be reproduced and displayed. FIG. 5 is a block diagram showing an electrical configuration of a face image synthesis display device for reproducing such an image. 6 and 7 show an example of a display screen of a display device included in the face image composition display device shown in FIG.

The face image synthesizing display device shown in FIG. 5 reads out the data recorded on the card cd to reproduce and display the face image, and also photographs and displays the face of the subject. It is a device suitable for judging whether the user of the card is a legitimate owner by judging whether they match.

The face image synthesis display device shown in FIG.
A component bank 17 is included as in the face synthesis data creation / display device shown in FIG. Also, in this component bank 17,
A plurality of databases 18a to 18n are attached as in the case of the face-synthesized data creation / display apparatus shown in FIG. These data bases 18a to 18n are the data bases 18a to 18n provided in the face synthesis data creation / display device shown in FIG.
If the same identification data is given, the image data representing the same constituent element is obtained.

When the card cd is attached to the card reader 31, all the data recorded on the card cd are read and given to the data extraction circuit 32. The data extraction circuit 32 extracts the component identification data and the component display position data. The component identification data is given to the component bank 17, and the component display position data is given to the face image creating circuit 33.

When the constituent element identification data is given to the constituent element bank 17, constituent element image data representing constituent elements such as the size and shape of the type specified by the constituent element identification data are stored in the data bases 18a to 18n. Read from. The constituent element image data read from the data bases 18a to 18n is applied to the face image creating circuit 33. In the face image creating circuit 33, the face image is displayed so that the constituent elements represented by the constituent element image data read from the data bases 18a to 18n based on the given constituent element display position data are displayed at predetermined positions. Is created.

Data representing the face image created by the face image creating circuit 33 is applied to the image layout determining circuit 43.

On the other hand, the face of the owner of the card cd is photographed by the video camera 41 as a subject. A video signal representing the face of the subject is output from the video camera 41 and given to the reproduction control circuit 42. The video signal representing the face of the subject is subjected to a predetermined reproduction process in the reproduction control circuit 42 and is given to the image arrangement determination circuit 43.

As shown in FIGS. 6 and 7, the image arrangement determining circuit 43 is a reproduced image represented by the image data provided by the face image creating circuit 33 and a captured image represented by the image data provided by the reproduction control circuit 42. Is a circuit that determines the arrangement of images so that and can be displayed together on the display screen of the display device 44. The image arrangement determining circuit 43 also enlarges or reduces the image as necessary.

The image data output from the image layout determining circuit 43 is applied to the display device 44. As a result, as shown in FIG. 6 or 7, on the display screen 51 of the display device 44, an image obtained by reproducing based on the data recorded on the card cd is displayed in the display area 52, and the display area 53 is displayed. The image actually captured is displayed on. Card c
If the user of d is the owner of the card cd, the reproduced image displayed in the area 52 and the captured image displayed in the area 53 match as shown in FIG. However, if the user of the card cd is not the owner of the card cd, the reproduced image displayed in the area 52 and the captured image displayed in the area 53 do not match as shown in FIG. Therefore, the user of the card cd
You can see if you are the true owner. Since the owner of the card cd can be confirmed without attaching the photograph to the card cd, it is possible to prevent an error such as reattaching the photograph. Further, the image can be reproduced only by recording the component identification data and the component display position data on the card cd, and the amount of data recorded on the card cd can be reduced.

[Brief description of drawings]

FIG. 1 is a block diagram showing an electrical configuration of a face synthesis data creation device.

2A and 2B show components and their identification data stored in a database.

FIG. 3 shows how a face image is constructed.

FIG. 4 shows component identification data and display position data recorded on a card.

FIG. 5 is a block diagram showing an electrical configuration of a face image synthesis display device.

FIG. 6 shows an example of a reproduced image obtained based on data recorded on a card and a photographed image obtained by actual photographing.

FIG. 7 shows an example of a reproduced image obtained based on data recorded on a card and a photographed image obtained by actual photographing.

[Explanation of symbols]

 11, 41 Video camera 15, 19 Component extraction circuit 16 Component comparison circuit 17 Component bank 18a-18n Data base 20,43 Image placement determination circuit 33 Face image creation circuit

Claims (10)

[Claims] 1. A face component image data storage means for storing face component image data representing face components for each of a plurality of components having different characteristics, a face of a subject is photographed, and a face is captured. Means for outputting face image data representing the image of the face, face constituent image data extracting means for extracting constituent image data representing the constituent elements of the face of the subject from the face image data output from the photographing means, and the face An extracted component represented by the component image data extracted by the component image data extraction means and a component stored in the face component image data storage means and of a type corresponding to the extracted component And the extraction among the components represented by the face component image data stored in the face component image data storage means. Selective output means for selecting and outputting face constituent image data representing a constituent closest to the constituent, and a display device for displaying a selected face constituent represented by the facial constituent image data output from the selecting and outputting means. , And display position adjusting means for adjusting the display position of the selected face constituent element so that the selected face constituent element displayed on the display device is displayed at a desired position for each type thereof. apparatus. 2. The face synthesis data creation according to claim 1, wherein the display device displays a face image represented by face image data output from the photographing means in addition to the selected face constituent element. apparatus. 3. The face configuration representing, in addition to the face component image data representing the component closest to the extracted component, the selective output means representing another component of the same type that is similar to the extracted component. Element image data is selected and output, and the display position adjusting means selects a desired component from the same type of components displayed at the display position, and selects the selected component. The face synthesizing data creating apparatus according to claim 1, which is adjusted so as to be displayed at a desired position. 4. A storage control means for storing, in a storage medium, an identification code representing face component image data output from the selective output means and a display position code representing a display position adjusted by the display position adjusting means. The face synthesizing data creating apparatus according to claim 1. 5. Face component image data storage for storing a plurality of face component image data representing face components and identified by a face component identification code, each having a different characteristic for each component type. The face component identification code is stored for each face component, and the display position of the face component represented by the face component image data specified by the stored face component identification code is displayed. A reading means for reading the face component identification data and the display position data from a storage medium in which the display position code is stored, and a face corresponding to the face component identification code read from the storage medium by the reading means. Face component image data selection means for selectively reading component image data from the face component image data storage means, and the above A face image synthesizing display device comprising display control means for displaying a face constituent element represented by the face constituent element image data selecting means at a position specified by the display position code read by the reading means. 6. A face component image data representing a face component is stored by storing a plurality of components having different characteristics for each component type, a face of an object is photographed, and a face representing a face image is captured. Image data is obtained, component image data representing components of the face of the subject is extracted from the face image data obtained by the photographing, and is represented by the component image data extracted by the face component image data extraction processing. The extracted component is compared with the component stored in advance and of a type corresponding to the extracted component, and the extracted component among the components represented by the face component image data stored in advance. Face component which represents the component closest to the element, outputs the face component image data selected and output by the above selection output processing A selected face constituent element represented by image data is displayed, and the display position of the selected face constituent element is adjusted so that the selected face constituent element displayed on the display device is displayed at a desired position for each type. Face synthesis data creation method. 7. The face-synthesized-data creating method according to claim 6, wherein the display processing displays a face image represented by the face image data obtained by the photographing processing in addition to the selected face constituent element. . 8. The face configuration representing, in addition to the face component image data representing the component closest to the extracted component, the selective output process representing another component of the same type similar to the extracted component. Element image data is selected and output, and the display position adjustment process selects a desired component from the same type of components displayed on the display device, and selects the selected component, 7. The face synthesis data creation method according to claim 6, wherein the face synthesis data is adjusted so as to be displayed at a desired position. 9. The storage medium stores an identification code representing face component image data output by the selective output process and a display position code representing a display position adjusted by the display position adjusting process. Method for creating face synthesis data described. 10. A face constituent image data that represents a constituent element of a face and is identified by a face constituent element identification code is stored for each kind of plural constituent elements having different characteristics. An element identification code is stored for each face component, and a display position code representing the display position of the face component represented by the face component image data specified by the stored face component identification code is The face constituent element identification data and the display position data are read from the stored storage medium, and face constituent element image data corresponding to the face constituent element identification code read from the storage medium by the reading process is stored in advance. The face constituent elements represented by the face constituent element image data selection processing are selectively read out from the face constituent element image data A face image composition display method for displaying a pixel at a position specified by the display position code read by the reading process.