JP4254418B2 - Personal authentication apparatus and method, and portable communication terminal - Google Patents

Description

  The present invention relates to a personal authentication apparatus and method using biometric information, and a mobile communication terminal.

  As a means for specifying an individual, a method of detecting physical characteristics, so-called biological information, is known. Physical features include fingerprints, irises, vein distribution, palm shapes / palmprints and faces. For detecting the fingerprint, the feature point (manisha) of the fingerprint is used. An iris radial pattern is used to detect the iris. The size, length, thickness and / or ratio of the hand is used for detecting the palm shape / palmprint. For the detection of the face, the outline of the face, the shape and position of the eyes and nose, etc. are used.

  By using fingerprints and irises, individuals can be identified with high accuracy. Mobile communication terminals incorporating a fingerprint detection function have been put into practical use. In order to detect the iris, a camera for photographing the iris is required. A camera capable of macro photography is required to shoot the radial patterns of the iris to such an extent that they can be separated from each other.

  On the other hand, palm shapes, palm prints, and faces have low accuracy for identifying individuals. In recent mobile phones with a camera, it is only necessary to photograph these physical features with the attached camera, so that the environment is relatively easy to use at present.

For personal authentication, it is necessary to register each person's biometric information in advance. That is, biometric information is photographed, and the photographed image or feature information extracted from the photographed image is stored in a local or remote storage device. In actual authentication, biometric information of the same part is photographed, and the image or feature information extracted from the image is compared with a registered image or feature information.
JP 2000-184448 A JP-T-2001-504964

  There is a great psychological resistance to registering information that can accurately identify an individual such as a fingerprint and an iris in a mobile communication terminal and transmitting it to a remote server or the like. This is because there is a risk of deciphering and leakage, and because of the high accuracy of personal identification, there is a great risk of misuse. Moreover, since a dedicated reader is required for fingerprints and irises, a portable communication terminal or a portable information processing device equipped with the reader is expensive.

  On the other hand, palm shapes / palmprints and faces have relatively low personal characteristic accuracy, and therefore have little psychological resistance to registration and transmission. In addition, since recent camera-equipped mobile phones only need to incorporate software for personal authentication, there is little increase in price due to the provision of this function.

  In this way, in the case of a system for authenticating an individual based on a certain wide range of images, one of the registered image and the captured image is zoomed in advance to match both images, which reduces the authentication accuracy. It is a factor. In addition, the processing burden is heavy. Even when feature information is extracted from an image and an individual is authenticated using the feature information, authentication may fail if the size or inclination of the original image is different.

  It is an object of the present invention to present a personal authentication device and method and a mobile communication terminal that have an improved personal authentication system with a simple configuration.

The personal authentication device according to the present invention includes a marker projection device that projects a plurality of markers indicating a two-dimensional size reference in parallel on a subject that exhibits physical characteristics, and the subject together with the plurality of markers that are projected on the subject. the imaged, an imaging device for outputting an image including a plurality of marker images showing subject image and the plurality of markers, respectively, the object image in accordance with the plurality of marker images, the distance between the plurality of marker images specified value And an image deforming device that deforms so that each marker image has a shape corresponding to the shape of the marker, a storage device that stores an individual-specific image, and a subject image deformed by the image deforming device. And a collation device for collating with the individual specific image stored in the storage device.

The personal authentication device according to the present invention includes a marker projection device that projects a plurality of markers indicating a two-dimensional size reference in parallel on a subject that exhibits physical characteristics, and the subject together with the plurality of markers that are projected on the subject. the imaged, an imaging device for outputting an image including a plurality of marker images showing subject image and the plurality of markers, respectively, the object image in accordance with the plurality of marker images, the distance between the plurality of marker images specified value And an image deformation device that deforms so that each marker image has a shape corresponding to the shape of the marker, a storage device that stores personal identification information, and a subject image deformed by the image deformation device The feature extraction device for extracting the physical feature and the physical feature extracted by the feature extraction device are stored in the storage device. Characterized by comprising a verification device for collating with the personal identification information.

In addition to the matching of physical characteristics, the more deformed the subject image to the image transformation apparatus may be collated with the individual specific image stored in the storage device.

In the personal authentication method according to the present invention, a plurality of markers indicating a two-dimensional size criterion are projected in parallel on a subject indicating physical characteristics, and the subject is imaged together with the plurality of markers projected on the subject. generating an image including a plurality of marker images showing subject image and the plurality of markers, respectively, the subject image image according the plurality of markers images, the distance between the plurality of marker image becomes a predetermined value, and, each as a shape of the marker image corresponds to the shape of the marker, deformed, characterized in that to match the individual specific image a modified the subject images.

In the personal authentication method according to the present invention, a plurality of markers indicating a two-dimensional size criterion are projected in parallel on a subject indicating physical characteristics, and the subject is imaged together with the plurality of markers projected on the subject. generating an image including a plurality of marker images showing subject image and the plurality of markers, respectively, the subject image image according the plurality of markers images, the distance between the plurality of marker image becomes a predetermined value, and, each as a shape of the marker image corresponds to the shape of the marker, the deformed, the deformed the subject image image and extracts the physical characteristics, extracted the physical features to match the personal identification information It is characterized by.

  In addition to the collation of physical features, the subject image deformed according to the marker image may be collated with the personal identification image.

A mobile communication terminal according to the present invention is a mobile communication terminal having a personal authentication function, and a marker projection device that projects a plurality of markers indicating a two-dimensional size reference in parallel on a subject indicating physical characteristics; An imaging device that images the subject together with the plurality of markers projected on the subject, and outputs an image including a subject image and a plurality of marker images respectively indicating the plurality of markers, and the subject image is represented by the plurality of marker images In accordance with the above, the image deformation device that is deformed and the image deformation device are deformed so that the distance between the plurality of marker images becomes a predetermined value and each marker image has a shape corresponding to the shape of the marker . And a collation device for collating the subject image with the individual specific image.

A mobile communication terminal according to the present invention is a mobile communication terminal having a personal authentication function, and a marker projection device that projects a plurality of markers indicating a two-dimensional size reference in parallel on a subject indicating physical characteristics; An imaging device that images the subject together with the plurality of markers projected on the subject, and outputs an image including a subject image and a plurality of marker images respectively indicating the plurality of markers, and the subject image is represented by the plurality of marker images The deformation between the plurality of marker images is a prescribed value, and each of the marker images is deformed so as to have a shape corresponding to the shape of the marker . A feature extraction device that extracts the physical feature from the subject image, and the physical feature extracted by the feature extraction device as personal identification information Characterized by comprising a case matching device.

  As can be easily understood from the above description, according to the present invention, a marker is projected onto a physically characteristic subject, and the image of the subject is deformed according to the image of the marker. Can be matched by size. Thereby, an individual can be authenticated with high accuracy.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 shows a schematic block diagram of an embodiment of the present invention applied to a mobile phone terminal. Here, an example in which a palm shape is used as a physical feature used for personal authentication will be described.

  First, the owner's palm shape is registered. The owner's hand (subject) 12 is held in front of the camera mounted on the portable terminal 10. By a predetermined switch operation, the marker projection device 14 of the mobile terminal 10 projects a plurality of markers 16 and 18 toward the subject 12. The markers 16 and 18 are used as a scale indicating the actual size. The marker projection device 14 projects a plurality of markers toward the subject 12 in parallel. The marker projection device 14 includes, for example, a light source (light emitting diode or laser diode), a collimator lens, and a marker slit. The wavelength of the light source may be any wavelength that can be photographed by the imaging device 20 described later, but if it is visible light, it is convenient for the user to visually confirm the markers 16 and 18 on the subject 12.

  On the subject 12, the shapes of the markers 16 and 18 are generally distorted due to the orientation of the surface of the subject and the curved shape. By projecting the plurality of markers 16 and 18 in parallel, the distance between the markers 16 and 18 on the subject 12 can be used as an absolute reference for the size of the subject.

  Even when a plurality of markers are projected radially, if the distortion of the markers on the subject is small, the size of each marker can be used as an absolute reference for the size of the subject. In that case, distortion of the marker causes an error.

  The imaging device 20 images the subject 12 together with the markers 16 and 18 and supplies the captured image to the image deformation device 22. The photographed image is an image in which the projected images of the markers 16 and 18 (marker images) are superimposed on the image of the subject 12 (subject image). The image deforming device 22 deforms the captured image from the image capturing device 20, more specifically, the subject image, using the markers 16 and 18 photographed together. Specifically, the image conversion device 22 performs the following processes A. Perform both or one of B. That is, the process A is a process of deforming the subject image so that the distance between the extracted markers 16 and 18 becomes the reference value. The process B is a process for deforming the subject image so that the extracted markers 16 and 18 have an initial shape, that is, the distortion of the markers 16 and 18 on the subject 12 is eliminated. In both processes A and B, the deformation includes enlargement / reduction, that is, scaling. As the number of markers to be projected is increased, this deformation process becomes easier.

  The feature extraction device 24 extracts features used for personal authentication from the deformed subject image. Such features include, for example, hand size (height and width), palm print and / or palm vein distribution. Palmprints include outlines, crest / streak / wrinkle shapes, and shades (such as moles). In this embodiment, since the subject image is deformed according to the images of the markers 16 and 18, the position of each feature can be determined with high accuracy without being affected by the distance to the subject 12. This contributes to improvement of personal authentication accuracy.

  The actual size of each part of the subject 12 can be measured by image deformation according to the process A and / or B in the image deformation device 22. This improves the accuracy of personal authentication. Even with simple numerical processing, a high recognition rate can be realized.

  The feature extraction device 24 registers the image transformed by the image transformation device 22 and / or the feature extracted by the feature extraction device 24 in the image / feature database 26. Equipping the image / feature database 26 in the terminal 10 reduces the risk that the owner or user of the terminal will expose his / her physical characteristics to the outside, and psychological resistance regarding registering physical characteristics. Less.

  The image / feature database 26 may be arranged in a remote server. When the image / feature database 26 is installed in a remote server, the mobile terminal 10 manages the image / feature database 26 via a communication line, and stores the image / feature in its name and the name of the mobile terminal 10. It is transmitted with identification information.

  As described above, the physical features of the owner are registered in the image / feature database 26.

  The operation at the time of authentication will be described. Since the operations from the marker projection by the marker projection device 14 to the feature extraction by the feature extraction device 24 are the same as those at the time of registration, detailed description is omitted. The feature extraction device 24 supplies the extracted feature and, if necessary, the subject image transformed by the image transformation device 22 to the collation device 28. The collation device 28 reads out the image / feature stored in the image / feature database 26 and collates with the image / feature from the feature extraction device 24 to determine whether the hand is a person registered in the image / feature database 26. To do.

  The verification processing of the verification device 28 includes numerical processing and graphic processing. Numerical processing is processing for comparing digitized features, and graphic processing is processing for matching specific feature patterns.

  For example, when the feature extracted by the feature extraction device 24 is the outline of the hand (front and / or back), the contrast elements of the numerical processing include the width / height of the palm, the length / width of each finger, And the width of the wrist. As contrast elements for graphic processing, there are patterns such as contours and nails.

  When the feature extracted by the feature extraction device 24 is a wrinkle figure of the hand (front and / or back), the distance between the joint wrinkles and the length of the specific wrinkle of the palm are used as contrast elements of the numerical processing. There is etc. As a contrast element of graphic processing, there is a pattern of feature points of the palm.

  When the features extracted by the feature extraction device 24 are shades such as moles, there are distances between moles as contrast elements for numerical processing, and mole patterns as contrast elements for graphic processing.

  FIG. 2 shows an example of a marker pattern to be projected. It is desirable for the marker to be able to easily determine the center position and to determine the size in two directions, the horizontal direction and the vertical direction. In this respect, the markers 30 and 32 are more suitable than the markers 34 and 36.

It is a schematic block diagram of one Example of this invention. It is an example of the marker to project.

Explanation of symbols

10: Mobile terminal 12: Hand (subject)
14: marker projection device 16, 18: marker projected on subject 20: imaging device 22: image transformation device 24: feature extraction device 26: image / feature database 28: collation device

Claims (21)

A marker projection device (14) for projecting a plurality of markers indicating a two-dimensional size reference in parallel on a subject exhibiting physical characteristics;
An imaging device (20) for imaging the subject together with the plurality of markers projected on the subject, and outputting an image including a subject image and a plurality of marker images respectively indicating the plurality of markers;
An image deformation device that deforms the subject image according to the plurality of marker images so that the distance between the plurality of marker images becomes a specified value and each marker image has a shape corresponding to the shape of the marker. 22)
A storage device (26) for storing an individual specific image;
A collation device (28) for collating the subject image deformed by the image deformation device (22) with the personal identification image stored in the storage device (26).
And a personal authentication device.   The personal authentication device according to claim 1, further comprising a registration device for registering the subject image deformed by the image deformation device (22) in the storage device (26) as the personal identification image. A marker projection device (14) for projecting a plurality of markers indicating a two-dimensional size reference in parallel on a subject exhibiting physical characteristics;
An imaging device (20) for imaging the subject together with the plurality of markers projected on the subject, and outputting an image including a subject image and a plurality of marker images respectively indicating the plurality of markers;
An image deformation device that deforms the subject image according to the plurality of marker images so that the distance between the plurality of marker images becomes a specified value and each marker image has a shape corresponding to the shape of the marker. 22)
A storage device (26) for storing personal identification information;
A feature extraction device (24) for extracting the physical features from the subject image transformed by the image transformation device (22);
A collation device (28) that collates the physical features extracted by the feature extraction device (24) with the personal identification information stored in the storage device (26).
And a personal authentication device.   The personal authentication device according to claim 3, further comprising a registration device for registering the physical feature extracted by the feature extraction device (24) in the storage device (26) as the personal identification information. The personal identification information includes a personal identification image corresponding to the subject image and a personal identification feature corresponding to the physical feature,
The collation device (28) stores the subject image transformed by the image transformation device (22) and the physical features extracted by the feature extraction device (24) in the storage device (26). The personal authentication device according to claim 3, wherein the personal identification image is collated with the personal identification image and the personal identification feature.   Furthermore, the subject image transformed by the image transformation device (22) and the physical feature extracted by the feature extraction device (24) are stored as the personal identification image and the personal identification feature, respectively, in the storage device (26). The personal authentication device according to claim 5, further comprising a registration device that registers with the personal authentication device. A plurality of markers indicating a two-dimensional size standard are projected in parallel on a subject exhibiting physical characteristics,
Imaging the subject together with the plurality of markers projected on the subject to generate an image including a subject image and a plurality of marker images respectively indicating the plurality of markers;
According the subject image image of the plurality markers images, it becomes the distance prescribed value between the plurality of marker images, and, as a shape of each marker images correspond to the shape of the marker, deformed,
Personal authentication method characterized by matching the individual specific image a modified the subject images. The personal authentication method according to claim 7 , further comprising: registering an image of the subject deformed according to the image of the marker as a personal identification image. A plurality of markers indicating a two-dimensional size standard are projected in parallel on a subject exhibiting physical characteristics,
Imaging the subject together with the plurality of markers projected on the subject to generate an image including a subject image and a plurality of marker images respectively indicating the plurality of markers;
According the subject image image of the plurality markers images, it becomes the distance prescribed value between the plurality of marker images, and, as a shape of each marker images correspond to the shape of the marker, deformed,
From deformed the subject image image and extracts the physical characteristics,
A personal authentication method characterized by collating the extracted physical characteristics with personal identification information. The personal authentication method according to claim 9 , further comprising a step of registering the extracted physical features as the personal identification information. The personal identification information includes a personal identification image corresponding to the image of the subject and a personal identification feature corresponding to the physical feature,
The personal authentication method according to claim 9 , wherein the step of collating the extracted physical feature with personal identification information further collates the deformed subject image with the personal identification image. The personal authentication method according to claim 11 , further comprising the step of registering the subject image deformed according to the marker image and the extracted physical feature as a personal identification image and a personal identification feature, respectively. A mobile communication terminal having a personal authentication function,
A marker projection device (14) for projecting a plurality of markers indicating a two-dimensional size reference in parallel on a subject exhibiting physical characteristics;
An imaging device (20) for imaging the subject together with the plurality of markers projected on the subject, and outputting an image including a subject image and a plurality of marker images respectively indicating the plurality of markers;
An image deformation device that deforms the subject image according to the plurality of marker images so that the distance between the plurality of marker images becomes a specified value and each marker image has a shape corresponding to the shape of the marker. 22)
A collation device (28) for collating the subject image deformed by the image deformation device (22) with the personal identification image
A portable communication terminal comprising: Further, the portable communication terminal according to claim 1 3, comprising a storage device (26) for storing the personal identification image. Additionally, portable communication terminal according to claim 1 4, comprising a registration device for registering a modified subject image by the image transformation unit (22) to the storage device (26) as the individual specific image. Further, the portable communication terminal according to claim 1 to 3, a modified subject image by the image transformation apparatus (22) as the individual specific image, comprising a registration device for registering a remote storage device (26). A mobile communication terminal having a personal authentication function,
A marker projection device (14) for projecting a plurality of markers indicating a two-dimensional size reference in parallel on a subject exhibiting physical characteristics;
An imaging device (20) for imaging the subject together with the plurality of markers projected on the subject, and outputting an image including a subject image and a plurality of marker images respectively indicating the plurality of markers;
An image deformation device that deforms the subject image according to the plurality of marker images so that the distance between the plurality of marker images becomes a specified value and each marker image has a shape corresponding to the shape of the marker. 22)
A feature extraction device (24) for extracting the physical features from the subject image transformed by the image transformation device (22);
Collation device (28) for collating the physical features extracted by the feature extraction device (24) with the personal identification information
A portable communication terminal comprising: The mobile communication terminal according to claim 17 , further comprising a storage device (26) for storing the personal identification information. The mobile communication terminal according to claim 18 , further comprising a registration device for registering the physical feature extracted by the feature extraction device (24) in the storage device (26) as the personal identification information. The personal identification information includes a personal identification image corresponding to the subject image and a personal identification feature corresponding to the physical feature,
The individual stored in the storage device is the subject image transformed by the image transformation device (22) and the physical features extracted by the feature extraction device (24). The mobile communication terminal according to claim 17 , wherein the mobile communication terminal is collated with the specific image and the individual specific feature. Furthermore, the subject image transformed by the image transformation device (22) and the physical feature extracted by the feature extraction device (24) are stored as the personal identification image and the personal identification feature, respectively, in the storage device (26). the portable communication terminal according to claim 2 0 having a registration device for registering a.

Images