JP4553138B2 - Face image authentication device - Google Patents

Face image authentication device Download PDF

Info

Publication number
JP4553138B2
JP4553138B2 JP2005281487A JP2005281487A JP4553138B2 JP 4553138 B2 JP4553138 B2 JP 4553138B2 JP 2005281487 A JP2005281487 A JP 2005281487A JP 2005281487 A JP2005281487 A JP 2005281487A JP 4553138 B2 JP4553138 B2 JP 4553138B2
Authority
JP
Japan
Prior art keywords
face
face image
condition
image
illumination
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2005281487A
Other languages
Japanese (ja)
Other versions
JP2007094637A (en
Inventor
敬司 甲村
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Denso Corp
Original Assignee
Denso Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Denso Corp filed Critical Denso Corp
Priority to JP2005281487A priority Critical patent/JP4553138B2/en
Priority to KR1020060094045A priority patent/KR100826309B1/en
Priority to DE102006045752A priority patent/DE102006045752B4/en
Publication of JP2007094637A publication Critical patent/JP2007094637A/en
Application granted granted Critical
Publication of JP4553138B2 publication Critical patent/JP4553138B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Collating Specific Patterns (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)

Description

本発明は顔画像認証装置に関し、特に車両に乗車する運転者などの個人認証に好適な顔画像認証装置に関する。 The present invention relates to a face image authentication apparatus, and more particularly to a face image authentication apparatus suitable for personal authentication of a driver or the like riding in a vehicle.

車両のセキュリティシステムや利便システムとして、運転者の顔画像を利用した個人認証の活用が、数多く提案されている。 Many proposals have been made to use personal authentication using a driver's face image as a vehicle security system or convenience system.

顔画像による個人認証の従来技術としては、オフィスへの入退室管理などのセキュリティ確保を目的とした顔認証システムがあり（例えば、特許文献１，特許文献２等参照）、車両用セキュリティシステムへの適用も提案されている。 As a conventional technique for personal authentication using a face image, there is a face authentication system for ensuring security such as entrance / exit management in an office (see, for example, Patent Document 1, Patent Document 2, etc.). Application is also proposed.

特開２００５−１１５４８１号公報JP-A-2005-115481 特開２００４−１５７６０２号公報JP 2004-157602 A

上述した従来の認証技術の多くは、顔画像の陰影などを個人に依存する特徴量として捕らえ、予め登録した顔特徴量と比較することで、認証を行うようにしているが、顔画像の陰影などは、顔向き条件および照明条件の組合せによって大きく変わるため、あらかじめ顔特徴量を登録した際の顔向き条件および照明条件の組合せと異なる顔向き条件および照明条件の組合せで作動させた場合、顔特徴量の本人らしさが低下し、本人であっても認証を拒否されてしまう不具合が発生する。例えば、予め登録した顔特徴量が顔を上に向けて撮影した顔画像に基づく場合には、顔を下に向けて撮影したときの本人の顔画像の顔特徴量とは異なってくるので、本人棄却率が高くなる。また、予め登録した顔特徴量が真昼の外光下で顔を撮影した顔画像に基づく場合には、夕暮れのときに撮影した本人の顔画像の顔特徴量とは異なってくるので、本人棄却率が高くなる。特に、車両の運転者の個人認証システムに用いた場合には、右ハンドル車では、右窓側から顔に当たる外光量が多くならざるを得ず、天気のときと曇天のときとで撮影した本人の顔画像の顔特徴量とは異なってくるおそれがあり、正確な個人認証を行うことができないという問題点があった。 Many of the above-described conventional authentication techniques capture facial image shading as a feature quantity that depends on an individual and compare it with a pre-registered face feature quantity to perform authentication. Etc. vary greatly depending on the combination of the face orientation condition and the lighting condition, so that if the face feature and the lighting condition combination are different from the combination of the face orientation condition and the lighting condition registered in advance, The identity of the feature amount is reduced, and a problem that authentication is rejected even by the user is generated. For example, when the pre-registered face feature amount is based on a face image taken with the face facing up, the face feature amount of the person's face image taken with the face facing down is different, The person rejection rate increases. In addition, if the face feature value registered in advance is based on a face image obtained by photographing a face under daylight, it will be different from the face feature value of the person's face image taken at dusk. The rate is high. In particular, when used in a vehicle driver's personal authentication system, the right-hand drive vehicle has to have a large amount of external light that hits the face from the right window side. There is a risk that it may differ from the facial feature amount of the face image, and there is a problem that accurate personal authentication cannot be performed.

一方、そのような顔向き条件および照明条件の組合せで本人が認証を拒否されることを避けるため、本人判定閾値を低く設定すると、他人を受け入れる確率が高くなり、本来の個人認証性能を低下させてしまう不具合が発生する。 On the other hand, if the identification threshold is set low to prevent the person from being refused authentication due to such a combination of face orientation and lighting conditions, the probability of accepting another person increases and the original personal authentication performance decreases. A malfunction that occurs.

初期登録する時点で、多様な顔向き条件および照明条件での顔特徴量を登録しておけば、以上のような問題点を回避することが可能であるが、多様な顔向き条件および照明条件の組合せでの顔特徴量をあらかじめ登録することは、照明条件を整えることが困難である上に、登録者本人への負担も大きいので、実際に実施するのは困難であるという課題がある。 By registering facial feature quantities under various face orientation conditions and lighting conditions at the time of initial registration, the above problems can be avoided, but various face orientation conditions and lighting conditions can be avoided. In addition, it is difficult to prepare the lighting feature in advance, and the burden on the registrant is large, so that there is a problem that it is difficult to actually perform the registration.

そこで、本発明は、多様な顔向き条件および照明条件の組合せでの顔特徴量を自動的に登録する顔画像認証装置を提供することを目的とする。 SUMMARY OF THE INVENTION An object of the present invention is to provide a face image authentication apparatus that automatically registers face feature amounts under various combinations of face orientation conditions and illumination conditions.

本発明は、上記問題を鑑みてなされたものであり、被撮影者の通常の振る舞いにおける顔画像を継続的に撮影し、その顔画像における顔向き条件および照明条件の組合せが、前記記憶手段に登録されている登録者の顔画像の顔特徴量の顔向き条件および照明条件の組合せと一致するかどうかを判定し、その顔向き条件および照明条件の組合せと一致する顔向き条件および照明条件の組合せが登録されていない場合に、被撮影者の顔画像の顔特徴量を前記記憶手段に追加登録し、様々な顔向き条件および照明条件の組合せでの顔画像の顔特徴量を登録させる。様々な顔向き条件および照明条件の組合せでの顔特徴量を登録することで、様々な顔向き条件および照明条件の組合せで顔画像による個人認証を行った場合でも、登録者を拒否する可能性を低減させることができる顔画像認証装置を提供することを目的とする。 The present invention has been made in view of the above problems, and continuously captures a face image in the normal behavior of the subject, and the combination of the face orientation condition and the illumination condition in the face image is stored in the storage means. It is determined whether or not the combination of the facial orientation and the lighting condition of the facial feature amount of the registered registrant's facial image matches, and the facial orientation condition and the lighting condition that match the combination of the facial orientation condition and the lighting condition are determined. When the combination is not registered, the facial feature quantity of the face image of the subject is additionally registered in the storage unit, and the facial feature quantity of the facial image under various combinations of face orientation conditions and illumination conditions is registered. By registering facial feature quantities under various combinations of face orientation conditions and lighting conditions, there is a possibility that registrants will be rejected even when personal authentication is performed using facial images with various combinations of face orientation conditions and lighting conditions It is an object of the present invention to provide a face image authentication device that can reduce the image quality.

課題を解決するための手段及び発明の効果Means for Solving the Problems and Effects of the Invention

上記課題を解決するため、本発明の顔画像認証装置は、車両に配設される顔画像認証装置であって、登録者の顔画像の顔特徴量を顔向き条件および照明条件の組合せ毎に登録する記憶手段と、被撮影者の顔を撮影する顔撮影手段と、被撮影者の操作に基づいて前記顔撮影手段により撮影された被撮影者の顔画像の顔特徴量を、顔画像撮影時の顔向き条件および照明条件の組合せに対応させて前記記憶手段に初期登録する顔画像初期登録手段と、被撮影者の所定の動作を契機として前記顔撮影手段により撮影された被撮影者の顔画像の顔特徴量が前記記憶手段に登録されている登録者の顔画像の顔特徴量と類似する場合に、被撮影者の顔画像の顔特徴量を、登録者の顔画像の顔特徴量として、顔画像撮影時の顔向き条件および照明条件の組合せに対応させて前記記憶手段に追加登録する顔画像追加登録手段と、前記顔撮影手段により撮影された被撮影者の顔画像の顔特徴量が前記記憶手段に登録されている登録者の顔画像の顔特徴量のいずれかと類似する場合に、被撮影者は登録者であると認証する認証手段と、を備えることを前提とする。
この本発明の前提となる顔画像認証装置によれば、顔撮影用カメラで撮影した登録者の顔画像が予め登録されている顔向き条件および照明条件の組合せにて登録されているかどうかを判定し、登録されている顔向き条件および照明条件の組合せでない場合には、再度、登録者の顔画像を所定顔向き条件および照明条件の組合せにて追加登録するようにしたことにより、被撮影者の顔を顔撮影用カメラで撮影した顔画像を利用して個人認証を行うシステムにおいて、被撮影者の顔画像における顔向き条件および照明条件の組合せが、登録者の顔画像の顔特徴量の顔向き条件および照明条件の組合せと一致するかどうかを判定し、その顔向き条件および照明条件の組合せと一致する顔向き条件および照明条件の組合せが登録されていない場合に、被撮影者の顔画像の顔特徴量を前記記憶手段に追加登録し、様々な顔向き条件および照明条件の組合せでの顔画像の顔特徴量を登録させる。様々な顔向き条件および照明条件の組合せでの顔特徴量を登録することで、様々な顔向き条件および照明条件の組合せで顔画像による個人認証を行った場合でも、登録者を拒否する可能性を低減させることができる。 In order to solve the above problems, a face image authentication device according to the present invention is a face image authentication device disposed in a vehicle, and the facial feature amount of a registrant's face image is determined for each combination of face orientation condition and illumination condition. A storage means for registering, a face photographing means for photographing the face of the subject, and a facial feature amount of the face image of the subject photographed by the face photographing means based on the operation of the subject. Face image initial registration means for initial registration in the storage means corresponding to the combination of the face orientation condition and the lighting condition of the time, and the subject photographed by the face photographing means triggered by a predetermined operation of the subject When the facial feature quantity of the facial image is similar to the facial feature quantity of the registrant's facial image registered in the storage means, the facial feature quantity of the photographed person's facial image is used as the facial feature quantity of the registrant's facial image. As a quantity, a combination of face orientation conditions and lighting conditions at the time of face image shooting Corresponding face image addition registration means for additionally registering in the storage means, and the facial feature amount of the face image of the subject photographed by the face photographing means of the registrant face image registered in the storage means When it is similar to any one of the facial feature amounts, it is assumed that the photographed person includes authentication means for authenticating that the subject is a registrant.
According to the face image authentication apparatus as a premise of the present invention, it is determined whether or not a registrant's face image photographed by a face photographing camera is registered with a combination of face orientation conditions and illumination conditions registered in advance. If it is not a combination of the registered face orientation conditions and illumination conditions, the registrant's face image is again registered with a combination of predetermined face orientation conditions and illumination conditions, so that the subject In a system for performing personal authentication using a face image obtained by photographing a face of a person with a face photographing camera, the combination of the face orientation condition and the illumination condition in the face image of the subject is the facial feature amount of the registrant's face image. It is determined whether or not the combination of the face direction condition and the lighting condition is matched, and when the combination of the face direction condition and the lighting condition that matches the combination of the face direction condition and the lighting condition is not registered, The facial feature quantity of the photographer's face image is additionally registered in the storage means, and registers the face feature amount of the face image of a combination of different face orientation conditions and lighting conditions. By registering facial feature quantities under various combinations of face orientation conditions and lighting conditions, there is a possibility that registrants will be rejected even when personal authentication is performed using facial images with various combinations of face orientation conditions and lighting conditions Can be reduced.

そして、本発明の顔画像認証装置は、上記前提要件に加え、さらに、前記顔画像初期登録手段が、被撮影者の顔画像から顔特徴量を演算する顔特徴量演算手段と、被撮影者の顔画像から顔向き条件を演算することにより顔の向きを調べる顔向き条件算出手段と、被撮影者の顔画像から照明条件を演算することにより均等照明、右顔面が明るい照明、左顔面が明るい照明、顔面下半分が明るい照明のいずれであるかを決定する照明条件算出手段と、前記顔特徴量を前記顔向き条件および前記照明条件の組合せに対応させて前記記憶手段に登録する顔特徴量・顔向き条件・照明条件記憶手段とを含むことを特徴とする。この顔画像認証装置によれば、顔特徴量を顔向き条件および照明条件の組合せに対応させて記憶手段に登録するようにしたことにより、どの条件で顔特徴量が登録されているかを明らかにすることができる。 The face image recognition apparatus of the present invention, in addition to the above prerequisites, further the face image initial registration means, a facial feature quantity calculating means for calculating a facial feature from the photographer's face image, the photographer Face orientation condition calculating means for examining the face orientation by calculating the face orientation condition from the face image of the subject, uniform illumination, bright illumination of the right face, and left face by calculating the illumination condition from the face image of the subject Illumination condition calculation means for determining whether the illumination is bright or the lower half of the face is bright, and the facial feature is registered in the storage means in correspondence with the combination of the face orientation condition and the illumination condition. It includes a quantity / face orientation condition / illumination condition storage means. According to this face image authentication device, clear whether by that be registered in the storage means in association with the combination of the face orientation conditions and lighting conditions the facial feature quantity, the facial feature quantity in which conditions are registered Can be.

この場合、前記顔画像追加登録手段が、被撮影者の顔画像から顔特徴量を演算する顔特徴量演算手段と、前記顔特徴量演算手段により演算された顔特徴量と前記記憶手段に登録されている顔特徴量との類似度を演算する顔特徴量類似度比較手段と、前記顔特徴量類似度比較手段により演算された類似度が類似度最大値より大きい場合に当該類似度を類似度最大値に設定する類似度最大値設定手段と、前記類似度最大値設定手段により設定された類似度最大値が第１閾値以上である場合に被撮影者の顔画像から顔向き条件を演算する顔向き条件算出手段と、被撮影者の顔画像から照明条件を演算する照明条件算出手段と、前記顔向き条件および前記照明条件の組合せに対応させて顔特徴量が未登録である場合に前記顔特徴量演算手段により演算された顔特徴量を前記顔向き条件および前記照明条件の組合せに対応させて前記記憶手段に登録する顔特徴量・顔向き条件・照明条件記憶手段とを含むようにすることができる。これによれば、演算された顔特徴量と記憶手段に登録されている顔特徴量との類似度を演算し、演算された類似度が類似度最大値より大きい場合に当該類似度を類似度最大値に設定し、類似度最大値が第１閾値以上である場合に、今回の被撮影者が本来の登録者であると判定して顔特徴量の追加登録を許可し、顔画像の顔向き条件の演算および顔画像の照明条件の演算を実行し、算出された顔向き条件および照明条件の組合せに対応して顔特徴量を記憶手段に登録するようにしたことにより、類似度の低い顔特徴量の登録を防止することができる。 In this case , the face image addition registration unit registers the face feature amount calculation unit that calculates the face feature amount from the face image of the subject, the face feature amount calculated by the face feature amount calculation unit, and the storage unit. A facial feature quantity similarity comparison unit that calculates a similarity to a facial feature quantity that has been calculated, and the similarity calculated by the facial feature quantity similarity comparison unit is greater than the similarity maximum value. Similarity maximum value setting means for setting the maximum degree value, and when the maximum similarity value set by the maximum similarity value setting means is equal to or greater than a first threshold, the face orientation condition is calculated from the face image of the subject A face orientation condition calculating means, an illumination condition calculating means for calculating an illumination condition from the face image of the photographed person, and a face feature amount corresponding to a combination of the face orientation condition and the illumination condition is not registered. Calculated by the face feature value calculating means The facial feature quantity can be made to contain a said face orientation condition and the facial feature quantity and face orientation conditions and lighting condition storage means for registering in the storage means in association with the combination of the illumination conditions. According to this , the similarity between the calculated face feature amount and the face feature amount registered in the storage unit is calculated, and when the calculated similarity is larger than the maximum similarity, the similarity is calculated as the similarity. When the maximum value is set and the maximum similarity value is equal to or greater than the first threshold, it is determined that the subject to be photographed is the original registrant and additional registration of the facial feature amount is permitted, and the face of the face image By calculating the orientation condition and the illumination condition of the face image and registering the facial feature quantity in the storage means corresponding to the calculated combination of the face orientation condition and the illumination condition, the degree of similarity is low. Registration of facial feature values can be prevented.

また、前記認証手段が、前記類似度最大値と登録者と認証する類似度の下限値である第２閾値とを比較し、前記類似度最大値が前記第２閾値以上である場合は被撮影者を登録者と認証するものとしてもよい。この場合、例えば、前記第１閾値が、前記第２閾値に比して大きく設定され、前記顔画像追加登録手段により被撮影者の顔画像が追加登録される場合の方が、前記認証手段により登録者と認証される場合よりも拒否される可能性が高く設定されるものとすることができる。これによれば、類似度最大値が第２閾値以上である場合に被撮影者を登録者と認証するようにしたことにより、最も確実性の高い類似度を用いて被撮影者を登録者と認証するので、登録者を拒否する可能性を低減させることができる。 The authentication unit compares the maximum similarity value with a second threshold value that is a lower limit value of the similarity level for authenticating the registrant. If the maximum similarity value is equal to or greater than the second threshold value, the subject is photographed. It is good also as what authenticates a person with a registrant . In this case, for example, when the first threshold value is set larger than the second threshold value and the face image of the subject is additionally registered by the face image additional registration unit, the authentication unit performs the registration. It is possible to set a higher possibility of being rejected than when authenticating as a registrant. According to this , since the photographed person is authenticated as the registrant when the maximum similarity is equal to or greater than the second threshold value, the photographed person is registered with the registrant using the most reliable similarity. Since authentication is performed, the possibility of refusing a registrant can be reduced.

また、被撮影者の顔を照明する照明手段を備える構成にするとよい。これによれば、照明手段により被撮影者の顔を照明することができるので、より鮮明な顔画像を得ることができ、顔画像による個人認証の精度をさらに向上させることができる。 Moreover , it is good to have a structure provided with the illumination means which illuminates a to-be-photographed person's face . According to this , since the face of the subject can be illuminated by the illumination means, a clearer face image can be obtained, and the accuracy of personal authentication using the face image can be further improved.

様々な顔向き条件および照明条件の組合せで顔画像による個人認証を行った場合でも、登録者を拒否する可能性を低減させるという目的を、被撮影者の顔を適時撮影し、被撮影者の顔画像の顔特徴量を記憶手段に追加登録し、様々な顔向き条件および照明条件の組合せでの顔画像の顔特徴量を登録することで達成した。 Even when personal authentication is performed using facial images with various face orientation conditions and lighting conditions, the subject's face is photographed in a timely manner to reduce the possibility of refusing the registrant. This is achieved by additionally registering the facial feature quantity of the face image in the storage means and registering the facial feature quantity of the facial image under various combinations of face orientation conditions and illumination conditions.

以下、本発明の実施例１について図面を参照しながら詳細に説明する。 Hereinafter, Example 1 of the present invention will be described in detail with reference to the drawings.

図１は、本発明の実施例１に係る顔画像認証装置を示すブロック図である。本実施例１に係る顔画像認証装置は、車両の運転席に対応するインスツルメントパネル内に配設された画像処理装置１０と、画像処理装置１０とから起動されるＬＥＤ（Light Emitting Diode)電流制御装置２０と、ＬＥＤ電流制御装置２０と接続され、車両の運転席に着座した運転者の顔を照明するように運転席に対応するインスツルメントパネルに組み込まれたＬＥＤ３０と、車両の運転席に着座した運転者の顔を撮影できるように運転席に対応するインスツルメントパネルに組み込まれた、例えばＣＣＤ（Charge Coupled Device）カメラ等でなる顔撮影用カメラ４０とから構成されている。 FIG. 1 is a block diagram illustrating a face image authentication apparatus according to Embodiment 1 of the present invention. The face image authentication device according to the first embodiment includes an image processing device 10 disposed in an instrument panel corresponding to a driver's seat of a vehicle, and an LED (Light Emitting Diode) activated from the image processing device 10. A current control device 20; an LED current control device 20 connected to the LED current control device 20; and an LED 30 incorporated in an instrument panel corresponding to the driver's seat so as to illuminate a driver's face seated in the driver's seat of the vehicle; It is composed of a face photographing camera 40 such as a CCD (Charge Coupled Device) camera incorporated in an instrument panel corresponding to the driver's seat so that the driver's face seated on the seat can be photographed.

図２を参照すると、画像処理装置１０は、ＣＰＵ（Central Processing Unit)１１と、画像処理プログラム１００を格納するＲＯＭ（Read Only Memory)１２と、ＣＰＵ１１の動作データを一時的に格納するためのＲＡＭ（Random Access Memory)１３と、登録者の顔画像の顔特徴量ならびに顔向き条件および照明条件の組合せを登録するＥＥＰＲＯＭ（Electrically Erasable &Programmable Read Only Memory)等でなる不揮発性メモリ１４とを含んで構成されている。 Referring to FIG. 2, the image processing apparatus 10 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12 that stores an image processing program 100, and a RAM that temporarily stores operation data of the CPU 11. (Random Access Memory) 13 and a nonvolatile memory 14 composed of an EEPROM (Electrically Erasable & Programmable Read Only Memory) or the like for registering a facial feature amount of a registrant's face image and a combination of face orientation conditions and illumination conditions. Has been.

図３を参照すると、画像処理プログラム１００には、顔画像登録起動信号入力手段１０１と、顔画像登録終了信号入力手段１０２と、撮影トリガー入力手段１０３と、登録条件読出し手段１０４と、他の機器への通信手段１０５と、画像入力手段１０６と、顔特徴量演算手段１０７と、顔特徴量類似度比較手段１０８と、第１閾値記憶手段１０９と、第２閾値記憶手段１１０と、顔向き条件算出手段１１１と、照明条件算出手段１１２と、顔特徴量・顔向き条件・照明条件記憶手段１１３と、登録条件類似度比較手段１１４とを含んで構成されている。 Referring to FIG. 3, the image processing program 100 includes a face image registration start signal input means 101, a face image registration end signal input means 102, a shooting trigger input means 103, a registration condition reading means 104, and other devices. Communication means 105, image input means 106, face feature quantity calculation means 107, face feature quantity similarity comparison means 108, first threshold value storage means 109, second threshold value storage means 110, face orientation condition The calculation unit 111, the illumination condition calculation unit 112, the face feature amount / face orientation condition / illumination condition storage unit 113, and the registered condition similarity comparison unit 114 are configured.

図４は、顔画像初期登録処理（顔画像初期登録手段）を示すフローチャートである。 FIG. 4 is a flowchart showing face image initial registration processing (face image initial registration means).

図５は、顔画像追加登録処理（顔画像追加登録手段）を示すフローチャートである。なお、実施例１では、顔画像による個人認証処理の登録者判定閾値として、顔画像の追加登録を許可する類似度の下限値である第１閾値Ｔｈ１と、顔画像による個人認証において登録者と判定する類似度の下限値である第２閾値Ｔｈ２とを有しており、第１閾値Ｔｈ１＞第２閾値Ｔｈ２（閾値が大きい方が厳しいとする)としてある。例えば、第１閾値Ｔｈ１は登録者棄却率０.５％、第２閾値Ｔｈ２は登録者棄却率２％となるように設定されている。 FIG. 5 is a flowchart showing face image addition registration processing (face image addition registration means). In the first embodiment, as a registrant determination threshold for personal authentication processing using a face image, a first threshold Th1 that is a lower limit value of similarity that permits additional registration of a facial image, and a registrant in personal authentication using a facial image, It has a second threshold value Th2 that is a lower limit value of the similarity to be determined, and the first threshold value Th1> the second threshold value Th2 (assuming that a larger threshold value is more severe). For example, the first threshold value Th1 is set to be a registrant rejection rate of 0.5%, and the second threshold value Th2 is set to be a registrant rejection rate of 2%.

図６は、顔特徴量を不揮発性メモリ１４に登録する顔向き条件および照明条件の組合せを例示する概念図である。均等照明，右顔面が明るい照明，左顔面が明るい照明，顔面下半分が明るい照明の４つ照明条件下で、それぞれ上下顔向きが−３０°から＋３０°まで１０°毎で、かつ左右顔向きが−３０°から＋３０°まで１０°毎に顔特徴量が登録されるようになっている。なお、この実施例では、登録する情報量を削減するため、均等照明，右顔面が明るい照明，左顔面が明るい照明，顔面下半分が明るい照明の各照明条件下で、（−３０°，−３０°），（−３０°，＋３０°），（＋３０°，−３０°），（＋３０°，＋３０°）の４つの顔向きの近傍の条件は除かれている。 FIG. 6 is a conceptual diagram illustrating a combination of face orientation conditions and illumination conditions for registering face feature amounts in the nonvolatile memory 14. Under the four lighting conditions of uniform lighting, bright lighting on the right face, bright lighting on the left face, and bright lighting on the lower half of the face, the upper and lower faces are each -30 ° to + 30 ° in 10 ° increments and left and right faces. However, the facial feature amount is registered every 10 ° from −30 ° to + 30 °. In this embodiment, in order to reduce the amount of information to be registered, (−30 °, −30 °, − (30 °), (−30 °, + 30 °), (+ 30 °, −30 °), and (+ 30 °, + 30 °) four conditions near the face direction are excluded.

次に、このように構成された本実施例１に係る顔画像認証装置の動作について、図４および図５のフローチャートを参照しながら説明する。 Next, the operation of the face image authentication apparatus according to the first embodiment configured as described above will be described with reference to the flowcharts of FIGS. 4 and 5.

（１) 顔画像初期登録処理（図４参照) (1) Face image initial registration process (see Fig. 4)

本発明の実施にあたっては、少なくとも１つ以上の顔向き条件および照明条件の組合せでの登録者の顔画像の顔特徴量ならびに顔画像撮影時の顔向き条件および照明条件の組合せが初期登録されていることが前提となるので、画像処理装置１０は、まず、図４に示す顔画像初期登録処理を実行する。 In carrying out the present invention, a facial feature amount of a registrant's face image in a combination of at least one face orientation condition and illumination condition and a combination of face orientation condition and illumination condition at the time of face image shooting are initially registered. Therefore, the image processing apparatus 10 first executes a face image initial registration process shown in FIG.

車両の運転席に着座した者（顔画像初期登録処理では、登録者という)が自身の顔画像を登録するために顔画像登録ボタン等を操作すると、画像処理装置１０は、顔画像登録起動信号入力手段１０１により顔画像登録起動信号を入力して（図４のＳ１０１)、画像処理プログラム１００を起動する（図４のＳ１０２)。なお、顔画像登録起動信号入力手段１０１は、暗証番号などによる認証手段を有し、その認証結果をもって、画像処理プログラム１００を起動するようになっている。 When a person seated in the driver's seat of the vehicle (referred to as a registrant in the face image initial registration process) operates a face image registration button or the like to register his / her face image, the image processing apparatus 10 receives a face image registration start signal. A face image registration activation signal is input by the input means 101 (S101 in FIG. 4), and the image processing program 100 is activated (S102 in FIG. 4). The face image registration activation signal input unit 101 includes an authentication unit such as a personal identification number, and starts the image processing program 100 based on the authentication result.

次に、画像処理装置１０は、ＬＥＤ電流制御装置２０を起動する（図４のＳ１０３)。これにより、ＬＥＤ３０の発光が可能となる。 Next, the image processing apparatus 10 activates the LED current control apparatus 20 (S103 in FIG. 4). Thereby, light emission of LED30 is attained.

続いて、画像処理装置１０は、顔撮影用カメラ４０を起動する（図４のＳ１０４)。これにより、登録者の顔の撮影が可能になる。 Subsequently, the image processing apparatus 10 activates the face photographing camera 40 (S104 in FIG. 4). This makes it possible to photograph the registrant's face.

次に、登録者が撮影ボタン等を操作すると、画像処理装置１０は、撮影トリガー信号入力手段１０３により撮影トリガー信号を入力し（図４のＳ１０５)、ＬＥＤ３０を発光させると同時に、顔撮影用カメラ４０により登録者の顔画像を撮影する（図４のＳ１０６)。撮影された登録者の顔画像は、画像入力手段１０６により顔撮影用カメラ４０から画像処理装置１０に入力されて、ＲＡＭ１３上に一時的に格納される。 Next, when the registrant operates the shooting button or the like, the image processing apparatus 10 inputs a shooting trigger signal by the shooting trigger signal input means 103 (S105 in FIG. 4), and simultaneously causes the LED 30 to emit light, and at the same time, a face shooting camera. The face image of the registrant is photographed by 40 (S106 in FIG. 4). The photographed face image of the registrant is input from the face photographing camera 40 to the image processing apparatus 10 by the image input means 106 and temporarily stored in the RAM 13.

続いて、画像処理装置１０は、顔特徴量演算手段１０７により、ＲＡＭ１３上に一時的に格納された顔画像から顔特徴量を演算する（図４のＳ１０７)。詳しくは、顔特徴量演算手段１０７は、まず、ＲＡＭ１３上に一時的に格納された顔画像から登録者の顔領域を検出する。例えば、あらかじめ用意されたテンプレートを、顔画像中を移動させながら相関値を求めることにより、最も高い相関値を持った場所を顔領域とする。なお、その他に、固有空間法や部分空間法を利用した顔領域抽出法などを使用してもよい。次に、顔特徴量演算手段１０７は、検出された顔領域の部分の中から、目、鼻、口といった顔部品の位置を検出する。この検出方法としては、例えば、文献（福井和広、山口修：「形状抽出とパターン照合の組合せによる顔特徴点抽出」、電子情報通信学会論文誌（Ｄ），ｖｏｌ．Ｊ８０−Ｄ−ＩＩ，Ｎｏ．８，ｐｐ２１７０−２１７７（１９９７））などに記載された方法を用いることができる。続いて、顔特徴量演算手段１０７は、検出された顔部品の位置を基に、顔領域を一定の大きさ、形状に切り出し、その濃淡情報を顔の特徴量として用いる。たとえば、ｍピクセル×ｎピクセルの領域の濃淡値をそのまま情報として用い、ｍ×ｎ次元の情報を特徴ベクトルとして用いることができる。 Subsequently, the image processing apparatus 10 calculates the face feature amount from the face image temporarily stored in the RAM 13 by the face feature amount calculation unit 107 (S107 in FIG. 4). Specifically, the face feature amount computing unit 107 first detects the registrant's face area from the face image temporarily stored on the RAM 13. For example, by obtaining a correlation value while moving a template prepared in advance in a face image, a place having the highest correlation value is set as a face region. In addition, a face region extraction method using an eigenspace method or a subspace method may be used. Next, the face feature amount calculation means 107 detects the position of the face parts such as eyes, nose, and mouth from the detected face area. As this detection method, for example, literature (Kazuhiro Fukui, Osamu Yamaguchi: “Face feature point extraction by combination of shape extraction and pattern matching”, IEICE Transactions (D), vol. J80-D-II, No. 8, pp2170-2177 (1997)). Subsequently, the face feature quantity computing means 107 cuts out the face area into a certain size and shape based on the detected position of the face part, and uses the shading information as the face feature quantity. For example, the gray value of an area of m pixels × n pixels can be used as information as it is, and m × n-dimensional information can be used as a feature vector.

次に、画像処理装置１０は、顔向き条件算出手段１１１により、ＲＡＭ１３上に一時的に格納された顔画像から顔向き条件を演算する（図４のＳ１０８)。詳しくは、顔向き条件算出手段１１１は、顔のテンプレートによる顔検出と、目、鼻などの顔部品の検出座標の相対位置によって顔の向きを調べる。 Next, the image processing apparatus 10 calculates the face orientation condition from the face image temporarily stored in the RAM 13 by the face orientation condition calculating unit 111 (S108 in FIG. 4). Specifically, the face orientation condition calculation unit 111 checks the face orientation based on the face detection based on the face template and the relative position of the detection coordinates of the face parts such as eyes and nose.

続いて、画像処理装置１０は、照明条件算出手段１１２により、ＲＡＭ１３上に一時的に格納された顔画像から照明条件を演算する（図４のＳ１０９)。例えば、照明条件算出手段１１２は、顔画像を左上四半部，右上四半部，左下四半部，右下四半部の４つの画像領域に分け、各画像領域の明度の平均値を比較することにより、均等照明，右顔面が明るい照明，左顔面が明るい照明，顔面下半分が明るい照明の４つ照明条件のいずれであるかを決定する。 Subsequently, the image processing apparatus 10 calculates the illumination condition from the face image temporarily stored in the RAM 13 by the illumination condition calculation unit 112 (S109 in FIG. 4). For example, the illumination condition calculation unit 112 divides the face image into four image areas of an upper left quadrant, an upper right quadrant, a lower left quadrant, and a lower right quadrant, and compares the average brightness values of the image areas. It is determined which of the four illumination conditions is uniform illumination, illumination with a bright right face, illumination with a bright left face, and illumination with a bright lower half of the face.

次に、画像処理装置１０は、顔特徴量・顔向き条件・照明条件記憶手段１１３により、ステップＳ１０７で演算した顔特徴量を、ステップＳ１０８で演算した顔向き条件、およびステップＳ１０９で演算した照明条件の組合せに対応させて不揮発性メモリ１４に登録する（図４のＳ１１０)。この際、登録条件類似度判定手段１１４により、図６に示した顔向き条件および照明条件の組み合わせの中から、演算した顔向き条件および演算した照明条件の組合せに最も近い顔向き条件および照明条件の組み合わせが選定される。 Next, the image processing apparatus 10 uses the face feature amount / face orientation condition / illumination condition storage unit 113 to convert the face feature amount calculated in step S107 to the face orientation condition calculated in step S108 and the illumination calculated in step S109. The information is registered in the nonvolatile memory 14 corresponding to the combination of conditions (S110 in FIG. 4). At this time, the registered condition similarity determination unit 114 causes the face orientation condition and the illumination condition closest to the calculated face orientation condition and the calculated illumination condition combination from the combinations of the face orientation condition and the illumination condition shown in FIG. Is selected.

そして、画像処理装置１０は、登録者に顔画像の初期登録を終了するか否かを問い合せ（図４のＳ１１１)、登録者の顔画像登録終了ボタン等の操作に基づく顔画像登録終了信号を、顔画像登録終了信号入力手段１０２により入力しないかぎり（図４のＳ１１１：Ｎｏ)、ステップＳ１０５に制御を戻して、ステップＳ１０５〜Ｓ１１１を繰り返す。 Then, the image processing apparatus 10 inquires the registrant whether or not to end the initial registration of the face image (S111 in FIG. 4), and sends a face image registration end signal based on the operation of the registrant's face image registration end button or the like. Unless otherwise input by the face image registration end signal input means 102 (S111: No in FIG. 4), control is returned to step S105, and steps S105 to S111 are repeated.

顔特徴量の顔向き条件および照明条件の組合せに対応する登録を１回以上行った後に、登録者が顔画像登録終了ボタン等を操作すると、画像処理装置１０は、顔画像登録終了信号入力手段１０２により顔画像登録終了信号を入力し（図４のＳ１１１：Ｙｅｓ)、顔画像初期登録処理を終了する（図４のＳ１１２)。 When the registrant operates the face image registration end button or the like after performing registration corresponding to the combination of the face direction and the lighting condition of the face feature quantity one or more times, the image processing apparatus 10 displays the face image registration end signal input means. The face image registration end signal is input at 102 (S111: Yes in FIG. 4), and the face image initial registration process is ended (S112 in FIG. 4).

（２) 顔画像追加登録処理（図５参照) (2) Face image additional registration processing (see FIG. 5)

車両への人の乗車意図を契機として、画像処理装置１０は、顔画像追加登録処理を実行する。 The image processing apparatus 10 executes a face image additional registration process in response to a person's intention to board the vehicle.

車両の運転席に人（顔画像追加登録処理では、被撮影者という）が乗り込むと、運転席シートに内蔵したセンサ（例えば荷重センサなど)により被撮影者の運転席への着座が検出され（図５のＳ２０１)、画像処理装置１０は、画像処理プログラム１００を起動する（図５のＳ２０２)。なお、被撮影者の運転席への着座検出に代えて、車両ドアの開錠等を契機として顔画像登録起動信号を入力するようにしてもよい。このように、被撮影者からの指示なしに、被撮影者の運転席への乗車意図によって、画像処理プログラム１００を自動的に起動する点は、本発明の特徴である。 When a person (referred to as a photographed person in the face image additional registration process) gets into the driver's seat of the vehicle, the seating of the photographed person in the driver's seat is detected by a sensor (such as a load sensor) built in the driver's seat ( 5 (S201 in FIG. 5), the image processing apparatus 10 activates the image processing program 100 (S202 in FIG. 5). Instead of detecting the seating of the photographed person in the driver's seat, a face image registration activation signal may be input when the vehicle door is unlocked. As described above, it is a feature of the present invention that the image processing program 100 is automatically started according to the user's intention to board the driver's seat without an instruction from the user.

次に、画像処理装置１０は、登録条件読出し手段１０４により、不揮発性メモリ１４から顔特徴量が未登録の顔向き条件および照明条件の組合せを読み出す（図５のＳ２０３)。 Next, the image processing apparatus 10 reads the combination of the face orientation condition and the illumination condition for which the face feature amount is not registered from the nonvolatile memory 14 by the registered condition reading unit 104 (S203 in FIG. 5).

続いて、画像処理装置１０は、すでに顔特徴量が登録されている顔向き条件および照明条件の組合せの数（条件登録数）を演算し（図５のＳ２０４)、顔向き条件および照明条件の組合せが１つ以上登録されているかどうかを判定する（図５のＳ２０５)。 Subsequently, the image processing apparatus 10 calculates the number of combinations of face orientation conditions and illumination conditions for which facial feature quantities have already been registered (condition registration count) (S204 in FIG. 5), and sets the face orientation conditions and illumination conditions. It is determined whether one or more combinations are registered (S205 in FIG. 5).

顔特徴量が登録されている顔向き条件および照明条件の組合せが１つも無い場合は（図５のＳ２０５：Ｎｏ)、画像処理装置１０は、他の機器への通信手段１０５により、顔画像初期登録処理（図４参照)が実施されていないことを他の機器（例えば、メータ装置，カーナビゲーション装置，携帯電話機等）に送信して被撮影者，車両オーナ等に報知した後（図５のＳ２２６)、顔画像追加登録処理を終了する（図５のＳ２２７)。 When there is no combination of the face orientation condition and the illumination condition in which the facial feature amount is registered (S205: No in FIG. 5), the image processing apparatus 10 uses the communication means 105 to other devices to start the initial facial image. After notifying the registration process (see FIG. 4) to other devices (for example, a meter device, a car navigation device, a mobile phone, etc.) and notifying the photographed person, vehicle owner, etc. (see FIG. 5) S226), the face image additional registration process is terminated (S227 in FIG. 5).

顔特徴量が登録されている顔向き条件および照明条件の組合せが１つ以上有る場合は（図５のＳ２０５：Ｙｅｓ)、画像処理装置１０は、不揮発性メモリ１４から登録されている顔特徴量ならびに顔向き条件および照明条件の組合せを読み出す（図５のＳ２０６)。 If there is one or more combinations of face orientation conditions and illumination conditions for which facial feature amounts are registered (S205 in FIG. 5: Yes), the image processing apparatus 10 registers the facial feature amounts from the nonvolatile memory 14. In addition, the combination of the face orientation condition and the illumination condition is read (S206 in FIG. 5).

次に、画像処理装置１０は、今回の顔画像による個人認証動作における類似度最大値Ｐmaxを０に初期設定する（図５のＳ２０７)。 Next, the image processing apparatus 10 initially sets the similarity maximum value Pmax in the personal authentication operation using the current face image to 0 (S207 in FIG. 5).

続いて、画像処理装置１０は、ＬＥＤ電流制御装置２０を起動する（図５のＳ２０８)。これにより、ＬＥＤ３０の発光が可能となる。 Subsequently, the image processing apparatus 10 activates the LED current control apparatus 20 (S208 in FIG. 5). Thereby, light emission of LED30 is attained.

次に、画像処理装置１０は、顔画像撮影用カメラ４０を起動する（図５のＳ２０９)。これにより、被撮影者の顔の撮影が可能になる。 Next, the image processing apparatus 10 activates the face image capturing camera 40 (S209 in FIG. 5). As a result, the face of the subject can be photographed.

続いて、画像処理装置１０は、撮影トリガー入力手段１０３により撮影トリガー信号を自動的に入力してＬＥＤ３０を発光させると同時に顔画像撮影用カメラ４０のシャッターを作動させ、被撮影者の顔画像を撮影する（図５のＳ２１０)。撮影された被撮影者の顔画像は、画像入力手段１０６により、顔撮影用カメラ４０から画像処理装置１０に入力され、ＲＡＭ１３上に一時的に格納される。 Subsequently, the image processing apparatus 10 automatically inputs a shooting trigger signal by the shooting trigger input means 103 to cause the LED 30 to emit light, and simultaneously operates the shutter of the face image shooting camera 40 to capture the face image of the subject. A picture is taken (S210 in FIG. 5). The photographed face image of the photographed person is input from the face photographing camera 40 to the image processing apparatus 10 by the image input means 106 and temporarily stored in the RAM 13.

次に、画像処理装置１０は、顔特徴量演算手段１０７により、ＲＡＭ１３上に一時的に格納された被撮影者の顔画像から顔特徴量を演算する（図５のＳ２１１)。なお、顔特徴量の演算については、すでにステップＳ１０７で詳述した。 Next, the image processing apparatus 10 calculates the face feature amount from the face image of the person to be photographed temporarily stored in the RAM 13 by the face feature amount calculation unit 107 (S211 in FIG. 5). The calculation of the facial feature amount has already been described in detail in step S107.

続いて、画像処理装置１０は、顔特徴量類似度比較手段１０８により、ステップＳ２１１で演算された顔特徴量と、不揮発性メモリ１４に初期登録されている顔特徴量との類似度を演算する（図５のＳ２１２)。詳しくは、顔特徴量類似度比較手段１０８は、部分空間法や複合類似度法などの方法を用いて顔特徴量の類似度を演算する。たとえば、文献（前田賢一、渡辺貞一：「局所的構造を導入したパターン・マッチング法」、電子情報通信学会論文誌（Ｄ），ｖｏｌ．Ｊ６８−Ｄ，Ｎｏ．３，ｐｐ３４５−３５２（１９８５））に記載されている相互部分空間法を用いることができる。この方法では、演算された顔特徴量も、初期登録されている顔特徴量も部分空間として表現され、２つの部分空間のなす「角度」を類似度として定義する。なお、相関値やユークリッド距離といった他の尺度で類似度を定義してもよいことはもちろんである。 Subsequently, the image processing apparatus 10 calculates the degree of similarity between the face feature amount calculated in step S211 and the face feature amount initially registered in the nonvolatile memory 14 by the face feature amount similarity comparing unit 108. (S212 of FIG. 5). Specifically, the face feature amount similarity comparison unit 108 calculates the similarity of the face feature amount using a method such as a subspace method or a composite similarity method. For example, literature (Kenichi Maeda, Sadaichi Watanabe: “Pattern matching method introducing local structure”, IEICE Transactions (D), vol. J68-D, No. 3, pp 345-352 (1985)). The mutual subspace method described in can be used. In this method, both the calculated face feature value and the initially registered face feature value are expressed as a partial space, and an “angle” formed by the two partial spaces is defined as a similarity. Of course, the degree of similarity may be defined by another scale such as a correlation value or Euclidean distance.

次に、画像処理装置１０は、演算された類似度が類似度最大値Ｐmaxより大きいかどうかを判定し（図５のＳ２１３)、大きい場合は（図５のＳ２１３：Ｙｅｓ)、演算された類似度を類似度最大値Ｐmaxに設定する（図５のＳ２１４)。演算された類似度が類似度最大値Ｐmax以下の場合には（図５のＳ２１３：Ｎｏ)、ステップＳ２１４をスキップする。 Next, the image processing apparatus 10 determines whether or not the calculated similarity is larger than the maximum similarity Pmax (S213 in FIG. 5), and if it is larger (S213 in FIG. 5: Yes), the calculated similarity is determined. The degree is set to the similarity maximum value Pmax (S214 in FIG. 5). If the calculated similarity is equal to or less than the maximum similarity Pmax (S213: No in FIG. 5), step S214 is skipped.

続いて、画像処理装置１０は、類似度最大値Ｐmaxと、第１閾値記憶手段１０９に記憶されている、顔画像の追加登録を許可する類似度の下限値である第１閾値Ｔｈ１とを比較する（図５のＳ２１５)。 Subsequently, the image processing apparatus 10 compares the maximum similarity value Pmax and the first threshold value Th1 that is stored in the first threshold value storage unit 109 and that is a lower limit value of the similarity level that permits additional registration of face images. (S215 in FIG. 5).

類似度最大値Ｐmax が第１閾値Ｔｈ１以上である場合（図５のＳ２１５：Ｙｅｓ)、画像処理装置１０は、ステップＳ２１６に制御を移し、顔向き条件算出手段１１１による被撮影者の顔画像の顔向き条件の演算（図５のＳ２１６：図４のＳ１０８と同様)、照明条件算出手段１１２による被撮影者の顔画像の照明条件の演算（図５のＳ２１７：図４のＳ１０９と同様)を実行し、算出された顔向き条件および照明条件の組合せに対応して顔特徴量が未登録であるかどうかを判定する（図５のＳ２１８)。顔向き条件および照明条件の組合せに対応して顔特徴量が未登録である場合は（図５のＳ２１８：Ｙｅｓ)、画像処理装置１０は、顔特徴量・顔向き条件・照明条件記憶手段１１３により、被撮影者の顔画像の顔特徴量を顔向き条件および照明条件の組合せに対応させて不揮発性メモリ１４に登録し（図５のＳ２１９)、ステップＳ２２０に制御を移す。この際、登録条件類似度判定手段１１４により、図６に示した顔向き条件および照明条件の組み合わせの中から、演算した顔向き条件および演算した照明条件の組合せに最も近い顔向き条件および照明条件の組み合わせが選定される。顔向き条件および照明条件の組合せに対応して顔特徴量がすでに登録されている場合は（図５のＳ２１８：Ｎｏ)、画像処理装置１０は、登録者の顔画像の顔特徴量を不揮発性メモリ１４に登録することなしに、ステップＳ２２０に制御を移す。 When the similarity maximum value Pmax is equal to or greater than the first threshold value Th1 (S215: Yes in FIG. 5), the image processing apparatus 10 moves control to step S216, and the face orientation condition calculation unit 111 determines the face image of the subject. Calculation of face orientation conditions (S216 in FIG. 5: the same as S108 in FIG. 4), calculation of illumination conditions of the face image of the subject by the illumination condition calculation means 112 (S217 in FIG. 5: similar to S109 in FIG. 4) It is executed, and it is determined whether or not the face feature amount is unregistered corresponding to the calculated combination of the face orientation condition and the illumination condition (S218 in FIG. 5). When the face feature amount is not registered corresponding to the combination of the face orientation condition and the illumination condition (S218 in FIG. 5: Yes), the image processing apparatus 10 stores the face feature amount / face orientation condition / illumination condition storage unit 113. Thus, the facial feature quantity of the face image of the subject is registered in the nonvolatile memory 14 in association with the combination of the face orientation condition and the illumination condition (S219 in FIG. 5), and the control is shifted to step S220. At this time, the registered condition similarity determination unit 114 causes the face orientation condition and the illumination condition closest to the calculated face orientation condition and the calculated illumination condition combination from the combinations of the face orientation condition and the illumination condition shown in FIG. Is selected. When the facial feature amount has already been registered corresponding to the combination of the face orientation condition and the illumination condition (S218: No in FIG. 5), the image processing apparatus 10 sets the facial feature amount of the registrant's face image to nonvolatile. Without registering in the memory 14, control is passed to step S220.

一方、類似度最大値Ｐmaxが第１閾値Ｔｈ１未満である場合は（図５のＳ２１５：Ｎｏ)、画像処理装置１０は、ステップＳ２１６〜Ｓ２１９を実行することなく、ステップＳ２２０に制御を移す。 On the other hand, when the similarity maximum value Pmax is less than the first threshold value Th1 (S215: No in FIG. 5), the image processing apparatus 10 shifts the control to step S220 without executing steps S216 to S219.

ステップＳ２２０では、画像処理装置１０は、類似度最大値Ｐmaxと、第２閾値記憶手段１１０に記憶されている、顔画像による個人認証において登録者と認証する類似度の下限値である第２閾値Ｔｈ２とを比較する。 In step S <b> 220, the image processing apparatus 10 stores the similarity maximum value Pmax and the second threshold value that is stored in the second threshold value storage unit 110 and is the lower limit value of the similarity level that authenticates the registrant in personal authentication using a face image. Compare with Th2.

類似度最大値Ｐmaxが第２閾値Ｔｈ２未満である場合は（図５のＳ２２０：Ｎｏ)、画像処理装置１０は、被撮影者の顔画像を登録者以外の顔画像であると判定し、すなわち被撮影者を登録者であるとは認証せずに（図５のＳ２２２)、認証結果を他の機器に送信する（図５のＳ２２３)。 When the maximum similarity Pmax is less than the second threshold Th2 (S220: No in FIG. 5), the image processing apparatus 10 determines that the face image of the subject is a face image other than the registrant, that is, Without authenticating that the subject is a registered person (S222 in FIG. 5), the authentication result is transmitted to another device (S223 in FIG. 5).

他方、類似度最大値Ｐmaxが第２閾値Ｔｈ２以上である場合は（図５のＳ２２０：Ｙｅｓ)、画像処理装置１０は、被撮影者の顔画像を登録者の顔画像であると判定し、すなわち被撮影者を登録者と認証し（図５のＳ２２１)、認証結果を他の機器に送信する（図５のＳ２２３)。 On the other hand, when the maximum similarity Pmax is equal to or greater than the second threshold Th2 (S220 in FIG. 5: Yes), the image processing apparatus 10 determines that the face image of the subject is the face image of the registrant, That is, the person to be photographed is authenticated as a registrant (S221 in FIG. 5), and the authentication result is transmitted to another device (S223 in FIG. 5).

次に、画像処理装置１０は、類似度最大値Ｐmaxが第２閾値Ｔｈ２以上で、かつ、同じ被撮影者が継続して運転席に着座中であるかを判定する（図５のＳ２２４)。同じ被撮影者が継続して運転席に着座中であるかどうかは、例えば、シートに内蔵した荷重センサにより、被撮影者が離席していないことを検出して判断する。 Next, the image processing apparatus 10 determines whether or not the maximum similarity value Pmax is equal to or greater than the second threshold Th2 and the same subject is continuously seated in the driver's seat (S224 in FIG. 5). Whether or not the same subject continues to be seated in the driver's seat is determined by, for example, detecting that the subject is not away by a load sensor built in the seat.

類似度最大値Ｐmaxが第２閾値Ｔｈ２以上で、かつ、同じ被撮影者が継続して運転席に着座中であると判定された場合は（図５のＳ２２４：Ｙｅｓ)、画像処理装置１０は、撮影インターバルの演算後（図５のＳ２２５)、ステップＳ２１０に制御を戻し、ステップＳ２１０〜Ｓ２２４が再度実行する。これにより、顔画像が未登録の顔向き条件および照明条件の組合せに対応させて、顔画像を自動的に順次登録することができる。 When it is determined that the maximum similarity value Pmax is equal to or greater than the second threshold Th2 and the same subject is continuously seated in the driver's seat (S224: Yes in FIG. 5), the image processing apparatus 10 After the calculation of the shooting interval (S225 in FIG. 5), control is returned to step S210, and steps S210 to S224 are executed again. Thus, the face images can be automatically and sequentially registered in correspondence with combinations of face orientation conditions and illumination conditions for which the face images are not registered.

類似度最大値Ｐmaxが第２閾値Ｔｈ２以上で、かつ、同じ被撮影者が継続して運転席に着座中であると判定されなかった場合は（図５のＳ２２４：Ｎｏ)、画像処理装置１０は、顔画像追加登録処理を終了する（図５のＳ２２７)。 When the similarity maximum value Pmax is equal to or greater than the second threshold Th2 and it is not determined that the same subject is continuously seated in the driver's seat (S224: No in FIG. 5), the image processing apparatus 10 Finishes the face image addition registration process (S227 in FIG. 5).

以上のような一連の動作を繰り返すことで、登録者が面倒な顔画像の登録操作を繰り返すことなしに、様々な顔向き条件および照明条件の組み合わせでの顔特徴量を自動的にαに追加登録することができる。このため、顔画像による個人認証時には、自動的に登録された複数の顔特徴量に基づいて認証がなされるため、顔画像撮影時の顔向き条件および照明条件の組合せが理想的な顔向き条件および照明条件の組合せから多少外れていても、登録者を棄却する可能性を低減することができる。 By repeating the series of operations as described above, registrants automatically add facial feature quantities to α in various combinations of face orientation conditions and lighting conditions without repeating troublesome facial image registration operations. You can register. For this reason, when performing personal authentication using a face image, authentication is performed based on a plurality of automatically registered facial feature amounts. Therefore, a combination of face orientation conditions and illumination conditions at the time of face image shooting is an ideal face orientation condition. The possibility of rejecting the registrant can be reduced even if the combination of lighting conditions is slightly different.

なお、本実施例１では、車両の運転者の顔を顔撮影用カメラ４０で撮影した顔画像を利用して個人認証を行うシステムを前提として説明したが、本発明の適用対象が車両での個人認証に限定されるわけではないことはいうまでもない。例えば、図書館，美術館等の入館管理システム、会社，研究所等の入退室管理システム、カメラ付携帯電話機での個人認証システム等の様々な分野で本発明を適用することができる。 In the first embodiment, the description has been made on the premise of a system for performing personal authentication using a face image obtained by photographing the face of the driver of the vehicle with the face photographing camera 40. However, the application target of the present invention is a vehicle. Needless to say, it is not limited to personal authentication. For example, the present invention can be applied in various fields such as an entrance management system for libraries and museums, an entrance / exit management system for companies, laboratories, etc., and a personal authentication system for camera-equipped mobile phones.

以上、本発明の実施例を説明したが、これはあくまでも例示にすぎず、本発明はこれに限定されるものではなく、特許請求の範囲の趣旨を逸脱しない限りにおいて、当業者の知識に基づく種々の変更が可能である。 As mentioned above, although the Example of this invention was described, this is only an illustration, this invention is not limited to this, Based on the knowledge of those skilled in the art, unless it deviates from the meaning of a claim Various changes are possible.

本発明の実施例１に係る顔画像認証装置の構成を示すブロック図。1 is a block diagram showing a configuration of a face image authentication device according to Embodiment 1 of the present invention. 図１中の画像処理装置の構成を示す回路ブロック図。The circuit block diagram which shows the structure of the image processing apparatus in FIG. 図２中の画像処理プログラムの構成を示すブロック図。The block diagram which shows the structure of the image processing program in FIG. 本実施例１に係る顔画像認証装置における顔画像初期登録処理を示すフローチャート。6 is a flowchart illustrating face image initial registration processing in the face image authentication apparatus according to the first embodiment. 本実施例１に係る顔画像認証装置における顔画像追加登録処理を示すフローチャート。5 is a flowchart illustrating face image addition registration processing in the face image authentication apparatus according to the first embodiment. 図５の顔画像追加登録処理における顔画像を登録する顔向き条件および照明条件の組合せの例を示す図。The figure which shows the example of the combination of the face direction conditions and illumination conditions which register the face image in the face image addition registration process of FIG.

符号の説明Explanation of symbols

１０ 画像処理装置
１１ ＣＰＵ
１２ ＲＯＭ
１３ ＲＡＭ
１４ 不揮発性メモリ
２０ ＬＥＤ電流制御装置
３０ ＬＥＤ
４０ 顔撮影用カメラ
１００ 画像処理プログラム
１０１ 顔画像登録起動信号入力手段
１０２ 顔画像登録終了信号入力手段
１０３ 撮影トリガー入力手段
１０４ 登録条件読出し手段
１０５ 他の機器への通信手段
１０６ 画像入力手段
１０７ 顔特徴量演算手段
１０８ 顔特徴量類似度比較手段
１０９ 第１閾値記憶手段
１１０ 第２閾値記憶手段
１１１ 顔向き条件算出手段
１１２ 照明条件算出手段
１１３ 顔特徴量・顔向き条件・照明条件記憶手段
１１４ 登録条件類似度比較手段 10 Image processing device 11 CPU
12 ROM
13 RAM
14 Nonvolatile memory 20 LED current control device 30 LED
40 face photographing camera 100 image processing program 101 face image registration start signal input means 102 face image registration end signal input means 103 photographing trigger input means 104 registration condition reading means 105 communication means 106 to other equipment 106 image input means 107 facial features Quantity calculation means 108 Face feature quantity similarity comparison means 109 First threshold storage means 110 Second threshold storage means 111 Face orientation condition calculation means 112 Illumination condition calculation means 113 Facial feature quantity / face orientation condition / illumination condition storage means 114 Registration conditions Similarity comparison means

Claims (5)

車両に配設される顔画像認証装置であって、
登録者の顔画像の顔特徴量を顔向き条件および照明条件の組合せ毎に登録する記憶手段と、
被撮影者の顔を撮影する顔撮影手段と、
被撮影者の操作に基づいて前記顔撮影手段により撮影された被撮影者の顔画像の顔特徴量を、顔画像撮影時の顔向き条件および照明条件の組合せに対応させて前記記憶手段に初期登録する顔画像初期登録手段と、
被撮影者の所定の動作を契機として前記顔撮影手段により撮影された被撮影者の顔画像の顔特徴量が前記記憶手段に登録されている登録者の顔画像の顔特徴量と類似する場合に、被撮影者の顔画像の顔特徴量を、登録者の顔画像の顔特徴量として、顔画像撮影時の顔向き条件および照明条件の組合せに対応させて前記記憶手段に追加登録する顔画像追加登録手段と、
前記顔撮影手段により撮影された被撮影者の顔画像の顔特徴量が前記記憶手段に登録されている登録者の顔画像の顔特徴量のいずれかと類似する場合に、被撮影者は登録者であると認証する認証手段と、を備え、
前記顔画像初期登録手段が、被撮影者の顔画像から顔特徴量を演算する顔特徴量演算手段と、被撮影者の顔画像から顔向き条件を演算することにより顔の向きを調べる顔向き条件算出手段と、被撮影者の顔画像から照明条件を演算することにより均等照明、右顔面が明るい照明、左顔面が明るい照明、顔面下半分が明るい照明のいずれであるかを決定する照明条件算出手段と、前記顔特徴量を前記顔向き条件および前記照明条件の組合せに対応させて前記記憶手段に登録する顔特徴量・顔向き条件・照明条件記憶手段とを含むことを特徴とする顔画像認証装置。 A face image authentication device disposed in a vehicle,
Storage means for registering the facial feature amount of the registrant's face image for each combination of face orientation condition and illumination condition;
A face photographing means for photographing the face of the subject,
Initial face feature amount of the person to be photographed face image photographed by the face image pickup device based on the operation of the photographer, in the storage means in association with the combination of the face orientation conditions and lighting conditions at the time of face image photographing A face image initial registration means to be registered;
When the facial feature quantity of the face image of the photographed person photographed by the face photographing means triggered by the predetermined action of the photographed person is similar to the facial feature quantity of the registrant face image registered in the storage means Further, the face feature amount of the face image of the photographed person is additionally registered in the storage unit as the face feature amount of the registrant face image in correspondence with the combination of the face orientation condition and the illumination condition at the time of face image shooting. Image additional registration means;
When the facial feature amount of the face image of the subject photographed by the face photographing means is similar to any one of the facial feature amounts of the registrant face image registered in the storage means, the subject is a registered person An authentication means for authenticating that
The face image initial registration means includes a face feature amount calculating means for calculating a face feature amount from the face image of the photographed person, and a face orientation for checking the face direction by calculating a face orientation condition from the face image of the photographed person Illumination conditions that determine whether the condition calculation means and the illumination conditions are calculated from the face image of the photographed person, equal illumination, bright illumination on the right face, bright illumination on the left face, or illumination on the lower half of the face A face comprising: a calculation means; and a face feature quantity / face orientation condition / illumination condition storage means for registering the face feature quantity in the storage means in association with a combination of the face orientation condition and the illumination condition Image authentication device. 前記顔画像追加登録手段が、被撮影者の顔画像から顔特徴量を演算する顔特徴量演算手段と、前記顔特徴量演算手段により演算された顔特徴量と前記記憶手段に登録されている顔特徴量との類似度を演算する顔特徴量類似度比較手段と、前記顔特徴量類似度比較手段により演算された類似度が類似度最大値より大きい場合に当該類似度を類似度最大値に設定する類似度最大値設定手段と、前記類似度最大値設定手段により設定された類似度最大値が第１閾値以上である場合に被撮影者の顔画像から顔向き条件を演算する顔向き条件算出手段と、被撮影者の顔画像から照明条件を演算する照明条件算出手段と、前記顔向き条件および前記照明条件の組合せに対応して顔特徴量が未登録である場合に前記顔特徴量演算手段により演算された顔特徴量を前記顔向き条件および前記照明条件の組合せに対応させて前記記憶手段に登録する顔特徴量・顔向き条件・照明条件記憶手段とを含む請求項１に記載の顔画像認証装置。 The face image addition registration means is registered in the face feature amount calculating means for calculating the face feature amount from the face image of the subject, the face feature amount calculated by the face feature amount calculating means, and the storage means. A face feature quantity similarity comparison unit that calculates a similarity with a face feature quantity, and if the similarity calculated by the face feature quantity similarity comparison unit is greater than the maximum similarity value, the similarity is set to the maximum similarity value And a face orientation for calculating a face orientation condition from the face image of the subject when the similarity maximum value set by the similarity maximum value setting means is equal to or greater than a first threshold. A condition calculation unit, an illumination condition calculation unit that calculates an illumination condition from a face image of the subject, and the face feature when the face feature amount is not registered corresponding to a combination of the face orientation condition and the illumination condition. Facial features calculated by quantity calculation means A face image authentication device according to claim 1 including said face orientation condition and the facial feature quantity and face orientation conditions and lighting condition storage means for registering in the storage means in association with the combination of the illumination conditions. 前記認証手段が、前記類似度最大値と登録者と認証する類似度の下限値である第２閾値とを比較し、前記類似度最大値が前記第２閾値以上である場合は被撮影者を登録者と認証する請求項２に記載の顔画像認証装置。 The authentication means compares the maximum similarity value with a second threshold value that is a lower limit value of the similarity level that authenticates the registrant. If the maximum similarity value is equal to or greater than the second threshold value, The face image authentication device according to claim 2, wherein the face image authentication device authenticates a registrant. 前記第１閾値は、前記第２閾値に比して大きく設定されており、前記顔画像追加登録手段により被撮影者の顔画像が追加登録される場合の方が、前記認証手段により登録者と認証される場合よりも拒否される可能性が高く設定されている請求項３に記載の顔画像認証装置。The first threshold value is set to be larger than the second threshold value. When the face image of the photographed person is additionally registered by the face image additional registration unit, the authentication unit and the registrant The face image authentication apparatus according to claim 3, wherein the face image authentication apparatus is set to have a higher possibility of being rejected than when authenticated. 被撮影者の顔を照明する照明手段を備える請求項１ないし４のいずれか１項に記載の顔画像認証装置。 Face image authentication device according to any one of claims 1 comprises an illumination means for illuminating the face of the person to be photographed 4.
JP2005281487A 2005-09-28 2005-09-28 Face image authentication device Expired - Fee Related JP4553138B2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2005281487A JP4553138B2 (en) 2005-09-28 2005-09-28 Face image authentication device
KR1020060094045A KR100826309B1 (en) 2005-09-28 2006-09-27 Device for authenticating face image
DE102006045752A DE102006045752B4 (en) 2005-09-28 2006-09-27 Facial image authentication device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2005281487A JP4553138B2 (en) 2005-09-28 2005-09-28 Face image authentication device

Publications (2)

Publication Number Publication Date
JP2007094637A JP2007094637A (en) 2007-04-12
JP4553138B2 true JP4553138B2 (en) 2010-09-29

Family

ID=37980300

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2005281487A Expired - Fee Related JP4553138B2 (en) 2005-09-28 2005-09-28 Face image authentication device

Country Status (3)

Country Link
JP (1) JP4553138B2 (en)
KR (1) KR100826309B1 (en)
DE (1) DE102006045752B4 (en)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009011401A1 (en) * 2007-07-19 2009-01-22 Nec Corporation Living body information registering device, living body information registering method and living body information registering program
JP5104369B2 (en) * 2008-02-13 2012-12-19 日産自動車株式会社 Face recognition device and face recognition method
JP2009245338A (en) * 2008-03-31 2009-10-22 Secom Co Ltd Face image collating apparatus
JP5123037B2 (en) * 2008-04-16 2013-01-16 パナソニック株式会社 Face authentication apparatus and face authentication method
JP2014116033A (en) * 2008-06-16 2014-06-26 Canon Inc Personal authentication device, personal authentication method, camera, program, and storage medium
JP2010027035A (en) * 2008-06-16 2010-02-04 Canon Inc Personal authentication equipment and personal authentication method
JP4844670B2 (en) * 2009-11-13 2011-12-28 日本ビクター株式会社 Video processing apparatus and video processing method
JP5434708B2 (en) * 2010-03-15 2014-03-05 オムロン株式会社 Collation apparatus, digital image processing system, collation apparatus control program, computer-readable recording medium, and collation apparatus control method
JP2012014568A (en) * 2010-07-02 2012-01-19 Omron Corp Monitoring apparatus and method, and program
KR101172213B1 (en) 2010-12-08 2012-08-07 현대자동차주식회사 System and Method for face identification
JP2012203668A (en) * 2011-03-25 2012-10-22 Sony Corp Information processing device, object recognition method, program and terminal device
KR101241625B1 (en) 2012-02-28 2013-03-11 인텔 코오퍼레이션 Method, apparatus for informing a user of various circumstances of face recognition, and computer-readable recording medium for executing the method
US9177130B2 (en) 2012-03-15 2015-11-03 Google Inc. Facial feature detection
JP6197613B2 (en) 2013-12-02 2017-09-20 富士通株式会社 Biological information extraction device, biological information extraction method, and biological information extraction program
NZ738874A (en) 2015-06-30 2019-11-29 Nec Corp America Facial recognition system
CN111382681B (en) * 2020-02-28 2023-11-14 浙江大华技术股份有限公司 Face registration method, device and storage medium
JP7093037B2 (en) * 2020-10-28 2022-06-29 キヤノンマーケティングジャパン株式会社 Information processing equipment, face recognition system, its control method and program
US20240321005A1 (en) * 2021-07-09 2024-09-26 Nec Corporation Authentication system, authentication apparatus, authentication method, and recording medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001043373A (en) * 1999-07-29 2001-02-16 Yis Corporation Co Ltd Device for discriminating whether operation is to be permitted
JP2003317101A (en) * 2002-04-23 2003-11-07 Samsung Electronics Co Ltd Method for verifying face using method for automatically updating database and system therefor
JP2003346158A (en) * 2002-05-28 2003-12-05 Toshiba Corp Face area tracking method by face image
JP2005056004A (en) * 2003-08-07 2005-03-03 Omron Corp Unit, method and program for face collation

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6181805B1 (en) * 1993-08-11 2001-01-30 Nippon Telegraph & Telephone Corporation Object image detecting method and system
US6345109B1 (en) 1996-12-05 2002-02-05 Matsushita Electric Industrial Co., Ltd. Face recognition-matching system effective to images obtained in different imaging conditions
SG103253A1 (en) 2000-01-26 2004-04-29 Kent Ridge Digital Labs Method and apparatus for cancelling lighting variations in object recognition
JP3575679B2 (en) * 2000-03-31 2004-10-13 日本電気株式会社 Face matching method, recording medium storing the matching method, and face matching device
TWI299471B (en) * 2001-08-24 2008-08-01 Toshiba Kk Person recognition apparatus
JP2003178274A (en) 2001-12-12 2003-06-27 Nippon Signal Co Ltd:The Issuing device and issuing system for information storage medium used for access control
US7653219B2 (en) * 2002-01-22 2010-01-26 Photoinaphoto.Com System and method for image attribute recording an analysis for biometric applications
AU2002951625A0 (en) * 2002-09-24 2002-10-10 Biometix Pty Limited System for improving and modifying object illumination using active light sources
JP4314016B2 (en) * 2002-11-01 2009-08-12 株式会社東芝 Person recognition device and traffic control device
JP4057501B2 (en) 2003-10-03 2008-03-05 東芝ソシオシステムズ株式会社 Authentication system and computer-readable storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001043373A (en) * 1999-07-29 2001-02-16 Yis Corporation Co Ltd Device for discriminating whether operation is to be permitted
JP2003317101A (en) * 2002-04-23 2003-11-07 Samsung Electronics Co Ltd Method for verifying face using method for automatically updating database and system therefor
JP2003346158A (en) * 2002-05-28 2003-12-05 Toshiba Corp Face area tracking method by face image
JP2005056004A (en) * 2003-08-07 2005-03-03 Omron Corp Unit, method and program for face collation

Also Published As

Publication number Publication date
DE102006045752A1 (en) 2007-05-16
KR20070035989A (en) 2007-04-02
JP2007094637A (en) 2007-04-12
DE102006045752B4 (en) 2011-06-01
KR100826309B1 (en) 2008-04-30

Similar Documents

Publication Publication Date Title
JP4553138B2 (en) Face image authentication device
US9652663B2 (en) Using facial data for device authentication or subject identification
US7536037B2 (en) Apparatus and method for human distinction using infrared light
JP4826234B2 (en) Face authentication apparatus, security strength changing method and program
CN110443016B (en) Information leakage prevention method, electronic device and storage medium
US8320642B2 (en) Face collation apparatus
EP2336949B1 (en) Apparatus and method for registering plurality of facial images for face recognition
US8422746B2 (en) Face authentication system and authentication method thereof
JP5076563B2 (en) Face matching device
US20100014720A1 (en) Fraud Resistant Biometric Financial Transaction System and Method
US20070113099A1 (en) Authentication apparatus and portable terminal
US8280122B2 (en) Registration device, collation device, extraction method, and program
JP2006259923A (en) Object authentication device, face authentication device, cellular phone, object authentication unit, object authentication method, and object authentication program
JP2006330936A (en) Face authentication device
JP5955031B2 (en) Face image authentication device
JP2003178306A (en) Personal identification device and personal identification method
WO2014084249A1 (en) Facial recognition device, recognition method and program therefor, and information device
JPWO2020079741A1 (en) Iris recognition device, iris recognition method, iris recognition program and recording medium
KR101000130B1 (en) Mobile terminal capable face recognition and method for face recognition thereof
JP4320775B2 (en) Face recognition device
JP2003308524A (en) Access control system
US20230118532A1 (en) Method and system for detecting a spoofing attempt
CN116030513A (en) Face authentication system, vehicle including face authentication system, and face authentication method
JP2023007006A (en) Face authentication system and face authentication method
US20240046696A1 (en) System and method for detecting an object within an image

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20071015

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20100319

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20100324

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20100518

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20100623

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130723

Year of fee payment: 3

R151 Written notification of patent or utility model registration

Ref document number: 4553138

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20100706

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130723

Year of fee payment: 3

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees