EP1955290B1 - Mit mehreren gesichtserkennungssystemen kompatible verteilte id-überprüfung auf abstand - Google Patents

Mit mehreren gesichtserkennungssystemen kompatible verteilte id-überprüfung auf abstand Download PDF

Info

Publication number
EP1955290B1
EP1955290B1 EP06851924A EP06851924A EP1955290B1 EP 1955290 B1 EP1955290 B1 EP 1955290B1 EP 06851924 A EP06851924 A EP 06851924A EP 06851924 A EP06851924 A EP 06851924A EP 1955290 B1 EP1955290 B1 EP 1955290B1
Authority
EP
European Patent Office
Prior art keywords
face
rfid
computer
facial
individual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP06851924A
Other languages
English (en)
French (fr)
Other versions
EP1955290A2 (de
Inventor
Michael E. Bazakos
David W. Meyers
Vassailios Morellas
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honeywell International Inc
Original Assignee
Honeywell International Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/290,524 external-priority patent/US7817013B2/en
Priority claimed from US11/290,523 external-priority patent/US7843313B2/en
Application filed by Honeywell International Inc filed Critical Honeywell International Inc
Publication of EP1955290A2 publication Critical patent/EP1955290A2/de
Application granted granted Critical
Publication of EP1955290B1 publication Critical patent/EP1955290B1/de
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00—Individual registration on entry or exit
    • G07C9/20—Individual registration on entry or exit involving the use of a pass
    • G07C9/22—Individual registration on entry or exit involving the use of a pass in combination with an identity check of the pass holder
    • G07C9/25—Individual registration on entry or exit involving the use of a pass in combination with an identity check of the pass holder using biometric data, e.g. fingerprints, iris scans or voice recognition
    • G07C9/257—Individual registration on entry or exit involving the use of a pass in combination with an identity check of the pass holder using biometric data, e.g. fingerprints, iris scans or voice recognition electronically

Definitions

  • the present invention relates generally to methods and systems for security identification, and more particularly, to methods and systems for personnel biometric verification.
  • Security access control is an important issue for maintaining the safety of individuals and facilities.
  • personnel In a typical gate security system for a large facility, personnel must show their ID cards and/or display authorization tags on vehicles or on the person in order to gain access to the facility.
  • personnel can use a data card, such as an electronic data card, to release a gate to gain access to the facility.
  • a data card such as an electronic data card
  • RFID system 10 comprises three basic elements: an antenna or coil 11, a transceiver 12 (with decoder) and a transponder 13 (i.e., an RFID tag) electronically programmed with unique identification information.
  • Antenna 11 emits radio frequency signals to activate tag 13 and read and write data to it, and functions as a conduit between tag 13 and transceiver 12.
  • Antenna 11 can take on various shapes and sizes.
  • antenna 11 can be built into a door frame to receive tag data from persons or things passing through the door, or mounted on structures such as an interstate toll booth to monitor the traffic passing on a highway.
  • Antenna 11 is often packaged with transceiver 12 and decoder (not shown) to function as a reader (or interrogator), which can be configured either as a handheld or a fixed-mount device.
  • the reader emits radio waves in a range of one inch to 100 feet or more, thereby establishing a predetermined electromagnetic zone.
  • the reader decodes the data encoded in the tag's integrated circuit and the data is passed to a host computer 15 via an RF module 16 for processing.
  • RFID tags 13 can be either active or passive. Active RFID tags are powered by an internal battery and are typically readable and rewriteable. In a typical read/write RFID system, an active RFID tag delivers a set of instructions to a machine, and the machine then reports its performance to the tag. In contrast, passive RFID tags operate without a separate external power source and obtain power generated from the reader.
  • RFID tags can be read through a variety of substances such as snow, fog, ice, paint, and other visually and environmentally challenging conditions. RFID tags can also be read under challenging circumstances such as when vehicles pass points at relatively high speeds. A typical reader can respond to an RFID tag in less than 100 milliseconds.
  • RFID systems have been used to control facility access through a gate.
  • individuals carry an RFID tag or display an RFID tag in their vehicle.
  • a reader composed of a transceiver and an antenna is installed at or near the gate so that when the individual is close to the gate, the reader reads the data embedded in the tags and sends the data to a computer for identification. If the data from the tag indicate that the individual or the vehicle is permitted entry, the gate will open to allow the individual or vehicle to enter. On the other hand, if the data shows that the individual or vehicle is not permitted entry, the gate will remain closed. In some cases, a guard will stop the vehicle to acquire more information from the individual or driver of the vehicle.
  • An indication device 17, such as a red/green light, may also be provided.
  • Biometric verification for example, patent application US 2005/0218215 , is now being employed more frequently to verify personnel identification.
  • Such systems typically comprise a database storing personal biometric information, such as facial templates or features, finger prints, hand geometry, iris prints, thermograms, and skin colors of personnel.
  • biometric information such as facial templates or features, finger prints, hand geometry, iris prints, thermograms, and skin colors of personnel.
  • the system takes an image or an image sequence of a person and then performs a "one-to-many" verification database search against the images stored in the database. This is done using 2D or 3D imaging technology.
  • a one-to-many search is very slow and often unreliable.
  • present biometric verification systems typically require facial verification in a benign lighting and background environment with no relative facial movement.
  • the person who is requesting access must either stay still or move in a prescribed fashion while the system takes his/her image, or the individual must present their fingers or iris in direct contact to a biometric reader. This presentation requires direct contact and increases the overall time needed for completing the verification task.
  • the present invention provides a system as defined in Claim 1.
  • the system may incude the features of any one or more of dependent claims 2 to 9.
  • the present invention provides a fast and secure verification method and system that can dynamically identify vehicles and/or personnel by combining RFID and advanced facial detection and recognition techniques.
  • the method functions without requiring a vehicle and/or an individual to be in a particular place or posture, or come into physical contact with a biometric device.
  • the present invention provides a method and system for dynamic stand-off biometric verification, in which a tri-band imaging scheme is employed to detect and recognize the face of an enrolled individual whose physical ID and an assigned RFID tag are related in an enrollment database.
  • a method for providing dynamic security verification comprises storing data regarding personal information and a face print (template) of the person in a database, wherein the face print is represented by numerical codes of a face digital image of the person.
  • the method further comprises recording data regarding the personal ID information in a radio frequency identification (RFID) tag, reading data from the RFID tag, comparing the data with those stored in the database, retrieving a face print (usually a template) corresponding to the data read from the RFID from the database, and scanning (imaging) the face of the person in two near-IR bands in the reflective region of the spectrum to obtain two facial images.
  • RFID radio frequency identification
  • the method then performs a weighted subtraction of the two facial images (fusion), and thresholds the resulting image to obtain an image of the exposed skin of the person.
  • the method also performs a video scan of the face of the person, overlays the thresholded image (skin image on the video image (registered)), performs a model-based approach to determined the face part of the skin in the video image (face detection) and then compares the detected face with the retrieved face print.
  • the face of the person i.e., three-band facial images: low near-IR band, upper near-IR band, and the visible band mentioned above
  • TBI Tri-Band Imaging
  • a system for dynamical stand-off verification comprises an RFID tag on which an ID number is stored, a computer database for storing data regarding information and face prints and other personal information of a plurality of individuals, an RFID tag reader for reading the ID from the RFID tag, a facial recognition system for scanning the face of the personnel and obtaining facial images for the personnel, and a computer for processing the data read by the RFID tag reader and the facial images obtained by the facial recognition system.
  • the IDs of the vehicle and driver read by the RFID reader and the scanned facial images are sent to the computer.
  • the computer according to the received RF IDs, retrieves the vehicle ID and personnel ID from the database and determines if the received ID matches with stored ID's.
  • the computer also processes the facial images from the TBI camera to obtain a final facial image, retrieves stored images from the database and compares the two.
  • the facial detection and recognition system comprises a near-IR illuminator for generating near-IR light, an illumination adjustment module for adjusting the near-IR light based on environmental lighting conditions, a TBI camera for precise face detection and location, and a computer for processing the facial images to complete the verification process.
  • the present invention also provides alternative embodiments of methods and systems for dynamic and stand-off verification.
  • One alternative embodiment of the present invention is to store a face template of an individual in an RFID personal tag along with personal information of the individual.
  • the personal information of the individual is also stored in a database that is coupled with a computer.
  • the computer can be a central host computer of a facility or a local computer at a control gate.
  • a RFID tag reader reads data from the RFID personal tag and sends the data to the computer for further processing.
  • the computer decodes the data, relates a read RFID number to the information stored in the database, and decodes/decrypts the face template that is stored in the RFID personal tag.
  • a facial recognition system dynamically takes a picture of the individual and obtains a facial image of the individual. The facial image is also sent to the computer.
  • the computer compares the decoded face template with the facial image for biometric verification.
  • the present disclosure may also provide a method for providing dynamic security verification.
  • the method comprises recording data regarding information and a face print of a person in a RFID device that is carried by the person, reading the RFID device and relating a read RFID number to information stored in a database, dynamically obtaining a facial image of the person, retrieving the face print from the RFID device, and comparing the retrieved face print with the facial image of the person.
  • the method for providing dynamic security verification at a facility can be performed using only local computers located at control gates or, for example, on each floor of a building.
  • the RFID personal tag may store a set of digital images of the face of the owner of the RFID tag and/or a set of processed face templates, each of which is formatted in accordance with a specific facial recognition system (FRS) technology.
  • FRS facial recognition system
  • the RFID personal tag may also store identifying codes that correspond to the formats of the FRS technology. Accordingly, the face templates stored in the RFID personal tag can be read and decoded by a computer that may be operating in accordance with one of several possible FRS technologies.
  • the stored digital images and/or face templates provide protection against counterfeiting, identity theft, and other misuses, as follows: In the case that the host computer FRS currently in use recognizes one of the templates retrieved from the RFID tag as its own, it accepts it as the "enrolled" face template for the person carrying the RFID tag. Then a new digital image is acquired of the person presenting the RFID tag and the corresponding new "real-time” face template is computed. Finally a match is made between the "enrolled" template and the new acquired "real-time” template.
  • the host computer FRS currently in use does not recognize one of the templates retrieved from the RFID tag as its own (this would be, for example, the case when new FRS systems are developed and used after the issuance of the RFID tag,) it processes the digital images received from the RFID tag and generates its own "enrolled" face template for the person to whom the RFID tag was issued by the competent authority. Then a new digital image is acquired of the person presenting the RFID tag and the corresponding new "real-time" face template is computed. Finally a match is made between the "enrolled" template and the new acquired "real-time” templates.
  • the system of the present invention leverage RFID and dynamic biometric verification techniques to provide secure and fast access control solutions.
  • the system preferably utilize a tri-band imaging (TBI) system that can dynamically capture a face within the context of an ambiguous image frame.
  • TBI tri-band imaging
  • the resulting facial image is then uniquely linked by information gleaned from an RFID tag to a stored facial image template in a database.
  • the present invention utilizes RFID to identify vehicles and personnel in combination with a dynamic facial recognition technique to identify face prints of the personnel, the present invention is capable of capturing key vehicle information and biometric data while a vehicle is moving at relative high speeds.
  • a dynamic facial recognition biometric scheme can scan a facial image of a subject, even at vehicle speeds up to about 40 miles per hour.
  • An RFID scheme can read data from RFID tags at an even higher rate. Therefore, the present invention is particularly beneficial for use as a gate access control system for vehicles and personnel at a main gate of a facility, such as a military base, a governmental office or other locations that require increased security measures.
  • the present invention is not limited to gate access control applications.
  • the dynamic biometric verification of the present invention can also be beneficially used inside an office building to control personnel entering into different work areas. Furthermore, by double-checking the identification of a person by matching the RFID information and the facial information, the system of the present invention is capable of providing more secure identification.
  • RFID READER In the following descriptions, "RFID READER”, “RFID PERSONAL READER”, “Read RFID Personal Tag, ", and “Read RFID Personal Smart Card, " shown in Figures 2 (reference number 22), 3 (reference number 34), 4 (reference number 42), 8 (reference number 81), 9( reference number 91), and 10 (reference number 102) at least read or may be interpreted by reading multiple types of data associated with the person who the RFID card was issued to by the authorities, and which data are already stored in the RFID tag, including but not limited to: RFID number assigned, face prints (facial templates) corresponding to known FRS, FRS ID numbers, one or several digital image chips of the face of the owner, and additional personal data of the owner (SSN, employee ID number, address, phone number, DOB, etc.)
  • FIG. 2 is a schematic block diagram of a security system in accordance with a first embodiment of the present invention.
  • the security system of Figure 2 comprises a central computer (not shown) that preferably first stores relationship information of personnel and (if desired) their vehicles, as well as the personnels' biometric features in a database 21. This function can also be performed by (local) computer 24.
  • the relationship information of the personnel and their vehicles may include, for example, the license plate numbers, model types and colors of the vehicles.
  • the biometric features of the personnel may include, for example, their facial images/ photographs, their processed templates, and other data such as racial information (for example, facial skin and features) and cultural information (for example, the wearing of hats, hair styles, etc.).
  • the facial information may be encoded by an exemplary local feature analysis (LFA) algorithm, which maps a face and creates a "face print" that is a unique numerical code for that face.
  • LFA local feature analysis
  • RFID tags (not shown) on which is recorded personnel unique ID numbers, are given to the personnel for carrying and/or displaying on their vehicles.
  • a vehicle RFID tag uniquely identifies a vehicle, and a personnel RFID tag that uniquely identifies the person who drives or owns the vehicle.
  • the RFID vehicle tag may be mounted on the vehicle and the RFID personnel tag may be carried by the person.
  • the system of Figure 2 further includes an RFID tag reader 22 and a facial image reader 23, such as a TBI camera.
  • the RFID tag reader 22 is used to read data from RFID tags carried by personnel and/or mounted on vehicles, such as the RFID vehicle tags and the RFID personnel tags mentioned above.
  • RFID tag reader 22 may include an RFID vehicle tag reader and an RFID personnel tag reader (both of which will be described with reference to Figure 3 ) for reading data from the RFID vehicle tag and the RFID personnel tag, respectively.
  • the RFID vehicle tags may be the passive type that do not have batteries, and the RFID personnel tags may be the active type, which includes batteries, as described with respect to Figure 1 .
  • Facial image reader 23 is used to take a digital facial image of a person who intends to pass through an access gate.
  • the data read by readers 22 and 23 are then sent to computer 24 for further processing.
  • the indication device 25 may be an indication light.
  • the indication device 25 may be a lock controlling device that releases a lock when the vehicle and/or personnel are authorized entry, and keeps the lock locked when any of the vehicle data, personnel data and facial image does not match with stored information.
  • FIG. 3 shows an exemplary security system in accordance with a first embodiment of the present invention.
  • the security system of Figure 3 is employed at a main gate of an organization or company to identify vehicles and drivers. Any vehicle (such as vehicle 33) and personnel who intend to pass through gate 39 is required to carry passive RFID vehicle tags 332 and/or active RFID personnel tags 331 (although both devices could be active or both could be passive.)
  • the security system includes passive RFID vehicle tag reader 32 and/or active RFID driver tag reader 34 that are installed at a distance from gate 39 for reading the RFID vehicle tags carried by vehicle 33 and the RFID personnel tags carried by personnel riding in vehicle 33.
  • the passive RFID vehicle tag reader 32 and the active RFID driver tag reader 34 are separate readers in the embodiment, these two readers may be also included in a single reader 31.
  • the system also preferably includes facial recognition system 36 that is installed closer to gate 39 for scanning facial images of the personnel in vehicle 33.
  • the system further includes a computer 38 that is installed in a guard booth or a control office at gate 39 and is preferably remotely connected with a central computer (not shown).
  • RFID vehicle tag reader 32 and RFID personnel tag reader 34 are arranged at locations close to sensing point 35. Therefore, when vehicle 33 passes through sensing point 35, such as a light beam, passive RFID vehicle tag reader 32 is first activated to read data from the RFID vehicle tag. Next, active RFID personnel tag reader 34 is activated to read data from the RFID personnel tag. The data read by readers 32 and 34 are immediately recorded and sent to computer 38 for further processing. It is noted that those data can be temporarily recorded in a database of the central computer or in a local database of computer 38. After an identification is complete, the data can be erased immediately or erased automatically after a period of time.
  • a digital image camera such as TBI camera 361 installed in association with facial recognition system 36 takes a facial image of the driver, creates a face print for this particular driver, and sends the face print to computer 38.
  • computer 38 After gathering all the data sent from readers 32, 34 and 36, computer 38 then retrieves information regarding the vehicle tag ID and the personnel tag ID sent from readers 32 and 34 to check if the read IDs match with the IDs stored in the database. Computer 38 also compares the face print which was just created with thousands of face prints stored in the database for a facial recognition. However, in a preferred embodiment, the computer 38 retrieves a stored face print which corresponds to the RFID data read by readers 32 and 34 to compare the stored face print with the just-created face print for a one-to-one matching. If the information matches, gate 39 will be opened to allow vehicle 33 to enter. If information does not match with data stored in the database, vehicle 33 can be stopped for further verification.
  • the system of Figure 3 may further include an indication light 37 which illuminates, for example, a green light when the driver and vehicle are authorized entry (authenticated), or a red light when unauthorized vehicle, unauthorized individual or incompatible face print is detected.
  • active RFID reader 34 and facial recognition reader 36 substantially simultaneously read each individual's RFID personnel tag and their facial images and create their individual face prints when vehicle 33 passes through readers 34 and 36.
  • computer 38 retrieves the stored data from the database for matching and then indicates if those individuals and vehicle are authorized to enter the gate.
  • a dynamic stand-offbiometric verification method is explained below with reference to Figure 4 .
  • vehicle 33 When vehicle 33 passes through sensing point 35, it actives RFID vehicle tag reader 32, RFID personal tag reader 34 and facial recognition reader 36. As readers 32, 34 and 36 are arranged in an order from a distance to gate 39, RFID vehicle tag reader 32 first reads data from RFID vehicle tag. The data is then recorded and sent to computer 38, as shown at step 41.
  • RFID personal tag reader 34 reads data from RFID personnel tag. As indicated in step 41, the data is also recorded and sent to computer 38.
  • camera 53 shown in Figure 5 ) takes images of personnel in the vehicle. The images are also recorded and sent to computer 38 for further processing.
  • step 44 computer 38 decodes the data read from readers 32, 34, and 36, retrieves relevant data from database and compares those data.
  • the relevant data may include information about vehicle 33, information about personnel who are riding in vehicles 33 and their face prints that are stored in the database.
  • the process moves to step 45.
  • step 45 computer 38 processes the facial images, detects the faces, and compares the detected faces with the retrieved face prints.
  • a guard is preferably available to stop vehicle 33 to ask for more identification information, as shown at step 46.
  • the vehicle may be directed to another area which is separated from gate 39.
  • a guard at this separate area may stop the vehicle and ask for more identification information. Upon investigation of other identification information, the guard can then decide if vehicle 33 and personnel are to be granted or denied entry through gate 39, as shown at steps 47 and 48.
  • the matching process performed by computer 38 is preferably accomplished in, perhaps, less than 1 second, so that a guard at gate 39 can react and stop the vehicle in time should the vehicle and/or personnel not be authenticated. So that this is possible, RFID reader 32 and 34, and facial recognition reader 36 are preferably installed far enough forward of gate 39.
  • when passing by facial recognition reader 36 it is not necessary for the driver to stop the vehicle or stay still for reader 36 to take the facial image.
  • computer 38 has determined if this vehicle and/or driver are authenticated and has gate 39 react accordingly. This feature is beneficial because the system verifies the vehicle and personnel so rapidly that traffic congestion at the gate can be avoided. Furthermore, because the system described herein is non-invasive, personnel in vehicles hardly notice the higher security level that is achieved.
  • the present invention preferably employs a facial recognition scheme that uses a near-infrared light spectrum to scan facial images by sensing the reflective IR light of human faces.
  • the reflective near-infrared (near-IR) light spectrum scheme avoids a characteristic problem found in conventional visual spectrum systems in which a computer system may intermittently fix on, and attempt to analyze a non-facial portion of the image.
  • the facial recognition scheme of the present invention can quickly locate a face out of surrounding backgrounds so that the biometric data can be more efficiently captured and compared to that in the database. In turn, the processing speed of the facial recognition aspect of the system is greatly reduced.
  • the facial recognition scheme of the present invention preferably uses a tri-band imaging (TBI) system, which uses common optics in low band near-IR, high band near-IR and visual band to analyze, detect and match a face.
  • TBI tri-band imaging
  • FIG. 5 is a schematic diagram of a facial recognition system that is preferably used in the present invention for,identifying a facial image of a subject.
  • the facial recognition system includes near-IR illuminator S1 for generating near-IR light with both high wavelength bands and low wavelength bands on subject 57 (which may be a person or several persons), a power supply for supplying power to near-IR illuminator 51, and a TBI camera 53 for taking three digital images of subject 57.
  • the facial recognition reader 36 of Figure 3 preferably employs the facial recognition system of Figure 5 .
  • the system may also include an illumination adjustment module 58 that evaluates current luminance level in the scene and adjusts power output from power supply 53 to change a light level of near IR illuminator 51.
  • facial images of subject 57 are taken, the images are then sent to computer 54 (same as computer 38 in Figure 3 ) for processing to detect the face.
  • computer 54 searches database 55 for stored face prints that correspond to data read from RFID personnel tag and/or RFID vehicle tag and compares the face print just obtained with stored face print/face prints.
  • Figure 6 shows a flow chart of a facial recognition method that can be practiced with the system of Figure 5 .
  • a facial recognition reader such as reader 36 in Figure 3
  • camera 53 takes pictures of a driver in the low near-IR band and high near-IR band. Images obtained by these two light bands are then sent to computer 54 for processing, as shown at step 61.
  • illuminator adjustment module 58 constantly detects the luminance level at the scene and adjusts the illumination level of illuminator 51, at step 62.
  • Computer 54 first performs a series of operations to isolate the skin in the images.
  • computer 54 performs multi-band extraction operations to detect the face.
  • the skin detection and face detection steps are preferably performed via tri-band image recognition.
  • a face is detected.
  • computer 54 retrieves a face print from database 55 and compares the retrieved face print with the detected face. After a matching comparison, a result showing the recognized face image matches or does not match with the retrieved face print is obtained, as shown at step 67. If it matches, a gate (such as gate 39 of Figure 3 ) or a door (not shown) is released to allow vehicle and/or individuals to enter. If it does not match, the gate or door preferably remains locked.
  • computer 54 can retrieve the face print from database 55 according to data read from RFID vehicle tag and/or RFID personal tag that subject 57 drives and/or carries to perform a one-to-one matching comparison process.
  • Computer 54 can also retrieve a number of face prints from database 55, thereby performing a one-to-many matching comparison process.
  • Figure 7 further explains a tri-band image detection and recognition process employed in the steps shown in Figure 6 .
  • the facial recognition method preferably utilizes low band near-IR light, high band near-IR light and visual band light to scan and detect a human face.
  • the method scans the facial image with low near-IR light and at step 72, the method scans the facial image with high near-IR light.
  • a high band image obtained at step 72 is subtracted (weighed) from a low band image obtained at step 71 and thresholded to obtain a skin image from the two near-IR images.
  • a feature image is extracted from the two near-IR images of steps 71 and 72 by a multi-band extraction scheme.
  • step 75 computer 54 processes, as necessary, the feature image and the skin image obtained at steps 73 and 74, respectively.
  • Processing may include, e.g., a series of generalized Hough transforms or model-sized algorithms. Such transforms or algorithms often lead to a good approximation of the location of the eyes, eyebrows, nose and mouth. And, based on the distance and relation between these features, a two-dimensional orientation and extent of the face is more easily obtained, at step 76.
  • the obtained face is then compared by computer 54 with a retrieved face print from the database for matching.
  • the system of the present invention can effectively verify personnel and/or vehicles at a control gate by identifying data from RFID tags and matching facial images of the personnel with stored face prints.
  • the method and system of the present invention can also be utilized in a building for controlling personnel access to different secured work areas.
  • a facial recognition reader such as reader 23 of Figure 2 can be installed at access control doors of each work area for capturing facial images of personnel. The data read from RFID personal tag and the facial image are then sent to a control computer for a verification process.
  • a second camera can also be installed inside of gate 39 for monitoring vehicle 33 after the vehicle is allowed to enter gate 39.
  • This embodiment provides yet another level of security to the facility.
  • the use of such a second camera is sometimes referred to as post-processing.
  • the face prints of the personnel of a facility are pre-stored in templates in a database of a host computer that is remotely connected with a local computer, such as computer 38 of control gate 39 of Figure 3 .
  • the face print templates are generated during an enrollment stage, that is, when the personnel obtains security credentials.
  • local computer 38 at control gate 39 retrieves face prints from the host computer for comparing with facial images obtained by facial recognition reader 36 near local control gate 39. This embodiment works well when local computer 38 is successfully connected with the host computer. However, when the connection between local computer 38 and the host computer is interrupted, local computer 38 cannot retrieve face prints from the host computer, causing an interruption in biometric verification.
  • This potential problem can be solved by storing the face print templates in local computer 38.
  • this solution in accordance with the present invention, requires that local computer 38 have a large storage capacity.
  • the formats of encoding the facial images at facial recognition reader 36 are fixed and specific to the format of the face print templates.
  • the present invention provides several alternative embodiments.
  • One alternative is to store not only basic information on the RFID personal tags, but also to store the digital face and the face prints themselves, which would normally be stored in a central database of a host computer, in accordance with the previously-described embodiments.
  • These RFID personnel tags, including face prints or image chips, can be referred to as "smart cards.”
  • control gates require rapid security checks for vehicles, drivers and passengers, storing face prints only in a host computer is not always efficient.
  • a large facility usually has more than one point of entry (i.e., more than one control gate), but has only one host computer storing the face prints of all of the personnel.
  • the speed of retrieving the face prints from the host computer may be detrimentally effected.
  • the host computer is "down," local computers at each of the control gates will not be able to connect with the host computer. Under such circumstances, it would become impossible to perform biometric verifications as described above.
  • a digital face image and/or templates of the face of a person is stored directly on an RFID smart card.
  • the RFID smart card can be RFID personnel tag 331 like that depicted in Figure 3 , which also stores information about the person, such as the skin tone, the vehicle he/she is driving, etc.
  • FIG 8 is a schematic diagram of an alternative embodiment of the present invention, in which local computer 88 at control gate 89 is coupled with remote host computer 84, and vehicle 83 carries RFID vehicle tag 832 and RFID personal smart tags 831 that belongs to a driver and/or passengers of vehicle 83, respectively.
  • vehicle 83 carries RFID vehicle tag 832 and RFID personal smart tags 831 that belongs to a driver and/or passengers of vehicle 83, respectively.
  • RFID vehicle tag reader 82 and RFID smart card reader 81 are activated to read data stored in vehicle tag 832 and smart card 831.
  • camera 861 takes a picture of the driver.
  • the picture of the driver is then sent to facial recognition reader 86 to be encoded into a facial image.
  • the facial recognition system used by facial recognition reader 86 has been described with reference to Figures 5-7 and, thus, its description is omitted here.
  • the data read by RFID vehicle reader 82 and RFID smart card reader 81 and the facial image obtained by facial recognition reader 86 are sent to local computer 88 of control gate 39 for processing.
  • Local computer 88 is preferably capable of retrieving face prints stored in face print templates of host computer 34 and decoding the face prints that are pre-stored in RFID smart card 831. Therefore, when the connection between local computer 88 and the host computer 84 is interrupted (as shown), local computer 88 can still decode (and perhaps display) the face print from RFID smart card 831.
  • Local computer 88 compares the decoded face print with the facial image obtained from facial recognition reader 86 to see if they match. If they match, which means that vehicle 83 and the driver are authenticated, indication light 87 turns green and gate 89 is opened to allow vehicle 83 to enter. If the data do not match, a guard may then direct vehicle to leave via exit 80.
  • the local computer may also operate independently from host computer. This case is illustrated in an embodiment shown in Figure 9 .
  • local computer 98 of control gate 99 does not connect with host computer 94.
  • local computer 98 includes a database 981 that pre-stores data relative to registered vehicles and personnel.
  • Local computer 98 also has the capability of decoding and retrieving face prints from RFID personal smart card 931.
  • vehicle 93 passes through sensing point 95, data stored in vehicle tag 932 and personal smart card 931 carried by vehicle 93 and the driver are read by RFID vehicle tag reader 92 and RFID smart card reader 91, respectively, and are sent to local computer 98 for further processing. Based on the read data, local computer 89 searches relevant data stored in its database 981.
  • local computer 89 decodes the face print stored in RFID smart card 931 and may display the decoded face print on its display.
  • local computer 98 receives facial image data of the driver that is obtained from camera 961 and facial recognition reader 96. Local computer 98 then compares the decoded face print with the facial image for verification.
  • FIG. 10 An exemplary method executed at local computer 98 to dynamically stand-off biometric-verify the driver of vehicle 93 is illustrated in Figure 10 .
  • the steps of Figure 10 are similar to those of Figure 4 , except that in Figure 10 , the vehicle data and personal data are stored in a database of a local computer and the local computer can decode and retrieve face prints that are pre-stored in RFID personal smart cards.
  • RFID vehicle tag reader 92 reads data from vehicle tag 932 and sends the data to local computer 98.
  • RFID smart card reader 91 reads data and face print data from personal smart card 931 and sends these data to local computer 98 for processing.
  • facial recognition reader 96 also sends a facial image data that is generated by processing a facial image taken by camera 961 to local computer 98 for further processing.
  • local computer 98 decodes the data read from RFID vehicle tag 932 and RFID smart card 931 and retrieves relevant data from its database. Local computer 98 also decodes the face print data read from RFID smart card 931 and displays the face print on its display.
  • step 105 local computer 98 determines if the data retrieved from its database match with the data read from RFID vehicle tag 932 and RFID personal smart card 931. If these data match, the process moves to step 106, where local computer 98 further compares the decoded face print with the facial image obtain by facial recognition reader 96. At step 106, if the face print and the facial image also match, vehicle 93 and the driver are deemed authenticated, as shown at step 109.
  • a guard is preferably available to stop vehicle 93 to ask for more information, as shown at step 107. Upon investigation of other identification information, the guard can then decide if vehicle 33 and personnel are to be granted or denied entry through gate 99, as shown at steps 108 and 109. In another embodiment, to maintain smooth traffic flow, at the investigation step 107, vehicle 93 may be directed to another area which is separated from gate for investigation.
  • the above unique systems that store the digital images and/or the templates of the face of a person on an RFID smart card provide a hands-free, one-to-one biometric verification, or one-to-many identification, under dynamic motion. Therefore, the system is capable of distributing biometric digital image data (image prints of the face) to local computers and allows the local computer to accomplish the verification or identification of the person. This distribution of facial image data also allows critical access control decisions to be accomplished at the local computer during a loss of connection to the central system.
  • the present invention thus provides a stand-alone system that can be operated independently of the remote central facility.
  • the face recognition system used in a preferred embodiment is a Tri-band imaging system (TBI) as described in the above embodiment, which can dynamically capture a face (face detection) within the context of an ambiguous image frame.
  • TBI Tri-band imaging system
  • Other face detection technology can also be employed.
  • the resulting facial image obtained by the face recognition system will be uniquely compared to a facial image chip (i.e., face print) stored on the RFID smart card.
  • the smart card has enough memory to store one or more image chips (digital video facial pictures of the person) and/or face templates.
  • a set of frequently used face recognition system templates can be stored on the card along with corresponding identifying codes so that the receiving host computer or local computers will "know" which face recognition system is being used at any given time.
  • one organization may have facilities located at various places, and these facilities may employ different face recognition systems.
  • face recognition system templates By storing various face recognition system templates on a single smart card, the person who carries the single smart card can be recognized and verified at different facilities without the need to reprogram the card or carry different cards. This feature thus allows the use of several face recognition technologies for the same person, so that combined biometrics resulting from the several face recognition technologies can be used.
  • the present invention provides a system for both dynamic and stand-off biometric verification in the sense that a person can be detected even if driving in a vehicle (dynamic) and, further, in that the person being detected need not actively place themselves in a particular place, or physically touch some device (stand-off) to effect biometric verification.

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Collating Specific Patterns (AREA)

Claims (9)

  1. System zur dynamischen Verifikation auf Abstand, wobei das System Folgendes umfasst:
    ein Etikett der Hochfrequenzidentifikation bzw. RFID (331, 831, 931), das von einem Individuum getragen wird, wobei das RFID-Etikett persönliche Informationen des Individuums speichert;
    eine Datenbank (21, 55) zum Speichern von Daten bezüglich Informationen einer Vielzahl von Individuen; einen RFID-Etikettenleser (22, 91) zum Lesen von Daten aus dem RFID-Etikett; und
    einen Computer (38, 88) zum Inbeziehungsetzen einer durch den RFID-Etikettenleser aus dem RFID-Etikett gelesenen RFID-Nummer mit in der Datenbank gespeicherten spezifischen Informationen;
    gekennzeichnet durch
    einen Gesichtserkennungsleser (86, 96) zum Scannen eines Gesichts des Individuums und zum Erhalten eines gescannten Gesichtsbilds für das Individuum; eine Vielzahl von in dem RFID-Etikett gespeicherten Gesichtsvorlagen des Individuums, wobei die Vielzahl gespeicherter Gesichtsvorlagen verschiedene Formate umfasst, die verschiedenen Gesichtserkennungstechnologien entsprechen; und dadurch, dass
    der Computer die in dem RFID-Etikett gespeicherten Gesichtsvorlagen des Individuums abruft und die abgerufenen Gesichtsvorlagen mit dem gescannten Gesichtsbild vergleicht, um zu bestimmen, ob eine der abgerufenen Gesichtsvorlagen mit dem gescannten Gesichtsbild übereinstimmt.
  2. System nach Anspruch 1, wobei, wenn der Computer keine der Vielzahl der in dem RFID-Etikett gespeicherten Gesichtsvorlagen erkennt, der Computer eine der Vielzahl von Gesichtsvorlagen auswählt und die gewählte Gesichtsvorlage als eine neue Gesichtsvorlage registriert.
  3. System nach Anspruch 1 oder 2, wobei das RFID-Etikett ferner Identifizierungscodes umfasst, die einem Format einer Gesichtserkennungstechnologie entsprechen, wobei die Gesichtsvorlage auf der Basis der in dem RFID-Etikett gespeicherten Identifizierungscodes abgerufen wird.
  4. System nach Anspruch 1, 2 oder 3, wobei der Computer ein lokaler Computer (98) ist, der von einem zentralen Hostcomputer (94) entkoppelt ist.
  5. System nach einem der vorhergehenden Ansprüche, das ferner einen Sensor umfasst, der aktiviert wird, wenn das Individuum über eine Erfassungslinie (85, 95) geht, und der ferner eine Lesesequenz für den RFID-Etikettenleser und den Gesichtserkennungsleser aktiviert.
  6. System nach Anspruch 5, wobei die Lesesequenz für den Gesichtserkennungsleser das Gesicht des Individuums automatisch scannt, wenn das Individuum an der Erfassungslinie vorbeigeht.
  7. System nach einem der vorhergehenden Ansprüche, wobei die in dem RFID-Etikett gespeicherten persönlichen Informationen biometrische Informationen bezüglich des Individuums und Beziehungsinformationen bezüglich eines Fahrzeugs, das das Individuum fährt, umfassen.
  8. System nach einem der vorhergehenden Ansprüche, wobei der Gesichtserkennungsleser Folgendes umfasst: einen Nah-IR-Illuminator (51) zum Erzeugen von Nah-IR-Licht; ein Beleuchtungseinstellmodul (58) zum Einstellen des Nah-IR-Lichts auf der Basis von Umgebungsbeleuchtungsbedingungen; eine Kamera (53) zur Dreiband-Bildgebung bzw. TBI zum Aufnehmen von Gesichtsbildern des Individuums; und einen Mehrband-Extraktionscomputer (54) zum Verarbeiten der Gesichtsbilder, um das gescannte Gesichtsbild zu erhalten.
  9. System nach Anspruch 8, wobei der Mehrband-Extraktionscomputer das gescannte Gesichtsbild in einem Format speichert, das einer vorbestimmten Erkennungstechnologie entspricht.
EP06851924A 2005-12-01 2006-11-28 Mit mehreren gesichtserkennungssystemen kompatible verteilte id-überprüfung auf abstand Not-in-force EP1955290B1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US11/290,524 US7817013B2 (en) 2003-09-05 2005-12-01 Distributed stand-off ID verification compatible with multiple face recognition systems (FRS)
US11/290,523 US7843313B2 (en) 2003-09-05 2005-12-01 Distributed stand-off verification and face recognition systems (FRS)
PCT/US2006/045508 WO2008054410A2 (en) 2005-12-01 2006-11-28 Distributed stand-off id verification compatible with multiple face recognition systems (frs)

Publications (2)

Publication Number Publication Date
EP1955290A2 EP1955290A2 (de) 2008-08-13
EP1955290B1 true EP1955290B1 (de) 2010-10-13

Family

ID=39312128

Family Applications (1)

Application Number Title Priority Date Filing Date
EP06851924A Not-in-force EP1955290B1 (de) 2005-12-01 2006-11-28 Mit mehreren gesichtserkennungssystemen kompatible verteilte id-überprüfung auf abstand

Country Status (5)

Country Link
EP (1) EP1955290B1 (de)
JP (1) JP2009527804A (de)
DE (1) DE602006017578D1 (de)
IL (1) IL191866A (de)
WO (1) WO2008054410A2 (de)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10289896B2 (en) 2014-06-23 2019-05-14 British Telecommunications Public Limited Company Biometric identification
WO2023156313A1 (en) * 2022-02-15 2023-08-24 Trinamix Gmbh Authentication of a user for access

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2154653A1 (de) * 2008-07-21 2010-02-17 SkiData AG Zugangskontrollsystem
IT1391538B1 (it) * 2008-11-05 2012-01-11 Nuova Quasco S C R L Metodo e sistema per il controllo degli accessi a un cantiere
JP4751442B2 (ja) * 2008-12-24 2011-08-17 株式会社東芝 映像監視システム
IT1395316B1 (it) * 2009-08-24 2012-09-14 Isi Holding Srl Varco biometrico a mani libere
IT1401813B1 (it) * 2010-09-10 2013-08-28 Net Electronic Smt S R L Apparato e sistema per l'accertamento e il controllo a distanza dei veicoli stradali e dei loro conducenti
GB2494912A (en) * 2011-09-26 2013-03-27 Lee Harvey Walden Vehicle identification reader using an onboard RFID device
WO2015198011A1 (en) 2014-06-23 2015-12-30 British Telecommunications Public Limited Company Biometric identification
CN106896118B (zh) * 2014-07-22 2019-09-10 北京君和信达科技有限公司 对移动目标进行辐射扫描的系统、方法以及数据信息标签
CN105445809B (zh) * 2014-08-19 2018-09-11 清华大学 对移动目标进行检查的设备及方法
MY191339A (en) 2014-08-19 2022-06-16 Nuctech Co Ltd Apparatus and method for inspecting moving target
DE112018000705T5 (de) 2017-03-06 2019-11-14 Cummins Filtration Ip, Inc. Erkennung von echten filtern mit einem filterüberwachungssystem
CN110348347A (zh) * 2019-06-28 2019-10-18 深圳市商汤科技有限公司 一种信息处理方法及装置、存储介质
CN111341004B (zh) * 2020-03-26 2020-11-10 山东合力金桥系统集成技术有限公司 一种人脸识别控制的新型闸机

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3955170B2 (ja) * 2000-07-03 2007-08-08 富士フイルム株式会社 画像検索システム
US20040193893A1 (en) * 2001-05-18 2004-09-30 Michael Braithwaite Application-specific biometric templates
US7898385B2 (en) * 2002-06-26 2011-03-01 Robert William Kocher Personnel and vehicle identification system using three factors of authentication
US7183895B2 (en) * 2003-09-05 2007-02-27 Honeywell International Inc. System and method for dynamic stand-off biometric verification
JP2005242775A (ja) * 2004-02-27 2005-09-08 Omron Corp ゲートシステム
WO2006031255A2 (en) * 2004-04-02 2006-03-23 Riptide Systems, Inc. Biometric identification system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10289896B2 (en) 2014-06-23 2019-05-14 British Telecommunications Public Limited Company Biometric identification
WO2023156313A1 (en) * 2022-02-15 2023-08-24 Trinamix Gmbh Authentication of a user for access

Also Published As

Publication number Publication date
IL191866A0 (en) 2009-08-03
DE602006017578D1 (de) 2010-11-25
IL191866A (en) 2013-07-31
WO2008054410A3 (en) 2008-07-24
EP1955290A2 (de) 2008-08-13
JP2009527804A (ja) 2009-07-30
WO2008054410A2 (en) 2008-05-08

Similar Documents

Publication Publication Date Title
US7817013B2 (en) Distributed stand-off ID verification compatible with multiple face recognition systems (FRS)
US7843313B2 (en) Distributed stand-off verification and face recognition systems (FRS)
US7183895B2 (en) System and method for dynamic stand-off biometric verification
EP1955290B1 (de) Mit mehreren gesichtserkennungssystemen kompatible verteilte id-überprüfung auf abstand
US7362210B2 (en) System and method for gate access control
EP1953676B1 (de) Gerät zur Authentifizierung von Personen
US6958676B1 (en) Vehicle passenger authorization system
US7898385B2 (en) Personnel and vehicle identification system using three factors of authentication
CA2793453C (en) Access control device
JP4559819B2 (ja) 不審者検出システム及び不審者検出プログラム
US7401732B2 (en) Apparatus for reading standardized personal identification credentials for integration with automated access control systems
US20070252001A1 (en) Access control system with RFID and biometric facial recognition
JP2005242775A (ja) ゲートシステム
CN111462365A (zh) 访客车辆管理方法及系统
CN106934424A (zh) 识别管理方法和装置
KR101634943B1 (ko) 탑승자 생체인식 및 이동통신단말기의 인증을 이용한 장애인전용 주차 관리시스템
JP2003331323A (ja) 自動ゲートシステム
EP3232408B1 (de) Dynamisches zugangssteuerungssystem und dynamisches zugangsteuerungsverfahren
JP2006099687A (ja) 利用者認証装置
CN206741505U (zh) 识别管理设备和装置
CN212208332U (zh) 一种人证核验装置
EP3929884B1 (de) Vorrichtung, verfahren und programm
Bazakos et al. Fast access control technology solutions (FACTS)
US20150332092A1 (en) Action control apparatus

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20080529

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK RS

R17D Deferred search report published (corrected)

Effective date: 20080724

17Q First examination report despatched

Effective date: 20081030

RBV Designated contracting states (corrected)

Designated state(s): DE FR GB

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE FR GB

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 602006017578

Country of ref document: DE

Date of ref document: 20101125

Kind code of ref document: P

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20110714

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602006017578

Country of ref document: DE

Effective date: 20110714

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20180131

Year of fee payment: 12

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602006017578

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190601

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20191128

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20191128

Year of fee payment: 14

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20201128

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201128