EP4619205A1 - Robotic automation testing apparatus and method for testing biometric sensors with synthetic fingerprints - Google Patents

Robotic automation testing apparatus and method for testing biometric sensors with synthetic fingerprints

Info

Publication number
EP4619205A1
EP4619205A1 EP23892281.9A EP23892281A EP4619205A1 EP 4619205 A1 EP4619205 A1 EP 4619205A1 EP 23892281 A EP23892281 A EP 23892281A EP 4619205 A1 EP4619205 A1 EP 4619205A1
Authority
EP
European Patent Office
Prior art keywords
synthetic
finger assembly
synthetic finger
fingerprint
end effector
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP23892281.9A
Other languages
German (de)
French (fr)
Inventor
Kelvin CHUN
Sherri TASTO-MULLER
Thomas Heckmann
Markus STEPHANY
Frank Kalka
Matthias LEUTZGEN
Jean CREIGNOU
Steven Becker
Thomas VELHAGEN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Visa International Service Association
Original Assignee
Visa International Service Association
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Visa International Service Association filed Critical Visa International Service Association
Publication of EP4619205A1 publication Critical patent/EP4619205A1/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/50Maintenance of biometric data or enrolment thereof
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00Manipulators not otherwise provided for
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J15/00Gripping heads and other end effectors
    • B25J15/008Gripping heads and other end effectors with sticking, gluing or adhesive means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Program-controlled manipulators
    • B25J9/16Program controls
    • B25J9/1679Program controls characterised by the tasks executed
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor

Definitions

  • the present disclosure is directed to automated testing of fingerprint/biometric sensor systems with synthetic fingerprints. More particularly, the present disclosure is directed to robotic automation for testing fingerprint/biometric sensor systems with synthetic fingers comprising synthetic fingerprints.
  • the present disclosure provides a robotic system for testing a biometric sensor using synthetic fingers.
  • the robotic system comprises a robot comprising: a robotic arm comprising an end effector configured to select a synthetic finger assembly, wherein the synthetic finger assembly comprises a synthetic finger and a near field communication (NFC) circuit; a controller electrically coupled to the robotic arm, the controller is configured to: control movement of the robotic arm; cause the end effector to select the synthetic finger assembly; and identify the synthetic finger assembly; and a biometric scanner coupled to a computer system, wherein the biometric scanner comprises a sensor configured to scan a fingerprint disposed on the synthetic finger.
  • NFC near field communication
  • the robotic arm comprises a spring configured to apply a uniform pressure to the synthetic finger assembly.
  • the robotic system comprises a contactless reader configured to read the NFC circuit portion of the synthetic finger assembly to identify the synthetic finger assembly.
  • the NFC circuit comprises a radio frequency identification (RFID) tag.
  • the controller is configured to: cause the contactless reader to scan the NFC circuit on the synthetic finger assembly to determine an identity of the synthetic finger assembly; and record the identity of the synthetic finger assembly.
  • RFID radio frequency identification
  • the robotic arm comprises a contactless reader configured to read an NFC circuit portion of the synthetic finger assembly to identify the synthetic finger assembly.
  • the end effector is a vacuum end effector coupled to a vacuum source to enable the vacuum end effector to lift, hold, and move the synthetic finger assembly from a tray.
  • the end effector is a gecko inspired gripper.
  • the computer system coupled to biometric scanner is configured to extract an enrollment testing process from the biometric sensor.
  • the controller is configured to cause the robotic arm to control the end effector to place the synthetic finger assembly in a plurality of positions according to the enrollment testing process.
  • the biometric scanner is configured to scan the fingerprint in each of the plurality of positions and record each scan of the fingerprint in each of the plurality of positions.
  • the computer system is configured to receive each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process; and record a reference template of the fingerprint, wherein the reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process.
  • the reference template is correlated with an identity of the synthetic finger assembly recorded by a contactless reader.
  • the controller is configured to step through a tray, wherein the tray comprises a plurality of synthetic finger assemblies.
  • the robotic arm is rotatable and articulatable.
  • the present disclosure provides a method of testing a biometric sensor using synthetic fingers.
  • the method comprises selecting, by an end effector of a robotic arm, a synthetic finger assembly from a tray, wherein the synthetic finger assembly comprises a synthetic finger and a near field communication (NFC) circuit; scanning, by a contactless reader, the NFC circuit disposed on the synthetic finger assembly to identify the synthetic finger assembly; identifying, by the contactless reader, the synthetic finger assembly; and scanning, by a biometric scanner, a fingerprint disposed on the synthetic finger according to an enrollment testing process.
  • NFC near field communication
  • scanning the fingerprint according to the enrollment testing process comprises: placing, by the end effector of the robotic arm, the synthetic finger assembly in a plurality of positions according to the enrollment testing process; scanning, by the biometric scanner, the fingerprint in each of the plurality of positions; and recording, by a computer system coupled to the biometric scanner, each scan of the fingerprint in each of the plurality of positions.
  • placing includes rotating the synthetic finger assembly.
  • the method comprises recording a reference template of the fingerprint, wherein the reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process.
  • the method comprises recording the identity of the synthetic finger assembly read by the contactless reader.
  • the method comprises correlating the identity of the synthetic finger assembly and the reference template for each synthetic finger assembly.
  • the method comprises moving, by the robotic arm, the synthetic finger assembly to the contactless reader.
  • the method comprises moving, by the robotic arm, the synthetic finger assembly from the contactless reader to the biometric scanner.
  • selecting by the end effector of the robotic arm comprises applying a vacuum by the end effector of the robotic arm to lift, hold, and move the synthetic finger assembly.
  • selecting by the end effector of the robotic arm comprises lifting, holding, and moving the synthetic finger assembly with a gecko-inspired gripper.
  • the method comprises returning, by the end effector of the robotic arm, the synthetic finger assembly to the tray after the enrollment testing process is complete.
  • the method comprises receiving, by a computer system coupled to the biometric scanner, the enrollment testing process data from the biometric scanner.
  • the method comprises stepping, by the end effector of the robotic arm, through a tray of synthetic finger assemblies to select each synthetic finger assembly disposed within the tray.
  • the method comprises recording a reference template with the identity of the synthetic finger assembly of each synthetic finger assembly in the tray.
  • the method comprises returning, by the end effector of the robotic arm, the synthetic finger assembly to the tray after the enrollment testing process is complete; selecting, by the end effector of the robotic arm, a second synthetic finger assembly from the tray, wherein the second synthetic finger assembly comprises a second synthetic finger and a second NFC circuit; scanning, by the contactless reader, a second NFC circuit disposed on the second synthetic finger assembly; identifying, by the contactless reader, the second synthetic finger assembly; and scanning, by a biometric scanner, a second fingerprint disposed on the second synthetic finger according to the enrollment testing process.
  • FIG. 1 illustrates a flow diagram of a process for manufacturing a synthetic finger comprising a synthetic fingerprint and testing a fingerprint/biometric sensor using the synthetic finger, according to at least one aspect of the present disclosure.
  • FIG. 2 illustrates a fingerprint generated using artificial intelligence techniques, according to at least one aspect of the present disclosure.
  • FIG. 3 illustrates a mold comprising a metal plate and an array of individual 3D fingerprint molds for manufacturing a plurality of synthetic fingers, according to at least one aspect of the present disclosure.
  • FIG. 4 illustrates a support structure comprising a frame to support the metal plate shown in FIG. 3 during the casting process and a casting material for casting the 3D fingerprint molds onto the casting material to create a plurality of synthetic fingers, according to at least one aspect of the present disclosure.
  • FIG. 5 illustrates a sheet of casting material comprising an array of synthetic fingers created with the metal plate shown in FIGS. 3 and 4, where the synthetic fingers are being separated into strips from the array of synthetic fingers, according to at least one aspect of the present disclosure.
  • FIG. 6 illustrates the sheet of casting material comprising an array of synthetic fingers shown in FIG. 5, where individual synthetic fingers are being separated from the strips, according to at least one aspect of the present disclosure.
  • FIGS. 7A-7E illustrate the steps for manufacturing a synthetic finger assembly for testing a fingerprint sensor used in fingerprint scanner systems to recognize a person, according to at least one aspect of the present disclosure, where:
  • FIG. 7A illustrates a substrate, or plate for mounting a synthetic finger, according to at least one aspect of the present disclosure
  • FIG. 7B illustrates a first synthetic finger subassembly comprising an NFC (near field communication) circuit attached to the substrate, according to at least one aspect of the present disclosure
  • FIG. 70 illustrates a second synthetic finger subassembly comprising a doublesided adhesive tape attached over the NFC circuit, according to at least one aspect of the present disclosure
  • FIG. 7D illustrates a synthetic finger assembly, according to at least one aspect of the present disclosure.
  • FIG. 7E illustrates an alternate synthetic finger assembly comprising a layer of foam interposed between a substrate and a synthetic finger, according to at least one aspect of the present disclosure.
  • FIG. 8 illustrates a dispensing tray comprising a plurality of synthetic finger assemblies manufactured using the process shown in FIGS. 7A-7D or 7E, according to at least one aspect of the present disclosure.
  • FIG. 9 illustrates a dispensing tray comprising a plurality of synthetic finger assemblies manufactured using the process shown in FIGS. FIGS. 7A-7D or 7E, according to at least one aspect of the present disclosure.
  • FIG. 10 illustrates a robotic automated testing system for testing biometric scanners with synthetic fingers, according to at least one aspect of the present disclosure.
  • FIG. 11 is a close-up view of the robotic automated testing system shown in FIG. 10, showing dispensing trays comprising a plurality of cells for housing a plurality of synthetic finger assemblies therein for use in the testing process, according to at least one aspect of the present disclosure.
  • FIG. 12 illustrates the robotic automated testing system shown in FIG. 10 showing the end effector of the robotic arm positioned above the synthetic finger assembly disposed in a one of the cells of the dispensing tray, according to at least one aspect of the present disclosure.
  • FIG. 13 is a close-up view of the dispensing trays and the end effector of the robotic arm positioned over the synthetic finger assembly disposed in one of the cells of the dispensing tray, according to at least one aspect of the present disclosure.
  • FIG. 14 is a close-up view of the dispensing trays showing the end effector of the robot in the process of lifting the synthetic finger assembly out of one of the cells of the dispensing tray, according to at least one aspect of the present disclosure.
  • FIG. 15 illustrates the robotic automated testing system shown in FIG. 10 in the process of placing the synthetic finger assembly proximate to a contactless reader, according to at least one aspect of the present disclosure.
  • FIG. 16 is a close-up view of the robotic automated testing system shown in FIG.
  • FIG. 17 is a close-up view of the robotic automated testing system shown in FIG.
  • FIGS. 18A-18D is a sequence of the robotic automated testing system in the process of positioning the synthetic finger assembly on a sensor of a biometric scanner in a variety of orientations and applied pressure, according to at least one aspect of the present disclosure, where:
  • FIG. 18A shows the end effector positioning the synthetic finger assembly in a first orientation relative to the sensor, according to at least one aspect of the present disclosure
  • FIG. 18B shows the end effector positioning the synthetic finger assembly in a second orientation relative to the sensor, according to at least one aspect of the present disclosure
  • FIG. 18C shows the end effector positioning the synthetic finger assembly in a third orientation relative to the sensor, according to at least one aspect of the present disclosure.
  • FIG. 18D shows the end effector positioning the synthetic finger assembly in a fourth orientation relative to the sensor, according to at least one aspect of the present disclosure.
  • FIG. 19 is a flow diagram of an automated testing process, according to at least one aspect of the present disclosure.
  • FIG. 20 is a block diagram of a computer apparatus with data processing subsystems or components, according to at least one aspect of the present disclosure. DESCRIPTION
  • the following disclosure may provide exemplary systems, devices, and methods for conducting a financial transaction and related activities. Although reference may be made to such financial transactions in the examples provided below, aspects are not so limited. That is, the systems, methods, and apparatuses may be utilized for any suitable purpose.
  • robotic automated testing of fingerprint/biometric sensor systems with synthetic fingerprints was not foreseen as being acceptable by most biometric sensor manufacturers due to anti-spoofing considerations.
  • the synthetic fingerprints and the process for manufacturing the synthetic fingerprints disclosed herein provide an improvement over existing biometric sensor testing systems due to significant improvements in the generation of synthetic fingerprints using artificial intelligence (Al) and the creation of realistic synthetic fingerprints not recognized as such by the fingerprint/biometric sensors under test.
  • the synthetic fingerprints disclosed herein are generated using high quality synthetic fingerprint images, high quality molds, and casting materials.
  • the synthetic finger assemblies can be read by a variety of different fingerprint/biometric sensors under test.
  • the synthetic fingerprints and the process for manufacturing the synthetic fingerprints for testing biometric sensors disclosed herein provide a significant improvement over conventional fingerprint/biometric sensor systems.
  • the robotic automated testing of the fingerprint/biometric sensor systems with synthetic fingerprints facilitates the evaluation of the FAR/FRR during the testing process.
  • FIG. 1 illustrates a flow diagram of a process 100 for manufacturing a synthetic finger comprising a synthetic fingerprint and testing fingerprint/biometric sensors using the synthetic finger, according to at least one aspect of the present disclosure.
  • the process 100 starts with the creation of a high quality database 102 with a fingerprint image resolution between 500ppi (pixels per inch) to 1000ppi or greater, for example.
  • the database 102 can have different origins, for example, two main database 102 sources as follows.
  • a first fingerprint database 104 comprises fingerprint data generated by a computer (e.g., the computer apparatus 3000 shown in FIG. 20) using Al generated fingerprint techniques or other training algorithms to generate reliable and near human fingerprints.
  • Al techniques can include, for example, using Generative Adversarial Neural Networks (GAN or styleGAN) and/or other software techniques to improve the last layer resolution of fingerprint data.
  • GANs are effective at generating large high-quality images and to train more generator models.
  • the Style-GAN is an extension to the GAN architecture, including the use of a mapping network to map points in latent space to an intermediate latent space, the use of the intermediate latent space to control style at each point in the generator model, and the introduction to noise as a source of variation at each point in the generator model.
  • the resulting model is capable not only of generating photorealistic high-quality photos of human features such as fingerprints, but also offers control over the style of the generated image at different levels of detail through varying the style vectors and noise.
  • Al can be used on a final layer to improve generation from growing patterns using minutia or patterns generated using fixed algorithms such as, for example, multiresolution analysis algorithms (e.g., Min-Temp MultiRes or low level Al generation Syn-Re-GAN). Such techniques, however, may provide results of lower similarity to a human finger.
  • FIG. 2 illustrates an example of a fingerprint 200 generated using Al techniques, according to at least one aspect of the present disclosure.
  • a second fingerprint database 106 comprises fingerprint data from real persons that can be employed by the process 100.
  • the use of the second fingerprint database 106 collected from real human fingerprints guarantees similarity to real human fingerprints.
  • this technique can considerably lower certain benefits and diversity that can be realized using the Al generated fingerprint database 104.
  • One example of Al Software used for generating a fingerprint database includes a pre-trained model configuration file (CFG) and a synthetically generated dataset publicly available as Clarkson Fingerprint Generator, which is an example of a Style-GAN described above.
  • Example databases of real person fingerprints includes some involving the CrossMatch Gardian sensor or the Biometrica Hi Scan Sensor as for example the NIST Special Database. These databases of real person fingerprints can be used by the process 100 to modify the real persons fingerprint data to generate synthetic fingerprints, for example.
  • the process 100 includes the creation of a synthetic finger 112 using high quality/fidelity quality material 108.
  • the creation of the synthetic finger 112 can employ a material having optical, mechanical, electrical conductivity, and thermal conductivity, among other properties, reflecting the properties of real human skin.
  • the high fidelity quality materials exhibiting real human skin properties include jellifying products (e.g., gelatin, pectin casein, agar), polymer products (natural or artificial glues), and/or additives mixed in ratios to produce a casting material that reflects properties of real human skin.
  • the creation of a synthetic finger 112 includes the creation of high quality 3D molds 110.
  • a high quality 3D model of a fingerprint is created using fingerprint data read from the high quality database 102.
  • the high quality 3D model uses greyscale as a displacement map on a high-resolution grid.
  • the displacement map is used to achieve a maximum vertical displacement between 30 and 80pm in order to reflect the real repartition of friction ridge depth of a real fingerprint.
  • the high quality 3D model is then used to create molds using a 3D process.
  • a high quality fingerprint image has a resolution between 500ppi (pixels per inch) to 1000ppi or greater, as discussed above.
  • the present disclosure provides a process for transforming the fingerprint image in a 3D model using commercially available image processing techniques and image manipulation software.
  • software such as “Python” with the libraries “numpy” and “PIL” enabled fast and easy image processing.
  • an image processing technique includes inverting the fingerprint image (if needed) such that the background corresponds to “0” black and the fingerprint appears in white. If any non-zero value is present at the border of the image, a soft frame having a width of 5 pixels is created around the image with 0 value (increase size). The greyscale repartition is modified linearly such that the image greyscale is in a range from 0 to 255. If several images from the same finger are available, the image with the best coverage and/or less rotation is selected. The fingerprint is centered. The image size is modified using LANCZOS interpolation in order to target an image with 3000ppi and an upscale to compensate for any shrinkage.
  • a 500ppi image is upscaled with a factor 6.6.
  • the image is cropped to correspond to the size of the target pattern. For example, a crop to (3064,3776) for an area of 26mmx32mm. If any non-zero value is present at the border of the cropped image a soft frame of 6 to 12 pixel width is overlapped around the image with 0 value (keep size).
  • the following 3D meshing technique can be performed with commercially available 3D software.
  • the software Blender® has been successfully used in this context.
  • the 3D meshing technique starts by creating a mesh representing a square of the large area (example 26mmx32mm).
  • a displacement modifier is used (Displace in Blender®) using the input image as texture (unwrap the texture such that the size corresponds) and the strength is set such that a complete white pixel corresponds to the desired maximal displacement (so between 33 and 81 pm - this also considers the shrinkage of the material used for creating the final synthetic finger).
  • the displacement is applied and a final mesh is obtained to allow 3D engraving, such as laser engraving/etching.
  • the creation of the 3D mold 110 can employ additive or subtractive processes, or combinations thereof.
  • the process of creating a 3D mold 110 can include a high precision additive model (1-5 pm) such as 3D printing, for example.
  • the process of creating 100 a 3D mold can include a subtractive process such as high precision laser engraving/etching on a metal plate, for example.
  • Creation of the 3D mold 110 includes automatic labeling on the image (white text in the image) to allow easy identification of the later produced synthetic fingerprints.
  • FIG. 3 illustrates a mold 600 comprising a metal plate 602 and an array of individual synthetic 3D fingerprint molds 604 for manufacturing a plurality of synthetic fingers, according to at least one aspect of the present disclosure.
  • the array of 3D fingerprint molds 604 is formed on a metal plate 602.
  • the fingerprint molds 604 can be made using a high precision additive process such as 3D printing, for example, or a high precision subtractive process such as a high precision laser engraving, for example.
  • the 3D fingerprint molds 604 each can include a label 606 formed near the image of the fingerprint to allow identification of the synthetic fingerprints.
  • a metal plate may include any number of fingerprint molds, without limitation.
  • FIG. 4 illustrates a support structure 700 comprising a frame 702 to support the metal plate 602 shown in FIG. 3 during the casting process and a casted material 704.
  • the 3D fingerprint molds 604 on the metal plate 602 are casted onto the casted material 704 to create a sheet of casted material 704 comprising a plurality of synthetic fingerprints, according to at least one aspect of the present disclosure.
  • FIG. 5 illustrates a sheet 800 of casted material 704 comprising an array of synthetic fingers 802 created using the metal plate 600 and casting material 704 shown in FIGS. 3 and 4.
  • the synthetic fingers 802 are being separated into strips 804 from the array of synthetic fingers 802, according to at least one aspect of the present disclosure.
  • the synthetic fingers 802 are separated by a robotic arm.
  • FIG. 6 illustrates the sheet 800 of casted material 704 comprising an array of synthetic fingers 802 shown in FIG. 5.
  • the individual synthetic fingers 806 are being separated from the strips 804, according to at least one aspect of the present disclosure.
  • the synthetic fingers 802 are separated by a robotic arm.
  • FIGS. 7A-7D illustrate the steps for manufacturing a synthetic finger assembly for testing a fingerprint sensor used in fingerprint scanner systems to recognize a person, according to at least one aspect of the present disclosure.
  • FIG. 7E illustrates an alternate synthetic fingerprint assembly 920.
  • FIG. 7A illustrates a substrate 900, or plate, for mounting a synthetic finger thereon.
  • the substrate 900 can be made of any rigid or semi-rigid material suitable for supporting the components of a synthetic finger assembly 912, 920 shown in FIGS. 7D, 7E, respectively, for example.
  • the substrate 900 can be formed of a polymeric material such as plastic, for example.
  • the polymer or plastic can be a biobased polymer such as Polylactic Acid (PLA), for example.
  • PLA Polylactic Acid
  • FIG. 7B illustrates a first synthetic finger subassembly 904 comprising an NFC circuit 902 attached to the substrate 900.
  • the NFC circuit 902 can be an RFID tag.
  • the NFC circuit 902 can be attached to the substrate 900 with an adhesive, such as, for example, an adhesive sticker provided on one side of the NFC circuit 902.
  • FIG. 7C illustrates a second synthetic finger subassembly 908 comprising a piece of double-sided adhesive tape 906 attached over the NFC circuit 902.
  • a top side 907 of the double-sided adhesive tape 906 is shown ready to receive a synthetic finger 910 as shown in FIG. 7D.
  • FIG. 7D illustrates a synthetic finger assembly 912, according to at least one aspect of the present disclosure.
  • a bottom side 914 of a synthetic finger 910 manufactured in accordance with steps 102-112 of the process 100 shown in FIG. 1 , is attached to the top side 907 (FIG. 7C) of the double-sided adhesive tape 906.
  • a fingerprint portion of the synthetic finger 910 is on a top side 916 of the synthetic finger 910.
  • the synthetic finger assembly 912 is shown ready to be used in a fingerprint/biometric sensor testing process.
  • FIG. 7E illustrates an alternate synthetic fingerprint assembly 920 comprising a layer of foam material 918 interposed between the substrate 900 and the synthetic finger 910, according to at least one aspect of the present disclosure.
  • a bottom side of the foam material 918 is attached to the top side 907 (FIG. 7C) of the double-sided adhesive tape 906.
  • a second adhesive layer 919 is attached to a top side of the foam material 918 to attach the bottom side 914 of the synthetic finger 910 to the top side of the foam material 918.
  • the foam material 918 is used to control the pressure applied to the fingerprint sensor during the testing process.
  • FIG. 8 illustrates a dispensing tray 1000 comprising a plurality of synthetic finger assemblies 1002 manufactured using the process shown in FIGS. 7A-7D or 7E, according to at least one aspect of the present disclosure.
  • the dispensing tray 1000 comprises a frame 1004 defining a plurality of cells 1006 arranged in an array. Each cell 1006 is configured to receive and accommodate a synthetic finger assembly 1002.
  • each synthetic finger assembly 1002 comprises an identification label 1008, disposed over a substrate 1010, as described in connection with FIGS. 7A-7D or 7E.
  • One side of an NFC circuit 1012 is attached to the substrate 1010 and a synthetic finger 1014 is attached to an opposite side of the NFC circuit 1012.
  • FIG. 8 illustrates a dispensing tray 1000 comprising a plurality of synthetic finger assemblies 1002 manufactured using the process shown in FIGS. 7A-7D or 7E, according to at least one aspect of the present disclosure.
  • the dispensing tray 1000 comprises a frame 1004 defining a plurality of cells 1006
  • the synthetic finger 1014 is positioned in a cell 1006 such that the synthetic fingerprint is facing the bottom of a cell 1006.
  • the opposite side of the synthetic finger 1014 attached to the NFC circuit 1012 is positioned such that it faces the bottom of the cell 1006.
  • the layout configuration of the dispensing tray 1000 is suitable for use in either manual or automated fingerprint/biometric sensor testing process.
  • an end effector of a robotic arm selects a synthetic finger assembly 1002 from a cell 1006 of the dispensing tray 1000 and then places the synthetic fingerprint portion of the synthetic finger assembly 1002 on a fingerprint/biometric sensor under test.
  • FIG. 9 illustrates a dispensing tray 1100 comprising a plurality of synthetic fingerprint assemblies 1102 manufactured using the process shown in FIGS. 7A-7D or 7E, according to at least one aspect of the present disclosure.
  • the dispensing tray 1100 comprises a frame 1104 defining a plurality of cells 1106 arranged in an array. Each cell 1106 is configured to receive and accommodate a synthetic finger assembly 1102.
  • each synthetic finger assembly 1102 comprises an identification label 1108, disposed over a substrate 1010, as described in connection with FIGS. 7A-7D or 7E.
  • One side of an NFC circuit is attached to a substrate and a synthetic finger is attached to an opposite side of the NFC circuit.
  • FIG. 9 illustrates a dispensing tray 1100 comprising a plurality of synthetic fingerprint assemblies 1102 manufactured using the process shown in FIGS. 7A-7D or 7E, according to at least one aspect of the present disclosure.
  • the dispensing tray 1100 comprises a frame 1104 defining a plurality of cells 1106 arranged
  • the synthetic fingerprint is located on a bottom side of the synthetic finger assembly 1102 facing the bottom of the cell 1106, which is opposite the side of the synthetic finger attached to the NFC circuit.
  • the layout configuration of the dispensing tray 1100 is suitable for use in either manual or automated fingerprint/biometric sensor testing process.
  • an end effector of a robotic arm selects a synthetic finger assembly 1102 from a cell 1106 of the dispensing tray 1100 and places the synthetic fingerprint portion of the synthetic finger assembly 1102 on a fingerprint/biometric sensor under test.
  • the process 100 includes an automated testing process 114 for testing a fingerprint sensor using the synthetic finger manufactured according to steps 102-112 of the process 100.
  • FIG. 1 together with FIGS. 8 and 9, a layout of each created synthetic finger assembly 1001 , 1102 disposed in dispensing trays 1000, 1100 is configured and optimized to automate the presentation of the synthetic finger assembly 1002, 1102 to a robot.
  • a proxy software to the collection software data from all the synthetic fingerprints can be automatically collected using the NFC circuits 1012 on the synthetic finger assembly 1002, 1102.
  • Data is collected according to the definition for enrollment 116 (enrollment update) defined by the sensor manufacturer (given in the evaluation results definition) and the verification positions 118.
  • the synthetic fingerprint is recognized using a contactless reader.
  • the dataset is automatically labelled using this information.
  • the process 100 can include the creation 120 of blind data 122 to prevent cheating.
  • the blind data 122 is provided to an algorithm under evaluation 125.
  • the process of blinding the data includes shuffling and/or renaming the verification data in a way that matching of a data with an enrollment data is written in a separate file and cannot be deduced from the name/structure of the verification file. This step is optional but ensures that cheating the evaluation cannot be easily accomplished, although may still be possible.
  • the result of the shuffling is the blinded data 122 on one side and matching information 128 on the other side.
  • the algorithm 124 under evaluation is run using the blinded data 122 as a universal attacker (evaluation of the FAR or FRR).
  • the evaluation returns output matching results 126 in a predefined format that allows for automatic evaluation.
  • the matching information 128 and the matching result 126 output by the algorithm 124 are recombined to evaluate 130 the real FAR/FRR.
  • the present evaluation process increases the comparability between test laboratory using the same test material and pattern at all labs; increases the repeatability by defining fixed test positions/pressure and test conditions; in case of computer generated fingerprints database, removes privacy concerns; reduces cost and testing time; removes error due to human presentation and labeling (better precision in presentation position); allows testing in pandemic situations; using specific generation design, the generated fingerprint can reflect some trait related to age or ethnicity; and/or using variation in conductivity, foam (pressure level), and environment conditions (humidity and temperature)provides additional advantages to the evaluation process.
  • FIG. 10 illustrates a robotic automated testing system 1200 for testing biometric scanner 1216 with synthetic fingers, according to at least one aspect of the present disclosure.
  • the robotic automated testing system 1200 comprises a robot 1202 comprising a movable robotic arm 1204, an end effector 1206, and a controller 1207 electrically coupled to the robotic arm 1204.
  • the robotic arm 1204 is rotatable and articulatable.
  • the controller 1207 may implemented as the computer apparatus 3000 shown in FIG. 20.
  • the controller 1220 is configured to control movement of the robotic arm 1204 and cause the end effector 1206 to select the synthetic finger assembly 1210 out of a dispensing tray 1212 and identify the synthetic finger assembly 1210 using contactless reader 1214.
  • the end effector 1206 is pneumatically coupled to a vacuum source via tube 1208.
  • the end effector 1206 can be a vacuum end effector configured lift the synthetic finger assembly 1210 out of the dispensing tray 1212, hold the synthetic finger assembly 1210, and move the synthetic finger assembly 1210 from the dispensing tray 1212 to the contactless reader 1214 and then to the biometric scanner 1216.
  • the end effector 1206 then contacts the synthetic finger assembly 1210 with the sensor 1218 to scan the synthetic fingerprint.
  • the robot controller 1220 is configured to step the robotic arm 1204 and end effector 1206 through the dispensing tray 1212 to select and replace the plurality of synthetic finger assemblies 1210 contained in the dispensing tray 1212.
  • the end effector 1206 may comprise a gripper with a gecko-inspired adhesive to grasp and manipulate the synthetic finger assembly 1210 out of the dispensing tray 1212, hold the synthetic finger assembly 1210, and move the synthetic finger assembly 1210 from the dispensing tray 1212 to the contactless reader 1214 and then to the biometric scanner 1216.
  • the biometric scanner 1216 is coupled to a computer system for acquiring test data from the biometric scanner 1216.
  • the computer system 1222 may be implemented as the computer apparatus 3000 shown in FIG. 20.
  • the biometric scanner 1216 comprises a sensor 1218 configured to scan a fingerprint disposed on the synthetic finger 910, 910 (FIGS. 7D, 7E) of the synthetic finger assembly 1210.
  • the contactless reader 1214 is configured to read the NFC circuit 902 (FIGS. 7A, 7B) for the purpose of identifying the synthetic finger assembly 1210 and, in particular, the synthetic fingerprint on the synthetic finger 910 (FIGS. 7A, 7B).
  • the contactless reader 1214 is an RFID tag reader.
  • the contactless reader 1214 can be coupled to the robot controller 1220 or the computer system 1222, or both.
  • the robotic arm 1204 can include a contactless reader 1224 to wirelessly read the NFC circuit 902 (FIGS. 7A, 7B) for the purpose of identifying the synthetic finger assembly 1210 and, in particular, the synthetic fingerprint on the synthetic finger 910 (FIGS. 7A, 7B).
  • the NFC circuit 902 can be an RFID tag.
  • robot controller 1220 is configured to cause the robotic arm 1204 to control the end effector 1206 to place the synthetic finger assembly 1210 in a plurality of positions according to the enrollment testing process.
  • the biometric scanner 1216 is configured to scan the fingerprint in each of the plurality of positions and record each scan of the fingerprint in each of the plurality of positions.
  • the computer system 1222 is configured to receive each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process and record a reference template of the fingerprint.
  • the reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process.
  • the reference template is correlated with an identity of the synthetic finger assembly 1210 recorded by the contactless reader 12140.
  • FIG. 11 is a close-up view of the robotic automated testing system 1200 shown in FIG. 10, showing dispensing trays 1212 comprising a plurality of cells 1226 for housing a plurality of synthetic finger assemblies 1210 therein for use in the testing process, according to at least one aspect of the present disclosure.
  • FIG. 12 illustrates the robotic automated testing system 1200 shown in FIG. 10 showing the end effector 1206 of the robotic arm 1204 positioned over a synthetic finger assembly 1210 disposed in one of the cells 1226 of the dispensing tray 1212, according to at least one aspect of the present disclosure.
  • FIG. 13 is a close-up view of the dispensing tray 1212 and the end effector 1206 of the robotic arm 1204 positioned above the synthetic finger assembly 1210 disposed in one of the cells 1226 of the dispensing tray 1212, according to at least one aspect of the present disclosure.
  • FIG. 12 illustrates the robotic automated testing system 1200 shown in FIG. 10 showing the end effector 1206 of the robotic arm 1204 positioned over a synthetic finger assembly 1210 disposed in one of the cells 1226 of the dispensing tray 1212, according to at least one aspect of the present disclosure.
  • FIG. 13 is a close-up view of the dispensing tray 1212 and the end effector 1206 of the robotic arm 1204 positioned above the synthetic finger assembly 1210
  • FIG. 14 is a close-up view of the dispensing trays 1212 showing the end effector 1206 of the robot arm 1204 in the process of lifting the synthetic finger assembly 1210 out of one of the cells 1226 of the dispensing tray 1212, according to at least one aspect of the present disclosure.
  • the end effector 1206 can use vacuum to lift the synthetic finger assembly 1210 out of the cell 1226 of the dispensing tray 1212 as shown in FIG. 14.
  • FIG. 15 illustrates the robotic automated testing 1200 system shown in FIG. 10 in the process of placing the synthetic finger assembly 1210 proximate to a contactless reader 1214, according to at least one aspect of the present disclosure.
  • the contactless reader 1214 is coupled to either the robot controller 12220 or the computer system 1222, or both.
  • the contactless reader 1214 reads the NFC circuit 902 (FIGS. 7A, 7B) for the purpose of identifying the synthetic finger assembly 1210 and in particular, identifying the fingerprint that is about to be scanned by the sensor 1218 of the biometric scanner 1216.
  • FIG. 16 is a close-up view of the robotic automated testing system 1200 shown in FIG. 15 in the process of placing the synthetic finger assembly 1210 proximate to the contactless reader 1214, according to at least one aspect of the present disclosure.
  • FIG. 17 is a close-up view of the robotic automated testing system 1200 shown in FIG. 16 in the process of lifting the synthetic finger assembly 1210 from the contactless reader 1214, according to at least one aspect of the present disclosure, prior to moving the synthetic finger assembly 1210 over to the sensor 1218 of the biometric scanner 1216.
  • FIGS. 18A-18D is a sequence of the robotic automated testing system 1200 in the process of positioning the synthetic finger assembly 1210 on the sensor 1218 of the biometric scanner 1216 in a variety of orientations and applied pressure, according to at least one aspect of the present disclosure.
  • FIG. 18A shows the end effector 1206 positioning the synthetic finger assembly 1210 in a first orientation relative to the sensor 1218, according to at least one aspect of the present disclosure.
  • FIG. 18B shows the end effector 1206 positioning the synthetic finger assembly 1210 in a second orientation relative to the sensor 1218, according to at least one aspect of the present disclosure.
  • FIG. 18C shows the end effector 1206 positioning the synthetic finger assembly 1210 in a third orientation relative to the sensor 1218, according to at least one aspect of the present disclosure.
  • FIG. 18D shows the end effector 1206 positioning the synthetic finger assembly 1210 sensor in a fourth orientation relative to the sensor 1218, according to at least one aspect of the present disclosure.
  • FIG. 19 is a flow diagram of an automated testing process 1300, according to at least one aspect of the present disclosure.
  • an end effector 1206 of a robotic arm 1204 selects 1302 a synthetic finger assembly 1210 from a tray 1212.
  • the synthetic finger assembly 1210 comprises a synthetic finger 910 (FIGS. 7D, 7E) and a near field communication (NFC) circuit 902 (FIGS. 7B, 7C).
  • a contactless reader 1214 scans 1304 the NFC circuit 902 disposed on the synthetic finger assembly 1210 to identify the synthetic finger assembly 1210.
  • the contactless reader 1214 identifies 1306 the synthetic finger assembly 1310.
  • a biometric scanner 1216 scans 1308 a fingerprint disposed on the synthetic finger 910 according to an enrollment testing process.
  • the end effector 1206 of the robotic arm 1204 places the synthetic finger assembly 1210 in a plurality of positions according to the enrollment testing process.
  • the biometric scanner 1216 scans the fingerprint in each of the plurality of positions.
  • a computer system 1222 coupled to the biometric scanner 1216 records each scan of the fingerprint in each of the plurality of positions.
  • placing comprises rotating the synthetic finger assembly 1210.
  • the computer system 1222 records a reference template of the fingerprint.
  • the reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process.
  • the computer system 1222 records the identity of the synthetic finger assembly 1210 read by the contactless reader 1214.
  • the computer system 1222 correlates the identity of the synthetic finger assembly 1210 and the reference template for each synthetic finger assembly 1210.
  • the robotic arm 1204 moves the synthetic finger assembly 1210 to the contactless reader 1214. In another aspect, the robotic arm 1204 moves the synthetic finger assembly 1210 from the contactless reader 1214 to the biometric scanner 1216. In another aspect, the end effector 1206 of the robotic arm 1204 applies a vacuum to select a synthetic finger assembly 1210 and lift, hold, and move the synthetic finger assembly 1210. In another aspect, the end effector 1206 of the robotic arm 1204 returns the synthetic finger assembly 1210 to the tray 1212 after the enrollment testing process is complete. In another aspect, a computer system 1222 coupled to the biometric scanner 1216 receives the enrollment testing process data from the biometric scanner 1216.
  • the end effector 1206 of the robotic arm 1204 steps through a tray 1212 of synthetic finger assemblies 1210 and selects each synthetic finger assembly 1210 disposed within the tray 1212.
  • the computer system 1222 records a reference template with the identity of the synthetic finger assembly 1210 of each synthetic finger assembly 1210 in the tray 1212.
  • the end effector 1206 of the robotic arm 1204 returns the synthetic finger assembly 1210 to the tray 1212 after the enrollment testing process is complete.
  • the end effector 1206 of the robotic arm 1204 selects a second synthetic finger assembly 1210 from the tray 1212.
  • the second synthetic finger assembly 1210 comprises a second synthetic finger and a second NFC circuit.
  • the contactless reader 1214 scans a second NFC circuit disposed on the second synthetic finger assembly.
  • the contactless reader 1214 identifies the second synthetic finger assembly.
  • the biometric scanner 1216 scans a second fingerprint disposed on the second synthetic finger according to the enrollment testing process.
  • FIG. 20 is a block diagram of a computer apparatus 3000 with data processing subsystems or components, according to at least one aspect of the present disclosure.
  • the computer apparatus 3000 may be configured to implement the computer functions in the process 100 described in connection with FIG. 1.
  • the subsystems shown in FIG. 20 are interconnected via a system bus 3010. Additional subsystems such as a printer 3018, keyboard 3026, fixed disk 3028 (or other memory comprising computer readable media), monitor 3022, which is coupled to a display adapter 3020, and others are shown.
  • Peripherals and input/output (I/O) devices which couple to an I/O controller 3012 (which can be a processor or other suitable controller), can be connected to the computer system by any number of means known in the art, such as a serial port 3024.
  • the serial port 3024 or external interface 3030 can be used to connect the computer apparatus to a wide area network such as the Internet, a mouse input device, or a scanner.
  • the interconnection via system bus allows the central processor 3016 to communicate with each subsystem and to control the execution of instructions from system memory 3014 or the fixed disk 3028, as well as the exchange of information between subsystems.
  • the system memory 3014 and/or the fixed disk 3028 may embody a computer readable medium.
  • Non-volatile media include, for example, optical or magnetic disks, such as a fixed disk.
  • Volatile media include dynamic memory, such as system RAM.
  • Transmission media include coaxial cables, copper wire and fiber optics, among others, including the wires that comprise one aspect of a bus.
  • Transmission media can also take the form of acoustic or light waves, such as those generated during radio frequency (RF) and infrared (IR) data communications.
  • RF radio frequency
  • IR infrared
  • Common forms of computer-readable media include, for example, a flexible disk, a hard disk, magnetic tape, any other magnetic medium, a CD-ROM disk, digital video disk (DVD), any other optical medium, any other physical medium with patterns of marks or holes, a RAM, a PROM, an EPROM, an EEPROM, a FLASH EPROM, any other memory chip or data exchange adapter, a carrier wave, or any other medium from which a computer can read.
  • Various forms of computer-readable media may be involved in carrying one or more sequences of one or more instructions to a CPU for execution.
  • a bus carries the data to system RAM, from which a CPU retrieves and executes the instructions.
  • the instructions received by system RAM can optionally be stored on a fixed disk either before or after execution by a CPU.
  • Computer program code for carrying out operations for aspects of the present technology may be written in any combination of one or more programming languages, including an object-oriented programming language such as Java, Smalltalk, C++, or the like and conventional procedural programming languages, such as the "C" programming language, Go, Python, or other programming languages, including assembly languages.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
  • the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
  • LAN local area network
  • WAN wide area network
  • Internet Service Provider an Internet Service Provider
  • a robotic system for testing a biometric sensor using synthetic fingers comprising: a robotic arm comprising an end effector configured to select a synthetic finger assembly, wherein the synthetic finger assembly comprises a synthetic finger and a near field communication (NFC) circuit; a controller electrically coupled to the robotic arm; and a biometric scanner comprising a sensor configured to scan a fingerprint disposed on the synthetic finger; wherein the controller is configured to: control movement of the robotic arm; cause the end effector to select the synthetic finger assembly; and identify the synthetic finger assembly.
  • NFC near field communication
  • Clause 7 The robotic system of any one of clauses 1-6, wherein the end effector is a vacuum end effector coupled to a vacuum source to enable the vacuum end effector to lift, hold, and move the synthetic finger assembly from a tray.
  • the end effector is a vacuum end effector coupled to a vacuum source to enable the vacuum end effector to lift, hold, and move the synthetic finger assembly from a tray.
  • Clause 8 The robotic system of any one of clauses 1-7, wherein the end effector is a gecko inspired gripper.
  • a system for testing a biometric sensor using synthetic fingers comprising: a computer system; and a robot coupled to the computer system, the robot comprising: a robotic arm comprising an end effector configured to select a synthetic finger assembly, wherein the synthetic finger assembly comprises a synthetic finger and a near field communication (NFC) circuit; a controller electrically coupled to the robotic arm; and a biometric scanner comprising a sensor configured to scan a fingerprint disposed on the synthetic finger; wherein the controller is configured to: control movement of the robotic arm; cause the end effector to select the synthetic finger assembly; and identify the synthetic finger assembly.
  • NFC near field communication
  • Clause 12 The system of clause 11, wherein the computer system is coupled to the biometric scanner and is configured to extract an enrollment testing process from the sensor.
  • Clause 13 The system of any one of clauses 11-12, wherein the controller is configured to cause the robotic arm to control the end effector to place the synthetic finger assembly in a plurality of positions according to the enrollment testing process.
  • Clause 14 The system of any one of clauses 11-13, wherein the biometric scanner is configured to scan the fingerprint in each of the plurality of positions and record each scan of the fingerprint in each of the plurality of positions.
  • Clause 15 The system of any one of clauses 11-14, wherein the computer system is configured to: receive each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process; and record a reference template of the fingerprint, wherein the reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process.
  • Clause 16 The system of any one of clauses 11-15, wherein the reference template is correlated with an identity of the synthetic finger assembly recorded by a contactless reader.
  • a method of testing a biometric sensor using synthetic fingers comprising: selecting, by an end effector of a robotic arm, a synthetic finger assembly from a tray, wherein the synthetic finger assembly comprises a synthetic finger and a near field communication (NFC) circuit; scanning, by a contactless reader, the NFC circuit disposed on the synthetic finger assembly to identify the synthetic finger assembly; identifying, by the contactless reader, the synthetic finger assembly; and scanning, by a biometric scanner, a fingerprint disposed on the synthetic finger according to an enrollment testing process.
  • NFC near field communication
  • scanning the fingerprint according to the enrollment testing process comprises: placing, by the end effector of the robotic arm, the synthetic finger assembly in a plurality of positions according to the enrollment testing process; scanning, by the biometric scanner, the fingerprint in each of the plurality of positions; and recording, by a computer system coupled to the biometric scanner, each scan of the fingerprint in each of the plurality of positions.
  • Clause 19 The method of clause 18, wherein placing includes rotating the synthetic finger assembly.
  • Clause 20 The method of any one of clauses 18-19, comprising recording a reference template of the fingerprint, wherein the reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process.
  • Clause 21 The method of clause 20, comprising recording an identity of the synthetic finger assembly read by the contactless reader.
  • Clause 22 The method of clause 21 , comprising correlating the identity of the synthetic finger assembly and the reference template for each synthetic finger assembly.
  • Clause 23 The method of any one of clauses 17-22, comprising moving, by the robotic arm, the synthetic finger assembly to the contactless reader.
  • Clause 24 The method of clause 23, comprising moving, by the robotic arm, the synthetic finger assembly from the contactless reader to the biometric scanner.
  • Clause 25 The method of any one of clauses 17-24, wherein selecting by the end effector of the robotic arm comprises applying a vacuum by the end effector of the robotic arm to lift, hold, and move the synthetic finger assembly.
  • Clause 26 The method of any one of clauses 17-25, wherein selecting by the end effector of the robotic arm comprises lifting, holding, and moving the synthetic finger assembly with a gecko-inspired gripper.
  • Clause 27 The method of any one of clauses 17-26, comprising returning, by the end effector of the robotic arm, the synthetic finger assembly to the tray after the enrollment testing process is complete.
  • Clause 28 The method of any one of clauses 17-27, comprising receiving, by a computer system coupled to the biometric scanner, the enrollment testing process data from the biometric scanner.
  • Clause 29 The method of any one of clauses 17-28, comprising stepping, by the end effector of the robotic arm, through a tray of synthetic finger assemblies to select each synthetic finger assembly disposed within the tray.
  • Clause 30 The method of clause 29, comprising recording a reference template with an identity of the synthetic finger assembly of each synthetic finger assembly in the tray.
  • Clause 31 The method of any one of clauses 17-30, comprising returning, by the end effector of the robotic arm, the synthetic finger assembly to the tray after the enrollment testing process is complete; selecting, by the end effector of the robotic arm, a second synthetic finger assembly from the tray, wherein the second synthetic finger assembly comprises a second synthetic finger and a second NFC circuit; scanning, by the contactless reader, a second NFC circuit disposed on the second synthetic finger assembly; identifying, by the contactless reader, the second synthetic finger assembly; and scanning, by a biometric scanner, a second fingerprint disposed on the second synthetic finger according to the enrollment testing process.
  • Instructions used to program logic to perform various disclosed aspects can be stored within a memory in the system, such as dynamic random access memory (DRAM), cache, flash memory, or other storage. Furthermore, the instructions can be distributed via a network or by way of other computer readable media.
  • DRAM dynamic random access memory
  • cache cache
  • flash memory or other storage.
  • the instructions can be distributed via a network or by way of other computer readable media.
  • a machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), but is not limited to, floppy diskettes, optical disks, compact disc, read-only memory (CD-ROMs), and magneto-optical disks, read-only memory (ROMs), random access memory (RAM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic or optical cards, flash memory, or a tangible, machine-readable storage used in the transmission of information over the Internet via electrical, optical, acoustical or other forms of propagated signals (e.g., carrier waves, infrared signals, digital signals, etc.).
  • the non- transitory computer-readable medium includes any type of tangible machine-readable medium suitable for storing or transmitting electronic instructions or information in a form readable by a machine (e.g., a computer).
  • Any of the software components or functions described in this application may be implemented as software code to be executed by a processor using any suitable computer language such as, for example, Python, Java, C++ or Perl using, for example, conventional or object-oriented techniques.
  • the software code may be stored as a series of instructions, or commands on a computer readable medium, such as RAM, ROM, a magnetic medium such as a hard-drive or a floppy disk, or an optical medium such as a CD- ROM. Any such computer readable medium may reside on or within a single computational apparatus and may be present on or within different computational apparatuses within a system or network.
  • logic may refer to an app, software, firmware and/or circuitry configured to perform any of the aforementioned operations.
  • Software may be embodied as a software package, code, instructions, instruction sets and/or data recorded on non-transitory computer readable storage medium.
  • Firmware may be embodied as code, instructions or instruction sets and/or data that are hard-coded (e.g., nonvolatile) in memory devices.
  • the terms “component,” “system,” “module” and the like can refer to a computer-related entity, either hardware, a combination of hardware and software, software, or software in execution.
  • an “algorithm” refers to a self-consistent sequence of steps leading to a desired result, where a “step” refers to a manipulation of physical quantities and/or logic states which may, though need not necessarily, take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It is common usage to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like. These and similar terms may be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities and/or states.
  • a network may include a packet switched network.
  • the communication devices may be capable of communicating with each other using a selected packet switched network communications protocol.
  • One example communications protocol may include an Ethernet communications protocol which may be capable of permitting communication using a Transmission Control Protocol/lnternet Protocol (TCP/IP).
  • TCP/IP Transmission Control Protocol/lnternet Protocol
  • the Ethernet protocol may comply or be compatible with the Ethernet standard published by the Institute of Electrical and Electronics Engineers (IEEE) titled “IEEE 802.3 Standard”, published in December, 2008 and/or later versions of this standard.
  • the communication devices may be capable of communicating with each other using an X.25 communications protocol.
  • the X.25 communications protocol may comply or be compatible with a standard promulgated by the International Telecommunication Union-Telecommunication Standardization Sector (ITU-T).
  • the communication devices may be capable of communicating with each other using a frame relay communications protocol.
  • the frame relay communications protocol may comply or be compatible with a standard promulgated by Consultative Committee for International Circuit and Telephone (CCITT) and/or the American National Standards Institute (ANSI).
  • the transceivers may be capable of communicating with each other using an Asynchronous Transfer Mode (ATM) communications protocol.
  • ATM Asynchronous Transfer Mode
  • the ATM communications protocol may comply or be compatible with an ATM standard published by the ATM Forum titled “ATM- MPLS Network Interworking 2.0” published August 2001, and/or later versions of this standard.
  • ATM-MPLS Network Interworking 2.0 published August 2001
  • One or more components may be referred to herein as “configured to,” “configurable to,” “operable/operative to,” “adapted/adaptable,” “able to,” “conformable/conformed to,” etc.
  • “configured to” can generally encompass active-state components and/or inactive-state components and/or standby-state components, unless context requires otherwise.
  • any reference to “one aspect,” “an aspect,” “an exemplification,” “one exemplification,” and the like means that a particular feature, structure, or characteristic described in connection with the aspect is included in at least one aspect.
  • appearances of the phrases “in one aspect,” “in an aspect,” “in an exemplification,” and “in one exemplification” in various places throughout the specification are not necessarily all referring to the same aspect.
  • the particular features, structures or characteristics may be combined in any suitable manner in one or more aspects.

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Image Input (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

A robotic apparatus, system, and method for testing a biometric sensor using synthetic fingers. The robotic system includes a robot and a biometric scanner. The robot includes a robotic arm having an end effector configured to select a synthetic finger assembly. The synthetic finger assembly includes a near field communication (NFC) circuit. A controller is electrically coupled to the robotic arm. The controller is configured to control movement of the robotic arm, cause the end effector to select the synthetic finger assembly, and identify the synthetic finger assembly. The biometric scanner includes a sensor configured to scan a fingerprint disposed on the synthetic finger.

Description

TITLE
ROBOTIC AUTOMATION TESTING APPARATUS AND METHOD FOR TESTING BIOMETRIC SENSORS WITH SYNTHETIC FINGERPRINTS
CROSS-REFERENCE TO RELATED APPLICATION
[0001] This application claims the benefit of and priority under 35 U.S.C. § 119(e) to U.S. Provisional Application No. 63/384,326, filed November 18, 2022, entitled ROBOTIC AUTOMATION TESTING APPARATUS AND METHOD FOR TESTING BIOMETRIC SENSORS WITH SYNTHETIC FINGERPRINTS, the contents of which is hereby incorporated by reference in its entirety herein.
TECHNICAL FIELD
[0002] The present disclosure is directed to automated testing of fingerprint/biometric sensor systems with synthetic fingerprints. More particularly, the present disclosure is directed to robotic automation for testing fingerprint/biometric sensor systems with synthetic fingers comprising synthetic fingerprints.
BACKGROUND
[0003] Current standards for false acceptance rate (FAR) and false rejection rate (FRR) evaluation for fingerprint sensors set by the International Organization for Standardization (ISO) and fast identity online (FIDO) rely on the evaluation using a large test crew of genuine persons to provide actual fingerprints. This evaluation technique has many drawbacks. The technique lacks comparability between test labs and as test crews change. Test positions/conditions for verifications are not defined. The technique provides almost no repeatability, for example, the test crew must be the same, which is difficult to achieve, and humans will not present their finger in same positions and pressure from test to test. Using actual fingerprints may raise privacy concerns in most countries. Current testing techniques have a high cost related to travel, motivation expenses, and legal management. It requires a long test time and the system is prone to human error (bad labeling of finger, false presentation of finger). Also, because the technique relies on live humans, it is nearly impossible to conduct the test during pandemic situations. Finally, getting ethnic and age diversity in human test subjects can be difficult depending on the test location.
SUMMARY
[0004] In one aspect, the present disclosure provides a robotic system for testing a biometric sensor using synthetic fingers. The robotic system comprises a robot comprising: a robotic arm comprising an end effector configured to select a synthetic finger assembly, wherein the synthetic finger assembly comprises a synthetic finger and a near field communication (NFC) circuit; a controller electrically coupled to the robotic arm, the controller is configured to: control movement of the robotic arm; cause the end effector to select the synthetic finger assembly; and identify the synthetic finger assembly; and a biometric scanner coupled to a computer system, wherein the biometric scanner comprises a sensor configured to scan a fingerprint disposed on the synthetic finger.
[0005] In another aspect, the robotic arm comprises a spring configured to apply a uniform pressure to the synthetic finger assembly.
[0006] In another aspect, the robotic system comprises a contactless reader configured to read the NFC circuit portion of the synthetic finger assembly to identify the synthetic finger assembly. In one aspect, the NFC circuit comprises a radio frequency identification (RFID) tag. In one aspect, the controller is configured to: cause the contactless reader to scan the NFC circuit on the synthetic finger assembly to determine an identity of the synthetic finger assembly; and record the identity of the synthetic finger assembly.
[0007] In another aspect, the robotic arm comprises a contactless reader configured to read an NFC circuit portion of the synthetic finger assembly to identify the synthetic finger assembly.
[0008] In another aspect, the end effector is a vacuum end effector coupled to a vacuum source to enable the vacuum end effector to lift, hold, and move the synthetic finger assembly from a tray.
[0009] In another aspect, the end effector is a gecko inspired gripper.
[0010] In another aspect, the computer system coupled to biometric scanner is configured to extract an enrollment testing process from the biometric sensor. In one aspect, the controller is configured to cause the robotic arm to control the end effector to place the synthetic finger assembly in a plurality of positions according to the enrollment testing process. In one aspect, the biometric scanner is configured to scan the fingerprint in each of the plurality of positions and record each scan of the fingerprint in each of the plurality of positions. In one aspect, the computer system is configured to receive each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process; and record a reference template of the fingerprint, wherein the reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process. In one aspect, the reference template is correlated with an identity of the synthetic finger assembly recorded by a contactless reader. [0011] In another aspect, the controller is configured to step through a tray, wherein the tray comprises a plurality of synthetic finger assemblies.
[0012] In another aspect, the robotic arm is rotatable and articulatable.
[0013] In one aspect, the present disclosure provides a method of testing a biometric sensor using synthetic fingers. The method comprises selecting, by an end effector of a robotic arm, a synthetic finger assembly from a tray, wherein the synthetic finger assembly comprises a synthetic finger and a near field communication (NFC) circuit; scanning, by a contactless reader, the NFC circuit disposed on the synthetic finger assembly to identify the synthetic finger assembly; identifying, by the contactless reader, the synthetic finger assembly; and scanning, by a biometric scanner, a fingerprint disposed on the synthetic finger according to an enrollment testing process.
[0014] In another aspect, scanning the fingerprint according to the enrollment testing process comprises: placing, by the end effector of the robotic arm, the synthetic finger assembly in a plurality of positions according to the enrollment testing process; scanning, by the biometric scanner, the fingerprint in each of the plurality of positions; and recording, by a computer system coupled to the biometric scanner, each scan of the fingerprint in each of the plurality of positions.
[0015] In another aspect, placing includes rotating the synthetic finger assembly.
[0016] In another aspect, the method comprises recording a reference template of the fingerprint, wherein the reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process. In one aspect, the method comprises recording the identity of the synthetic finger assembly read by the contactless reader. In one aspect, the method comprises correlating the identity of the synthetic finger assembly and the reference template for each synthetic finger assembly.
[0017] In another aspect, the method comprises moving, by the robotic arm, the synthetic finger assembly to the contactless reader. In one aspect, the method comprises moving, by the robotic arm, the synthetic finger assembly from the contactless reader to the biometric scanner. In one aspect, selecting by the end effector of the robotic arm comprises applying a vacuum by the end effector of the robotic arm to lift, hold, and move the synthetic finger assembly.
[0018] In another aspect, selecting by the end effector of the robotic arm comprises lifting, holding, and moving the synthetic finger assembly with a gecko-inspired gripper. [0019] In another aspect, the method comprises returning, by the end effector of the robotic arm, the synthetic finger assembly to the tray after the enrollment testing process is complete.
[0020] In another aspect, the method comprises receiving, by a computer system coupled to the biometric scanner, the enrollment testing process data from the biometric scanner.
[0021] In another aspect, the method comprises stepping, by the end effector of the robotic arm, through a tray of synthetic finger assemblies to select each synthetic finger assembly disposed within the tray. In one aspect, the method comprises recording a reference template with the identity of the synthetic finger assembly of each synthetic finger assembly in the tray.
[0022] In another aspect, the method comprises returning, by the end effector of the robotic arm, the synthetic finger assembly to the tray after the enrollment testing process is complete; selecting, by the end effector of the robotic arm, a second synthetic finger assembly from the tray, wherein the second synthetic finger assembly comprises a second synthetic finger and a second NFC circuit; scanning, by the contactless reader, a second NFC circuit disposed on the second synthetic finger assembly; identifying, by the contactless reader, the second synthetic finger assembly; and scanning, by a biometric scanner, a second fingerprint disposed on the second synthetic finger according to the enrollment testing process.
BRIEF DESCRIPTION OF THE DRAWINGS
[0023] In the description, for purposes of explanation and not limitation, specific details are set forth, such as particular aspects, procedures, techniques, etc. to provide a thorough understanding of the present technology. However, it will be apparent to one skilled in the art that the present technology may be practiced in other aspects that depart from these specific details.
[0024] The accompanying drawings, where like reference numerals refer to identical or functionally similar elements throughout the separate views, together with the detailed description below, are incorporated in and form part of the specification, and serve to further illustrate aspects of concepts that include the claimed disclosure and explain various principles and advantages of those aspects.
[0025] The synthetic fingerprints and method of manufacturing synthetic fingerprints for testing biometric sensors disclosed herein have been represented where appropriate by conventional symbols in the drawings, showing only those specific details that are pertinent to understanding the various aspects of the present disclosure so as not to obscure the disclosure with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein.
[0026] FIG. 1 illustrates a flow diagram of a process for manufacturing a synthetic finger comprising a synthetic fingerprint and testing a fingerprint/biometric sensor using the synthetic finger, according to at least one aspect of the present disclosure.
[0027] FIG. 2 illustrates a fingerprint generated using artificial intelligence techniques, according to at least one aspect of the present disclosure.
[0028] FIG. 3 illustrates a mold comprising a metal plate and an array of individual 3D fingerprint molds for manufacturing a plurality of synthetic fingers, according to at least one aspect of the present disclosure.
[0029] FIG. 4 illustrates a support structure comprising a frame to support the metal plate shown in FIG. 3 during the casting process and a casting material for casting the 3D fingerprint molds onto the casting material to create a plurality of synthetic fingers, according to at least one aspect of the present disclosure.
[0030] FIG. 5 illustrates a sheet of casting material comprising an array of synthetic fingers created with the metal plate shown in FIGS. 3 and 4, where the synthetic fingers are being separated into strips from the array of synthetic fingers, according to at least one aspect of the present disclosure.
[0031] FIG. 6 illustrates the sheet of casting material comprising an array of synthetic fingers shown in FIG. 5, where individual synthetic fingers are being separated from the strips, according to at least one aspect of the present disclosure.
[0032] FIGS. 7A-7E illustrate the steps for manufacturing a synthetic finger assembly for testing a fingerprint sensor used in fingerprint scanner systems to recognize a person, according to at least one aspect of the present disclosure, where:
[0033] FIG. 7A illustrates a substrate, or plate for mounting a synthetic finger, according to at least one aspect of the present disclosure;
[0034] FIG. 7B illustrates a first synthetic finger subassembly comprising an NFC (near field communication) circuit attached to the substrate, according to at least one aspect of the present disclosure; [0035] FIG. 70 illustrates a second synthetic finger subassembly comprising a doublesided adhesive tape attached over the NFC circuit, according to at least one aspect of the present disclosure;
[0036] FIG. 7D illustrates a synthetic finger assembly, according to at least one aspect of the present disclosure; and
[0037] FIG. 7E illustrates an alternate synthetic finger assembly comprising a layer of foam interposed between a substrate and a synthetic finger, according to at least one aspect of the present disclosure.
[0038] FIG. 8 illustrates a dispensing tray comprising a plurality of synthetic finger assemblies manufactured using the process shown in FIGS. 7A-7D or 7E, according to at least one aspect of the present disclosure.
[0039] FIG. 9 illustrates a dispensing tray comprising a plurality of synthetic finger assemblies manufactured using the process shown in FIGS. FIGS. 7A-7D or 7E, according to at least one aspect of the present disclosure.
[0040] FIG. 10 illustrates a robotic automated testing system for testing biometric scanners with synthetic fingers, according to at least one aspect of the present disclosure.
[0041] FIG. 11 is a close-up view of the robotic automated testing system shown in FIG. 10, showing dispensing trays comprising a plurality of cells for housing a plurality of synthetic finger assemblies therein for use in the testing process, according to at least one aspect of the present disclosure.
[0042] FIG. 12 illustrates the robotic automated testing system shown in FIG. 10 showing the end effector of the robotic arm positioned above the synthetic finger assembly disposed in a one of the cells of the dispensing tray, according to at least one aspect of the present disclosure.
[0043] FIG. 13 is a close-up view of the dispensing trays and the end effector of the robotic arm positioned over the synthetic finger assembly disposed in one of the cells of the dispensing tray, according to at least one aspect of the present disclosure.
[0044] FIG. 14 is a close-up view of the dispensing trays showing the end effector of the robot in the process of lifting the synthetic finger assembly out of one of the cells of the dispensing tray, according to at least one aspect of the present disclosure. [0045] FIG. 15 illustrates the robotic automated testing system shown in FIG. 10 in the process of placing the synthetic finger assembly proximate to a contactless reader, according to at least one aspect of the present disclosure.
[0046] FIG. 16 is a close-up view of the robotic automated testing system shown in FIG.
15 in the process of placing the synthetic finger assembly proximate to the contactless reader, according to at least one aspect of the present disclosure.
[0047] FIG. 17 is a close-up view of the robotic automated testing system shown in FIG.
16 in the process of lifting the synthetic finger assembly from the contactless reader, according to at least one aspect of the present disclosure.
[0048] FIGS. 18A-18D is a sequence of the robotic automated testing system in the process of positioning the synthetic finger assembly on a sensor of a biometric scanner in a variety of orientations and applied pressure, according to at least one aspect of the present disclosure, where:
[0049] FIG. 18A shows the end effector positioning the synthetic finger assembly in a first orientation relative to the sensor, according to at least one aspect of the present disclosure;
[0050] FIG. 18B shows the end effector positioning the synthetic finger assembly in a second orientation relative to the sensor, according to at least one aspect of the present disclosure;
[0051] FIG. 18C shows the end effector positioning the synthetic finger assembly in a third orientation relative to the sensor, according to at least one aspect of the present disclosure; and
[0052] FIG. 18D shows the end effector positioning the synthetic finger assembly in a fourth orientation relative to the sensor, according to at least one aspect of the present disclosure.
[0053] FIG. 19 is a flow diagram of an automated testing process, according to at least one aspect of the present disclosure.
[0054] FIG. 20 is a block diagram of a computer apparatus with data processing subsystems or components, according to at least one aspect of the present disclosure. DESCRIPTION
[0055] This application is related to US Provisional Patent Application Serial No.63/384, 214, filed November 18, 2022, titled SYNTHETIC FINGERPRINTS AND METHOD OF MANUFACTURING SYNTHETIC FINGERPRINTS FOR TESTING BIOMETRIC SENSORS, which is herein incorporated by reference in its entirety.
[0056] The following disclosure may provide exemplary systems, devices, and methods for conducting a financial transaction and related activities. Although reference may be made to such financial transactions in the examples provided below, aspects are not so limited. That is, the systems, methods, and apparatuses may be utilized for any suitable purpose.
[0057] In one aspect, robotic automated testing of fingerprint/biometric sensor systems with synthetic fingerprints was not foreseen as being acceptable by most biometric sensor manufacturers due to anti-spoofing considerations. The synthetic fingerprints and the process for manufacturing the synthetic fingerprints disclosed herein, however, provide an improvement over existing biometric sensor testing systems due to significant improvements in the generation of synthetic fingerprints using artificial intelligence (Al) and the creation of realistic synthetic fingerprints not recognized as such by the fingerprint/biometric sensors under test. The synthetic fingerprints disclosed herein are generated using high quality synthetic fingerprint images, high quality molds, and casting materials. The synthetic finger assemblies can be read by a variety of different fingerprint/biometric sensors under test. Accordingly, the synthetic fingerprints and the process for manufacturing the synthetic fingerprints for testing biometric sensors disclosed herein provide a significant improvement over conventional fingerprint/biometric sensor systems. The robotic automated testing of the fingerprint/biometric sensor systems with synthetic fingerprints facilitates the evaluation of the FAR/FRR during the testing process.
[0058] Turning now to the figures, FIG. 1 illustrates a flow diagram of a process 100 for manufacturing a synthetic finger comprising a synthetic fingerprint and testing fingerprint/biometric sensors using the synthetic finger, according to at least one aspect of the present disclosure. The process 100 starts with the creation of a high quality database 102 with a fingerprint image resolution between 500ppi (pixels per inch) to 1000ppi or greater, for example. The database 102 can have different origins, for example, two main database 102 sources as follows.
[0059] In one aspect, a first fingerprint database 104 comprises fingerprint data generated by a computer (e.g., the computer apparatus 3000 shown in FIG. 20) using Al generated fingerprint techniques or other training algorithms to generate reliable and near human fingerprints. Al techniques can include, for example, using Generative Adversarial Neural Networks (GAN or styleGAN) and/or other software techniques to improve the last layer resolution of fingerprint data. The GANs are effective at generating large high-quality images and to train more generator models. The Style-GAN, is an extension to the GAN architecture, including the use of a mapping network to map points in latent space to an intermediate latent space, the use of the intermediate latent space to control style at each point in the generator model, and the introduction to noise as a source of variation at each point in the generator model. The resulting model is capable not only of generating photorealistic high-quality photos of human features such as fingerprints, but also offers control over the style of the generated image at different levels of detail through varying the style vectors and noise. In one aspect, Al can be used on a final layer to improve generation from growing patterns using minutia or patterns generated using fixed algorithms such as, for example, multiresolution analysis algorithms (e.g., Min-Temp MultiRes or low level Al generation Syn-Re-GAN). Such techniques, however, may provide results of lower similarity to a human finger. FIG. 2 illustrates an example of a fingerprint 200 generated using Al techniques, according to at least one aspect of the present disclosure.
[0060] With reference back to FIG. 1, in another aspect, a second fingerprint database 106 comprises fingerprint data from real persons that can be employed by the process 100. The use of the second fingerprint database 106 collected from real human fingerprints guarantees similarity to real human fingerprints. However, this technique can considerably lower certain benefits and diversity that can be realized using the Al generated fingerprint database 104.
[0061] One example of Al Software used for generating a fingerprint database includes a pre-trained model configuration file (CFG) and a synthetically generated dataset publicly available as Clarkson Fingerprint Generator, which is an example of a Style-GAN described above. Example databases of real person fingerprints includes some involving the CrossMatch Gardian sensor or the Biometrica Hi Scan Sensor as for example the NIST Special Database. These databases of real person fingerprints can be used by the process 100 to modify the real persons fingerprint data to generate synthetic fingerprints, for example.
[0062] Once the high quality database 102 has been created, the process 100 includes the creation of a synthetic finger 112 using high quality/fidelity quality material 108. The creation of the synthetic finger 112 can employ a material having optical, mechanical, electrical conductivity, and thermal conductivity, among other properties, reflecting the properties of real human skin. The high fidelity quality materials exhibiting real human skin properties include jellifying products (e.g., gelatin, pectin casein, agar), polymer products (natural or artificial glues), and/or additives mixed in ratios to produce a casting material that reflects properties of real human skin.
[0063] The creation of a synthetic finger 112 includes the creation of high quality 3D molds 110. A high quality 3D model of a fingerprint is created using fingerprint data read from the high quality database 102. The high quality 3D model uses greyscale as a displacement map on a high-resolution grid. The displacement map is used to achieve a maximum vertical displacement between 30 and 80pm in order to reflect the real repartition of friction ridge depth of a real fingerprint. The high quality 3D model is then used to create molds using a 3D process. A high quality fingerprint image has a resolution between 500ppi (pixels per inch) to 1000ppi or greater, as discussed above.
[0064] In one aspect, the present disclosure provides a process for transforming the fingerprint image in a 3D model using commercially available image processing techniques and image manipulation software. In practice, software such as “Python” with the libraries “numpy” and “PIL” enabled fast and easy image processing.
[0065] In one aspect, an image processing technique includes inverting the fingerprint image (if needed) such that the background corresponds to “0” black and the fingerprint appears in white. If any non-zero value is present at the border of the image, a soft frame having a width of 5 pixels is created around the image with 0 value (increase size). The greyscale repartition is modified linearly such that the image greyscale is in a range from 0 to 255. If several images from the same finger are available, the image with the best coverage and/or less rotation is selected. The fingerprint is centered. The image size is modified using LANCZOS interpolation in order to target an image with 3000ppi and an upscale to compensate for any shrinkage. For example, using a final material with shrinkage of 9.09% (dividing by 1.1), a 500ppi image is upscaled with a factor 6.6. The image is cropped to correspond to the size of the target pattern. For example, a crop to (3064,3776) for an area of 26mmx32mm. If any non-zero value is present at the border of the cropped image a soft frame of 6 to 12 pixel width is overlapped around the image with 0 value (keep size).
[0066] The following 3D meshing technique can be performed with commercially available 3D software. The software Blender® has been successfully used in this context. The 3D meshing technique starts by creating a mesh representing a square of the large area (example 26mmx32mm). The mesh is subdivided such that the plane is composed of a grid of vertex every 25pm (in Blender we used 1 unit = 1 mm). A displacement modifier is used (Displace in Blender®) using the input image as texture (unwrap the texture such that the size corresponds) and the strength is set such that a complete white pixel corresponds to the desired maximal displacement (so between 33 and 81 pm - this also considers the shrinkage of the material used for creating the final synthetic finger). The displacement is applied and a final mesh is obtained to allow 3D engraving, such as laser engraving/etching.
[0067] With reference back to FIG. 1, the creation of the 3D mold 110 can employ additive or subtractive processes, or combinations thereof. In one aspect, the process of creating a 3D mold 110 can include a high precision additive model (1-5 pm) such as 3D printing, for example. In another aspect, the process of creating 100 a 3D mold can include a subtractive process such as high precision laser engraving/etching on a metal plate, for example. Creation of the 3D mold 110 includes automatic labeling on the image (white text in the image) to allow easy identification of the later produced synthetic fingerprints.
[0068] FIG. 3 illustrates a mold 600 comprising a metal plate 602 and an array of individual synthetic 3D fingerprint molds 604 for manufacturing a plurality of synthetic fingers, according to at least one aspect of the present disclosure. The array of 3D fingerprint molds 604 is formed on a metal plate 602. As discussed above, the fingerprint molds 604 can be made using a high precision additive process such as 3D printing, for example, or a high precision subtractive process such as a high precision laser engraving, for example. The 3D fingerprint molds 604 each can include a label 606 formed near the image of the fingerprint to allow identification of the synthetic fingerprints. The metal plate 602 shown in FIG. 3, yields 49 fingerprints. Those skilled in the will appreciate, however, that a metal plate may include any number of fingerprint molds, without limitation.
[0069] FIG. 4 illustrates a support structure 700 comprising a frame 702 to support the metal plate 602 shown in FIG. 3 during the casting process and a casted material 704. The 3D fingerprint molds 604 on the metal plate 602 are casted onto the casted material 704 to create a sheet of casted material 704 comprising a plurality of synthetic fingerprints, according to at least one aspect of the present disclosure.
[0070] FIG. 5 illustrates a sheet 800 of casted material 704 comprising an array of synthetic fingers 802 created using the metal plate 600 and casting material 704 shown in FIGS. 3 and 4. As shown in FIG. 5, the synthetic fingers 802 are being separated into strips 804 from the array of synthetic fingers 802, according to at least one aspect of the present disclosure. In one aspect, the synthetic fingers 802 are separated by a robotic arm.
[0071] FIG. 6 illustrates the sheet 800 of casted material 704 comprising an array of synthetic fingers 802 shown in FIG. 5. The individual synthetic fingers 806 are being separated from the strips 804, according to at least one aspect of the present disclosure. In one aspect, the synthetic fingers 802 are separated by a robotic arm.
[0072] FIGS. 7A-7D illustrate the steps for manufacturing a synthetic finger assembly for testing a fingerprint sensor used in fingerprint scanner systems to recognize a person, according to at least one aspect of the present disclosure. FIG. 7E illustrates an alternate synthetic fingerprint assembly 920.
[0073] FIG. 7A illustrates a substrate 900, or plate, for mounting a synthetic finger thereon. The substrate 900 can be made of any rigid or semi-rigid material suitable for supporting the components of a synthetic finger assembly 912, 920 shown in FIGS. 7D, 7E, respectively, for example. In one aspect, the substrate 900 can be formed of a polymeric material such as plastic, for example. In one aspect, the polymer or plastic can be a biobased polymer such as Polylactic Acid (PLA), for example.
[0074] FIG. 7B illustrates a first synthetic finger subassembly 904 comprising an NFC circuit 902 attached to the substrate 900. In one aspect, the NFC circuit 902 can be an RFID tag. In one aspect, the NFC circuit 902 can be attached to the substrate 900 with an adhesive, such as, for example, an adhesive sticker provided on one side of the NFC circuit 902.
[0075] FIG. 7C illustrates a second synthetic finger subassembly 908 comprising a piece of double-sided adhesive tape 906 attached over the NFC circuit 902. A top side 907 of the double-sided adhesive tape 906 is shown ready to receive a synthetic finger 910 as shown in FIG. 7D.
[0076] FIG. 7D illustrates a synthetic finger assembly 912, according to at least one aspect of the present disclosure. A bottom side 914 of a synthetic finger 910, manufactured in accordance with steps 102-112 of the process 100 shown in FIG. 1 , is attached to the top side 907 (FIG. 7C) of the double-sided adhesive tape 906. A fingerprint portion of the synthetic finger 910 is on a top side 916 of the synthetic finger 910. The synthetic finger assembly 912 is shown ready to be used in a fingerprint/biometric sensor testing process.
[0077] FIG. 7E illustrates an alternate synthetic fingerprint assembly 920 comprising a layer of foam material 918 interposed between the substrate 900 and the synthetic finger 910, according to at least one aspect of the present disclosure. In the aspect illustrated in FIG. 7E, a bottom side of the foam material 918 is attached to the top side 907 (FIG. 7C) of the double-sided adhesive tape 906. A second adhesive layer 919 is attached to a top side of the foam material 918 to attach the bottom side 914 of the synthetic finger 910 to the top side of the foam material 918. The foam material 918 is used to control the pressure applied to the fingerprint sensor during the testing process.
[0078] FIG. 8 illustrates a dispensing tray 1000 comprising a plurality of synthetic finger assemblies 1002 manufactured using the process shown in FIGS. 7A-7D or 7E, according to at least one aspect of the present disclosure. The dispensing tray 1000 comprises a frame 1004 defining a plurality of cells 1006 arranged in an array. Each cell 1006 is configured to receive and accommodate a synthetic finger assembly 1002. As shown in the aspect illustrated in FIG. 8, each synthetic finger assembly 1002 comprises an identification label 1008, disposed over a substrate 1010, as described in connection with FIGS. 7A-7D or 7E. One side of an NFC circuit 1012 is attached to the substrate 1010 and a synthetic finger 1014 is attached to an opposite side of the NFC circuit 1012. In the aspect illustrated in FIG. 8, the synthetic finger 1014 is positioned in a cell 1006 such that the synthetic fingerprint is facing the bottom of a cell 1006. In other words, the opposite side of the synthetic finger 1014 attached to the NFC circuit 1012 is positioned such that it faces the bottom of the cell 1006. In one aspect, the layout configuration of the dispensing tray 1000 is suitable for use in either manual or automated fingerprint/biometric sensor testing process. In an automated testing process, for example, an end effector of a robotic arm selects a synthetic finger assembly 1002 from a cell 1006 of the dispensing tray 1000 and then places the synthetic fingerprint portion of the synthetic finger assembly 1002 on a fingerprint/biometric sensor under test.
[0079] FIG. 9 illustrates a dispensing tray 1100 comprising a plurality of synthetic fingerprint assemblies 1102 manufactured using the process shown in FIGS. 7A-7D or 7E, according to at least one aspect of the present disclosure. The dispensing tray 1100 comprises a frame 1104 defining a plurality of cells 1106 arranged in an array. Each cell 1106 is configured to receive and accommodate a synthetic finger assembly 1102. As shown in the aspect illustrated in FIG. 9, each synthetic finger assembly 1102 comprises an identification label 1108, disposed over a substrate 1010, as described in connection with FIGS. 7A-7D or 7E. One side of an NFC circuit is attached to a substrate and a synthetic finger is attached to an opposite side of the NFC circuit. In the aspect illustrated in FIG. 9, the synthetic fingerprint is located on a bottom side of the synthetic finger assembly 1102 facing the bottom of the cell 1106, which is opposite the side of the synthetic finger attached to the NFC circuit. In one aspect, the layout configuration of the dispensing tray 1100 is suitable for use in either manual or automated fingerprint/biometric sensor testing process. In an automated testing process, for example, an end effector of a robotic arm selects a synthetic finger assembly 1102 from a cell 1106 of the dispensing tray 1100 and places the synthetic fingerprint portion of the synthetic finger assembly 1102 on a fingerprint/biometric sensor under test.
[0080] With reference now back to FIG. 1, the process 100 includes an automated testing process 114 for testing a fingerprint sensor using the synthetic finger manufactured according to steps 102-112 of the process 100. Using the synthetic finger manufactured according to steps 102-112 of the process 100. With reference now to FIG. 1 together with FIGS. 8 and 9, a layout of each created synthetic finger assembly 1001 , 1102 disposed in dispensing trays 1000, 1100 is configured and optimized to automate the presentation of the synthetic finger assembly 1002, 1102 to a robot. Using a proxy software to the collection software, data from all the synthetic fingerprints can be automatically collected using the NFC circuits 1012 on the synthetic finger assembly 1002, 1102. Data is collected according to the definition for enrollment 116 (enrollment update) defined by the sensor manufacturer (given in the evaluation results definition) and the verification positions 118. The synthetic fingerprint is recognized using a contactless reader. The dataset is automatically labelled using this information.
[0081] Still with reference to FIG. 1, the process 100 can include the creation 120 of blind data 122 to prevent cheating. The blind data 122 is provided to an algorithm under evaluation 125. The process of blinding the data includes shuffling and/or renaming the verification data in a way that matching of a data with an enrollment data is written in a separate file and cannot be deduced from the name/structure of the verification file. This step is optional but ensures that cheating the evaluation cannot be easily accomplished, although may still be possible. The result of the shuffling is the blinded data 122 on one side and matching information 128 on the other side.
[0082] The algorithm 124 under evaluation is run using the blinded data 122 as a universal attacker (evaluation of the FAR or FRR). The evaluation returns output matching results 126 in a predefined format that allows for automatic evaluation. The matching information 128 and the matching result 126 output by the algorithm 124 are recombined to evaluate 130 the real FAR/FRR. The evaluation process according to various aspects of the present disclosure provides several advantages. For example, the present evaluation process increases the comparability between test laboratory using the same test material and pattern at all labs; increases the repeatability by defining fixed test positions/pressure and test conditions; in case of computer generated fingerprints database, removes privacy concerns; reduces cost and testing time; removes error due to human presentation and labeling (better precision in presentation position); allows testing in pandemic situations; using specific generation design, the generated fingerprint can reflect some trait related to age or ethnicity; and/or using variation in conductivity, foam (pressure level), and environment conditions (humidity and temperature)provides additional advantages to the evaluation process.
[0083] FIG. 10 illustrates a robotic automated testing system 1200 for testing biometric scanner 1216 with synthetic fingers, according to at least one aspect of the present disclosure. The robotic automated testing system 1200 comprises a robot 1202 comprising a movable robotic arm 1204, an end effector 1206, and a controller 1207 electrically coupled to the robotic arm 1204. The robotic arm 1204 is rotatable and articulatable. In one aspect, the controller 1207 may implemented as the computer apparatus 3000 shown in FIG. 20.
[0084] With reference back to FIG. 10, the controller 1220 is configured to control movement of the robotic arm 1204 and cause the end effector 1206 to select the synthetic finger assembly 1210 out of a dispensing tray 1212 and identify the synthetic finger assembly 1210 using contactless reader 1214. In one aspect, the end effector 1206 is pneumatically coupled to a vacuum source via tube 1208. In this example, the end effector 1206 can be a vacuum end effector configured lift the synthetic finger assembly 1210 out of the dispensing tray 1212, hold the synthetic finger assembly 1210, and move the synthetic finger assembly 1210 from the dispensing tray 1212 to the contactless reader 1214 and then to the biometric scanner 1216. The end effector 1206 then contacts the synthetic finger assembly 1210 with the sensor 1218 to scan the synthetic fingerprint. The robot controller 1220 is configured to step the robotic arm 1204 and end effector 1206 through the dispensing tray 1212 to select and replace the plurality of synthetic finger assemblies 1210 contained in the dispensing tray 1212. In another example, the end effector 1206 may comprise a gripper with a gecko-inspired adhesive to grasp and manipulate the synthetic finger assembly 1210 out of the dispensing tray 1212, hold the synthetic finger assembly 1210, and move the synthetic finger assembly 1210 from the dispensing tray 1212 to the contactless reader 1214 and then to the biometric scanner 1216.
[0085] The biometric scanner 1216 is coupled to a computer system for acquiring test data from the biometric scanner 1216. In one aspect, the computer system 1222 may be implemented as the computer apparatus 3000 shown in FIG. 20. With reference back to FIG. 10, the biometric scanner 1216 comprises a sensor 1218 configured to scan a fingerprint disposed on the synthetic finger 910, 910 (FIGS. 7D, 7E) of the synthetic finger assembly 1210.
[0086] The contactless reader 1214 is configured to read the NFC circuit 902 (FIGS. 7A, 7B) for the purpose of identifying the synthetic finger assembly 1210 and, in particular, the synthetic fingerprint on the synthetic finger 910 (FIGS. 7A, 7B). In one aspect, the contactless reader 1214 is an RFID tag reader. The contactless reader 1214 can be coupled to the robot controller 1220 or the computer system 1222, or both.
[0087] The robotic arm 1204 can include a contactless reader 1224 to wirelessly read the NFC circuit 902 (FIGS. 7A, 7B) for the purpose of identifying the synthetic finger assembly 1210 and, in particular, the synthetic fingerprint on the synthetic finger 910 (FIGS. 7A, 7B). As previously discussed, in one aspect the NFC circuit 902 can be an RFID tag.
[0088] In one aspect, robot controller 1220 is configured to cause the robotic arm 1204 to control the end effector 1206 to place the synthetic finger assembly 1210 in a plurality of positions according to the enrollment testing process. The biometric scanner 1216 is configured to scan the fingerprint in each of the plurality of positions and record each scan of the fingerprint in each of the plurality of positions. In one aspect, the computer system 1222 is configured to receive each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process and record a reference template of the fingerprint. The reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process. In one aspect, the reference template is correlated with an identity of the synthetic finger assembly 1210 recorded by the contactless reader 12140.
[0089] FIG. 11 is a close-up view of the robotic automated testing system 1200 shown in FIG. 10, showing dispensing trays 1212 comprising a plurality of cells 1226 for housing a plurality of synthetic finger assemblies 1210 therein for use in the testing process, according to at least one aspect of the present disclosure.
[0090] FIG. 12 illustrates the robotic automated testing system 1200 shown in FIG. 10 showing the end effector 1206 of the robotic arm 1204 positioned over a synthetic finger assembly 1210 disposed in one of the cells 1226 of the dispensing tray 1212, according to at least one aspect of the present disclosure. FIG. 13 is a close-up view of the dispensing tray 1212 and the end effector 1206 of the robotic arm 1204 positioned above the synthetic finger assembly 1210 disposed in one of the cells 1226 of the dispensing tray 1212, according to at least one aspect of the present disclosure. FIG. 14 is a close-up view of the dispensing trays 1212 showing the end effector 1206 of the robot arm 1204 in the process of lifting the synthetic finger assembly 1210 out of one of the cells 1226 of the dispensing tray 1212, according to at least one aspect of the present disclosure. In one aspect, once the end effector 1206 is positioned over the synthetic finger assembly 1210, the end effector 1206 can use vacuum to lift the synthetic finger assembly 1210 out of the cell 1226 of the dispensing tray 1212 as shown in FIG. 14.
[0091] FIG. 15 illustrates the robotic automated testing 1200 system shown in FIG. 10 in the process of placing the synthetic finger assembly 1210 proximate to a contactless reader 1214, according to at least one aspect of the present disclosure. As described above, the contactless reader 1214 is coupled to either the robot controller 12220 or the computer system 1222, or both. The contactless reader 1214 reads the NFC circuit 902 (FIGS. 7A, 7B) for the purpose of identifying the synthetic finger assembly 1210 and in particular, identifying the fingerprint that is about to be scanned by the sensor 1218 of the biometric scanner 1216. FIG. 16 is a close-up view of the robotic automated testing system 1200 shown in FIG. 15 in the process of placing the synthetic finger assembly 1210 proximate to the contactless reader 1214, according to at least one aspect of the present disclosure.
[0092] FIG. 17 is a close-up view of the robotic automated testing system 1200 shown in FIG. 16 in the process of lifting the synthetic finger assembly 1210 from the contactless reader 1214, according to at least one aspect of the present disclosure, prior to moving the synthetic finger assembly 1210 over to the sensor 1218 of the biometric scanner 1216.
[0093] FIGS. 18A-18D is a sequence of the robotic automated testing system 1200 in the process of positioning the synthetic finger assembly 1210 on the sensor 1218 of the biometric scanner 1216 in a variety of orientations and applied pressure, according to at least one aspect of the present disclosure. FIG. 18A shows the end effector 1206 positioning the synthetic finger assembly 1210 in a first orientation relative to the sensor 1218, according to at least one aspect of the present disclosure. FIG. 18B shows the end effector 1206 positioning the synthetic finger assembly 1210 in a second orientation relative to the sensor 1218, according to at least one aspect of the present disclosure. FIG. 18C shows the end effector 1206 positioning the synthetic finger assembly 1210 in a third orientation relative to the sensor 1218, according to at least one aspect of the present disclosure. FIG. 18D shows the end effector 1206 positioning the synthetic finger assembly 1210 sensor in a fourth orientation relative to the sensor 1218, according to at least one aspect of the present disclosure.
[0094] FIG. 19 is a flow diagram of an automated testing process 1300, according to at least one aspect of the present disclosure. With reference now to FIG. 19 together with FIGS. 7A-18D, according to one aspect of the process 1300, an end effector 1206 of a robotic arm 1204 selects 1302 a synthetic finger assembly 1210 from a tray 1212. The synthetic finger assembly 1210 comprises a synthetic finger 910 (FIGS. 7D, 7E) and a near field communication (NFC) circuit 902 (FIGS. 7B, 7C). A contactless reader 1214 scans 1304 the NFC circuit 902 disposed on the synthetic finger assembly 1210 to identify the synthetic finger assembly 1210. The contactless reader 1214 identifies 1306 the synthetic finger assembly 1310. A biometric scanner 1216 scans 1308 a fingerprint disposed on the synthetic finger 910 according to an enrollment testing process.
[0095] In another aspect of the process 1300, in scanning the fingerprint according to the enrollment testing process, the end effector 1206 of the robotic arm 1204 places the synthetic finger assembly 1210 in a plurality of positions according to the enrollment testing process. The biometric scanner 1216 scans the fingerprint in each of the plurality of positions. A computer system 1222 coupled to the biometric scanner 1216 records each scan of the fingerprint in each of the plurality of positions. In one aspect, placing comprises rotating the synthetic finger assembly 1210. In another aspect, the computer system 1222 records a reference template of the fingerprint. The reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process. In another aspect, the computer system 1222 records the identity of the synthetic finger assembly 1210 read by the contactless reader 1214. In another aspect, the computer system 1222 correlates the identity of the synthetic finger assembly 1210 and the reference template for each synthetic finger assembly 1210.
[0096] In various aspects, the robotic arm 1204 moves the synthetic finger assembly 1210 to the contactless reader 1214. In another aspect, the robotic arm 1204 moves the synthetic finger assembly 1210 from the contactless reader 1214 to the biometric scanner 1216. In another aspect, the end effector 1206 of the robotic arm 1204 applies a vacuum to select a synthetic finger assembly 1210 and lift, hold, and move the synthetic finger assembly 1210. In another aspect, the end effector 1206 of the robotic arm 1204 returns the synthetic finger assembly 1210 to the tray 1212 after the enrollment testing process is complete. In another aspect, a computer system 1222 coupled to the biometric scanner 1216 receives the enrollment testing process data from the biometric scanner 1216.
[0097] In various aspects, the end effector 1206 of the robotic arm 1204 steps through a tray 1212 of synthetic finger assemblies 1210 and selects each synthetic finger assembly 1210 disposed within the tray 1212. In another aspect, the computer system 1222 records a reference template with the identity of the synthetic finger assembly 1210 of each synthetic finger assembly 1210 in the tray 1212. In another aspect, the end effector 1206 of the robotic arm 1204 returns the synthetic finger assembly 1210 to the tray 1212 after the enrollment testing process is complete. The end effector 1206 of the robotic arm 1204 selects a second synthetic finger assembly 1210 from the tray 1212. The second synthetic finger assembly 1210 comprises a second synthetic finger and a second NFC circuit. The contactless reader 1214 scans a second NFC circuit disposed on the second synthetic finger assembly. The contactless reader 1214 identifies the second synthetic finger assembly. The biometric scanner 1216 scans a second fingerprint disposed on the second synthetic finger according to the enrollment testing process.
[0098] FIG. 20 is a block diagram of a computer apparatus 3000 with data processing subsystems or components, according to at least one aspect of the present disclosure. The computer apparatus 3000 may be configured to implement the computer functions in the process 100 described in connection with FIG. 1. The subsystems shown in FIG. 20 are interconnected via a system bus 3010. Additional subsystems such as a printer 3018, keyboard 3026, fixed disk 3028 (or other memory comprising computer readable media), monitor 3022, which is coupled to a display adapter 3020, and others are shown. Peripherals and input/output (I/O) devices, which couple to an I/O controller 3012 (which can be a processor or other suitable controller), can be connected to the computer system by any number of means known in the art, such as a serial port 3024. For example, the serial port 3024 or external interface 3030 can be used to connect the computer apparatus to a wide area network such as the Internet, a mouse input device, or a scanner. The interconnection via system bus allows the central processor 3016 to communicate with each subsystem and to control the execution of instructions from system memory 3014 or the fixed disk 3028, as well as the exchange of information between subsystems. The system memory 3014 and/or the fixed disk 3028 may embody a computer readable medium.
[0099] It is noteworthy that any hardware platform suitable for performing the processing described herein is suitable for use with the technology. The terms “computer-readable storage medium” and “computer-readable storage media” as used herein refer to any medium or media that participate in providing instructions to a CPU for execution. Such media can take many forms, including, but not limited to, non-volatile media, volatile media, and transmission media. Non-volatile media include, for example, optical or magnetic disks, such as a fixed disk. Volatile media include dynamic memory, such as system RAM. Transmission media include coaxial cables, copper wire and fiber optics, among others, including the wires that comprise one aspect of a bus. Transmission media can also take the form of acoustic or light waves, such as those generated during radio frequency (RF) and infrared (IR) data communications. Common forms of computer-readable media include, for example, a flexible disk, a hard disk, magnetic tape, any other magnetic medium, a CD-ROM disk, digital video disk (DVD), any other optical medium, any other physical medium with patterns of marks or holes, a RAM, a PROM, an EPROM, an EEPROM, a FLASH EPROM, any other memory chip or data exchange adapter, a carrier wave, or any other medium from which a computer can read.
[0100] Various forms of computer-readable media may be involved in carrying one or more sequences of one or more instructions to a CPU for execution. A bus carries the data to system RAM, from which a CPU retrieves and executes the instructions. The instructions received by system RAM can optionally be stored on a fixed disk either before or after execution by a CPU.
[0101] Computer program code for carrying out operations for aspects of the present technology may be written in any combination of one or more programming languages, including an object-oriented programming language such as Java, Smalltalk, C++, or the like and conventional procedural programming languages, such as the "C" programming language, Go, Python, or other programming languages, including assembly languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
[0102] Examples of the method according to various aspects of the present disclosure are provided below in the following numbered clauses. An aspect of the method may include any one or more than one, and any combination of, the numbered clauses described below.
[0103] Clause 1. A robotic system for testing a biometric sensor using synthetic fingers, the robotic system comprising: a robotic arm comprising an end effector configured to select a synthetic finger assembly, wherein the synthetic finger assembly comprises a synthetic finger and a near field communication (NFC) circuit; a controller electrically coupled to the robotic arm; and a biometric scanner comprising a sensor configured to scan a fingerprint disposed on the synthetic finger; wherein the controller is configured to: control movement of the robotic arm; cause the end effector to select the synthetic finger assembly; and identify the synthetic finger assembly.
[0104] Clause 2. The robotic system of clause 1 , wherein the robotic arm comprises a spring configured to apply a uniform pressure to the synthetic finger assembly.
[0105] Clause 3. The robotic system of any one of clauses 1-2, comprising a contactless reader configured to read the NFC circuit of the synthetic finger assembly to identify the synthetic finger assembly. [0106] Clause 4. The robotic system of clause 3, wherein the NFC circuit comprises a radio frequency identification (RFID) tag.
[0107] Clause 5. The robotic system of clause 4, wherein the controller is configured to: cause the contactless reader to scan the NFC circuit on the synthetic finger assembly to determine an identity of the synthetic finger assembly; and record the identity of the synthetic finger assembly.
[0108] Clause 6. The robotic system of any one of clauses 1-5, wherein the robotic arm comprises a contactless reader configured to read the NFC circuit of the synthetic finger assembly to identify the synthetic finger assembly.
[0109] Clause 7. The robotic system of any one of clauses 1-6, wherein the end effector is a vacuum end effector coupled to a vacuum source to enable the vacuum end effector to lift, hold, and move the synthetic finger assembly from a tray.
[0110] Clause 8. The robotic system of any one of clauses 1-7, wherein the end effector is a gecko inspired gripper.
[0111] Clause 9. The robotic system of any one of clauses 1-8, wherein the controller is configured to step through a tray, wherein the tray comprises a plurality of synthetic finger assemblies.
[0112] Clause 10. The robotic system of any one of clauses 1-14, wherein the robotic arm is rotatable and articulatable.
[0113] Clause 11. A system for testing a biometric sensor using synthetic fingers, the system comprising: a computer system; and a robot coupled to the computer system, the robot comprising: a robotic arm comprising an end effector configured to select a synthetic finger assembly, wherein the synthetic finger assembly comprises a synthetic finger and a near field communication (NFC) circuit; a controller electrically coupled to the robotic arm; and a biometric scanner comprising a sensor configured to scan a fingerprint disposed on the synthetic finger; wherein the controller is configured to: control movement of the robotic arm; cause the end effector to select the synthetic finger assembly; and identify the synthetic finger assembly.
[0114] Clause 12. The system of clause 11, wherein the computer system is coupled to the biometric scanner and is configured to extract an enrollment testing process from the sensor. [0115] Clause 13. The system of any one of clauses 11-12, wherein the controller is configured to cause the robotic arm to control the end effector to place the synthetic finger assembly in a plurality of positions according to the enrollment testing process.
[0116] Clause 14. The system of any one of clauses 11-13, wherein the biometric scanner is configured to scan the fingerprint in each of the plurality of positions and record each scan of the fingerprint in each of the plurality of positions.
[0117] Clause 15. The system of any one of clauses 11-14, wherein the computer system is configured to: receive each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process; and record a reference template of the fingerprint, wherein the reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process.
[0118] Clause 16. The system of any one of clauses 11-15, wherein the reference template is correlated with an identity of the synthetic finger assembly recorded by a contactless reader.
[0119] Clause 17. A method of testing a biometric sensor using synthetic fingers, the method comprising: selecting, by an end effector of a robotic arm, a synthetic finger assembly from a tray, wherein the synthetic finger assembly comprises a synthetic finger and a near field communication (NFC) circuit; scanning, by a contactless reader, the NFC circuit disposed on the synthetic finger assembly to identify the synthetic finger assembly; identifying, by the contactless reader, the synthetic finger assembly; and scanning, by a biometric scanner, a fingerprint disposed on the synthetic finger according to an enrollment testing process.
[0120] Clause 18. The method of clause 17, wherein scanning the fingerprint according to the enrollment testing process comprises: placing, by the end effector of the robotic arm, the synthetic finger assembly in a plurality of positions according to the enrollment testing process; scanning, by the biometric scanner, the fingerprint in each of the plurality of positions; and recording, by a computer system coupled to the biometric scanner, each scan of the fingerprint in each of the plurality of positions.
[0121] Clause 19. The method of clause 18, wherein placing includes rotating the synthetic finger assembly.
[0122] Clause 20. The method of any one of clauses 18-19, comprising recording a reference template of the fingerprint, wherein the reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process.
[0123] Clause 21. The method of clause 20, comprising recording an identity of the synthetic finger assembly read by the contactless reader.
[0124] Clause 22. The method of clause 21 , comprising correlating the identity of the synthetic finger assembly and the reference template for each synthetic finger assembly.
[0125] Clause 23. The method of any one of clauses 17-22, comprising moving, by the robotic arm, the synthetic finger assembly to the contactless reader.
[0126] Clause 24. The method of clause 23, comprising moving, by the robotic arm, the synthetic finger assembly from the contactless reader to the biometric scanner.
[0127] Clause 25. The method of any one of clauses 17-24, wherein selecting by the end effector of the robotic arm comprises applying a vacuum by the end effector of the robotic arm to lift, hold, and move the synthetic finger assembly.
[0128] Clause 26. The method of any one of clauses 17-25, wherein selecting by the end effector of the robotic arm comprises lifting, holding, and moving the synthetic finger assembly with a gecko-inspired gripper.
[0129] Clause 27. The method of any one of clauses 17-26, comprising returning, by the end effector of the robotic arm, the synthetic finger assembly to the tray after the enrollment testing process is complete.
[0130] Clause 28. The method of any one of clauses 17-27, comprising receiving, by a computer system coupled to the biometric scanner, the enrollment testing process data from the biometric scanner.
[0131] Clause 29. The method of any one of clauses 17-28, comprising stepping, by the end effector of the robotic arm, through a tray of synthetic finger assemblies to select each synthetic finger assembly disposed within the tray.
[0132] Clause 30. The method of clause 29, comprising recording a reference template with an identity of the synthetic finger assembly of each synthetic finger assembly in the tray.
[0133] Clause 31. The method of any one of clauses 17-30, comprising returning, by the end effector of the robotic arm, the synthetic finger assembly to the tray after the enrollment testing process is complete; selecting, by the end effector of the robotic arm, a second synthetic finger assembly from the tray, wherein the second synthetic finger assembly comprises a second synthetic finger and a second NFC circuit; scanning, by the contactless reader, a second NFC circuit disposed on the second synthetic finger assembly; identifying, by the contactless reader, the second synthetic finger assembly; and scanning, by a biometric scanner, a second fingerprint disposed on the second synthetic finger according to the enrollment testing process.
[0134] The foregoing detailed description has set forth various forms of the systems and/or processes via the use of block diagrams, flowcharts, and/or examples. Insofar as such block diagrams, flowcharts, and/or examples contain one or more functions and/or operations, it will be understood by those within the art that each function and/or operation within such block diagrams, flowcharts, and/or examples can be implemented, individually and/or collectively, by a wide range of hardware, software, firmware, or virtually any combination thereof. Those skilled in the art will recognize that some aspects of the forms disclosed herein, in whole or in part, can be equivalently implemented in integrated circuits, as one or more computer programs running on one or more computers (e.g., as one or more programs running on one or more computer systems), as one or more programs running on one or more processors (e.g., as one or more programs running on one or more microprocessors), as firmware, or as virtually any combination thereof, and that designing the circuitry and/or writing the code for the software and or firmware would be well within the skill of one of skill in the art in light of this disclosure. In addition, those skilled in the art will appreciate that the mechanisms of the subject matter described herein are capable of being distributed as one or more program products in a variety of forms, and that an illustrative form of the subject matter described herein applies regardless of the particular type of signal bearing medium used to actually carry out the distribution.
[0135] Instructions used to program logic to perform various disclosed aspects can be stored within a memory in the system, such as dynamic random access memory (DRAM), cache, flash memory, or other storage. Furthermore, the instructions can be distributed via a network or by way of other computer readable media. Thus a machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), but is not limited to, floppy diskettes, optical disks, compact disc, read-only memory (CD-ROMs), and magneto-optical disks, read-only memory (ROMs), random access memory (RAM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic or optical cards, flash memory, or a tangible, machine-readable storage used in the transmission of information over the Internet via electrical, optical, acoustical or other forms of propagated signals (e.g., carrier waves, infrared signals, digital signals, etc.). Accordingly, the non- transitory computer-readable medium includes any type of tangible machine-readable medium suitable for storing or transmitting electronic instructions or information in a form readable by a machine (e.g., a computer).
[0136] Any of the software components or functions described in this application, may be implemented as software code to be executed by a processor using any suitable computer language such as, for example, Python, Java, C++ or Perl using, for example, conventional or object-oriented techniques. The software code may be stored as a series of instructions, or commands on a computer readable medium, such as RAM, ROM, a magnetic medium such as a hard-drive or a floppy disk, or an optical medium such as a CD- ROM. Any such computer readable medium may reside on or within a single computational apparatus and may be present on or within different computational apparatuses within a system or network.
[0137] As used in any aspect herein, the term “logic” may refer to an app, software, firmware and/or circuitry configured to perform any of the aforementioned operations. Software may be embodied as a software package, code, instructions, instruction sets and/or data recorded on non-transitory computer readable storage medium. Firmware may be embodied as code, instructions or instruction sets and/or data that are hard-coded (e.g., nonvolatile) in memory devices.
[0138] As used in any aspect herein, the terms “component,” “system,” “module” and the like can refer to a computer-related entity, either hardware, a combination of hardware and software, software, or software in execution.
[0139] As used in any aspect herein, an “algorithm” refers to a self-consistent sequence of steps leading to a desired result, where a “step” refers to a manipulation of physical quantities and/or logic states which may, though need not necessarily, take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It is common usage to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like. These and similar terms may be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities and/or states.
[0140] A network may include a packet switched network. The communication devices may be capable of communicating with each other using a selected packet switched network communications protocol. One example communications protocol may include an Ethernet communications protocol which may be capable of permitting communication using a Transmission Control Protocol/lnternet Protocol (TCP/IP). The Ethernet protocol may comply or be compatible with the Ethernet standard published by the Institute of Electrical and Electronics Engineers (IEEE) titled “IEEE 802.3 Standard”, published in December, 2008 and/or later versions of this standard. Alternatively or additionally, the communication devices may be capable of communicating with each other using an X.25 communications protocol. The X.25 communications protocol may comply or be compatible with a standard promulgated by the International Telecommunication Union-Telecommunication Standardization Sector (ITU-T). Alternatively or additionally, the communication devices may be capable of communicating with each other using a frame relay communications protocol. The frame relay communications protocol may comply or be compatible with a standard promulgated by Consultative Committee for International Telegraph and Telephone (CCITT) and/or the American National Standards Institute (ANSI). Alternatively or additionally, the transceivers may be capable of communicating with each other using an Asynchronous Transfer Mode (ATM) communications protocol. The ATM communications protocol may comply or be compatible with an ATM standard published by the ATM Forum titled “ATM- MPLS Network Interworking 2.0” published August 2001, and/or later versions of this standard. Of course, different and/or after-developed connection-oriented network communication protocols are equally contemplated herein.
[0141] Unless specifically stated otherwise as apparent from the foregoing disclosure, it is appreciated that, throughout the present disclosure, discussions using terms such as “processing,” “computing,” “calculating,” “determining,” “displaying,” or the like, refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission or display devices.
[0142] One or more components may be referred to herein as “configured to,” “configurable to,” “operable/operative to,” “adapted/adaptable,” “able to,” “conformable/conformed to,” etc. Those skilled in the art will recognize that “configured to” can generally encompass active-state components and/or inactive-state components and/or standby-state components, unless context requires otherwise.
[0143] Those skilled in the art will recognize that, in general, terms used herein, and especially in the appended claims (e.g., bodies of the appended claims) are generally intended as “open” terms (e.g., the term “including” should be interpreted as “including but not limited to,” the term “having” should be interpreted as “having at least,” the term “includes” should be interpreted as “includes but is not limited to,” etc.). It will be further understood by those within the art that if a specific number of an introduced claim recitation is intended, such an intent will be explicitly recited in the claim, and in the absence of such recitation no such intent is present. For example, as an aid to understanding, the following appended claims may contain usage of the introductory phrases “at least one” and “one or more” to introduce claim recitations. However, the use of such phrases should not be construed to imply that the introduction of a claim recitation by the indefinite articles “a” or “an” limits any particular claim containing such introduced claim recitation to claims containing only one such recitation, even when the same claim includes the introductory phrases “one or more” or “at least one” and indefinite articles such as “a” or “an” (e.g., “a” and/or “an” should typically be interpreted to mean “at least one” or “one or more”); the same holds true for the use of definite articles used to introduce claim recitations.
[0144] In addition, even if a specific number of an introduced claim recitation is explicitly recited, those skilled in the art will recognize that such recitation should typically be interpreted to mean at least the recited number (e.g., the bare recitation of “two recitations,” without other modifiers, typically means at least two recitations, or two or more recitations). Furthermore, in those instances where a convention analogous to “at least one of A, B, and C, etc.” is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., “a system having at least one of A, B, and C” would include but not be limited to systems that have A alone, B alone, C alone, A and B together, A and C together, B and C together, and/or A, B, and C together, etc.). In those instances where a convention analogous to “at least one of A, B, or C, etc.” is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., “a system having at least one of A, B, or C” would include but not be limited to systems that have A alone, B alone, C alone, A and B together, A and C together, B and C together, and/or A, B, and C together, etc.). It will be further understood by those within the art that typically a disjunctive word and/or phrase presenting two or more alternative terms, whether in the description, claims, or drawings, should be understood to contemplate the possibilities of including one of the terms, either of the terms, or both terms unless context dictates otherwise. For example, the phrase “A or B” will be typically understood to include the possibilities of “A” or “B” or “A and B.”
[0145] With respect to the appended claims, those skilled in the art will appreciate that recited operations therein may generally be performed in any order. Also, although various operational flow diagrams are presented in a sequence(s), it should be understood that the various operations may be performed in other orders than those which are illustrated, or may be performed concurrently. Examples of such alternate orderings may include overlapping, interleaved, interrupted, reordered, incremental, preparatory, supplemental, simultaneous, reverse, or other variant orderings, unless context dictates otherwise. Furthermore, terms like “responsive to,” “related to,” or other past-tense adjectives are generally not intended to exclude such variants, unless context dictates otherwise.
[0146] It is worthy to note that any reference to “one aspect,” “an aspect,” “an exemplification,” “one exemplification,” and the like means that a particular feature, structure, or characteristic described in connection with the aspect is included in at least one aspect. Thus, appearances of the phrases “in one aspect,” “in an aspect,” “in an exemplification,” and “in one exemplification” in various places throughout the specification are not necessarily all referring to the same aspect. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner in one or more aspects.
[0147] As used herein, the singular form of “a”, “an”, and “the” include the plural references unless the context clearly dictates otherwise.
[0148] Any patent application, patent, non-patent publication, or other disclosure material referred to in this specification and/or listed in any Application Data Sheet is incorporated by reference herein, to the extent that the incorporated materials is not inconsistent herewith. As such, and to the extent necessary, the disclosure as explicitly set forth herein supersedes any conflicting material incorporated herein by reference. Any material, or portion thereof, that is said to be incorporated by reference herein, but which conflicts with existing definitions, statements, or other disclosure material set forth herein will only be incorporated to the extent that no conflict arises between that incorporated material and the existing disclosure material. None is admitted to be prior art.
[0149] In summary, numerous benefits have been described which result from employing the concepts described herein. The foregoing description of the one or more forms has been presented for purposes of illustration and description. It is not intended to be exhaustive or limiting to the precise form disclosed. Modifications or variations are possible in light of the above teachings. The one or more forms were chosen and described in order to illustrate principles and practical application to thereby enable one of ordinary skill in the art to utilize the various forms and with various modifications as are suited to the particular use contemplated. It is intended that the claims submitted herewith define the overall scope.

Claims

CLAIMS What is claimed is:
1. A robotic system for testing a biometric sensor using synthetic fingers, the robotic system comprising: a robotic arm comprising an end effector configured to select a synthetic finger assembly, wherein the synthetic finger assembly comprises a synthetic finger and a near field communication (NFC) circuit; a controller electrically coupled to the robotic arm; and a biometric scanner comprising a sensor configured to scan a fingerprint disposed on the synthetic finger; wherein the controller is configured to: control movement of the robotic arm; cause the end effector to select the synthetic finger assembly; and identify the synthetic finger assembly.
2. The robotic system of claim 1 , wherein the robotic arm comprises a spring configured to apply a uniform pressure to the synthetic finger assembly.
3. The robotic system of claim 1 , comprising a contactless reader configured to read the NFC circuit of the synthetic finger assembly to identify the synthetic finger assembly.
4. The robotic system of claim 3, wherein the NFC circuit comprises a radio frequency identification (RFID) tag; and wherein the controller is configured to: cause the contactless reader to scan the NFC circuit on the synthetic finger assembly to determine an identity of the synthetic finger assembly; and record the identity of the synthetic finger assembly.
5. The robotic system of claim 1 , wherein the robotic arm comprises a contactless reader configured to read the NFC circuit of the synthetic finger assembly to identify the synthetic finger assembly.
6. The robotic system of claim 1 , wherein the end effector is a vacuum end effector coupled to a vacuum source to enable the vacuum end effector to lift, hold, and move the synthetic finger assembly from a tray.
7. The robotic system of claim 1 , wherein the end effector is a gecko inspired gripper.
8. The robotic system of claim 1 , wherein the controller is configured to step through a tray, wherein the tray comprises a plurality of synthetic finger assemblies.
9. A system for testing a biometric sensor using synthetic fingers, the system comprising: a computer system; and a robot coupled to the computer system, the robot comprising: a robotic arm comprising an end effector configured to select a synthetic finger assembly, wherein the synthetic finger assembly comprises a synthetic finger and a near field communication (NFC) circuit; a controller electrically coupled to the robotic arm; and a biometric scanner comprising a sensor configured to scan a fingerprint disposed on the synthetic finger; wherein the controller is configured to: control movement of the robotic arm; cause the end effector to select the synthetic finger assembly; and identify the synthetic finger assembly.
10. The system of claim 9, wherein the computer system is coupled to the biometric scanner and is configured to extract an enrollment testing process from the sensor.
11. The system of claim 10, wherein the controller is configured to cause the robotic arm to control the end effector to place the synthetic finger assembly in a plurality of positions according to the enrollment testing process.
12. The system of claim 11 , wherein the biometric scanner is configured to scan the fingerprint in each of the plurality of positions and record each scan of the fingerprint in each of the plurality of positions; and wherein the computer system is configured to: receive each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process; and record a reference template of the fingerprint, wherein the reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process; and wherein the reference template is correlated with an identity of the synthetic finger assembly recorded by a contactless reader.
13. A method of testing a biometric sensor using synthetic fingers, the method comprising: selecting, by an end effector of a robotic arm, a synthetic finger assembly from a tray, wherein the synthetic finger assembly comprises a synthetic finger and a near field communication (NFC) circuit; scanning, by a contactless reader, the NFC circuit disposed on the synthetic finger assembly to identify the synthetic finger assembly; identifying, by the contactless reader, the synthetic finger assembly; and scanning, by a biometric scanner, a fingerprint disposed on the synthetic finger according to an enrollment testing process.
14. The method of claim 13, wherein scanning the fingerprint according to the enrollment testing process comprises: placing, by the end effector of the robotic arm, the synthetic finger assembly in a plurality of positions according to the enrollment testing process; scanning, by the biometric scanner, the fingerprint in each of the plurality of positions; recording, by a computer system coupled to the biometric scanner, each scan of the fingerprint in each of the plurality of positions; recording a reference template of the fingerprint, wherein the reference template comprises each scan of the fingerprint in each of the plurality of positions according to the enrollment testing process; recording an identity of the synthetic finger assembly read by the contactless reader; and correlating the identity of the synthetic finger assembly and the reference template for each synthetic finger assembly.
15. The method of claim 13, wherein selecting by the end effector of the robotic arm comprises applying a vacuum by the end effector of the robotic arm to lift, hold, and move the synthetic finger assembly.
16. The method of claim 13, wherein selecting by the end effector of the robotic arm comprises lifting, holding, and moving the synthetic finger assembly with a gecko-inspired gripper.
17. The method of claim 13, comprising returning, by the end effector of the robotic arm, the synthetic finger assembly to the tray after the enrollment testing process is complete.
18. The method of claim 13, comprising receiving, by a computer system coupled to the biometric scanner, enrollment testing process data from the biometric scanner.
19. The method of claim 13, comprising: stepping, by the end effector of the robotic arm, through a tray of synthetic finger assemblies to select each synthetic finger assembly disposed within the tray; and recording a reference template with an identity of the synthetic finger assembly of each synthetic finger assembly in the tray.
20. The method of claim 13, comprising: returning, by the end effector of the robotic arm, the synthetic finger assembly to the tray after the enrollment testing process is complete; selecting, by the end effector of the robotic arm, a second synthetic finger assembly from the tray, wherein the second synthetic finger assembly comprises a second synthetic finger and a second NFC circuit; scanning, by the contactless reader, a second NFC circuit disposed on the second synthetic finger assembly; identifying, by the contactless reader, the second synthetic finger assembly; and scanning, by a biometric scanner, a second fingerprint disposed on the second synthetic finger according to the enrollment testing process.
EP23892281.9A 2022-11-18 2023-09-29 Robotic automation testing apparatus and method for testing biometric sensors with synthetic fingerprints Pending EP4619205A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202263384326P 2022-11-18 2022-11-18
PCT/US2023/075474 WO2024107489A1 (en) 2022-11-18 2023-09-29 Robotic automation testing apparatus and method for testing biometric sensors with synthetic fingerprints

Publications (1)

Publication Number Publication Date
EP4619205A1 true EP4619205A1 (en) 2025-09-24

Family

ID=91085270

Family Applications (1)

Application Number Title Priority Date Filing Date
EP23892281.9A Pending EP4619205A1 (en) 2022-11-18 2023-09-29 Robotic automation testing apparatus and method for testing biometric sensors with synthetic fingerprints

Country Status (3)

Country Link
EP (1) EP4619205A1 (en)
CN (1) CN120152826A (en)
WO (1) WO2024107489A1 (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090074256A1 (en) * 2007-03-05 2009-03-19 Solidus Networks, Inc. Apparatus and methods for testing biometric equipment
CN107918327A (en) * 2017-12-08 2018-04-17 上海摩软通讯技术有限公司 The control method and system of fingerprint test based on artificial fingerprint
CN210222160U (en) * 2019-06-27 2020-03-31 宁波神州泰岳锐智信息科技有限公司 Electronic equipment fingerprint identification module test mechanism and test system
KR102252401B1 (en) * 2020-01-15 2021-05-14 김연섭 A test device for fingerprint identification
CN116756007A (en) * 2020-07-13 2023-09-15 支付宝(杭州)信息技术有限公司 A biometric identification attack test method, device and equipment

Also Published As

Publication number Publication date
WO2024107489A1 (en) 2024-05-23
CN120152826A (en) 2025-06-13

Similar Documents

Publication Publication Date Title
CN107607207B (en) A kind of power equipment thermal fault detection method, system and electronic equipment
US11927738B2 (en) Computational microscopy based-system and method for automated imaging and analysis of pathology specimens
JP4501937B2 (en) Face feature point detection device, feature point detection device
CN112149615B (en) Face living body detection method, device, medium and electronic equipment
CN110232719A (en) Medical image classification method, model training method and server
US20210104043A1 (en) Skin Abnormality Monitoring Systems and Methods
US20100165090A1 (en) Frontal Hand Capture of Fingerprints, Palm Prints and Hand Geometry Using Contactless Photography
CN108269333A (en) Face identification method, application server and computer readable storage medium
US11861838B1 (en) Systems and methods for system agnostic automated detection of cardiovascular anomalies and/or other features
CN108388889B (en) Method and device for analyzing face image
CN105844202A (en) Image recognition system and method
KR101955919B1 (en) Method and program for providing tht region-of-interest in image by deep-learing algorithm
JP2024529455A (en) Image display method, device, terminal and storage medium
CN112529128A (en) Biological sample collection method and device, computer equipment and storage medium
CN117011216A (en) A defect detection method, device, electronic equipment and storage medium
CN110032593A (en) Houseclearing querying method, device, equipment and computer readable storage medium
EP4619205A1 (en) Robotic automation testing apparatus and method for testing biometric sensors with synthetic fingerprints
CN109858379A (en) Smile's sincerity degree detection method, device, storage medium and electronic equipment
EP4619211A1 (en) Synthetic fingerprints and method of manufacturing synthetic fingerprints for testing biometric sensors
CN115457662A (en) A multimodal living body detection model training method and a multimodal living body detection method
CN109334010A (en) 3D printer implementation method, device and electronic equipment
US20250132970A1 (en) Anomaly detection based on multi-modal data analysis
KR102558551B1 (en) Method for providing information of in vitro fertilization and device using the same
KR102597459B1 (en) System and method of correcting of image for diagnoisis
CN112397180B (en) Intelligent marking system and method for surgical images

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20250618

A4 Supplementary search report drawn up and despatched

Effective date: 20250715

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)