WO2023210231A1 - 生体認証装置、生体認証方法および生体認証システム - Google Patents

生体認証装置、生体認証方法および生体認証システム Download PDF

Info

Publication number
WO2023210231A1
WO2023210231A1 PCT/JP2023/012049 JP2023012049W WO2023210231A1 WO 2023210231 A1 WO2023210231 A1 WO 2023210231A1 JP 2023012049 W JP2023012049 W JP 2023012049W WO 2023210231 A1 WO2023210231 A1 WO 2023210231A1
Authority
WO
WIPO (PCT)
Prior art keywords
authentication device
exposure
biometric
biometric information
illumination
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2023/012049
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
啓二 平田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Management Co Ltd
Original Assignee
Panasonic Intellectual Property Management Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Intellectual Property Management Co Ltd filed Critical Panasonic Intellectual Property Management Co Ltd
Priority to US18/860,554 priority Critical patent/US20250371836A1/en
Priority to JP2024517908A priority patent/JPWO2023210231A1/ja
Priority to EP23795978.8A priority patent/EP4517701A4/en
Publication of WO2023210231A1 publication Critical patent/WO2023210231A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/147—Details of sensors, e.g. sensor lenses
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/141—Control of illumination
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/13—Sensors therefor
    • G06V40/1318—Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/1347—Preprocessing; Feature extraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/1365—Matching; Classification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/50—Maintenance of biometric data or enrolment thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means

Definitions

  • the present disclosure relates to a biometric authentication device, a biometric authentication method, and a biometric authentication system.
  • Patent Document 1 discloses that a plurality of sets of palm images are acquired using light irradiated from a light under a plurality of different illumination conditions, and a difference between each image set when acquiring the plurality of image sets according to the photographing conditions is disclosed.
  • a biometric authentication device is disclosed that adjusts time intervals, extracts biometric features from each of a plurality of image sets, and compares each extracted biometric feature with registered biometric features that are registered in advance.
  • biometric authentication is performed using a set of images taken at adjusted time intervals and under a plurality of different illumination conditions. Therefore, the biometric authentication device may not be able to obtain a set of images taken under all illumination conditions, depending on the adjusted time interval, the speed at which the user moves the palm, and the like. Furthermore, conventionally, in synchronizing control of lighting and a camera during high-speed photography, it has been difficult to control the lighting to turn on and off in accordance with the timing of camera photography.
  • the present disclosure was devised in view of the above-mentioned conventional circumstances, and aims to provide a biometric authentication device, a biometric authentication method, and a biometric authentication system that capture images more suitable for biometric authentication.
  • the present disclosure includes an imaging unit that captures an image of at least a part of the hand of a person to be authenticated, an illumination unit that illuminates the hand of the person to be authenticated; a control unit that controls at least one of the plurality of authenticated persons; an authentication unit that authenticates the person to be authenticated based on the biometric information of each person, and the plurality of captured images are captured by the imaging unit for each of the exposure parameters. do.
  • the present disclosure also provides a biometric authentication method performed by a biometric authentication device that performs biometric authentication of a person to be authenticated, which controls at least one of a camera and lighting based on a plurality of different exposure parameters, and capturing an image of at least a portion of the person's hand for each of the exposure parameters, extracting biometric information of the person to be authenticated from each of the plurality of captured images, and registering the biometric information of the person to be authenticated in advance.
  • the present invention provides a biometric authentication method for authenticating a person to be authenticated based on biometric information of each of a plurality of people to be authenticated.
  • the present disclosure also provides a biometric authentication system including a biometric information acquisition device that acquires biometric information of a person to be authenticated, and an authentication device that can communicate with the biometric information acquisition device, wherein the biometric information acquisition device is , controlling at least one of a camera and lighting based on a plurality of different exposure parameters, capturing an image of at least a portion of the hand of the person to be authenticated for each of the exposure parameters, and from each of the plurality of captured images.
  • the biometric information of the person to be authenticated is acquired and transmitted to the authentication device, and the authentication device uses the biometric information of the person to be authenticated transmitted from the biometric information acquisition device and a plurality of pre-registered biometric information.
  • the present invention provides a biometric authentication system that authenticates a person to be authenticated based on the biometric information of each person to be authenticated.
  • a captured image more suitable for biometric authentication can be captured.
  • a perspective view of the inside of the housing of the authentication device in Embodiment 1 and the biometric information acquisition device in a modification of Embodiment 1 Block diagram showing an example of internal configuration of an authentication device according to Embodiment 1 Diagram explaining an example of exposure control in an authentication device A diagram illustrating an example of the first exposure control pattern in the authentication device A diagram illustrating an example of a second exposure control pattern in the authentication device Flowchart explaining the first operation procedure of the biometric authentication system according to the first embodiment Diagram explaining usage example of biometric authentication system Table showing an example of shutter speed conditions for the authentication device Timing chart showing an example of exposure control of illumination and image sensor in the second operation procedure Flowchart explaining the second operation procedure of the biometric authentication system according to Embodiment 1 Table showing an example of second exposure conditions (lighting conditions) in the authentication device Timing chart showing an example of exposure control of illumination and image sensor in the second operation procedure Timing chart
  • FIG. 18 is a diagram illustrating an example of exposure control in the conventional authentication device B1.
  • Authentication device B1 shown in FIG. 18 has the same configuration as authentication device B1 described later.
  • the authentication device B1 illuminates the user's hand UH, which is the object of biometric authentication, with the illumination unit 30 (see FIG. 3), and images the user's hand UH with the imaging unit 40 (see FIG. 3).
  • the authentication device B1 performs biometric authentication (user authentication) using the captured image.
  • the authentication device B1 images the moving user's hand UH by controlling each of the illumination unit 30 and the imaging unit 40 under predetermined exposure conditions.
  • Each of the captured images IMG01, IMG02, and IMG03 is a captured image of the hand UH captured by the authentication device B1.
  • the captured image IMG01 is a captured image when the distance (hereinafter referred to as "imaging distance") between the user's hand UH and the glass surface 16 (see FIG. 3) of the authentication device B1 is short.
  • the user's hand UH reflected in the captured image IMG01 is blown out due to the close imaging distance, and the image quality is degraded.
  • the brightness graph LG01 shows the brightness value (hereinafter referred to as "biometric brightness value”) of a region from which biometric information used for biometric authentication is extracted from the region of the user's hand UH reflected in the captured image IMG01.
  • the biometric luminance value indicated by the luminance graph LG01 is larger than the biometric luminance value Lm11 suitable for acquiring (extracting) biometric information used for biometric authentication. Therefore, the captured image IMG01 is a captured image that is not suitable for acquiring biological information.
  • the captured image IMG02 is a captured image when the imaging distance is appropriate.
  • the brightness graph LG02 shows the biological brightness value of the captured image IMG02.
  • the biometric luminance value indicated by the luminance graph LG02 is approximately equal to the biometric luminance value Lm11 suitable for acquiring (extracting) biometric information used for biometric authentication. Therefore, the captured image IMG02 is a captured image suitable for acquiring biological information.
  • the captured image IMG03 is a captured image when the imaging distance is long.
  • the brightness graph LG03 shows the biological brightness value of the captured image IMG03.
  • the user's hand UH reflected in the captured image IMG03 is dark and the image quality is degraded because the imaging distance is long.
  • the biometric luminance value indicated by the luminance graph LG03 is smaller than the biometric luminance value Lm11 suitable for acquiring (extracting) biometric information used for biometric authentication. Therefore, the captured image IMG03 is a captured image that is not suitable for acquiring biological information.
  • the authentication device B1 that performs conventional exposure control can acquire biometric information suitable for biometric authentication or perform more accurate biometric authentication depending on the height at which the user holds up their hand UH (that is, the imaging distance). could be difficult to realize.
  • the user has to retake the image many times in order to capture an image that can obtain biometric information suitable for biometric authentication, which is very time consuming.
  • FIG. 1 is a diagram illustrating an example use case of biometric authentication systems 100 and 200 according to the first embodiment and a modification of the first embodiment. Note that the biometric authentication system 100 according to the first embodiment will be described here, and the biometric authentication system 200 according to a modification of the first embodiment will be described later.
  • biometric authentication mainly using fingerprints as biometric information
  • biometric information is not limited to this.
  • the biometric information may be a user's fingerprint, palm print, finger or palm vein, or the like.
  • the biometric authentication system 100 includes an authentication device B1 and a monitor MN.
  • the biometric authentication system 100 captures an image obtained by capturing at least a portion of the hand UH of the user who is the person to be authenticated (specifically, an area from which biometric information used for biometric authentication can be extracted) by the authentication device B1. , to obtain the user's biometric information that appears in the captured image.
  • the biometric authentication system 100 also uses the authentication device B1 to perform biometric authentication by comparing the user's biometric information with each of a plurality of pre-registered biometric information, and outputs the biometric authentication results to the monitor MN. Display.
  • the monitor MN is configured using, for example, a Liquid Crystal Display (LCD) or an organic Electroluminescence (EL).
  • the monitor MN displays the verification result output from the authentication device B1 or outputs the verification result through a speaker (not shown). Note that the monitor MN may be configured integrally with the authentication device B1.
  • biometric authentication system 100 will be described with reference to an example in which the authentication device B1 and the monitor MN are configured separately, they may be configured integrally.
  • FIG. 2 is a perspective view of the inside of the casing 18 of the authentication device B1 in the first embodiment and the biometric information acquisition device B1A in a modification of the first embodiment.
  • FIG. 3 is a block diagram showing an example of the internal configuration of authentication device B1 according to the first embodiment.
  • the authentication device B1 which is an example of a biometric authentication device, is made of metal or resin.
  • Authentication device B1 includes a control section 10, a glass surface 16, a housing 18, an exposure control section 20, an illumination section 30, an imaging section 40, a sensor section 50, and a display control section 60. configured.
  • the control unit 10 includes a processor 11, a memory 12, and a biological information database DB.
  • the processor 11 which is an example of the authentication unit, is configured using, for example, a Central Processing Unit (hereinafter referred to as "CPU") or a System-on-Chip (SOC), and cooperates with the memory 12 to perform various types of processing. and control. Specifically, the processor 11 refers to the program and data held in the memory 12 and executes the program to control each section such as the control section 10, the exposure control section 20, the sensor section 50, the display control section 60, etc. Realize the functions of
  • CPU Central Processing Unit
  • SOC System-on-Chip
  • the processor 11 causes the exposure control section 20 to start controlling each of the illumination section 30 and the imaging section 40 based on the first detection signal output from the sensor section 50 and notifying the detection of the user's hand UH.
  • the processor 11 causes the exposure control unit 20 to end the control of the illumination unit 30 and the imaging unit 40 based on the second detection signal output from the sensor unit 50 and notifying the detection of the user's hand UH.
  • the processor 11 performs image processing on the captured image captured by the imaging unit 40 to extract feature amounts of the user's biometric information.
  • the processor 11 performs user authentication (i.e., biometric authentication).
  • the processor 11 outputs the biometric authentication result to the display control unit 60 to display it on the monitor MN.
  • the memory 12 includes, for example, Random Access Memory (hereinafter referred to as "RAM”) as a work memory used when executing each process of the processor 11 and the exposure control circuit 21, and a memory of each of the processor 11 and the exposure control circuit 21. It has a Read Only Memory (hereinafter referred to as "ROM”) that stores programs and data that define operations. Data or information generated or acquired by the processor 11 or the exposure control circuit 21 is temporarily stored in the RAM. Programs that define the operations of the processor 11 and the exposure control circuit 21 are written in the ROM.
  • RAM Random Access Memory
  • ROM Read Only Memory
  • the memory 12 stores information regarding the exposure control of each of the illumination unit 30 and the imaging unit 40 executed by the exposure control unit 20.
  • the information regarding exposure control includes, for example, an exposure control pattern, exposure conditions, and an output pattern of a trigger signal.
  • the exposure conditions here are control parameters for executing exposure control of the illumination section 30 or the imaging section 40, such as shutter speed conditions and illumination conditions, for example.
  • the biometric information database DB is a storage medium device such as a Hard Disk Drive (hereinafter referred to as "HDD") or a Solid State Drive (hereinafter referred to as "SSD”), and stores multiple users registered in advance by an administrator. stores each piece of biological information.
  • the biometric information stored in the biometric information database DB is biometric information that can be biometrically authenticated, such as fingerprints or veins of each of the user's fingers, and the user's palm print, and includes user information (for example, name, date of birth, The information is stored in association with an identification number, employee number, facial photograph, etc. that can identify the user.
  • the biometric information database DB shown in FIG. 3 shows an example configured integrally with the authentication device B1, it is separate from the authentication device B1 and is connected to an external device so as to be able to send and receive data through wireless or wired communication. It may also be configured as a storage device.
  • the wireless communication referred to here is communication via a wireless local area network (LAN) such as Wi-Fi (registered trademark).
  • LAN wireless local area network
  • the glass surface 16 is arranged on the top surface of the housing 18 adjacent to at least one sensor (the first proximity sensor 51 or the second proximity sensor 52).
  • the glass surface 16 is provided so that the user's hand UH passing over the upper surface 18A of the housing 18 can be illuminated by the illumination unit 30 and imaged by the imaging unit 40.
  • the cover guide 17 is made of metal or resin and is formed into a substantially L-shape.
  • the cover guide 17 is fixed to one side of the upper surface 18A of the casing, which has a substantially L-shape with one end formed in a rectangular shape.
  • the substantially L-shaped other end of the cover guide 17 is provided to cover the upper surface 18A of the housing, and blocks the illumination light of the illumination unit 30 that passes through the glass surface 16 of the upper surface 18A of the housing at the other end side. .
  • the distance between the lower surface of the cover guide 17 and the upper surface 18A of the housing (that is, the height ) is formed so that it becomes larger (higher).
  • the authentication device B1 can increase the distance (that is, the height) between the cover guide 17 and the top surface 18A of the housing in the direction in which the user is located. Therefore, since the distance (height) between the cover guide 17 and the top surface 18A of the housing is the highest toward the side where the user is located, the user can easily You can put your hand in and let it pass.
  • the cover guide 17 also has two sides adjacent to the side to which one end of the cover guide 17 is fixed (that is, a side corresponding to the direction in which the user's finger enters and a side corresponding to the direction in which the user's finger leaves) and the cover guide 17 and the other end side. Thereby, the user can intuitively grasp the direction in which the user's finger should pass (that is, the passing direction X or the direction opposite to the passing direction X).
  • the authentication device B1 limits the height of the user's hand UH, that is, the imaging distance between the imaging unit 40 and the user's hand UH, to the distance between the cover guide 17 and the glass surface 16 using the cover guide 17. You can also. Note that in the authentication device B1 according to the first embodiment, the cover guide 17 is not an essential configuration and may be omitted.
  • the exposure control unit 20 which is an example of a control unit, is configured using, for example, a CPU or an FPGA, and performs various processes and controls in cooperation with the memory 12. Specifically, the exposure control section 20 implements the functions of the exposure control circuit 21 by referring to the program and data held in the memory 12 and executing the program.
  • the exposure control unit 20 When the exposure control unit 20 acquires the control command output from the processor 11 and corresponding to the first detection signal, the exposure control unit 20 controls the illumination unit 30 and the imaging unit 40 based on the information regarding exposure control stored in the memory 12. Execute each control (exposure control). Note that the exposure control referred to here is control for adjusting the amount of light taken in when the imaging unit 40 captures an image of the user's hand UH.
  • the exposure control unit 20 executes exposure control such as ON/OFF control of the illumination 32 and start (ON)/end (OFF) control of the shutter of the image sensor 42 .
  • the exposure control circuit 21 generates an illumination light emission signal for controlling the illumination 32 or a shutter control signal for controlling the image sensor 42 based on information regarding exposure control.
  • the exposure control circuit 21 outputs the generated illumination light emission signal to the illumination driver circuit 31. Further, the exposure control circuit 21 outputs the generated shutter control signal to the image sensor 42.
  • the exposure control circuit 21 controls the illumination unit 30 and the imaging unit 40 from the timing when the control command corresponding to the first detection signal is acquired to the timing when the control command corresponding to the second detection signal is acquired. Each exposure control is executed repeatedly, and the number of times the exposure control corresponding to each exposure condition is executed is counted. When the exposure control circuit 21 obtains the control command output from the processor 11 and corresponding to the first detection signal, it ends the exposure control of each of the illumination section 30 and the imaging section 40.
  • the illumination unit 30 is stored inside the casing 18 of the authentication device B1, and illuminates the user's hand UH, which is the object to be imaged by the imaging unit 40.
  • the lighting section 30 includes a lighting driver circuit 31 and a lighting 32.
  • the lighting driver circuit 31 executes ON/OFF control of the lighting 32 based on the control command output from the exposure control circuit 21.
  • the lighting 32 is configured with one or more lighting such as a Light Emitting Diode (LED), a Laser Diode (LD), and an InfraRed (IR) lighting.
  • LED Light Emitting Diode
  • LD Laser Diode
  • IR InfraRed
  • FIG. 2 shows the illumination part 30 formed in the annular shape as an example, it is not limited to this.
  • the illumination unit 30 may be a point light source, or may have a configuration in which each of a plurality of illumination lights is arranged in a polygonal shape or a substantially annular shape.
  • the imaging unit 40 which is an example of a camera, is stored inside the casing 18 of the authentication device B1, and images the user's hand UH passing over the glass surface 16.
  • the imaging section 40 includes a lens 41, an imaging sensor 42, and an imaging signal processing section 43.
  • the lens 41 forms an image of the light incident on the lens barrel (not shown) on the image sensor 42 .
  • the image sensor 42 is a so-called image sensor, and is, for example, a charged-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) solid-state image sensor.
  • the image sensor 42 executes start/end control of an electronic shutter (not shown) (that is, exposure start/end control) based on a shutter control signal output from the exposure control circuit 21 . Further, the image sensor 42 converts the optical image formed on the imaging surface by the lens 41 into an electrical signal at a frame rate set in advance by the administrator, and outputs the electric signal to the image signal processing section 43.
  • the imaging signal processing unit 43 processes the electrical signal output from the imaging sensor 42 and outputs it to the processor 11.
  • the sensor section 50 includes each of a first proximity sensor 51 and a second proximity sensor 52, and a sensor control circuit 53.
  • each of the first proximity sensor 51 (an example of a first sensor) and the second proximity sensor 52 (an example of a second sensor) is a reflective Time Of Flight (TOF) sensor, an infrared sensor, or a transmissive type. This is realized using laser sensors, light receiving sensors, etc.
  • Each of the first proximity sensor 51 and the second proximity sensor 52 is arranged on the passing direction X in which the user's finger passes across the glass surface 16, and each of the first proximity sensor 51 and the second proximity sensor 52 has A user's hand UH passing through a predetermined detection area is detected.
  • Each of the first proximity sensor 51 and the second proximity sensor 52 generates a detection signal and outputs it to the processor 11 when detecting the user's hand UH.
  • FIG. 4 is a diagram illustrating an example of exposure control in the authentication device B1. It goes without saying that the exposure control example shown in FIG. 4 is just an example and is not limited thereto.
  • the exposure control unit 20 controls the user's hand UH reflected in the captured image even if there is variation in the imaging distance between the user's hand UH and the imaging unit 40 (that is, the height of the user's hand UH). Exposure control is performed so that the bioluminance value of the area from which the feature amount of biometric information is extracted is approximately equal to the bioluminance value Lm10 suitable for extracting biometric information.
  • the exposure control unit 20 executes exposure control corresponding to each of a plurality of exposure conditions that are stored in the memory 12 and set in advance in a time-sharing manner, thereby achieving an exposure control suitable for extracting the user's biological information. Realizes the capturing of captured images.
  • the exposure control unit 20 switches the exposure control corresponding to each of the three exposure conditions in a time-sharing manner. For example, the exposure control unit 20 executes exposure control corresponding to the first exposure condition in time period T11, executes exposure control corresponding to the second exposure condition in time period T12, and performs exposure control corresponding to the second exposure condition in time period T13. Exposure control corresponding to the third exposure condition is executed, and exposure control corresponding to the first exposure condition is executed in time period T14.
  • the first exposure condition shown in FIG. 4 is the exposure condition with the highest exposure (light amount).
  • the second exposure condition is an exposure condition that provides less exposure than the first exposure condition and more exposure than the third exposure condition.
  • the third exposure condition is the exposure condition with the least exposure.
  • the brightness graph LG11 shows the area of the user's hand UH that appears in each of the four captured images captured in each time period T11 to T14 when the imaging distance between the imaging unit 40 and the user's hand UH is short. It shows the bioluminance value of the area from which biometric information used for biometric authentication is extracted. In the luminance graph LG11, the bioluminance value of the captured image IMG11 captured under the third exposure condition in the time period T13 is approximately equal to the bioluminance value Lm10.
  • the brightness graph LG12 shows the living body brightness value of each of the four captured images taken in each time period T11 to T14 when the imaging distance is appropriate.
  • the biological brightness value of the captured image IMG12 captured under the second exposure condition in the time period T12 is approximately equal to the biological brightness value Lm10.
  • the brightness graph LG13 shows the living body brightness value of each of the four captured images taken in each time period T11 to T14 when the imaging distance is appropriate.
  • the bioluminance value of the captured image IMG13 captured under the first exposure condition in the time periods T11 and T14 is approximately equal to the bioluminance value Lm10.
  • the authentication device B1 can eliminate variations in the height of the user's hand (that is, the imaging distance) by switching each of the plurality of exposure conditions in a time-sharing manner and capturing an image of the user's hand UH under each exposure condition. Even in such a case, a captured image suitable for extracting biological information can be captured.
  • the number of exposure conditions can be arbitrarily set based on the dynamic range of the imaging unit 40, the size of the imaging area that can be captured by the imaging unit 40, the speed of the user's hand passing over the glass surface 16, etc. It's fine. For example, when the dynamic range of the imaging unit 40 is small, the authentication device B1 can easily obtain a captured image closer to the bioluminance value Lm10 suitable for extracting biometric information by increasing the number of exposure conditions.
  • the authentication device B1 may set the length of the time period in which the exposure control corresponding to each exposure condition is executed based on the number of exposure conditions, the speed of the user's hand passing over the glass surface 16, etc. .
  • the length of each of the time periods T11 to T14 is 70 to 80 frames per second (fps), but is not limited to this.
  • the authentication device B1 shortens the length of each time period T11 to T14.
  • FIG. 5 is a diagram illustrating an example of the first exposure control pattern in the authentication device B1.
  • FIG. 6 is a diagram illustrating an example of a second exposure control pattern in the authentication device.
  • the first exposure control pattern shown in FIG. 5 is a control pattern in which exposure control corresponding to each exposure condition is time-divisionally switched in the order of "exposure condition 1" ⁇ "exposure condition 2" ⁇ "exposure condition 3". be.
  • the first exposure control pattern is a control pattern in which one period includes three exposure controls corresponding to "exposure condition 1" ⁇ "exposure condition 2" ⁇ "exposure condition 3".
  • the exposure control unit 20 performs exposure control based on the first exposure control pattern from the timing when the control command outputted from the processor 11 to start the exposure control is acquired to the timing when the control command to end the exposure control is acquired. Execute repeatedly.
  • the exposure control unit 20 performs exposure control corresponding to "exposure condition 1" in time period T21, exposure control corresponding to "exposure condition 2" in time period T22, and exposure control corresponding to "exposure condition 3" in time period T23.
  • exposure control corresponding to "exposure condition 1" in time period T24, exposure control corresponding to "exposure condition 2" in time period T25, exposure control corresponding to "exposure condition 3" in time period T26, Exposure control corresponding to "exposure condition 1" in time period T27, exposure control corresponding to "exposure condition 2" in time period T28, and exposure control corresponding to "exposure condition 3" in time period T29 are executed in a time-sharing manner. do.
  • the authentication device B1 obtains a captured image ( Frame No. "1", “4", "7") can be acquired.
  • Authentication device B1 captures a captured image (frame No. "2", "5", "8") can be obtained.
  • Authentication device B1 captures the captured image (frame No. "3", “6”, “9") can be obtained.
  • the authentication device B1 acquires three captured images having three different bioluminance values (bioluminance values Lm20 to Lm22) during each of the time periods T21 to T23, T24 to T26, and T27 to T29. can. That is, the authentication device B1 can more efficiently capture captured images suitable for extracting biometric information by periodically and repeatedly performing three exposure controls corresponding to the three exposure conditions.
  • the second exposure control pattern shown in FIG. 6 performs exposure control corresponding to each exposure condition in the order of "exposure condition 1" ⁇ "exposure condition 2" ⁇ "exposure condition 3" ⁇ "exposure condition 2". This is a control pattern that is switched by dividing.
  • the second exposure control pattern is a control pattern in which one cycle includes four exposure controls corresponding to "exposure condition 1" ⁇ "exposure condition 2" ⁇ "exposure condition 3" ⁇ "exposure condition 2".
  • the exposure control unit 20 performs exposure control based on the second exposure control pattern from the timing when it acquires a control command output from the processor 11 to start exposure control to the timing when it acquires a control command to end exposure control. Execute repeatedly.
  • the exposure control unit 20 performs exposure control corresponding to "exposure condition 1" in time period T31, exposure control corresponding to "exposure condition 2" in time period T32, and exposure control corresponding to "exposure condition 3" in time period T33.
  • exposure control corresponding to "exposure condition 2" in time period T34, exposure control corresponding to "exposure condition 1" in time period T35, exposure control corresponding to "exposure condition 2" in time period T36, Exposure control corresponding to "exposure condition 3" in time period T37, exposure control corresponding to "exposure condition 2" in time period T38, and exposure control corresponding to "exposure condition 1" in time period T39 are executed in a time-sharing manner. do.
  • the authentication device B1 obtains a captured image ( Frame No. "1", "5", "9") can be acquired.
  • the authentication device B1 captures a captured image (frame) in which the bioluminance value of the user's hand UH is the bioluminance value Lm30 in each of the time periods T32, T34, T36, and T38 in which the exposure control corresponding to "exposure condition 2" is executed. No. "2", “4", "6”, "8") can be obtained.
  • Authentication device B1 captures a captured image (frame No. "3", "7") can be obtained.
  • the authentication device B1 can acquire four captured images having three different bioluminance values (bioluminance values Lm30 to Lm32) during each of the time periods T31 to T34 and T35 to T38. That is, the authentication device B1 can more efficiently capture captured images suitable for extracting biometric information by periodically and repeatedly performing four exposure controls corresponding to each of the three exposure conditions.
  • the exposure control unit 20 when performing exposure control using the second exposure control pattern, performs exposure control to obtain the biological brightness value Lm32, which has the minimum biological brightness value, to the biological brightness value, which has the maximum biological brightness value. Since switching to exposure control to obtain Lm31 is not performed, the amount of change in control parameters (for example, shutter speed, light emission time of illumination 32, etc.) at the time of switching exposure control can be reduced. Therefore, the authentication device B1 can more effectively suppress the follow-up delay of each part of the illumination unit 30 and the imaging unit 40 when switching the exposure control.
  • control parameters for example, shutter speed, light emission time of illumination 32, etc.
  • FIG. 7 is a flowchart illustrating the first operation procedure of the biometric authentication system 100 according to the first embodiment.
  • FIG. 8 is a diagram illustrating an example of how the biometric authentication system 100 is used.
  • FIG. 9 is a table TB1 showing an example of shutter speed conditions in the authentication device B1.
  • the authentication device B1 executes only one period of an exposure control pattern in which exposure control corresponding to each shutter speed condition (exposure condition) is sequentially executed once.
  • the first operation procedure is an operation procedure of the biometric authentication system 100 when performing exposure control under exposure conditions in which the illumination time of the illumination 32 is constant and the shutter speed of the imaging unit 40 is different.
  • exposure condition will be replaced with the term “shutter speed condition.”
  • the authentication device B1 detects the approach or insertion of the user's hand UH between the cover guide 17 and the glass surface 16 using one of the sensors (the first proximity sensor 51 or the second proximity sensor 52) (St1 -1).
  • the authentication device B1 starts strobe light emission of the lighting 32 based on the information regarding exposure control stored in the memory 12 (St2-3A).
  • the authentication device B1 images the user's hand UH at a shutter speed based on the n-th shutter speed condition among the plurality of shutter speed conditions stored in the memory 12 (St3-1A).
  • the authentication device B1 captures an image at a shutter speed of 20 ⁇ s, which is the 0th shutter speed condition
  • An image is taken with a shutter speed of 35 ⁇ s, which is the second shutter speed condition
  • the authentication device B1 captures an image at a shutter speed of 150 ⁇ s, which is the k-th shutter speed condition.
  • the shutter speed values for each shutter speed condition shown in FIG. 9 are merely examples, and the present invention is not limited thereto.
  • the authentication device B1 stops the strobe light emission of the illumination 32 (St3-2A), and increments the exposure control count number n (n+1) (St3-3).
  • the authentication device B1 determines whether the incremented exposure control count number n is equal to the shutter speed condition number k (St3-4A).
  • step St3-4A determines in the process of step St3-4A that the exposure control count number n after incrementing is not equal to the number k of shutter speed conditions (n ⁇ k) (St3-4A, NO) , it is determined whether the other sensor detects the user's hand UH (St4-1).
  • step St4-1 determines in the process of step St4-1 that the user's hand UH is detected by the other sensor (St4-1, YES), it ends the exposure control (St5-1).
  • step St4-1 determines in the process of step St4-1 that the user's hand UH is not detected by the other sensor (St4-1, NO)
  • the authentication device B1 moves to the process of step St2-3A. .
  • the authentication device B1 selects a biometric brightness value that is optimal for acquiring biometric information among at least one captured image from which biometric authentication is to be extracted from each of a plurality of captured images captured under each shutter speed condition. Select a captured image.
  • the finger on which the captured image selection process is executed may be at least one predetermined finger (eg, index finger, middle finger, ring finger, little finger, etc.).
  • the part from which biometric information is to be extracted is the palm, the palm is detected and the bioluminance value of the palm is calculated, and the calculated bioluminance value is the optimal bioluminance value for acquiring biometric information. Select an image.
  • the authentication device B1 extracts (obtains) the feature amount of the user's biometric information (eg, fingerprint, vein, palm print, etc.) from the selected captured image (St5-2).
  • the feature amount of the biometric information is extracted using a known technique (eg, minutiae method, frequency feature analysis method, etc.).
  • the minutiae method is a method for extracting the feature amount of a fingerprint or palmprint by detecting the end points or branching points (separations) of the ridges of the fingerprint or palmprint line.
  • the frequency feature analysis method is a method of extracting the feature amount of a fingerprint or palm print from a frequency waveform converted into a frequency based on the uneven edges, bending points, etc. of the fingerprint.
  • the vein feature amount for example, a vein pattern of the user's finger is extracted from a captured image of the user's finger that is captured using near-infrared light.
  • the authentication device B1 compares the extracted feature amount of the biometric information of the user with the feature amount of the biometric information of each of the plurality of users registered in advance in the biometric information database DB. The authentication device B1 determines whether the extracted user's feature amount matches or is similar to the feature amount of each of the plurality of biometric information, and obtains the biometric authentication result (matching result) (St6 -1).
  • the authentication device B1 determines whether user information to be biometrically authenticated (for example, name, date of birth, identification number that can identify the user, employee number, face photo, etc.) is registered in the biometric information database DB. (St6-2).
  • user information to be biometrically authenticated for example, name, date of birth, identification number that can identify the user, employee number, face photo, etc.
  • the authentication device B1 determines that the extracted user's feature amount is a feature amount that matches or is similar to each feature amount of a plurality of pieces of biometric information, and that the extracted user's feature amount is a feature amount that matches or is similar to each feature amount of the plurality of biometric information, and that it is a biometric authentication target in the biometric information database DB. If it is determined that the user information of a certain user is registered (St6-2, YES), an authentication result screen is generated to notify that the biometric authentication result (verification result) is "OK" and displayed on the monitor MN. Send. The monitor MN displays the authentication result screen (authentication result "OK”) transmitted from the authentication device B1 (St7-1).
  • the authentication device B1 determines that the extracted user's feature amount is a feature amount that does not match or is not similar to each feature amount of the plurality of biometric information, and the authentication device B1 stores the biometric authentication information in the biometric information database DB. If it is determined that the user information of the target user is not registered (St6-2, NO), an authentication result screen is generated to notify that the biometric authentication result (verification result) is "NG", and the monitor Send to MN. The monitor MN displays the authentication result screen (authentication result "NG") transmitted from the authentication device B1 (St7-2).
  • the biometric authentication system 100 executes exposure control based on a plurality of preset shutter speed conditions (exposure conditions) and images the user's hand UH.
  • the authentication device B1 can acquire captured images with different exposures (light amounts) by changing the shutter speed. Therefore, the authentication device B1 can more efficiently acquire a captured image captured at a brightness (bioluminance value) suitable for extracting biometric information.
  • FIG. 10 is a timing chart showing an example of exposure control of the illumination 32 and the image sensor 42 in the first operation procedure. Note that the exposure control example shown in FIG. 10 is just an example, and it goes without saying that the exposure control example is not limited thereto.
  • the exposure control unit 20 switches exposure control corresponding to each of three shutter speed conditions (exposure conditions) in a time-sharing manner.
  • the exposure control unit 20 performs exposure control corresponding to the first shutter speed condition in the time period T41 to T42, exposure control corresponding to the second shutter speed condition in the time period T43 to T44, and exposure control corresponding to the second shutter speed condition in the time period T45 to T46.
  • Exposure control corresponding to the third shutter speed condition is executed.
  • the exposure control unit 20 turns on the illumination 32 to emit light for a certain time period (time period T41), and then turns on the illumination 32 for a certain time period (time period T42). Control of the illumination unit 30 to turn off and turn off the light is repeatedly executed.
  • the control of the imaging unit 40 is executed.
  • the control section 40 is executed.
  • the control section 40 is executed.
  • the size relationship of the time slots is T41>T43>T45.
  • the image taken under the first shutter speed condition (frame No. "1") has the highest exposure (light amount)
  • the second The exposure (light amount) of the captured image (frame No. "2") captured under the shutter speed condition is lower than the first shutter speed condition and higher than the third shutter speed condition
  • the third shutter speed condition is The exposure (light amount) of the captured image (frame No. "3") captured under the eye shutter speed condition is the lowest.
  • the authentication device B1 can acquire captured images with different exposures (light amounts) by capturing images while changing the shutter open state (exposure state) time (shutter speed) with respect to the light emission time of the illumination 32. Therefore, the authentication device B1 can more efficiently acquire a captured image captured at a brightness (bioluminance value) suitable for extracting biometric information.
  • FIG. 11 is a flowchart illustrating the second operation procedure of the biometric authentication system 100 according to the first embodiment.
  • FIG. 12 is a table TB2 showing an example of the second exposure conditions (illumination conditions) in the authentication device B1.
  • the second operation procedure of the biometric authentication system 100 shown in FIG. 11 is given the same reference numeral to the same process as the first operation procedure of the biometric authentication system 100 shown in FIG. 7, and the description thereof will be omitted.
  • the authentication device B1 executes an exposure control pattern that sequentially executes exposure control corresponding to each illumination condition (exposure condition) once for only one cycle.
  • the second operation procedure is an operation procedure of the biometric authentication system 100 when performing exposure control under exposure conditions in which the shutter speed of the imaging unit 40 is constant and the illumination light emission time of the illumination 32 is different.
  • exposure condition will be replaced with the term "illumination condition.”
  • the authentication device B1 starts shutter start/end control of the image sensor 42 based on the information regarding exposure control stored in the memory 12 (St2-3B).
  • the authentication device B1 causes the illumination 32 to emit light during the illumination emission time based on the n-th illumination condition among the plurality of illumination conditions stored in the memory 12, and images the user's hand UH (St3-1B). .
  • the authentication device B1 turns on the illumination 32 for an illumination time of 20 ⁇ s, which is the 0th illumination condition, and captures an image
  • the authentication device B1 takes an image when the illumination time is 25 ⁇ s, which is the first illumination condition.
  • the illumination 32 is turned on for a light emission time of 50 ⁇ s to capture an image.
  • the authentication device B1 turns on the illumination 32 for an illumination light emission time of 150 ⁇ s, which is the m-th illumination condition, and captures an image.
  • the authentication device B1 stops the shutter start/end control of the imaging sensor 42 (St3-2B), and increments the exposure control count number n (n+1) (St3-3).
  • the authentication device B1 determines whether the incremented exposure control count number n is equal to the illumination speed condition number m (St3-4B).
  • step St3-4B determines in the process of step St3-4B that the exposure control count number n after incrementing is not equal to the number m of illumination conditions (n ⁇ m) (St3-4B, NO), It is determined whether the other sensor detects the user's hand UH (St4-1).
  • the biometric authentication system 100 executes exposure control based on a plurality of preset illumination conditions (exposure conditions) and images the user's hand UH.
  • the authentication device B1 can acquire captured images with different exposures (light amounts) by changing the illumination time of the illumination 32. Therefore, the authentication device B1 can more efficiently acquire a captured image captured at a brightness (bioluminance value) suitable for extracting biometric information.
  • FIG. 13 is a timing chart showing an example of exposure control of the illumination 32 and the image sensor 42 in the second operation procedure. It goes without saying that the exposure control example shown in FIG. 13 is just an example and is not limited thereto.
  • the exposure control unit 20 switches exposure control corresponding to each of three illumination conditions (exposure conditions) in a time-sharing manner.
  • the exposure control unit 20 performs exposure control corresponding to the first illumination condition in the time period T51 to T52, exposure control corresponding to the second illumination condition in the time period T53 to T54, and three exposure controls in the time period T55 to T56.
  • Each performs exposure control corresponding to the lighting conditions of the eyes.
  • the exposure control unit 20 controls the shutter to be open (ON (exposure) state) for a certain time period (time periods T51, T53, T55), and then controls the shutter to be in an open state (ON (exposure) state) for a certain time period (time periods T51, T53, T55).
  • Control of the imaging unit 40 is repeatedly executed to control the shutter to a closed state (OFF state) during time periods T52, T54, and T56).
  • the shutter speed is constant and equal to the time periods T51, T53, and T55.
  • the exposure control unit 20 controls the lighting during the time period T52.
  • the lighting section 30 is controlled to turn off the lighting section 32.
  • the lighting unit 30 is controlled to be turned off.
  • the lighting unit 30 is controlled to be turned off.
  • the magnitude relationship of the time slots is T51>T53>T55.
  • the image taken under the first illumination condition (frame No. 1) has the highest exposure (light amount)
  • the exposure (light amount) of the captured image (frame No. 2) taken under the condition is less than the first lighting condition and more than the third lighting condition,
  • the exposure (light amount) of the captured image (frame No. "3") is the smallest.
  • the authentication device B1 can acquire captured images with different exposures (light amounts) by capturing images while changing the illumination emission time of the illumination 32 with respect to the predetermined shutter speed of the image sensor 42. Therefore, the authentication device B1 can more efficiently acquire a captured image captured at a brightness (bioluminance value) suitable for extracting biometric information.
  • FIG. 14 is a timing chart showing an example of exposure control of the illumination 32 and the image sensor 42 in the authentication device B1. Note that the third exposure control process shown in FIG. 14 is an example, and it goes without saying that the process is not limited thereto.
  • the exposure control unit 20 switches the exposure control corresponding to each of the three exposure conditions in a time-sharing manner.
  • the exposure control unit 20 performs exposure using an exposure control pattern that switches exposure control corresponding to each exposure condition in a time-sharing manner in the order of the first exposure condition ⁇ second exposure condition ⁇ third exposure condition. Execute control.
  • the exposure control unit 20 controls the illumination 32 and the lighting based on the above-described exposure control pattern from the timing when it acquires the control command output from the processor 11 to start the exposure control to the timing when it acquires the control command to end the exposure control. Exposure control for each image sensor 42 is repeatedly executed.
  • the exposure control unit 20 controls the image sensor 42 at a constant shutter speed, and causes the illumination 32 to emit light for a constant illumination time.
  • the exposure control unit 20 determines the timing of outputting an illumination start signal (trigger signal) for turning on the illumination 32 to the illumination driver circuit 31, and a shutter open signal (trigger signal) for opening the shutter of the image sensor 42 (exposure state).
  • an illumination start signal trigger signal
  • a shutter open signal trigger signal
  • the exposure control unit 20 can adjust the exposure (light amount) in capturing one captured image, and can capture captured images in which the bioluminance values of the user's hand UH shown in the captured image are different.
  • the exposure control unit 20 Under the first exposure condition, the exposure control unit 20 outputs a shutter open signal and a light emission start signal at time T71.
  • the image sensor 42 opens the shutter (exposure state) based on the shutter open signal output from the exposure control section 20 and performs exposure at the shutter speed ST.
  • the illumination 32 is turned on based on the light emission start signal output from the exposure control unit 20, and illuminates the user's hand UH passing over the glass surface 16 during the light emission time LT.
  • the imaging unit 40 outputs the captured image (frame number “1”) to the processor 11.
  • the exposure control unit 20 Under the second exposure condition, the exposure control unit 20 outputs a shutter open signal at time T72, and outputs a light emission start signal at time T73.
  • the image sensor 42 opens the shutter (exposure state) based on the shutter open signal output from the exposure control unit 20 at time T72, and performs exposure at the shutter speed ST.
  • the illumination 32 is turned on based on the light emission start signal output from the exposure control unit 20 at time T73, and illuminates the user's hand UH passing over the glass surface 16 during the light emission time LT.
  • the imaging unit 40 outputs the captured image (frame No. "2") to the processor 11.
  • the exposure control unit 20 outputs a shutter open signal at time T74, and outputs a light emission start signal at time T75.
  • the image sensor 42 opens the shutter (exposure state) based on the shutter open signal output from the exposure control unit 20 at time T74, and performs exposure at the shutter speed ST.
  • the illumination 32 is turned on based on the light emission start signal output from the exposure control section 20 at time T75, and illuminates the user's hand UH passing over the glass surface 16 during the light emission time LT.
  • the imaging unit 40 outputs the captured image (frame No. “3”) to the processor 11.
  • the exposure control unit 20 executes the exposure control corresponding to the first exposure condition again.
  • the exposure control unit 20 outputs a shutter open signal and a light emission start signal at time T76.
  • the image sensor 42 opens the shutter (exposure state) based on the shutter open signal output from the exposure control section 20 and performs exposure at the shutter speed ST.
  • the illumination 32 is turned on based on the light emission start signal output from the exposure control unit 20, and illuminates the user's hand UH passing over the glass surface 16 during the light emission time LT.
  • the imaging unit 40 outputs the captured image (frame number “4”) to the processor 11.
  • the exposure times of the captured images (frame numbers “1" and "4") captured under the first exposure condition are time periods T61 and T64 in which the shutter speed ST and the illumination light emission time LT overlap.
  • the captured image (frame No. "1") has the highest exposure (light amount) compared to other captured images.
  • the exposure time of the captured image (frame No. "2") captured under the second exposure condition is a time period T62 in which the shutter speed ST and the illumination light emission time LT overlap.
  • the captured image (frame No. "2") has a lower exposure (light intensity) than the captured image (frame No. "1") captured under the first exposure condition, and It is larger than the exposure (light amount) of the captured image (frame No. "3").
  • the exposure time of the captured image (frame No. "3") captured under the third exposure condition is a time period T63 in which the shutter speed ST and the illumination light emission time LT overlap.
  • the captured image (frame No. "3") has the lowest exposure (light amount) compared to other captured images.
  • the authentication device B1 controls the processor 11 or the exposure control unit 20 by simultaneously controlling the ON/OFF control of the illumination 32 and the start/end control of the shutter of the image sensor 42. Even if the processing load increases, exposure control of the illumination 32 and the image sensor 42 can be achieved by simply generating and outputting trigger signals for the shutters of the illumination 32 and the image sensor 42.
  • the authentication device B1 can obtain a captured image captured with a brightness suitable for extracting biometric information.
  • the authentication device B1 may control the exposure (amount of light) that enters the image sensor 42 by controlling the aperture of the lens 41.
  • the exposure control unit 20 may perform exposure control to adjust the aperture of the lens 41 during a period in which the shutter of the image sensor 42 is in a closed state (that is, an OFF period).
  • the biometric authentication system 100 according to the first embodiment described above shows an example in which the authentication device B1 images the user's hand UH, performs biometric authentication, and displays the biometric authentication result on the monitor MN.
  • the biometric authentication system 200 according to the modification of the first embodiment is an example in which the biometric information acquisition device B1A images the user's hand UH, the authentication device P1 executes the biometric authentication, and the monitor MN displays the biometric authentication result. explain. Note that in the following description, the same components as those of each device constituting the biometric authentication system 100 according to Embodiment 1 will be given the same reference numerals and the description will be omitted.
  • the biometric authentication system 200 includes a biometric information acquisition device B1A, an authentication device P1, and a monitor MN.
  • the biometric authentication system 200 captures a captured image of a user's hand or a part of the hand UH using the biometric information acquisition device B1A, acquires biometric information of the user appearing in the captured image, and communicates with the biometric information acquisition device B1A.
  • the authentication device P1 is connected to the authentication device P1 so that data can be transmitted and received therebetween.
  • the biometric authentication system 200 also uses the authentication device P1 to perform biometric authentication by comparing the user's biometric information with each of a plurality of pre-registered biometric information, and sends the biometric authentication results to the biometric information acquisition device B1A. Send.
  • the biometric authentication system 200 uses the biometric information acquisition device B1A to generate an authentication result screen that notifies the biometric authentication result, and outputs and displays it on the monitor MN.
  • biometric authentication system 200 will be described as an example in which the biometric information acquisition device B1A and the monitor MN are configured separately, they may be configured integrally.
  • the biometric information acquisition device B1A and the authentication device P1 may be connected to each other via a network (not shown) so that data can be transmitted and received, or, for example, via a wired cable or the like. It may also be connected to enable data transmission and reception.
  • FIG. 15 is a block diagram showing an example of the internal configuration of the biological information acquisition device B1A according to a modification of the first embodiment. Note that the inside of the casing 18 of the biometric information acquisition device B1A is the same as the inside of the casing 18 of the authentication device B1 shown in FIG. 2, so a description thereof will be omitted.
  • the biological information acquisition device B1A is made of metal or resin.
  • the biological information acquisition device B1A communicates with a control section 10A, a glass surface 16, a housing 18, an exposure control section 20, an illumination section 30, an imaging section 40, a sensor section 50, a display control section 60, and a control section 10A. 70.
  • the control unit 10A includes a processor 11A and a memory 12.
  • the processor 11A is configured using, for example, a CPU or an FPGA, and performs various processing and control in cooperation with the memory 12. Specifically, the processor 11A refers to the program and data held in the memory 12, and executes the program to control each section such as the control section 10A, the exposure control section 20, the sensor section 50, the display control section 60, etc. Realize the functions of
  • the processor 11A causes the exposure control section 20 to start controlling each of the illumination section 30 and the imaging section 40 based on the first detection signal output from the sensor section 50 and notifying the detection of the user's hand UH.
  • the processor 11A causes the exposure control unit 20 to terminate the control of the illumination unit 30 and the imaging unit 40, based on the second detection signal output from the sensor unit 50 and notifying the detection of the user's hand UH.
  • the processor 11A performs image processing on the captured image captured by the imaging unit 40 to extract the feature amount of the user's biometric information.
  • the processor 11A outputs the extracted feature amount of the user's biometric information to the communication unit 70, and causes the communication unit 70 to transmit it to the authentication device P1.
  • the processor 11A acquires the biometric authentication result (user authentication result) transmitted from the authentication device P1.
  • the processor 11A generates an authentication result screen for notifying the biometric authentication result based on the acquired biometric authentication result information, outputs it to the display control unit 60, and displays it on the monitor MN.
  • the communication unit 70 is connected to the communication unit 80 in the authentication device P1 so as to enable data communication. Note that the communication unit 70 may be connected to the communication unit 80 in the authentication device P1 to enable wireless or wired communication.
  • the communication unit 70 transmits the feature amount of the user's biometric information output from the processor 11A to the authentication device P1. Furthermore, the communication unit 70 outputs the biometric authentication result transmitted from the authentication device P1 to the processor 11A.
  • the feature amount of the user's biometric information and the biometric authentication result information transmitted and received by the communication unit 70 may be encrypted by the respective processors 11A and 81.
  • FIG. 16 is a block diagram showing an example of the internal configuration of authentication device P1 according to a modification of the first embodiment.
  • the authentication device P1 includes a communication unit 80, a processor 81, a memory 82, and a biometric information database DBA.
  • the biometric information database DBA may be configured separately from the authentication device P1 and connected to the authentication device P1 so as to be able to transmit and receive data.
  • the communication unit 80 is connected to the communication unit 70 in the biometric information acquisition device B1A for wireless or wired communication and executes data transmission and reception.
  • the communication unit 80 acquires the feature amount of the user's biometric information transmitted from the biometric information acquisition device B1A, and outputs it to the processor 81. Furthermore, the communication unit 80 transmits information on the biometric authentication result output from the processor 81 to the biometric information acquisition device B1A.
  • the processor 81 is configured using, for example, a CPU or an FPGA, and performs various processing and control in cooperation with the memory 82. Specifically, the processor 81 references programs and data held in the memory 82 and executes the programs to realize the functions of each part.
  • the processor 81 performs user authentication (using biometric information) based on the feature amount of the user's biometric information and the feature amount of each biometric information of a plurality of users registered (stored) in advance in the biometric information database DBA. In other words, biometric authentication) is performed.
  • the processor 81 generates a biometric authentication result, outputs information on the biometric authentication result to the communication unit 80, and causes the biometric information acquisition device B1A to transmit the information.
  • the memory 82 includes, for example, a RAM as a work memory used when the processor 81 executes each process, and a ROM that stores programs and data that define the operations of the processor 81. Data or information generated or acquired by the processor 81 is temporarily stored in the RAM. A program that defines the operation of the processor 81 is written in the ROM.
  • the biometric information database DBA is a storage medium device such as an HDD or an SSD, and stores each of the biometric information of a plurality of users registered in advance by an administrator.
  • the biometric information stored in the biometric information database DBA is biometric information that can be biometrically authenticated, such as fingerprints or veins of each of a plurality of fingers of the user, and a palm print of the user, and is stored in association with information about the user.
  • the biometric information in the modification of the first embodiment may be the captured image itself from which the feature amount of the biometric information is extracted.
  • the biometric information acquisition device B1A according to the modification of the first embodiment selects at least one captured image that includes biometric information and for extracting the feature amount of the biometric information, and You may send it to
  • the authentication device P1 may acquire a captured image containing the user's biometric information that is transmitted from the biometric information acquisition device B1A, and may extract the feature amount of the user's biometric information from the acquired captured image.
  • the authentication device P1 performs biometric authentication (user authentication) using the extracted feature amount of the user's biometric information.
  • FIG. 17 is a table TB3 showing the correspondence between each operation procedure shown in FIGS. 7 and 11 and the operation procedure of the biometric authentication systems 100 and 200 according to each embodiment.
  • the authentication device B1 executes each process from step St1-1 to step St6-2, and the monitor MN executes each process from step St7-1 to step St7-2. Execute.
  • the biometric information acquisition device B1A executes steps St1-1 to St5-2, and the authentication device P1 executes steps St6-1 to St6-2. Each process in St6-2 is executed, and each process in steps St7-1 to St7-2 is executed by the monitor MN.
  • the authentication device B1 (an example of a biometric authentication device) according to the first embodiment includes the imaging unit 40 that images at least a part of the hand of a user (an example of a person to be authenticated), and the lighting that illuminates the user's hand.
  • an exposure control section 20 (an example of a control section) that controls at least one of the imaging section 40 and the illumination section 30 based on a plurality of different exposure conditions (an example of exposure parameters);
  • a processor 11 (an example of an authentication unit) that extracts the user's biometric information from each of the captured images and authenticates the user based on the user's biometric information and the biometric information of each of the plurality of users registered in advance; , is provided.
  • a plurality of captured images are captured by the imaging unit 40 for each exposure condition.
  • the authentication device B1 according to Embodiment 1 can adjust the exposure (light amount) in capturing one captured image even if the height of the user's hand (that is, the imaging distance) varies. This can be adjusted and images with different biometric brightness values of biometric authentication parts (for example, palms, fingers, etc.) appearing in the captured image can be captured, so it is possible to obtain captured images with brightness more suitable for extraction of biometric information.
  • biometric authentication parts for example, palms, fingers, etc.
  • the imaging unit 40 in the authentication device B1 according to the first embodiment includes a shutter.
  • the plurality of exposure conditions have different shutter speeds.
  • the authentication device B1 according to the first embodiment acquires captured images with different exposures (light amounts) by changing the shutter speed based on a plurality of preset shutter speed conditions (exposure conditions). can. Therefore, the authentication device B1 can more efficiently acquire a captured image captured at a brightness (bioluminance value) suitable for extracting biometric information.
  • the plurality of exposure conditions in the authentication device B1 according to the first embodiment are parameters related to light emission control of the illumination unit 30.
  • the authentication device B1 according to the first embodiment controls the light emission of the illumination 32 based on a plurality of illumination conditions (exposure conditions) set in advance, thereby allowing the authentication device B1 to capture captured images with different exposures (light amounts). can be obtained. Therefore, the authentication device B1 can more efficiently acquire a captured image captured at a brightness (bioluminance value) suitable for extracting biometric information.
  • the plurality of exposure conditions in the authentication device B1 according to the first embodiment have different light emission times of the illumination unit 30.
  • the authentication device B1 according to the first embodiment controls the illumination time of the illumination 32 based on a plurality of illumination conditions (exposure conditions) set in advance, thereby capturing images with different exposures (light amounts). Images can be obtained. Therefore, the authentication device B1 can more efficiently acquire a captured image captured at a brightness (bioluminance value) suitable for extracting biometric information.
  • the plurality of exposure conditions in the authentication device B1 according to the first embodiment are such that the light emission intensity of the illumination section 30 is constant, and the light emission time of the illumination section 30 is different.
  • the authentication device B1 according to the first embodiment controls the lighting time of the lighting 32 (that is, ON/OFF control of the lighting) based on a plurality of lighting conditions (exposure conditions) set in advance. This makes it easier to obtain captured images with different exposures (light amounts). Therefore, the authentication device B1 can more efficiently acquire a captured image captured at a brightness (bioluminance value) suitable for extracting biometric information.
  • the imaging unit 40 in the authentication device B1 according to the first embodiment includes a shutter.
  • the plurality of exposure conditions are parameters related to at least one of the shutter speed of the shutter and the light emission time of the illumination unit 30.
  • the authentication device B1 according to the first embodiment can perform different exposures (light amounts) by controlling the light emission of the illumination 32 or changing the shutter speed of the shutter based on a plurality of exposure conditions set in advance. Captured images can be obtained. Therefore, the authentication device B1 can more efficiently acquire a captured image captured at a brightness (bioluminance value) suitable for extracting biometric information.
  • the plurality of exposure conditions in the authentication device B1 according to the first embodiment are different in the first timing to start the shutter or the second timing to turn on the illumination unit 30.
  • the authentication device B1 according to the first embodiment outputs a shutter open signal (trigger signal) that opens the shutter (exposed state) and a light emission start signal (trigger signal) that lights up the illumination unit 30.
  • a shutter open signal trigger signal
  • a light emission start signal trigger signal
  • the authentication device B1 can more efficiently acquire a captured image captured at a brightness (bioluminance value) suitable for extracting biometric information.
  • the exposure control unit 20 in the authentication device B1 according to the first embodiment lights up the illumination unit 30 and then images the hand for each exposure condition.
  • the authentication device B1 according to the first embodiment can omit the ON/OFF control of the illumination unit 30 during image capturing, and perform control to change the shutter speed of the shutter to capture captured images with different exposures (light amounts). can be obtained. Therefore, the authentication device B1 can more efficiently acquire a captured image captured at a brightness (bioluminance value) suitable for extracting biometric information.
  • the exposure control unit 20 in the authentication device B1 according to the first embodiment starts shutter start control and then images the hand for each exposure condition.
  • the authentication device B1 according to the first embodiment can perform simple control to start and end the shutter at a constant shutter speed and control the lighting time of the lighting 32 (that is, ON/OFF control of the lighting). , images with different exposures (light amounts) can be obtained more easily. Therefore, the authentication device B1 can more efficiently acquire a captured image captured at a brightness (bioluminance value) suitable for extracting biometric information.
  • the authentication device B1 according to the first embodiment further includes a first proximity sensor 51 (an example of a first sensor) that detects entry of the hand UH into the imaging area of the imaging unit 40.
  • the exposure control section 20 starts controlling the imaging section 40 and the illumination section 30 at the timing when the first proximity sensor 51 detects the entry of the hand UH.
  • the imaging unit 40 images the hand under each exposure condition.
  • the authentication device B1 according to the first embodiment starts exposure control from the timing when the imaging unit 40 can image the user's hand UH, so that the increase in power consumption of the authentication device B1 can be more effectively reduced. It can be suppressed.
  • the authentication device B1 according to the first embodiment further includes a second proximity sensor 52 (an example of a second sensor) that detects escape of the hand UH from the imaging area of the imaging unit 40.
  • the exposure control section 20 ends the control of the imaging section 40 and the illumination section 30 at the timing when the escape of the hand UH is detected by the second sensor.
  • the authentication device B1 according to the first embodiment ends the exposure control at the timing when the imaging unit 40 is no longer able to image the user's hand UH, so that the increase in power consumption of the authentication device B1 can be more effectively reduced. It can be suppressed.
  • the biometric authentication system 200 includes a biometric information acquisition device B1A that acquires biometric information of a user (an example of a person to be authenticated), and an authentication device that can communicate with the biometric information acquisition device B1A. P1.
  • the biological information acquisition device B1A controls at least one of the imaging unit 40 (an example of a camera) and the illumination 32 based on a plurality of different exposure conditions (an example of an exposure parameter), and displays the user's hand UH for each exposure condition.
  • the biometric information of the user is acquired from each of the plurality of captured images and transmitted to the authentication device P1.
  • the authentication device P1 authenticates the user based on the user's biometric information transmitted from the biometric information acquisition device B1A and the biometric information of each of the plurality of users registered in advance.
  • the biometric authentication system 200 can reduce the exposure of one captured image even when the height of the user's hand (that is, the imaging distance) varies. (Light amount) can be adjusted and images with different biometric brightness values of biometric authentication parts (e.g. palms, fingers, etc.) appearing in the captured image can be captured, so captured images are captured with brightness more suitable for extracting biometric information. can be obtained.
  • biometric authentication parts e.g. palms, fingers, etc.
  • the present disclosure is useful as a presentation of a biometric authentication device, a biometric authentication method, and a biometric authentication system that capture images more suitable for biometric authentication.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Signal Processing (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Vascular Medicine (AREA)
  • Image Input (AREA)
  • Collating Specific Patterns (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
PCT/JP2023/012049 2022-04-28 2023-03-24 生体認証装置、生体認証方法および生体認証システム Ceased WO2023210231A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US18/860,554 US20250371836A1 (en) 2022-04-28 2023-03-24 Biometric authentication device, biometric authentication method, and biometric authentication system
JP2024517908A JPWO2023210231A1 (https=) 2022-04-28 2023-03-24
EP23795978.8A EP4517701A4 (en) 2022-04-28 2023-03-24 BIOMETRIC AUTHENTICATION DEVICE, BIOMETRIC AUTHENTICATION METHOD, AND BIOMETRIC AUTHENTICATION SYSTEM

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022075296 2022-04-28
JP2022-075296 2022-04-28

Publications (1)

Publication Number Publication Date
WO2023210231A1 true WO2023210231A1 (ja) 2023-11-02

Family

ID=88518686

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/012049 Ceased WO2023210231A1 (ja) 2022-04-28 2023-03-24 生体認証装置、生体認証方法および生体認証システム

Country Status (4)

Country Link
US (1) US20250371836A1 (https=)
EP (1) EP4517701A4 (https=)
JP (1) JPWO2023210231A1 (https=)
WO (1) WO2023210231A1 (https=)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004280383A (ja) * 2003-03-14 2004-10-07 Canon Inc 認証装置、認証方法、及びコンピュ−タ読み取り可能な記憶媒体、プログラム
JP2008005081A (ja) * 2006-06-21 2008-01-10 Mitsubishi Electric Corp 認証装置
JP2008262599A (ja) * 2008-07-17 2008-10-30 Hitachi Ltd 個人認証装置および該装置を用いた行政システム
JP2017162302A (ja) 2016-03-10 2017-09-14 富士通株式会社 生体認証装置、生体認証方法および生体認証プログラム
JP2019040472A (ja) * 2017-08-25 2019-03-14 富士通株式会社 画像処理装置、画像処理方法、及び画像処理プログラム
JP2022075296A (ja) 2020-11-06 2022-05-18 三菱瓦斯化学株式会社 多層容器

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7274808B2 (en) * 2003-04-18 2007-09-25 Avago Technologies Ecbu Ip (Singapore)Pte Ltd Imaging system and apparatus for combining finger recognition and finger navigation
JP2009129365A (ja) * 2007-11-27 2009-06-11 Sony Corp 撮像装置およびその方法
US9251396B2 (en) * 2013-01-29 2016-02-02 Diamond Fortress Technologies, Inc. Touchless fingerprinting acquisition and processing application for mobile devices
JP6660720B2 (ja) * 2015-12-08 2020-03-11 株式会社日立製作所 指静脈認証装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004280383A (ja) * 2003-03-14 2004-10-07 Canon Inc 認証装置、認証方法、及びコンピュ−タ読み取り可能な記憶媒体、プログラム
JP2008005081A (ja) * 2006-06-21 2008-01-10 Mitsubishi Electric Corp 認証装置
JP2008262599A (ja) * 2008-07-17 2008-10-30 Hitachi Ltd 個人認証装置および該装置を用いた行政システム
JP2017162302A (ja) 2016-03-10 2017-09-14 富士通株式会社 生体認証装置、生体認証方法および生体認証プログラム
JP2019040472A (ja) * 2017-08-25 2019-03-14 富士通株式会社 画像処理装置、画像処理方法、及び画像処理プログラム
JP2022075296A (ja) 2020-11-06 2022-05-18 三菱瓦斯化学株式会社 多層容器

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4517701A4

Also Published As

Publication number Publication date
JPWO2023210231A1 (https=) 2023-11-02
US20250371836A1 (en) 2025-12-04
EP4517701A4 (en) 2025-05-14
EP4517701A1 (en) 2025-03-05

Similar Documents

Publication Publication Date Title
US10373008B2 (en) Systems and methods of biometric analysis with adaptive trigger
US9848113B2 (en) Multi-band biometric camera system having iris color recognition
US11281892B2 (en) Technologies for efficient identity recognition based on skin features
US8514277B2 (en) Video infrared retinal image scanner
US20150085096A1 (en) Tracking optics for a mobile device
US20140253711A1 (en) Agile non-contact biometric sensor
US11687635B2 (en) Automatic exposure and gain control for face authentication
KR101939696B1 (ko) 사용자 무의식형 멀티모달 출입통제시스템
US10395093B2 (en) Image processing apparatus, image processing method, and non-transitory computer-readable storage medium
US10346673B2 (en) Biometric authentication device, biometric authentication method, and computer-readable non-transitory medium
JP7400949B2 (ja) 撮像システム、撮像方法及び撮像プログラム
US20210256103A1 (en) Handheld multi-sensor biometric imaging device and processing pipeline
US20160350607A1 (en) Biometric authentication device
KR100572626B1 (ko) 홍채 등록 장치
WO2023210231A1 (ja) 生体認証装置、生体認証方法および生体認証システム
CN113614772A (zh) 照明控制装置、方法、系统和计算机可读介质
WO2022092305A1 (ja) 生体情報取得装置、生体認証装置および生体情報取得方法
JP2007094535A (ja) 認証システム及び認証方法
JP2018101289A (ja) 生体認証装置、生体認証システム、生体認証プログラム、及び生体認証方法
WO2025028478A1 (ja) 生体画像取得装置、生体画像取得方法および生体認証システム
CN112672021B (zh) 语言识别方法、装置及电子设备
TWM524478U (zh) 雙波段光譜鏡頭模組
KR20200107167A (ko) 자연광 환경에서 적외선을 이용하여 얼굴 인식이 가능한 이미지를 생성할 수 있는 얼굴인식장치 및 그 인식방법
WO2025197901A1 (ja) 生体画像取得装置、および生体画像取得方法
WO2024225283A1 (ja) 生体画像取得装置、生体画像取得方法および生体認証システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23795978

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024517908

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2023795978

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2023795978

Country of ref document: EP

Effective date: 20241128