JP2023132726A - Biological image acquisition device and biological image acquisition method - Google Patents

Abstract

To provide a biological image acquisition device and a biological image acquisition method which suppress variations in photographing conditions of a biological authentication part, in non-contact biological authentication using a camera.SOLUTION: In a biological authentication system 100, an authentication device P0 as a biological image acquisition device includes a tactile sense generation device P1 for generating a tactile sense using acoustic waves at a predetermined aerial position, and a biological information acquisition device P2 having a camera for biological information acquisition for photographing a predetermined part of a person to be authenticated positioned at the predetermined position, and a communication part for transmitting a photographic image photographed by the camera for biological information acquisition to a biological authentication device P3 for executing authentication processing of the person to be authenticated through network NW.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to a biological image acquisition device and a biological image acquisition method.

Patent Document 1 discloses a biometric authentication device that acquires information regarding a human body part to be authenticated and performs personal authentication based on the result of comparing the acquired information with pre-registered personal authentication information. There is. The biometric authentication device displays guiding information for guiding the body part to be authenticated to a predetermined imaging area on the display unit, and the aerial imaging member allows light indicating the guiding information to be incident, and directs the incident light to the incident side. It emits on the opposite side and creates a virtual image in the air. The biometric authentication device captures an image of the body part to be authenticated, processes the image of the body part to be authenticated, acquires information about the body part to be authenticated, and uses the acquired information about the body part to be authenticated and the stored information for personal authentication. Personal authentication is performed based on the comparison results with the information. Further, the aerial imaging member generates a virtual image at a location away from the biometric authentication device, and the surface located on the side where the virtual image is generated is flat.

JP 2019-40463 Publication

However, in Patent Document 1, the actual position of the part to be authenticated with respect to the generated virtual image differs for each person to be authenticated, and the size of the part to be authenticated (for example, a hand, etc.) differs depending on individual differences. Therefore, in the biometric authentication device, variations may occur in the imaging conditions for images of the body part to be authenticated used for biometric authentication.

The present disclosure was devised in view of the above-mentioned conventional circumstances, and provides a biometric image acquisition device and a biometric image acquisition method that suppress variations in imaging conditions of a biometric authentication site in non-contact biometric authentication using a camera. With the goal.

The present disclosure provides a tactile sensation generating unit that generates a tactile sensation using sound waves at a predetermined position in the air, a camera that images a predetermined part of a person to be authenticated located at the predetermined position, and an image captured by the camera, A living body image acquisition device is provided, comprising: a communication unit that transmits data to an external device that performs authentication processing of the person to be authenticated.

The present disclosure also provides a biological image acquisition method performed by a biological image acquisition device including one or more computers, which generates a tactile sensation using sound waves at a predetermined position in the air, and A biometric information acquisition method is provided, in which a predetermined part of a person is imaged, and the captured image is transmitted to an external device that performs authentication processing of the person to be authenticated.

According to the present disclosure, in non-contact biometric authentication using a camera, variations in imaging conditions of a biometric authentication site can be suppressed.

A diagram illustrating an example of the overall configuration of a biometric authentication system according to Embodiment 1 A diagram showing an example 1 of the internal configuration of the tactile sensation generation device in the first embodiment Diagram explaining the tactile presentation method by the ultrasonic transmitter Diagram explaining an example of an ultrasonic transmitter A diagram showing an internal configuration example 2 of the tactile sensation generation device in the first embodiment A diagram showing an example of internal configuration of a biometric information acquisition device and a biometric authentication device in Embodiment 1. A diagram illustrating an example of the overall configuration of a biometric authentication system according to a modification of Embodiment 1 A diagram showing an example of the internal configuration of a biometric information acquisition device and a biometric authentication device in a modification of Embodiment 1. Flowchart illustrating example 1 of operation procedures of the biometric authentication system according to the first embodiment and a modification of the first embodiment Diagram illustrating a first example of acquiring an image for biometric authentication Diagram illustrating a first example of acquiring an image for biometric authentication A diagram illustrating a second example of acquiring an image for biometric authentication A diagram illustrating a second example of acquiring an image for biometric authentication A diagram illustrating a third example of acquiring an image for biometric authentication A diagram illustrating a third example of acquiring an image for biometric authentication Diagram illustrating a fourth acquisition example of biometric authentication images Diagram illustrating a fourth acquisition example of biometric authentication images Flowchart showing a second example of the operation procedure of the biometric authentication system according to the first embodiment and a modification of the first embodiment Flowchart showing a third example of the operation procedure of the biometric authentication system according to the first embodiment and a modification of the first embodiment A diagram illustrating a fifth example of acquiring an image for biometric authentication A diagram illustrating a fifth example of acquiring an image for biometric authentication Diagram illustrating the sixth acquisition example of biometric authentication images Diagram illustrating the sixth acquisition example of biometric authentication images

DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments specifically disclosing the configuration and operation of a biological image acquisition device and a biological image acquisition method according to the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanations of well-known matters or redundant explanations of substantially the same configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter recited in the claims.

(Embodiment 1)
The overall configuration of biometric authentication system 100 according to Embodiment 1 will be described with reference to FIG. 1. FIG. 1 is a diagram illustrating an example of the overall configuration of a biometric authentication system 100 according to the first embodiment.

The biometric authentication system 100 according to the first embodiment provides a tactile sensation to the hand of a user who is a biometric authentication target using the tactile generation devices P1 and P1A, and generates a captured image used for biometric authentication (hereinafter referred to as a "biometric authentication image"). guide the user to the imaging position (denoted as ) or present the imaging position. The biometric authentication system 100 captures an image of a user's biological body part (for example, a part of the hand, such as a fingertip or a palm) located at an imaging position, and obtains the user's biometric information based on the captured biometric authentication image. Extract. The biometric authentication system 100 performs user authentication based on the extracted user's biometric information. Note that the biometric information referred to here may be a user's fingerprint, palm print, vein, or the like.

The biometric authentication system 100 according to the first embodiment is configured to include an authentication device P0 and a biometric authentication device P3. Note that the biometric information acquisition device P2 and the biometric authentication device P3 in the authentication device P0 are connected via the network NW to enable wireless communication or wired communication, and transmit and receive data. Note that the wireless communication referred to here is communication via a wireless LAN (Local Area Network) such as Wi-Fi (registered trademark), for example.

Authentication device P0 is configured to include at least tactile sense generation devices P1 and P1A and biometric information acquisition device P2. The authentication device P0 uses the tactile sense to present to the user a position where a biometric authentication image can be captured by the tactile sense generation devices P1 and P1A, and acquires the user's biometric information by the biometric information acquisition device P2. The biometric authentication device P3 executes user authentication processing based on the user's biometric information acquired by the biometric information acquisition device P2. The biometric information acquisition device P2 transmits the acquired biometric information of the user to the biometric authentication device P3, generates a screen for notifying the user authentication result based on the user authentication result executed by the biometric authentication device P3, Output and display on monitor MN.

Note that the authentication device P0 does not have a configuration in which the monitor MN is essential and may be omitted. The monitor MN may be configured to be connected to the tactile sensation generating devices P1 and P1A so as to be able to transmit and receive data.

The biometric authentication device P3 is connected to the biometric information acquisition device P2 so as to be able to transmit and receive data. The biometric authentication device P3 acquires the user's biometric information transmitted from the biometric information acquisition device P2, and compares the acquired user's biometric information with the biometric information of multiple persons registered in the biometric information database DB. This will perform user authentication. The biometric authentication device P3 transmits the user authentication result to the biometric information acquisition device P2.

The network NW connects the biometric information acquisition device P2 of the authentication device P0 and the biometric authentication device P3 so that data can be transmitted and received.

The internal configuration of the haptic sensation generating device P1 in the first embodiment will be described with reference to FIG. 2, FIG. 3A, and FIG. 3B. FIG. 2 is a diagram showing an example 1 of the internal configuration of the tactile sensation generating device P1 in the first embodiment. FIG. 3A is a diagram illustrating a tactile presentation method by the ultrasound transmitter 15. FIG. 3B is a diagram illustrating an example of the ultrasound transmitter 15. Note that the number and arrangement of the ultrasonic elements of the ultrasonic transmitter 15 shown in FIG. 3B are merely an example, and are not limited thereto.

The tactile sense generation device P1 is connected to the biometric information acquisition device P2 so that data can be transmitted and received. The tactile sensation generation device P1 includes a communication section 10, a processor 11, a memory 12, a hand insertion detection section 13, a signal level conversion section 14, and an ultrasound transmission section 15.

The communication unit 10 transmits and receives data to and from the communication unit 30 of the biological information acquisition device P2. The communication unit 10 outputs the electrical signal (control command) transmitted from the biological information acquisition device P2 to the processor 11. Furthermore, the communication unit 10 transmits the hand insertion detection result output from the processor 11 to the biological information acquisition device P2.

The processor 11 is configured using, for example, a CPU (Central Processing Unit) or an FPGA (Field Programmable Gate Array), and performs various processing and control in cooperation with the memory 12. Specifically, the processor 11 refers to the program and data held in the memory 12 and executes the program to control the output signal modulation section 111, the output level calculation section 112, the delay time calculation section 113, and the transmission. It realizes the functions of the signal generation unit 114 and the like.

The memory 12 includes, for example, a RAM (Random Access Memory) as a work memory used when the processor 11 executes each process, and a ROM (Read Only Memory) that stores programs and data that define the operations of the processor 11. have Data or information generated or acquired by the processor 11 is temporarily stored in the RAM. A program that defines the operation of the processor 11 is written in the ROM.

The hand insertion detection unit 13 is realized by, for example, a camera, a sensor (for example, a reflective TOF (Time Of Flight) sensor, an infrared sensor, a transmission laser sensor, a light receiving sensor), or the like. The hand insertion detection unit 13 determines (detects) whether or not a user's biological part (specifically, a finger, a palm, etc.) has been inserted into a region where a tactile sensation can be generated by the ultrasound transmission unit 15 . When the hand insertion detection unit 13 determines that the user's biological part has been inserted into the area where a tactile sensation can be imparted, the hand insertion detection unit 13 issues a notification (control command) that the user's biological part has been inserted, or a notification of the detected user's biological part. Position information is generated and output to the processor 11.

For example, when the hand insertion detection unit 13 is implemented by a camera, the hand insertion detection unit 13 images a region where a tactile sensation can be presented (generated) (for example, a tactile sensation presentation possible region ARU11 (see FIG. 9), etc.), and captures an image. Analyze the captured image. When the hand insertion detection unit 13 determines that the user's biological part has been inserted into the area where tactile sensation can be generated based on the analysis result of the captured image, it sends a notification (control command) that the user's biological part has been inserted. It is generated and output to the processor 11.

Further, for example, when the hand insertion detection unit 13 is implemented by a sensor, the hand insertion detection unit 13 detects a biological part of the user in an area where a tactile sensation can be generated (for example, a tactile sensation presentation possible area ARU11 (see FIG. 9), etc.). is inserted. When the hand insertion detection unit 13 detects insertion of the user's biological part into the range (area) where a tactile sensation can be generated, the hand insertion detection unit 13 generates a notification (control command) that the user's biological part has been inserted, and sends the processor 11 Output to.

The signal level converter 14 converts the voltage value of the electrical signal output from the transmission signal generator 114 of the processor 11 and outputs the converted electrical signal to the ultrasound transmitter 15.

The ultrasonic transmitter 15 includes a plurality of ultrasonic elements 16A, 16B, ..., 16k (k: an integer of 2 or more) arranged in N (N: an integer of 1 or more) columns (FIGS. 3A and 3B). Reference) configured. The ultrasonic transmitter 15 converts the electrical signal output from the signal level converter 14 into a sound wave with an amplitude corresponding to the voltage value, and sends the sound wave toward the tactile presentation surface HH (see FIG. 3A) corresponding to the position of the user's hand. and output it. The sound waves output from each of the plurality of ultrasonic elements 16A to 16kN mutually intensify each other at the focal point Pt0 on the haptic presentation surface HH, thereby making it possible to provide a tactile sensation to the user's hand at the focal point Pt0.

The functions of each section realized by the processor 11 will be described below.

The output signal modulation section 111 modulates the output amplitude of the ultrasonic element for each ultrasonic element. For example, the output signal modulation unit 111, based on the distance between the focal point Pt0 corresponding to a predetermined tactile presentation area set in advance and the sound wave output position of each of the plurality of ultrasonic elements 16A to 16kN, The sound wave amplitude at the focus Pt0 is modulated. Output signal modulation section 111 generates a modulation signal for modulating the amplitude of the sound wave, and outputs it to transmission signal generation section 114.

Note that the tactile presentation area referred to here is a position where a tactile sense is presented to a predetermined fingertip, palm, etc. that is a biological part of the inserted user in order to capture an image for biometric authentication.

Furthermore, the modulation referred to here means that the sound wave amplitude output from each of the plurality of ultrasonic elements is turned ON and OFF at a constant cycle at the position of the focal point Pt0, or the output of the sound wave is made such that it draws a sine wave at the position of the focal point Pt0. This is a process that changes the amplitude. In this way, by changing the amplitude of the sound waves at the focal position, the user can obtain a tactile sensation due to the sound waves.

The output level calculation unit 112 calculates the output level (magnitude of the output signal) of the sound waves of the ultrasound transmitting unit 15 for presenting a tactile sensation using sound waves. The output level calculation unit 112 outputs information on the calculated output level of the sound wave for each ultrasonic element to the transmission signal generation unit 114.

The delay time calculation unit 113 calculates the output delay time of each element arranged in the ultrasound transmitting unit 15 for presenting a tactile sensation to the user's hand at a preset hand insertion position. Specifically, the delay time calculation unit 113 calculates the output timing (delay) of the sound waves for each ultrasonic element so that the sound waves output from each of the plurality of ultrasonic elements 16A to 16 kN strengthen each other in a predetermined tactile presentation area. time). Delay time calculation section 113 outputs information on the calculated delay time for each ultrasonic element to transmission signal generation section 114.

For example, the delay time calculation unit 113 calculates the distance between a predetermined tactile presentation area and the output position of the sound wave of each ultrasonic element, and the phase of the sound wave output from each element according to the calculated distance. The delay time for each ultrasonic element is calculated so that it is the same at the focal position.

The transmission signal generation section 114 receives the modulated signal output from the output signal modulation section 111, the output level information for each ultrasonic element output from the output level calculation section 112, and the ultrasonic wave output from the delay time calculation section 113. Based on the delay time information for each acoustic wave element, an electric signal is generated to control the sound waves output from each of the plurality of ultrasonic elements 16A to 16 kN. Transmission signal generation section 114 outputs the generated electrical signal to signal level conversion section 14.

Next, with reference to FIG. 4, another internal configuration of the haptic sensation generating device P1A in the first embodiment will be described. FIG. 4 is a diagram showing a second example of the internal configuration of the tactile sensation generating device P1A in the first embodiment. Note that the same components as those of the tactile sensation generating device P1 shown in FIG. 2 are given the same reference numerals, and the description thereof will be omitted.

The tactile sensation generating device P1A shown in FIG. 4 detects the position of the user's inserted biological part (for example, fingertip, palm, etc.), and based on the detected position of the user's biological part and the state of the user's hand. Then, the presentation (output) position of the sound waves output by the ultrasound transmitter 15 is adjusted.

The tactile sensation generation device P1A is connected to the biological information acquisition device P2 so as to be able to transmit and receive data. The tactile sensation generating device P1A includes a communication section 10, a processor 11A, a memory 12, a hand insertion detection section 13, a signal level conversion section 14, and an ultrasound transmission section 15.

The processor 11A is configured using, for example, a CPU or an FPGA, and performs various processes and controls in cooperation with the memory 12. Specifically, the processor 11A refers to the program and data held in the memory 12, and executes the program to improve the output signal modulation section 111, output level calculation section 112, delay time calculation section 113A, and transmission signal. The functions of the generation unit 114A, coordinate-distance conversion unit 115, etc. are realized.

The hand insertion detection section 13A is realized by, for example, a camera, a sensor, or the like. The hand insertion detection unit 13A detects when the user's hand (specifically, fingers, palm, etc.) is inserted into a region where the ultrasound transmitting unit 15 can generate a tactile sensation (for example, a tactile presentation possible region ARU11 (see FIG. 9)). Determine (detect) whether or not it has occurred. When the hand insertion detection unit 13A determines that the user's hand has been inserted into the region where a tactile sensation can be imparted, the hand insertion detection unit 13A measures the position (coordinates) of the user's biological part (for example, finger, palm, etc.). The hand insertion detection unit 13A generates a notification (control command) that the user's hand has been inserted and the position information of the detected body part of the user, and outputs the information to the processor 11A.

Note that the body part detected by the hand insertion detection unit 13A may not be an arbitrary part but a preset part (for example, a predetermined fingertip, palm, etc.).

The coordinate-distance conversion unit 115 acquires the position information (coordinates) of the user's biological body part output from the hand insertion detection unit 13A. The coordinate-distance converter 115 calculates the distance between the output position of the sound wave of each of the plurality of ultrasonic elements 16A to 16kN that constitute the ultrasonic transmitter 15 based on the acquired position information (coordinates) of the biological part. The distance is calculated and output to the delay time calculation section 113A.

The delay time calculation unit 113A calculates a plurality of ultrasonic waves based on the distance between the user's body part outputted from the coordinate-distance conversion unit 115 and the output position of each of the sound waves of the plurality of ultrasonic elements 16A to 16 kN. The delay time of the sound waves output from each of the sound wave elements 16A to 16 kN is calculated. The delay time calculation unit 113A outputs information on the calculated delay time of the sound waves output from each of the plurality of ultrasonic elements 16A to 16kN to the transmission signal generation unit 114A.

The transmission signal generation section 114A uses the modulated signal output from the output signal modulation section 111, the output level information for each ultrasonic element output from the output level calculation section 112, and the ultrasonic wave output from the delay time calculation section 113A. Based on the delay time information for each acoustic wave element, an electric signal is generated to control the sound waves output from each of the plurality of ultrasonic elements 16A to 16 kN. The transmission signal generation section 114A outputs the generated electrical signal to the signal level conversion section 14.

Note that the tactile sensation generation device P1A guides the user's biometric position to the imaging area of the biometric authentication image by moving the tactile point (position) presented to the user's biometric region detected by the hand insertion detection unit 13A. I can do it. Therefore, the tactile sensation generation device P1A can support capturing of a biometric authentication image more suitable for biometric authentication. Furthermore, the user can more easily move the body part to the tactile presentation area using the tactile sense.

With reference to FIG. 5, the internal configurations of biometric information acquisition device P2 and biometric authentication device P3 in Embodiment 1 will be described. FIG. 5 is a diagram showing an example of the internal configuration of the biometric information acquisition device P2 and the biometric authentication device P3 in the first embodiment.

The biometric information acquisition device P2 is connected to the tactile sensation generation device P1 and the biometric authentication device P3 so as to enable data communication with each other. The biometric information acquisition device P2 captures an image of the user's authentication site (eg, fingertip, palm, etc.) using the biometric information acquisition camera 34. Note that the authentication site referred to here is a site from which biometric information of the user is acquired, and is, for example, a fingertip when the biometric information is a fingerprint, and a palm when the biometric information is a palm print or vein.

The biometric information acquisition device P2 analyzes the captured biometric authentication image to obtain the user's biometric information (e.g., fingerprint, palm print, vein, etc.), and transfers the acquired user biometric information to the biometric authentication device P3. Send to. Furthermore, the biometric information acquisition device P2 generates a user authentication result based on the biometric authentication result executed by the biometric authentication device P3, and outputs it to the monitor MN.

The biological information acquisition device P2 includes a communication section 30, a processor 31, a memory 32, a still detection camera 33, a biological information acquisition camera 34, and an illumination section 35. Note that the illumination section 35 is not essential and may be omitted. Further, the monitor MN may be configured integrally with the biological information acquisition device P2.

The communication unit 30 is connected to enable wireless or wired communication between the communication unit 10 of the tactile sense generation devices P1, P1A and the communication unit 20 of the biometric authentication device P3, and executes data transmission and reception. The communication unit 30 outputs the detection information of the user's body parts transmitted from the tactile sense generation devices P1 and P1A to the processor 31. The communication unit 30 transmits the user's cutout image or biometric information output from the processor 31 to the biometric authentication device P3, and outputs the authentication result transmitted from the biometric authentication device P3 to the processor 31.

Note that the user's cutout image, biometric information, etc. sent to the biometric authentication device P3 may be subjected to encryption processing. Moreover, the cutout image here is an image cut out from the biometric authentication image in which a part of the part (for example, fingertip, palm, etc.) of the user is to be acquired is shown.

The processor 31 is configured using, for example, a CPU or an FPGA, and performs various processing and control in cooperation with the memory 32. Specifically, the processor 31 refers to the program and data held in the memory 32, and executes the program to obtain a hand image of the user or biometric information of the user. The functions of a stillness detection section 312, a timeout detection section 313, a blurred image detection section 314, etc. are realized.

Furthermore, when the processor 31 determines that the user authentication is successful based on the biometric recognition result transmitted from the biometric authentication device P3, the processor 31 generates an authentication result screen (not shown) that notifies that the user authentication has been successful. and output it to the monitor MN for display. On the other hand, if the processor 31 determines that the user authentication has failed, it generates an authentication result screen (not shown) that notifies that the user authentication has failed, and outputs it to the monitor MN for display.

The hand detection unit 311 determines whether the user's hand or authentication part is inserted into the imaging area based on the captured image captured by the still detection camera 33 (hereinafter referred to as "detection image"). Judgment (detection). The hand detection unit 311 executes hand insertion detection processing for each frame.

The stillness detection unit 312 determines (detects) whether the user's hand or the authentication site is stationary based on the detection image captured by the stillness detection camera 33. The stillness detection unit 312 executes stillness detection processing of the hand or the authentication site for each frame.

The timeout detection unit 313 detects whether the user's hand remains still within a predetermined time limit set in advance from the timing when the hand detection unit 311 detects that the user's hand is inserted into the imaging area. judge. When the user's hand stillness is not detected within a predetermined time limit, the timeout detection unit 313 generates a timeout notification screen (not shown) that notifies that the timeout has occurred, and outputs it to the monitor MN.

The blurred image detection unit 314 determines whether or not the biometric authentication image is blurred based on the biometric authentication image captured by the biometric information acquisition camera 34 . Note that the blur referred to here refers to motion blur that occurs when a subject moves, and indicates, for example, the trajectory (afterimage) of the authentication site that remains in the captured image when the user's authentication site as the subject moves at high speed.

When the blurred image detection unit 314 determines that the biometric authentication image is not blurred, a part of the authentication part (for example, fingertip, palm, etc.) from which biometric information of the user is acquired is reflected in the acquired biometric authentication image. A cutout image is generated by cutting out the range, an encryption process is performed on the cutout image, and the encrypted image is sent to the biometric authentication device P3. Note that the blurred image detection unit 314 may extract the user's biometric information using the generated cutout image, perform encryption processing on the extracted user's biometric information, and transmit it to the biometric authentication device P3.

Here, a method for generating a cutout image will be explained. The blurred image detection unit 314 analyzes the biometric authentication image, detects an authentication part from which biometric information of the user is to be obtained, cuts out an area including the detected authentication part, and generates a cutout image. Note that the method of generating the cutout image is not limited to this, and other known techniques may be used.

The still detection camera 33 includes at least an image sensor (not shown) and a lens (not shown). The image sensor is a solid-state imaging device such as a CCD (Charged-Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and converts an optical image formed on an imaging surface into an electrical signal. The still detection camera 33 has a higher frame rate and lower resolution than the biological information acquisition camera 34. The still detection camera 33 used in the biological information acquisition device P2 is, for example, a camera with a frame rate of 60 fps and a resolution of 640×480. The still detection camera 33 is controlled by the processor 31 .

The biological information acquisition camera 34 includes at least an image sensor (not shown) and a lens (not shown). The image sensor is, for example, a CCD or CMOS solid-state imaging device, and converts an optical image formed on an imaging surface into an electrical signal. The biological information acquisition camera 34 has a lower frame rate and higher resolution than the still detection camera 33. The biometric information acquisition camera 34 used in the biometric information acquisition device P2 is, for example, a camera with a frame rate of 1 fps and a resolution of 3280×2464. The biological information acquisition camera 34 is controlled by the processor 31.

The illumination unit 35 is configured with one or more illuminations such as an LED (Light Emitting Diode), a fluorescent lamp, an incandescent lamp, an IR (infrared) illumination, etc., and illuminates the user's authentication site located within the imaging area. do.

The monitor MN may be configured using a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence). The monitor MN outputs an authentication completion screen (not shown), an authentication failure notification (not shown), etc. output from the processor 31.

The biometric authentication device P3 extracts the user's biometric information using the user's cutout image transmitted from the biometric information acquisition device P2. Note that a known technique (for example, the technique disclosed in Japanese Patent Laid-Open No. 2018-124999) may be used to extract the biometric information. The biometric authentication device P3 compares the extracted biometric information with the biometric information of each of the plurality of users registered in advance by the administrator of the biometric authentication system 100 or the biometric information acquisition device P2. The biometric authentication device P3 determines whether the extracted biometric information matches any of the biometric information of each of the registered users, executes biometric authentication processing, and acquires biometric information from the biometric authentication processing result. Send to device P2.

The biometric authentication device P3 includes a communication unit 40, a processor 41, a memory 42, and a biometric information database DB.

The communication unit 40 is connected to the communication unit 30 of the biological information acquisition device P2 to enable wireless or wired communication, and executes data transmission and reception. The communication unit 40 outputs the cutout image of the user transmitted from the biometric information acquisition device P2 to the processor 41, and transmits the biometric authentication result output from the processor 41 to the biometric information acquisition device P2. Note that the biometric authentication result sent to the biometric information acquisition device P2 may be subjected to encryption processing.

The processor 41 is configured using, for example, a CPU or an FPGA, and performs various processing and control in cooperation with the memory 42. Specifically, the processor 41 references the program and data held in the memory 42 and executes the program, thereby realizing the function of the biometric information authentication unit 411 to perform user authentication.

The biometric information authentication unit 411 extracts the user's biometric information based on the user's cutout image. The biometric information authentication unit 411 compares the extracted user's biometric information with the biometric information of each of the plurality of users stored (registered) in the biometric information database DB. The biometric information authentication unit 411 generates a biometric authentication result that determines whether the extracted user's biometric information matches or is similar to any of the biometric information of each of the registered users, and outputs it to the communication unit 40. and transmits it to the biometric information acquisition device P2.

The memory 42 includes, for example, a RAM as a work memory used when the processor 41 executes each process, and a ROM that stores programs and data that define the operations of the processor 41. Data or information generated or acquired by the processor 41 is temporarily stored in the RAM. A program that defines the operation of the processor 41 is written in the ROM.

The biometric information database DB stores information related to each of a plurality of users registered in advance (for example, name, employee number, identification number, ID, face photo, etc.) and biometric information of each of the plurality of users for each user. Store (register) in association.

(Modification of Embodiment 1)
The biometric authentication system 100 according to the first embodiment described above shows an example in which the biometric information acquisition device P2 and the biometric authentication device P3 are configured separately and are connected to be able to transmit and receive data via the network NW. Ta. A biometric authentication system 100A according to a modification of the first embodiment will be described with reference to an example in which a biometric information acquisition device P2A and a biometric authentication device P3A are integrally configured. Note that the same components as the biometric authentication system 100 according to Embodiment 1 and each device constituting the biometric authentication system 100 are given the same reference numerals, and a description thereof will be omitted.

With reference to FIG. 6, the overall configuration of a biometric authentication system 100A according to a modification of the first embodiment will be described. FIG. 6 is a diagram illustrating an example of the overall configuration of a biometric authentication system 100A according to a modification of the first embodiment.

A biometric authentication system 100A according to a modification of the first embodiment executes a tactile presentation process by the tactile generation devices P1 and P1A, and a user authentication process by biometric authentication by each of the biometric information acquisition device P2A and the biometric authentication device P3A. .

A biometric authentication system 100A according to a modification of the first embodiment includes tactile sense generation devices P1 and P1A, a biometric information acquisition device P2A, and a biometric authentication device P3A. Note that the tactile sense generation devices P1 and P1A shown in FIG. 6 and the biometric information acquisition device P2 may be realized as one computer (an example of an authentication device) that is integrally configured.

The biometric information acquisition device P2A is connected to the biometric authentication device P3A so as to be able to transmit and receive data. The biometric information acquisition device P2A acquires a user's biometric authentication image, or generates a cutout image that cuts out an authentication part from which biometric information is to be acquired from the biometric authentication image, and transmits it to the biometric authentication device P3A.

The biometric authentication device P3A is connected to the tactile sense generation devices P1, P1A and the biometric information acquisition device P2A so that data can be transmitted and received, respectively. The biometric authentication device P3A extracts the user's biometric information from the user's biometric authentication image or cutout image transmitted from the biometric information acquisition device P2A. The biometric authentication device P3A performs biometric authentication (user authentication) by comparing the extracted user's biometric information with the biometric information of each of a plurality of users registered in the biometric information database DB.

The biometric authentication device P3A generates an authentication result screen (not shown) that notifies the user authentication result based on the biometric authentication result and the tactile authentication result executed by the tactile generation devices P1 and P1A, and outputs it to the monitor MNA. and display it.

Referring to FIG. 7, the internal configurations of biometric information acquisition device P2A and biometric authentication device P3A in a modified example of Embodiment 1 will be described. FIG. 7 is a diagram showing an example of the internal configuration of the biometric information acquisition device P2A and the biometric authentication device P3A in a modification of the first embodiment.

The biological information acquisition device P2A is configured to include at least a still detection camera 33 and a biological information acquisition camera 34. Note that the illumination unit 35 is not an essential component and may be omitted.

The biometric authentication device P3A is connected to the tactile sense generation devices P1 and P1A, the biometric information acquisition device P2A, and the monitor MNA so that data can be transmitted and received, respectively. The biometric authentication device P3A includes a communication unit 40A, a processor 41A, a memory 42A, and a biometric information database DB.

The communication unit 40A includes the communication unit 10 of the tactile sensation generation devices P1 and P1A, each device (the still detection camera 33, the biometric information acquisition camera 34, and the illumination unit 35) constituting the biological information acquisition device P2A, and the monitor. It is connected to the MNA for wireless or wired communication and transmits and receives data.

The communication unit 40A outputs various data transmitted from the biometric information acquisition device P2A to the processor 41A, and outputs the tactile authentication results transmitted from the tactile sensation generation devices P1 and P1A to the processor 41A. The communication unit 40A also outputs an authentication result screen (not shown) that notifies the user authentication result output from the processor 41A to the monitor MNA.

The processor 41A is configured using, for example, a CPU or an FPGA, and performs various processing and control in cooperation with the memory 42A. Specifically, the processor 41A refers to the program and data held in the memory 42A, and executes the program to detect the biometric information authentication section 411A, the hand detection section 412, the stillness detection section 413, and the timeout detection section 414. , the functions of the blurred image detection unit 415 and the like are realized.

The biometric information authentication unit 411A extracts the user's biometric information based on the cutout image output from the blurred image detection unit 415. The biometric information authentication unit 411A compares the extracted user's biometric information with the biometric information of each of the plurality of users stored (registered) in the biometric information database DB. The biometric information authentication unit 411A determines whether the extracted user's biometric information matches or is similar to any of the biometric information of each of the registered users (that is, biometric authentication).

The biometric information authentication unit 411A performs user authentication based on the biometric authentication result. If the biometric information authentication unit 411A determines that the user authentication is successful, it generates an authentication result screen (not shown) that notifies the user that the user authentication has been successful, and outputs it to the monitor MNA for display. On the other hand, if the biometric information authentication unit 411A determines that the user authentication has failed, it generates an authentication result screen (not shown) that notifies that the user authentication has failed, and outputs it to the monitor MNA for display.

The hand detection unit 412 determines whether the user's authentication part is inserted into the imaging area based on the image captured by the still detection camera 33 (hereinafter referred to as "detection image"). detection). The hand detection unit 412 executes authentication part insertion detection processing for each frame.

The stillness detection unit 413 determines (detects) whether the user's authentication region is stationary based on the detection image captured by the stillness detection camera 33. The stillness detection unit 413 executes the stillness detection process of the authentication part for each frame.

The timeout detection unit 414 determines whether or not the user's authentication part is detected to be stationary within a predetermined time limit set in advance from the timing when the hand detection unit 412 detects insertion of the user's authentication part into the imaging area. Determine whether When the user's authentication part is not detected to be stationary within a predetermined time limit, the timeout detection unit 414 generates a timeout notification screen (not shown) that notifies that the timeout has occurred, and outputs it to the monitor MNA.

The blurred image detection unit 415 determines whether or not the biometric authentication image is blurred based on the biometric authentication image captured by the biometric information acquisition camera 34 . Note that the blur referred to here refers to motion blur that occurs when a subject moves, and indicates, for example, the trajectory (afterimage) of the authentication site that remains in the captured image when the user's authentication site as the subject moves at high speed.

When the blurred image detection unit 415 determines that the biometric authentication image is not blurred, a part of the authentication part (for example, fingertip, palm, etc.) from which biometric information of the user is acquired is reflected in the acquired biometric authentication image. A cutout image is generated by cutting out the range, and outputted to the biometric information authentication section 411A.

Next, with reference to FIG. 8, the operating procedure of biometric authentication processing in the first embodiment and a modification of the first embodiment will be described. FIG. 8 is a flowchart illustrating a first example of the operation procedure of the biometric authentication system 100, 100A according to the first embodiment and a modification of the first embodiment.

The tactile sensation generation device P1 detects insertion of the user's hand into a region where tactile sensations can be generated (presented) (for example, tactile sensation presentation possible regions ARU11, ARU21 (see FIGS. 9 and 13), etc.) by the ultrasonic transmitter 15. It is determined whether or not (St11).

When the tactile sensation generating device P1 determines that insertion of the user's hand is detected in the process of step St11 (St11, YES), the tactile sensation generating device P1 outputs a sound wave through the ultrasonic transmitter 15 and presents a tactile sensation to the detected user's hand. (St12).

On the other hand, when the tactile sensation generating device P1 determines in the process of step St11 that insertion of the user's hand is not detected (St11, NO), the process returns to the process of step St11.

The biometric information acquisition device P2 or the biometric authentication device P3A starts imaging with the stillness detection camera 33, and determines whether the detected hand is still or not based on the stillness detection image captured by the stillness detection camera 33. It is further determined whether or not (St13). Note that the hand stillness here refers to a state in which the hand is stationary so that a biometric authentication image can be captured.

If the biometric information acquisition device P2 or the biometric authentication device P3A determines in the process of step St13 that the detected stillness of the hand is detected (St13, YES), the biometric information acquisition device P2 or the biometric authentication device P3A performs the authentication used for biometric authentication by the biometric information acquisition camera 34. A part (for example, a fingertip, a palm, etc.) is imaged (St14).

On the other hand, when the biometric information acquisition device P2 or the biometric authentication device P3A determines in the process of step St13 that the detected stillness of the hand is not detected (St13, NO), the process returns to the process of step St11. Here, the biometric information acquisition device P2 or the biometric authentication device P3A repeatedly executes the hand stillness detection process for a predetermined period of time (for example, 15 seconds, 20 seconds, etc.) from the timing when the hand stillness detection is started, and If it is determined that the hand stillness is not detected within the time, the process may return to step St11.

The biometric information acquisition device P2 or the biometric authentication device P3A generates a cutout image in which an area in which the authentication part is shown is cut out from the biometric authentication image in which the authentication part is captured. The biometric authentication devices P3 and P3A extract the user's biometric information from the cutout image, and match the extracted user's biometric information with each of the biometric information of a plurality of users registered in the biometric information database DB (St15). ).

The biometric authentication devices P3 and P3A determine whether or not each of the biometric information of a plurality of users registered in the biometric information database DB includes biometric information that is the same as or similar to the extracted biometric information of the user (St16). ).

When the biometric authentication device P3 determines in the process of step St16 that each of the biometric information of a plurality of users registered in the biometric information database DB has biometric information that is the same as or similar to the extracted biometric information of the user. (St16, YES), a biometric authentication result indicating that the user authentication is successful is generated and transmitted to the biometric information acquisition device P2. Based on the biometric authentication result sent from the biometric authentication device P3, the biometric information acquisition device P2 generates an authentication result screen (not shown) notifying that the user authentication is successful, and outputs it to the monitor MN. Display it (St17). Note that the authentication result screen may be generated including information regarding the authenticated (that is, identified) user (for example, the user's name, facial image, etc.).

On the other hand, in the process of step St16, the biometric authentication device P3 determines that there is no biometric information that is the same as or similar to the extracted user's biometric information in each of the biometric information of the plurality of users registered in the biometric information database DB. If so (St16, NO), a biometric authentication result indicating that the user authentication has failed is generated and transmitted to the biometric information acquisition device P2. The biometric information acquisition device P2 generates an authentication result screen (not shown) notifying that user authentication has failed based on the biometric authentication result sent from the biometric authentication device P3, and outputs it to the monitor MN. Display it (St18).

In addition, in the process of step St16, the biometric authentication device P3A determines that each of the biometric information of a plurality of users registered in the biometric information database DB has biometric information that is the same as or similar to the extracted biometric information of the user. If so (St16, YES), an authentication result screen (not shown) is generated and output to the monitor MNA for display (St17).

On the other hand, in the process of step St16, the biometric authentication device P3A determines that there is no biometric information that is the same as or similar to the extracted user's biometric information in each of the biometric information of the plurality of users registered in the biometric information database DB. If so (St16, NO), an authentication result screen (not shown) is generated and output to the monitor MNA for display (St18).

As described above, the biometric authentication systems 100 and 100A according to the first embodiment and the modification of the first embodiment can perform biometric authentication using tactile presentation using ultrasound in non-contact biometric authentication using the biometric information acquisition camera 34. The user's authentication site can be guided to a position where an authentication image can be captured. Thereby, the biometric authentication systems 100, 100A can more effectively suppress variations in the imaging position of the authentication part, and therefore can capture a biometric authentication image more suitable for biometric authentication.

Next, a first example of acquiring an image for biometric authentication will be described with reference to FIGS. 9 and 10, respectively. FIG. 9 is a diagram illustrating a first example of acquiring an image for biometric authentication. FIG. 10 is a diagram illustrating a first example of acquiring an image for biometric authentication. In addition, in FIGS. 9 and 10, in order to make the explanation easier to understand, only the main parts of the tactile sense generation device P1A and the biometric information acquisition devices P2 and P2A in the biometric authentication systems 100 and 100A are illustrated.

Here, the relationship between the tactile presentation area ARU12 and the imaging area ARC12 in the examples shown in FIGS. 9 and 10 will be explained.

In the first acquisition example shown in FIGS. 9 and 10, the biological part and the authentication part are different, and by presenting a tactile sensation on the palm, which is the biological part, and capturing an image of one or more fingertips, which are the authentication part. Obtain information (eg, fingerprints, etc.). Note that the fingertip to be imaged is not limited to any one, but may be any fingertip that corresponds to a fingerprint registered in the biometric information database DB.

The ultrasound transmitter 15 in the first acquisition example presents a tactile sensation to a tactile sensation presentation area ARU12 within a tactile sensation presentation possible area ARU11. Here, the tactile sensation presentation possible area ARU11 indicates an area where the ultrasound transmitter 15 can present a tactile sensation. The tactile presentation area ARU12 is set within the tactile presentation possible area ARU11 and in a substantially horizontal direction (a direction perpendicular to the Z-axis or a direction substantially parallel to the insertion direction D1 of the user's hand). The tactile presentation area ARU12 is set to fit within the tactile presentation possible area ARU11 in the Z direction and the horizontal direction. The position of the tactile presentation area ARU12 is preferably presented on the side where the biometric information acquisition camera 34 is installed (left side in the paper) within the tactile presentation possible area ARU11.

The biological information acquisition camera 34 in the first acquisition example images the fingertip located in the imaging area ARC12 within the viewing angle ARC11. The imaging area ARC12 is an area that is included in the focused area of the lens of the biological information acquisition camera 34 (that is, the depth of field) and is not included in the tactile presentation possible area ARU11. Further, the height H11 of the imaging area ARC12 is set to fall within the height H12 of the tactile presentation possible area ARU11 in the Z direction (that is, height H11<height H12).

In the first acquisition example, the user inserts the hand H1 from the insertion direction D1. The tactile sensation generating devices P1, P1A start outputting sound waves by the ultrasonic transmitter 15 at the timing when the insertion of the user's hand H1 is detected by the hand insertion detectors 13, 13A, and detect the user's hand H1. A control command to be notified is generated and transmitted to the biometric information acquisition device P2 or the biometric authentication device P3A. Specifically, the tactile sensation generating devices P1 and P1A output sound waves such that the sound waves output from each of the plurality of ultrasonic elements 16A to 16kN in the tactile sensation presentation area ARU12 strengthen each other. Note that the tactile sensation generating devices P1 and P1A may always execute the tactile sensation presentation process to the tactile sensation presentation area ARU12.

The biometric information acquisition device P2 or the biometric authentication device P3A causes the still detection camera 33 to image the authentication site (here, the fingertip) based on the control commands transmitted from the tactile sense generation devices P1 and P1A. When the biometric information acquisition device P2 or the biometric authentication device P3A determines that the authentication site is stationary based on the captured image output from the still detection camera 33, the biometric information acquisition device P2 or the biometric authentication device P3A sends the biometric information acquisition camera 34 to the imaging area ARC12. The located authentication site is imaged.

As a result, the biometric authentication systems 100 and 100A according to the first embodiment and the modification of the first embodiment can hold up the user's palm using the sense of touch even if the hand size, finger length, etc. differ from user to user. Since the position can be presented, variations in the imaging position of the user's fingertip (authentication site) can be more effectively suppressed. Therefore, the biometric authentication system 100, 100A can more efficiently capture a biometric image suitable for biometric authentication and acquire biometric information.

Furthermore, the biometric authentication systems 100 and 100A according to the first embodiment and the modification of the first embodiment adjust the height position of the hand H1 to a predetermined height by presenting the tactile presentation area ARU12 that extends approximately horizontally. (that is, the height at which the tactile presentation area ARU12 is presented). In other words, the biometric authentication systems 100 and 100A more effectively suppress variations in the height of the user's fingertips (authentication site), so that the user's fingertips (authentication site) are in the field of view of the biometric information acquisition camera 34. It can be guided to position within the depth.

In addition, in the first acquisition example, the biometric authentication systems 100 and 100A according to the first embodiment and the modification of the first embodiment have a tactile sense on the user's palm because the tactile presentation area ARU12 and the imaging area ARC12 do not overlap. It is possible to image the fingertip while presenting the image.

Next, a second example of acquiring a biometric authentication image will be described with reference to FIGS. 11 and 12, respectively. FIG. 11 is a diagram illustrating a second example of acquiring an image for biometric authentication. FIG. 12 is a diagram illustrating a second example of acquiring an image for biometric authentication. In addition, in FIGS. 11 and 12, in order to make the explanation easier to understand, only the main parts of the tactile sense generation device P1A and the biometric information acquisition devices P2 and P2A in the biometric authentication systems 100 and 100A are illustrated. Furthermore, since the second acquisition example has the same configuration as the first acquisition example, similar configurations are given the same reference numerals and descriptions thereof will be omitted.

Here, the relationship between the tactile presentation area ARU12 and the imaging area ARC12 in the examples shown in FIGS. 11 and 12 will be explained.

In the second acquisition example shown in FIGS. 11 and 12, the biological part and the authentication part are different, and the biological part is presented with a tactile sensation on the palm, which is the biological part, and one or more fingertips, which are the authentication part, are imaged. Obtain information (eg, fingerprints, etc.). Note that the fingertip to be imaged is not limited to any one, but may be any fingertip that corresponds to a fingerprint registered in the biometric information database DB.

The ultrasound transmitter 15 in the second acquisition example presents a tactile sensation to the tactile sensation presentation area ARU13 within the tactile sensation presentation possible area ARU11. The tactile presentation area ARU13 is set within the tactile presentation possible area ARU11 and in a substantially vertical direction (a direction along the Z axis or a direction substantially orthogonal to the user's hand insertion direction D2). The tactile presentation area ARU13 is set so that the height H13 in the Z direction is within the tactile presentation possible area ARU11 and within the imaging area ARC12 of the biological information acquisition camera 34 (that is, within the depth of field), and is horizontally The area in the direction is set so that it falls within the tactile presentation possible area ARU11. The position of the tactile presentation area ARU13 is preferably presented on the side where the biometric information acquisition camera 34 is installed (left side in the paper) within the tactile presentation possible area ARU11.

The biological information acquisition camera 34 in the second acquisition example images the fingertip located in the imaging area ARC12 within the viewing angle ARC11. The imaging area ARC12 is an area that is included in the focused area of the lens of the biological information acquisition camera 34 (that is, the depth of field) and is not included in the tactile presentation possible area ARU11. Further, the height H11 of the imaging area ARC12 is set to fall within the height H12 of the tactile presentation possible area ARU11 in the Z direction (that is, height H11<height H12).

Thereby, the biometric authentication systems 100, 100A according to the first embodiment and the modification of the first embodiment can determine the insertion position of the user's hand in the Z-axis direction by presenting the tactile sensation in the tactile area ARC13 in the substantially vertical direction. The tactile sensation can be presented to the user's hand even if there are variations in the tactile sensation.

In addition, the biometric authentication systems 100 and 100A can use tactile sense to indicate the position of the user's palm even if the hand size, finger length, etc. differ from user to user. Positional variations can be suppressed more effectively. Therefore, the biometric authentication system 100, 100A can more efficiently capture a biometric image suitable for biometric authentication and acquire biometric information.

In addition, in the second acquisition example, the biometric authentication systems 100 and 100A according to the first embodiment and the modification of the first embodiment have a tactile sense on the user's palm because the tactile presentation area ARU12 and the imaging area ARC12 do not overlap. It is possible to image the fingertip while presenting the image.

Next, a third example of acquiring an image for biometric authentication will be described with reference to FIGS. 13 and 14, respectively. FIG. 13 is a diagram illustrating a third example of acquiring an image for biometric authentication. FIG. 14 is a diagram illustrating a third example of acquiring an image for biometric authentication. In addition, in FIGS. 13 and 14, in order to make the explanation easier to understand, only the main parts of the tactile sense generation device P1A and the biometric information acquisition devices P2 and P2A in the biometric authentication systems 100 and 100A are illustrated.

Here, the relationship between the tactile presentation area ARU22 and the imaging area ARC22 in the examples shown in FIGS. 13 and 14 will be explained.

In the third acquisition example shown in FIGS. 13 and 14, the biological part and the authentication part are the same, and by presenting a tactile sensation to the palm, which is the biological part, and capturing an image of the palm, which is the authentication part, biological information (for example Obtain palm prints, veins, etc.).

The ultrasound transmitting unit 15 in the third acquisition example presents a tactile sensation to a tactile sensation presentation area ARU22 within a tactile sensation presentation possible area ARU21. The tactile presentation area ARU22 is set within the tactile presentation possible area ARU21 and in the insertion direction D2 of the user's hand H1 (that is, the direction along the user's palm). The entire area of the tactile presentation area ARU22 is set to fall within the tactile presentation possible area ARU21 and within the imaging area ARC22 of the biological information acquisition camera 34 (that is, within the depth of field).

The biological information acquisition camera 34 in the third acquisition example images the palm located in the imaging area ARC22 within the viewing angle ARC21. The imaging area ARC22 is an area that is included in the focused area (that is, the depth of field) of the lens (not shown) of the biological information acquisition camera 34, and is also included in the tactile presentation possible area ARU21. Furthermore, the height H21 of the imaging area ARC22 is set to fall within the height H22 of the tactile presentation possible area ARU21 in the Z direction (that is, height H21<height H22).

In the third acquisition example, the user inserts the hand H1 from the insertion direction D2. The tactile sensation generating devices P1, P1A start outputting sound waves by the ultrasonic transmitter 15 at the timing when the insertion of the user's hand H1 is detected by the hand insertion detectors 13, 13A, and detect the user's hand H1. A control command to be notified is generated and transmitted to the biometric information acquisition device P2 or the biometric authentication device P3A. Specifically, the tactile sensation generating devices P1 and P1A output sound waves such that the sound waves output from each of the plurality of ultrasonic elements 16A to 16kN in the tactile sensation presentation area ARU23 strengthen each other. Note that the tactile sensation generating devices P1 and P1A may always execute the tactile sensation presentation process to the tactile sensation presentation area ARU13.

The biometric information acquisition device P2 or the biometric authentication device P3A causes the still detection camera 33 to image the authentication site (here, the fingertip) based on the control commands transmitted from the tactile sense generation devices P1 and P1A. When the biometric information acquisition device P2 or the biometric authentication device P3A determines that the authentication site is stationary based on the captured image output from the still detection camera 33, the biometric information acquisition device P2 or the biometric authentication device P3A sends the biometric information acquisition camera 34 to the imaging area ARC22. The located authentication site is imaged.

Note that when the biometric information acquisition device P2 or the biometric authentication device P3A determines that the authentication part is stationary based on the captured image output from the stillness detection camera 33, the biometric information acquisition device P2 or the biometric authentication device P3A issues a control command to notify that the authentication part is stationary. may be generated and transmitted to the tactile sensation generating devices P1 and P1A. In such a case, the tactile sensation generating devices P1 and P1A stop the output of sound waves by the ultrasonic transmitter 15. The biometric information acquisition device P2 or the biometric authentication device P3A images the authentication site using the biometric information acquisition camera 34 after the ultrasound transmitter 15 finishes outputting the sound waves (that is, presenting the tactile sensation).

As a result, the biometric authentication systems 100 and 100A according to the first embodiment and the modification of the first embodiment present the position where the user's palm is held up using the tactile sense, and the biometric authentication system 100, 100A according to the first embodiment and the modification example of the first embodiment can use the tactile sense to present the position where the user's palm is held up, and the biometric authentication system 100, 100A can use the tactile sense to present the position where the user's palm is held up, and By imaging the user's palm (authentication site), variations in the imaging position of the user's palm (authentication site) can be more effectively suppressed. Therefore, the biometric authentication system 100, 100A can more efficiently capture a biometric image suitable for biometric authentication and acquire biometric information.

Next, a fourth example of acquiring an image for biometric authentication will be described with reference to FIGS. 15 and 16, respectively. FIG. 15 is a diagram illustrating a fourth example of acquiring an image for biometric authentication. FIG. 16 is a diagram illustrating a fourth example of acquiring a biometric authentication image. In addition, in FIGS. 15 and 16, in order to make the explanation easy to understand, only the main parts of the tactile sense generation device P1A and the biometric information acquisition devices P2 and P2A in the biometric authentication systems 100 and 100A are illustrated.

Here, the relationship between the tactile presentation area ARU32 and the imaging area ARC32 in the examples shown in FIGS. 15 and 16 will be explained.

In the fourth acquisition example shown in FIGS. 15 and 16, the biological part and the authentication part are the same, and by presenting a tactile sensation to the fingertip, which is the biological part, and capturing an image of the fingertip, which is the authentication part, biological information (for example, fingerprints, etc.). Note that the fingertip to be imaged is not limited to any one, but may be any fingertip that corresponds to a fingerprint registered in the biometric information database DB.

The ultrasound transmitter 15 in the fourth acquisition example presents a tactile sensation to a tactile sensation presentation area ARU32 within a tactile sensation presentation possible area ARU31. The tactile presentation area ARU32 is set to fit within the tactile presentation possible area ARU31 and within the imaging area ARC32 of the biological information acquisition camera 34 (that is, within the depth of field). In addition, in the ultrasonic transmitter 15 shown in FIG. 15, the output position (output surface) of each of the plurality of ultrasonic elements 16A to 16kN of the sound waves is arranged in a direction substantially perpendicular to the insertion direction D1 of the user's H1. Examples are shown below, but are not limited to these. The ultrasonic transmitter 15 does not need to be arranged substantially parallel to the insertion direction D1, and may be arranged at a predetermined angle to the insertion direction D1, for example, as shown by the broken line in FIG. 15. .

The biological information acquisition camera 34 in the fourth acquisition example images at least one fingertip located in the imaging area ARC32 within the angle of view ARC31. Note that the imaging area ARC32 is an area that is included in the focused area (that is, the depth of field) of the lens (not shown) of the biological information acquisition camera 34, and is also included in the tactile presentation possible area ARU31. Further, the height H31 of the imaging area ARC32 is set to fall within the height H32 of the tactile presentation possible area ARU31 in the Z direction (that is, height H31<height H32).

In the fourth acquisition example, the user inserts the hand H1 from the insertion direction D1. The tactile sensation generating devices P1, P1A start outputting sound waves by the ultrasonic transmitter 15 at the timing when the insertion of the user's hand H1 is detected by the hand insertion detectors 13, 13A, and detect the user's hand H1. A control command to be notified is generated and transmitted to the biometric information acquisition device P2 or the biometric authentication device P3A. Specifically, the tactile sensation generating devices P1 and P1A output sound waves such that the sound waves output from each of the plurality of ultrasonic elements 16A to 16kN strengthen each other in the tactile sensation presentation area ARU33. Note that the tactile sensation generating devices P1 and P1A may always execute the tactile sensation presentation process to the tactile sensation presentation area ARU33.

The biometric information acquisition device P2 or the biometric authentication device P3A causes the still detection camera 33 to image the authentication site (here, the fingertip) based on the control commands transmitted from the tactile sense generation devices P1 and P1A. When the biometric information acquisition device P2 or the biometric authentication device P3A determines that the authentication site is stationary based on the captured image output from the still detection camera 33, the biometric information acquisition device P2 or the biometric authentication device P3A sends the biometric information acquisition camera 34 to the imaging area ARC32. The located authentication site is imaged.

Note that when the biometric information acquisition device P2 or the biometric authentication device P3A determines that the authentication part is stationary based on the captured image output from the stillness detection camera 33, the biometric information acquisition device P2 or the biometric authentication device P3A issues a control command to notify that the authentication part is stationary. may be generated and transmitted to the tactile sensation generating devices P1 and P1A. In such a case, the tactile sensation generating devices P1 and P1A stop the output of the sound waves by the ultrasound transmitter 15. The biometric information acquisition device P2 or the biometric authentication device P3A images the authentication site using the biometric information acquisition camera 34 after the ultrasound transmitter 15 finishes outputting the sound waves (that is, presenting the tactile sensation).

As a result, the biometric authentication systems 100 and 100A according to the first embodiment and the modification of the first embodiment present the position where the user's fingertip, which is the authentication site, is placed over using the tactile sense, and the position (area) where the tactile sense is presented. By capturing an image of a stationary fingertip, variations in the imaging position of the user's fingertip (authentication site) can be more effectively suppressed. Therefore, the biometric authentication system 100, 100A can more efficiently capture a biometric image suitable for biometric authentication and acquire biometric information.

Furthermore, in the biometric authentication system 100, 100A according to the first embodiment and the modification of the first embodiment, when a tactile sense is presented to a predetermined fingertip as shown in the fourth acquisition example, the biometric authentication system 100, 100A according to the first embodiment and the modification example of the first embodiment is configured to Since the area is small, variations in the size of fingertips (that is, fingerprints) appearing in biometric authentication images can be efficiently suppressed. Therefore, the biometric authentication systems 100, 100A can improve biometric authentication accuracy.

Next, with reference to FIG. 17, the operating procedure of biometric authentication processing in the first embodiment and a modification of the first embodiment will be described. FIG. 17 is a flowchart showing a second example of the operation procedure of the biometric authentication system 100, 100A according to the first embodiment and a modification of the first embodiment. Note that in the explanation of the flowchart shown in FIG. 17, each of the processes from step St14 to step St18 is the same as each process from step St14 to step St18, which is the same process as in FIG. 8, so the description will be omitted. .

Operation procedure example 2 shows an operation procedure in which a tactile sensation is presented at the timing when the user's hand is inserted into the imaging area of the biometric information acquisition camera 34.

The tactile sensation generation device P1A determines whether or not the ultrasonic wave transmitter 15 detects insertion of the user's hand into a region where a tactile sensation can be generated (for example, the tactile sensation presentation possible region ARU41 (see FIGS. 19 and 21)). (St21).

In the process of step St21, when the tactile sensation generation device P1A determines that insertion of the user's hand is detected (St21, YES), the tactile sensation generation device P1A determines that the position of the detected user's hand is within the imaging area (lens) of the biometric information acquisition camera 34. It is determined whether the captured image is within the depth of field of the subject (not shown), for example, within the imaging area ARC42 (see FIGS. 19 and 21) (St22).

On the other hand, when the tactile sensation generating device P1A determines in the process of step St21 that insertion of the user's hand is not detected (St21, NO), the process returns to the process of step St21.

If the tactile sensation generation device P1A determines in the process of step St22 that the detected position of the user's hand is within the imaging area of the biological information acquisition camera 34 (St22, YES), the ultrasound transmitter 15 transmits a sound wave. outputs a tactile sensation on the detected user's hand (St23), generates a control command to notify that the position of the user's hand is within the imaging area, and sends the biometric information acquisition device P2 or the biometric authentication device Send to P3A.

On the other hand, when the tactile sensation generation device P1A determines in the process of step St22 that the detected position of the user's hand is not within the imaging area (St22, NO), the process returns to the process of step St21.

The biometric information acquisition device P2 or the biometric authentication device P3A starts imaging by the still detection camera 33 based on the control command transmitted from the tactile sensation generation device P1A. The biometric information acquisition device P2 or the biometric authentication device P3A further determines whether or not the detected stillness of the hand is detected based on the stillness detection image captured by the stillness detection camera 33 (St24). Note that the hand stillness here refers to a state in which the hand is stationary so that a biometric authentication image can be captured. Furthermore, the biometric information acquisition device P2 or the biometric authentication device P3A may detect that the user's authentication site is still.

When the biometric information acquisition device P2 or the biometric authentication device P3A determines in the process of step St24 that the detected stillness of the hand is detected (St24, YES), the biometric information acquisition device P2 or the biometric authentication device P3A performs the authentication used for biometric authentication by the biometric information acquisition camera 34. A part (for example, a fingertip, a palm, etc.) is imaged (St14).

On the other hand, when the biometric information acquisition device P2 or the biometric authentication device P3A determines in the process of step St24 that the detected stillness of the hand is not detected (St24, NO), the process returns to the process of step St21. Note that the biometric information acquisition device P2 or the biometric authentication device P3A determines whether the user's hand remains still within a predetermined time limit set in advance from the timing of acquiring the control command transmitted from the haptic generation device P1A. If it is determined whether or not the user's hand remains still within a predetermined time limit, the process may return to step St21.

As described above, the biometric authentication systems 100 and 100A according to the first embodiment and the modification of the first embodiment can present a tactile sensation when the user's hand is detected within the imaging area of the biometric information acquisition camera 34. With this, the user can be notified of the start of biometric authentication processing (that is, the start of imaging of the authentication site for biometric authentication). In other words, the user can understand where and when to stop the hand. Thereby, the biometric authentication systems 100 and 100A can more effectively suppress variations in the imaging position of the authentication site of the user who has received the tactile sense presentation, and therefore can capture an image for biometric authentication that is more suitable for biometric authentication.

Next, with reference to FIG. 18, the operating procedure of biometric authentication processing in the first embodiment and a modification of the first embodiment will be described. FIG. 18 is a flowchart showing a third example of the operation procedure of the biometric authentication system 100, 100A according to the first embodiment and a modification of the first embodiment. In addition, in the explanation of the flowchart shown in FIG. 18, each process from step St14 to step St18 is the same as each process from step St14 to step St18, which is the same process as in FIG. 8, so the description will be omitted. .

Operation procedure example 3 detects the position of the user's hand and moves the tactile presentation position based on the detected position of the user's hand, thereby placing the user's authentication site within the imaging area of the biometric information acquisition camera 34. The following describes the operating procedure for guiding the robot to its position.

The tactile sensation generation device P1A determines whether the ultrasonic transmitter 15 detects insertion of the user's hand into a region where tactile sensations can be generated (for example, the tactile presentation region ARU41 (see FIGS. 19 and 21)). (St31).

In the process of step St31, when the tactile sensation generating device P1A determines that insertion of the user's hand is detected (St31, YES), the tactile sensation generating device P1A detects the position of the user's palm (St32), and sets the detected user's palm to the focal position. , the ultrasonic transmitter 15 outputs a sound wave and presents a tactile sensation to the user's palm (St33). Here, the tactile sensation generation device P1A detects the position of the user's palm while detecting the focal position of the sound wave output by the ultrasound transmitter 15 (that is, the tactile sensation presentation position) in the imaging area of the biological information acquisition camera 34. (that is, the depth of field). Thereby, the biometric authentication system 100, 100A can guide the user's hand to the imaging area of the biometric information acquisition camera 34.

On the other hand, when the tactile sensation generating device P1A determines in the process of step St31 that insertion of the user's hand is not detected (St31, NO), the process returns to the process of step St31.

The tactile sensation generating device P1A is configured such that the detected position of the user's hand is within the imaging area of the biometric information acquisition camera 34 (within the depth of field of the lens, for example, the imaging area ARC42 (see FIGS. 19 and 21)), etc. ) is determined (St34).

If the tactile sensation generation device P1A determines in the process of step St34 that the detected position of the user's hand is within the imaging area of the biometric information acquisition camera 34 (St34, YES), the tactile sensation generation device P1A determines that the position of the user's hand is within the imaging area A control command notifying that the area is within the area is generated and transmitted to the biometric information acquisition device P2 or the biometric authentication device P3A.

If the tactile sensation generating device P1A determines in the process of step St34 that the detected position of the user's hand is not within the imaging area of the biometric information acquisition camera 34 (St34, NO), the tactile sensation generating device P1A returns to the process of step St33 and The focus position of the sound waves output by the sound wave transmitter 15 is moved toward the imaging area of the biological information acquisition camera 34 to guide the user's palm.

The biometric information acquisition device P2 or the biometric authentication device P3A starts imaging by the still detection camera 33 based on the control command transmitted from the tactile sensation generation device P1A. The biometric information acquisition device P2 or the biometric authentication device P3A further determines whether or not the detected stillness of the hand is detected based on the stillness detection image captured by the stillness detection camera 33 (St35). Note that the hand stillness here refers to a state in which the hand is stationary so that a biometric authentication image can be captured. Furthermore, the biometric information acquisition device P2 or the biometric authentication device P3A may detect that the user's authentication site is still.

When the biometric information acquisition device P2 or the biometric authentication device P3A determines in the process of step St35 that the detected stillness of the hand is detected (St35, YES), the biometric information acquisition device P2 or the biometric authentication device P3A performs the authentication used for biometric authentication by the biometric information acquisition camera 34. A part (for example, a fingertip, a palm, etc.) is imaged (St14).

On the other hand, when the biometric information acquisition device P2 or the biometric authentication device P3A determines in the process of step St35 that the detected stillness of the hand is not detected (St35, NO), the process returns to the process of step St31. Note that the biometric information acquisition device P2 or the biometric authentication device P3A determines whether the user's hand remains still within a predetermined time limit set in advance from the timing of acquiring the control command transmitted from the haptic generation device P1A. If it is determined whether or not the user's hand remains still within a predetermined time limit, the process may return to step St31.

As described above, the biometric authentication systems 100 and 100A according to the first embodiment and the modification of the first embodiment detect the position of the user's palm, and the position ( In other words, by moving the tactile presentation area), the user's palm can be guided into the imaging area of the biological information acquisition camera 34. In other words, the user can intuitively understand where to move the hand by moving the palm in accordance with the presentation position of the tactile sense. Thereby, the biometric authentication systems 100 and 100A can more effectively suppress variations in the imaging position of the authentication site of the user who has received the tactile sense presentation, and therefore can capture an image for biometric authentication that is more suitable for biometric authentication.

Next, a fifth example of acquiring an image for biometric authentication will be described with reference to FIGS. 19 and 20, respectively. FIG. 19 is a diagram illustrating a fifth example of acquiring a biometric authentication image. FIG. 20 is a diagram illustrating a fourth example of acquiring an image for biometric authentication. In addition, in FIGS. 19 and 20, in order to make the explanation easier to understand, only the main parts of the tactile sense generation device P1A and the biometric information acquisition devices P2 and P2A in the biometric authentication systems 100 and 100A are illustrated.

Here, the relationship between the tactile presentation area ARU42 and the imaging area ARC42 in the examples shown in FIGS. 19 and 20 will be explained.

In the fifth acquisition example shown in FIGS. 19 and 20, the biological part and the authentication part are the same, and by presenting a tactile sensation on the palm, which is the biological part, and capturing an image of the palm, which is the authentication part, the biological information Obtain palm prints, veins, etc.).

The ultrasound transmitter 15 in the fifth acquisition example presents the tactile sensation in the tactile sensation presentation area ARU42 within the tactile sensation presentation possible area ARU41, within the haptic movement area ARC43, and within the imaging area of the biological information acquisition camera 34. . The tactile movement area ARC43 is an area in which the presentation position of the tactile presentation area ARU42 can be changed from the insertion detection position of the user's hand to the imaging position. The tactile presentation area ARU42 is generated within the tactile movement area ARC43 and in the insertion direction D1 of the user's hand H1 (that is, the direction along the user's palm) based on the detected position of the user's palm.

The biological information acquisition camera 34 in the fifth acquisition example images the palm located in the imaging area ARC42 within the viewing angle ARC41. The imaging area ARC42 is an area included in the focused area (that is, the depth of field) of the lens (not shown) of the biometric information acquisition camera 34, and is also included in the tactile presentation possible area ARU41. Further, the height H41 of the imaging area ARC42 is set to fall within the height H42 of the tactile presentation possible area ARU41 in the Z direction (that is, height H41<height H42). Further, the height H43 of the tactile movement area ARC43 described above is set to fall within the height H41 of the imaging area ARC42 (that is, height H43<height H41).

In the fifth acquisition example, the user inserts the hand H1 from the insertion direction D1. The tactile sensation generation device P1A includes a hand insertion detection section 13A on the opposite side of the biological information acquisition camera 34 with the ultrasound transmission section 15 in between. The hand insertion detection unit 13A is capable of detecting insertion of the user's hand and has a detection area ART41 that is wider than the viewing angle ARC41 of the biometric information acquisition camera 34. The tactile sensation generation device P1A detects the position of the user's palm at the timing when the insertion of the user's hand H1 is detected by the hand insertion detection unit 13A, and performs coordinate-distance conversion on the detected position (coordinates) of the user's palm. 115.

The tactile sensation generating device P1A converts the distance between the position (coordinates) of the user's palm and the ultrasound transmitting unit 15 (that is, each of the plurality of ultrasound elements 16A to 16kN) and biological information using the coordinate-distance conversion unit 115. Sound waves are output based on the imaging area ARC42 of the acquisition camera 34. The tactile sensation generation device P1A detects the position of the user's palm and presents a tactile sensation corresponding to the detected position of the user's palm when the user's palm is located within the imaging area ARC42 of the biometric information acquisition camera 34. Repeat until . When the tactile sensation generation device P1A determines that the user's hand is located within the imaging area ARC42 of the biometric information acquisition camera 34, the tactile sensation generation device P1A generates a control command and transmits it to the biometric information acquisition device P2 or the biometric authentication device P3A.

The biometric information acquisition device P2 or the biometric authentication device P3A causes the still detection camera 33 to image the authentication site (here, the palm) based on the control commands transmitted from the tactile sense generation devices P1 and P1A. When the biometric information acquisition device P2 or the biometric authentication device P3A determines that the authentication site is stationary based on the captured image output from the still detection camera 33, the biometric information acquisition device P2 or the biometric authentication device P3A sends the biometric information acquisition camera 34 to the imaging area ARC42. The located authentication site is imaged.

Thereby, the biometric authentication systems 100 and 100A according to the first embodiment and the modification of the first embodiment can guide the user's palm, which is the authentication site, to the imaging area ARC42 of the biometric information acquisition camera 34 using the sense of touch. I can do it. Therefore, the biometric authentication systems 100 and 100A can more effectively suppress variations in the imaging position by guiding the user's palm (authentication site) to the imaging area. Therefore, the biometric authentication system 100, 100A can more efficiently capture a biometric image suitable for biometric authentication and acquire biometric information.

Next, a sixth example of acquiring a biometric authentication image will be described with reference to FIGS. 21 and 22, respectively. FIG. 21 is a diagram illustrating a sixth example of acquiring an image for biometric authentication. FIG. 22 is a diagram illustrating a fourth example of acquiring a biometric authentication image. Note that in FIGS. 21 and 22, in order to make the explanation easier to understand, only the main parts of the tactile sense generation device P1A and the biometric information acquisition devices P2 and P2A in the biometric authentication systems 100 and 100A are illustrated. Furthermore, since the sixth acquisition example has the same configuration as the fifth acquisition example, the same configurations are given the same reference numerals and the description thereof will be omitted.

Here, the relationship between the tactile presentation area ARU52 and the imaging area ARC52 in the examples shown in FIGS. 21 and 22 will be described.

In the sixth acquisition example shown in FIGS. 21 and 22, the biological part and the authentication part are the same, and by presenting a tactile sensation to the palm, which is the biological part, and capturing an image of the palm, which is the authentication part, biological information (for example, Obtain palm prints, veins, etc.). Furthermore, the installation position of the hand insertion detection unit 13A in the sixth acquisition example is different from the installation position of the hand insertion detection unit 13A shown in the fifth acquisition example. In the sixth acquisition example, the hand insertion detection section 13A and the biological information acquisition camera 34 may be integrally configured.

The ultrasound transmitter 15 in the sixth acquisition example presents the tactile sensation in the tactile sensation presentation area ARU42 within the tactile sensation presentation possible area ARU41, within the haptic movement area ARC43, and within the imaging area of the biological information acquisition camera 34. . The tactile movement area ARC43 is an area in which the presentation position of the tactile presentation area ARU42 can be changed from the insertion detection position of the user's hand to the imaging position. The tactile presentation area ARU42 is generated within the tactile movement area ARC43 and in the insertion direction D1 of the user's hand H1 (that is, the direction along the user's palm) based on the detected position of the user's palm.

The biological information acquisition camera 34 in the sixth acquisition example images the palm located in the imaging area ARC42 within the viewing angle ARC41. The imaging area ARC42 is an area that is included in the focused area of the lens of the biological information acquisition camera 34 (that is, the depth of field) and is also included in the tactile presentation possible area ARU41. Further, the height H41 of the imaging area ARC42 is set to fall within the height H42 of the tactile presentation possible area ARU41 in the Z direction (that is, height H41<height H42). Further, the height H43 of the tactile movement area ARC43 described above is set to fall within the height H41 of the imaging area ARC42 (that is, height H43<height H41).

In the sixth acquisition example, the user inserts the hand H1 from the insertion direction D1. The tactile sensation generating device P1A includes a hand insertion detection unit 13A that is arranged adjacent to the biological information acquisition camera 34 in a direction substantially orthogonal to the user's hand insertion direction D1. The hand insertion detection unit 13A is capable of detecting insertion of the user's hand and has a detection area ART42 that is wider than the viewing angle ARC41 of the biometric information acquisition camera 34. The tactile sensation generation device P1A detects the position of the user's palm at the timing when the insertion of the user's hand H1 is detected by the hand insertion detection unit 13A, and performs coordinate-distance conversion on the detected position (coordinates) of the user's palm. 115.

As a result, in the biometric authentication systems 100 and 100A according to the first embodiment and the modification of the first embodiment, the detection region ART42 of the hand insertion detection section 13A and the imaging region ARC42 of the biometric information acquisition camera 34 are similar. Therefore, it is possible to further reduce the deviation between the position where the tactile sense is presented and the position where the biometric authentication image is captured.

In addition, the configuration of the sixth acquisition example allows the hand insertion detection section 13A and the biometric information acquisition camera 34 to be realized by one camera. In such a case, when the biometric authentication system 100, 100A implements the hand insertion detection unit 13A and the biometric information acquisition camera 34 by one camera, the biometric authentication system 100, 100A is configured to have a processor (specifically, a tactile sensation generating device P1A, a biometric information This facilitates control by the processor of either the acquisition device P2 or the biometric authentication device P3A.

As described above, the authentication device P0 (an example of a biological image acquisition device) according to the first embodiment has an ultrasonic transmitter 15 (an example of a tactile sense generator) that generates a tactile sense using sound waves in a tactile area in the air (an example of a predetermined position). an example), a biometric information acquisition camera 34 (an example of a camera) that captures an image of an authentication part (an example of a predetermined part) of the person to be authenticated located at a predetermined position, and an image taken by the biometric information acquisition camera 34. and a communication unit 30 that transmits the information to an external device that executes authentication processing of the person to be authenticated. Note that the computer here is realized by, for example, a device in which the tactile sense generation devices P1, P1A and the biological information acquisition device P2 are integrally configured.

As a result, in non-contact biometric authentication using the biometric information acquisition camera 34, the authentication device P0 according to the first embodiment uses tactile presentation using ultrasound to place the user in a position where a biometric authentication image can be captured. Authentication site can be guided. Thereby, the authentication device P0 can more effectively suppress variations in the imaging position of the authentication part, and therefore can capture an image for biometric authentication that is more suitable for biometric authentication.

Further, as described above, the ultrasonic transmitter 15 in the authentication device P0 according to the first embodiment is configured using a plurality of ultrasonic elements 16A to 16kN. In each of the plurality of ultrasonic elements 16A to 16kN, output parts that output sound waves are arranged on the same plane. As a result, the authentication device P0 according to the first embodiment can more easily control the sound waves output from each of the plurality of ultrasonic elements 16A to 16kN, and can effectively control the positional shift of the presentation (generation) position of the tactile sensation. can be suppressed.

Further, as described above, the ultrasonic transmitter 15 in the authentication device P0 according to the first embodiment generates a tactile sensation in a direction substantially parallel to the same plane (see FIGS. 9 to 10 and FIGS. 19 to 22). . Thereby, the authentication device P0 according to the first embodiment can more easily control the sound waves output from each of the plurality of ultrasonic elements 16A to 16kN. Furthermore, since the user can feel the tactile sensation on a wider surface such as the palm, it becomes easier for the user to intuitively understand where to place (stop) the hand.

Further, as described above, the ultrasonic transmitter 15 in the authentication device P0 according to the first embodiment generates a tactile sensation in a direction substantially perpendicular to the same plane (that is, in the Z-axis direction) (see FIGS. 11 and 12). . As a result, the authentication device P0 according to the first embodiment can present a tactile sensation to any part of the user's hand even if the insertion position of the user's hand varies in the height direction (Z-axis direction). Variations in the imaging position of the user's fingertip (authentication site) can be more effectively suppressed. In addition, even if the hand size, finger length, etc. differ from user to user, the authentication device P0 can indicate the position where the user's palm should be placed using the sense of touch, so it can eliminate variations in the imaging position of the user's fingertips (authentication site). It can be suppressed more effectively. Therefore, the authentication device P0 can more efficiently capture a biometric image suitable for biometric authentication and acquire biometric information.

Further, as described above, the ultrasonic transmitting unit 15 in the authentication device P0 according to the first embodiment can set a predetermined angle (specifically, 0 (zero) degrees or more and less than 90 degrees) with respect to the same plane. A tactile sensation is generated in the direction of the object (see FIGS. 13 and 14). As a result, the authentication device P0 according to the first embodiment determines the user's authentication site (i.e., When it is desirable to image the palm, fingertips, etc.) from a direction other than directly below, it is possible to present a tactile sensation at a predetermined angle corresponding to the depth of field or imaging direction of the biological information acquisition camera 34. Therefore, by presenting the tactile area at a predetermined angle to the ultrasound transmitting unit 15, the authentication device P0 can more efficiently capture a biometric image suitable for biometric authentication and acquire biometric information.

Further, as described above, the ultrasonic transmitter 15 in the authentication device P0 according to the first embodiment generates a tactile sensation outside the depth of field of the biometric information acquisition camera 34 (see FIGS. 9 to 12). Thereby, in the authentication device P0 according to the first embodiment, since the tactile sensation presentation area ARU12 and the imaging area ARC12 do not overlap, it is possible to image the fingertip while presenting the tactile sensation to the user's palm.

Further, as described above, the ultrasonic transmitting unit 15 in the authentication device P0 according to the first embodiment generates a tactile sensation within the depth of field of the biometric information acquisition camera 34 (FIGS. 13 to 16, and FIGS. 19 to 16). (See Figure 22). With this, the authentication device P0 according to Embodiment 1 determines the position where the user's palm is held up using the tactile sense when the biological part presenting the tactile sense and the authentication part imaged by the biometric information acquisition camera 34 are the same. By imaging a stationary palm at the position (area) where the tactile sensation is presented, variations in the imaging position of the user's palm (authentication site) can be more effectively suppressed.

Further, as described above, the authentication device P0 according to the first embodiment detects the entry of the hand of the person to be authenticated into the tactile sense generation possible area (an example of the tactile sense generation area) where the ultrasonic wave transmitter 15 can generate a tactile sense. It further includes hand insertion detection units 13 and 13A (an example of a detection unit) and processors 11 and 11A (an example of an instruction unit) that cause the ultrasonic transmission unit 15 to generate a tactile sensation. When hand insertion detection units 13 and 13A determine that entry of a hand into the tactile sense generation possible area is detected, they output a control command to the processors 11 and 11A to the effect that entry of the hand has been detected. The processors 11 and 11A cause the ultrasound transmitter 15 to generate a tactile sensation based on the control command. Thereby, the authentication device P0 according to the first embodiment can suppress power consumption by constantly generating a tactile sensation by the ultrasonic transmitter 15.

Furthermore, as described above, the authentication device P0 according to the first embodiment includes the hand insertion detection unit 13A that detects the entry of the authentication part of the person to be authenticated into the tactile sense generation possible area where the ultrasonic wave transmission unit 15 can generate a tactile sense. , a processor 11A that causes the ultrasonic transmitter 15 to generate a tactile sensation. If the hand insertion detection unit 13A determines that entry of the authentication part into the tactile sense generation possible area is detected, it outputs a control command to the processor 11A indicating that entry of the predetermined part has been detected. The processor 11A causes the ultrasonic transmitter 15 to generate a tactile sensation based on the control command. Thereby, in the authentication device P0 according to the first embodiment, when the biological part presenting the tactile sensation and the authentication part imaged by the biological information acquisition camera 34 are the same, the user's hand is By presenting a tactile sensation when detected within the imaging area of No. 34, it is possible to notify the user of the start of biometric authentication (that is, the start of imaging of the authentication site). In other words, the user can understand the position and timing at which the authentication part should be kept still. Thereby, the authentication device P0 can more effectively suppress variations in the imaging position of the authentication part of the user who has received the tactile sense presentation, and therefore can capture an image for biometric authentication that is more suitable for biometric authentication.

Further, as described above, the hand insertion detection unit 13A in the authentication device P0 according to the first embodiment measures the position of the detected authentication part (see FIGS. 19 to 22). The processor 11A determines a tactile area in which a tactile sensation is generated based on the measured position of the authentication site. The ultrasonic transmitter 15 generates a tactile sensation in the determined tactile area. Thereby, the authentication device P0 according to the first embodiment detects the position of the user's authentication part and moves the position where the tactile sense is presented (that is, the tactile sense presentation area) based on the detected position of the authentication part. By doing so, the user's authentication site can be guided into the imaging area of the biometric information acquisition camera 34. In other words, the user can intuitively understand where to move the hand by moving the palm in accordance with the presentation position of the tactile sense. Thereby, the authentication device P0 can more effectively suppress variations in the imaging position of the authentication part of the user who has received the tactile sense presentation, and therefore can capture an image for biometric authentication that is more suitable for biometric authentication.

Further, as described above, the processor 11 in the authentication device P0 according to the first embodiment determines that the position of the detected authentication part is within the depth of field (that is, within the imaging area) of the biometric information acquisition camera 34. In this case, the biometric information acquisition camera 34 is caused to image the authentication site. As a result, the authentication device P0 according to the first embodiment captures an image with the biometric information acquisition camera 34 at the timing when it is determined that the user's authentication part is located within the imaging area, thereby providing a biometric authentication device more suitable for biometric authentication. Images can be taken.

Further, as described above, when the processor 11A in the authentication device P0 according to the first embodiment determines that the position of the detected authentication site is not within the depth of field of the biometric information acquisition camera 34, the processor 11A in the authentication device P0 according to the first embodiment Based on the position of , determine the next haptic region where the haptic sensation will be generated. The ultrasonic transmitter 15 generates a tactile sensation in the determined next tactile area. Thereby, the authentication device P0 according to the first embodiment detects the position of the user's authentication part and moves the position where the tactile sense is presented (that is, the tactile sense presentation area) based on the detected position of the authentication part. By doing so, the user's authentication site can be guided into the imaging area of the biometric information acquisition camera 34.

Further, as described above, the authentication device P0 according to the first embodiment has the stillness detection camera 33 (still (an example of a detection unit). When the stillness detection camera 33 determines that the authentication site is stationary, it causes the biometric information acquisition camera 34 to image the authentication site. Thereby, the authentication device P0 according to the first embodiment can capture an image for biometric authentication more suitable for biometric authentication by capturing an image using the biometric information acquisition camera 34 at the timing when the stationary state of the authentication part is detected.

Although various embodiments have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is clear that those skilled in the art can come up with various changes, modifications, substitutions, additions, deletions, and equivalents within the scope of the claims, and It is understood that it falls within the technical scope of the present disclosure. Further, each of the constituent elements in the various embodiments described above may be arbitrarily combined without departing from the spirit of the invention.

The present disclosure is useful as a presentation of a biometric image acquisition device and a biometric image acquisition method that can suppress variations in imaging conditions of a biometric authentication site in non-contact biometric authentication using a camera.

11, 11A, 31, 41, 41A Processor 13, 13A Hand insertion detection section 15 Ultrasonic transmission section 33 Still detection camera 34 Biometric information acquisition camera 100, 100A Biometric authentication system 115 Coordinate-distance conversion section 311, 412 Hand detection Units 411, 411A Biometric information authentication unit DB Biometric information database MN, MNA Monitor P0 Authentication device P1, P1A Tactile sensation generation device P2, P2A Biometric information acquisition device P3, P3A Biometric authentication device

Claims (14)

a tactile sensation generation unit that generates a tactile sensation using sound waves at a predetermined position in the air;
a camera that images a predetermined part of the person to be authenticated located at the predetermined position;
a communication unit that transmits a captured image captured by the camera to an external device that executes authentication processing of the person to be authenticated;
Biological image acquisition device. The tactile sensation generation unit is configured using a plurality of ultrasonic elements,
In each of the plurality of ultrasonic elements, an output part that outputs the sound wave is arranged on the same plane.
The biological image acquisition device according to claim 1. The tactile sensation generation unit generates the tactile sensation in a direction substantially parallel to the same plane.
The biological image acquisition device according to claim 2. The tactile sensation generation unit generates the tactile sensation in a direction substantially perpendicular to the same plane.
The biological image acquisition device according to claim 2. The tactile sensation generation unit generates the tactile sensation in a direction having a predetermined angle with respect to the same plane.
The biological image acquisition device according to claim 2. The tactile sensation generation unit generates the tactile sensation outside the depth of field of the camera.
The biological image acquisition device according to claim 1. The tactile sensation generation unit generates the tactile sensation within the depth of field of the camera.
The biological image acquisition device according to claim 1. a detection unit that detects entry of the person's hand into a tactile generation area in which the tactile sensation generation unit can generate the tactile sensation;
further comprising an instruction unit that causes the tactile sensation generation unit to generate the tactile sensation,
When the detection unit determines that the entry of the hand into the tactile sense generation area is detected, the detection unit outputs a control command to the instruction unit to the effect that entry of the hand has been detected;
The instruction unit causes the tactile sensation generation unit to generate the tactile sensation based on the control command.
The biological image acquisition device according to claim 1. a detection unit that detects entry of a predetermined part of the person to be authenticated into a tactile sense generation area in which the tactile sense generation unit can generate the tactile sense;
further comprising an instruction unit that causes the tactile sensation generation unit to generate the tactile sensation,
When the detection unit determines that entry of the predetermined part into the tactile sensation generation area is detected, outputs a control command to the instruction unit to the effect that entry of the predetermined part is detected;
The instruction unit causes the tactile sensation generation unit to generate the tactile sensation based on the control command.
The biological image acquisition device according to claim 1. The detection unit measures the detected position of the predetermined region,
The instruction unit determines the predetermined position where the tactile sensation is generated based on the measured position of the predetermined part,
The tactile sensation generation unit generates the tactile sensation at the determined predetermined position.
The biological image acquisition device according to claim 9. The instruction unit causes the camera to image the predetermined region when determining that the detected position of the predetermined region is within the depth of field of the camera;
The biological image acquisition device according to claim 10. If the instruction unit determines that the detected position of the predetermined part is not within the depth of field of the camera, the instruction unit determines the next predetermined position where the tactile sensation is generated based on the measured position of the predetermined part. decide,
the tactile sensation generation unit generates the tactile sensation at the determined next predetermined position;
The biological image acquisition device according to claim 10. further comprising a stillness detection unit that detects whether the predetermined part located within the depth of field of the camera is stationary;
The stationary state detection unit causes the camera to image the predetermined region when determining that the predetermined region is stationary.
The biological image acquisition device according to claim 1. A biological image acquisition method performed by a biological image acquisition device comprising one or more computers, the method comprising:
Generates a tactile sensation using sound waves at a predetermined location in the air,
imaging a predetermined part of the person to be authenticated located at the predetermined position;
transmitting the captured image to an external device that executes authentication processing of the person to be authenticated;
How to obtain biological information.

Images