JP6964527B2 - Authentication system, authentication device, authentication program, and authentication method - Google Patents

Description

The present invention relates to an authentication system, an authentication device, an authentication program, and an authentication method.

In vein authentication, which is personal authentication using veins of fingers and palms, one-to-N authentication is used in which photographed veins are collated with a plurality of registered data. When one-to-N authentication is used, there is an advantage that the user does not need to carry an IC card or store an identification code.

As a related technique, a technique has been proposed in which face recognition is performed before 1-to-N finger vein recognition to reduce the number of comparisons of finger vein recognition (see, for example, Patent Document 1).

Further, as a related technique, a technique has been proposed in which the authentication process is divided into several stages and a certain amount of registered data is excluded from the authentication target at each stage (see, for example, Patent Document 2).

Further, as a related technique, a technique has been proposed in which service provision history information is filtered, identification information matching the conditions is extracted, and the extracted identification information is preferentially authenticated (see, for example, Patent Document 3). ..

Japanese Unexamined Patent Publication No. 2007-154472 JP-A-2010-244287 JP-A-2010-244365

In one-to-N authentication, as the number of registered data (N) increases, the time required for the vein authentication process increases. For example, even if the techniques disclosed in Patent Documents 1 to 3 are used, as the number of registered data increases, the time required for the vein authentication process increases, which makes the user who performs the vein authentication wait. There are challenges.

As one aspect, the present invention aims to reduce the processing time for vein authentication.

In one embodiment, the authentication system includes a first photographing device that photographs a person's face, and a second photographing device that is installed at a position separated from the photographing range of the first photographing device by a predetermined distance and photographs the veins of the person. , The first photographing device and an authentication device capable of communicating with the second photographing device. The authentication device acquires a face image from the first photographing device, acquires a vein image from the second photographing device, extracts face authentication data used for face authentication from the face image, and extracts the vein image. An extraction unit that extracts vein authentication data used for vein authentication from, and a face authentication unit that executes face authentication based on the extracted face authentication data and a plurality of pre-registered face authentication registration data. A vein that executes venous authentication based on the venous authentication data and the venous authentication registration data corresponding to the face authentication registration data that has been successfully authenticated by the face authentication among a plurality of pre-registered venous authentication registration data. Includes certification unit.

According to one aspect, the processing time for vein authentication can be reduced.

It is a figure which shows the whole structure of the authentication system in 1st Embodiment. It is a functional block diagram of the authentication apparatus in 1st Embodiment. It is a figure which shows the authentication information. It is a figure which shows the authentication candidate. It is a flowchart which shows the flow of face recognition processing. It is a flowchart which shows the flow of the vein authentication processing. It is a figure which shows the whole structure of the authentication system in 2nd Embodiment. It is a functional block diagram of the authentication apparatus in 2nd Embodiment.

<First Embodiment>
Hereinafter, the first embodiment will be described with reference to the drawings. FIG. 1 is a diagram showing an overall configuration of an authentication system according to the first embodiment.

FIG. 1 shows stores such as convenience stores. In the store, the first photographing device 1a is installed at a position where the vicinity of the entrance of the store can be photographed. In addition, a second imaging device 2a used for vein authentication is installed at a counter in the store located a predetermined distance from the entrance. That is, the second photographing device 2a is installed at a position separated from the photographing range of the first photographing device 1a by a predetermined distance.

The first photographing device 1a photographs the face of a person (user 4a) who enters the store from the entrance of the store by photographing the vicinity of the entrance of the store at a predetermined cycle, and generates a face image. The first photographing device 1a can communicate with the authentication device 3a, and transmits the generated face image to the authentication device 3a. The first photographing device 1a may be, for example, a surveillance camera installed in advance in a store.

The authentication device 3a executes one-to-N face authentication based on the face image and a plurality of face authentication registration data registered in advance. The authentication device 3a is an example of a computer.

After entering the store from the entrance and selecting a product, the user 4a holds his / her palm over the second photographing device 2a at the counter and makes a payment using vein authentication.

The second photographing device 2a is, for example, a CMOS (Complementary Metal Oxide Semiconductor) camera provided with a filter that blocks visible light, a CCD (Charge Coupled Device) camera, or the like. The second imaging device 2a has an irradiation unit (not shown) that irradiates near-infrared light, and when it detects that the palm is placed, it irradiates the palm with near-infrared light. The irradiation unit is, for example, an LED (Light Emitting Diode) capable of irradiating light in the wavelength range of near infrared light.

The second imaging device 2a photographs the veins of the palm irradiated with near-infrared light, and generates a vein image in which the veins of the palm of the user 4a are captured. The second photographing device 2a can communicate with the authentication device 3a, and transmits the generated vein image to the authentication device 3a. The vein image captured by the second imaging device 2a may be a finger vein image.

When the authentication device 3a acquires a vein image from the second imaging device 2a, the authentication device 3a performs 1-to-N vein authentication based on the vein authentication registration data narrowed down by face authentication among a plurality of vein authentication registration data registered in advance. To execute. It is conceivable that a predetermined time has passed due to the selection or movement of the product between the time when the user 4a enters the store and the time when the payment is made. Therefore, it is assumed that the face authentication of the user 4a is completed at the time when the authentication device 3a performs the vein authentication of the user 4a.

The display device 5a displays the result of vein authentication output by the authentication device 3a. When the clerk 6 confirms that the authentication is successful by referring to the display device 5a, the clerk 6 executes the payment process.

As described above, since the authentication system executes one-to-N vein authentication for the vein authentication registration data narrowed down by face authentication, the processing time of the vein authentication can be reduced.

FIG. 2 is a functional block diagram of the authentication device 3a. The authentication device 3a includes an acquisition unit 10, an extraction unit 11, an authentication information DB 12a, an authentication candidate DB 12b, a face authentication unit 13, a vein authentication unit 14, a first setting unit 15, and an output unit 16.

The acquisition unit 10 acquires a face image from the first imaging device 1a and acquires a vein image from the second imaging device 2a.

The extraction unit 11 extracts face recognition data used for face recognition from the face image acquired by the acquisition unit 10. In addition, the extraction unit 11 extracts vein authentication data used for vein authentication from the vein image acquired by the acquisition unit 10.

The authentication information DB 12a stores authentication information including a plurality of face authentication registration data used for face authentication, a plurality of vein authentication registration data used for vein authentication, and the like. The details of the authentication information will be described later.

The authentication candidate DB 12b stores the authentication candidate in which the vein authentication registration data is associated with the shooting date and time of the face image. The details of the authentication candidates will be described later.

The face recognition unit 13 executes face recognition based on the face recognition data extracted by the extraction unit 11 and a plurality of face recognition registration data registered in advance in the authentication information DB 12a. Of the vein authentication registration data stored in the authentication information DB 12a, the face authentication unit 13 associates the vein authentication registration data associated with the face authentication registration data that has succeeded in face authentication with the shooting date and time of the face image. Is stored in the authentication candidate DB 12b.

The vein authentication unit 14 corresponds to the vein authentication data extracted by the extraction unit 11 and the face authentication registration data that has been successfully authenticated by face authentication among a plurality of vein authentication registration data registered in advance in the authentication information DB 12a. Perform vein recognition based on the registration data. For example, the vein authentication unit 14 acquires the vein authentication registration data associated with the shooting date and time of the facial image in the past predetermined time zone among the vein authentication registration data stored in the authentication candidate DB 12b. Then, the vein authentication unit 14 executes the vein authentication based on the vein authentication data extracted by the extraction unit 11 and the vein authentication registration data acquired from the authentication candidate DB 12b.

The first setting unit 15 calculates the difference between the shooting date and time of the past face image stored in the authentication information DB 12a and the date and time of vein authentication corresponding to the shooting date and time of the past face image for each person, and the difference. The start time of the above-mentioned predetermined time zone used for controlling vein authentication is set based on the average value of.

The output unit 16 outputs the authentication result of the vein authentication unit 14. The output unit 16 transmits, for example, the authentication result of the vein authentication unit 14 to the display device 5a, and causes the display device 5a to display the authentication result. The output unit 16 may transmit, for example, the authentication result of the vein authentication unit 14 to an information processing device (not shown) or the like.

The authentication device 3a has a processor, a memory, and an auxiliary storage device. The memory is, for example, RAM (Random Access Memory). The auxiliary storage device is, for example, a ROM (Read Only Memory) or an HDD (Hard Disc Drive). Memory and auxiliary storage are both examples of computer-readable tangible storage media. These tangible storage media are not temporary media such as signal carriers.

The acquisition unit 10, the extraction unit 11, the face authentication unit 13, the vein authentication unit 14, the first setting unit 15, and the output unit 16 in the authentication device 3a are realized by executing the authentication program expanded in the memory by the processor. NS. The authentication information DB 12a and the authentication candidate DB 12b are stored in, for example, an auxiliary storage device.

The authentication device 3a has a communication interface. The acquisition unit 10 acquires a face image and a vein image via a communication interface. Further, the output unit 16 outputs the authentication result to the display device 5a, the information processing device, or the like via the communication interface.

FIG. 3 is a diagram showing an example of authentication information. The authentication information shown in FIG. 3 is information stored in the authentication information DB 12a, and includes various attribute information regarding the user 4a.

The authentication information includes the ID (Identification) of the user 4a, the name, the face authentication registration data, the vein authentication registration data, the gender, the age, the date and time when the last face image was taken, and the date and time of the last authentication.

The ID, name, face authentication registration data, vein authentication registration data, gender and age of the user 4a are recorded, for example, when the user 4a registers for use at the store. The ID is given as identification information of the user 4a by, for example, the manager on the store side. For the name, gender and age, the information applied by the user 4a is recorded.

The face authentication registration data and the vein authentication registration data are generated in advance based on the face image and the vein image taken when the user 4a performs the usage registration. The face recognition registration data and the vein recognition registration data are numerical data including, for example, the positions of feature points in an image, the distance between feature points, and the like.

The final face image shooting date and time is the date and time when the user 4a was last shot by the first shooting device 1a. That is, the last face image shooting date and time is the date and time when the user 4a last entered the store. For example, when the face recognition unit 13 confirms that the user 4a has entered the store by face recognition, the face recognition unit 13 records the shooting date and time assigned to the face image as the final face image shooting date and time.

The final authentication date and time is the date and time when the vein authentication unit 14 finally executed the vein authentication and succeeded in the authentication. When the vein authentication unit 14 executes the vein authentication and the authentication is successful, the vein authentication unit 14 records the authentication date and time as the final authentication date and time.

The first setting unit 15 calculates the difference between the final authentication date and time and the final face image shooting date and time of all users 4a with reference to the authentication information shown in FIG. 3, and calculates the average value of the differences. The average value is an estimated value of the time from when the user 4a enters the store to when the vein authentication is performed. Then, the first setting unit 15 sets the start time of the predetermined time zone used for the control of the vein authentication unit 14 based on the calculated average value. For example, the first setting unit 15 sets the start time of the predetermined time zone to 30 seconds before the time obtained by subtracting the above average value from the date and time when the vein authentication is started. Further, the range of the predetermined time zone is, for example, 1 minute.

FIG. 4 is a diagram showing an example of authentication candidates. The authentication candidate is information stored in the authentication candidate DB 12b. As shown in FIG. 4, the authentication candidate is information in which the ID, the vein authentication registration data, and the face image shooting date and time are associated with each other.

As described above, the face recognition unit 13 executes the face recognition process based on the extracted face recognition data and the plurality of face recognition registration data in the authentication information DB 12a. Then, the face recognition unit 13 acquires the ID associated with the face recognition registration data that has been successfully authenticated and the vein recognition registration data from the authentication information DB 12a among the plurality of face recognition registration data. The face recognition unit 13 stores the ID and the vein recognition registration data acquired from the authentication information DB 12a in the authentication candidate DB 12b as authentication candidates in association with the shooting date and time of the face image used for face recognition.

FIG. 5 is a flowchart showing the flow of face recognition processing. The face recognition process shown in FIG. 5 is executed, for example, in the same predetermined cycle as the shooting cycle of the first shooting device 1a. Further, a plurality of face recognition processes may be executed in parallel.

The acquisition unit 10 acquires a face image obtained by photographing the first photographing apparatus 1a (step S101). The extraction unit 11 extracts the face authentication data used for face authentication from the face image acquired by the acquisition unit 10 (step S102). The face recognition data is, for example, numerical data including the positions of feature points in a face image, the distance between feature points, and the like. When the acquisition unit 10 acquires a plurality of face images, the extraction unit 11 extracts face recognition data used for face recognition for each face image.

The face recognition unit 13 executes one-to-N face recognition based on the extracted face recognition data and all the face recognition registration data stored in the authentication information DB 12a (step S103).

The face recognition unit 13 collates, for example, the face recognition data extracted in step S102 with all the face recognition registration data stored in the authentication information DB 12a, and the face matching the face recognition data extracted in step S102. It is determined whether the authentication registration data exists in the authentication information DB 12a. The face authentication unit 13 determines that the authentication is successful if the matching face authentication registration data exists, and determines that the authentication is unsuccessful if the matching face authentication registration data does not exist.

When the authentication is successful (YES in step S104), the face authentication unit 13 is associated with the vein authentication registration data associated with the successfully authenticated face authentication registration data among the vein authentication registration data stored in the authentication information DB 12a. The data is stored in the authentication candidate DB 12b in association with the shooting date and time of the face image acquired by the acquisition unit 10 in step S101 (step S105).

When the authentication fails (NO in step S104), or after the process of step S105, the face recognition unit 13 determines whether the face recognition of all the faces in the image acquired by the acquisition unit 10 is completed (step S106). .. If YES in step S106, the process ends. If NO in step S106, the process proceeds to step S103.

By performing the above processing, the authentication candidates shown in FIG. 4 are accumulated in the authentication candidate DB 12b. Since the user 4a shown in FIG. 1 selects and moves products between the time he / she enters the store and the time when the payment is made, the face recognition process is performed when the user 4a performs vein authentication for payment. Is assumed to have been completed.

FIG. 6 is a flowchart showing the flow of vein authentication processing.
The acquisition unit 10 acquires a vein image from the second imaging device 2a (step S201). The acquisition unit 10 periodically accesses the second imaging device 2a, for example, and acquires the vein image when a new vein image is captured.

The extraction unit 11 extracts the vein authentication data used for vein authentication from the vein image acquired by the acquisition unit 10 (step S202). The vein authentication data is, for example, numerical data including the position of the feature point in the vein image, the distance between the feature points, and the like.

The vein recognition unit 14 acquires the vein recognition registration data associated with the date and time when the face image was taken in the past predetermined time zone from the authentication candidate DB 12b (step S203). That is, the finger vein recognition unit 14 acquires the finger vein recognition registration data corresponding to the face recognition registration data that has succeeded in the face recognition processing for the face image taken in the past predetermined time zone. The vein authentication registration data acquired by the vein authentication unit 14 in step S203 may be a plurality of data.

The vein authentication unit 14 executes one-to-N vein authentication based on the vein authentication data extracted in step S202 and the vein authentication registration data acquired from the authentication candidate DB 12b in step S203 (step S204). That is, the vein authentication unit 14 is based on the extracted vein authentication data and the vein authentication registration data corresponding to the face authentication registration data that has been successfully authenticated by face authentication among a plurality of pre-registered vein authentication registration data. Perform finger vein recognition.

In step S204, the vein authentication unit 14 collates, for example, the extracted vein authentication data with each vein authentication registration data acquired from the authentication candidate DB 12b. Then, the vein authentication unit 14 determines that the authentication was successful if the vein authentication registration data matching the extracted vein authentication data exists in the authentication candidate DB 12b, and if the matching vein authentication registration data does not exist, the authentication is performed. Judge that it failed.

It is assumed that the vein authentication registration data in the authentication candidate DB 12b used for the vein authentication in step S204 is smaller than the vein authentication registration data in the authentication information DB 12a. Therefore, the vein authentication unit 14 can reduce the time required for authentication by performing 1-to-N authentication using each vein authentication registration data acquired from the authentication candidate DB 12b.

When the vein authentication unit 14 succeeds in authentication (YES in step S205), the output unit 16 outputs the authentication result (step S209). For example, the output unit 16 causes the display device 5a to display a message indicating that the authentication is successful.

When the vein authentication unit 14 fails in the authentication (NO in step S205), the finger vein authentication registration data corresponding to the time zone immediately before the face image taking time zone corresponding to the vein authentication registration data used for the authentication in step S204 is displayed. It is determined whether or not it exists in the authentication candidate DB 12b (step S206). For example, when the width of the time zone is 1 minute and the face image shooting time zone corresponding to the vein recognition registration data used in step S204 is 9:05: 00 to 9:05:59, the time immediately before the above. The band will be from 9:04: 00 to 9:04:59.

When the vein authentication unit 14 determines that the authentication candidate DB 12b has the vein authentication registration data corresponding to the time zone immediately before (YES in step S206), the finger vein authentication unit 14 corresponds to the face image shooting date and time in the time zone immediately before the above. The registration data is acquired from the authentication candidate DB 12b (step S207).

In steps S206 and S207, the finger vein authentication unit 14 obtains the finger vein authentication registration data corresponding to the face image taking time zone in the time zone immediately after the face image taking time zone corresponding to the vein authentication registration data used for authentication in step S204. It may be acquired from the authentication candidate DB 12b. For example, when the width of the time zone is 1 minute and the facial image shooting time zone corresponding to the vein recognition registration data used in step S204 is 9:05: 00 to 9:05:59, the time immediately after the above. The band will be from 9:06:00 to 9:06:59.

After the processing of step S207, the process returns to step S204, and the vein authentication unit 14 returns to the vein based on the vein authentication data extracted by the extraction unit 11 in step S202 and the vein authentication registration data newly acquired from the authentication candidate DB 12b in step S207. Authentication is executed (step S204).

When the vein authentication unit 14 determines that the authentication candidate DB 12b does not have the vein authentication registration data corresponding to the time zone immediately before the above (NO in step S206), the vein authentication unit 14 authenticates with the vein authentication data extracted by the extraction unit 11 in step S202. The finger vein authentication is executed based on all the finger vein authentication registration data in the information DB 12a (step S208). For example, the vein authentication unit 14 collates the vein authentication data extracted by the extraction unit 11 with all the vein authentication registration data in the authentication information DB 12a to determine whether they match. If the vein authentication registration data matching the vein authentication data extracted by the extraction unit 11 exists in the authentication information DB 12a, the vein authentication unit 14 determines that the authentication is successful, and the matching vein authentication registration data exists. If not, it is determined that the authentication has failed.

After the process of step S208, the output unit 16 outputs the authentication result based on the authentication result in step S208 (step S209). For example, the output unit 16 causes the display device 5a to display a message indicating that the authentication was successful or a message indicating that the authentication has failed as an authentication result.

In the example shown in FIG. 6, the authentication device 3a repeats the processes of steps S204 to S207 until the result becomes NO in step S206, but the processes of steps S204 to S207 may be repeated a predetermined number of times. ..

In the authentication system of the present embodiment, as shown in FIG. 1, since the imaging range of the first imaging device 1a for photographing the face and the second imaging device 2a for photographing the vein are separated by a predetermined distance, the vein authentication is started. It is possible to secure the execution time of face recognition by. Then, since the authentication device 3a executes 1 to N vein authentication for the vein authentication registration data narrowed down by face authentication, when executing 1 to N vein authentication for all the vein authentication registration data. Compared with, the processing time of vein recognition can be reduced.

<Second embodiment>
Hereinafter, the second embodiment will be described with reference to the drawings. The description of the same configuration as that of the first embodiment will be omitted.

FIG. 7 is a diagram showing an overall configuration of the authentication system according to the second embodiment. FIG. 7 shows the door 7 and the passage 8 through which the user 4b toward the door 7 passes. The first photographing device 1b is installed at a position where a predetermined range of the passage 8 can be photographed. Further, the second photographing device 2b is provided in the vicinity of the door 7. Further, it is assumed that the photographing range of the first photographing device 1b and the second photographing device 2b are separated from each other by a predetermined distance.

The first photographing device 1b photographs a person (user 4b) passing through the passage 8 toward the second photographing device 2b to generate a face image. The first photographing device 1b can communicate with the authentication device 3b, and transmits the generated face image to the authentication device 3b. The first photographing device 1b may be, for example, a surveillance camera installed in advance in the passage 8.

The authentication device 3b executes face authentication based on the face image and a plurality of face authentication registration data registered in advance. The authentication device 3b is an example of a computer.

After passing through the imaging range of the first imaging device 1b, the user 4b holds his palm over the second imaging device 2b to unlock the door 7, and performs personal authentication by vein authentication.

The second imaging device 2b photographs the veins of the palm irradiated with near-infrared light, and generates a vein image in which the veins of the palm of the user 4b are captured. The second photographing device 2b can communicate with the authentication device 3b, and transmits the generated vein image to the authentication device 3b. It is assumed that the function and configuration of the second photographing device 2b are the same as those of the second photographing device 2a in the first embodiment.

When the authentication device 3b acquires the vein image from the second imaging device 2b, the authentication device 3b executes the vein authentication based on the vein authentication registration data narrowed down by face authentication among the plurality of vein authentication registration data registered in advance. If the authentication device 3b succeeds in authentication, the authentication device 3b transmits an unlocking instruction to the door 7.

It is considered that a predetermined time has elapsed from the passage of the user 4b through the photographing range of the first photographing device 1b to the arrival at the second photographing device 2b. Therefore, it is assumed that the face authentication of the user 4b is completed when the authentication device 3b performs the vein authentication of the user 4b.

The display device 5b displays the result of vein authentication output by the authentication device 3b. The user 4b can know whether the authentication is successful by referring to the display device 5b.

In the example shown in FIG. 7, for example, the installation position of the first photographing device 1b is changed according to the processing capacity of the authentication device 3b and the number of registered users 4b, and the photographing range of the first photographing device 1b is set. You may change it. The higher the processing capacity of the authentication device 3b, the shorter the processing time for face recognition. Therefore, the first photographing device 1b may be installed near the door 7. Further, as the number of registered users 4b is smaller, the processing time for face recognition is shorter, so that the first photographing device 1b may be installed near the door 7.

As described above, since the authentication device 3b executes the vein authentication by the one-to-N authentication for the vein authentication registration data narrowed down by the face authentication, the processing time of the vein authentication can be reduced.

FIG. 8 is a functional block diagram of the authentication device 3b according to the second embodiment. The authentication device 3b shown in FIG. 8 is different from the authentication device 3a of the first embodiment shown in FIG. 2 in that a second setting unit 17 is included instead of the first setting unit 15.

The second setting unit 17 in the second embodiment is a vein authentication unit 14 based on the distance S between the imaging range of the first imaging device 1b and the second imaging device 2b and the estimated value V of the walking speed of the person. Set the start time of the predetermined time zone used for the processing of. For example, the distance S between the portion of the imaging range of the first imaging device 1b that is closest to the second imaging device 2b and the second imaging device 2b is defined as the distance S. The second setting unit 17 sets the start time of the predetermined time zone based on, for example, the following formula. It is assumed that T is, for example, 30 seconds, and the time width of the predetermined time zone is, for example, 1 minute.
Start time of predetermined time zone = current time- (distance S ÷ estimated walking speed V) -T

The calculation result of (distance S ÷ estimated walking speed V) indicates an estimated value of the time from the photographing range of the first photographing device 1b to the arrival of the second photographing device 2b by the user 4b. It is assumed that the distance S between the photographing range of the first photographing device 1b and the second photographing device 2b and the estimated value V of the walking speed of the person are set in advance by the administrator.

Since the authentication information and the authentication candidate in the second embodiment are the same as the authentication information and the authentication candidate in the first embodiment shown in FIGS. 3 and 4, the description thereof will be omitted. The authentication information in the second embodiment may include the presence / absence of the access right to the door 7.

Further, since the face authentication process and the vein authentication process of the authentication device 3b in the second embodiment are the same as the processes shown in FIGS. 5 and 6, the description thereof will be omitted.

In the authentication system of the present embodiment, as shown in FIG. 7, since the imaging range of the first imaging device 1b for photographing the face and the second imaging device 2b for photographing the vein are separated by a predetermined distance, the vein authentication is started. It is possible to secure the execution time of face recognition by. Then, since the authentication device 3b executes one-to-N vein authentication for the vein authentication registration data narrowed down by face authentication, the processing time of the vein authentication can be reduced.

It should be noted that each of the above embodiments is not limited to the configurations described above, and various configurations can be applied within a range that does not deviate from the gist of each embodiment.

1a, 1b 1st imaging device 2a, 2b 2nd imaging device 3a, 3b Authentication device 4a, 4b User 5a, 5b Display device 6 Clerk 7 Door 8 Passage 10 Acquisition unit 11 Extraction unit 12a Authentication information DB
12b Authentication candidate DB
13 Face recognition unit 14 Vein authentication unit 15 1st setting unit 16 Output unit 17 2nd setting unit

Claims (8)

A first imaging device that photographs a person's face, a second imaging device that is installed at a predetermined distance from the imaging range of the first imaging device and photographs a person's veins, the first imaging device, and the first imaging device. 2 An authentication system equipped with a photographing device and an authentication device capable of communicating.
The authentication device is
An acquisition unit that acquires a face image from the first imaging device and acquires a vein image from the second imaging device.
An extraction unit that extracts face authentication data used for face authentication from the face image and extracts vein authentication data used for vein authentication from the vein image.
Face recognition is executed based on the extracted face recognition data and the plurality of face recognition registration data stored in the first storage unit, and among the vein recognition registration data stored in the first storage unit, face recognition is executed. said the vein authentication registration data associated with the face authentication registration data successfully face authentication, the face face authentication unit Ru is stored in the second storage section in association with the shooting date and time of the image,
Among the vein authentication registration data stored in the second storage unit, the vein authentication registration data associated with the shooting date and time of the face image in the past predetermined time zone is acquired, and the vein authentication data extracted. An authentication system including a vein authentication unit that executes vein authentication based on the vein authentication registration data acquired from the second storage unit. The first photographing device photographs the face of a person entering the store from the entrance of the store.
The authentication system according to claim 1, wherein the second photographing device photographs a vein of a person who makes a payment in the store. The first photographing device photographs the face of a person entering the store from the entrance of the store.
The second imaging device photographs the veins of a person who makes a payment in the store.
The authentication device calculates the difference between the past shooting date and time of the face image stored in the first storage unit and the date and time of vein authentication corresponding to the shooting date and time of the past face image for each person. The authentication system according to claim 1 , further comprising a setting unit for setting the start time of the predetermined time zone based on the average value of the differences. The authentication system according to claim 1, wherein the first photographing device photographs the face of a person passing through a passage toward the second photographing device. The first photographing device photographs the face of a person passing through a passage toward the second photographing device.
The authentication device sets a setting unit for setting the start time of the predetermined time zone based on the distance between the shooting range of the first shooting device and the second shooting device and the estimated value of the walking speed of the person. The authentication system according to claim 1 , wherein the authentication system includes. An authentication device capable of communicating with a first imaging device that photographs a person's face and a second imaging device that is installed at a predetermined distance from the imaging range of the first imaging device and photographs a person's veins.
An acquisition unit that acquires a face image from the first imaging device and acquires a vein image from the second imaging device.
An extraction unit that extracts face authentication data used for face authentication from the face image and extracts vein authentication data used for vein authentication from the vein image.
Face recognition is executed based on the extracted face recognition data and the plurality of face recognition registration data stored in the first storage unit, and among the vein recognition registration data stored in the first storage unit, face recognition is executed. said the vein authentication registration data associated with the face authentication registration data successfully face authentication, the face face authentication unit Ru is stored in the second storage section in association with the shooting date and time of the image,
Among the vein authentication registration data stored in the second storage unit, the vein authentication registration data associated with the shooting date and time of the face image in the past predetermined time zone is acquired, and the vein authentication data extracted. An authentication device including a vein authentication unit that executes vein authentication based on the vein authentication registration data acquired from the second storage unit. A computer capable of communicating with a first imaging device that photographs a person's face and a second imaging device that is installed at a predetermined distance from the imaging range of the first imaging device and photographs a person's veins.
A face image is acquired from the first imaging device, and a vein image is acquired from the second imaging device.
The face authentication data used for face authentication is extracted from the face image, and the vein authentication data used for vein authentication is extracted from the vein image.
Face recognition is executed based on the extracted face recognition data and the plurality of face recognition registration data stored in the first storage unit, and among the vein recognition registration data stored in the first storage unit. The vein authentication registration data associated with the face authentication registration data that succeeded in face recognition is stored in the second storage unit in association with the shooting date and time of the face image.
Among the vein authentication registration data stored in the second storage unit, the vein authentication registration data associated with the shooting date and time of the face image in the past predetermined time zone is acquired, and the vein authentication data extracted. And an authentication program for executing a process of executing vein authentication based on the vein authentication registration data acquired from the second storage unit. A computer capable of communicating with a first imaging device that photographs a person's face and a second imaging device that is installed at a predetermined distance from the imaging range of the first imaging device and photographs a person's veins.
A face image is acquired from the first imaging device, and a vein image is acquired from the second imaging device.
The face authentication data used for face authentication is extracted from the face image, and the vein authentication data used for vein authentication is extracted from the vein image.
Face recognition is executed based on the extracted face recognition data and the plurality of face recognition registration data stored in the first storage unit, and among the vein recognition registration data stored in the first storage unit. The vein authentication registration data associated with the face authentication registration data that succeeded in face recognition is stored in the second storage unit in association with the shooting date and time of the face image.
Among the vein authentication registration data stored in the second storage unit, the vein authentication registration data associated with the shooting date and time of the face image in the past predetermined time zone is acquired, and the vein authentication data extracted. An authentication method characterized by executing a process of executing vein authentication based on the vein authentication registration data acquired from the second storage unit.

Images