JP6793363B2 - Personal authentication method and personal authentication system - Google Patents

Description

The present invention relates to a personal authentication method and a personal authentication system.

Generally, as personal authentication when using a digital device, for example, a 4-digit passcode (personal identification number) is entered and collated with a number string stored in a machine in advance.
However, what is often used as a method of detecting passcodes is actually the simplest shoulder hack. This is to steal information by looking at the operation of the subject over the shoulder.
In recent years, with the rapid spread of mobile terminals, there is a risk that the passcode will be stolen by various methods such as taking a voyeur of the movement of the finger with a small camera, which is necessary for unlocking the lock screen of the mobile terminal. It is increasing. Once the passcode is stolen, it can be easily spoofed by simply typing the key. If ultra-high resolution surveillance cameras such as 4K and 8K become widespread in the future, such dangers are expected to increase dramatically.
In addition to preventing eavesdropping due to shoulder hacks and the like, if spoofing can be prevented, security can be further improved.

Therefore, instead of typing with a finger, fingerprint authentication or eye-gaze authentication, which is more difficult to be snooped and is easier to prevent spoofing, can be considered. However, fingerprint authentication can be performed by touching the sensor while sleeping. There is a possibility of being authenticated against the intention of. On the other hand, if the authentication is based on the line of sight, it is safe because the person does not enter it unintentionally.
The problem with line-of-sight measurement is that there is a deviation angle of several degrees between the optical axis of the eyeball measured from the outside and the line of sight (line-of-sight) actually seen by the person. Is. Therefore, in order to accurately measure the line of sight, a process (calibration) is required in which a point instructed in advance is gazed at and the deviation of the person is measured. It is said that this deviation hardly changes once measured.

On the other hand, as an authentication device for preventing unauthorized authentication, the line-of-sight angle of the user captured in the image is specified, and the line-of-sight direction is specified while using the line-of-sight direction identification information indicating the correspondence between the line-of-sight angle and the line-of-sight direction. Then, an authentication device that authenticates an individual based on the specific result is known (see Patent Document 1).
However, the authentication method disclosed in Patent Document 1 does not identify an individual by the line-of-sight direction specifying information itself. In addition, the line-of-sight angle is as large as ± 20 ° and ± 10 °, and there is a problem that another person who knows the direction of authentication permission can impersonate.

Japanese Unexamined Patent Publication No. 2014-206923

In view of the above situation, the present invention enables personal authentication from a large number of subjects using the line of sight, increases the resistance to theft and spoofing of the passcode, and improves the security of the passcode authentication. The purpose is to provide a personal authentication method and a personal authentication system.

In order to solve the above problems, the personal authentication method of the present invention is a personal authentication method in which a passcode is input with a line of sight, when user identification information is input and an input key displayed on a display panel is gazed at. The orientation of the optical axis of the camera is measured, and the spatial three-dimensional coordinates of the display panel, the orientation of the optical axis of the eyeball, and the optical axis and visual axis of the eyeball registered in advance in association with the input user identification information ( The passcode is calculated from the deviation angle (κ angle) of the line of sight) and verified by collating with the registered passcode.

According to the personal authentication method of the present invention, by performing passcode authentication using the deviation angle between the optical axis and the visual axis of the eyeball, the passcode is less likely to be stolen and spoofed, and the passcode authentication can be performed. Safety can be improved. In other words, unlike the case of entering the passcode with a finger, the deviation angle (κ angle) between the optical axis and the visual axis of the eyeball is used for personal authentication, so the risk of the passcode being stolen by a shoulder hack is reduced, and Since the line-of-sight information varies from person to person, it is also effective in preventing spoofing.

Here, the deviation angle (κ angle) between the optical axis and the visual axis of the eyeball is a feature quantity that takes two-dimensional values in the vertical direction (vertical direction) and the horizontal direction (horizontal direction). When measuring the deviation angle between the optical axis and the visual axis of the eyeball in advance, the deviation angle is acquired by using a known line-of-sight measurement method or device only once and calibrating. By recording the orientation of the face for measuring the deviation angle as personal information, it can be used as more accurate personal information. Here, the orientation of the face is the posture of the face when gazing at the input key, and is tilted at a solid angle such as 10 ° toward the left shoulder or 15 ° toward the right shoulder. A direction that affects a certain deviation angle (κ angle). Even if you stand in front of the display panel and look at the input keys on the panel with your face facing right, the eyeballs rotate as much as your face turns to the right, so the deviation angle (κ angle) does not change, If you tilt (rotate) toward the right shoulder around the neck, the deviation angle (κ angle) will rotate accordingly. In this way, the deviation angle (κ angle) can be determined if the posture is always the same when gazing at the input key on the front display panel, or simply with the face facing left or right and looking sideways at the front. If so, basically it does not depend on the measurement angle, but when the face is tilted toward the right shoulder or left shoulder and the input key is gazed, the measurement angle of the face orientation corrects the deviation angle (κ angle). It becomes important as an angle. Therefore, when measuring the deviation angle in advance, it is preferable to measure the direction in which the deviation angle is measured to obtain an accurate deviation angle. That is, in order to use it as accurate personal information, when measuring the direction of the optical axis of the eyeball, the measurement angle such as the direction and inclination of the face is measured. The measurement angle also takes a two-dimensional value like the deviation angle.

The passcode is not limited to numbers and alphanumeric characters, but is a code including other characters, symbols, and figures, and is determined by the user or the provider of the personal authentication service. The passcode may be, for example, a 3-digit or 4-digit number, but may be something that gazes at a specific part (feature point), a gesture-like one, or something other than these. There are differences in the level of safety, but single-digit numbers are acceptable.

When the input key is gazed, camera measurement is performed to measure the direction of the optical axis of the eyeball. For example, the face is photographed by two cameras having a fixed positional relationship between the cameras and different imaging angles, and the direction of the optical axis of the eyeball is measured using the world coordinate system (global coordinate system). As a method for measuring the direction of the optical axis of the eyeball, a known measurement method may be used. If the shape of the display panel on which the input keys are displayed and the positional relationship with the camera are known, the world coordinates (spatial three-dimensional coordinates) of the display panel can be known. Furthermore, if the pixel information in the input key display screen of the display panel is known, the world coordinates of each input key can be known. Here, the pixel information is information on which pixel a specific input key is displayed on.
Obtain the orientation of the optical axis of the eyeball using the world coordinate system. The direction of the optical axis of the eyeball can be represented by the coordinates of the center of the pupil and the coordinates of the intersection of the optical axis of the eyeball and the surface of the display panel. Then, from the pixel information of the display panel, the direction of the optical axis of the eyeball, and the deviation angle associated with the input user identification information, the gazing point on the display panel, that is, the gazing passcode is calculated. Can be done.

In the personal authentication method of the present invention, the deviation angle between the optical axis and the visual axis of the eyeball is measured in advance for each user, and the passcode and the deviation angle are registered in association with the user identification information, and then personal authentication is performed. Do.
Alternatively, in the personal authentication method of the present invention, a passcode is set in advance for each user, and the direction of the optical axis of the eyeball when gazing at the input key corresponding to the passcode displayed on the display panel is measured by the camera. Then, after registering the deviation angle from the input key area as the deviation angle between the optical axis and the visual axis of the eyeball in association with the user identification information, personal authentication is performed.

Specifically, the personal authentication method of the present invention comprises the following registration step and authentication step.
First, the registration step is composed of the following 1) to 4).
1) User identification information setting for each user User identification information setting step 2) Passcode setting for each user Passcode setting step 3) For each user, measure the deviation angle between the optical axis and the visual axis of the eyeball. Misalignment angle measurement step 4) A storage step in which the passcode and the misalignment angle are registered in association with the user identification information.

Next, the authentication step is composed of the following 5) to 11).
5) Input the user identification information User identification information input step 6) Display the input key on the display panel Input key display step 7) Confirm the state in which the input key is gazed Step 8) Gaze the input key Optical axis measurement that measures the direction of the optical axis of the eyeball with a camera Step 9) From the measured orientation of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel, the intersection coordinates of the optical axis of the eyeball and the display panel Coordinate calculation to be calculated 10) Passcode calculation step 11) Calculation to calculate the watched passcode from the pixel information of the display panel, the above intersection coordinates, and the deviation angle associated with the input user identification information. Passcode matching step to match the entered passcode with the preset passcode

In the personal authentication method of the present invention, it is more preferable to calculate the visual axis from the optical axis of the eyeball by measuring the orientation of the face when the input key is gazed, using the registered deviation angle. By measuring the orientation of the face, the visual axis of the eyeball can be calculated accurately.

In the personal authentication method of the present invention, when the input key is displayed on the display panel, it is preferable to change the size or shape of the input key according to the distance between the user and the display panel. Further, it is preferable that the viewing angle size of the input key is larger than the error range of the camera measurement and smaller than the preset variation range of the deviation angle. If the size of the key is smaller than the range in which the line-of-sight measurement causes variation, the authentication accuracy of the person will deteriorate even if the calibration is performed, that is, the false rejection rate will increase. On the other hand, if the size of the key exceeds the preset range of variation regarding the deviation angle, if the passcode is stolen by another person in some way, it becomes possible for another person to impersonate. Therefore, it is provided in the above range.

The variation of the measured value in the line-of-sight measurement can be 1 to 2 °, while the range of the variation of the deviation value between users is 5 to 7 °. Therefore, the size of the key is the line-of-sight information. It is preferable that the solid angle is determined on the premise that the solid angle is 3 to 4 °. As a result, it is possible to realize an authentication method in which the passcode is not easily stolen, the authentication accuracy is high, and even if the passcode is stolen, it is difficult to be spoofed.

In the personal authentication method of the present invention, the display of the input key array is as follows: random arrangement, arrangement rotated from the arrangement of the previous display, arrangement different from the arrangement of the previous display, number of rows and columns of the matrix arrangement of the previous display. It is preferable to display on the display panel in an arrangement in which at least one of them is increased, or an arrangement in which the spacing between adjacent keys is changed. Authentication security can be improved by changing the display of the input key array.

In the personal authentication method of the present invention, when calculating the coordinates of the intersection of the optical axis of the eyeball and the display panel, it is preferable to calculate the coordinates of the median value of the calculated coordinate distribution at a predetermined elapsed time from the start of gaze. Here, the predetermined elapsed time is 1.5 to 3 seconds, more preferably 2 seconds. When a person is gazing at something, the deviation angle (κ angle) between the optical axis of the eyeball and the visual axis is constant, but the eyeball blurring called fixation tremor occurs, and the gazing point cannot be determined. .. There are several types of fixation tremors, but even when gazing at a certain point, the eyeball rotates at about 1/3 ° and several Hz / sec. Therefore, when the camera image in a certain frame is measured, an error occurs in the measurement of the κ angle. As a result of statistically investigating the variation in the coordinates of the intersection between the optical axis of the eyeball and the display panel when gazing at one point, the error from the mean value in long-term measurement is less than the amplitude of fixation tremor. Was found to be the coordinates of the median value of the coordinate distribution calculated in any elapsed time in the range of 1.5 to 3 seconds from the start of gaze.

In the personal authentication method of the present invention, the user identification information is at least one of user ID, fingerprint information, palm print information, and iris information. An ID card storing a user ID is usually used for identifying a user, but iris data, fingerprint data, palm print data, and other personally identifiable data may be used in combination.

In the above-mentioned gaze state determination step in the personal authentication method of the present invention, specifically, the gaze state is determined by gaze time detection, confirmation motion detection, or confirmation intention detection. Here, the gaze time detection is, for example, to detect that a certain point on the display panel is gazed for 3 seconds. In addition, confirmation motion detection means that the user operates a button at the timing when he / she gazes at a specific input key, detects the button operation to confirm the gaze state, touch-operates with a touch panel, and captures data by a camera. The image processing of the above is to detect the movement of a part of the body and determine the gaze state. Further, the definite intention detection is to detect the definite intention by measuring the brain wave, for example.

Next, the personal authentication system of the present invention will be described.
The personal authentication system of the present invention is an authentication system in which an input terminal and an authentication server are connected by a network, and the input terminal and the authentication server have the following technical features.
1) Authentication server A database is provided in which the deviation angle between the optical axis and the visual axis of the eyeball measured for each user and the set passcode are associated with the user identification information and stored in advance.
The passcode watched from the user identification information received from the input terminal, the pixel information of the display panel, the orientation of the optical axis of the eyeball, the spatial three-dimensional coordinates of the display panel, and the deviation angle stored in the database. Is calculated, collated with the passcode stored in the database, and the collation result is transmitted to the input terminal.
2) Input terminal A user identification information input means, a camera measuring means, and a display panel for displaying input keys are provided.
The user identification information is read from the user identification information input means and sent to the authentication server.
When the input key displayed on the display panel is gazed, the direction of the optical axis of the eyeball is measured by the camera, and the measured direction of the optical axis of the eyeball, the spatial three-dimensional coordinates of the display panel, and the display panel Send the pixel information to the authentication server.

In the personal authentication system of the present invention, it is preferable to calculate the visual axis by measuring the orientation of the face when the input key is gazed, and using the deviation angle from the optical axis of the eyeball. Further, when the input key is displayed on the display panel, it is preferable to change the size or shape of the input key according to the distance between the user and the display panel. Further, it is preferable that the viewing angle size of the input key is larger than the error range of the camera measurement and smaller than the preset variation range of the deviation angle. In addition, the display of the input key array increases at least one of the random arrangement, the arrangement rotated from the arrangement of the previous display, the arrangement different from the arrangement of the previous display, and the number of rows and columns of the matrix arrangement of the previous display. It is preferable to display on the display panel in a different arrangement or in an arrangement in which the spacing between adjacent keys is changed. Further, when calculating the coordinates of the intersection between the optical axis of the eyeball and the display panel, it is preferable to calculate the coordinates of the median value of the coordinate distribution calculated at a predetermined elapsed time from the start of gaze.

In the personal authentication system of the present invention, the user identification information input means is at least one of a card reading device in which a user ID is recorded, a fingerprint information reading device, a palm print information reading device, and an iris information reading device.
It is preferable that the input terminal in the personal authentication system of the present invention is further provided with any of the gaze time detecting means, the definite motion detecting means, and the definite intention detecting means.

The program installed in the authentication server of the present invention uses the authentication server computer as a user identification information receiving means, a deviation angle reading means, a coordinate receiving means, a passcode calculating means, a passcode matching means, and a collation in the personal authentication system of the present invention. It is a program for functioning as a result transmission means.
The program mounted on the input terminal of the present invention makes the input terminal computer a user identification information transmitting means, an input key display means, a means for detecting a state in which the input key is gazed, an optical axis measuring means, a coordinate transmitting means, and a collation. It is a program for functioning as a result output means.

Further, according to another viewpoint, the personal authentication method of the present invention is a personal authentication method in which a passcode is input with a line of sight when user identification information is input and an input key displayed on a display panel is gazed at. , The orientation of the optical axis of the eyeball is measured by the camera, and the spatial three-dimensional coordinates of the display panel, the orientation of the optical axis of the eyeball, and the orientation of the optical axis of the eyeball registered in advance in association with the input user identification information. Authenticate using the code corresponding to the input key on the display panel located at.
In the above method, paying attention to the fact that there is a deviation angle between the optical axis of the eyeball and the visual axis, the code pointed to by the optical axis of the eyeball is imitated as a password without storing the passcode on the system side, and personal authentication is performed. To do. The user pays close attention to the input key corresponding to the passcode decided by the user (the system does not know the passcode). Since there is a deviation angle between the optical axis of the eyeball and the visual axis, the input key gazed by the user and the input key located in the direction of the optical axis of the eyeball are different. As a premise, the viewing angle size of the input key needs to be larger than the error range of the camera measurement and smaller than the preset variation range regarding the deviation angle between the optical axis and the visual axis of the eyeball.
Since the code corresponding to the input key located in the direction of the optical axis of the eyeball can be recognized by the system, it is imitated as a passcode determined by the user and registered in advance in association with the user identification information. It is.
At the time of authentication, similarly, the code corresponding to the input key located in the direction of the optical axis of the eyeball when the input key is gazed is obtained, and the code associated with the user identification information and registered (a code imitated as a passcode) is obtained. ) And personal authentication.

In this method, it is a precondition that the positional relationship between the position of the eyeball, the device for measuring the camera, and the display panel is fixed. In addition, the arrangement of the input keys displayed on the display panel also needs to be fixed. Therefore, the user needs to behave in the same way each time, such as the standing position and face orientation at the time of authentication, but these behaviors are information that only the user can know like the passcode, and in that sense, if the security level is improved. I can say. The arrangement of the input keys displayed on the display panel is fixed, but for example, by measuring the distance between the display panel and the user and changing the size of the input keys according to the distance, the user's standing position can be determined to some extent. It is also possible to give the degree of freedom of.
By measuring the distance between the display panel and the user and changing the size of the input key according to the distance, the user's standing position may be given a certain degree of freedom. Considering the two types of deviation angles (3 ° and 5 °) when the distance between the display panel and the user is 30 cm, the tan 3 ° is 1.5 cm and the tan 5 ° is 2.6 cm. It can be seen that the deviation between the optical axis of the eyeball on the display panel and the coordinates of the intersection of the display panel due to the deviation angle does not change so much even if the standing position of the eye changes by about 5 cm. However, the orientation of the face is important, and authentication is performed while confirming the position of the user's own face by installing a mirror on the display panel or using application software to make a part of the panel a mirror-like panel. Is preferable.
As an alternative to the code corresponding to the input key on the display panel located in the direction of the optical axis of the eyeball, the intersection coordinates of the optical axis of the eyeball and the display panel are registered, and the intersection coordinates obtained at the time of authentication are registered. It would be possible to authenticate by whether or not it is within a certain distance from the coordinates of the intersection.

Specifically, the personal authentication method from another viewpoint consists of the following registration step and authentication step.
The registration step consists of the following 1) to 5).
1) User identification information setting for each user Step 2) Passcode determination step for the user to determine the passcode 3) When the input key displayed on the display panel is watched for each user , Optical axis pre-measurement to measure the direction of the optical axis of the eyeball with a camera Step 4) Calculate the intersection coordinates of the optical axis of the eyeball and the display panel from the measured orientation of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel. Coordinate pre-calculation step 5) A storage step of registering a code corresponding to an input key located at an intersection coordinate in association with user identification information.

The authentication step is composed of the following 6) to 12).
6) Input the user identification information User identification information input step 7) Display the input key on the display panel Input key display step 8) Confirm the state in which the input key is gazed Step 9) Gaze the input key Optical axis measurement step 10) Measuring the direction of the optical axis of the eyeball with a camera The intersection coordinate of the optical axis of the eyeball and the display panel from the measured orientation of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel. Coordinates to be calculated Step 11) Code to calculate the code corresponding to the input key located in the direction of the optical axis of the eyeball from the pixel information of the display panel and the above intersection coordinates Step 12) Calculated code and user Code matching step to match the code registered in association with the identification information

Further, from another viewpoint, the personal authentication system of the present invention is an authentication system in which an input terminal and an authentication server are connected by a network, and the input terminal and the authentication server have the following technical features.
A) Authentication server A database in which a code corresponding to an input key located at the intersection coordinate between the optical axis of the eyeball and the display panel measured for each user is stored in advance in association with the user identification information is provided.
From the user identification information received from the input terminal, the pixel information of the display panel, the orientation of the optical axis of the eyeball, and the spatial three-dimensional coordinates of the display panel, it corresponds to the input key located in the orientation of the optical axis of the eyeball. The code is calculated, collated with the code stored in the database, and the collation result is sent to the input terminal.
B) Input terminal A user identification information input means, a camera measuring means, and a display panel for displaying input keys are provided.
The user identification information is read from the user identification information input means and sent to the authentication server.
When the input key displayed on the display panel is gazed, the direction of the optical axis of the eyeball is measured by the camera, and the measured direction of the optical axis of the eyeball, the spatial three-dimensional coordinates of the display panel, and the display panel Send the pixel information to the authentication server.

According to the personal authentication method and the personal authentication system of the present invention, personal authentication can be performed from a large number of target persons by using the line of sight, and the passcode is less likely to be stolen and spoofed. It has the effect of improving safety.

Schematic diagram of the personal authentication system of Example 1 Image of the authentication step of Example 1 Illustration of interactive password Explanatory drawing of side-by-side passcode input for the user whose deviation angle (κ angle) is on the top Explanatory diagram of vertically arranged passcode input for the user whose deviation angle (κ angle) is on the top. Measurement example of deviation angle (κ angle) Relationship diagram of mean, median and mode in short-time measurement when the mean value in long-term measurement with normal distribution is used as the solution Distribution map of deviation angle (κ angle) An example in which the size is assigned to 9 people actually measured with n as 3. Diagram defining the distribution range of the deviation angle (κ angle) A diagram showing the screen size displayed on the screen and the range in which the optical axis of the eyeball should be measured. It is an example of the key layout on the display screen, (1) shows the numeric keypad method, and (2) shows the random method. The figure which showed the variance of the deviation angle (κ angle) of 10 users Example of changing the size of the key on the display screen Relationship between the optical axis and the visual axis of the eyeball Processing flow of registration step and authentication step in the personal authentication method of Example 1 Data communication flow of input terminal and authentication server in the personal authentication system of the first embodiment An example of a database table Functional block diagram of personal authentication system Processing flow of registration step and authentication step in the personal authentication method of Example 3 Data communication flow of input terminal and authentication server in the personal authentication system of Example 3

Hereinafter, an example of the embodiment of the present invention will be described in detail with reference to the drawings. The scope of the present invention is not limited to the following examples and illustrated examples, and many modifications and modifications can be made.

In human vision, between the visual axis (the axis connecting the eyeball and the center of the object perceived by vision) and the optical axis of the eyeball (the geometric central axis when the eyeball is regarded as a rotating body). , It is known that there is a deviation of about 5 °. This is called the κ angle (the angle of deviation between the optical axis and the visual axis of the eyeball).
The axis of vision depends on the location of the most densely distributed cone cells, the part with the best vision, located in the center of the macula of the eye, called the fovea. As shown in FIG. 15, there are individual differences in the position of the fovea. The optical axis of the eyeball can be measured from the outside, whereas the visual axis depends on human perception, and when a line-of-sight measuring device based on a three-dimensional model is not used, it is measured from the outside. Hateful.

By the way, in a general line-of-sight measuring device on the market, where a person is looking is measured by associating the two-dimensional plane of the display with the two-dimensional plane of the camera in which the eyeball is photographed.
Therefore, before using the device, for example, five points on the screen are viewed, and calibration is performed to associate the display coordinates at that time with the coordinates of the eyeball photographed by the camera. In general, in a line-of-sight measuring device that does not perform calibration, about 5 ° corresponding to the κ angle is not calibrated and remains as an error.

In this embodiment, a line-of-sight measuring device based on a three-dimensional model is used, and by using a plurality of cameras and light sources, the optical axis of the eyeball is calculated as a three-dimensional vector, and the optical axis and the visual axis of the eyeball are calculated. The deviation, that is, the κ angle is obtained and calibrated to obtain the three-dimensional vector of the optical axis. The intersection of this vector with the object is the point of gaze. That is, the content of the calibration is different from that of a general line-of-sight measuring device.

In a general line-of-sight measuring device, the parameters used for calibration depend on the arrangement of the display, the camera, and the like, whereas the κ angle can be considered to be always constant.
Like height, κ angle is considered to be normally distributed, although there are individual differences, and it is possible that it will take the same value. Therefore, it is not possible to identify an individual by using itself as a feature, such as a fingerprint or a glow. However, while height is a one-dimensional feature, κ angle is a feature that takes two-dimensional values in the vertical and horizontal directions.
In addition, the orientation of the face when the κ angle is measured, that is, the measurement angle is also recorded as personal information. This is because without such information, it cannot be used as accurate personal information. Here, the reference angles are horizontal and vertical.

FIG. 1 is a schematic view of the personal authentication system of the first embodiment. As shown in FIG. 1, the personal authentication system 1 includes an input terminal 2, an authentication server 3, and a network 5, and the input terminal 2 includes a display device 21 for displaying a screen, a confirmation device 22 for confirming input by a line of sight, and the input terminal 2. A measuring device 23 for measuring the optical axis of the eyeball and an identification device 24 for identifying an individual are provided.
The network 5 is used for transmitting and receiving data between the input terminal 2 and the authentication server 3. Unlike this embodiment, it may be a stand-alone device in which the input terminal 2 and the authentication server 3 are directly connected without providing the network 5.
The authentication server 3 collates the input data with the database 31 that stores the data in the collation means 32, and determines whether or not the authentication is possible. In addition, the result is transmitted to the input terminal 2 through the network 5.

In order to measure the deviation angle (κ angle), it is necessary to accurately extract the coordinates of the intersection of the optical axis of the eyeball and the display panel (hereinafter referred to as “optical axis coordinates of the eyeball”).
When a person is gazing at something, the κ angle is constant, but eye movements called fixation tremors occur, and the gazing point cannot be determined. There are several types of fixation tremors, but even when gazing at a certain point, the eyeball rotates at about 1/3 ° and several Hz / sec. Therefore, when the camera image in a certain frame is measured, an error occurs in the measurement of the κ angle.

FIG. 6 shows an example of measuring the deviation angle (κ angle). In this example, a 15-inch display having 1024 pixels in the horizontal direction (x coordinate) and 768 pixels in the vertical direction (y coordinate) is installed, and the distance to a person is fixed at 50 cm for measurement. Using a line-of-sight measuring device based on a three-dimensional model, the power of the x-coordinate of the optical axis of the eyeball when one point is gazed is totaled. (1) is the frequency when the person is gazed for 3 seconds, which is the interval between blinks of a person during relaxation, and (2) is the frequency when the person is gazed for 90 seconds, which is performed to measure an accurate gaze point. Shows the frequency. As shown in FIG. 6 (1), in the line-of-sight measurement in a short time, the appearance coordinates of the coordinates of the points to be watched do not have a normal distribution. On the other hand, as shown in FIG. 6 (2), it has a normal distribution in long-term measurement.

FIG. 7 shows a relationship diagram of the mean value, the median value, and the mode value in the short-time measurement when the average value in the long-time measurement having a normal distribution is used as the solution. That is, it indicates how many frames are required to converge with respect to the optical axis coordinates of the eyeball. The processing speed of the personal authentication system of this embodiment is about 15 frames / second.
Since it is considered that the error should be less than the amplitude of the fixation tremor (10 pixels or less in this experiment), it is accurate in a short time to take the median value for 2 seconds from the start of gaze as shown in FIG. It can be seen that there is an optimum for obtaining the optical axis coordinates of the eyeball. Therefore, in this embodiment, the median value for 2 seconds from the start of gaze is taken and used.

What kind of screen should be displayed on the display device of the authentication terminal is related to the robustness (= false rejection rate) and safety (= false acceptance rate) of the system in addition to the visual characteristics of the person. How to design this is very important.

FIG. 8 is a distribution map of the deviation angle (κ angle). Although the κ angle is about 5 °, it is distributed in two-dimensional coordinates in the vertical and horizontal directions, and is actually considered to be normally distributed as shown in FIG. Considering the visual characteristics of human beings, the structures of the left and right eyeballs are not completely the same, and the positions of the fovea are not necessarily symmetrical. There is also an effect. Under such conditions, vision needs to be aware that information from the optic nerve is properly processed and perceived in the brain (= theoretically, the visual axis cannot be measured from the outside). In particular, when the κ angle of only one eye of the left or right eye is measured, the distribution is likely to be wider than that of FIG. This is because the movements of the left and right eyeballs are the same, so even if the line-of-sight measurement is performed using the κ angle measured with one eye, the error does not increase, but the eyeball on the non-effective side sees a point different from the object. This is because there is a high possibility that it is.
In any case, the size of the key can be determined from the distribution of the κ angle. First, the minimum size depends on the measurement error of the individual κ angle. This is considered to be mainly in the range of the above-mentioned error due to fixation tremor and the measurement error of the system. _Let this length be l _min .

Second, the maximum key size depends on security. Divide the distribution of κ angles into n equal parts according to the frequency. The distance at the time of division is short in the center in both the vertical and horizontal directions and increases as it spreads to the periphery. Among them, the minimum length is l _max . Since it is divided into n equal parts in both the vertical direction and the horizontal direction, the probability that a certain user is impersonated by another user is 1 / n ² . At this time, if the key is larger than the size, the probability of being spoofed increases. On the other hand, if n is made too large, it becomes smaller than l _min , and an individual cannot be identified. FIG. 9 shows an example in which the size is assigned to 9 actually measured persons, where n is 3. Since the number of people to be measured is small, it is not one person in each frame, but as the number of people increases, it is thought that the number of people in the frame will match 1 / n ² .

In this embodiment, it is assumed that the number of people using the system is large, and the distribution is divided so as to minimize the probability of being spoofed. When only a few people use it, such as the key to a house or a car, it may be set to reject κ angles other than the users.

From the above, assuming that the size of the key, that is, the length of one side of the _key is l _key , using the above-mentioned l _min and l _max , the size of the key on the screen display should be within the range shown in the following equation 1. Just do it.

(Number 1)
l _max > l _key > l _min ... (Equation 1)

FIG. 10 shows a diagram defining the distribution range of the deviation angle (κ angle). This is the case where the left eye is measured at an angle of 0 °, and is a surface including all the distributions in FIG. Here, there is usually an upward deviation, and for the left eye, the right deviation is larger.

FIG. 11 is a diagram showing a screen size displayed on the screen and a range in which the optical axis of the eyeball should be measured.
Assuming that the screen size displayed on the screen is the inter-individual variance width 6, the deviation of the lower right with respect to the upper left, the deviation of the lower left with respect to the upper right, the deviation of the upper right with respect to the lower left, and the deviation of the upper left with respect to the lower right. Since it is necessary for the user to be able to measure the optical axis, the range in which the optical axis of the eyeball should be measured is determined to be the line-of-sight measurement target range 7. For this, a camera or a light source may be arranged by a known method.

The key may be displayed in any size and range described above. However, the safety changes depending on the arrangement.
FIG. 12 shows an example of the key layout on the display screen, (1) shows the numeric keypad method, and (2) shows the random method. As shown in FIG. 12 (1), when the numeric keypad is fixedly displayed, the κ angle can be estimated from inputs such as 1, 2, 3 or 4 because the κ angle is always constant. If a random key as shown in 2) is used, it is possible to input 1 by looking at a different 1 and input it, which makes it difficult to estimate the κ angle. In this embodiment, the numeric keypad method is adopted.
By sending the screen of the keyboard layout from the authentication server and displaying it on the input terminal, the security of key input can be enhanced.

Hereinafter, how to use the personal authentication system 1 will be described.
The use of the personal authentication system 1 is divided into a registration step and an authentication step.
First, in the registration step, an individual ID is issued in advance, and the service provider or the person himself / herself determines a passcode corresponding to the ID. In addition, the κ angle and the measurement angle are used. Here, the κ angle and the measurement angle are obtained by calibrating the line-of-sight measurement device that has introduced the three-dimensional model only once.

The κ angle and measurement angle are recorded in the database of the authentication server and are also used as part of the passcode. In this case, if the pixel information of the display device and the coordinates of the optical axis of the eyeball are sent on the input terminal side, the passcode can be restored on the authentication server side, so the passcode itself can be used on the input terminal as well as on the network. But since it has not been entered, you can safely enter the passcode.
If you register the necessary information by the above method, the system can be used.

Next, the authentication step will be described. FIG. 2 shows an image diagram of the authentication step of the first embodiment.
As shown in FIG. 2, first, the identification device 24 reads the ID of the user 4 to identify which individual the user is. The personal ID is generally a character string consisting of numbers and characters, but by using biometric information instead of this, convenience can be enhanced. In this embodiment, as shown in FIG. 2, a fingerprint is used as an ID. In this way, if you unlock by using a fingerprint as an ID and a 4-digit PIN and κ angle as a passcode instead of a house or car key, even if the PIN is known, It is difficult for others to impersonate. In addition, unlike this embodiment, a magnetic card or character input may be used.

Next, the information is input by looking at the screen display of the display device 21. However, in the case of input by the line of sight, there is a problem of the midas touch problem. This means that it causes an unintended operation, for example, it is input just by looking at it. Therefore, a confirmation device 22 for confirming the input by the line of sight, such as detecting that the person has been gazed for several seconds or pressing a button, is required. At this time, the measuring device 23 measures the optical axis of the user's eyeball. The data measured in this way is sent to the authentication server 3 via the network 5.

The authentication server 3 collates the passcode based on the sent data. That is, the passcode is restored by the authentication server using the pixel information of the display device, the κ angle, and the measurement angle information. The restored passcode is collated with the passcode entered in the registration step, and if they match, authentication is complete.

FIG. 3 shows an explanatory diagram of the interactive password. Here, the interactive password refers to a mechanism for interactively inputting a password by using the already recorded κ angle and measurement angle, and in this embodiment, such a mechanism is used. Moreover, "password" is used synonymously with "passcode".
As shown in FIG. 3, before the user 4 inputs the PIN, the display images (21a, 21b) to be displayed on the display device 21 are transmitted in advance from the authentication server 3 to the input terminal 2.

FIG. 4 is an explanatory diagram of side-by-side passcode input for a user whose deviation angle (κ angle) is on the top, (1) is the arrangement of input keys, (2) is the movement of the line of sight (optical axis), and (3). ) Indicates the movement of the optical axis of the eyeball and the coordinates of the intersection of the display panel. As shown in FIG. 4 (1), in the display image 21a, the numbers 1 to 9 are arranged in order from the upper left to the horizontal. In the case of a user whose deviation angle (κ angle) is on the top and the passcodes are input side by side, if the passcodes are in the order of 1, 2, 3, 4, the movement of the line of sight (line of sight) is shown in FIG. As shown by the arrow in (2), they are viewed in the order of 1, 2, 3, and 4. On the other hand, the movement of the intersection coordinate between the optical axis of the eyeball and the display panel is affected by the deviation angle (κ angle) between the optical axis of the eyeball and the visual axis, and is 4 as shown by the arrow in FIG. 4 (3). It will move in the order of 5, 6 and 7.

FIG. 5 is an explanatory diagram of vertically arranged passcode input for a user whose deviation angle (κ angle) is on the top, (1) is the arrangement of input keys, (2) is the movement of the line of sight (optical axis), and ( 3) shows the movement of the optical axis of the eyeball and the coordinates of the intersection of the display panel. As shown in FIG. 5 (1), in the display image 21b, the numbers 1 to 9 are arranged in order from the upper left to the vertical. In the case of a user whose deviation angle (κ angle) is on the top and the passcodes are input vertically, if the passcodes are in the order of 1, 2, 3, 4, the movement of the line of sight (line of sight) is shown in the figure. As shown by the arrow in 5 (2), they are viewed in the order of 1, 2, 3, and 4. On the other hand, the movement of the intersection coordinate between the optical axis of the eyeball and the display panel moves in the order of 2, 3 and margins 21e and 5 as shown by the arrow in FIG. 5 (3).
In this way, even if the numbers are the same, the coordinates of the intersection between the optical axis of the eyeball and the display panel change due to the influence of the deviation angle (κ angle) between the optical axis of the eyeball and the visual axis. It becomes difficult to estimate the angle (κ angle).

The distribution of the deviation angle (κ angle) was measured using the personal authentication system 1 of this example.
First, in order to determine the button size (button width), the variance of the visual axis of 10 experimental collaborators was extracted. The standard deviation between individuals is 103.0971245 in the x-axis direction and 70.85036246 in the y-axis direction, while the standard deviation within an individual is 45.0325907 in the x-axis direction and 35.66371922 in the y-axis direction. Therefore, it was confirmed that the following equation 2 holds.

(Number 2)
l _max > l _min ... (Equation 2)

FIG. 13 is a diagram showing the variance of the κ angle of 10 users. The distribution of the κ angle is divided into three equal parts according to the frequency. Since the threshold value was about 150 px square in pixels, a button of 150 px square was set. Further, since this value is equal to the value obtained by dividing l _max into nine equal parts, the following equation 3 holds.

(Number 3)
l _max > l _key ... (Equation 3)

The self-authentication rate and the exclusion rate of others were measured using the personal authentication system 1 of this embodiment.
First, it was confirmed that the user could set his own passcode "3759" and enter the system 100% after 10 demonstrations. Next, assuming that the passcode "3759" was stolen, 10 trials were made to see if a person other than the user could break into the system. The result was an intrusion success rate of 0%.

FIG. 16 shows the processing flow of the registration step and the authentication step. As shown in FIG. 16, in the registration step, first, user identification information is set for each user (S01). A passcode is set for each user (S02). For each user, the deviation angle between the optical axis and the visual axis of the eyeball is measured (S03). In the storage step, the passcode and the deviation angle are registered in association with the user identification information (S04). The data registered in the storage step is written to the database.

As shown in FIG. 16, in the authentication step, first, the user identification information is input (S11). The input key is displayed on the display panel (S12). The state in which the input key is gazed is confirmed (S13). The direction and measurement angle of the optical axis of the eyeball when the input key is gazed at are measured by the camera (S14). The measured optical axis of the eyeball and the world coordinates of the display panel are calculated (S15). The gazed passcode is calculated from the pixel information of the display panel, the optical axis coordinates of the eyeball, the deviation angle associated with the input user identification information, and the measurement angle (S16). The preset passcode is read from the database, and the calculated passcode is collated with the preset passcode (S17). As a result of the collation, if an authentication error occurs and the authentication is attempted again, the authentication step is performed again (S11 to 17).

FIG. 17 shows the flow of the personal authentication system. For example, when the input terminal reads the user identification information such as the user ID, the user identification information is transmitted from the input terminal to the authentication server. On the authentication server side, the deviation angle and passcode are read from the database using the received user identification information. When the user gazes at the input key displayed on the display panel (for example, if the passcode is a 4-digit number code, gaze at the four numbers in order), the pixel information of the display panel and the optical axis coordinates of the eyeball (4). The four optical axis coordinates when gazing at the digit code in order) and the measurement angle are transmitted from the input terminal to the authentication server. The calculation passcode is calculated on the authentication server based on the deviation angle read from the database. The passcode is collated with the calculated passcode and the passcode read from the database. The collation result is transmitted from the authentication server to the input terminal.
Here, regarding the measurement of the measurement angle of the face orientation, if the authentication is performed under the condition that the face does not tilt, the measurement of the measurement angle is unnecessary.

FIG. 18 shows an example of a database table. As shown in FIG. 18, when the personal ID is "10012345", the passcode is registered as "468" and the deviation angle is registered as "(2 °, 1 °)". Further, when the personal ID is "101351", the passcode is registered as "7531" and the deviation angle is registered as "(1 °, 3 °)".

FIG. 19 shows a functional block diagram of the personal authentication system. As shown in FIG. 19, it consists of an authentication server, an input terminal and a network.
The authentication server includes a database, a personal identification information receiving means, a deviation angle / deviation angle measuring angle reading means, a coordinate receiving means, a passcode calculating means, a passcode collating means, and a collating result transmitting means.
In the authentication server, the personal identification information acquired by the personal identification information receiving means via the network is stored in the database. From the database, information on the deviation angle is sent to the deviation angle / deviation angle measurement angle reading means, and the passcode is sent to the passcode collation means. Information on coordinates and measurement angles is sent to the coordinate receiving means and sent to the passcode calculating means via the network. The calculation passcode is sent from the passcode calculation means to the passcode collation means. The collation result is sent from the passcode collation means to the collation result transmission means.

The input terminal includes a user identification information input means, a user identification information transmission means, a camera measurement means, a gaze state determination means, an optical axis measurement means, a coordinate transmission means, an input key display means, a display panel, and a collation result output means.
In the input terminal, the input key is displayed on the display panel by the input key display means. The user identification information input by the user identification information input means is sent to the authentication server via the network by the user identification information transmission means. The information obtained by the camera measuring means and the gaze state determining means is sent to the optical axis measuring means. Information on the coordinates / measurement angle is sent to the authentication server via the network by the coordinate transmission means. Further, the collation result received from the authentication server is output by the collation result output means.

FIG. 14 shows an example in which the size of the key on the display screen is changed. As shown in FIG. 14, when the size of the key is changed for each measurement, the coordinates of the gazing point change even when the same number is viewed. However, to be precise, since the viewing angle depends on both the position of the head and the screen display, the viewing angle changes depending on the position of the head even if the display is the same.
Robustness and safety can be improved by changing the arrangement interval and the shape in addition to the above arrangement, movement, enlargement / reduction, and rotation. In that case, it is preferable to use an image that is difficult to analyze on the input terminal side.

The personal authentication method of the third embodiment is a personal authentication method in which a passcode is input by the line of sight. When the user identification information is input and the input key displayed on the display panel is gazed at, the direction of the optical axis of the eyeball is determined. Input on the display panel located in the spatial three-dimensional coordinates of the display panel measured by the camera, the direction of the optical axis of the eyeball, and the direction of the optical axis of the eyeball registered in advance in association with the input user identification information. This is a method of authenticating using a code corresponding to the key.

For example, suppose a user decides his / her passcode as 1,2,3,4 and remembers it. If the input keys displayed on the display panel are as shown in FIG. 4 (1) and the user gazes at 1, 2, 3, and 4 in order, as shown by the arrows in FIG. 4 (2). The coordinates of the intersection of the line of sight (line of sight) and the display panel will move. On the other hand, the coordinates of the intersection between the optical axis of the eyeball and the display panel are 4, 5, 6, as shown by the arrows shown in FIG. 4 (3) due to the influence of the deviation angle (κ angle) between the optical axis of the eyeball and the visual axis. It will move in the order of 7. On the system side, the order of 4, 5, 6 and 7 is imitated as a user password and stored in association with the user identification information.

The user always looks at the input keys displayed on the display panel in the same standing position, and by gazing at 1, 2, 3, and 4 that he remembers as his passcode in order, the optical axis of the eyeball on the system side. Since the intersection coordinates of the display panel are 4, 5, 6, and 7, the authentication is performed.
As described above, in the case of the personal authentication method of the third embodiment, it is not necessary to calculate the deviation angle (κ angle) between the optical axis and the visual axis of the eyeball on the system side. In addition, since the user has to remember the standing position other than the passcode, this will be information that only the user can know, and may become a stronger passcode. For example, if the size of the input key displayed on the display panel is fixed, if the user moves backward from the correct standing position, the optical axis of the eyeball and the intersection coordinates of the display panel will be affected by the deviation angle when gazing at 1. It appears even larger and becomes 7. On the other hand, when approaching the display panel from the correct standing position, when 1 is gazed at, the optical axis of the eyeball and the intersection coordinates of the display panel become the same 1 because the influence of the deviation angle becomes small. That is, when the standing position is changed, the code (a code imitated as a passcode) stored in association with the user identification information does not match, and the user is not authenticated. In this respect, standing position is also an element of personal authentication.

FIG. 20 shows the processing flow of the registration step and the authentication step in the personal authentication method of the third embodiment. As shown in FIG. 20, in the registration step, first, user identification information is set for each user (S21). The user determines his / her passcode (S22). Here, the determined passcode only needs to be remembered by the user himself, and there is no need to set and register it on the system side. Next, for each user, when the input key displayed on the display panel is gazed at, the direction of the optical axis of the eyeball is measured by the camera (S23). Then, the intersection coordinates of the optical axis of the eyeball and the display panel are calculated from the measured orientation of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel (S24). Then, the code corresponding to the input key located at the intersection coordinate is registered in the database in association with the user identification information (S25).

As shown in FIG. 20, in the authentication step, first, the user identification information is input (S31). The input key is displayed on the display panel (S32). The state in which the input key is gazed is confirmed (S33). The direction and measurement angle of the optical axis of the eyeball when the input key is gazed at are measured by the camera (S34). The measured optical axis of the eyeball and the world coordinates of the display panel are calculated (S35). From the pixel information of the display panel and the optical axis coordinates of the eyeball, the code corresponding to the input key located in the direction of the optical axis of the eyeball is calculated (S36). Then, the calculated code is collated with the code registered in association with the user identification information (S37). As a result of the collation, if an authentication error occurs and the authentication is attempted again, the authentication step is performed again (S31 to 37).

FIG. 21 shows the flow of the personal authentication system of the third embodiment. For example, when the input terminal reads the user identification information such as the user ID, the user identification information is transmitted from the input terminal to the authentication server. On the authentication server side, the code registered from the database is read using the received user identification information. When the user gazes at the input key displayed on the display panel (for example, if the passcode is a three-digit number code, gaze at the three numbers in order), the pixel information of the display panel and the optical axis coordinates of the eyeball (3). The three optical axis coordinates when gazing at the digit code in order) are transmitted from the input terminal to the authentication server.
On the authentication server side, the code located in the direction of the optical axis is calculated from the pixel information on the display panel and the coordinates of the optical axis, and this is collated with the code read from the database, and the verification result is sent from the authentication server to the input terminal. Will be done.

The present invention is useful for personal authentication using the line of sight.

1 Personal authentication system 2 Input terminal 3 Authentication server 4 Users 5 Network 6 Interpersonal distribution width 7 Eye measurement target range 8 Eyeball 9 Fovea 10 Eye axis 11 Eyeball optical axis 21 Display device 21a to 21d Display screen 21e Extra 22 Confirmation device 23 Measuring device 24 Identification device 31 Database 32 Verification means W button size

Claims (10)

In the personal authentication method of entering the passcode with the line of sight,
Enter the user identification information and
An input key whose viewing angle size is larger than the error range of camera measurement of the direction of the optical axis of the eyeball and smaller than the preset range of variation regarding the deviation angle between the optical axis of the eyeball and the visual axis, and is displayed on the display panel. When the displayed input key is gazed at, the direction of the optical axis of the eyeball is measured by the camera.
The passcode is calculated from the spatial three-dimensional coordinates of the display panel, the direction of the optical axis of the eyeball, and the deviation angle registered in advance in association with the input user identification information, and the registered passcode is used. A personal authentication method characterized by matching. The personal authentication according to claim 1, wherein the deviation angle is measured in advance for each user, the passcode and the deviation angle are registered in association with the user identification information, and then personal authentication is performed. Method. A passcode is set in advance for each user, the direction of the optical axis of the eyeball when gazing at the input key corresponding to the passcode displayed on the display panel is measured by the camera, and the direction of the optical axis is measured from the area of the input key. The personal authentication method according to claim 1, wherein the deviation angle is registered as the deviation angle in association with the user identification information, and then personal authentication is performed. The personal authentication method consists of a registration step and an authentication step.
The registration step is
A user identification information setting step that sets user identification information for each user, and
Passcode setting step to set passcode for each user,
A deviation angle measurement step for measuring the deviation angle between the optical axis and the visual axis of the eyeball for each user,
A storage step that registers the passcode and the deviation angle in association with the user identification information,
Consists of
The authentication step is
User identification information input step to input user identification information,
An input key display step for displaying the input key on the display panel, and
A gaze state determination step for determining the state in which the input key is gazed, and
An optical axis measurement step for measuring the direction of the optical axis of the eyeball when the input key is gazed at by a camera, and
A coordinate calculation step that calculates the intersection coordinates of the optical axis of the eyeball and the display panel from the measured orientation of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel.
A passcode calculation step for calculating the gazed passcode from the pixel information of the display panel, the intersection coordinates, and the deviation angle associated with the input user identification information.
A passcode collation step that collates the calculated passcode with a preset passcode,
The personal authentication method according to claim 1, wherein the personal authentication method comprises. In an authentication system in which the input terminal and the authentication server are connected via a network
1) The authentication server is
A database is provided in which the deviation angle between the optical axis and the visual axis of the eyeball measured for each user and the set passcode are stored in advance in association with the user identification information.
The path watched from the user identification information received from the input terminal, the pixel information of the display panel, the orientation of the optical axis of the eyeball, the spatial three-dimensional coordinates of the display panel, and the deviation angle stored in the database. Calculate the code, collate it with the passcode stored in the database, and send the collation result to the input terminal.
2) The input terminal is
The user identification information input means, the camera measurement means, and the input keys whose viewing angle size is larger than the error range of the camera measurement of the direction of the optical axis of the eyeball and smaller than the range of the preset variation regarding the deviation angle are displayed. Equipped with a display panel
The user identification information is read from the user identification information input means and sent to the authentication server.
When the input key displayed on the display panel is gazed at, the direction of the optical axis of the eyeball is measured by the camera, the measured direction of the optical axis of the eyeball, the spatial three-dimensional coordinates of the display panel, and the display panel. Send the pixel information of the to the authentication server,
A personal authentication system characterized by that. An input terminal in the personal authentication system of claim 5 .
The user identification information input means and
With the camera measuring means
With the display panel
A user identification information transmitting means for transmitting the user identification information read from the user identification information input means to the authentication server, and a user identification information transmitting means.
An input key display means for displaying the input key on the display panel,
Gaze state determining means for determining the state in which the input key is gazed, and
An optical axis measuring means that measures the direction of the optical axis of the eyeball with a camera when the input key is gazed at.
A coordinate transmission means that transmits the pixel information of the display panel, the orientation of the optical axis of the eyeball, and the spatial three-dimensional coordinates of the display panel to the authentication server.
Collation result output means that receives the collation result from the authentication server and outputs the collation result,
An input terminal consisting of. A program mounted on the input terminal of claim 6 .
Computer,
The user identification information transmitting means,
The input key display means,
A means for detecting a state in which the input key is gazed at,
The optical axis measuring means,
The coordinate transmitting means,
The collation result output means,
A program to function as. In the personal authentication method of entering the passcode with the line of sight,
When the user identification information is input and the input key displayed on the display panel is gazed at, the direction of the optical axis of the eyeball is measured by the camera, and the spatial three-dimensional coordinates of the display panel and the direction of the optical axis of the eyeball are measured. A personal authentication method characterized by performing authentication using a code corresponding to the input key on a display panel located in the direction of the optical axis registered in advance in association with the input user identification information. The personal authentication method consists of a registration step and an authentication step.
The registration step is
A user identification information setting step that sets user identification information for each user, and
The passcode determination step, in which the user himself determines the passcode,
For each user, an optical axis pre-measurement step of measuring the direction of the optical axis of the eyeball with a camera when the input key displayed on the display panel is gazed at.
A coordinate pre-calculation step that calculates the intersection coordinates of the optical axis of the eyeball and the display panel from the measured orientation of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel.
A storage step of registering a code corresponding to the input key located at the intersection coordinates in association with the user identification information.
Consists of
The authentication step is
User identification information input step to input user identification information,
An input key display step for displaying the input key on the display panel, and
A gaze state determination step for determining the state in which the input key is gazed, and
An optical axis measurement step for measuring the direction of the optical axis of the eyeball when the input key is gazed at by a camera, and
A coordinate calculation step that calculates the intersection coordinates of the optical axis of the eyeball and the display panel from the measured orientation of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel.
A code calculation step for calculating a code corresponding to the input key located in the direction of the optical axis of the eyeball from the pixel information of the display panel and the intersection coordinates.
A code matching step that matches the calculated code with the code registered in association with the user identification information,
The personal authentication method according to claim 8 , wherein the personal authentication method comprises. In an authentication system in which the input terminal and the authentication server are connected via a network
1) The authentication server is
The code corresponding to the input key located at the intersection coordinate of the optical axis of the eyeball and the display panel measured for each user is provided with a database stored in advance in association with the user identification information.
Corresponds to the input key located in the direction of the optical axis of the eyeball from the user identification information received from the input terminal, the pixel information of the display panel, the orientation of the optical axis of the eyeball, and the spatial three-dimensional coordinates of the display panel. Calculate the code to be used, collate it with the code stored in the database, and send the collation result to the input terminal.
The input terminal is
It is provided with a user identification information input means, a camera measurement means, and a display panel for displaying the input key.
The user identification information is read from the user identification information input means and sent to the authentication server.
When the input key displayed on the display panel is gazed at, the direction of the optical axis of the eyeball is measured by the camera, the measured direction of the optical axis of the eyeball, the spatial three-dimensional coordinates of the display panel, and the display panel. Send pixel information to the authentication server,
A personal authentication system characterized by that.