JP2017162420A - Personal authentication method and personal authentication system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a personal authentication method and a personal authentication system which allow personal authentication of a person of many subjects, using the line of sight, make a passcode more difficult to steal or make impersonation of the person more difficult, and increase the safety of passcode authentication.SOLUTION: In the personal authentication method using a line of vision for passcode input, the difference angle between the optical axis and the vision axis of eyeballs is measured on a user-by-user basis, and the passcode and the difference angle are related to user identification information and are registered in a database 31. After that, the user identification information is input, and the direction of the optical axis of the eyeballs is measured by a camera 23 when an input key displayed in a display panel 21 is gazed, and the gazed passcode is determined based on the three-dimensional coordinates of the display panel 21, the direction of the optical axis of the eyeballs, and the difference angle related to the input user identification information, and the gazed passcode is checked against the registered passcode for authentication.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a personal authentication method and a personal authentication system.

In general, as personal authentication when using a digital device, for example, a four-digit passcode (password) is keyed and collated with a number string stored in advance in a machine.
However, what is often used as a method of finding out the passcode is actually the simplest shoulder hack. This steals information by looking at the operation of the subject over the shoulder.
In recent years, with the rapid spread of mobile terminals, there is a risk that passcodes may be stolen by various methods such as voyeuring the movement of fingers with a small camera for unlocking the lock screen of mobile terminals. It is growing. Once a passcode has been stolen, it can be easily spoofed by simply typing the same key. In the future, if surveillance cameras with ultra-high resolution such as 4K and 8K will become widespread, it is considered that such danger will increase dramatically.
Moreover, if not only spoofing by a shoulder hack etc. but also spoofing can be prevented, security can be further improved.

Therefore, it is possible to use fingerprint authentication or gaze-based authentication that is more difficult to see, and that can prevent spoofing, rather than keying with a finger. Fingerprint authentication can be performed by touching the sensor while sleeping. It may be authenticated against the intention of On the other hand, if the authentication is based on the line of sight, the person himself / herself does not intend to input and it is safe.
The problem with eye gaze measurement is that there is a deviation angle of several degrees that varies from person to person between the optical axis of the eyeball measured from the outside and the gaze actually seen by the person (visual axis). It is. For this reason, accurate gaze measurement requires a process (calibration) in which a point designated in advance is watched and the person's deviation is measured. It is said that this deviation hardly changes once measured.

On the other hand, as an authentication device that prevents unauthorized authentication, the line-of-sight direction of the user captured in the image is specified, and the line-of-sight direction information is used to indicate the correspondence between the line-of-sight angle and the line-of-sight direction. And the authentication apparatus which authenticates an individual from the specific result is known (refer patent document 1).
However, the authentication method disclosed in Patent Document 1 does not specify an individual with the line-of-sight direction specifying information itself. In addition, the line-of-sight angle is as large as ± 20 ° and ± 10 °, and there is a problem that it is possible for another person who knows the direction of authentication permission to impersonate.

JP 2014-206932 A

  In view of the above situation, the present invention is capable of personal authentication from a large number of subjects using a line of sight, increasing the difficulty of impersonating the passcode and improving the safety of passcode authentication. An object is to provide a personal authentication method and a personal authentication system.

  In order to solve the above-mentioned problems, the personal authentication method of the present invention is a personal authentication method in which a passcode is input with a line of sight. When the user identification information is input and the input key displayed on the display panel is watched, the eyeball The direction of the optical axis is measured by the camera, the spatial three-dimensional coordinates of the display panel, the direction of the optical axis of the eyeball, and the optical axis and visual axis of the eyeball registered in advance in association with the input user identification information ( The pass code is calculated from the deviation angle (kappa angle) of the line of sight, and is verified by comparing with the registered pass code.

  According to the personal authentication method of the present invention, the passcode authentication is performed using the angle of deviation between the optical axis of the eyeball and the visual axis, thereby increasing the difficulty of passing the passcode and impersonating the passcode. Safety can be improved. In other words, unlike the case where a passcode is input with a finger, the angle of deviation (κ angle) between the optical axis of the eyeball and the visual axis is used for personal authentication, so the risk of the passcode being stolen by a shoulder hack is reduced. Since the line-of-sight information varies among individuals, it is also effective in preventing impersonation.

  Here, the angle of deviation (κ angle) between the optical axis of the eyeball and the visual axis is a feature value that takes a two-dimensional value in the vertical direction (up and down direction) and the horizontal direction (left and right direction). When measuring the deviation angle between the optical axis of the eyeball and the visual axis in advance, the deviation angle is acquired by using a known gaze measurement method or apparatus only once and performing calibration. By recording the orientation of the face for measuring the deviation angle as personal information, it can be used as more accurate personal information. Here, the direction of the face is the posture of the face when gazing at the input key, for example, a solid angle such as tilting 10 ° toward the left shoulder or tilting 15 ° toward the right shoulder. An orientation that affects a certain misalignment angle (κ angle). Even if you stand in front of the display panel and turn the face to the right and look at the input keys on the panel, the eyeball will also rotate as much as the face turns to the right, so the deviation angle (κ angle) will not change, If the head is tilted (rotated) around the neck toward the right shoulder, the misalignment angle (κ angle) will also rotate accordingly. As described above, when the gaze angle (kappa angle) is always in the same posture when gazing at the input keys on the front display panel, the gaze angle (kappa angle) is simply gaze at the front with a horizontal eye with the face facing left or right. If you do, basically it does not depend on the measurement angle, but when you tilt the face to the right shoulder or left shoulder and gaze at the input key, the measurement angle of the face direction is corrected for the deviation angle (κ angle) It becomes important as an angle. Therefore, when measuring the deviation angle in advance, it is preferable to measure the direction in which the deviation angle is measured to obtain an accurate deviation angle. That is, in order to use it as accurate personal information, when measuring the direction of the optical axis of the eyeball, measurement angles such as the direction and inclination of the face are measured. The measurement angle also takes a two-dimensional value like the deviation angle.

  The pass code is not limited to numerals and alphanumeric characters, and is a code including other characters, symbols, and figures, and is determined by the user himself or the provider of the personal authentication service. The passcode may be, for example, a three-digit or four-digit number, but may be something that looks at a specific part (feature point), a gesture-like one, or other. Although there is a difference in the level of safety, a single digit number may be used.

When the input key is watched, camera measurement is performed to measure the direction of the optical axis of the eyeball. For example, the face is photographed by two cameras having different imaging angles in which the positional relationship between the cameras is fixed, and the direction of the optical axis of the eyeball is measured using a world coordinate system (global coordinate system). As a method for measuring the direction of the optical axis of the eyeball, a known measurement method may be used. If the positional relationship between the shape of the display panel on which the input key is displayed and the camera is known, the world coordinates (spatial three-dimensional coordinates) of the display panel can be known. Furthermore, if the pixel information in the input key display screen of the display panel is known, the world coordinates of each input key can be known. Here, the pixel information is information indicating which pixel a specific input key is displayed on.
The direction of the optical axis of the eyeball is acquired using the world coordinate system. The direction of the optical axis of the eyeball can be represented by the pupil center coordinates and the intersection coordinates of the optical axis of the eyeball and the display panel surface. Then, from the pixel information of the display panel, the direction of the optical axis of the eyeball, and the misalignment angle associated with the input user identification information, the gaze point on the display panel, that is, the gaze pass code is calculated. Can do.

In the personal authentication method of the present invention, for each user, after measuring the deviation angle between the optical axis of the eyeball and the visual axis and registering the passcode and the deviation angle in association with the user identification information, the personal authentication is performed. Do.
Alternatively, in the personal authentication method of the present invention, a passcode is set in advance for each user, and the direction of the optical axis of the eyeball when gazing at the input key corresponding to the passcode displayed on the display panel is measured by the camera. Then, after the misalignment angle from the input key area is registered in association with the user identification information as the misalignment angle between the optical axis of the eyeball and the visual axis, personal authentication is performed.

Specifically, the personal authentication method of the present invention includes the following registration step and authentication step.
First, the registration step includes the following 1) to 4).
1) User identification information setting step for setting user identification information for each user 2) Passcode setting step for setting a passcode for each user 3) Measuring a deviation angle between the optical axis of the eyeball and the visual axis for each user Deviation angle measurement step 4) Storage step of registering the passcode and the deviation angle in association with the user identification information

Next, the authentication step includes the following 5) to 11).
5) User identification information input step for inputting user identification information 6) Input key display step for displaying input keys on the display panel 7) Gaze state determination step for determining the state in which the input key is watched 8) The input key is watched Optical axis measurement step 9 for measuring the direction of the optical axis of the eyeball at the time of shooting. The intersection of the optical axis of the eyeball and the display panel is determined from the measured direction of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel. Coordinate calculation step for calculating 10) Passcode calculation step for calculating a watched passcode from the pixel information of the display panel, the above-mentioned intersection coordinates, and the shift angle associated with the input user identification information 11) Calculation Passcode verification step for verifying passcodes and preset passcodes

  In the personal authentication method of the present invention, it is more preferable to calculate the visual axis using the registered deviation angle from the optical axis of the eyeball by measuring the orientation of the face when the input key is watched. By measuring the orientation of the face, the visual axis of the eyeball can be calculated with high accuracy.

  In the personal authentication method of the present invention, when the input key is displayed on the display panel, it is preferable to change the size or shape of the input key according to the distance between the user and the display panel. The viewing angle size of the input key is preferably larger than the range of camera measurement errors and smaller than a preset range of variation with respect to the shift angle. If the size of the key is smaller than the range in which the line-of-sight measurement is varied, the authentication accuracy of the person is deteriorated even if calibration is performed, that is, the person rejection rate is increased. On the other hand, if the size of the key exceeds a preset range of variation with respect to the misalignment angle, it becomes possible for another person to impersonate if the passcode is stolen by another method. Therefore, it is provided in the above range.

  The variation of the measurement value in the line-of-sight measurement can be set to 1 to 2 °. On the other hand, the range of the variation value between the users is 5 to 7 °. It is preferable to be determined on the assumption that the solid angle is 3 to 4 °. Thereby, it is possible to realize an authentication method in which a passcode is difficult to be stolen, authentication accuracy is high, and even if a passcode is stolen, it is difficult to be spoofed.

  In the personal authentication method of the present invention, the display of the input key arrangement is a random arrangement, an arrangement rotated from the arrangement of the previous display, an arrangement different from the arrangement of the previous display, the number of rows and columns of the matrix arrangement of the previous display. It is preferable to display on the display panel in an arrangement in which at least one of them is increased or an arrangement in which the interval between adjacent keys is changed. The security of authentication can be improved by changing the display of the input key arrangement.

  In the personal authentication method of the present invention, when calculating the intersection coordinates of the optical axis of the eyeball and the display panel, it is preferable to calculate the coordinates of the median value of the calculated coordinate distribution at a predetermined elapsed time from the start of gaze. Here, the predetermined elapsed time is 1.5 to 3 seconds, more preferably 2 seconds. When a person is gazing at something, the deviation angle (kappa angle) between the optical axis of the eyeball and the visual axis is constant, but there is blurring of the eyeball called fixation micromotion, and the gaze point is not fixed. . There are several types of microscopic eye movements, and even when a point is being watched, the eyeball rotates at about 1/3 ° and several Hz / second. Therefore, if a camera image in one frame is measured, an error occurs in the measurement of the κ angle. As a result of statistically investigating the variation in the coordinates of the intersection of the eyeball optical axis and the display panel when gazes at one point, the error from the average value in long-term measurement is less than the amplitude of fixation tremor. Is the coordinate of the median of the coordinate distribution calculated at any elapsed time in the range of 1.5 to 3 seconds from the start of gaze.

  In the personal authentication method of the present invention, the user identification information is at least one of a user ID, fingerprint information, palm print information, and iris information. For identification of a user, an ID card storing a user ID is usually used. However, iris data, fingerprint data, palm print data, and other data that can identify an individual may be used in combination.

  In the gaze state determination step in the personal authentication method of the present invention, specifically, the gaze state is determined by gaze time detection, deterministic operation detection, or definite intention detection. Here, the gaze time detection is, for example, detecting that a certain point on the display panel is gaze for 3 seconds. In addition, the deterministic operation detection is a button operation at the timing when the user gazes at a specific input key, detects the button operation to confirm the gaze state, a touch operation on the touch panel, or imaging data from the camera. In this image processing, the movement of a part of the body is detected to determine the gaze state. Moreover, definite intention detection is detecting a definite intention by the measurement of an electroencephalogram, for example.

Next, the personal authentication system of the present invention will be described.
The personal authentication system of the present invention is an authentication system in which an input terminal and an authentication server are connected via a network, and the input terminal and the authentication server have the following technical features.
1) Authentication server A database in which a deviation angle between the optical axis of the eyeball and the visual axis measured for each user and a set passcode is stored in advance in association with user identification information is provided.
The passcode watched from the user identification information received from the input terminal, the pixel information of the display panel, the direction of the optical axis of the eyeball, the spatial three-dimensional coordinates of the display panel, and the shift angle stored in the database Is calculated, collated with the passcode stored in the database, and the collation result is transmitted to the input terminal.
2) Input terminal A user identification information input unit, a camera measurement unit, and a display panel for displaying input keys are provided.
The user identification information is read from the user identification information input means and transmitted to the authentication server.
When the input key displayed on the display panel is watched, the direction of the optical axis of the eyeball is measured by the camera, the direction of the optical axis of the measured eyeball, the spatial three-dimensional coordinates of the display panel, and the display panel Send the pixel information to the authentication server.

  In the personal authentication system of the present invention, it is preferable to calculate the visual axis using the angle of deviation from the optical axis of the eyeball by measuring the orientation of the face when the input key is watched. Further, when the input key is displayed on the display panel, it is preferable to change the size or shape of the input key according to the distance between the user and the display panel. The viewing angle size of the input key is preferably larger than the range of camera measurement errors and smaller than a preset range of variation with respect to the shift angle. In addition, the display of the input key arrangement may be at least one of a random arrangement, an arrangement rotated from the arrangement of the previous display, an arrangement different from the arrangement of the previous display, and the number of rows and columns of the matrix arrangement of the previous display. It is preferable to display on the display panel in a different arrangement or an arrangement in which the interval between adjacent keys is changed. When calculating the intersection coordinates of the optical axis of the eyeball and the display panel, it is preferable to calculate the coordinates of the median value of the calculated coordinate distribution at a predetermined elapsed time from the start of gaze.

In the personal authentication system of the present invention, the user identification information input means is at least one of a card reading device, a fingerprint information reading device, a palmprint information reading device, and an iris information reading device on which a user ID is recorded.
It is preferable that the input terminal in the personal authentication system of the present invention is further provided with a gaze state determination unit of any one of a gaze time detection unit, a definite operation detection unit, and a definite intention detection unit.

The program installed in the authentication server according to the present invention includes an authentication server computer, user identification information reception means, deviation angle reading means, coordinate reception means, passcode calculation means, passcode verification means, verification in the personal authentication system of the present invention. This is a program for functioning as result transmission means.
The program installed in the input terminal of the present invention includes an input terminal computer, user identification information transmission means, input key display means, means for detecting a state in which the input key is watched, optical axis measurement means, coordinate transmission means, verification A program for functioning as result output means.

According to another aspect, the personal authentication method of the present invention is a personal authentication method in which a passcode is input with a line of sight when user identification information is input and an input key displayed on the display panel is watched. The direction of the optical axis of the eyeball is measured by the camera, the spatial three-dimensional coordinates of the display panel, the direction of the optical axis of the eyeball, and the direction of the optical axis of the eyeball registered in advance in association with the input user identification information Authentication is performed using a code corresponding to the input key on the display panel located at the location.
In the above method, paying attention to the fact that there is a misalignment angle between the optical axis of the eyeball and the visual axis, the code pointed to by the optical axis of the eyeball is impersonated as a password without storing the passcode on the system side, and personal authentication To do. The user watches the input key corresponding to the passcode determined by the user (the system does not know the passcode). Since there is a misalignment angle between the optical axis of the eyeball and the visual axis, the input key looked at by the user is different from the input key positioned in the direction of the optical axis of the eyeball. As a premise, the viewing angle size of the input key needs to be larger than the range of camera measurement error and smaller than the preset variation range with respect to the deviation angle between the optical axis of the eyeball and the viewing axis.
Since the code corresponding to the input key positioned in the direction of the optical axis of the eyeball can be recognized by the system, it is preliminarily registered in association with the user identification information by imitating it with the passcode determined by the user. It is.
Similarly, at the time of authentication, a code corresponding to the input key positioned in the direction of the optical axis of the eyeball when the input key is watched is obtained, and a code registered in association with the user identification information (a code imitated with a pass code) ) And personal authentication.

In this method, it is a precondition that the positional relationship between the position of the eyeball, the camera measurement device, and the display panel is fixed. In addition, the arrangement of the input keys displayed on the display panel needs to be fixed. For this reason, the user needs to behave in the same way at every authentication, such as the standing position and the orientation of the face, but these behaviors are information that only the user can know, like the passcode, and in that sense the security level is improved. I can say that. Although the arrangement of the input keys displayed on the display panel is fixed, for example, by measuring the distance between the display panel and the user and changing the size of the input key according to the distance, the user's standing position is somewhat It does not matter even if it gives the degree of freedom.
By measuring the distance between the display panel and the user and changing the size of the input key according to the distance, the user's standing position may have some degree of freedom. In addition, when considering two types of misalignment angles (3 ° and 5 °) when the distance between the display panel and the user is 30 cm, tan 3 ° is 1.5 cm and tan 5 ° is 2.6 cm. It can be seen that even if the distance of the standing position changes and the distance changes by about 5 cm, the deviation of the optical axis of the eyeball on the display panel and the coordinate of the intersection of the display panel due to the deviation angle does not change so much. However, the orientation of the face is important, and authentication is performed while checking the position of the user's own face, such as by installing a mirror on the display panel or by using application software to make a part of the panel a mirror-like panel. Is preferred.
As an alternative to the code corresponding to the input key on the display panel located in the direction of the optical axis of the eyeball, the intersection coordinates of the optical axis of the eyeball and the display panel are registered, and the intersection coordinates obtained at the time of authentication are registered. It may be possible to authenticate based on whether or not it is within a certain distance from the determined intersection coordinates.

Specifically, a personal authentication method according to another aspect includes the following registration step and authentication step.
The registration step includes the following 1) to 5).
1) User identification information setting step for setting user identification information for each user 2) Passcode determination step for determining the passcode by the user himself 3) When an input key displayed on the display panel is watched for each user , Optical axis pre-measurement step for measuring the direction of the optical axis of the eyeball with the camera 4) Calculate the intersection coordinates of the optical axis of the eyeball and the display panel from the measured optical axis direction of the eyeball and the spatial three-dimensional coordinates of the display panel Pre-coordinate calculation step 5) A storage step of registering the code corresponding to the input key located at the intersection coordinates in association with the user identification information

The authentication step includes the following 6) to 12).
6) User identification information input step for inputting user identification information Step 7) Input key display step for displaying input key on display panel 8) Gaze state determination step for confirming state where input key is watched 9) Input key is watched Optical axis measurement step for measuring the direction of the optical axis of the eyeball at the time of camera 10) The intersection of the optical axis of the eyeball and the display panel is determined from the measured optical axis direction of the eyeball and the spatial three-dimensional coordinates of the display panel. Coordinate calculation step 11) Code calculation step for calculating a code corresponding to the input key located in the direction of the optical axis of the eyeball from the pixel information of the display panel and the above-mentioned intersection coordinates 12) The calculated code and the user Code collation step for collating with codes registered in association with identification information

According to another aspect, the personal authentication system of the present invention is an authentication system in which an input terminal and an authentication server are connected via a network, and the input terminal and the authentication server have the following technical features.
A) Authentication server A database in which codes corresponding to input keys located at the intersection coordinates of the optical axis of the eyeball and the display panel measured for each user are stored in advance in association with the user identification information.
Corresponds to the input key located in the direction of the optical axis of the eyeball from the user identification information received from the input terminal, the pixel information of the display panel, the direction of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel The code is calculated, collated with the code stored in the database, and the collation result is transmitted to the input terminal.
B) Input terminal A user identification information input unit, a camera measurement unit, and a display panel for displaying input keys are provided.
The user identification information is read from the user identification information input means and transmitted to the authentication server.
When the input key displayed on the display panel is watched, the direction of the optical axis of the eyeball is measured by the camera, the direction of the optical axis of the measured eyeball, the spatial three-dimensional coordinates of the display panel, and the display panel Send the pixel information to the authentication server.

  According to the personal authentication method and the personal authentication system of the present invention, it is possible to perform personal authentication from among a large number of subjects using a line of sight, which increases the difficulty of passcode authentication and impersonation. It has the effect of improving safety.

Schematic diagram of the personal authentication system of the first embodiment Image diagram of authentication step in embodiment 1 Illustration of interactive password Explanatory diagram of side-by-side passcode input for users with misalignment angle (κ angle) on top Explanatory drawing of passcode input in vertical alignment for users with misalignment angle (κ angle) on top Measurement example of deviation angle (kappa angle) Relationship diagram of average value, median value, and mode value in short-time measurement when the average value in long-time measurement with normal distribution is used as the solution Distribution chart of deviation angle (κ angle) Example of assigning size to 9 people actually measured, where n is 3 Figure defining the distribution range of deviation angle (κ angle) Diagram showing the screen size to be displayed on the screen and the range where the optical axis of the eyeball should be measured It is an example of a key arrangement in a display screen, (1) shows a ten key system and (2) shows a random system. The figure which showed dispersion of deviation angle (kappa angle) of ten users Example of changing the key size on the display screen Relationship between the optical axis of the eyeball and the visual axis Processing flow of registration step and authentication step in personal authentication method of embodiment 1 Data communication flow between input terminal and authentication server in personal authentication system of embodiment 1 An example of a database table Functional block diagram of personal authentication system Processing flow of registration step and authentication step in personal authentication method of embodiment 3 Data communication flow between input terminal and authentication server in personal authentication system of embodiment 3

  Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. The scope of the present invention is not limited to the following examples and illustrated examples, and many changes and modifications can be made.

In human vision, there is a gap between the visual axis (the axis connecting the eyeball and the center of the object perceived by vision) and the optical axis of the eyeball (the geometrical central axis when the eyeball is viewed as a rotating body). It is known that there is a deviation of about 5 °. This is called the κ angle (deviation angle between the optical axis of the eyeball and the visual axis).
The visual axis depends on the position of the most densely distributed pyramidal cells located at the center of the macula of the eyeball, which is called the fovea, that is, the portion with the best visual acuity. As shown in FIG. 15, there are individual differences in the position of the fovea. Note that the optical axis of the eyeball can be measured from the outside, whereas the visual axis depends on human perception, and when the gaze measurement device based on the three-dimensional model is not used, the optical axis is measured from the outside. Hateful.

By the way, in a general line-of-sight measuring device that is commercially available, a two-dimensional plane of a display is associated with a two-dimensional plane of a camera that has photographed an eyeball to measure where a person is looking.
Therefore, before using the apparatus, for example, calibration is performed so that five points on the screen are seen and the display coordinates at that time are associated with the coordinates of the eyeballs photographed by the camera. In general, in a line-of-sight measuring apparatus that does not perform calibration, about 5 ° corresponding to the κ angle is not calibrated and remains as an error.

  In this embodiment, by using a gaze measuring device based on a three-dimensional model, using a plurality of cameras and light sources, the optical axis of the eyeball is calculated as a three-dimensional vector, and the optical axis of the eyeball and the visual axis are calculated. A three-dimensional vector of the visual axis is obtained by obtaining and correcting the deviation, that is, the κ angle. The intersection of this vector and the object is the point of interest. That is, the content of calibration is different from that of a general line-of-sight measurement apparatus.

In a general line-of-sight measurement device, parameters used for calibration depend on the arrangement of a display, a camera, and the like, whereas the κ angle may be considered to be always constant.
Like the height, the κ angle is considered to be a normal distribution, although there are individual differences, and may have the same value. Therefore, an individual cannot be identified using itself as a feature quantity like a fingerprint or a glow. However, while the height is a one-dimensional feature value, the κ angle is a feature value that takes two-dimensional values in the vertical and horizontal directions.
Further, the orientation of the face when the κ angle is measured, that is, the measurement angle is also recorded as personal information. This is because without such information, it cannot be used as accurate personal information. Here, the reference angle is horizontal and vertical.

FIG. 1 is a schematic diagram of a personal authentication system according to the first embodiment. As shown in FIG. 1, the personal authentication system 1 includes an input terminal 2, an authentication server 3, and a network 5. The input terminal 2 includes a display device 21 that displays a screen, a confirmation device 22 that determines an input by line of sight, A measuring device 23 for measuring the optical axis of the eyeball and an identification device 24 for identifying an individual are provided.
The network 5 is used for data transmission / reception between the input terminal 2 and the authentication server 3. Unlike the present embodiment, the network 5 may not be provided, and a stand-alone device in which the input terminal 2 and the authentication server 3 are directly connected may be used.
The authentication server 3 collates the database 31 for storing data with the input data in the collating means 32 and determines whether or not authentication is possible. The result is transmitted to the input terminal 2 through the network 5.

In order to measure the misalignment angle (κ angle), it is necessary to accurately extract the intersection coordinates of the optical axis of the eyeball and the display panel (hereinafter referred to as “optical axis coordinates of the eyeball”).
When a person is gazing at something, the κ angle is constant, but there is blurring of the eyeball, called fixation fixation, and the gazing point is not fixed. There are several types of microscopic eye movements, and even when a point is being watched, the eyeball rotates at about 1/3 ° and several Hz / second. Therefore, if a camera image in one frame is measured, an error occurs in the measurement of the κ angle.

  FIG. 6 shows a measurement example of the deviation angle (κ angle). In this example, a 15-inch display with a horizontal (x coordinate) of 1024 pixels and a vertical (y coordinate) of 768 pixels is installed, and the distance to a person is fixed at 50 cm. Using a line-of-sight measuring device based on a three-dimensional model, the frequency of the x-coordinates of the optical axis of the eyeball when one point is watched is tabulated. (1) is the frequency when gazes for 3 seconds, which is the blinking interval of the person when relaxing, (2) is the gaze when 90 gps are performed to measure the exact gaze point Indicates frequency. As shown in FIG. 6 (1), in the gaze measurement in a short time, the appearance coordinates of the coordinates of the point of gaze are not a normal distribution. On the other hand, as shown in FIG. 6 (2), the normal distribution is obtained in the long-time measurement.

FIG. 7 shows a relationship diagram of the average value, the median value, and the mode value in the measurement in a short time when the average value in the long-time measurement having a normal distribution is used as a solution. That is, it indicates how many frames are converged with respect to the optical axis coordinate of the eyeball. The processing speed of the personal authentication system of this embodiment is about 15 frames / second.
Since it is considered that the error should be smaller than the amplitude of fixation fixation (10 pixels or less in this experiment), as shown in FIG. 7, taking the median value for 2 seconds from the start of gaze is accurate in a short time. It can be seen that there is an optimum for obtaining the optical axis coordinates of the eyeball. Therefore, in this embodiment, a median value of 2 seconds from the start of gaze is taken and used.

  Since what kind of screen should be displayed on the display device of the authentication terminal is related to the robustness of the system (= person rejection rate) and safety (= other people acceptance rate) in addition to the human visual characteristics, How this should be designed is very important.

FIG. 8 is a distribution diagram of the deviation angle (κ angle). Although the κ angle is about 5 °, it is distributed in two-dimensional coordinates in the vertical direction and the horizontal direction, and is actually considered to be a normal distribution as shown in FIG. Considering human visual characteristics, the structures of the left and right eyeballs are not completely the same, and the position of the fovea is not necessarily symmetrical. There are also benefits. Under such conditions, it is necessary to note that information from the optic nerve is properly processed and perceived in the brain (= theoretically, the visual axis cannot be measured from the outside). In particular, when the κ angle of only one eye of the left eye or the right eye is measured, there is a high possibility that the distribution will be wider than that in FIG. This is because the movements of the left and right eyeballs are the same, and even if eye gaze measurement is performed using the κ angle measured with one eye, the error does not increase, but the eyeball on the non-effective side sees a different point from the object. This is because there is a high possibility that
In any case, the key size can be determined from the distribution of κ angles. First, the minimum size depends on the measurement error of the individual κ angle. This is considered to be mainly in the range obtained by adding the error due to the above-mentioned fixation fine movement and the measurement error of the system. This length is defined as l _min .

Second, the maximum key size depends on security. The k-angle distribution is divided into n equal parts according to the frequency. The distance at the time of division is short in the center in both the vertical direction and the horizontal direction, and becomes longer as it spreads to the periphery. Among these, the minimum length is l _max . Since the vertical direction and the horizontal direction are equally divided into n, the probability that a user is impersonated as another user is 1 / n ² . At this time, if the key becomes larger than the size, the probability of impersonation increases. On the other hand, if n is too large, it will be smaller than l _min and the individual cannot be identified. FIG. 9 is an example in which n is set to 3 and size allocation is performed for nine actually measured people. Since the number of people to be measured is small, it is not one person in each frame. However, if the number of people increases, the number of people in the frame is considered to match 1 / n ² .

  In this embodiment, it is assumed that the number of users of the system is large, and the distribution is divided so as to minimize the probability of impersonation. When only a few people use it, such as the key of a house or a car, it may be set so as to reject κ angles other than users.

From the above, assuming that the key size, i.e., the length of one side of the _key is l _key , the size of the key in the screen display is within the range shown in the following equation 1 by using l _min and l _max described above. That's fine.

(Equation 1)
_lmax > _lkey > _lmin ... (Formula 1)

  FIG. 10 shows a diagram defining the distribution range of the deviation angle (κ angle). This is a surface including all of the distribution of FIG. 9 when the left eye is measured at an angle of 0 °. Here, normally, there is a shift in the upward direction, and in the left eye, the shift in the right direction is larger.

FIG. 11 is a diagram showing a screen size displayed on the screen and a range in which the optical axis of the eyeball should be measured.
Assuming that the screen size to be displayed on the screen is an inter-individual width of 6, the lower right shift with respect to the upper left, the lower left shift with respect to the upper right, the upper right shift with respect to the lower left, and the upper left shift with respect to the lower right. Since it is necessary for the user to be able to measure, as a whole, the range in which the optical axis of the eyeball should be measured is determined as the visual line measurement target range 7. For this, a camera or a light source may be arranged by a known method.

The key may be displayed in any manner as long as it is within the above-described size and range. However, the safety changes depending on the arrangement.
FIG. 12 shows an example of the key arrangement on the display screen, where (1) shows the ten-key method and (2) shows the random method. As shown in FIG. 12 (1), when the numeric keypad is fixedly displayed, the κ angle is always constant, so the κ angle can be estimated from inputs such as 1, 2, 3 or 4, but FIG. If a random key as shown in 2) is used, it is difficult to estimate the κ angle because it can be input by looking at a different 1 even if it is input as 1. In this embodiment, a ten key method is adopted.
By transmitting the key layout screen from the authentication server and displaying it on the input terminal, the security of key input can be improved.

Hereinafter, a method of using the personal authentication system 1 will be described.
Use of the personal authentication system 1 is divided into a registration step and an authentication step.
First, in the registration step, a personal ID is issued in advance, and the service provider or the person determines a passcode corresponding to the ID. In addition, the κ angle and the measurement angle are used. Here, the gaze angle and the measurement angle are obtained by using the line-of-sight measurement apparatus into which the three-dimensional model is introduced only once and performing calibration.

The κ angle and the measurement angle are recorded in the database of the authentication server and are also used as part of the passcode. In this case, on the input terminal side, if the pixel information of the display device and the coordinates of the optical axis of the eyeball are sent, the passcode can be restored on the authentication server side. But since it is not entered, you can enter the passcode safely.
If necessary information is registered by the above method, the system can be used.

Next, the authentication step will be described. FIG. 2 shows an image diagram of the authentication step of the first embodiment.
As shown in FIG. 2, first, the identification device 24 reads the ID of the user 4 to identify which individual. The personal ID is generally a character string composed of numbers and characters, but convenience can be enhanced by using biometric information instead. In this embodiment, as shown in FIG. 2, a fingerprint is used as an ID. In this way, if the lock is released by using the fingerprint as the ID and the 4-digit PIN and κ angle as the passcode instead of the house or car key, even if the PIN is known, It is hard to impersonate others. Unlike this embodiment, a magnetic card or character input may be used.

  Next, information is input by looking at the screen display of the display device 21. However, in the case of the input by the line of sight, there is a problem of mid-touch problem. This means that, for example, an unintended operation such as an input just by looking is caused. Therefore, it is necessary to have a confirmation device 22 for confirming the input by the line of sight, such as detecting that the user has watched for several seconds or pressing a button. At this time, the measuring device 23 measures the optical axis of the user's eyeball. The data measured in this way is sent to the authentication server 3 via the network 5.

  The authentication server 3 verifies the passcode based on the transmitted data. That is, the passcode is restored by the authentication server using the pixel information of the display device, the κ angle, and the measurement angle information. The restored passcode is compared with the passcode entered in the registration step, and if this matches, the authentication is completed.

FIG. 3 shows an explanatory diagram of the interactive password. Here, the interactive password refers to a mechanism for interactively inputting a password using the already recorded κ angle and measurement angle, and this embodiment uses such a mechanism. “Password” is used synonymously with “passcode”.
As shown in FIG. 3, display images (21 a and 21 b) to be displayed on the display device 21 are transmitted in advance from the authentication server 3 to the input terminal 2 before the user 4 inputs the PIN.

  FIG. 4 is an explanatory diagram of side-by-side passcode input for a user with a misalignment angle (κ angle) on top, (1) is the input key arrangement, (2) is the movement of the line of sight (visual axis), (3 ) Indicates the movement of the intersection coordinates of the optical axis of the eyeball and the display panel. As shown in FIG. 4A, in the display image 21a, the numbers 1 to 9 are sequentially arranged from the upper left to the side. In the case of a user with a deviation angle (kappa angle) at the top and side-by-side passcode input, if the passcodes are in the order of 1, 2, 3, and 4, the movement of the line of sight (visual axis) is as shown in FIG. As shown by the arrows in (2), the images are viewed in the order of 1, 2, 3, and 4. On the other hand, the movement of the coordinate of the intersection between the optical axis of the eyeball and the display panel is 4 due to the influence of the deviation angle (κ angle) between the optical axis of the eyeball and the visual axis, as indicated by the arrow in FIG. It moves in the order of 5, 6, and 7.

FIGS. 5A and 5B are explanatory diagrams of vertically arranged passcode input for a user with a misalignment angle (κ angle) on top, where (1) is the input key arrangement, (2) is the movement of the line of sight (visual axis), 3) shows the movement of the intersection coordinates of the optical axis of the eyeball and the display panel. As shown in FIG. 5 (1), in the display image 21b, the numbers 1 to 9 are arranged in order from the upper left. If the user has a gap angle (kappa angle) at the top and the passcodes are arranged vertically, if the passcodes are in the order of 1, 2, 3, 4, the movement of the line of sight (visual axis) As shown by the arrow 5 (2), the images are viewed in the order of 1, 2, 3, and 4. On the other hand, the movement of the coordinate of the intersection between the optical axis of the eyeball and the display panel moves in the order of 2, 3 and margins 21e and 5 as indicated by the arrows in FIG.
Thus, even if the numbers are the same, the coordinates of the intersection between the optical axis of the eyeball and the display panel change due to the effect of the deviation angle (κ angle) between the optical axis of the eyeball and the visual axis. It becomes difficult to estimate the angle (κ angle).

Using the personal authentication system 1 of the present example, the distribution of deviation angles (κ angles) was measured.
First, in order to determine the button size (the width of the button), the variance of the visual axis of 10 experiment cooperators was extracted. The standard deviation between individuals is 103.0971245 in the x-axis direction and 70.5036246 in the y-axis direction, whereas the standard deviation within the individual is 45.032507907 in the x-axis direction and 35.66319922 in the y-axis direction. Therefore, it was confirmed that the following formula 2 was established.

(Equation 2)
l _max > l _min (Formula 2)

FIG. 13 is a diagram showing dispersion of κ angles of 10 users. The distribution of κ angles is divided into three equal parts according to the frequency. Since a pixel has a threshold value of about 150 px square, a 150 px square button was set. Further, since this value is equal to a value obtained by dividing l _max by nine, the following expression 3 is established.

(Equation 3)
l _max > l _key (Formula 3)

Using the personal authentication system 1 of this example, the self-authentication rate and the other person exclusion rate were measured.
First, it was confirmed that the user set his / her passcode “3759” and entered the 100% system under 10 trials. Next, assuming that the passcode “3759” was stolen, ten trials were made to see if a person other than the user could enter the system. As a result, the penetration success rate was 0%.

  FIG. 16 shows a processing flow of the registration step and the authentication step. As shown in FIG. 16, in the registration step, first, user identification information is set for each user (S01). A passcode is set for each user (S02). The deviation angle between the optical axis of the eyeball and the visual axis is measured for each user (S03). In the storing step, the passcode and the deviation angle are registered in association with the user identification information (S04). The data registered in the storing step is written into the database.

  As shown in FIG. 16, in the authentication step, first, user identification information is input (S11). The input key is displayed on the display panel (S12). The state in which the input key is watched is determined (S13). The direction of the optical axis of the eyeball when the input key is watched and the measurement angle are measured by the camera (S14). The optical axis of the measured eyeball and the world coordinates of the display panel are calculated (S15). The watched passcode is calculated from the pixel information of the display panel, the optical axis coordinates of the eyeball, the shift angle associated with the input user identification information, and the measurement angle (S16). The preset passcode is read from the database, and the calculated passcode is collated with the preset passcode (S17). If authentication results in an error as a result of verification and authentication is attempted again, the authentication step is performed again (S11 to 17).

FIG. 17 shows a flow of the personal authentication system. For example, when the input terminal reads user identification information such as a user ID, the user identification information is transmitted from the input terminal to the authentication server. On the authentication server side, the deviation angle and passcode are read from the database using the received user identification information. When the user gazes at the input key displayed on the display panel (for example, if the passcode is a four-digit numeric code, gazes four numbers in order), the pixel information on the display panel, the optical axis coordinates of the eyeball (4 The four optical axis coordinates when the digit codes of the digits are closely watched) and the measurement angle are transmitted from the input terminal to the authentication server. A calculation passcode is calculated in the authentication server based on the deviation angle read from the database. The passcode is verified for the calculated passcode and the passcode read from the database. The verification result is transmitted from the authentication server to the input terminal.
Here, regarding the measurement of the measurement angle of the face orientation, if the authentication is performed under the condition that the face does not tilt, the measurement angle need not be measured.

  FIG. 18 shows an example of a database table. As shown in FIG. 18, when the personal ID is “10012345”, the pass code is registered as “468” and the deviation angle is registered as “(2 °, 1 °)”. When the personal ID is “10013501”, the pass code is registered as “7531” and the deviation angle is registered as “(1 °, 3 °)”.

FIG. 19 shows a functional block diagram of the personal authentication system. As shown in FIG. 19, it consists of an authentication server, an input terminal, and a network.
The authentication server includes a database, personal identification information receiving means, deviation angle / shift angle measurement angle reading means, coordinate receiving means, passcode calculating means, passcode collating means, and collation result transmitting means.
In the authentication server, personal identification information acquired by the personal identification information receiving means via the network is stored in a database. From the database, information on the deviation angle is sent to the deviation angle / deviation angle measurement angle reading means, and the pass code is sent to the pass code verification means. Information on the coordinates and measurement angles is sent to the coordinate receiving means via the network, and is sent to the passcode calculating means. The calculated passcode is sent from the passcode calculating means to the passcode collating means. The verification result is sent from the passcode verification means to the verification result transmission means.

The input terminal includes user identification information input means, user identification information transmission means, camera measurement means, gaze state determination means, optical axis measurement means, coordinate transmission means, input key display means, display panel, and verification result output means.
In the input terminal, the input key is displayed on the display panel by the input key display means. The user identification information input by the user identification information input means is sent to the authentication server via the network by the user identification information transmission means. Information obtained by the camera measurement unit and the gaze state determination unit is sent to the optical axis measurement unit. Information on the coordinates / measurement angle is sent to the authentication server via the network by the coordinate transmission means. Further, the verification result received from the authentication server is output by the verification result output means.

FIG. 14 shows an example in which the key size on the display screen is changed. As shown in FIG. 14, when the key size is changed for each measurement, the coordinates of the gazing point change even when the same number is viewed. However, since the viewing angle depends on both the position of the head and the screen display, the viewing angle varies depending on the position of the head even if the display is the same.
In addition to the arrangement, movement, enlargement / reduction, and rotation as described above, robustness and safety can be improved by changing the arrangement interval and changing the shape. In that case, it is preferable to use an image that is difficult to analyze on the input terminal side.

  The personal authentication method according to the third embodiment is a personal authentication method in which a passcode is input with a line of sight. When the user identification information is input and the input key displayed on the display panel is watched, the direction of the optical axis of the eyeball is changed. Input on the display panel that is measured by the camera and positioned in the direction of the optical axis of the eyeball registered in advance in association with the spatial three-dimensional coordinates of the display panel, the direction of the optical axis of the eyeball, and the input user identification information In this method, authentication is performed using a code corresponding to a key.

  For example, it is assumed that the user determines his / her own passcode as 1, 2, 3, 4 and remembers it. When the input keys displayed on the display panel are as shown in FIG. 4 (1) and the user gazes at 1, 2, 3, and 4 in order, as shown by the arrows in FIG. 4 (2). The intersection coordinates of the line of sight (visual axis) and the display panel move. On the other hand, the coordinates of the intersection of the optical axis of the eyeball and the display panel are 4, 5, 6, as indicated by the arrows shown in FIG. 4 (3) due to the influence of the deviation angle (κ angle) between the optical axis of the eyeball and the visual axis. It will move in the order of 7. On the system side, the order of 4, 5, 6 and 7 is assumed to be a user password and stored in association with user identification information.

The user always keeps the same standing position when looking at the input keys displayed on the display panel, and by paying attention to 1, 2, 3, and 4 that are remembered as the passcode in order, the system side, the optical axis of the eyeball Since the intersection coordinates of the display panel are 4, 5, 6, and 7, authentication is performed.
As described above, in the case of the personal authentication method according to the third embodiment, the system does not need to calculate the deviation angle (κ angle) between the optical axis of the eyeball and the visual axis. Furthermore, since the user must remember the standing position other than the passcode, this may become information that only the user can know and may become a stronger passcode. For example, if the size of the input key displayed on the display panel is fixed, and the user looks back from the correct standing position, when the user gazes at 1, the intersection coordinates of the optical axis of the eyeball and the display panel are affected by the shift angle. It appears even larger and becomes 7. On the other hand, when approaching the display panel from the correct standing position, when the gaze is 1, the intersection coordinates of the optical axis of the eyeball and the display panel become the same 1 due to the effect of the deviation angle. That is, when the standing position is changed, it does not match the code stored in association with the user identification information (the code imitated with the pass code) and is not authenticated. In this respect, the standing position is also an element of personal authentication.

  FIG. 20 shows a processing flow of the registration step and the authentication step in the personal authentication method of the third embodiment. As shown in FIG. 20, in the registration step, first, user identification information is set for each user (S21). The user determines his / her passcode (S22). Here, it is only necessary for the user to remember the determined passcode, and it is not necessary to set and register it on the system side. Next, for each user, when the input key displayed on the display panel is watched, the direction of the optical axis of the eyeball is measured by the camera (S23). Then, the intersection coordinates of the optical axis of the eyeball and the display panel are calculated from the measured direction of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel (S24). And the code | cord | chord corresponding to the input key located in an intersection coordinate is linked | related with user identification information, and is registered into a database (S25).

  As shown in FIG. 20, in the authentication step, first, user identification information is input (S31). The input key is displayed on the display panel (S32). The state in which the input key is watched is determined (S33). The direction of the optical axis of the eyeball when the input key is watched and the measurement angle are measured by the camera (S34). The optical axis of the measured eyeball and the world coordinates of the display panel are calculated (S35). A code corresponding to the input key positioned in the direction of the optical axis of the eyeball is calculated from the pixel information of the display panel and the optical axis coordinates of the eyeball (S36). Then, the calculated code and the code registered in association with the user identification information are collated (S37). If authentication results in an error as a result of verification and authentication is attempted again, the authentication step is performed again (S31 to 37).

FIG. 21 shows a flow of the personal authentication system of the third embodiment. For example, when the input terminal reads user identification information such as a user ID, the user identification information is transmitted from the input terminal to the authentication server. On the authentication server side, the registered code is read from the database using the received user identification information. When the user gazes at the input key displayed on the display panel (for example, if the passcode is a three-digit numeric code, the user gazes at three numbers in order), the pixel information on the display panel and the optical axis coordinates of the eyeball (3 The three optical axis coordinates when the digit codes of the digits are closely watched are transmitted from the input terminal to the authentication server.
On the authentication server side, the code located in the direction of the optical axis is calculated from the pixel information on the display panel and the optical axis coordinates, this is compared with the code read from the database, and the verification result is sent from the authentication server to the input terminal. Is done.

  The present invention is useful for personal authentication using a line of sight.

DESCRIPTION OF SYMBOLS 1 Personal authentication system 2 Input terminal 3 Authentication server 4 User 5 Network 6 Individual dispersion | distribution width 7 Range of gaze measurement object 8 Eyeball 9 Fovea 10 Visual axis 11 Optical axis of eyeball 21 Display device 21a-21d Display screen 21e Outer margin 22 Determination device 23 Measuring device 24 Identification device 31 Database 32 Verification means W Button size

Claims (26)

In the personal authentication method of entering a passcode with a line of sight,
When the user identification information is input and the input key displayed on the display panel is watched, the direction of the optical axis of the eyeball is measured by the camera, the spatial three-dimensional coordinates of the display panel, and the direction of the optical axis of the eyeball And a personal identification method characterized in that a pass code is calculated from a deviation angle between the optical axis of the eyeball and the visual axis registered in advance in association with the input user identification information and collated with the registered passcode .   The personal authentication according to claim 1, wherein the personal authentication is performed after measuring the deviation angle for each user in advance and registering the passcode and the deviation angle in association with user identification information. Method.   For each user, a passcode is set in advance, the direction of the optical axis of the eyeball when gazing at the input key corresponding to the passcode displayed on the display panel is measured by the camera, and the deviation from the input key area is measured. The personal authentication method according to claim 1, wherein personal authentication is performed after a corner is registered in association with user identification information as the misalignment angle. The personal authentication method consists of a registration step and an authentication step.
The registration step is
A user identification information setting step for setting user identification information for each user;
A passcode setting step for setting a passcode for each user;
For each user, a deviation angle measuring step for measuring a deviation angle between the optical axis of the eyeball and the visual axis,
A storage step of registering the passcode and the misalignment angle in association with the user identification information;
Consisting of
The authentication step is
A user identification information input step for inputting user identification information;
An input key display step for displaying the input key on the display panel;
A gaze state determination step for determining a state in which the input key is watched;
An optical axis measurement step for measuring the direction of the optical axis of the eyeball when the input key is watched by the camera;
A coordinate calculation step of calculating the intersection coordinates of the optical axis of the eyeball and the display panel from the measured direction of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel;
A passcode calculating step for calculating a watched passcode from the pixel information of the display panel, the intersection coordinates, and the shift angle associated with the input user identification information;
A passcode verification step for verifying the calculated passcode with a preset passcode;
The personal authentication method according to claim 1, comprising:   5. The visual axis is calculated using the shift angle from the optical axis of the eyeball by measuring the orientation of the face when the input key is gazed. Personal authentication method.   The personal authentication method according to claim 1, wherein when the input key is displayed on the display panel, the size or shape of the input key is changed according to the distance between the user and the display panel.   The personal authentication method according to any one of claims 1 to 6, wherein a viewing angle size of the input key is larger than a range of camera measurement error and smaller than a predetermined range of variation with respect to the shift angle.   The display of the input key arrangement is random arrangement, arrangement rotated from the arrangement of the previous display, arrangement different from the arrangement of the previous display, arrangement in which at least one of the number of rows and columns of the matrix arrangement of the previous display is increased. The personal authentication method according to any one of claims 1 to 7, wherein the display is performed on the display panel in an arrangement in which the interval between adjacent keys is changed.   5. The personal authentication method according to claim 4, wherein when calculating the intersection coordinates, the coordinates of the median value of the calculated coordinate distribution at a predetermined elapsed time from the start of gaze are calculated.   5. The personal authentication method according to claim 4, wherein in the gaze state determination step, the gaze state is determined by gaze time detection, determination operation detection, or determination intention detection.   The personal authentication method according to claim 1, wherein the user identification information is at least one of a user ID, fingerprint information, palm print information, and iris information. In an authentication system in which an input terminal and an authentication server are connected via a network,
1) The authentication server
A deviation angle between the optical axis of the eyeball measured for each user and the visual axis and a set passcode are stored in advance in association with user identification information,
From the user identification information received from the input terminal, the pixel information of the display panel, the direction of the optical axis of the eyeball, the spatial three-dimensional coordinates of the display panel, and the misalignment angle stored in the database, the observed path Calculating the code, verifying it with the passcode stored in the database, and transmitting the verification result to the input terminal;
2) The input terminal is
User identification information input means, camera measurement means, and a display panel for displaying input keys,
Read the user identification information from the user identification information input means, send it to the authentication server,
When the input key displayed on the display panel is watched, the direction of the optical axis of the eyeball is measured by the camera, the direction of the optical axis of the measured eyeball, the spatial three-dimensional coordinates of the display panel, and the display panel Send pixel information to the authentication server,
A personal authentication system characterized by that.   The personal authentication system according to claim 12, wherein the visual axis is calculated using the shift angle from the optical axis of the eyeball by measuring the orientation of the face when the input key is watched.   14. The personal authentication system according to claim 12, wherein when the input key is displayed on the display panel, the size or shape of the input key is changed according to the distance between the user and the display panel.   The personal authentication system according to any one of claims 12 to 14, wherein the viewing angle size of the input key is larger than a range of camera measurement error and smaller than a predetermined range of variation with respect to the shift angle.   The display of the input key arrangement is random arrangement, arrangement rotated from the arrangement of the previous display, arrangement different from the arrangement of the previous display, arrangement in which at least one of the number of rows and columns of the matrix arrangement of the previous display is increased. The personal authentication system according to any one of claims 12 to 15, wherein the display is performed on the display panel in an arrangement in which the interval between adjacent keys is changed.   The coordinate of the median value of the calculated coordinate distribution in the predetermined elapsed time from the start of gaze is calculated when calculating the intersection coordinates of the optical axis of the eyeball and the display panel. The personal authentication system described in 1.   18. The user identification information input means is at least one of a card reading device, a fingerprint information reading device, a palmprint information reading device, and an iris information reading device in which a user ID is recorded. The personal authentication system described in any one. An authentication server in the personal authentication system according to claim 12,
The database;
User identification information receiving means for receiving user identification information from the input terminal;
Using the user identification information received from the input terminal, referring to the database, a deviation angle reading means for reading the deviation angle of the user,
Coordinate receiving means for receiving from the input terminal pixel information of the display panel, the direction of the optical axis of the eyeball, and the spatial three-dimensional coordinates of the display panel;
Passcode calculation means for calculating a watched passcode from the pixel information of the display panel received from the input terminal, the three-dimensional coordinates, and the shift angle;
Passcode verification means for verifying the calculated passcode and the passcode stored in the database;
A verification result transmitting means for transmitting the verification result to the input terminal;
An authentication server consisting of An input terminal in the personal authentication system according to claim 12,
The user identification information input means;
The camera measuring means;
The display panel;
User identification information transmitting means for transmitting user identification information read from the user identification information input means to an authentication server;
An input key display means for displaying the input key on the display panel;
Gaze state determination means for determining a state in which the input key is being watched;
An optical axis measuring means for measuring the direction of the optical axis of the eyeball by the camera when the input key is watched;
Coordinate transmission means for transmitting the pixel information of the display panel, the direction of the optical axis of the eyeball, and the spatial three-dimensional coordinates of the display panel to the authentication server;
A verification result output means for receiving the verification result from the authentication server and outputting the verification result;
An input terminal consisting of   21. The input terminal according to claim 20, further comprising a gaze state determination unit of any one of a gaze time detection unit, a definite operation detection unit, and a definite intention detection unit. A program installed in the authentication server of claim 19,
Computer
The user identification information receiving means;
The deviation angle reading means;
The coordinate receiving means;
The passcode calculating means,
The passcode verification means;
The verification result transmitting means;
Program to function as. A program installed in the input terminal of claim 20,
Computer
The user identification information transmitting means;
The input key display means;
Means for detecting when the input key is watched,
The optical axis measuring means;
The coordinate transmission means;
The collation result output means;
Program to function as. In the personal authentication method of entering a passcode with a line of sight,
When the user identification information is input and the input key displayed on the display panel is watched, the direction of the optical axis of the eyeball is measured by the camera, the spatial three-dimensional coordinates of the display panel, and the direction of the optical axis of the eyeball And a code corresponding to the input key on the display panel located in the direction of the optical axis registered in advance in association with the input user identification information, and performing personal authentication. The personal authentication method consists of a registration step and an authentication step.
The registration step is
A user identification information setting step for setting user identification information for each user;
A passcode determination step in which the user himself determines the passcode;
For each user, when an input key displayed on the display panel is watched, an optical axis pre-measurement step for measuring the direction of the optical axis of the eyeball by a camera;
A coordinate pre-calculation step of calculating the intersection coordinates of the optical axis of the eyeball and the display panel from the measured direction of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel;
A storage step of registering the code corresponding to the input key located at the intersection coordinates in association with the user identification information;
Consisting of
The authentication step is
A user identification information input step for inputting user identification information;
An input key display step for displaying the input key on the display panel;
A gaze state determination step for determining a state in which the input key is watched;
An optical axis measurement step for measuring the direction of the optical axis of the eyeball when the input key is watched by the camera;
A coordinate calculation step of calculating the intersection coordinates of the optical axis of the eyeball and the display panel from the measured direction of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel;
A code calculating step for calculating a code corresponding to an input key located in the direction of the optical axis of the eyeball from the pixel information of the display panel and the intersection coordinates;
A code verification step for verifying the calculated code and the code registered in association with the user identification information;
The personal authentication method according to claim 24, comprising: In an authentication system in which an input terminal and an authentication server are connected via a network,
1) The authentication server
A code corresponding to the input key located at the intersection coordinates of the optical axis of the eyeball measured for each user and the display panel is stored in advance in association with the user identification information,
Corresponds to the input key located in the direction of the optical axis of the eyeball from the user identification information received from the input terminal, the pixel information of the display panel, the direction of the optical axis of the eyeball and the spatial three-dimensional coordinates of the display panel Calculate the code, match the code stored in the database, and send the verification result to the input terminal.
2) The input terminal is
User identification information input means, camera measurement means, and a display panel for displaying input keys,
Read the user identification information from the user identification information input means, send it to the authentication server,
When the input key displayed on the display panel is watched, the direction of the optical axis of the eyeball is measured by the camera, the direction of the optical axis of the measured eyeball, the spatial three-dimensional coordinates of the display panel, and the display panel Send pixel information to the authentication server,
A personal authentication system characterized by that.