JP6674683B2 - Authentication processing apparatus and authentication processing method - Google Patents

Description

  The present invention relates to an authentication processing device and an authentication processing method for performing personal authentication of a person to be authenticated.

  2. Description of the Related Art Conventionally, in bank ATMs and the like, personal authentication requires a person to be authenticated to input a four-digit PIN (Personal Identification Number) code registered as a personal identification number, and the PIN code entered by the person to be authenticated Is determined by determining whether or not is correct.

  In general, a bank ATM has a touch sensor attached to a display device that displays a numeric keypad image and the like. When a person to be authenticated touches a display screen, the touch sensor detects the touch position and detects any touch position. By determining whether the key image has been touched, which number has been input is identified. As an input device for numbers or the like, for example, Patent Document 1 discloses a device capable of detecting a non-contact input.

Japanese Patent No. 5509391

  By the way, in the conventional personal authentication using a personal identification number, there is a possibility that the personal identification number may be stolen due to, for example, a situation in which the personal identification number is being stolen or viewed from behind. In other words, personal authentication using a personal identification number cannot be said to have high security because the personal identification number may be stolen by a relatively simple method such as voyeurism and prying eyes. If the password is stolen and the card information is stolen by skimming or the like to create a forged card, the victim is likely to suffer a great deal of damage.

  For this reason, in recent years, the use of personal authentication using biometric information based on fingerprints, hand vein patterns, irises, and the like has increased the number of cases in which personal authentication with high security is performed. I have.

  However, authentication using biometric information is highly secure, safe, and secure, but requires special authentication sensors such as fingerprint sensors, vein sensors, and iris sensors, and the introduction cost is considerably high. .

  Also, for example, when a fingerprint is used, for example, when a finger or a finger touches a very smooth metal or glass surface, a fingerprint pattern of sebum may be left on the surface of the glass or the like. Could be stolen. Also, the vein pattern of the hand may be stolen by being photographed by, for example, an infrared camera.

  Furthermore, biometric information such as a fingerprint is information that is unique to each person and cannot be replaced. For example, if the information is stolen in some way, it is necessary to newly register authentication information. There is also a problem that it becomes very difficult.

  In addition, when a fingerprint is used for authentication, fingerprint collection is performed, and many people have a feeling of resistance to fingerprint collection. When information such as a fingerprint or a vein of a hand is used as the biometric information, the person to be authenticated must bring his / her finger or palm into contact with the authentication sensor provided in the authentication device. However, not a few people have an aversion to touching the authentication sensor touched by an unspecified number of people.

  The present invention has been made in view of such a problem, and provides an authentication processing apparatus and an authentication processing method that enable personal authentication with extremely high security without touching an authentication sensor or the like. The purpose is to:

An authentication processing device according to the present invention includes a coordinate detecting unit that detects three-dimensional coordinates of a detection target object in a three-dimensional space at predetermined time periods, and a plurality of selection units respectively corresponding to a plurality of code information used for an authentication code. Image display means for displaying a target image on a screen, a virtual two-dimensional plane set in the three-dimensional space, display coordinates of the plurality of selection target images in the screen, and virtual coordinates in a virtual two-dimensional plane By analyzing the three-dimensional coordinates of the detection target object, a plurality of parts constituting the detection target object are identified by analyzing the three-dimensional coordinates of the detection target object. When a predetermined movement due to the identified part is detected in the three-dimensional space in a state corresponding to the virtual coordinates in a three-dimensional plane, the selected pair is determined by the identified part. Performing an authentication determination based on analysis means for determining that an image has been selected, code information corresponding to the selection target image determined to have been selected by the analysis means, and code information of an authentication code registered in advance. possess an authentication decision means, a plurality of code information used for the authentication code is a number from 0 to 9, the image display means, the image of the numerals 0 to 9 as a plurality of selection images the screen In the case where the object to be detected is the hand of the person to be authenticated, the analysis means individually identifies each finger part, and performs a predetermined operation using one of the finger parts. Each time a motion is detected, a candidate array comprising each digit of the selection target image corresponding to each finger portion of the hand and each identification information of each finger portion corresponding to each digit is obtained, Authentication determination means The number and the identification information of each sequence in the authentication code in which the numbers arranged in order and the identification information of the finger parts corresponding to the numbers are registered in advance, and the predetermined movement are detected. The authentication determination of the person to be authenticated is performed by determining the match between the number in the candidate sequence and the identification information in each of the determined orders .

Further, the authentication processing device of the present invention includes a coordinate detecting unit that detects three-dimensional coordinates of a detection target in a three-dimensional space at predetermined time periods, and a plurality of code units respectively corresponding to a plurality of code information used for the authentication code. Image display means for displaying a selection target image in a screen, and setting a virtual two-dimensional plane in the three-dimensional space, and displaying the display coordinates of the plurality of selection target images in the screen and in a virtual two-dimensional plane. The virtual plane setting means for associating with the virtual coordinates, and by analyzing the three-dimensional coordinates of the detection target , identify a plurality of parts constituting the detection target, the coordinates of the identified part is the In a state corresponding to the virtual coordinates in the virtual two-dimensional plane, when detecting a predetermined movement by the identified part in the three-dimensional space, the identified part Analysis means for judging that the selection target image has been selected, code information corresponding to the selection target image judged to be selected by the analysis means, and code information of a pre-registered authentication code. And a plurality of code information used for the authentication code include at least a number from 0 to 9 and a predetermined symbol, and the image display means includes a plurality of 0 And an image excluding the image of the number is displayed as an image to be selected corresponding to the predetermined symbol, and the analysis unit determines that the object to be detected is the person to be authenticated. In the case of the hand, each finger part is individually identified, and each time a predetermined movement by one finger part of the finger parts is detected, a selection pair corresponding to each finger part of all the hands is detected. Obtain a candidate array consisting of each number or symbol of the image and each piece of identification information of each finger portion corresponding to each of the numbers or symbols, and the authentication determination unit sequentially arranges each of the numbers or symbols and each of the numbers Or, the identification information of each of the sequences in the authentication code in which the identification information of the finger part corresponding to each symbol is registered, and the identification information of each of the sequences and the candidate sequence of each of the sequences in which the predetermined motion is detected. The authentication determination of the person to be authenticated is performed by determining the match between the numeral or symbol and the identification information.
Further, the authentication processing device of the present invention includes a coordinate detecting unit that detects three-dimensional coordinates of a detection target in a three-dimensional space at predetermined time periods, and a plurality of code units respectively corresponding to a plurality of code information used for the authentication code. Image display means for displaying a selection target image in a screen, and setting a virtual two-dimensional plane in the three-dimensional space, and displaying the display coordinates of the plurality of selection target images in the screen and in a virtual two-dimensional plane. The virtual plane setting means for associating with the virtual coordinates, and by analyzing the three-dimensional coordinates of the detection target, identify a plurality of parts constituting the detection target, the coordinates of the identified part is the In a state corresponding to the virtual coordinates in the virtual two-dimensional plane, when detecting a predetermined movement by the identified part in the three-dimensional space, the identified part Analysis means for judging that the selection target image has been selected, code information corresponding to the selection target image judged to be selected by the analysis means, and code information of a pre-registered authentication code. The virtual plane setting means includes any two of the X, Y, and Z axes in the three-dimensional space represented by the X, Y, and Z axes. The virtual two-dimensional plane represented by coordinate axes is set, and the analysis unit measures a time at which the identified part is stationary in the three-dimensional space, and the part is stationary for a predetermined time. When detecting, in the three-dimensional space, a predetermined determination coordinate is set to a coordinate value separated by a predetermined distance from the tip of the part in a direction of a coordinate axis orthogonal to the virtual two-dimensional plane, and in the three-dimensional space By moving the part at When the end is reached the judgment coordinate, and detects the predetermined movement.
In addition, the authentication device of the present invention includes a coordinate detection unit that detects three-dimensional coordinates of a detection target in a three-dimensional space at predetermined time periods, and a plurality of code units respectively corresponding to a plurality of code information used for the authentication code. Image display means for displaying a selection target image in a screen, and setting a virtual two-dimensional plane in the three-dimensional space, display coordinates of the plurality of selection target images in the screen and virtual display in a virtual two-dimensional plane. By analyzing virtual plane setting means for associating the coordinates with the three-dimensional coordinates of the detection target, a plurality of parts constituting the detection target are identified, and the coordinates of the identified parts are determined by the virtual coordinates. In a state corresponding to the virtual coordinates in a two-dimensional plane, when a predetermined movement by the identified part is detected in the three-dimensional space, the selected part is selected by the identified part. Analysis means for determining that the elephant image has been selected, code information corresponding to the selection target image determined to be selected by the analysis means, and code information of an authentication code registered in advance, to perform authentication determination. The virtual plane setting means includes any two coordinate axes of the X axis, the Y axis, and the Z axis in the three-dimensional space represented by the X axis, the Y axis, and the Z axis. The virtual two-dimensional plane represented by the following formula is set, and the analysis means sets the coordinates in the virtual two-dimensional plane of the coordinate axes orthogonal to the virtual two-dimensional plane in the three-dimensional space as the reference coordinates. And set the positive side and the negative side with respect to the reference coordinates, and when the tip of the identified part moves from the positive side to the reference coordinates beyond the reference coordinates to the negative side, the It is characterized in that a predetermined movement is detected.
In addition, the authentication device of the present invention includes a coordinate detection unit that detects three-dimensional coordinates of a detection target in a three-dimensional space at predetermined time periods, and a plurality of code units respectively corresponding to a plurality of code information used for the authentication code. Image display means for displaying a selection target image in a screen, and setting a virtual two-dimensional plane in the three-dimensional space, display coordinates of the plurality of selection target images in the screen and virtual display in a virtual two-dimensional plane. By analyzing virtual plane setting means for associating the coordinates with the three-dimensional coordinates of the detection target, a plurality of parts constituting the detection target are identified, and the coordinates of the identified parts are determined by the virtual coordinates. In a state corresponding to the virtual coordinates in a two-dimensional plane, when a predetermined movement by the identified part is detected in the three-dimensional space, the selected part is selected by the identified part. Analysis means for determining that the elephant image has been selected, code information corresponding to the selection target image determined to be selected by the analysis means, and code information of an authentication code registered in advance, to perform authentication determination. Having authentication determination means to perform, the analysis means measures the time at which each of the identified parts has stopped in the three-dimensional space, and after detecting that each of the parts has stopped for a predetermined time, In the three-dimensional space, a part having the largest movement amount when the tip of each part moves is defined as a part where the predetermined movement is detected.

Further, the authentication processing method of the present invention includes a coordinate detecting step of detecting three-dimensional coordinates of a detection target in a three-dimensional space at predetermined time periods, and a plurality of code information corresponding to a plurality of code information used for the authentication code. An image display step of displaying a selection target image in a screen, and setting a virtual two-dimensional plane in the three-dimensional space, and displaying the display coordinates of the plurality of selection target images in the screen and in a virtual two-dimensional plane. A virtual plane setting step for associating the virtual coordinates, and by analyzing the three-dimensional coordinates of the detection target, identifies a plurality of parts constituting the detection target, the coordinates of the identified part is the In a state corresponding to the virtual coordinates in the virtual two-dimensional plane, when detecting a predetermined movement by the identified part in the three-dimensional space, the identified part An analysis step of determining that the selection target image has been selected, and code information corresponding to the selection target image determined to have been selected in the analysis step, based on code information of an authentication code registered in advance, An authentication determination step of performing an authentication determination , wherein the plurality of code information used for the authentication code are numbers from 0 to 9, and in the image displaying step, the numbers of 0 to 9 are used as the plurality of selection target images. An image is arranged and displayed in the screen, and in the analyzing step, when the object to be detected is the hand of the person to be authenticated, each finger part is individually identified, and one finger of the finger parts is identified. Each time a predetermined movement by a part is detected, each number of the selection target image corresponding to each finger part of all the hands and each identification information of each finger part corresponding to each of the numbers, In the authentication determination step, each of the numbers arranged in order and each identification information of the finger part corresponding to each of the numbers are obtained in accordance with the order of the arrangement in the authentication code registered in advance. The identification determination of the person to be authenticated is performed by determining whether the numeral and the identification information match with the numeral and the identification information in the candidate sequence in each order in which the predetermined movement is detected .

Further, the authentication processing method of the present invention includes a coordinate detecting step of detecting three-dimensional coordinates of a detection target in a three-dimensional space at predetermined time periods, and a plurality of code information corresponding to a plurality of code information used for the authentication code. An image display step of displaying a selection target image in a screen, and setting a virtual two-dimensional plane in the three-dimensional space, and displaying the display coordinates of the plurality of selection target images in the screen and in a virtual two-dimensional plane. A virtual plane setting step for associating the virtual coordinates, and by analyzing the three-dimensional coordinates of the detection target , identifies a plurality of parts constituting the detection target, the coordinates of the identified part is the In a state corresponding to the virtual coordinates in the virtual two-dimensional plane, when detecting a predetermined movement by the identified part in the three-dimensional space, the identified part An analysis step of determining that the selection target image has been selected, and code information corresponding to the selection target image determined to have been selected in the analysis step, based on code information of an authentication code registered in advance, An authentication determination step of performing an authentication determination, wherein the plurality of code information used for the authentication code includes at least a number from 0 to 9 and a predetermined symbol, and the image display step includes the plurality of selection target images. The image of the number from 0 to 9 is arranged in the screen, and the area excluding the image of the number is displayed as a selection target image corresponding to the predetermined symbol. In the analysis step, the detection target is authenticated. In the case of the target person's hand, each finger part is individually identified, and each time a predetermined movement by one of the finger parts is detected, the hand Obtain a candidate array consisting of each number or symbol of the selection target image corresponding to all the finger parts and each identification information of each finger part corresponding to each of the numbers or symbols, and in the authentication determination step, the arrays are sequentially arranged. The number and identification information for each sequence in the authentication code in which each of the numbers or symbols and the identification information of the finger portion corresponding to each of the numbers or symbols are registered, and the predetermined movement is The authentication determination of the person to be authenticated is performed by judging whether or not the detected sequence matches a number or a symbol in the candidate sequence and identification information.
Further, the authentication processing method of the present invention includes a coordinate detecting step of detecting three-dimensional coordinates of a detection target in a three-dimensional space at predetermined time periods, and a plurality of code information corresponding to a plurality of code information used for the authentication code. An image display step of displaying a selection target image in a screen, and setting a virtual two-dimensional plane in the three-dimensional space, and displaying the display coordinates of the plurality of selection target images in the screen and in a virtual two-dimensional plane. A virtual plane setting step for associating the virtual coordinates, and by analyzing the three-dimensional coordinates of the detection target, identifies a plurality of parts constituting the detection target, the coordinates of the identified part is the In a state corresponding to the virtual coordinates in the virtual two-dimensional plane, when detecting a predetermined movement by the identified part in the three-dimensional space, the identified part An analysis step of determining that the selection target image has been selected, and code information corresponding to the selection target image determined to have been selected in the analysis step, based on code information of an authentication code registered in advance, An authentication determination step of performing an authentication determination, wherein in the virtual plane setting step, any one of the X axis, the Y axis, and the Z axis is included in the three-dimensional space represented by the X axis, the Y axis, and the Z axis. The virtual two-dimensional plane represented by two coordinate axes is set, and in the analyzing step, the time during which the identified part is stationary in the three-dimensional space is measured, and the part is stationary for a predetermined time. When detecting, in the three-dimensional space, a predetermined determination coordinate is set to a coordinate value separated by a predetermined distance from the tip of the part in a direction of a coordinate axis orthogonal to the virtual two-dimensional plane, and in the three-dimensional space In front When the tip of the site by site has moved reaches the judgment coordinate, and detects the predetermined movement.
Further, the authentication processing method of the present invention includes a coordinate detecting step of detecting three-dimensional coordinates of a detection target in a three-dimensional space at predetermined time periods, and a plurality of code information corresponding to a plurality of code information used for the authentication code. An image display step of displaying a selection target image in a screen, and setting a virtual two-dimensional plane in the three-dimensional space, and displaying the display coordinates of the plurality of selection target images in the screen and in a virtual two-dimensional plane. A virtual plane setting step for associating the virtual coordinates, and by analyzing the three-dimensional coordinates of the detection target, identifies a plurality of parts constituting the detection target, the coordinates of the identified part is the In a state corresponding to the virtual coordinates in the virtual two-dimensional plane, when detecting a predetermined movement by the identified part in the three-dimensional space, the identified part An analysis step of determining that the selection target image has been selected, and code information corresponding to the selection target image determined to have been selected in the analysis step, based on code information of an authentication code registered in advance, An authentication determination step of performing an authentication determination, wherein in the virtual plane setting step, any one of the X axis, the Y axis, and the Z axis is included in the three-dimensional space represented by the X axis, the Y axis, and the Z axis. The virtual two-dimensional plane represented by two coordinate axes is set, and in the analyzing step, the coordinates in a coordinate axis orthogonal to the virtual two-dimensional plane in the three-dimensional space are set as coordinates in the virtual two-dimensional plane. Coordinates and set the positive side and the negative side with respect to the reference coordinates, when the tip of the identified portion moves from the positive side to the reference coordinates beyond the reference coordinates to the negative side, Detect the predetermined movement Characterized in that it.

  According to the present invention, personal authentication with extremely high security can be performed without touching an authentication sensor or the like.

It is a schematic diagram which shows an example of the general | schematic appearance of the authentication processing apparatus of 1st, 2nd embodiment. FIG. 4 is a diagram illustrating an example of an arrangement of virtual keys randomly arranged in a virtual touch panel. It is a figure showing an example of a key picture arranged at random. FIG. 2 is a functional block diagram in which each process, control, and hardware configuration of the information processing apparatus according to the first embodiment are divided into functions. 5 is a flowchart illustrating a flow of processing and control when the information processing apparatus of the first embodiment performs personal authentication of a person to be authenticated using a PIN code. It is a figure showing an example of arrangement of an infrared LED and an infrared camera on a sensor surface of a distance sensor. It is a figure used for description of the effective range of a distance sensor. It is a figure used for description of coordinates of a three-dimensional space on a sensor surface of a distance sensor. It is a figure used for description of air click performed in a virtual touch panel. FIG. 4 is a diagram used for describing a fake click performed in the virtual touch panel. FIG. 4 is a diagram illustrating an example of table information stored in a memory unit of the information processing device according to the first embodiment. FIG. 3 is a diagram illustrating a configuration example in which a reflection plate is provided on a display screen. It is a figure showing the example of composition which installed the optical imaging plate on the display screen. FIG. 13 is a functional block diagram in which each processing, control, and hardware configuration of the information processing apparatus according to the second embodiment are divided for each function. 9 is a flowchart illustrating a flow of processing and control when the information processing apparatus according to the second embodiment performs personal authentication of a person to be authenticated using a PIN code and finger identification information. FIG. 3 is a diagram illustrating a hand that is a detection target modeled and described. FIG. 14 is a diagram illustrating an example of table information stored in a memory unit of the information processing device according to the second embodiment. FIG. 9 is a diagram illustrating an example of a PIN code and finger identification information when the information processing apparatus according to the second embodiment performs personal authentication using the PIN code and finger identification information. It is a figure used for explaining the physical relationship of an information processor, a distance sensor, and a virtual touch panel in a 3rd embodiment. It is a figure used for description of a screen of a display, a distance sensor, and a physical relationship of a virtual touch panel in a 3rd embodiment. It is a figure used in 3rd Embodiment for explaining the relationship between each air click determination coordinate set after a fingertip stops, and each fingertip coordinate. FIG. 13 is a functional block diagram in which each processing, control, and hardware configuration of the information processing apparatus according to the third embodiment are divided into functions. 13 is a flowchart illustrating a flow of processing and control when the information processing apparatus of the third embodiment performs personal authentication of an authentication target person using a PIN code and finger identification information. It is a figure which shows each virtual key in the case of 4th Embodiment, and an example of the position of each of five fingertips of the authentication subject's thumb-little finger. It is a figure showing the example of the candidate code obtained by four air clicks in the case of a 4th embodiment. It is a figure showing an example of each virtual key in the case of a 5th embodiment, and the position of each of five fingertips of a to-be-authenticated person's thumb-little finger. It is a figure showing the example of the candidate code obtained by four air clicks in the case of a 5th embodiment. FIG. 1 is a diagram illustrating a schematic configuration example of a system in which security management is performed by a server to which an authentication processing device according to an embodiment is applied.

<First embodiment>
FIG. 1 is a diagram illustrating an example of an overview of an authentication processing device 1 according to a first embodiment of the present invention. As shown in FIG. 1, an authentication processing device 1 according to the present embodiment includes a display 11, and is an example of a configuration for realizing functions of a virtual plane setting unit, an analyzing unit, and an authentication determining unit. The apparatus includes a device 10 and a distance sensor 20 which is an example of a configuration for realizing the function of a coordinate detecting unit. The information processing device 10 and the distance sensor 20 are connected by a signal cable or wirelessly.

  The distance sensor 20 has a part of a function of a coordinate detecting unit for detecting three-dimensional coordinates of a detection target in a three-dimensional space at predetermined time periods. And a coordinate calculation unit 111 described later in the information processing apparatus 10. The display 11 is an example of an image display unit that displays, on a screen, a plurality of selection target images corresponding to a plurality of pieces of code information used for the authentication code. The information processing apparatus 10 sets a virtual two-dimensional plane in a three-dimensional space, and sets a virtual plane setting in which the display coordinates of the plurality of selection target images in the screen correspond to the virtual coordinates in the virtual two-dimensional plane. Means, by analyzing three-dimensional coordinates of the detection target, the detection target in the three-dimensional space in a state where the detection coordinates of the detection target correspond to the virtual coordinates on the two-dimensional plane. Analysis means for determining that the selection target image has been selected by the person to be authenticated upon detecting a predetermined movement by an object; code information corresponding to the selection target image determined to have been selected by the analysis means; 1 is an example of an apparatus that realizes each function as an authentication determination unit that performs an authentication determination based on code information of an authentication code that has been performed.

  In the authentication processing device 1 of the present embodiment, when the personal authentication of the person to be authenticated is performed by a PIN code which is an example of an authentication code in which a four-digit number is used as code information, the information processing device 10 performs the authentication. The code information consisting of four digits entered by the subject is compared with the registered PIN code of the regular user, and if they match, the subject is authenticated as the legitimate user. I do.

  Here, when performing personal authentication using a PIN code, the information processing apparatus 10 first performs a user confirmation process of determining whether or not the person to be authenticated is one of a plurality of users registered in advance. . When only one user is registered in advance, the determination for user confirmation can be omitted. When there are a plurality of pre-registered users, for example, user confirmation using a password or the like registered in advance separately from a PIN code, or user confirmation using an authentication card distributed to each user in advance. Alternatively, user confirmation using biological information of each user or the like can be performed.

  When it is determined that the person to be authenticated is one of the registered users, the information processing apparatus 10 determines, based on a signal supplied from the distance sensor 20, a tertiary tertiary area above the sensor surface 20F of the distance sensor 20. A touch panel 40, which is an example of a virtual two-dimensional plane, is set in the original space. In the following description, the virtual touch panel 40 is referred to as a virtual touch panel 40. The virtual touch panel 40 is set as a panel virtually corresponding to the screen of the display 11. The virtual touch panel 40 is set virtually in a three-dimensional space, and cannot be actually viewed by a person to be authenticated or another third party. A detailed description of how the information processing device 10 can handle the three-dimensional space above the sensor surface 20F of the distance sensor 20 as the virtual touch panel 40 will be described later.

  Next, based on the signal supplied from the distance sensor 20, the information processing apparatus 10 can indicate a certain narrow range such as the tip of the finger of the person to be authenticated (that is, the fingertip 31). It is determined whether the object having the tip exists in the three-dimensional space of the virtual touch panel 40. In the case of the first embodiment, the tip is not limited to the fingertip of the hand, and may be a tip that can indicate a narrow range such as a pen tip. When the tip of the fingertip 31 or the like exists in the three-dimensional space of the virtual touch panel 40, the information processing apparatus 10 displays the tip of the fingertip 31 or the like on the virtual touch panel 40 on the screen of the display 11. An instruction mark 13 corresponding to the position of the copy is displayed. Further, when the fingertip 31 or the like is moved in the virtual touch panel 40, the information processing apparatus 10 moves the display position of the instruction mark 13 on the screen of the display 11 in synchronization with the movement of the fingertip 31. The detailed description of the movement of the fingertip 31 in the virtual touch panel 40 and the synchronous display of the instruction mark 13 on the screen of the display 11 will be described later.

  Further, when the information processing apparatus 10 determines that the fingertip 31 or the like exists in the three-dimensional space of the virtual touch panel 40, the information processing apparatus 10 displays the key image 12 corresponding to, for example, numeric keys from “0 to 9” on the display 11. Display on the screen. These key images 12 are examples of a plurality of selection target images displayed on the screen of the display 11. In the present embodiment, the key images 12 are randomly arranged on the screen. In the example of the screen of the display 11 shown in FIG. 1, only the key image 12 and the instruction mark 13 are displayed, but together with them, for example, a cancel key for instructing cancellation is also displayed.

  Further, as described above, since the virtual touch panel 40 is a panel virtually corresponding to the screen of the display 11, the information processing apparatus 10 may be, for example, as shown in FIG. A virtual key V12 is arranged at a position corresponding to each key image 12 randomly arranged on the screen of the display 11. Note that, like the virtual touch panel 40, these virtual keys V12 are also virtually arranged in a three-dimensional space, and cannot be actually viewed by the person to be authenticated or another third party. . As shown in FIGS. 3A to 3C, the key image 12 displayed on the screen of the display 11 is arranged every time personal authentication is performed for the person to be authenticated. Changed randomly. Therefore, the arrangement of the virtual key V12 on the virtual touch panel 40 is randomly changed every time personal authentication is performed for the person to be authenticated. Although the example of FIG. 2 illustrates only the virtual key V12, a virtual cancel key for instructing cancellation is also arranged together with them.

  In addition, the information processing apparatus 10 performs a predetermined operation in which the person to be authenticated indicates a desired position on the virtual touch panel 40 by using the tip of the fingertip 31 of the hand 30 (the desired position is determined by the tip of the fingertip 31 or the like). When the user performs a predetermined movement (e.g., a thrusting motion), it is recognized that the user has clicked the position. In the present embodiment, an example of a predetermined operation for designating a desired position on the virtual touch panel 40 is an operation of pressing the desired position with the tip of the fingertip 31 or the like (or an operation of pushing or pushing). Listed in In the present embodiment, the predetermined movement for indicating a desired position by the tip portion is referred to as an air click in the following description. The information processing apparatus 10 recognizes whether or not the air click has been performed in the three-dimensional space of the virtual touch panel 40 based on a signal supplied from the distance sensor 20, and a detailed description thereof will be given later. Whether the air click has been performed reliably is determined by, for example, performing a predetermined display for air click completion notification on the screen of the display 11, generating a predetermined sound for air click completion notification, and the like. It is also possible to notify the person to be authenticated. Alternatively, in order to increase the confidentiality to a third party, the notification may not be performed at all.

  Then, the information processing apparatus 10 performs an air click at a position corresponding to the virtual key V12 in the virtual touch panel 40, and when the correct four-digit number of the PIN code is sequentially input by the air click, It is determined that the person to be authenticated is a legitimate user.

  FIG. 4 shows a schematic configuration of the information processing apparatus 10. Each configuration illustrated in FIG. 4 is a functional block in which each processing, control, and actual hardware configuration performed by the information processing apparatus 10 of the present embodiment is divided into functions. FIG. 4 also illustrates the distance sensor 20. In FIG. 4, the display unit (display 11) may be provided outside the information processing apparatus 10, or the information stored in the memory unit 107 may be stored in an external storage device. .

  FIG. 5 is a flowchart illustrating a flow of processing and control of the information processing apparatus 10 when personal authentication of a person to be authenticated is performed using a PIN code. Hereinafter, the operation, processing, and control of each component in FIG. 4 will be described with reference to the flowchart in FIG.

  First, when personal authentication of a person to be authenticated is performed, the user confirmation unit 106 of the information processing apparatus 10 determines whether or not the person to be authenticated is one of a plurality of registered users in step S1. Is determined for user confirmation. As described above, the determination process of the user confirmation is performed using the password, the authentication card, the biometric information of the user, and the like. Since the processing for user confirmation is the same as the existing processing, a detailed description thereof will be omitted.

  When it is determined in step S1 that the person to be authenticated is not a registered user, the control unit 105 determines that authentication has been denied (NG) and performs an authentication NG process in step S12. For example, as the authentication NG process in step S12, the control unit 105 clears all information acquired in the previous process, and then advances the process to step S11. When the process proceeds to step S11, the display control unit 121 of the control unit 105 displays authentication NG or the like on the screen of the display 11. The notification of the authentication NG may be made by voice. On the other hand, if it is determined in step S1 that the person to be authenticated is a registered user, the control unit 105 performs processing in step S2 based on the analysis result performed by the distance sensor output analysis unit 102, such as the fingertip 31 or the like. It is determined whether a tip that can indicate a very narrow range exists in the three-dimensional space of the virtual touch panel 40.

  Here, before describing the details of the processing performed by the distance sensor output analysis unit 102, the configuration of the distance sensor 20 and signals obtained from the distance sensor 20 will be described. As shown in FIG. 6, the distance sensor 20 includes, for example, three infrared LEDs 22L, 22C, and 22R and two infrared cameras 21L and 21R on the sensor surface 20F side. The infrared light emitted from the infrared LEDs 22L, 22C, and 22R is reflected by the detection target if any detection target exists on the sensor surface 20F side of the distance sensor 20, and is reflected by the infrared cameras 21L, 21R. Incident on. Each of the infrared cameras 21L and 21R includes an imaging optical system and an imaging element, and captures a light image composed of infrared light reflected by the detection target at predetermined time periods. In the case of the present embodiment, the predetermined time period is, for example, a frame rate of 290 fps (frames / second).

  In the distance sensor 20, the effective range in which the infrared light emitted from the infrared LEDs 22L, 22C, and 22R is reflected by the detection target and can be received by the infrared cameras 21L and 21R is, for example, as shown in FIG. From the midpoint 20C of the infrared cameras 21L and 21R on the 20F, an inverted pyramid-shaped range is set within a distance range DR of, for example, 25 mm to 600 mm and a spread angle θ of 150 degrees. The above-described distance sensor 20 outputs imaging signals of the infrared cameras 21L and 21R to the information processing device 10.

  The imaging signal output from the distance sensor 20 is received by the distance sensor output receiving unit 101 of the information processing device 10 according to the present embodiment. The distance sensor output receiving unit 101 is a signal cable connecting the distance sensor 20 and the information processing device 10 or a receiving unit according to a communication method such as wireless. The imaging signal received by the distance sensor output receiving unit 101 is sent to the distance sensor output analyzing unit 102.

  The distance sensor output analysis unit 102 includes, for example, a coordinate calculation unit 111, a target recognition unit 112, a tip coordinate information acquisition unit 113, and a Z coordinate determination unit 114. The coordinate calculation unit 111 performs an image analysis of the imaging signals from the two infrared cameras 21L and 21R of the distance sensor 20, and as shown in FIGS. 7 and 8, the X axis within the effective range of the distance sensor 20. , And the three-dimensional coordinates of the detection target (the fingertip 31 in the example of FIG. 8) in the three-dimensional space represented by the Y axis and the Z axis. Since the imaging signal supplied from the distance sensor 20 has a frame rate of 290 fps as described above, the coordinate calculation unit 111 calculates the three-dimensional coordinates of the fingertip 31 for each frame. In addition, even when there are a plurality of detection targets, or when there are a plurality of parts that move differently within one detection target, the coordinate calculation unit 111 may be configured for each of them. Is calculated. The three-dimensional coordinate information for each frame calculated by the coordinate calculation unit 111 is sent to the target recognition unit 112.

  The target recognition unit 112 recognizes what a detection target is in a three-dimensional space within the effective range of the distance sensor 20 based on the three-dimensional coordinate information for each frame. Here, it is assumed that the infrared camera of the distance sensor 20 is capturing an image of an object having a tip portion capable of pointing a certain narrow range, such as the fingertip 31 of the hand 30 in FIG. In this case, the target recognizing unit 112 recognizes at least the leading end of the detection target from the imaging signal and the three-dimensional coordinates calculated for each frame by the coordinate calculating unit 111. That is, in the case of the examples of FIGS. 1 and 8, the target recognition unit 112 recognizes at least the fingertip 31 of the hand 30. Although details will be described later in the second embodiment, when a human hand is imaged as a detection target, the target recognizing unit 112 includes a palm constituting the hand and five fingers, and The tips (fingertips), joints, and the like of the five fingers can also be recognized.

  When the target recognition unit 112 recognizes the tip of the detection target, the tip coordinate information acquisition unit 113 extracts the coordinate information of the tip from the three-dimensional coordinates calculated by the coordinate calculation unit 111. get. When acquiring the coordinate information of the tip, the tip coordinate information acquiring unit 113 sends the coordinate information to the control unit 105. That is, in step S2 of FIG. 5, the control unit 105 determines that the tip such as the fingertip 31 is in the three-dimensional space of the virtual touch panel 40 based on the target recognition result by the target recognition unit 112 of the distance sensor output analysis unit 102. It can be determined whether it exists.

  Returning to the flowchart of FIG. 5, when it is determined in step S2 that the leading end is present in the three-dimensional space of the virtual touch panel 40, the control unit 105 advances the process to step S3. When the tip does not exist in the three-dimensional space, the determination processing of step S2 is repeated.

  When the process proceeds to step S3, the key array control unit 122 of the control unit 105 generates data of the key images 12 to be randomly arranged on the display 11 as described above, and outputs the key images 12 via the display control unit 121. Is displayed on the screen of the display 11.

  Thereafter, the control unit 105 proceeds from step S4 to step S8 for acquiring a four-digit number for authentication input by the person to be authenticated through the virtual touch panel 40 from the analysis result of the distance sensor output analysis unit 102. Transition.

  When the process proceeds to step S4, the control unit 105 causes the tip coordinate information acquisition unit 113 of the distance sensor output analysis unit 102 to acquire the coordinates of the tip on the virtual touch panel 40. That is, the tip coordinate information acquisition unit 113 at this time acquires the coordinates of the tip recognized by the target recognition unit 112.

  At this time, the display control unit 121 of the control unit 105 generates an image of the instruction mark 13 to be displayed on the screen of the display 11 based on the coordinate information of the tip of the fingertip 31 or the like. When the fingertip 31 is moved in the three-dimensional space, the coordinate value of the tip of the fingertip 31 or the like changes every frame captured by the infrared cameras 21L and 21R. Therefore, the display position of the instruction mark 13 on the screen of the display 11 is changed in synchronization with the movement of the fingertip 31 in the three-dimensional space.

  Further, the control unit 105 determines that the coordinates of the tip acquired by the tip coordinate information acquiring unit 113 match the coordinates of any one of the virtual keys V12 arranged in the three-dimensional space of the virtual touch panel 40 as the process of step S5. Judge whether you did. In this case, the coincidence determination is performed to determine whether the X, Y coordinates of the tip end are within the range of the X, Y coordinates of the virtual key V12. Then, when the control unit 105 determines that the coordinates of the distal end portion match the coordinates of the virtual key V12, it proceeds to step S6, and when it determines that the coordinates do not match, returns the process to step S4.

  Since the virtual key V12 is not actually seen by the person to be authenticated and is virtually set in a three-dimensional space, the person to be authenticated accurately positions the tip of the virtual key V12 at the position of the virtual key V12. It may be difficult to match. In this case, as an example, a detection range of a predetermined size is set around the coordinates of the virtual key V12, and when the coordinates of the tip end are included in the detection range, It may be determined that the coordinates of the tip correspond to the coordinates of the virtual key V12.

  Next, the control unit 105 determines whether an air click has been performed on the virtual touch panel 40 based on the Z coordinate determination result of the Z coordinate determination unit 114. Here, the Z coordinate determination processing performed by the Z coordinate determination unit 114 will be described with reference to FIGS. 8, 9, and 10. The Z coordinate determination unit 114 sets reference coordinates for the Z coordinates of the three-dimensional space above the sensor surface 20F of the distance sensor 20 among the three-dimensional coordinates calculated by the coordinate calculation unit 111, and sets the Z reference coordinates. , A positive (+) Z coordinate and a negative (−) Z coordinate are set. 9 and 10, the virtual touch panel 40 is drawn as a screen on which grid-like cells are arranged, but these are only drawn to make the panel and its coordinates easy to understand. They are not visible to the subject.

  In the case of the example of FIG. 8, the Z coordinate axis is a coordinate axis in the depth direction orthogonal to the virtual touch panel 40 which is a virtual two-dimensional plane including the X axis and the Y axis, and the reference coordinate (Z = 0) is an example. Is the Z coordinate corresponding to the center of the sensor surface 20F of the distance sensor 20. In the case of the example of FIG. 8, the Z coordinate on the positive side (+ side) is closer to the reference coordinate (Z = 0) (closer to the person to be authenticated), and the Z coordinate on the negative side (− side) is the reference. It is on the depth side (farther from the person to be authenticated) with respect to the coordinates (Z = 0).

  Then, as shown in FIG. 9, the Z coordinate determination unit 114 determines that the Z coordinate of the tip of the detection target recognized by the target recognition unit 112 is from the positive side (+ side) to the reference coordinate (Z = 0). ) To determine whether it has changed to the negative side (− side). Here, when it is determined that the Z coordinate of the tip has changed, the Z coordinate determination unit 114 sends a determination detection signal to the control unit 105. Note that, after the Z coordinate of the distal end portion changes from the positive side (+ side) to the negative side (− side) after passing through the reference coordinate (Z = 0), the Z coordinate determination section 114 further sets, for example, It may be determined whether or not a change has been made to return to the positive side (+ side) within the determined time.

  Then, in step S6, when receiving the determination detection signal from the Z coordinate determination unit 114, the control unit 105 determines that an air click has been performed. If the air click has not been performed, the control unit 105 returns the process to step S4.

  As described above, in the present embodiment, as shown in FIG. 9, for example, the Z coordinate of the tip of the fingertip 31 or the like passes through the reference coordinate (Z = 0) from the positive side (+ side) to the negative side. After the change to (−), if the change returns to, for example, the positive side (+), it is determined that the air click has been performed. Therefore, for example, as shown in FIG. 10, even if the person to be authenticated performs an operation of pushing the tip of the fingertip 31 or the like in the Z-axis direction on the virtual touch panel 40, the pushing operation of the tip at that time is performed. Is performed only on the positive side (+ side) of the Z-axis coordinate, for example, it is not determined that the air click has been performed. In other words, when the pressing operation of the fingertip 31 or the like is performed only on the positive side (+ side) of the Z coordinate, for example, it appears that the air click is being performed by a third party, but the air click is actually performed. Is not done. In the present embodiment, such an apparent air click (fake air click) is possible.

  The reference coordinate of the Z coordinate axis is not limited to the Z coordinate corresponding to the center of the sensor surface 20F, and may be a Z coordinate closer to the authentication target person than the Z coordinate, or a farther Z coordinate. Is also good. Although details will be described in a third embodiment described later, the coordinates used to determine whether an air click has been performed are not limited to reference coordinates fixedly determined in advance on the Z coordinate axis. That is, the coordinates used to determine whether an air click has been performed are, for example, after the fingertip 31 of the hand 30 of the person to be authenticated is detected in the three-dimensional space of the virtual touch panel 40, and then the hand 30 or the fingertip 31 is tertiary. It is possible to set a coordinate which is separated by a predetermined distance in the fingertip direction and in the Z-axis direction from a Z coordinate at the time of stopping for a predetermined time in the original space. In other words, the coordinates used for the air click determination can be set as variable coordinates according to the Z coordinate when the hand 30 or the fingertip 31 is stationary in the three-dimensional space.

  Next, in step S6, it is determined that an air click has been performed, and when the process proceeds to step S7, the control unit 105 instructs the input information determination unit 103 to input a number corresponding to the coordinates input by the air click. , After storing as the array PIN (n), “1” is added to “n”, and the process proceeds to step S8.

  When the process proceeds to step S8, the control unit 105 determines whether “n” of the array PIN (n) stored in the input information determination unit 103 has become “m”. Note that “m” is “4” when the PIN code has four digits. Therefore, when “n” becomes “4”, control unit 105 proceeds to step S9. That is, when “n” becomes “4”, the number stored by the input information determination unit 103 as the array PIN (n) is a four-digit number. Is the number entered by the person to be authenticated.

  Next, when the process proceeds to step S9, the control unit 105 instructs the input information determination unit 103 via, for example, an array of PIN code numbers for each user stored in the memory unit 107 and the virtual touch panel 40. Then, it is determined whether or not the sequence of numbers input by the person to be authenticated completely matches.

  Here, table information in which the user information 131 and the PIN code 132 are associated with each other is registered in the memory unit 107 as an example. As shown in FIG. 11 as an example, the table information is one in which user information U1, U2, U3,... Representing each of a plurality of users are registered in association with a registered PIN code of each user. is there. The PIN code of the user determined to have been registered at the time of the user confirmation in step S1 has been passed from the memory unit 107 to the input information determination unit 103. Therefore, the input information determination unit 103 determines in step S9 , The PIN code and the number input by the person to be authenticated are determined.

  When the input information determination unit 103 determines that the input numeral of the person to be authenticated matches the PIN code, the control unit 105 determines that the authentication has been confirmed (OK) and performs an authentication OK process in step S10. When the control unit 105 proceeds from step S9 to step S10, for example, after clearing all the coordinate information acquired in the previous processing, the numerical information stored in the array PIN (n), and the like, the control unit 105 proceeds to step S11. Proceed to. When the process proceeds from step S10 to step S11, the display control unit 121 of the control unit 105 displays, for example, authentication OK on the screen of the display 11. Note that the notification of the authentication OK may be made by voice.

  On the other hand, if it is determined in step S9 that the input numeral does not match the PIN code, control unit 105 proceeds to step S12 to perform an authentication NG process. When the process proceeds from step S9 to step S12, the control unit 105 clears all the coordinate information acquired in the previous process, the numerical information stored in the array PIN (n), and the like, and then proceeds to step S11. . Then, when the process proceeds from step S12 to step S11, the display control unit 121 displays the authentication NG on the screen of the display 11.

  Note that when the authentication processing device 1 of the present embodiment is, for example, a device for performing authentication at the time of entering a room and controls opening and closing of an electric lock (not shown) according to the authentication result, the unlock control unit 104 determines in step S10 The opening / closing of the electric lock is controlled based on the result of the determination by the input information determining unit 103. That is, when the person to be authenticated is a legitimate user, the unlock control unit 104 controls the opening of the electric lock to allow the user to enter the room in step S10.

  1, 9, and 10 exemplify an example in which the screen of the display 11 faces, for example, directly from the person to be authenticated, but the screen of the display 11 is, for example, as shown in FIGS. 12 and 13. You may arrange | position so that it may not be seen directly from a target person side.

  The example of FIG. 12 illustrates a configuration example in which a display image on the display 11 is reflected by a reflector 51 disposed at an angle of, for example, 45 degrees with respect to the screen of the display 11, and the reflected image is viewed by the person to be authenticated. ing. In the case of FIG. 12, the display on the display 11 is a mirror image. In the case of the configuration shown in FIG. 12, the distance sensor 20 is disposed in front of a position where the person to be authenticated looks at the display screen reflected by the reflection plate 51. It will be arranged in a three-dimensional space above the sensor 20. In the case of the configuration shown in FIG. 12, a reflector 51 is provided on the display screen of the display 11, and the display screen of the display 11 is reflected by the reflector 51. It cannot be placed secretly on the display 11 screen.

  The example of FIG. 13 illustrates an example of a configuration in which an optical imaging plate 50 that is arranged at an angle of, for example, 45 degrees with respect to the screen of the display 11 and that forms a display image of the display 11 as a virtual stereoscopic image in the air is arranged. ing. As the optical imaging plate 50, for example, an optical imaging device disclosed in Japanese Patent Application Laid-Open No. 2013-127625 can be used. In the case of the configuration of FIG. 13, the distance sensor 20 is disposed at a position where a virtual stereoscopic image is formed by the optical imaging plate 50, and the virtual touch panel 40 is also located in a three-dimensional space above the distance sensor 20. Will be placed in In addition, the optical imaging plate 50 has a viewing angle of ± 20 degrees with 45 degrees as a base axis from the plate surface, and the display screen of the display 11 can be viewed only within such a narrow viewing angle range. . For this reason, for example, it is impossible to pry the display screen of the display 11 from over the shoulder or from the side of the person to be authenticated, and it is impossible to take a sneak shot with a small hidden camera.

  As described above, according to the authentication processing apparatus 1 of the first embodiment, a virtual key randomly arranged is clicked on the virtual touch panel 40 virtually arranged in a three-dimensional space with the fingertip 31 or the like ( Since the PIN code is entered by "air-clicking", it is possible to ensure extremely high security without actually seeing the figure entered by a third party or stealing it. ing.

  Further, according to the authentication processing device 1 of the present embodiment, whether or not a reliable air click operation has been performed can be recognized only by the person to be authenticated. There is no danger of knowing whether it is a PIN code number.

  Further, according to the authentication processing device 1 of the present embodiment, since the person to be authenticated only performs an air click on the virtual touch panel 40 and does not need to actually touch the touch panel or the like with a fingertip, the trace of a fingerprint pattern or the like is not obtained. No fingerprints are stolen.

  Further, in the authentication processing apparatus 1 of the present embodiment, if a configuration in which the reflection plate 51 shown in FIG. 12 and the optical imaging plate 50 shown in FIG. Voyeurism can be effectively prevented.

  Further, according to the authentication processing device 1 of the present embodiment, since the bright display on the display screen can be seen, even in a dark environment where sufficient brightness is not obtained, the person to be authenticated can input the PIN code. Becomes possible.

<Second embodiment>
Next, an authentication processing device 1 according to a second embodiment of the present invention will be described below. Note that the schematic configuration of the authentication processing device 1 of the second embodiment is the same as that of FIG. Further, in the second embodiment, the correspondence between the distance sensor 20, the screen display of the display 11, the virtual touch panel 40, and the key images 12 randomly arranged on the screen of the display 11 and the virtual keys V12 arranged in the virtual touch panel 40 are shown. The relationship, the distinction between the air click and the fake click, the reflection plate 51, the optical imaging plate 50, and the like are the same as those in the first embodiment.

  Here, in the case of the first embodiment described above, the detection target when an air click is detected on the virtual touch panel 40 may be any object having a tip that can indicate a somewhat narrow range. However, it is not limited to fingertips. Further, in the first embodiment, for example, when air click is performed with a fingertip, the person to be authenticated may use any finger from the thumb to the little finger in any manner, and input in numerical order of the PIN code. If possible.

  On the other hand, the authentication processing device 1 of the second embodiment individually recognizes five fingers of the hand of the person to be authenticated, and determines which one of the numbers of the PIN code uses which finger. The security performance is further enhanced by individually recognizing whether the input has been made.

  In order to realize such a case, in the second embodiment, when personal authentication is performed using, for example, a four-digit PIN code, the authentication processing device 1 stores each number of the PIN code and information of a finger corresponding to the number. Are registered in advance.

  In addition, when a four-digit number is input from the person to be authenticated through the virtual touch panel 40, the authentication processing device 1 can recognize which finger each of the four-digit numbers was input using. It has been done. Then, the authentication processing device 1 compares the input numbers and the information of the respective fingers that input the numbers, the numbers registered as the PIN codes and the information of the respective fingers registered corresponding to the numbers. Are compared, and only when all of them match, the person to be authenticated is authenticated as a legitimate user.

  FIG. 14 illustrates a schematic configuration of the information processing apparatus 10 according to the second embodiment. Each configuration illustrated in FIG. 14 is a functional block in which each processing, control, and actual hardware configuration performed by the information processing apparatus 10 of the present embodiment is divided into functions. In FIG. 14, the same functional blocks as in FIG. 4 described above are denoted by the same reference numerals as in FIG. 4, and description thereof will be omitted.

  That is, the information processing apparatus 10 according to the second embodiment analyzes the three-dimensional coordinates of the detection target as a function different from that of the information processing apparatus 10 according to the first embodiment. In the case of the hand 30 of the user, each finger part of the hand 30 is individually identified, and the coordinates of the identified finger part correspond to the virtual coordinates in the virtual two-dimensional plane. Analyzing means for judging that the selection target image is selected by the identified part when a predetermined movement by the identified finger part is detected, and a plurality of selections sequentially selected by the individually identified finger part. An array of a plurality of numbers corresponding to the target image, identification information of the finger portion that sequentially selected the selection target image, an array of numbers of the authentication code registered in advance, and each number of the authentication code The matching determination of the response to the identification information of the finger part that is registered in advance, which is an example of an apparatus for realizing the functions as the authentication decision means for performing authentication determination of the authentication subject.

  FIG. 15 is a flowchart illustrating a flow of processing and control of the information processing apparatus 10 when personal authentication using a PIN code is performed in the second embodiment. Hereinafter, the operation, processing, and control of each component in FIG. 14 will be described with reference to the flowchart in FIG.

  First, when the user is confirmed in the confirmation process of step S1, the control unit 205 determines that the hand 30 of the authentication target person is the virtual touch panel based on the analysis result performed by the distance sensor output analysis unit 202 as the process of step S21. It is determined whether it exists in the three-dimensional space of 40.

  Here, in the case of the second embodiment, the distance sensor output analysis unit 202 includes a coordinate calculation unit 211, a target recognition unit 212, a finger identification information acquisition unit 213, a fingertip coordinate information acquisition unit 214, and a Z coordinate determination unit 215. It is configured to have.

  The coordinate calculation unit 211 performs an image analysis of the image pickup signals from the two infrared cameras 21L and 21R of the distance sensor 20 to detect a detection target (in the present embodiment, in a three-dimensional space) within the effective range of the distance sensor 20. The three-dimensional coordinates of the hand 30) are calculated for each frame. In the second embodiment, the hand 30 that is the detection target is an object including a palm and five fingers, that is, an object in which a plurality of parts that move differently exist in one detection target. . Therefore, the coordinate calculation unit 211 calculates the three-dimensional coordinates of the palm and the five fingers constituting the hand 30. The three-dimensional coordinate information for each frame calculated by the coordinate calculation unit 211 is sent to the target recognition unit 212.

  The target recognizing unit 212 recognizes what the detection target is based on the imaging signal for each frame and the three-dimensional coordinate information. Here, when the hand 30 including the palm and five fingers is imaged by the infrared camera of the distance sensor 20, the target recognition unit 212 calculates the image signal and the coordinate calculation unit 211 for each frame. From the three-dimensional coordinates, it is recognized that the detection target is the hand 30. In addition, the target recognition unit 212 is a part that configures the hand 30 that is a detection target, that is, a palm and five fingers, a tip (fingertip) of the five fingers, and a bent part of the five fingers. Recognize joints and the like. As described above, when recognizing that the detection target is the hand 30, the target recognition unit 212 transmits the target recognition result and the coordinate information of the hand 30 including the palm and the five fingers to the control unit 205.

  Here, how the object to be detected is a human hand and how the palm and the five fingers constituting the hand are recognized by the target recognition unit 212 will be described with reference to FIG. The following description is a conceptual explanation, and the present invention is not limited to this example.

  When a human hand is imaged by the infrared cameras 21L and 21R of the distance sensor 20, the object recognizing unit 212 uses the image signal and the three-dimensional coordinates calculated for each frame by the coordinate calculating unit 211 to detect a target object. Is composed of a part having a larger area than other parts (part corresponding to a palm) and five parts (parts corresponding to five fingers) extending from the large part and each of which can be individually bent. Recognize that it will be.

  FIG. 16 is a diagram for describing a hand recognized as a detection target by modeling. In the example of FIG. 16, a palm part recognized as a detection target is modeled as a palm object P, and five finger parts are modeled as finger objects F0 to F4, respectively. The finger object F0 corresponds to the thumb, and similarly, the finger object F1 corresponds to the index finger, the finger object F2 corresponds to the middle finger, the finger object F3 corresponds to the ring finger, and the finger object F4 corresponds to the little finger. In the example of FIG. 16, the joints of each finger are modeled as joint objects F0j to F4j, and the fingertips of each finger are modeled as fingertip objects F0t to F4t. The area up to is modeled and represented as a bone object. The object recognition unit 212 recognizes that a detection target having each part that can be modeled exists in the three-dimensional space as shown in FIG. From this, it is recognized that the detection target object is a human hand.

  When receiving the recognition result of the human hand as the detection target from the target recognition unit 212, the control unit 205 determines that the human hand 30 has been detected in the virtual touch panel 40 in step S21 of FIG. The process proceeds to Step S3. When the process proceeds to step S3, the control unit 205 causes the key image 12 arranged at random to be displayed on the screen of the display 11, as in the first embodiment.

  Next, the control unit 205 advances the process to step S22, and causes the finger identification information acquisition unit 213 of the distance sensor output analysis unit 102 to acquire finger identification information for identifying each finger of the hand 30. The fingertip coordinate information acquisition unit 214 is made to acquire the coordinate information of each fingertip. The finger identification information is an example of the part identification information.

  In other words, the finger identification information acquisition unit 213 converts, from the thumb to the little finger, each of the parts of the hand 30 recognized by the target recognition unit 212 that can be modeled, for example, as the finger objects F0 to F4 in FIG. Identify a finger site. Then, the finger identification information acquisition unit 213 sends the finger identification information identifying the finger parts individually to the control unit 205. In addition, the fingertip coordinate information acquisition unit 214 acquires coordinate information of a tip part that can be modeled, for example, as the fingertip objects F0t to F4t in FIG. 16 among the finger parts identified by the finger identification information acquisition unit 213, The coordinate information of each fingertip part is sent to the control unit 205.

  Next, the control unit 205 determines the coordinates of the fingertip of the finger identified by the finger identification information from the finger identification information acquisition unit 213 and the coordinate information of the fingertip from the fingertip coordinate information acquisition unit 214 as the process of step S23. It is determined whether the coordinates match any one of the virtual keys V12 arranged in the three-dimensional space of the virtual touch panel 40. In this case, the coincidence determination is performed to determine whether the X and Y coordinates of the fingertip are within the range of the X and Y coordinates of the virtual key V12. When the controller 205 determines that the fingertip coordinates of the identified finger match the coordinates of the virtual key V12, the process proceeds to step S24, and when it determines that the fingers do not match, the process proceeds to step S22. Reverse processing. At the time of the determination in step S23, a predetermined detection range may be provided around the coordinates of the virtual key V12, as described in the first embodiment.

  Next, the control unit 205 determines whether an air click has been performed on the virtual touch panel 40 based on the Z coordinate determination result of the Z coordinate determination unit 215. Note that the Z coordinate determination process performed by the Z coordinate determination unit 215 is the same as in the first embodiment. Then, in step S24, when receiving the determination detection signal from the Z coordinate determination unit 215, the control unit 205 determines that an air click has been performed. If the air click has not been performed, the control unit 205 returns the process to step S22.

  Next, in step S24, it is determined that an air click has been performed, and when the process proceeds to step S25, the control unit 205 instructs the input information determination unit 203 to input a number corresponding to the coordinates input by the air click. After storing the information as an array PIN (n) and storing the identification information of any finger that has been air-clicked in the array FINGER (n), “1” is added to “n”, and the process proceeds to step S26.

  When the process proceeds to step S26, the control unit 205 sets “n” in the array PIN (n) stored in the input information determination unit 203 to “m” and sets “n” in the array FINGER (n) to “m”. It is determined whether or not “m” has been reached. Note that “m” is “4” when the PIN code has four digits. Therefore, when “n” becomes “4”, control unit 205 causes the process to proceed to step S27. That is, when “n” becomes “4”, the number stored as the array PIN (n) by the input information determination unit 203 becomes a four-digit number, and the four-digit number is displayed on the virtual touch panel 40. And the number entered by the person to be authenticated. Also, when “n” becomes “4”, the number of finger identification information stored in the array FINGER (n) by the input information determination unit 203 becomes “4”. Four air clicks by the identified finger are performed by the person to be authenticated.

  Next, when the process proceeds to step S27, the control unit 205 instructs the input information determination unit 203, for example, to associate the PIN code for each user stored in the memory unit 207 with each numeral of the PIN code. It is determined whether or not the finger identification information and the numbers input by the person to be authenticated via the virtual touch panel 40 and the finger identification information used when inputting the numbers completely match.

  Here, the memory unit 207 stores, for example, table information in which the user information 131, the PIN code 132, and the finger identification information 133 are registered. As the table information, as shown in FIG. 17 as an example, user information U1, U2, U3,... Respectively representing a plurality of users, a registered PIN code of each user, and each number of the PIN code are input. The identification information of the finger is registered in association with the identification information. The PIN code and finger identification information of the user determined to have been registered at the time of the user confirmation in the previous step S1 have been passed to the input information determination unit 203 from the memory unit 107. Therefore, the input information determination unit 203 In step S27, it is determined whether the PIN code and the finger identification information corresponding to each number of the PIN code coincide with the numbers input by the person to be authenticated and the finger identification information when those numbers are input.

  Then, in step S27, when the input information determination unit 203 determines that the input numeral of the person to be authenticated, the PIN code, and the finger identification information all match, the control unit 205 determines that the authentication is OK (OK) in step S10. Then, the authentication OK process is performed. That is, for example, as shown in FIG. 18, the PIN code is, for example, "1, 7, 6, 4", and the finger identification information "F0 (thumb), F4 (little finger), F1 ( In the case where “index finger” and F3 (ring finger) ”have been registered, the number of“ 1 ”by the thumb,“ 7 ”by the little finger,“ 6 ”by the index finger, and“ 4 ”by the ring finger from the authentication target person, When input in that order, the control unit 205 performs an authentication OK process. Subsequent processes are the same as those in the flowchart of FIG. On the other hand, when it is determined in step S27 that the input numeral, the PIN code, and each finger identification information do not completely match, the control unit 205 proceeds to step S12 to perform an authentication NG process. That is, when the PIN code is, for example, “1, 7, 6, 4” and the finger identification information “F0, F4, F1, F3” is registered for the numbers of those PIN codes, the authentication target When a numeral “1, 7, 6, 4” is input from the user using, for example, the index finger, the control unit 205 performs an authentication NG process.

  In the above description, an example has been given in which fingers are identified for all five fingers. However, the authentication processing device 1 according to the second embodiment may select a finger according to a required security level (degree of security). For example, it is also possible to identify only two fingers or to identify only three fingers. As the security level, as in the first embodiment described above, a security level in which only the PIN code number is input without specifying the finger to be used, or only predetermined two or three fingers out of five fingers are identified. Security level to identify all five fingers and the like. These security levels may be set for each registered user, or may be set according to places where entry control is performed. For example, for a place or user where the highest level is required as the security level, a setting is made to identify all of the five fingers, and for example, for a place or user who may have the lowest level, the finger is not specified. be able to.

  According to the authentication processing apparatus 1 of the second embodiment, similarly to the authentication processing apparatus 1 described in the above-described first embodiment, the actual input number can be viewed by a third party or pirated. Is not performed, and very high security can be ensured. Further, for example, when a fake click is performed, there is no risk that a third party will know which number is the PIN code number. Further, according to the authentication processing device 1 of the second embodiment, similarly to the first embodiment, the person to be authenticated does not need to actually touch the touch panel or the like with his / her fingertip, so that no trace such as a fingerprint pattern remains. Your fingerprint pattern will not be stolen. Further, in the authentication processing apparatus 1 of the second embodiment, similarly to the first embodiment, if the configuration in which the reflection plate 51 and the optical imaging plate 50 are provided is used, the PIN code can be stolen by a third party or voyeurized. Can be effectively prevented. Further, according to the authentication processing device 1 of the second embodiment, as in the first embodiment, even in a dark environment, the person to be authenticated can input a PIN code.

  Further, in addition to the same effects as those of the first embodiment, in the authentication processing device 1 of the second embodiment, for each number of the PIN code, a finger for inputting the number can be individually registered. Therefore, higher security can be realized. For example, if the PIN code is a four-digit number, there are only 10,000 combinations of these numbers in the fourth power of 10. However, as in the second embodiment, the four-digit number of the PIN code must be entered. On the other hand, when it is registered which of the five fingers is to be used, 62,500,000 combinations of 10 × 5 to the fourth power are registered. That is, according to the second embodiment, the security strength becomes 625 times as compared with the case where only the 4-digit number of the PIN code is used, and it becomes very difficult to impersonate a legitimate user and perform fraud. .

  Further, in the case of the authentication processing apparatus 1 of the second embodiment, since the security level can be set as described above, the degree of security is changed according to each registered user and a place where entry / exit management is performed. Can be.

  In the second embodiment, details will be described in a third embodiment which will be described later. However, the coordinates used for determining whether or not the recognized fingertip 31 has performed the air click are fixed in advance on the Z coordinate axis. The reference coordinates are not limited to the predetermined coordinates. That is, the coordinates used to determine whether the air click has been performed are, for example, after the fingertip 31 of the hand 30 of the person to be authenticated is detected in the three-dimensional space of the virtual touch panel 40, From each Z coordinate of each fingertip 31 when it is stationary for a predetermined time in the three-dimensional space, it is possible to set a coordinate that is separated by a predetermined distance in the fingertip direction and in the Z-axis direction. In other words, the coordinates used for air click determination can be set as variable coordinates according to each Z coordinate when each fingertip 31 is stationary in the three-dimensional space.

<Third embodiment>
In the first and second embodiments described above, examples are given in which the virtual touch panel 40 is set to face the person to be authenticated. That is, the first and second embodiments exemplify an example in which the virtual touch panel 40 is set as a virtual two-dimensional plane including the X axis and the Y axis when the direction of gravity is the Y axis direction.

  On the other hand, in the third embodiment, an example will be described in which the virtual two-dimensional plane of the virtual touch panel 40 is set substantially horizontally when viewed from the person to be authenticated. That is, in the third embodiment, as shown in FIG. 19, for example, when the gravity direction is set to the Y-axis direction, the virtual touch panel 40 is set as a virtual two-dimensional plane including the X axis and the Z axis. . In the case of the arrangement shown in FIG. 19, the display 11 and the distance sensor 20 viewed from the person to be authenticated have an arrangement relationship as shown in FIG. 20, for example. It will be set in a three-dimensional space. As in the example of FIG. 19, when the virtual touch panel 40 and the display surface of the display 11 are set to be substantially horizontal when viewed from the person to be authenticated, the person to be authenticated is substantially the same as when operating an existing bank ATM. The operation on the virtual touch panel 40 can be performed in the same posture.

  19 and 20, the display 11 is installed so that its display surface is horizontal when viewed from the person to be authenticated, and similarly, the distance sensor 20 is installed so that the sensor surface 20F is horizontal. However, this is only an example. In particular, if the virtual two-dimensional plane of the virtual touch panel 40 is within the effective range of the distance sensor 20, for example, when the gravity direction is the Y-axis direction, it can be set at any inclination with respect to the Y-axis. In the same manner, any inclination can be set for the X axis or the Z axis. FIG. 19 illustrates an example in which the Y-axis direction coincides with the direction of gravity. However, the Y-axis direction does not need to coincide with the direction of gravity, and is set as an axis inclined with respect to the direction of gravity. It may be. This is the same not only in the third embodiment but also in the first and second embodiments described above.

  Further, after the fingertip 31 of the hand 30 of the person to be authenticated is detected in the three-dimensional space of the virtual touch panel 40, the authentication processing device of the third embodiment stops the fingertip 31 of the hand 30 in the three-dimensional space. Time is measured. When the authentication processing device detects that the fingertip 31 has stopped for a predetermined time (hereinafter, referred to as a stillness determination time), the authentication processing device calculates the Y-coordinate of each fingertip 31 in the respective fingertip directions and in the Y-axis direction. Coordinates separated by a predetermined distance in each direction are set as coordinates used for determining whether an air click has been performed (hereinafter, referred to as air click determination coordinates). That is, in the case of the third embodiment, the air click determination coordinates are set as variable coordinates according to the Y coordinates of each fingertip 31 when the fingertip 31 is stationary in the three-dimensional space for the stationary determination time.

  In addition, it is preferable that the air click determination coordinate is set so as to have a determination area in which the width in the X-axis direction and the width in the Z-axis direction are each a predetermined width around the set Y coordinate. That is, when the fingertip 31 is moved in the Y-axis direction from a stationary state, the fingertip 31 does not always move exactly along the Y-axis. This is to make detection possible.

  FIG. 21 shows that the Y coordinate value separated by a predetermined distance DY0 from the fingertip coordinates FC0 of the thumb is set as the air click determination coordinate YS0 for the thumb, and similarly, a predetermined distance from each of the fingertip coordinates FC1 to FC4 of the index finger to the little finger. This conceptually illustrates a state in which Y coordinate values separated by DY1 to DY4 are set as air click determination coordinates YS1 to YS4 for the index finger to the little finger, respectively. The air click determination coordinates YS0 to YS4 have a determination area in which the X-axis direction and the Z-axis direction have a predetermined width as shown in FIG.

  After setting the air click determination coordinates YS0 to YS4 for the fingertip coordinates FC1 to FC4, the authentication processing device of the third embodiment determines whether any of the fingertip coordinates FC reaches the air click determination coordinate YS. Or, when it exceeds, it is determined that the air click has been performed. On the other hand, in the third embodiment, after the air click determination coordinates YS0 to YS4 are set, even if any fingertip coordinate FC moves to the vicinity of the air click determination coordinate YS, it does not reach the air click determination coordinate YS. Otherwise, a fake click results.

  The predetermined distances DY0 to DY4 from the fingertip coordinates FC0 to FC4 to the air click determination coordinates YS1 to YS4 are set to 1.0 cm, for example. The reason why the predetermined distance is set to 1.0 cm is that if the predetermined distance is set shorter than 1.0 cm, for example, when an air click is made with a ring finger or the like, the middle finger and the little finger move together with the movement of the ring finger. This is to reduce the possibility that the middle finger and the little finger are erroneously determined to have been air clicked. Of course, the predetermined distance of 1.0 cm is an example. For example, the predetermined distance for a finger that is easy to move such as a thumb, forefinger, or middle finger is set to be long, and the predetermined distance for a finger that is difficult to move such as a ring finger is set to be short. There may be. Further, for example, the predetermined distance to each fingertip may be changed according to a required security level.

  The stillness determination time for determining whether or not the fingertip 31 has stopped is set as a predetermined time such as one second as an example. When the stillness determination time is set to a predetermined time, the air click determination coordinates are set when it is detected that the state in which the fingertip 31 has stopped is longer than the stillness determination time. The stillness determination time may be set to a different time for each fingertip, or may be set to a different time according to, for example, a security level.

  Hereinafter, the authentication processing device 1 according to the third embodiment of the present invention will be described below. FIG. 22 illustrates a schematic configuration of an information processing apparatus 10 according to the third embodiment. Each configuration illustrated in FIG. 22 is a functional block in which each process, control, and actual hardware configuration performed by the information processing apparatus 10 of the present embodiment are divided into functions. In FIG. 22, the same reference numerals as in FIG. 14 denote the same functional blocks as in FIG. 14, and a description thereof will be omitted.

  The basic configuration and processing of the information processing apparatus 10 according to the third embodiment are substantially the same as those in FIG. 14, but include a Y coordinate determination unit 255 instead of the Z coordinate determination unit 215 in FIG. Also, the processing of the control unit 250 is partially different. In the case of the third embodiment, the correspondence between the key images 12 randomly arranged on the screen of the display 11 and the virtual keys V12 arranged in the virtual touch panel 40, the recognition of each finger of the person to be authenticated, and the air The personal authentication and the like by associating the finger used for the click with the four-digit PIN code are the same as in the second embodiment, but the arrangement relationship of the virtual touch panel 40, the distance sensor 20, the display 11 and the like are shown in FIG. 21 through FIG. 21.

  FIG. 23 is a flowchart illustrating a flow of processing and control of the information processing apparatus 10 when personal authentication using a PIN code is performed in the third embodiment. In FIG. 23, the same processing steps as those in FIG. 15 described above are denoted by the same reference numerals as in FIG. 15, and description thereof will be omitted. Hereinafter, the operation, processing, and control of each component in FIG. 22 will be described with reference to the flowchart in FIG.

  In FIG. 23, when the process proceeds from step S1 to step S31 via step S22, the control unit 250 determines the hand 30 of the authentication target person from the coordinate information of each fingertip acquired by the fingertip coordinate information acquiring unit 214 for each frame. The time during which the fingertip 31 is stationary in the three-dimensional space is measured, and it is determined whether the fingertip 31 is stationary for the stationary determination time. The control unit 250 returns the process to step S22 while determining that the fingertip 31 is not stationary until the stationary determination time is reached, and proceeds to step S32 when detecting that the fingertip 31 is stationary for the stationary determination time or longer. .

  When the process proceeds to step S32, the control unit 250 sets the coordinates of the fingertip of the finger identified by the finger identification information from the finger identification information acquisition unit 213 and the coordinate information of the fingertip from the fingertip coordinate information acquisition unit 214 to: It is determined whether the coordinates match any one of the virtual keys V12 arranged in the three-dimensional space of the virtual touch panel 40. The match determination in the third embodiment is a match determination as to whether the X, Z coordinates of the fingertip are within the range of the X, Z coordinates of the virtual key V12. If the controller 250 determines that the fingertip coordinates of the identified finger match the coordinates of the virtual key V12, the controller 250 proceeds to step S33, and if it determines that the fingers do not match, it proceeds to step S22. return. At the time of the determination in step S32, a predetermined detection range may be provided around the coordinates of the virtual key V12, as described in the first embodiment.

  When the process proceeds to step S33, the control unit 250 sets the air click determination coordinates separated from the Y coordinate of the fingertip 31 by a predetermined distance in the fingertip direction and the Y-axis direction as described above. Then, the control unit 250 passes the information of the set air click determination coordinates to the Y coordinate determination unit 255. Then, when the coordinates of the fingertip 31 have reached or exceeded the air click determination coordinates, the Y coordinate determination unit 255 sends a Y coordinate determination result indicating that fact to the control unit 250.

  Upon receiving the Y coordinate determination result indicating that the coordinates of the fingertip 31 have reached the air click determination coordinates, the control unit 250 determines that an air click has been performed as the process of step S34, and then proceeds to step S25. On the other hand, when the coordinates of the fingertip 31 have not reached the air click determination coordinates, the control unit 250 returns the process to step S22. The processing after step S25 is the same as that in the flowchart of FIG. 15, and a description thereof will be omitted.

  In the third embodiment, as in the second embodiment, the number of fingers to be recognized may be changed according to the required security level (security level). May be set for each registered user, or may be set according to a place where entry control is performed.

  According to the authentication processing device 1 of the third embodiment, the same effects as those described in the first and second embodiments can be obtained. Further, in the authentication processing device 1 of the third embodiment, the person to be authenticated can operate the virtual touch panel 40 in a posture almost the same as that when operating an existing bank ATM or the like. By setting, erroneous determination of air click can be reduced.

<Fourth embodiment>
Next, an authentication processing device 1 according to a fourth embodiment of the present invention will be described below. The overview of the authentication processing device 1 of the fourth embodiment is the same as that of FIG. 1 described above, and the schematic configuration of the information processing device 10 is the same as that of FIG. 14 or the third embodiment of the second embodiment. Since the configuration is the same as that of FIG. 22, their illustration is omitted. The authentication processing device 1 according to the fourth embodiment individually recognizes five fingers of the hand of the person to be authenticated, recognizes whether or not an air click has been performed by a predetermined finger among them, and uses the predetermined finger. When the air click is performed, information such as each numeral of each virtual key V12 respectively corresponding to all five fingers of the hand is acquired. Hereinafter, only the portions of the fourth embodiment that are different from the above-described second and third embodiments will be described.

  Here, in the case of the fourth embodiment, when the PIN code is input, the information processing apparatus 10 performs the air click with the predetermined finger (in this embodiment, the index finger) of the person to be authenticated. In this case, together with the identification information of the five fingers, the information of each numeral of the virtual key V12 in which the fingertips of all five fingers at the time of the air click are respectively obtained. If the fingertips of the remaining fingers that have not been air-clicked are not included in any of the virtual keys V12, information indicating that they are not any of the numbers of the virtual keys V12 is obtained. In the present embodiment, a symbol # is used as information indicating that it is not any numeral of each virtual key V12. In the case of the fourth embodiment, the area outside each virtual key V12, that is, the image area outside the key image 12 in the image displayed on the screen of the display 11, indicates that it is not any numeral of each virtual key V12. The area of the selection target image corresponding to the information (symbol #) is set.

  Then, the information processing apparatus 10 of the fourth embodiment includes the finger identification information of one finger (the index finger) that has performed the air click, the number of the virtual key V12 corresponding to the fingertip, and the remaining four that have not been air clicked. The five pieces of information consisting of the identification information of the fingers of the book and four pieces of information (four pieces of information consisting of numbers, symbols #, etc.) corresponding to the positions of the fingertips are converted into, for example, one of four-digit PIN codes. It is obtained as a candidate code (candidate sequence) for determining the code.

  FIGS. 24A to 24D show, in the fourth embodiment, each virtual key V12 arranged in the three-dimensional space of the virtual touch panel 40 and the thumb of the person to be authenticated in the virtual touch panel 40. An example of the position of each of the five fingertips F0 to F4 of the little finger is shown. It is assumed that each number in each virtual key V12 is a number associated with each virtual key V12. In the example of the figure, in order to make the description easier to understand, the respective numbers corresponding to the respective virtual keys V12 are arranged in the order of 0 to 9, but these numbers are the same as described in the above-described embodiments. They may be arranged randomly. 24 (a) to 24 (d), it is the index finger that performs the air click, while the circle mark EC in FIGS. 24 (a) to 24 (d) is sequentially clicked by the index finger. At each point in time, a virtual key V12 corresponding to each number registered as a correct PIN code is shown.

  The example of FIG. 24A shows five fingertips F0 to F4 when the first code (PIN = 1) of the four-digit PIN code is input (when the first air click is performed). The example of the position of is shown. In the example of FIG. 24A, when the first air click is performed with the index finger (F1), the correct PIN code (first PIN code) to be input is the number “1” and the number “1”. It is assumed that the finger to which "1" is to be input is registered in advance as the middle finger (F2). In the example of FIG. 24A, for example, the fingertip F0 of the thumb is located in the virtual key V12 of the number “3”, and similarly, the fingertip F1 of the index finger is the number “0”, and the fingertip F2 of the middle finger is the number “1”. , The fingertip F3 of the ring finger is located within the virtual key V12 having the number “2”, and the fingertip F4 of the little finger is located within the virtual key V12 having the number “6”. Therefore, as shown in FIG. 25, among the four-digit PIN codes, candidate codes for determining the first code (PIN = 1) are five codes “F0” to “F4” corresponding to the fingertips F0 to F4 of the thumb to the little finger. 3,0,1,2,6 ".

  Further, the example of FIG. 24B shows five fingertips F0 when the second code (PIN = 2) of the four-digit PIN code is input (when the second air click is performed). The example of the position of -F4 is shown. In the example of FIG. 24B, when the second air click is performed with the index finger (F1), the correct PIN code (the second PIN code) to be input is the number “5” and the number “5”. It is assumed that the finger to which "5" is to be input is registered in advance as the ring finger (F3). In the example of FIG. 24B, for example, the fingertip F0 of the thumb is outside the virtual key V12, the fingertip F1 of the index finger is located within the virtual key V12 of the number “3”, and so on. Is located within the virtual key V12 having the number “4”, the fingertip F3 of the ring finger being the number “5”, and the fingertip F4 of the little finger being the number “9”. Therefore, as shown in FIG. 25, among the four-digit PIN codes, candidate codes for determining the second code (PIN = 2) are five codes “F0” to “F4” corresponding to the fingertips F0 to F4 of the thumb to the little finger. #, 3, 4, 5, 9 ".

  Similarly, the example of FIG. 24C shows five fingertips when the third code (PIN = 3) of the four-digit PIN code is input (when the third air click is performed). The example of the position of F0-F4 is shown. In the example of FIG. 24C, when the third air click is performed with the index finger (F1), the correct PIN code (third PIN code) to be input is the number “3” and the number “3”. It is assumed that the finger to which "3" is to be input is registered in advance as the index finger (F1). In the example of FIG. 24C, for example, the fingertip F0 of the thumb is outside the virtual key V12, the fingertip F1 of the index finger is the number "3", the fingertip F2 of the middle finger and the fingertip F3 of the ring finger are both the number "4", and the fingertip F4 of the little finger Are located in the virtual key V12 of the number “8”. Therefore, as shown in FIG. 25, among the four-digit PIN codes, candidate codes for determining the third code (PIN = 3) are five codes “F0 to F4 corresponding to the fingertips F0 to F4 of the thumb to the little finger. #, 3, 4, 4, 8 ".

  Similarly, the example of FIG. 24D shows five fingertips when the fourth code (PIN = 4) of the four-digit PIN code is input (when the fourth air click is performed). The example of the position of F0-F4 is shown. In the example of FIG. 24C, when the fourth air click is performed with the index finger (F1), the correct PIN code (fourth PIN code) to be input is the number “8” and the number “8”. It is assumed that the finger to which "8" is to be input is registered in advance as the little finger (F4). In the example of FIG. 24D, the fingertip F0 of the thumb is outside the virtual key V12, the fingertip F1 of the index finger is the number “3”, the fingertip F2 of the middle finger and the fingertip F3 of the ring finger are both the number “4”, and the fingertip F4 of the little finger is It is located within the virtual key V12 with the number “8”. Therefore, as shown in FIG. 25, the candidate codes for determining the fourth code (PIN = 4) among the four-digit PIN codes are five codes “F0” to “F4” corresponding to the fingertips F0 to F4 of the thumb to the little finger. #, 3, 4, 4, 8 ".

  As described above, the information processing apparatus 10 of the fourth embodiment performs four air operations for determining the first code (PIN = 1) to the fourth code (PIN = 4) of the four-digit PIN code. When a click is made, every time an air click is made, five candidate codes corresponding to each of the fingertips F0 to F4 are acquired. Each number in these five candidate codes is associated with identification information of each finger at each fingertip F0 to F4.

  In the case of the examples of FIGS. 24A to 24D and FIG. 25, the candidate code “3, 0, 1, 2, 6, 6” acquired to determine the first code (PIN = 1) of the PIN code , The number registered with PIN = 1 is “1”, and the finger corresponding to the number “1” is the middle finger (F2). Similarly, among the candidate codes “#, 3, 4, 5, 9” acquired when determining the second code (PIN = 2) of the PIN code, the number registered at PIN = 2 is “ The finger corresponding to the numeral "5" is the ring finger (F3), and among the candidate codes "#, 3, 4, 4, 8" acquired when determining PIN = 3. , PIN = 3 is “3”, the finger corresponding to the number “3” is the index finger (F1), and the candidate code “#, #” acquired when PIN = 4 is determined. In “3, 4, 4, 8”, the number registered at PIN = 4 is “8”, and the finger corresponding to the number “8” is the little finger (F4).

  For this reason, in the case of the examples of FIGS. 24A to 24D and FIG. 25, “1, 5, 3, 8” is acquired as a four-digit PIN code in the input order by four air clicks, For the code "1" by the first air click, the finger identification information of the middle finger (F2) is obtained. For the code "5" by the second air click, the ring finger (F3) and the code "3" by the third air click The finger identification information of the index finger (F1) is obtained for “3”, and the finger identification information of the little finger (F4) is obtained for the code “8” obtained by the fourth air click. Here, in the present embodiment, the PIN codes registered for the person to be authenticated are, for example, in the order of “1, 5, 3, 8”, and the order of the finger identification information corresponding to those codes is “Middle finger (F2 ), The ring finger (F3), the index finger (F1), and the little finger (F4) ", the registered PIN code and the finger identification information, and FIG. 24 (a) to FIG. 24 (d) and FIG. In the example, the PIN code and the finger identification information obtained by four air clicks match, and therefore, the person to be authenticated is authenticated as a valid registrant.

  Further, as described above, in the case of the fourth embodiment, four air clicks are performed to determine the first code (PIN = 1) to the fourth code (PIN = 4) of the four-digit PIN code. Then, five candidate codes are obtained for each air click. Here, in the case of the fourth embodiment, of the five candidate codes acquired for each air click, only one candidate code corresponding to a previously registered finger is treated as an input code. All four candidate codes by four fingers other than are treated as fake codes. Further, in the case of the fourth embodiment, the air click is performed only with the index finger that is a predetermined finger, and when the finger for inputting the registered code is not registered as the index finger, the index finger that performed the air click is used. The air click itself becomes a fake. In the case of the examples of FIGS. 24A to 24D and FIG. 25, in the first air click, only the number “1” corresponding to the middle finger (F2) is treated as the input code, and the remaining thumb The number "3" corresponding to (F0), the number "0" corresponding to the index finger (F1) that performed the air click, the number "2" corresponding to the ring finger (F3), and the number "6" corresponding to the little finger (F0). Are all treated as fake codes. Similarly, in the second air click, a code in which only the number “5” corresponding to the ring finger (F3) is entered, the symbol “#” by the remaining thumb (F0), and the index finger (F1) performing the air click ), The number “4” by the middle finger (F2), and the number “9” by the little finger (F0) are all treated as fake codes. The same is performed for the third and fourth air clicks.

  As described above, according to the fourth embodiment, the air click itself is treated as a fake, and among the five candidate codes, the input code is treated as one candidate code selected by a pre-registered finger. And the remaining four candidate codes are all fake codes. According to the fourth embodiment, five candidate codes are generated every four air clicks for determining the first code (PIN = 1) to the fourth code (PIN = 4) of the four-digit PIN code. Therefore, the number of PIN code candidates is 5 × 4 × 4 × 4 = 320. For this reason, even if hacking or the like is performed by a malicious person, there is very little possibility that the registered PIN code will be known.

  In the information processing apparatus 10 according to the fourth embodiment, the authentication process is performed in a flow substantially similar to that described in the flowcharts of FIGS. 15 and 23 described above. And the processing of step S25 in FIG. Hereinafter, regarding the authentication processing in the fourth embodiment, processing different from the flowcharts of FIGS. 15 and 23 will be described.

  In the case of the fourth embodiment, instead of the processing described in step S25 of FIG. 15 or FIG. 23, the control unit 205 controls the input information determination unit 203 to perform the first to fourth airflows using the index finger as described above. The candidate codes obtained by the five fingers when the click is made are stored as an array PIN (M, N). “M” is a value of the number of first to fourth air clicks (“1 to 4” at PIN = 1 to PIN = 4). Then, control unit 205 adds “1” to “M” in array PIN (M, N) for input information determination unit 203, and proceeds to step S26. In the case of the fourth embodiment, when the process proceeds to step S26, the control unit 205 determines whether “M” of the array PIN (M, N) stored in the input information determination unit 203 has become “4”. Is determined.

  Here, “N” in the array PIN (M, N) is “1” for the thumb, “2” for the index finger, “3” for the middle finger, and “3” for the ring finger as values corresponding to each finger. Represents a value of “4”, the little finger has a value of “5”, and if “N” is represented as “1: 5”, it indicates that individual numbers and symbols by five fingers are included.

An example will be described with reference to FIGS. 24A to 24D and FIG. 25 described above.
When the first air click is performed with the index finger, the array PIN (1, 1) is “3”, the array PIN (1, 2) is “0”, the array PIN (1, 3) is “1”, and the array PIN is (1, 4) is "2", and the array PIN (1, 5) is "6". In this case, PIN (1, 1: 5) is (3, 0, 1, 2, 6).
When an air click is performed with the second index finger, the array PIN (2, 1) is “#”, the array PIN (2, 2) is “3”, the array PIN (2, 3) is “4”, and the array PIN is (2, 4) is “5”, and the array PIN (2, 5) is “9”. In this case, PIN (2, 1: 5) is (#, 3, 4, 5, 9).
When the third air click is performed with the index finger, the array PIN (3, 1) is “#”, the array PIN (3, 2) is “3”, the array PIN (3, 3) is “4”, and the array PIN is (3, 4) is "4" and the array PIN (3, 5) is "8". In this case, PIN (3, 1: 5) is (#, 3, 4, 4, 8).
When the air click is performed by the index finger for the fourth time, the array PIN (4, 1) is “#”, the array PIN (4, 2) is “3”, the array PIN (4, 3) is “4”, and the array PIN is (4, 4) is “4” and the array PIN (4, 5) is “8”. In this case, PIN (4, 1: 5) is (#, 3, 4, 4, 8).

The results of four candidate code inputs when these first to fourth air clicks are made are:
PIN (1,1: 5) = (3,0,1,2,6),
PIN (2,1: 5) = (#, 3,4,5,9),
PIN (3,1: 5) = (#, 3,4,4,8),
PIN (4,1: 5) = (#, 3,4,4,8).
There are 320 such combinations as described above, of which only one is the correct PIN code, that is, PIN (1,3) = "1" at the time of the first air click, and the second air click Then, PIN (2,4) = “5”, PIN (3,2) = “3” in the third air click, and PIN (4,5) = 8 in the fourth air click. In this case, the input PIN code is "1, 5, 3, 8".

  In the fourth embodiment, the control unit 205 determines in step S27 of FIG. 15 or FIG. 23 that each of the candidate codes and the finger identification information obtained by the PINs (M, N) in the order in which the air clicks were performed. Then, a match is determined between the previously registered PIN code and finger identification information. In the case of the fourth embodiment, the middle finger is for the first PIN code “1”, the ring finger is for the second PIN code “5”, the index finger is for the third PIN code “3”, The little finger is registered for the fourth PIN code "8", and in step S27, it is determined whether or not the PIN code "1, 5, 3, 8" matches each registered finger. Is performed.

<Fifth embodiment>
In the above-described fourth embodiment, an example is described in which only the number corresponding to the virtual key V12 is used as the PIN code. However, in the fifth embodiment, the above-described symbol “#” corresponding to the area outside the virtual key V12 is used. Is also treated as a PIN code. In the case of the fifth embodiment, the area outside each virtual key V12, that is, the image area outside the key image 12 in the image displayed on the screen of the display 11, is a code (symbol #) other than each numeral of each virtual key V12. ) Is set as the selection target image. Therefore, the information processing apparatus 10 of the fifth embodiment allows the user to select (input) the code of the symbol # corresponding to the area outside each virtual key V12.

  In FIGS. 26A to 26D and FIG. 27, the symbol “#” corresponding to the area outside the virtual key V12 as in the fifth embodiment is registered as one of the PIN codes. 9 shows an example of authentication when the authentication is performed. Note that the fifth embodiment is an example in which the symbol “#” outside the virtual key V12 is treated as one of the PIN codes in the fourth embodiment.

  FIGS. 26A to 26D show the virtual key V12 and the authentication target person in the fifth embodiment, similarly to the example of FIGS. 24A to 24D described above. An example of the positions of the fingertips F0 to F4 is shown. The circle marks EC in FIGS. 26A to 26D are drawn to indicate the virtual keys V12 corresponding to the numbers registered as the PIN codes, respectively.

  In the example of FIG. 26A, the fingertips F0 to F0 when the first air click is performed with the index finger of the four-digit PIN code, that is, when the first code (PIN = 1) is input. The example of the position of F4 is shown. In the example of FIG. 26A, when the first air click is performed with the index finger (F1), the correct PIN code (first PIN code) to be input is the number “1” and the number “1”. Is input in advance as the middle finger (F2). In the example of FIG. 26A, the thumb (F0) has the number “3”, the index finger (F1) has the number “0”, the middle finger (F2) has the number “1”, the ring finger (F3) has the number “2”, and the little finger. (F4) points to the number “6”. Therefore, as shown in FIG. 27, the candidate codes for determining the first code (PIN = 1) are “3, 0, 1, 2, 6”.

  FIG. 26B illustrates an example of the positions of the fingertips F0 to F4 when the second air click is performed, that is, when the second code (PIN = 2) is input. In the example of FIG. 26B, when the second air click is performed with the index finger (F1), the correct PIN code (the second PIN code) to be input is the symbol “#” and the symbol “#”. Is input in advance as a thumb (F0). In the example of FIG. 26B, the thumb (F0) is outside the virtual key V12, the index finger (F1) is the number "7", the middle finger (F2) is the number "8", the ring finger (F3) is the number "9", and the little finger. (F4) points outside the virtual key V12. Therefore, as shown in FIG. 27, candidate codes for determining the second code (PIN = 2) are “#, 7, 8, 9, #”.

  FIG. 26C shows an example of the positions of the fingertips F0 to F4 when the third air click is performed, that is, when the third code (PIN = 3) is input. In the example of FIG. 26C, when the third air click is performed with the index finger (F1), the correct PIN code (third PIN code) to be input is the number “3” and the number “3”. Is assumed to be registered in advance as the index finger (F1). In the example of FIG. 26C, the thumb (F0) is outside the virtual key V12, the index finger (F1) is the number "3", the middle finger (F2) is the number "4", the ring finger (F3) is the number "5", and the little finger. (F4) points to the number “9”. Therefore, as shown in FIG. 27, candidate codes for determining the third code (PIN = 3) are “#, 3, 4, 5, 9”.

  FIG. 26D shows an example of the positions of the fingertips F0 to F4 when the fourth air click is performed, that is, when the fourth code (PIN = 4) is input. In the example of FIG. 26D, when the fourth air click is performed with the index finger (F1), the correct PIN code (fourth PIN code) to be input is the number “8” and the number “8”. Is input in advance as the little finger (F4). In the example of FIG. 26D, the thumb (F0) and the index finger (F1) are both outside the virtual key V12, the middle finger (F2) is the number “3”, the ring finger (F3) is the number “4”, and the little finger (F4) is It points to the number "8". Therefore, as shown in FIG. 27, candidate codes for determining the fourth code (PIN = 4) are “#, #, 3, 4, 8”.

  In the case of the examples of FIGS. 26 (a) to 25 (d) and FIG. 27, among the candidate codes “3, 0, 1, 2, 6” of PIN = 1 acquired at the time of the first air click. The number registered at PIN = 1 is “1”, and the finger corresponding to the number “1” is the middle finger (F2). Similarly, among the candidate codes “#, 7, 8, 9, #” of PIN = 2 acquired at the time of the second air click, the symbol “#,” registered at PIN = 2, And the finger corresponding to the symbol “#” is the thumb (F0), and the candidate code “#, 3, 4, 5, 5” acquired at the time of the third air click (PIN = 3) 9 ”, the number registered at PIN = 3 is the number“ 3 ”, the finger corresponding to the number“ 3 ”is the index finger (F1), and the fourth air click (PIN = 3) Of the candidate codes “#, #, 3, 4, 8” obtained in 4), the number registered at PIN = 4 is the number “8”, which corresponds to the number “8”. The finger that has been made is the little finger (F4).

  For this reason, in the case of the examples of FIGS. 26A to 26D and FIG. 27, “1, #, 3, 8” is acquired as a 4-digit PIN code in the input order by four air clicks, Also, the middle finger (F2) for the first PIN code "1", the thumb (F0) for the second PIN code "5", the index finger (F1) for the third PIN code "3", the fourth PIN For the code "8", finger identification information of the little finger (F4) is obtained. The PIN codes registered for the person to be authenticated are, for example, in the order of “1, #, 3, 8”, and the order of the finger identification information corresponding to each code is “the middle finger (F2), the thumb (F0)” , Index finger (F1), little finger (F4) ", the registered PIN code and finger identification information are obtained in the examples of FIGS. 26 (a) to 26 (d) and FIG. 27. Since the PIN code and the finger identification information match, the person to be authenticated is authenticated as a valid registrant.

  In the case of the fifth embodiment, not only the same effects as in the above-described fourth embodiment are obtained, but also the area outside the virtual key V12 is treated as one of the PIN codes, so With respect to the PIN code of the digit, 5 ^ 4 = 625 kinds of candidate codes are obtained, and the resistance to hacking and the like is higher than 320 kinds in the case of the fourth embodiment. Note that the flowchart in the case of the fifth embodiment is substantially the same as that in the case of the above-described fourth embodiment, and a description thereof will be omitted.

<Other embodiments>
In each of the above-described embodiments, when the hand 30 or the fingertip 31 of the person to be authenticated stops in the three-dimensional space for a predetermined time, the coordinates separated by a predetermined distance in the fingertip direction are set as the coordinates for the air click determination. Although it is possible, as another example, if, for example, some fingertips 31 move after it is determined to be stationary, air click is performed by the finger having the largest movement amount among the moved fingertips 31. It may be determined that this has been done. That is to say, taking the configuration of FIG. 22 as an example, the hand 30 and the like stand still for a predetermined time as described above in a state where a predetermined fingertip 31 is set to a desired virtual key V12 by the person to be authenticated. When the fingertips 31 of the fingers from the thumb to the little finger move in the three-dimensional space after the movement, the control unit 250 compares the movement amounts (coordinate change amounts), and determines the fingertip having the largest change amount. 31 determines that an air click has been performed. That is, the fingertip 31 with the largest change amount in this case is the predetermined fingertip 31 that has been set to the desired virtual key V12, and the person to be authenticated can move the fingertip 31 with a small amount of movement without moving the fingertip 31 greatly. You will be able to air click. Also, in this example, even if a third party is looking over the shoulder of the person to be authenticated, the fingertip of the person to be authenticated has little movement, and multiple fingers are moving at the same time. A third party cannot know if the process has been performed. This example is applicable to each of the above-described embodiments.

  The authentication processing device 1 of each of the above-described embodiments is applicable to a system that requires advanced security management, such as a bank ATM or a research laboratory. FIG. 28 illustrates a schematic configuration example of a system to which the personal authentication of each embodiment is applied and security management is performed by a server.

  In the security system of FIG. 28, the server 300 is roughly configured to include a system information storage unit 301, a system control unit 302, and a network I / F unit 303. The network I / F unit 303 is capable of communicating with a terminal 310 whose security is controlled by the server 300 via a network 304. Each terminal 310 is provided with the distance sensor 20 described above. The system control unit 302 controls the entire security system, and also manages information transmitted / received to / from the terminal 310 connected through the network 304.

  The system information storage unit 301 in the server 300 stores various information for managing the entire system, the user information of all users registered in this security system, the information of PIN codes of all users, The above-described table information including the finger identification information is stored. In the case of this security system, each terminal 310 does not internally hold the table information of all the users, and transmits only the information necessary for the personal authentication of the person to be authenticated via the network 304 when the individual is authenticated. From the server 300. Then, the terminal 310 performs only the same analysis on the output signal of the distance sensor 20 as in the above-described distance sensor output analysis unit, and the server 300 uses the analysis information in the same manner as in the above-described embodiments to determine the authentication target. Perform personal authentication. When the server 300 determines that the person to be authenticated is a legitimate user, the server 300 allows the person to be authenticated to perform operations such as depositing and withdrawing using a bank ATM, and to enter and exit the room. (Such as unlocking).

  In the case where the terminal 310 performs personal authentication as in the information processing apparatus 10 described above, the terminal 310 is stored in the server 300 when it is confirmed that the person to be authenticated is a registered user in step S1 described above. Of the table information of all registered users, only the PIN code and finger identification information registered for the user confirmed in step S1 are received from server 300. When the terminal 310 determines that the person to be authenticated is a legitimate user, the server 300 permits the person to be authenticated to perform operations such as depositing and withdrawing using a bank ATM, and to enter and exit the room. (Such as unlocking).

  Further, in the second to fifth embodiments, the example in which the five fingers of the hand are recognized has been described. However, for example, the left and right hands are identified, and further, each of the five fingers is individually identified. It is also possible to identify. For example, when the model shown in FIG. 16 described above is taken as an example, the finger object F0 corresponding to the thumb is on the left and the finger object F4 corresponding to the little finger is on the right. In such a case, it can be recognized as the right hand. Similarly, when the finger object F0 of the thumb is on the left side and the finger object F4 of the little finger is on the right side, it can be recognized as the left hand. As described above, when all of the left and right hands and the total of ten fingers can be identified, it is possible to set a higher security level than when using five fingers of one hand.

  In each of the above-described embodiments, an example is described in which the PIN code number is input through the virtual touch panel 40. However, the present invention is not limited to inputting numbers, and other characters and icons are input through the virtual touch panel 40. Therefore, the present invention can be applied to the case of performing personal authentication.

  In the above-described embodiment, the virtual touch panel 40 is a virtual two-dimensional panel. However, the virtual touch panel 40 may be a virtual three-dimensional panel having a three-dimensional depth. In this case, for example, each virtual key V12 is The virtual three-dimensional panel may be arranged at different locations in the Z-axis direction. Further, in this case, the reference coordinates and air click determination coordinates may be set for each virtual key V12, and an air click is performed on the reference coordinates and air click determination coordinates set for each virtual key V12. Then, it may be determined that the input of the virtual key V12 has been performed. In the case of this example, the size of the key image 12 displayed on the display 11 is changed according to the depth of the virtual key V12 arranged in the virtual three-dimensional panel, and the size of the virtual key V12 is changed. The depth may be guessed by the person to be authenticated. That is, for example, when the virtual key V12 is arranged at a location close to the depth direction, the corresponding key image 12 on the display 11 is displayed in a large size. Conversely, when the virtual key V12 is arranged at a location far away, the corresponding key image is displayed. It is considered that, if 12 is displayed small, the person to be authenticated can easily estimate the location of the virtual key V12 in the depth direction based on the size of the key image 12 on the display 11.

  In the present embodiment, as an example of the predetermined operation for instructing a desired position on the virtual touch panel 40, an operation of pushing (or pushing or pushing) the desired position with the tip of the fingertip 31 or the like is described as an example. For example, an operation of flicking (flick operation) or an operation of touching (touch operation) with the fingertip 31 may be used.

  In addition, the present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or an apparatus via a network or various recording media, and a computer (or CPU, MPU, or the like) of the system or the apparatus reads out the program and This is the process to be performed. The program and a computer-readable recording medium storing the program are included in the present invention.

  It should be noted that the above-described embodiments of the present invention are merely examples of specific embodiments for carrying out the present invention, and the technical scope of the present invention should not be interpreted in a limited manner. It is. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features.

  1: Authentication processing device, 10: Information processing device, 11: Display, 12: Key image, 13: Instruction mark, 20: Distance sensor, 20F: Sensor surface, 30: Hand, 31: Fingertip, 40: Virtual touch panel, 50 : Optical imaging plate, 51: reflector, V12: virtual key, 101: distance sensor output receiving unit, 102, 202: distance sensor output analyzing unit, 103, 203: input information determining unit, 104: unlock control unit, 105, 205, 250: control unit, 106: user confirmation unit, 107, 207: memory unit, 111, 211: coordinate calculation unit, 112, 212: object recognition unit, 113: tip coordinate information acquisition unit, 114, 215: Z coordinate determination unit, 131: user information, 132: PIN code, 133: finger identification information, 121: display control unit, 122: key arrangement control unit, 131: user The information 213: finger identification information acquisition unit, 214: finger coordinate information obtaining unit, 255: Y-coordinate determining section

Claims (15)

Coordinate detection means for detecting the three-dimensional coordinates of the detection target in the three-dimensional space at predetermined time periods,
Image display means for displaying a plurality of selection target images corresponding to a plurality of code information used for the authentication code on a screen,
A virtual plane setting unit that sets a virtual two-dimensional plane in the three-dimensional space, and associates display coordinates of the plurality of selection target images in the screen with virtual coordinates in the virtual two-dimensional plane.
By analyzing the three-dimensional coordinates of the detection target, a plurality of parts constituting the detection target are identified, and the coordinates of the identified parts correspond to the virtual coordinates in the virtual two-dimensional plane. Analyzing means for determining that the selection target image is selected by the identified part when detecting a predetermined movement by the identified part in the three-dimensional space in a state where
And code information corresponding to the selection target image determined to have been selected by the analyzing means, based on the code information of the authentication code has been registered in advance, have a authentication decision means for performing authentication determination,
The plurality of code information used for the authentication code are numbers from 0 to 9,
The image display means arranges and displays images of numbers from 0 to 9 as the plurality of selection target images in the screen,
The analysis means, when the detection target is the hand of the person to be authenticated, individually identifies each finger part, each time a predetermined movement by one finger part of the finger parts is detected, Obtain a candidate array consisting of each number of the selection target image corresponding to each finger part of all the hands and each identification information of each finger part respectively corresponding to each number,
The authentication determination means, each number arranged in order and each identification information of the finger part corresponding to each number, the number and identification information of each sequence in the authentication code registered in advance, An authentication processing apparatus , wherein an authentication determination of the person to be authenticated is performed by determining a match between a number in the candidate sequence and identification information in each order in which a predetermined motion is detected . Coordinate detection means for detecting the three-dimensional coordinates of the detection target in the three-dimensional space at predetermined time periods,
Image display means for displaying a plurality of selection target images corresponding to a plurality of code information used for the authentication code on a screen,
A virtual plane setting unit that sets a virtual two-dimensional plane in the three-dimensional space, and associates display coordinates of the plurality of selection target images in the screen with virtual coordinates in the virtual two-dimensional plane.
By analyzing the three-dimensional coordinates of the detection target, a plurality of parts constituting the detection target are identified, and the coordinates of the identified parts correspond to the virtual coordinates in the virtual two-dimensional plane. Analyzing means for determining that the selection target image is selected by the identified part when detecting a predetermined movement by the identified part in the three-dimensional space in a state where
An authentication determination unit that performs an authentication determination based on code information corresponding to a selection target image determined to be selected by the analysis unit and code information of an authentication code registered in advance;
Has,
The plurality of code information used for the authentication code includes at least a number from 0 to 9 and a predetermined symbol,
The image display means arranges images of numbers 0 to 9 as the plurality of selection target images in the screen and displays an area excluding the number images as a selection target image corresponding to the predetermined symbol. ,
The analysis means, when the detection target is the hand of the person to be authenticated, individually identifies each finger part, each time a predetermined movement by one finger part of the finger parts is detected, Obtain a candidate array consisting of each number or symbol of the selection target image corresponding to each finger portion of all of the hands and each identification information of each finger portion corresponding to each of the numbers or symbols,
The authentication judging means includes a number and an identification number for each sequence in the authentication code in which each number or symbol arranged in order and each identification information of a finger portion corresponding to each number or symbol are registered. An authentication processing device, wherein an authentication determination of the person to be authenticated is performed by determining whether information matches a number or a symbol in the candidate sequence and identification information in each order in which the predetermined movement is detected. Coordinate detection means for detecting the three-dimensional coordinates of the detection target in the three-dimensional space at predetermined time periods,
Image display means for displaying a plurality of selection target images corresponding to a plurality of code information used for the authentication code on a screen,
A virtual plane setting unit that sets a virtual two-dimensional plane in the three-dimensional space, and associates display coordinates of the plurality of selection target images in the screen with virtual coordinates in the virtual two-dimensional plane.
By analyzing the three-dimensional coordinates of the detection target, a plurality of parts constituting the detection target are identified, and the coordinates of the identified parts correspond to the virtual coordinates in the virtual two-dimensional plane. Analyzing means for determining that the selection target image is selected by the identified part when detecting a predetermined movement by the identified part in the three-dimensional space in a state where
An authentication determination unit that performs an authentication determination based on code information corresponding to a selection target image determined to be selected by the analysis unit and code information of an authentication code registered in advance;
Has,
The virtual two-dimensional plane represented by any two coordinate axes of the X, Y, and Z axes in the three-dimensional space represented by the X, Y, and Z axes. Is set,
The analysis unit measures a time at which the identified part is stationary in the three-dimensional space, and when detecting that the part is stationary for a predetermined time, the virtual two-dimensional in the three-dimensional space. A predetermined determination coordinate is set at a coordinate value that is a predetermined distance away from the tip of the part in the direction of the coordinate axis orthogonal to the plane, and the tip of the part moves in the three-dimensional space so that the tip of the part is the determination coordinate. The authentication processing device detects the predetermined movement when the number of times reaches a predetermined value. Coordinate detection means for detecting the three-dimensional coordinates of the detection target in the three-dimensional space at predetermined time periods,
Image display means for displaying a plurality of selection target images corresponding to a plurality of code information used for the authentication code on a screen,
A virtual plane setting unit that sets a virtual two-dimensional plane in the three-dimensional space, and associates display coordinates of the plurality of selection target images in the screen with virtual coordinates in the virtual two-dimensional plane.
By analyzing the three-dimensional coordinates of the detection target, a plurality of parts constituting the detection target are identified, and the coordinates of the identified parts correspond to the virtual coordinates in the virtual two-dimensional plane. Analyzing means for determining that the selection target image is selected by the identified part when detecting a predetermined movement by the identified part in the three-dimensional space in a state where
An authentication determination unit that performs an authentication determination based on code information corresponding to a selection target image determined to be selected by the analysis unit and code information of an authentication code registered in advance;
Has,
The virtual two-dimensional plane represented by any two coordinate axes of the X, Y, and Z axes in the three-dimensional space represented by the X, Y, and Z axes. Is set,
The analysis unit sets the coordinates of the coordinate axes orthogonal to the virtual two-dimensional plane in the three-dimensional space to the coordinates in the virtual two-dimensional plane as reference coordinates and sets the positive side and the negative side with respect to the reference coordinates. The authentication processing device, wherein the predetermined movement is detected when the tip of the identified portion moves from the positive side to the reference coordinate and moves beyond the reference coordinate to the negative side with respect to the reference coordinate. Coordinate detection means for detecting the three-dimensional coordinates of the detection target in the three-dimensional space at predetermined time periods,
Image display means for displaying a plurality of selection target images corresponding to a plurality of code information used for the authentication code on a screen,
A virtual plane setting unit that sets a virtual two-dimensional plane in the three-dimensional space, and associates display coordinates of the plurality of selection target images in the screen with virtual coordinates in the virtual two-dimensional plane.
By analyzing the three-dimensional coordinates of the detection target, a plurality of parts constituting the detection target are identified, and the coordinates of the identified parts correspond to the virtual coordinates in the virtual two-dimensional plane. Analyzing means for determining that the selection target image is selected by the identified part when detecting a predetermined movement by the identified part in the three-dimensional space in a state where
An authentication determination unit that performs an authentication determination based on code information corresponding to a selection target image determined to be selected by the analysis unit and code information of an authentication code registered in advance;
Has,
The analysis means measures the time at which each of the identified parts has stopped in the three-dimensional space, and after detecting that each of the parts has stopped for a predetermined time, the An authentication processing apparatus characterized in that a part where the amount of movement when the tip of the head moves is the largest is a part where the predetermined movement is detected. The plurality of code information used for the authentication code are numbers from 0 to 9,
The image display means randomly displays images of numbers from 0 to 9 as the plurality of selection target images in the screen, and displays the images.
When the detection target is the hand of the person to be authenticated, the analysis unit individually identifies each finger part and acquires identification information of each finger part, and sequentially selects the finger parts according to the individually identified finger parts. Obtain an array of numbers corresponding to the plurality of selected images,
The authentication determination unit includes an array of a plurality of numbers corresponding to a plurality of selection target images sequentially selected by the finger parts individually identified by the analysis unit, and identification information of the finger part that sequentially selects the selection target image. The authentication determination of the person to be authenticated is performed by determining whether the sequence of the numbers of the authentication codes registered in advance matches the identification information of the finger part registered in advance corresponding to each number of the authentication codes. The authentication processing device according to any one of claims 3 to 5, wherein: The plurality of code information used for the authentication code are numbers from 0 to 9,
The image display means randomly displays images of numbers from 0 to 9 as the plurality of selection target images in the screen, and displays the images.
The analysis means, when the detection target is the hand of the person to be authenticated, obtains an array of numbers corresponding to the plurality of selection target images sequentially selected by one finger site,
The authentication determination unit is configured to determine whether or not the authentication target person is a match by determining whether an array of a plurality of numbers corresponding to the plurality of selection target images acquired by the analysis unit matches an array of numbers of an authentication code registered in advance. The authentication processing device according to claim 3 , wherein an authentication determination is performed. The plurality of code information used for the authentication code are numbers from 0 to 9,
The image display means randomly displays images of numbers from 0 to 9 as the plurality of selection target images in the screen, and displays the images.
The analysis means individually identifies at least one finger part corresponding to a security level set in advance for an authentication process when the detection target is the hand of the person to be authenticated. Along with acquiring the identification information, an array of numbers corresponding to the plurality of selection target images sequentially selected by the individually identified finger parts is acquired,
The authentication determination unit includes an array of a plurality of numbers corresponding to a plurality of selection target images sequentially selected by the finger parts individually identified by the analysis unit, and identification information of the finger part that sequentially selects the selection target image. And an array of numbers of the authentication code registered in advance and the identification information of the finger part registered in advance for each security level corresponding to each number of the authentication code, and The authentication processing device according to claim 3 , wherein an authentication determination is performed. The image display means, based on the three-dimensional coordinates of the detection object, according to claim 1 to 8, wherein the displaying the screen predetermined mark corresponding to the detected object on the image display means The authentication processing device according to claim 1. A reflection plate for reflecting a display image of the screen or an optical imaging plate for forming a display image of the screen as a virtual stereoscopic image in the air is disposed on a screen of the image display means. Item 10. The authentication processing device according to any one of Items 1 to 9 . 2. The coordinate detection unit according to claim 1, wherein the three-dimensional coordinates are calculated based on an imaging signal that emits infrared light and captures infrared light reflected by the detection target. 3. The authentication processing device according to any one of 0 . An authentication processing method executed by the authentication processing device,
A coordinate detection step of detecting the three-dimensional coordinates of the detection target in the three-dimensional space every predetermined time period,
An image display step of displaying a plurality of selection target images respectively corresponding to a plurality of code information used for the authentication code on a screen,
A virtual plane setting step of setting a virtual two-dimensional plane in the three-dimensional space, and causing display coordinates of the plurality of selection target images in the screen to correspond to virtual coordinates in the virtual two-dimensional plane,
By analyzing the three-dimensional coordinates of the detection target, a plurality of parts constituting the detection target are identified, and the coordinates of the identified parts correspond to the virtual coordinates in the virtual two-dimensional plane. In the state, when detecting a predetermined movement by the identified part in the three-dimensional space, an analysis step of determining that the selection target image is selected by the identified part,
Code information corresponding to the selection target image determined to be selected in the analysis step, based on the code information of the authentication code registered in advance, having an authentication determination step to perform an authentication determination ,
The plurality of code information used for the authentication code are numbers from 0 to 9,
In the image display step, images of numbers from 0 to 9 are arranged and displayed in the screen as the plurality of selection target images,
In the analyzing step, when the detection target is the hand of the person to be authenticated, each finger part is individually identified, and each time a predetermined movement by one finger part of the finger parts is detected, Obtain a candidate array consisting of each number of the selection target image corresponding to each finger part of all the hands and each identification information of each finger part respectively corresponding to each number,
In the authentication determination step, each number arranged in order and each identification information of the finger portion corresponding to each number, the number and identification information of each sequence in the authentication code registered in advance, and An authentication processing method , wherein an authentication determination of the person to be authenticated is performed by determining a match between a number in the candidate sequence and identification information in each order in which a predetermined motion is detected . An authentication processing method executed by the authentication processing device,
A coordinate detection step of detecting the three-dimensional coordinates of the detection target in the three-dimensional space every predetermined time period,
An image display step of displaying a plurality of selection target images respectively corresponding to a plurality of code information used for the authentication code on a screen,
A virtual plane setting step of setting a virtual two-dimensional plane in the three-dimensional space, and causing display coordinates of the plurality of selection target images in the screen to correspond to virtual coordinates in the virtual two-dimensional plane,
By analyzing the three-dimensional coordinates of the detection target, a plurality of parts constituting the detection target are identified, and the coordinates of the identified parts correspond to the virtual coordinates in the virtual two-dimensional plane. In the state, when detecting a predetermined movement by the identified part in the three-dimensional space, an analysis step of determining that the selection target image is selected by the identified part,
An authentication determination step of performing an authentication determination based on code information corresponding to the selection target image determined to be selected in the analysis step and code information of an authentication code registered in advance;
Has,
The plurality of code information used for the authentication code includes at least a number from 0 to 9 and a predetermined symbol,
The image display step includes arranging an image of a number from 0 to 9 as the plurality of selection target images in the screen and displaying an area excluding the number image as a selection target image corresponding to the predetermined symbol. ,
In the analyzing step, when the detection target is the hand of the person to be authenticated, each finger part is individually identified, and each time a predetermined movement by one finger part of the finger parts is detected, Obtain a candidate array consisting of each number or symbol of the selection target image corresponding to each finger portion of all of the hands and each identification information of each finger portion corresponding to each of the numbers or symbols,
In the authentication determination step, in the authentication code in which each number or symbol arranged in order and each identification information of a finger portion corresponding to each number or symbol are registered, the number and identification of each sequence in the authentication code are registered. An authentication processing method, comprising: performing authentication determination of the person to be authenticated by determining whether information matches a number or a symbol in the candidate sequence and identification information in each order in which the predetermined motion is detected. An authentication processing method executed by the authentication processing device,
A coordinate detection step of detecting the three-dimensional coordinates of the detection target in the three-dimensional space every predetermined time period,
An image display step of displaying a plurality of selection target images respectively corresponding to a plurality of code information used for the authentication code on a screen,
A virtual plane setting step of setting a virtual two-dimensional plane in the three-dimensional space, and causing display coordinates of the plurality of selection target images in the screen to correspond to virtual coordinates in the virtual two-dimensional plane,
By analyzing the three-dimensional coordinates of the detection target, a plurality of parts constituting the detection target are identified, and the coordinates of the identified parts correspond to the virtual coordinates in the virtual two-dimensional plane. In the state, when detecting a predetermined movement by the identified part in the three-dimensional space, an analysis step of determining that the selection target image is selected by the identified part,
An authentication determination step of performing an authentication determination based on code information corresponding to the selection target image determined to be selected in the analysis step and code information of an authentication code registered in advance;
Has,
In the virtual plane setting step, the virtual two-dimensional plane represented by any two coordinate axes of the X, Y, and Z axes in the three-dimensional space represented by the X, Y, and Z axes And set
In the analyzing step, the time at which the identified part is stationary in the three-dimensional space is measured, and when it is detected that the part is stationary for a predetermined time, the virtual two-dimensional A predetermined determination coordinate is set at a coordinate value that is a predetermined distance away from the tip of the part in the direction of the coordinate axis orthogonal to the plane, and the tip of the part moves in the three-dimensional space so that the tip of the part is the determination coordinate. Detecting the predetermined movement when the number of times has reached the threshold value. An authentication processing method executed by the authentication processing device,
A coordinate detection step of detecting the three-dimensional coordinates of the detection target in the three-dimensional space every predetermined time period,
An image display step of displaying a plurality of selection target images respectively corresponding to a plurality of code information used for the authentication code on a screen,
A virtual plane setting step of setting a virtual two-dimensional plane in the three-dimensional space, and causing display coordinates of the plurality of selection target images in the screen to correspond to virtual coordinates in the virtual two-dimensional plane,
By analyzing the three-dimensional coordinates of the detection target, a plurality of parts constituting the detection target are identified, and the coordinates of the identified parts correspond to the virtual coordinates in the virtual two-dimensional plane. In the state, when detecting a predetermined movement by the identified part in the three-dimensional space, an analysis step of determining that the selection target image is selected by the identified part,
An authentication determination step of performing an authentication determination based on code information corresponding to the selection target image determined to be selected in the analysis step and code information of an authentication code registered in advance;
Has,
In the virtual plane setting step, the virtual two-dimensional plane represented by any two coordinate axes of the X, Y, and Z axes in the three-dimensional space represented by the X, Y, and Z axes And set
In the analyzing step, the coordinates of the coordinate axes orthogonal to the virtual two-dimensional plane in the three-dimensional space are set to the coordinates in the virtual two-dimensional plane, and the positive side and the negative side are set to the reference coordinates. The authentication processing method, wherein the predetermined movement is detected when the tip of the identified part moves from the positive side to the reference coordinate beyond the reference coordinate to the negative side with respect to the reference coordinate.

Images