JP2017217094A - Attribution guarantee system, electronic pen, attribution guarantee device, and attribution guarantee method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To accurately determine that a person to be authenticated and a writer are the same person.SOLUTION: An attribution guarantee system 1 includes an authentication device 200, an electronic pen 300, and an attribution guarantee device 400 that transmit/receive information through a communication network. The authentication device 200 includes an authentication information extraction part 230 for extracting authentication information for authenticating a person to be authenticated from the person to be authenticated, an authentication processing part 240 for identifying the person to be authenticated by the authentication information, and a first biological information acquisition part 260 for acquiring biological information on the person to be authenticated as first biological information from the person to be authenticated. The electronic pen 300 includes a second biological information acquisition part 340 for acquiring biological information on the writer as second biological information. The attribution guarantee device 400 includes a collation part 450 for collating whether or not the writer is the person to be authenticated identified by the authentication processing part 240 on the basis of the first biological information and the second biological information.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an attribution guarantee system, an electronic pen, an attribution guarantee device, and an attribution guarantee method.

  In recent years, with the advancement of IT technology, various types of data have been digitized. So far, paperlessness has been promoted, and many documents have been digitized. However, especially for important documents such as contracts, it is rare that all processing is completed while being digitized. For example, in many cases, after printing on paper or the like and outputting it, only the signature section is additionally written by hand, and then captured by a scanner and digitized again. As described above, the signature part that is most important for concluding a contract has been used by handwriting to show that there was an indication of intention since ancient times because the handwriting includes personal characteristics. Actually, there is a handwriting appraisal that compares a plurality of handwriting and identifies whether or not the person who wrote it is the same person. For example, Non-Patent Document 1 describes a method in which each character written in advance is registered as a reference for authenticating the person, and then compared with the writing information obtained after writing.

  Further, in order to save the document signed by handwriting as electronic data in this way, an operation of taking the signed document with a scanner occurs. In order to reduce the load required for such work, signatures using an electronic pen are gradually spreading. Recently, there are an increasing number of stores that use an electronic pen and a pen tablet to sign a purchaser when using a credit card. Also in Computer Based Testing (CBT), a method for allowing a test taker to enter an answer using an electronic pen is being introduced. Furthermore, methods using an electronic pen are being studied in electronic voting, electronic commerce, electronic administration, electronic wills, and the like. Therefore, by using an electronic pen, research for confirming whether or not a signature is performed by the purchaser himself is performed using not only handwriting but also information obtained in a writing process. For example, Non-Patent Document 2 describes a method of mounting an acceleration / angular velocity sensor or the like on an electronic pen and determining the identity between the person represented by the signature and the person who wrote the signature from the obtained acceleration / angular velocity information. Has been.

  Further, Patent Document 1 describes a method of estimating a concentration state of a person based on biological information by mounting a temperature sensor, a pressure sensor, a skin potential sensor, an acceleration sensor, a pulse wave sensor, etc. on a writing instrument. .

JP 2014-158600 A

Haruki Kanamori, 3 others, "Examination of testee authentication method using character shape and public road characteristics at the time of writing", The Institute of Electrical Communication Toru Miyakawa, 3 others, "A method for reproducing character patterns using acceleration information of writing instruments" IEICE Transactions D-II Vol.J83-DII No.2, pp.671-679, February 2000

  However, in the method described in Non-Patent Document 1, spoofing is performed by writing in a manner similar to the characteristics of the target person from handwriting obtained in advance, or even though the person himself has written, registered writing due to intra-individual variation. In some cases, it may be determined that the person is not the person due to a difference from the information.

  In the method described in Non-Patent Document 2, since learning is performed only with a limited character string called a signature, it is difficult to determine the same personality by extending to an arbitrary character string or drawing. In addition, it is very difficult to determine the same personality because there is intra-individual variation similar to handwriting appraisal.

  Furthermore, in the method described in Patent Document 1, it is possible to refer to the concentration state of a person who is writing characters using an electronic pen. However, since the concentration state changes day by day, determination of the same personality Difficult to apply to.

  Therefore, an object of the present invention made in view of such a point is to make it possible to accurately determine that the person to be authenticated and the writer are the same.

  In order to solve the above problems, an attribute guarantee system according to the present invention is an attribute guarantee system including an authentication device, an electronic pen, and an attribute guarantee device that transmit and receive information to and from each other via a communication network. The authentication device includes an authentication information extraction unit that extracts authentication information for authenticating the user to be authenticated, an authentication processing unit that identifies the user to be authenticated by the authentication information, and the user to be authenticated. A first biometric information acquisition unit that acquires biometric information of the person to be authenticated as first biometric information, and the electronic pen acquires biometric information of the writer as second biometric information. Whether the attribute assurance device includes a biometric information acquisition unit, and the writer is identified by the authentication processing unit based on the first biometric information and the second biometric information. Check whether or not Characterized in that it comprises an engagement portion.

  The electronic pen according to the present invention includes an authentication information extraction unit that extracts authentication information for authenticating the user to be authenticated, an authentication processing unit that identifies the user to be authenticated by the authentication information, A biometric information acquisition unit that continuously acquires the biometric information of the writer during writing, and determines whether the biometric information is continuously acquired, and continues to acquire the biometric information. A collation unit that determines that the writer is the person to be authenticated.

  An attribute assurance device according to the present invention is an attribute assurance device that transmits and receives information to and from an authentication device and an electronic pen via a communication network. The writing unit based on the first biological information and the second biological information, and the communication unit that receives the second biological information that is the writer's biological information from the electronic pen. A verification unit that verifies whether or not the person is an authenticated person identified by the authentication device.

  An attribute guarantee method according to the present invention is an attribute guarantee method executed by an attribute guarantee device that transmits and receives information to and from an authentication device and an electronic pen via a communication network and includes a communication unit and a verification unit. The communication unit receives first biometric information that is biometric information of the person to be authenticated from the authentication device, and receives second biometric information that is biometric information of the writer from the electronic pen; And a step of collating whether or not the writer is a person to be authenticated identified by the authentication device based on the first biometric information and the second biometric information. It is characterized by.

  According to the present invention, it is possible to accurately determine that the person to be authenticated and the writer are the same.

It is a whole conceptual diagram of the belonging guarantee system concerning a 1st embodiment. It is a functional block diagram of the attribute guarantee system shown in FIG. It is a block diagram for demonstrating the electronic pen shown in FIG. It is a figure which shows the state which is writing by the third party who is not a writer who has the electronic pen shown in FIG. 3 moving a writer's hand. FIG. 5A is a diagram illustrating an example of characters written by the electronic pen illustrated in FIG. 3, FIG. 5A is a diagram illustrating an example of characters written by single writing, and FIG. It is a figure showing the example of the character written by the person writing. It is a sequence diagram which shows operation | movement of the attribute guarantee system which concerns on this embodiment. It is a whole conceptual diagram which shows the modification of an attribution guarantee system. It is a whole conceptual diagram of the attribution guarantee system which concerns on 2nd Embodiment. It is an enlarged view of the electronic pen shown in FIG.

<First Embodiment>
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.

<Functional configuration of attribution guarantee system>
First, the overall configuration of the first embodiment will be described with reference to FIG.

  As shown in FIG. 1, the attribution guarantee system 1 includes an authentication device 200, an electronic pen 300, and an attribution guarantee device 400. The electronic pen 300, the authentication device 200, and the attribution guarantee device 400 are connected via a communication network, and transmit / receive information to / from each other.

<Functional configuration of authentication device>
As illustrated in FIG. 2, the authentication device 200 includes a communication unit 210, an imaging unit 220, an authentication information extraction unit 230, an authentication processing unit 240, an authentication information storage unit 250, and a first biological information acquisition unit 260.

  The communication unit 210 transmits various types of information to the attribution guarantee device 400 via a communication network.

  The imaging unit 220 images the face of the person to be authenticated and generates a moving image in which the face is reflected. The imaging unit 220 is preferably realized by a camera such as a web camera arranged within the broken line in FIG.

  The authentication information extraction unit 230 extracts authentication information for authenticating the person to be authenticated from the person to be authenticated. The authentication information is an image obtained by capturing the face of the person to be authenticated in the present embodiment. The authentication processing unit 240 performs face detection using an image at each time constituting the moving image as an input. As a result, when only one face is detected, it is assumed that the authentication processing unit 240 has successfully detected the face. Further, when face detection cannot be performed from an image or when a plurality of faces are detected, face detection fails and face detection is performed again after a predetermined time has elapsed.

  Further, when the authentication information extraction unit 230 extracts the authentication information from the person to be authenticated, the authentication information extraction unit 230 outputs the extracted authentication information to the authentication processing unit 240. In the example of this embodiment, when only one face is detected by face detection, an image representing the face is output to the authentication processing unit 240 as authentication information.

  The authentication processing unit 240 performs an authentication process for identifying the person to be authenticated based on the authentication information extracted by the authentication information extraction unit 230 of the authentication device 200. Specifically, the authentication processing unit 240 compares the authentication information extracted by the authentication information extraction unit 230 with the authentication information stored in advance in the authentication information storage unit 250, and the extracted authentication information is stored. It is determined whether it matches any of the authentication information. Here, “matching” means, for example, that a feature point included in the authentication information extracted by the authentication information extraction unit 230 is a feature point included in the authentication information stored in the authentication information storage unit 250. This means that the matching ratio is a predetermined value or more. In the present embodiment, when the face detection by the authentication information extraction unit 230 is successful, the authentication processing unit 240 stores in advance in the authentication information storage unit 250 a face area in which one face is represented in the image. The person to be authenticated is identified using the template data.

  If the extracted authentication information matches any of the stored authentication information, the authentication processing unit 240 determines that the authentication result is “success”. If the extracted authentication information does not match any of the stored authentication information, the authentication processing unit 240 determines that the authentication result is “failure”.

  Furthermore, when the authentication result is “successful”, the authentication processing unit 240 stores a user ID for uniquely identifying the person to be authenticated, stored in association with the authentication information stored in the authentication information storage unit 250. (Identification) and the authentication result are transmitted to the attribute guarantee device 400 via the communication unit 210. In addition to the user ID, the authentication processing unit 240 may transmit attribute information stored in the authentication information storage unit 250 in association with the user ID to the attribution guarantee device 400. In addition, when the authentication result is “failure”, the authentication processing unit 240 transmits only the authentication result to the attribution guarantee device 400.

  The authentication information storage unit 250 stores in advance authentication information of a person who uses the system as template data in association with a user ID for uniquely identifying the person. The authentication information storage unit 250 may store attribute information such as the user's name in association with the user ID and the authentication information.

  The 1st biometric information acquisition part 260 acquires the biometric information resulting from a to-be-authenticated person's body as 1st biometric information. The first biological information is a characteristic that changes with time, and includes, for example, a pulse wave, a pulse, blood oxygen concentration, body temperature, bone conduction sound, body weight, heart sound, airway sound, and the like. In the present embodiment, the first biological information is assumed to be a pulse wave, and the first biological information acquisition unit 260 will be described as the first pulse wave acquisition unit 260 as an example.

  Specifically, the first pulse wave acquisition unit 260 calculates the face pulse wave based on the time-series data of the pixel values of the face area where the face of the person to be authenticated is captured in the image captured by the image capturing unit 220. Acquired as 1 pulse wave.

  The first pulse wave acquisition unit 260 performs a pulse wave extraction process using the face area in which the face of the image extracted by the authentication information extraction unit 230 is represented. Specifically, the authentication processing unit 240 calculates a representative value representing the degree of blood vessel enlargement / reduction at each time from the color information of the exposed portion of the facial skin related to face authentication. Information represented in the series is defined as a first pulse wave. The representative value is, for example, a statistical value (for example, an average value, a median value, a mode value, etc.) of pixel values (for example, luminance values) for each of a plurality of skin color portions shown in the face area. In addition, the first pulse wave acquisition unit 260 divides the face into several regions, calculates representative values for each region, and generates partial pulse waves as time series data from the heart of each divided region. Alternatively, the first pulse wave may be calculated by averaging in consideration of the phase difference estimated from the blood vessel path length.

  In addition, the first pulse wave acquisition unit 260 is configured not to acquire pulse waves simultaneously from a person different from the person to be authenticated that is authenticated by the authentication information extraction unit 230. For example, the hardware that implements the authentication information extraction unit 230 and the hardware that implements the first biometric information acquisition unit 260 are the same Web camera, and based on authentication information extracted from the same image captured by the Web camera. Thus, the first pulse wave is detected.

  Moreover, the 1st pulse wave acquisition part 260 transmits the acquired 1st pulse wave to the attribution guarantee apparatus 400 via the communication part 210, whenever it acquires the 1st pulse wave continuously.

<Functional configuration of electronic pen>
The electronic pen 300 is an input device for inputting information to a computer by a writer who writes in his / her hand like a writing instrument, that is, by moving the tip while pressing against a pressed medium such as paper or a tablet. . Specifically, the electronic pen 300 detects weak radio waves emitted from the tip with the tablet sensor of the main body and acquires the position of the pen coordinates as writing data, and the two places of ultrasonic waves emitted from the tip are tablets. Ultrasonic method for sensing pen coordinates as writing data by triangulation, and Anoto pattern method for reading the paper-shaped anoto pattern by a CCD camera provided at the tip and obtaining the position of the pen coordinates as writing data It may be. In addition, the electronic pen 300 may use any method other than these methods.

  As shown in FIG. 2, the electronic pen 300 includes a communication unit 310, a writing data acquisition unit 320, an acceleration / angular velocity sensor 330, and a second biological information acquisition unit 340.

  As shown in FIG. 3, the writing data acquisition unit 320 is provided at the tip of the electronic pen 300, and the second biological information acquisition unit 340 is provided as a pulse wave sensor at a portion touched by the writer's hand. In the example illustrated in FIG. 3, the communication unit 310 is provided at the end opposite to the tip of the electronic pen 300, but may be provided at an arbitrary portion. Further, the acceleration / angular velocity sensor 330 is built in the electronic pen 300.

  The communication unit 310 transmits various types of information to the attribution guarantee device 400 via the communication network.

  In addition, when the electronic pen 300 is instructed to start an operation, the communication unit 310 transmits a pulse wave extraction request to the attribution guarantee device 400. The pulse wave extraction request is information for requesting the second pulse wave extraction unit 440 of the belonging guarantee device 400 to extract the second pulse wave.

  The writing data acquisition unit 320 performs writing using the electronic pen 300 by the writer according to the above method, that is, when the tip of the electronic pen 300 moves on a pressed medium on paper or a tablet, the tip moves. The acquired trajectory is acquired as written trajectory data.

  The acceleration / angular velocity sensor 330 measures acceleration and angular velocity when a predetermined portion of the electronic pen 300 moves in a state where the tip of the electronic pen 300 is pressed against the pressed medium, and the measured acceleration and angular velocity are respectively measured. Output acceleration data and angular velocity data. In the following description, data including one or more of acceleration data and angular velocity data is referred to as movement data. Data including any one or more of the writing trajectory data and the movement data is referred to as writing data.

  The second biological information acquisition unit 340 continuously acquires second biological information that is biological information originating from the writer's body. The second biological information is a characteristic that changes with time, and includes, for example, a pulse wave, a pulse, blood oxygen concentration, body temperature, bone conduction sound, body weight, heart sound, airway sound, and the like. In the present embodiment, the second biological information is a pulse wave that is the same type of information as the first biological information, and the second biological information acquisition unit 340 is an example of the second pulse wave acquisition. This will be described as the unit 340.

  Specifically, the second pulse wave acquisition unit 340 acquires the writer's pulse wave as the second pulse wave by a photoelectric method, an electrical impedance method, or the like. When the second pulse wave acquisition unit 340 is a photoelectric type, based on the volume change of the blood volume calculated from the change in the amount of light that has undergone reflection or transmission, using the light absorption characteristics of blood in the visible light or infrared light region. To obtain a second pulse wave. Moreover, when the 2nd pulse-wave acquisition part 340 is an electrical impedance type | formula, a 2nd pulse wave is acquired based on the voltage and electric current at the time of flowing weak electricity to a biological body.

  Further, every time the second pulse wave acquisition unit 340 continuously acquires the second pulse wave, the acquired second pulse wave is transmitted to the second pulse wave of the belonging guarantee device 400 via the communication unit 310. It transmits to the wave extraction part 440.

  Further, the pulse wave sensor that realizes the second pulse wave acquisition unit 340 is configured to prevent a pulse wave from being acquired from a person different from the writer who holds the electronic pen 300 in hand. For example, the pulse wave sensor is not manually touched by the writer during writing so that a person different from the writer cannot touch the pulse wave sensor while the electronic writer 300 is writing. Be sure to provide it on the covered part.

<Functional configuration of attribution guarantee device>
The attribute guarantee device 400 includes a communication unit 410, a first biological information extraction unit 420, a writing data processing unit 430, a second biological information extraction unit 440, and a verification unit 450. The attribute guarantee device 400 is realized by, for example, a personal computer (PC), a tablet terminal, or the like.

  The communication unit 410 receives the authentication information, the first pulse wave, the pulse wave extraction request, and the like transmitted by the communication unit 210 of the authentication device 200 via the communication network. In addition, the communication unit 410 receives handwritten data, a second pulse wave, a pulse wave extraction request, and the like transmitted by the communication unit 310 of the electronic pen 300 via a communication network.

  When receiving the biometric information extraction request, the first biometric information extraction unit 420 extracts the first biometric information from the first biometric information acquisition unit 260 of the authentication device 200. In the present embodiment, the biological information is assumed to be a pulse wave as described above, and the first biological information extraction unit 420 will be described as the first pulse wave acquisition unit 420. When receiving the pulse wave extraction request, the first pulse wave extraction unit 420 extracts the first pulse wave from the first pulse wave acquisition unit 260 of the authentication device 200. Specifically, the first pulse wave extraction unit 420 transmits an instruction to acquire the first pulse wave to the first pulse wave acquisition unit 260, and then the first pulse wave acquisition unit 260 receives the first pulse wave acquisition unit 260. 2 pulse waves are received. In addition, first pulse wave extraction unit 420 outputs the received first pulse wave to collation unit 450.

  The writing data processing unit 430 determines whether or not the session has been continued based on the session continuity information output from the matching unit 450. When the session is continued, the writing data processing unit 430 includes writing data including one or more of the writing trajectory data acquired by the writing data acquiring unit 320 and the movement data output by the acceleration / angular velocity sensor 330. Is associated with the session ID.

  In addition, the writing data processing unit 430 performs a single writing determination based on the writing data associated with the session ID. Single writing judgment is a single writing that the writer wrote only with his / her hand or, as shown in FIG. 4, a third party who is not a writer writes by moving the writer's hand. It is to determine whether it is a third-party writing.

  Specifically, the writing data processing unit 430 has a smooth change in inclination and acceleration of the electronic pen 300 represented by the movement data included in the writing data, that is, the change in inclination and acceleration is smaller than a predetermined value. In the case, it is determined that it is a single writing. In addition, the writing data processing unit 430 determines that the change in the tilt and acceleration of the electronic pen 300 represented by the movement data included in the writing data is not smooth, that is, if the change in the tilt and acceleration is greater than a predetermined value, Judged to be written by a person.

  In addition, the writing data processing unit 430 performs a single writing determination by analyzing a character portion of writing such as stop, splash, and payment of characters represented by writing trajectory data included in the writing data. For example, the end portion of the portion surrounded by the broken line of the character “A” shown in FIG. 5A is “stop”. In this case, the writing data processing unit 430 performs writing related to the writing trajectory data. Judged as a single writing. Further, the end portion of the portion surrounded by the broken line of the character “A” shown in FIG. 5B is “Splash”, and in this case, the writing data processing unit 430 writes the writing related to the writing trajectory data. Is a third-party writing.

  Thus, when the single writing determination is performed, the writing data processing unit 430 associates the result of the single writing determination with the writing data as meta information. The writing data processing unit 430 may invalidate the writing data (assuming that the writing person and the authenticated person are not the same) when it is determined that the writing related to the writing data is a third-party writing by the single writing determination. it can. However, even if it is determined to be a third-party writing, the writing is based on the writer's own intention, and there is a situation in which the writer needs some assistance in performing the writing act. Therefore, in order to enable the administrator of this system that refers to the meta information to determine that the writing is valid in view of the situation, the meta data is associated with the writing data instead of invalidating the writing data. It is preferable.

  When receiving the biometric information extraction request, the second biometric information extraction unit 440 extracts the second biometric information from the second biometric information acquisition unit 340 of the electronic pen 300. In the present embodiment, the biological information is assumed to be a pulse wave as described above, and the second biological information extraction unit 440 will be described as the second pulse wave acquisition unit 440. When receiving the pulse wave extraction request, the second pulse wave extraction unit 440 extracts the second pulse wave from the second pulse wave acquisition unit 340 of the electronic pen 300. Specifically, the second pulse wave extraction unit 440 transmits an instruction to acquire the second pulse wave to the second pulse wave acquisition unit 340, and then the second pulse wave acquisition unit 340 receives the second pulse wave acquisition unit 340. 2 pulse waves are received. In addition, second pulse wave extraction unit 440 outputs the received second pulse wave to collation unit 450.

  In addition, when the pulse wave extraction request is transmitted from the communication unit 310 of the electronic pen 300, the second pulse wave extraction unit 440 generates a session ID. As described above, the second pulse wave extraction unit 440 continuously extracts the second pulse wave from the electronic pen 300 and continues to output it to the collation unit 450.

  Thus, the extraction of the second pulse wave is called a session, and the session is interrupted when the second pulse wave is not extracted. The collation unit 450 determines that the writer keeps holding the electronic pen 300 in the hand when the session is continued, and determines that the electronic pen 300 is separated from the writer's hand when the session is interrupted. To do. The session ID is an identifier for uniquely identifying the state from when the session is started until it is interrupted. For example, the second pulse wave extraction unit 440 generates the session ID of the state in which the writer has the electronic pen 300 in his hand as “001” for the first time, and the electronic pen 300 moves away from his / her hand. , The session ID is generated as “002”.

  In addition, when the session ID is output from matching unit 450, second pulse wave extraction unit 440 ends the extraction of the second pulse wave. Specifically, the second pulse wave extraction unit 440 transmits an instruction to stop the acquisition of the second pulse wave to the second pulse wave acquisition unit 340 of the electronic pen 300, and the second pulse wave acquisition unit 440 End reception.

  When the second pulse wave is output from the second pulse wave extraction unit 440 and the first pulse wave is output from the first pulse wave extraction unit 420, the collation unit 450 is written by the authentication processing unit. It is verified whether or not the person is identified.

  Specifically, the collation unit 450 determines whether or not the first pulse wave and the second pulse wave are temporal changes caused by the same heartbeat by comparing feature amounts such as the generation timing of each pulse wave. judge. For example, the collation unit 450 calculates the difference between the first pulse wave and the second pulse wave at each time within the time period from the first predetermined time to the second predetermined time, and the difference between them. If the sum of the first pulse wave and the second pulse wave coincides with each other within the predetermined range, it is determined that the person to be authenticated and the person to be imaged are the same. When the sum of the differences exceeds a predetermined range, the collation unit 450 determines that the first pulse wave and the second pulse wave do not match, and the person to be authenticated and the person to be imaged are not the same. judge. In addition, the method in which the collation unit 450 collates the first pulse wave and the second pulse wave is not limited to this, and an arbitrary method for determining whether or not the time change is caused by the same heartbeat. I just need it. In addition, more accurate determination can be made by determining whether or not the time changes are caused by the same heartbeat in consideration of the phase difference due to the difference between the detection portions of the two pulse waves.

  When the collation unit 450 determines by collation that the first pulse wave and the second pulse wave are temporal changes caused by the same heartbeat, that is, the collation result is “OK”, It is assumed that the person to be authenticated is the same person, and the collation result and the session ID are output to the first pulse wave extraction unit 420. Further, when the collation unit 450 determines by collation that the first pulse wave and the second pulse wave are not time changes caused by the same heartbeat, that is, the collation result is “NG”, the session is determined. The process is interrupted, and the authentication apparatus 200 is requested to perform authentication again.

  The collation unit 450 determines whether or not the session is continued. Specifically, collation unit 450 determines whether or not the second pulse wave is continuously received after receiving the session ID. When it is determined that reception of the second pulse wave is continued, the session is continued and it is determined that the writer is the person to be authenticated. Further, when receiving the second pulse wave is interrupted after receiving the session ID, the collating unit 450 determines that the session is interrupted at that time, and the subsequent writer is not an authenticated person.

  The collation unit 450 outputs the session ID and session continuity information indicating whether or not the session is continued to the writing data processing unit 430.

<Operation of attribution guarantee system>
Next, with reference to FIG. 6, an attribution guarantee method executed by the attribution guarantee system 1 according to the present embodiment will be described.

  First, the writer holds the electronic pen 300 and instructs the electronic pen 300 to start an operation (for example, the switch of the electronic pen 300 is turned on) (step S1). Further, the person to be authenticated stays within the imaging range of the imaging unit 220 of the authentication device 200 (step S1).

  When the writer instructs the electronic pen 300 to start the operation in step S <b> 1, the communication unit 310 transmits the pulse wave extraction request to the second pulse wave extraction unit 440 of the attribution guarantee device 400 via the communication unit 410. (Step S2).

  When the pulse wave extraction request is transmitted in step 2, the second pulse wave extraction unit 440 starts extracting the second pulse wave that is the writer's pulse wave (step S3). Thereafter, the second pulse wave extraction unit 440 continuously extracts the second pulse wave.

  When the second pulse wave is extracted in step S3, the second pulse wave extraction unit 440 outputs the extracted second pulse wave to the collation unit 450 (step S4). Thereafter, the second pulse wave extraction unit 440 continuously outputs the second pulse wave to the collation unit 450.

  Further, when the pulse wave extraction request is transmitted in step S2, the second pulse wave extraction unit 440 generates a session ID (step S5).

  When the session ID is generated in step S5, the second pulse wave extraction unit 440 transmits the generated session ID to the verification unit 450 (step S6).

  On the other hand, when the writer instructs the electronic pen 300 to start an operation in step S1, the authentication apparatus 200 extracts authentication information in order to authenticate the person to be authenticated (step S7) (step S8).

  When the authentication information is extracted in step S8, the authentication device 200 performs an authentication process based on the authentication information (step S9). Specifically, the authentication information extraction unit 230 detects a face area from an image obtained by imaging the person to be authenticated by the imaging unit 220. Then, the authentication processing unit 240 compares the face area with the user's face image stored in the authentication information storage unit 250 and determines whether there is a match.

  When it is determined that the authentication result is “success” in the authentication process in step S9, the communication unit 210 of the authentication device 200 transmits a pulse wave extraction request to the attribution guarantee device 400 via the communication unit 410 (step S10). ).

  When the pulse wave extraction request is transmitted in step S10, the first pulse wave extraction unit 420 starts extracting the first pulse wave that is the pulse wave of the person to be authenticated (step S11). Thereafter, the first pulse wave extraction unit 420 continues to extract the first pulse wave.

  When the first pulse wave extraction unit 420 extracts the first pulse wave in step S11, the first pulse wave extraction unit 420 outputs the extracted first pulse wave to the collation unit 450 (step S12).

  When the second pulse wave is output in step S4 and the first pulse wave is output in step S11, the matching unit 450 outputs the first pulse wave to the second pulse wave output in and after step S4. It collates with the wave (step S13).

  When the collation result is “OK” in step S13, the collation unit 450 outputs the session ID output from the second pulse wave extraction unit 440 in step S6 to the first pulse wave extraction unit 420 (step S6). S14). When the collation result is “NG”, the collation unit 450 interrupts the session and requests the authentication apparatus 200 to perform authentication again.

  When the session ID is output to the first pulse wave extraction unit 420 in step S14, the first pulse wave extraction unit 420 ends the extraction of the first pulse wave (step S15). Here, only the first pulse wave extraction by the first pulse wave extraction unit 420 ends, and the second pulse wave extraction unit 440 continues to extract the second pulse wave continuously.

  When the extraction of the first pulse wave is completed in step S15, the first pulse wave extraction unit 420 outputs the session ID received in step S14 to the writing data processing unit 430 (step S16).

  After the session ID is output to the writing data processing unit 430 in step S16, the writer writes with the electronic pen 300, that is, moves while pressing the tip of the electronic pen 300 against paper or a touch pad (step S17). ). When written by the writer in step S17, the writing data processing unit 430 receives the writing data acquired by the writing data acquisition unit 320 and the acceleration / angular velocity sensor 330 of the electronic pen 300 via the communication unit 410 ( Step S18).

  At this time, extraction and output of the second pulse wave started by the second pulse wave extraction unit 440 in step 3 are continuously performed. After receiving the session ID in step S6, collator 450 determines that the session is continuing when the second pulse wave has been received continuously (step S19). In addition, after receiving session ID by step S6, when the reception of the 2nd pulse wave is interrupted, the collation part 450 determines with the session interrupting at that time.

  If it is determined in step S19 that the session is continuing, the collation unit 450 writes the session ID relating to the continuing session and the session continuity information indicating that the session is continuing, to the handwritten data processing unit 430. (Step S20). Then, when the session continuity information and the session ID are output, the writing data processing unit 430 determines whether the session continuity information represents continuation of the session. When the session continuity information indicates continuation of the session, the writing data processing unit 430 associates the writing data received in step S18 with the session ID (step S21). Thereafter, the writing data processing unit 430 may store the associated writing data and the session ID in a storage device or display them on a display device.

  When the writing data is associated with the session ID in step S21, the writing data processing unit 430 performs a single writing determination based on the writing data associated with the session ID (step S22).

  As described above, in the attribution guarantee system 1 of the first embodiment, by collating the first pulse wave information acquired by the authentication device 200 and the second pulse wave information acquired by the electronic pen 300. It can be determined whether or not the person to be authenticated and the writer are the same. Therefore, it is possible to ensure that the written data belongs to the authenticated person.

  In the attribution guarantee system 1 of the first embodiment, the writer can determine whether or not the electronic pen 300 has continuously acquired from the second pulse wave information from the writer by using the electronic pen 300. It is possible to detect that 300 is released from the hand. Therefore, the impersonation by the other writer using the electronic pen 300 which the writer released from the hand can be prevented.

  Moreover, in the attribution guarantee system 1 of 1st Embodiment, the writer wrote only by own hand based on writing data, or the third party who is not a writer moves a writer's hand. By determining whether or not writing has been performed, it is possible to prevent writing by a writer who has been determined to be the same as the certifier, but not by his own intention, but by the will of another person. It becomes possible.

  Since it is determined whether the person to be authenticated and the writer are the same by checking the pulse wave, it is accurate not only for specific character strings such as signatures, but also for arbitrary character strings, drawing, etc. Judgment can be made. Unlike the case of guaranteeing that the written data relates to the writer by comparing the written data with the characteristics of the written data of each writer stored in advance, it is possible to accurately determine even if there is intra-individual variation. It can be carried out.

  In the first embodiment, the authentication device 200 is realized by a Web camera. Then, the authentication information extraction unit 230 extracts an image in which the face of the person to be authenticated is captured as authentication information, and the authentication processing unit 240 performs authentication processing based on the face area in which the face in the image is represented. This is not the case. For example, as shown in FIG. 7, the authentication device 200 of the attribution guarantee system 1 ′ may be realized by a vein authentication sensor. In this case, the authentication information extraction unit 230 extracts a vein pattern as authentication information of the person to be authenticated that is imaged by irradiation with visible light or infrared light. Then, the authentication processing unit 240 performs vein authentication by comparing the vein pattern with template data registered in advance. In this case, the first pulse wave acquisition unit 260 can acquire the first pulse wave by expressing the vein pattern in time series.

  In the first embodiment, the authentication apparatus 200 performs authentication processing or extracts the first pulse wave based on the face area of the person to be authenticated in the moving image, but this is not restrictive. For example, the authentication apparatus 200 may perform authentication processing based on the iris of the person to be authenticated in the moving image, or extract the first pulse wave.

<Second Embodiment>
Hereinafter, a second embodiment of the present invention will be described with reference to the drawings.

  As shown in FIG. 8, the attribution guarantee system 2 according to the second embodiment includes an electronic pen 600. Note that the same reference numerals are assigned to the same configuration blocks as those in the attribution guarantee system 1 in the second embodiment, and the description thereof will be omitted as appropriate.

  As illustrated in FIG. 9, the electronic pen 600 includes a communication unit 210, an imaging unit 220, an authentication information extraction unit 230, an authentication processing unit 240, and authentication information included in the authentication device 200 according to the first embodiment. A storage unit 250 is provided. In addition, the electronic pen 600 includes a writing data acquisition unit 320, an acceleration / angular velocity sensor 330, and a second biological information acquisition unit 340 (second pulse wave acquisition unit 340) included in the electronic pen 300 in the first embodiment ( In the present embodiment, it simply includes a “biological information acquisition unit 340 (pulse wave acquisition unit 340)”. Furthermore, the electronic pen 600 includes a writing data processing unit 430 and a collation unit 450 included in the attribution guarantee apparatus 400 according to the first embodiment. That is, the electronic pen 600 is configured by integrating the authentication device 200, the electronic pen 300, and the attribution guarantee device 400.

  The authentication information extraction unit 230 captures visible light or infrared light irradiated from the vein authentication sensor of the electronic pen 300 and extracts a vein pattern as authentication information of the person to be authenticated. Then, the authentication processing unit 240 performs vein authentication by comparing the vein pattern with template data stored in advance in the authentication information storage unit 250.

  The pulse wave acquisition unit 340 acquires the pulse wave of the writer by representing the vein pattern acquired by the authentication information extraction unit 230 in time series.

  The collation unit 450 determines whether or not the pulse wave is continuously acquired from the writer by the pulse wave acquisition unit 340. If the pulse wave is continuously acquired, it is determined that the session is continued. To do. In addition, when the acquisition of the pulse wave is interrupted, the collation unit 450 determines that the session is interrupted at that time.

  As described above, in the second embodiment, it is determined whether or not the electronic pen 300 is continuously obtained from the second pulse wave information from the writer by the electronic pen 300, so that the writer can hold the electronic pen 300 from the hand. The separation can be detected. Therefore, the impersonation by using the electronic pen 300 which the writer removed from the hand by another writer can be prevented, and the effect similar to 1st Embodiment is acquired.

  Further, in the second embodiment, the writing action and the authentication action cannot be physically separated from each other, that is, the authentication information extracting unit in which the writer who holds the electronic pen 300 is mounted on the electronic pen 300. Since it is authenticated by 230, the identity of the writer and the person to be authenticated is guaranteed. Therefore, in the attribution guarantee system 2 according to the second embodiment, the first pulse wave acquisition unit 260 provided in the attribution guarantee system 1 according to the first embodiment can be omitted, and the collation processing by the collation unit 450 is further performed. Can be omitted.

  Although the above-described embodiments and examples have been described as representative examples, it will be apparent to those skilled in the art that many changes and substitutions can be made within the spirit and scope of the invention. Therefore, the present invention should not be construed as being limited by the above-described embodiments and examples, and various modifications and changes can be made without departing from the scope of the claims. For example, a plurality of constituent blocks described in the embodiments and examples can be combined into one, or one constituent block can be divided.

1,1 ′, 2 Attribution assurance system 200 Authentication device 210 Communication unit 220 Imaging unit 230 Authentication information extraction unit 240 Authentication processing unit 250 Authentication information storage unit 260 First biological information acquisition unit (first pulse wave acquisition unit)
300,600 Electronic pen 310 Communication unit 320 Writing data acquisition unit 330 Acceleration / angular velocity sensor 340 Second biological information acquisition unit (second pulse wave acquisition unit)
400 attribution guarantee device 410 communication unit 420 first pulse wave extraction unit 430 writing data processing unit 440 second pulse wave extraction unit 450 collation unit

Claims (7)

An attribution guarantee system comprising an authentication device, an electronic pen, and an attribution guarantee device that transmit and receive information to and from each other via a communication network,
The authentication device
An authentication information extraction unit for extracting authentication information for authenticating the person to be authenticated from the person to be authenticated;
An authentication processing unit for identifying the person to be authenticated by the authentication information;
A first biometric information acquisition unit that acquires biometric information of the authenticated person as first biometric information from the authenticated person,
The electronic pen is
A second biological information acquisition unit that acquires the writer's biological information as second biological information;
The attribution guarantee device is:
A collation unit is provided for collating whether or not the writer is an authenticated person identified by the authentication processing unit based on the first biometric information and the second biometric information. Attribution guarantee system. The second biometric information acquisition unit continuously acquires the second biometric information and transmits it to the attribute guarantee device,
When the collation unit determines whether or not the second biometric information is being received, and determines that the second biometric information is being received, the writer is authenticated. 2. The attribution guarantee system according to claim 1, wherein it is determined that the person is a person. The electronic pen is a writing data acquisition unit that acquires writing trajectory data representing a trajectory moved while the tip of the electronic pen is pressed against the pressed medium by a writer;
An acceleration / angular velocity sensor that acquires movement data representing one or more of acceleration and angular velocity of the electronic pen;
In the case where the collation unit determines that the second biometric information is continuously received by the collation unit, the attribute guarantee device adds 1 to the session ID of the session representing the continuation and 1 of the writing trajectory data and the movement data. The attribution guarantee system according to claim 2, further comprising a writing data processing unit that associates writing data including at least two.   Whether the writing data processing unit is based on the writing data, whether the writer wrote only by his / her hand, or a third party who is not the writer wrote by moving the writer's hand The attribute guarantee system according to claim 3, wherein: An authentication information extraction unit for extracting authentication information for authenticating the person to be authenticated from the person to be authenticated;
An authentication processing unit for identifying the person to be authenticated by the authentication information;
A biometric information acquisition unit that continuously acquires the biometric information of the writer during writing,
A collation unit that determines whether or not the acquisition of the biometric information is continued and determines that the writer is the person to be authenticated when it is determined that the acquisition of the biometric information is continued; A featured electronic pen. An attribute guarantee device that transmits and receives information to and from an authentication device and an electronic pen via a communication network,
A communication unit that receives first biometric information that is biometric information of the person to be authenticated from the authentication device, and that receives second biometric information that is biometric information of the writer from the electronic pen;
A collation unit for collating whether or not the writer is an authenticated person identified by the authentication device based on the first biometric information and the second biometric information;
An attribution guarantee device comprising: An attribute guarantee method executed by an attribute guarantee device that transmits and receives information to and from an authentication device and an electronic pen via a communication network, and includes a communication unit and a verification unit,
The communication unit receives first biometric information that is biometric information of the person to be authenticated from the authentication device, and receives second biometric information that is biometric information of the writer from the electronic pen;
The collating unit collating based on the first biometric information and the second biometric information whether or not the writer is an authenticated person identified by the authentication device;
An attribution guarantee method characterized by including:

Images