JP2011018127A - System and method for determining writer, electronic pen, and information processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable identity confirmation of a writer also on a writing object in the middle of writing or after the completion of writing.SOLUTION: A writer determination system 1 includes: an electronic pen 100; and an information processing apparatus 50. The electronic pen 100 includes: a writing reading part 130 which obtains a writing coordinate and stores it as writing data, a writing time notification part 131 which sends a notification of start to an information processing apparatus responding to start of obtaining the writing coordinate, and sends a notification of end to the information processing apparatus according to an end of obtaining the writing coordinate; an obtaining completion notification part 132 which obtains and stores biological information responding to an obtaining request and a writing coordinate or the like during obtaining as biological information data; and a data transmission part 133 which transmits a writing data group and biological information data group to the information processing apparatus. The information processing apparatus 50 includes: a data obtaining instruction part 10 which repeatedly performs transmission etc. of obtaining requests of the biological information until receiving an end notification; and a result display part 20 which receives the writing data group and biological information data group from the electronic pen, generates a handwriting image from a writing coordinate group, and displays in an output part, the handwriting image where display data which shows a result of authentication processing are arranged.

Description

  The present invention relates to a writer determination system, a writer determination method, an electronic pen, and an information processing apparatus. Specifically, it is possible to check the identity of a writer even during writing and after writing is completed. It relates to the technology.

  Identification methods (ie, confirmation of various certificates such as driver's licenses), knowledge authentication (eg, confirmation of input password), biometrics (eg, fingerprint verification, etc.) are methods of identity verification, that is, personal authentication. Exists. Among these authentication methods, biometric authentication performs personal authentication based on the characteristics unique to the individual, and unlike the property authentication or knowledge authentication, there is little risk of forgery or theft, and is an effective means for identifying the individual. A representative example of this biometric authentication is authentication by finger vein verification. Authentication based on finger vein verification has already been put to practical use in a wide range of business, and various programs and the like have been developed and used as simple personal authentication means among biometric authentication.

  For example, a terminal, an electronic approval server, a digital pen server, and an authentication server are connected via a network, which enables high-speed processing while maintaining the approval order in electronic approval processing including target persons who are not familiar with computer operations. In the electronic approval system, the electronic approval server receives a user ID and an input unit database that stores information indicating a user information input unit in advance in association with each other, and receives a user ID from the terminal via the network. Then, an electronic approval system comprising: a determination unit that determines whether the user information input unit is a digital pen input or a terminal input based on the user ID and information in the input unit database (Patent Document 1) Have been proposed).

  In addition, in order to prevent impersonation and to ensure and facilitate contracts, etc., when a person who signs a contract, etc. signs it, it is written that the person is surely signing, To make sure the identity of the other party or third party other than the person such as the third party who should be a witness of the contract on the spot, visually or audibly and confirming the identity reliably Possible personal identification writing instruments (see Patent Document 2) have also been proposed.

JP 2008-33587 A JP 2006-51743 A

For example, when performing personal authentication before and after data input that requires the identity to be ensured, it is not possible to exclude the possibility that the person who actually performed the writing such as data input is different from the person who has received the personal authentication. In other words, impersonation of the writer or the person to be authenticated cannot be prevented, and the identity of the input data tends to fluctuate. In addition, for example, even if the identity is confirmed with an electronic pen at the start of writing, if the authentication data being written is not held, the identity cannot be confirmed with respect to the writing after the start of writing.
Accordingly, the present invention has been made in view of the above problems, and a main object thereof is to provide a technique that enables the writer to check the identity of a written material during and after writing.

  The writer determination system of the present invention that solves the above problem is a computer system in which an electronic pen and an information processing apparatus that preliminarily holds biological information of the electronic pen user in a storage unit are connected to be communicable.

  The electronic pen in this computer system is configured to obtain a writing coordinate by reading a writing information by the writing person on a predetermined sheet by an optical device, and a writing coordinate and the writing coordinate. A writing reading unit that stores the writing data including the acquisition time in the storage unit, and in response to the start of acquisition of the writing coordinates, a start notification of the acquisition of the writing coordinates is transmitted to the information processing apparatus, and the acquisition of the writing coordinates ends. In response to this, the writing time notification unit transmits a writing coordinate acquisition end notification to the information processing device, and when the biometric information acquisition request is received from the information processing device after transmitting the start notification, the living body information is received accordingly. Performing biometric information acquisition of the biological part of the writer at the grip location by the information sensor, and acquisition of the writing coordinates at the time of acquisition of the biometric information from the optical device, An acquisition completion notifying unit for storing biometric information data including the biometric information and the writing coordinates associated with the biometric information and the acquisition time of the biometric information in the storage unit, and returning a biometric information acquisition completion notification to the information processing device; A data transmission unit that reads a writing data group and a biometric information data group related to the writer from the storage unit and transmits them to the information processing apparatus.

  The information processing apparatus in the computer system transmits a biometric information acquisition request to the electronic pen and receives a response from the electronic pen in response to the acquisition request when receiving a start notification of writing coordinate acquisition from the electronic pen. Received biometric information acquisition completion notification is transmitted from the electronic pen and a data acquisition instructing unit that repeatedly executes a predetermined coordinate interval until receiving an end notification of writing coordinate acquisition from the electronic pen. Receiving the writing data group and the biometric information data group, storing them in the storage unit, collating each biometric information included in the biometric information data group with the biometric information in the storage unit, and obtaining each of the obtained information about the writer Execute authentication processing related to biometric information at the writing coordinates at the time, generate a handwriting image from the writing coordinates group included in the writing data group, and at each acquisition time The written coordinates and the written coordinate group are collated, the position of the written coordinates at each acquisition time in the handwritten image is specified, and the position in the handwritten image specified here is And a result display unit that arranges display data indicating the result of the authentication process of the biometric information corresponding to the handwritten coordinates, and displays a handwritten image on which the display data is arranged on the output unit.

  In addition, the writer determination method of the present invention includes an electronic pen that is equipped with a biological information sensor at a location gripped by the writer, and that stores biological information of the electronic pen user in advance in a storage unit. Each of the processing devices executes the following processing.

  That is, the electronic pen reads the writing contents by the writer on a predetermined sheet with an optical device to acquire the writing coordinates, and stores the writing data including the writing coordinates and the acquisition time of the writing coordinates in the storage unit And a process for transmitting a writing coordinate acquisition start notification to the information processing apparatus in response to the start of the acquisition of the writing coordinates, and transmitting a writing coordinate acquisition end notification to the information processing apparatus in response to the end of the acquisition of the writing coordinates. And when the biometric information acquisition request is received from the information processing apparatus after the start notification is transmitted, the biometric information acquisition of the biometric part of the writer at the grip location by the biometric information sensor and the biometric information Acquisition of writing coordinates from the optical device at the time of acquisition of information, and writing of biological information data including the biological information and the writing coordinates associated with the biological information and the acquisition time of the biological information. A process of storing the biometric information acquisition completion notification to the information processing apparatus, and a process of reading the writing data group and the biometric information data group related to the writer from the storage unit and transmitting them to the information processing apparatus. .

  When the information processing apparatus receives a writing coordinate acquisition start notification from the electronic pen, the biological information is transmitted from the electronic pen in response to the transmission of the biometric information acquisition request to the electronic pen. The acquisition completion notification is repeatedly received at predetermined intervals until the end of writing coordinate acquisition is received from the electronic pen, and the writing data group transmitted from the electronic pen and the living body An information data group is received and stored in a storage unit, and each biological information included in the biological information data group is collated with the biological information in the storage unit, and the living body at the writing coordinates at each acquisition time obtained for the writer Executes authentication processing related to information, generates a handwriting image from the writing coordinate group included in the writing data group, collates the writing coordinate and the writing coordinate group at each acquisition time, The position of the handwritten coordinates at each acquisition time in the trace image is specified, and the result of the authentication processing of the biometric information corresponding to the handwritten coordinates at the corresponding acquisition time is specified at each position in the handwritten image specified here. The display data to be displayed is arranged, and a process of displaying the handwriting image on which the display data is arranged on the output unit is executed.

  The electronic pen according to the present invention includes an optical device that reads the content written on the electronic pen compatible paper, a communication interface that communicates with other devices, a biological information sensor that is provided at a gripping position by a writer, and the predetermined paper. The writing content by the writer is read with an optical device to acquire writing coordinates, and the writing reading unit that stores the writing data including the writing coordinates and the acquisition time of the writing coordinates in the storage unit, and the acquisition of the writing coordinates In response, a writing coordinate acquisition start notification is transmitted to the information processing device, and a writing coordinate acquisition end notification is transmitted to the information processing device in response to the end of acquisition of the writing coordinate, and the start notification When the biometric information acquisition request is received from the information processing apparatus after the transmission of the biometric information, the biometric information acquisition of the biometric part of the writer at the grip location by the biometric information sensor is The biometric information is acquired from the optical device when biometric information is acquired, and biometric information data including the biometric information, the written coordinate associated with the biometric information, and the acquisition time of the biometric information is stored in the storage unit. An acquisition completion notification unit that returns a biometric information acquisition completion notification to the information processing device, and a data transmission unit that reads out the writing data group and the biometric information data group related to the writer from the storage unit and transmits them to the information processing device; It is characterized by providing.

  In addition, the information processing apparatus of the present invention receives the electronic coordinate information of the electronic pen user in advance, the communication unit that communicates with other devices, and the start of writing coordinate acquisition from the electronic pen. Sending a biometric information acquisition request to the pen and receiving a biometric information acquisition completion notification returned from the electronic pen in response to the acquisition request until receiving an end notification of writing coordinate acquisition from the electronic pen A data acquisition instruction unit repeatedly executed at predetermined intervals, and the writing data group and the biological information data group transmitted from the electronic pen are received and stored in a storage unit, and the biological information data group includes Each biometric information is collated with the biometric information in the storage unit, an authentication process is performed on the biometric information at the writing coordinates at each acquisition time obtained for the writer, and the written data group includes A handwriting image is generated from the handwriting coordinate group, the handwriting coordinate at each acquisition time is compared with the handwriting coordinate group, and the position of the handwriting coordinate at each acquisition time in the handwriting image is specified, where Display data indicating the result of the authentication processing of the biometric information corresponding to the handwritten coordinates at the corresponding acquisition time is arranged at each position in the identified handwritten image, and the handwritten image on which the display data is arranged is output to the output unit And a result display unit for displaying.

  In addition, the problems disclosed by the present application and the solutions thereof will be clarified by the embodiments of the present invention and the drawings.

  According to the present invention, it is possible to confirm the identity of the writer even during writing and after writing.

It is a figure which shows schematic structure of the writer determination system of this embodiment. It is a figure which shows schematic structure of the electronic pen of this embodiment. It is a figure which shows schematic structure of the movable switch periphery in the electronic pen of this embodiment. It is a figure which shows schematic structure regarding the internal structure of the electronic pen of this embodiment. It is a figure which shows schematic structure of the processing terminal of this embodiment. It is a figure which shows schematic structure of the management server of this embodiment. It is a figure which shows schematic structure of the DB server of this embodiment. It is a figure which shows the example of data of user information DB of this embodiment. It is a figure which shows the example of data of vein data DB of this embodiment. It is a figure which shows the example of data of the administrator ID password DB of this embodiment. It is a figure which shows the example of data of coordinate and vein data registration DB of this embodiment. It is a figure which shows the example of data of the vein data discrimination | determination information DB of this embodiment. It is a figure which shows the example of data of identification card DB of this embodiment. It is a figure which shows the example of data of the application DB of this embodiment. It is a figure which shows the example of data of login information DB of this embodiment. It is a figure which shows the example of data of coordinate data acquisition information DB of this embodiment. It is a figure which shows the example of data of the vein data acquisition information DB of this embodiment. It is a figure which shows the example of data of use user information DB of this embodiment. It is a figure which shows the process flow example 1 of the writer determination method of this embodiment. It is a figure which shows the process flow example 2 of the writer determination method of this embodiment. It is a figure which shows the process flow example 3 of the writer determination method of this embodiment. It is a figure which shows the process flow example 4 of the writer determination method of this embodiment. It is a figure which shows the process flow example 5 of the writer determination method of this embodiment. It is a figure which shows the process flow example 6 of the writer determination method of this embodiment. It is a figure which shows the process flow example 7 of the writer determination method of this embodiment. It is a figure which shows the process flow example 8 of the writer determination method of this embodiment. It is a figure which shows the example 1 of a screen in this embodiment. It is a figure which shows the example 2 of a screen in this embodiment. It is a figure which shows the example 3 of a screen in this embodiment. It is a figure which shows the example 4 of a screen in this embodiment. It is a figure which shows the example 5 of a screen in this embodiment. It is a figure which shows the example 6 of a screen in this embodiment. It is a figure which shows the example 7 of a screen in this embodiment. It is a figure which shows the example 8 of a screen in this embodiment.

--- System configuration ---
Embodiments of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a network configuration diagram including a writer determination system 1 of the present embodiment. A writer determination system 1 (hereinafter, system 1) shown in FIG. 1 is a computer system that enables the writer to check the identity of a written material during and after writing. In this embodiment, as an application example of the system 1, an authentication management server group (management server 300, DB server 400) that performs authentication of biometric information such as user vein information, registration and authentication of writing data, and identification of a writer, Assume a situation in which the system 1 is configured from an electronic pen 100 used for writing by a writer and a processing terminal 200 that mediates data exchange between the electronic pen 100 and the authentication management server group. In this case, the operation and management of the authentication management server group is department A, and department B (store, judicial scrivener office, various public facilities, etc.) serves as a contact point when a writer visits and writes. The writer becomes department C.

  For example, when a credit card is used, the purchaser himself / herself signs the purchase price so that the purchaser who purchases the product pays for the product with the credit card. At this time, the store from which the product is purchased stores the purchaser's signature. Here, the purchaser is the department C, the store is the department B, and the department A manages the vein information and specifies the purchaser. The department A server group is connected to the department B processing terminal 200 via a WAN line 30 such as the Internet. The vein information and the writing information acquired from the electronic pen 100 by the processing terminal 200 of the department B are transferred from the processing terminal 200 of the department B to the server group of the department A. The department A server group stores and manages the data obtained from the processing terminal 200 and holds it as a certificate relating to the writer.

  However, the present invention may be applied to various situations in which writing is performed using the electronic pen 100 as well as the above-described assumption examples. In this embodiment, the “information processing apparatus” is assumed to be a group of devices such as the processing terminal 200, the management server 300, and the DB server 400. However, the processing terminal 200 functions as the management server 300 and the DB server 400. It is also possible to provide all of the data and the data processing apparatus alone.

---- Electronic pen ---
Of the devices constituting the system 1, first, the electronic pen 100 will be described. FIG. 2 is a diagram illustrating a schematic configuration of the electronic pen 100 according to the present embodiment. As shown in FIG. 2, the electronic pen 100 includes a clock function 105, a battery 110, a vibrator 111, an LED indicator 112, a pressure sensor 113, an optical unit 114 (= biological information sensor), an imaging unit 115, a light source such as an infrared light. 116 and the movable switch unit 117 are mainly configured.

  The vibrator 111 and the LED indicator 112 correspond to the output interface 142 in the electronic pen 100, and are, for example, devices that output information indicating whether or not writing is possible. The pressure sensor 113 is a sensor that detects, for example, writing pressure. Further, the optical unit 114 is a natural function as an electronic pen that acquires the writing coordinates when writing is performed on the electronic pen-compatible paper 5.

  The imaging unit 115 and the light source 116 serve as a device that reads the finger vein of the writer who is writing by holding the electronic pen. The light source 116 is, for example, an infrared light or the like, and provides a light source for vein photography by irradiating light to a writer's finger during the operation of the imaging unit 115. The imaging unit 115 captures a finger vein irradiated with light from the light source 116.

  The movable switch unit 117 is a device that is used by a writer to push in with a finger at the start of writing, and serves as a switch that detects the start of authentication. FIG. 3 is a diagram illustrating a schematic configuration around the movable switch in the electronic pen 100 of the present embodiment. The mechanism for reading the vein information of the writer's finger during writing is arranged at the grip portion of the electronic pen 100 = the grip location as shown in FIG.

  When the writer holds the electronic pen 100, the grip portion is in contact with a part of a finger such as an index finger or a thumb, and hits a position where biological information such as vein information can be sensed. As shown in (a) and (b) of the figure, in the movable switch unit 117, a portion where the writer's finger directly contacts the pen is a glass plate 119 that transmits light, and this glass plate 119 is hinged. 3 is connected to the main body of the electronic pen so as to be rotatable. The glass plate 119 can be moved downward by the hinge 3 until it contacts the switch 118.

  In this case, the imaging unit 115 and the light source 116 are installed with an inclination so as to face the glass plate 119 in accordance with the inclination of the glass plate 119 after the rotation. When the glass plate 119 rotates and pushes the switch 118 downward to turn on the switch, the imaging unit 115 faces the glass plate 119 with which the writer's finger is in contact. The switch 118 is a switch for switching on / off between the battery 110 and the imaging unit 115 and the light source 116. While the switch 118 is pressed by the glass plate 119, the switch 118 is in an “on” state, and as a result, a driving current is supplied from the battery 110 to the imaging unit 115 and the light source 116. The imaging unit 115 and the light source 116 to which the drive current is supplied can read finger vein information. The battery 110 is incorporated in the power supply device 126. The power supply device 126 receives ON / OFF from the switch 118 and manages current supply from the battery 110 to the imaging unit 115 and the light source 116.

  In addition, the electronic pen 100 has a structure shown in FIG. The electronic pen 100 includes a communication unit 125, and is connected to the processing terminal 200 (for example, directly connected by the cable 31 according to a communication protocol in the communication unit 125) by the communication unit 125. In addition, the electronic pen 100 reads out the program 140 stored in the storage unit 124 so as to have a necessary function, and executes it by the CPU 123 as an arithmetic unit.

  The electronic pen 100 has an input interface 141 such as a button, an extremely small liquid crystal display or speaker, and an output interface 142 such as the vibrator 111 or LED indicator 112. In addition, as an electronic pen, the imaging unit 120 and the light source 121 are naturally provided in order to read the content written on the electronic pen compatible paper 5. The imaging unit 120 and the light source 121 serve as the optical unit 114 in FIG. Note that the data of the entry contents read by the imaging unit 120 is accumulated in the storage unit 124 or the memory 122. Note that the existing technology (see http://functionality.anoto.co.jp/cldoc/ajp24.htm) may be applied as the basic technology of the electronic pen 100 and the electronic pen compatible paper 5.

  Dots 127 are arranged on the electronic pen compatible paper 5. Each dot 127 represents coordinate information on the coordinate plane of the electronic pen-compatible paper 5. When writing is performed with the writing tool 128 of the electronic pen 100 on the electronic pen compatible paper 5 in which the dots 127 are arranged, the optical unit 114 (the imaging unit 120 and the light source 121) reads the dots 127 that have passed during writing, Get the coordinate information. The writing tool 128 is a general writing tool such as a ballpoint pen for writing in a notebook or the like.

  Next, the means that the electronic pen 100 configures and holds based on the program 140 will be described. The electronic pen 100 includes a data acquisition management unit 129 that performs transmission / reception control of data with the processing terminal 200, vein image acquisition control, character data acquisition acquisition control, and writing state confirmation control.

  In addition, the electronic pen 100 acquires the writing coordinates by reading the writing contents by the writer on the electronic pen compatible paper 5 with the optical unit 114 (optical device), and includes the writing coordinates and the acquisition time of the writing coordinates. A writing reading unit 130 for storing writing data in the storage unit 124 is provided. As for the acquisition time of the handwritten coordinates, the handwriting reading unit 130 makes a time inquiry to the clock function 105 to acquire time information.

  In addition, the electronic pen 100 transmits a writing coordinate acquisition start notification to the processing terminal 200 of the information processing device 50 in response to the start of acquisition of the writing coordinates, and in response to the end of acquisition of the writing coordinates. A writing time notification unit 131 that transmits an acquisition end notification to the information processing apparatus 50 is provided.

  The writing time notification unit 131 detects that there is no acquisition of new writing coordinates for a certain period of time, detects that there is no storage of new writing data in the storage unit 124 for a certain period of time, and pressure provided to the electronic pen 100. Triggered by either detecting that the writing pressure measured by the sensor 113 (= writing pressure sensor) has dropped to a reference value, or receiving an instruction to end writing at a predetermined interface (such as the switch 118) provided in the electronic pen 100. It is preferable that the end notification of the handwritten coordinate acquisition is transmitted to the information processing apparatus 50.

  In addition, when the electronic pen 100 receives a biometric information acquisition request from the information processing apparatus 50 after transmitting the start notification, the electronic pen 100 grasps the grip by the biometric information sensor (the imaging unit 115 and the light source 116) accordingly. The biological information acquisition of the writer's living body part at the location and the acquisition of the writing coordinates from the optical unit 114 at the time of acquiring the biological information are executed, the biological information and the writing coordinates associated with the biological information, and the biological information The biometric information data including the information acquisition time is stored in the storage unit 124, and the biometric information acquisition completion notification is returned to the information processing apparatus 50. In the present embodiment, the biometric information acquisition request is received from the processing terminal 200, and the biometric information acquisition completion notification is returned to the processing terminal 200.

  In addition, the electronic pen 100 includes a data transmission unit 133 that reads a writing data group and a biological information data group related to the writer from the storage unit 124 and transmits them to the information processing apparatus 50. In the present embodiment, the writing data group and the biological information data group are transmitted to the management server 300 via the processing terminal 200.

--- Processing terminal ---
Next, the processing terminal 200 that constitutes the writer determination system 1 as an information processing apparatus together with the electronic pen 100 will be described. FIG. 7 is a diagram illustrating a schematic configuration of the processing terminal 200. The processing terminal 200 is a computer terminal directly connected to the electronic pen 100 via a cable 31 according to a predetermined communication protocol.

  The processing terminal 200 executes the program 225 stored in the storage unit 224, which is a non-volatile storage device such as a hard disk drive, by the CPU 223 by reading it into a volatile memory 222 such as a RAM. The processing terminal 200 includes an input interface 209 for exchanging data with an input device 206 such as various keyboards and buttons generally provided in a computer device, and a display unit 208 for exchanging data with an output device 205 such as a display. It may be provided as necessary.

  The processing terminal 200 is connected to the management server 300 via the WAN 30 between the first communication unit 201 such as a NIC (Network Interface Card) that handles data exchange with the electronic pen 100 via the cable 31 and the management server 300. And a second communication unit 207 such as a network interface card (NIC) that exchanges data. Each of the communication units 201 and 207 has a security function such as data encryption processing during communication.

  Subsequently, a description will be given of functional units configured and held in the storage unit by the processing terminal 200 based on the program 225, for example. When the processing terminal 200 receives a writing coordinate acquisition start notification from the electronic pen 100, the processing terminal 200 transmits a biometric information acquisition request to the electronic pen 100, and is returned from the electronic pen 100 in response to the acquisition request. A data acquisition instructing unit 10 is provided that repeatedly receives the notification of the completion of acquisition of biometric information until it receives an end notification of acquisition of handwritten coordinates from the electronic pen 100.

  In addition, the processing terminal 200 receives the writing data group and the biological information data group transmitted from the electronic pen 100, stores them in the storage unit 224, and transmits them to the management server 300. 20. The result display unit 20 displays, at each position in the handwriting image by the writer, display data indicating the authentication processing result (processed by the management server 300 and the DB server 400) of the biometric information corresponding to the handwritten coordinates at the corresponding acquisition time. The arranged image is obtained from the management server 300 and displayed on the display 205 via the display unit 208.

  The data acquisition instruction unit 10 includes a data request function unit 202 and a data transmission function unit 204. The data request function unit 202 requests the management server 300 and the electronic pen 100 to acquire various data such as writing data, biometric information data, and personal information of the writer. The data transmission function unit 204 transmits the personal information, writing data, and the like of the writer acquired by the processing terminal 200 to the management server 300.

  The result display unit 20 includes a data acquisition function 203, a data transmission function unit 204, and a screen display function unit 205. The data acquisition function 203 receives handwritten coordinates acquired by the electronic pen 100 during writing by the writer, biometric information such as finger vein data, various messages and processing results, image data, and the like. The data transmission function unit 204 transmits the personal information, writing data, and the like of the writer acquired by the processing terminal 200 to the management server 300. Further, the screen display function unit 205 performs display processing of the screen data acquired from the management server 300 on the display 205 or the like.

--- Management server ---
FIG. 5 is a diagram illustrating a schematic configuration of the management server 300. On the other hand, the management server 300 is a server device that is connected to the processing terminal 200 via the WAN 30 such as the Internet. The management server 300 is a system login process by a writer, and an authentication process related to biometric information such as writer's finger vein data. The various management / authentication processes are executed.

  The management server 300 executes the program 325 stored in the storage unit 324 which is a nonvolatile storage device such as a hard disk drive by the CPU 323 by reading it into a volatile memory such as the memory 322. Further, the management server 300 requires an input interface 313 for exchanging data with an input device 309 such as various keyboards and buttons generally provided in a computer apparatus, and a display unit 312 for exchanging data with an output device 308 such as a display. You may prepare according to.

  The management server 300 is connected between the DB server 400 and the HTTP server 301 including a communication function such as a NIC (Network Interface Card) that exchanges data with the processing terminal 200 via the WAN 30 such as the Internet. A communication unit 311 such as a NIC (Network Interface Card) that exchanges data via the LAN 35 is provided, and can communicate with the processing terminal 200 and the DB server 400. The HTTP server 301 holds an application for providing functions to the processing terminal 200 via the interface 30. The HTTP server 301 may include a security function such as SSL authentication in order to handle personal information of each writer.

  Next, functional units that the management server 300 configures and holds in the storage unit 324 based on the program 325, for example, will be described. The management server 300 receives the writing data group and the biological information data group transmitted from the electronic pen 100 and received via the processing terminal 200, stores them in the corresponding database of the DB server 400, and stores the biological information. The biometric information included in the data group is collated with the biometric information managed by the DB server 400, and authentication processing relating to the biometric information at the writing coordinates at each acquisition time obtained for the writer is executed. A handwriting image is generated from the handwritten coordinate group included in the group, the handwritten coordinate at each acquisition time is compared with the handwritten coordinate group, and the position of the handwritten coordinate at each acquisition time in the handwritten image is specified. The display data indicating the result of the authentication processing of the biometric information corresponding to the handwritten coordinates at the corresponding acquisition time is arranged at each position in the handwriting image specified here. The handwriting image in which the display data are arranged, comprises to result display section 20 (displayed on the display 308 via the through display unit 312) transmitted to the processing terminal 200.

  The result display unit 20 includes a data request function unit 302, a data acquisition function unit 303, a data conversion function unit 304, a data DB function unit 305, a biometric information authentication function unit 306, a login processing unit 307, and a personal information management function unit 310. It is included. The data request function unit 302 performs start-up control of the processing terminal 200 and start-up control of the electronic pen 100 via the processing terminal 200 to start acquisition of writing data and finger vein data. Control vein authentication request to

  Further, the data acquisition function unit 303 performs control to receive each data from the processing terminal 200 and the DB server 400. Further, the data conversion function unit 304 performs processing for converting written characters into image information based on data of a writing coordinate group being written. Further, it may have a function of performing text data conversion control to kana / kanji based on the data of the written coordinate group.

  The data DB function unit 305 communicates with the data processing unit 415 of the DB server 400 to control writing data and finger vein data in a database. In addition, the biometric authentication function unit 306 has a function of determining whether the writing data is based on writing by the writer himself / herself based on pre-registered finger vein data and finger vein data acquired during writing. In addition, the login processing unit 307 controls login processing with the DB server 400 based on information acquired from the processing terminal 200. The personal information management function unit 310 has a function of performing registration and search control of personal information.

--- DB server ---
FIG. 6 is a diagram illustrating a schematic configuration of the DB server 400. The DB server 400 is a server device that performs I / O processing such as writing data, biometric information, login information, and personal information of a writer in cooperation with the management server 300. As shown in FIG. 6, the DB server 400 can communicate with the management server 300 via the LAN 35 and provides a database function for storing each piece of information transferred from the management server 300.

  The DB server 400 executes the program 425 stored in the storage unit 424 that is a nonvolatile storage device such as a hard disk drive by the CPU 423 by reading it into a volatile memory such as the memory 422. Further, the DB server 400 requires an input interface 417 for exchanging data with an input device 414 such as various keyboards and buttons generally provided in a computer device, and a display unit 416 for exchanging data with an output device 413 such as a display. You may prepare according to. The management server 300 includes a communication unit 401 such as a NIC (Network Interface Card) that exchanges data with the management server 300 via the LAN 35.

  For example, the DB server 400 includes a data processing unit 415 as a processing unit realized by the program 425. The data processing unit 415 performs processing such as updating and searching various DB data, and controls data transmission / reception with the management server 300.

  Further, the DB server 400 includes a user information DB 402, a vein data DB 403, an administrator ID password DB 404, a coordinate / vein data registration DB 405, a vein data identification information DB 406, an identification certificate DB 407, a use DB 408, and login information in the storage unit 424. Each database includes a DB 0409, a coordinate data acquisition information DB 410, a vein data acquisition information DB 411, and a use user information DB 412. The data structure of each database will be described later.

  Each unit 129 to 133 in the electronic pen 100, each unit 10 and 20 (202 to 205) in the processing terminal 200, each unit 20 (302 to 310) in the management server 300, and a DB server that constitute the system 1 shown so far. The data processing unit 415 in 400 may be realized as hardware, or may be realized as a program stored in an appropriate storage unit such as a memory or an HDD (Hard Disk Drive) in each device. In this case, an arithmetic device such as a CPU of each device reads the corresponding program from the storage unit into the memory in accordance with the program execution, and executes it.

--- Data structure example ---
Next, an example of a data structure of a database used by the system 1 according to the present embodiment will be described. 8 to 18 are data configuration examples of the database configured in the DB server 400. FIG. The user information DB 402 shown in FIG. 8 is a database for registering information on a user who is a writer's determination target = writer, and a user ID 1001 uniquely assigned to the user at the time of user registration is used as a key. It is an aggregate of records in which a personal name 1002, a date of birth 1003, and an address 1004, which are personal information, are associated with each other. In the personal number 1005, for example, a personal number (insurance card number, resident ID, license number, etc.) described in the identification card used at the time of user registration is stored. The identification certificate type 1006 stores a value (a value of the type 6001) specified by an identification card DB (FIG. 13), which will be described later, for the type of identification card used at the time of user registration.

  The vein data DB 403 shown in FIG. 9 is a database for registering the user's finger vein data. For example, the user ID 2001 and the name 2002 (the same values as the user ID 1001 and the name 1002 in the user information DB 402 in FIG. 8). Is stored as a key, and a set of records in which the first to third images as finger vein data are associated with each other. For example, the user acquires finger vein data three times during use registration. The finger vein data is finger vein data for the same finger location as the finger that is in contact with the grip portion of the electronic pen 100. The first image 2003 is finger vein data acquired for the first time, the second image 2004 is finger vein data acquired for the second time, and the third image 2005 is finger vein data acquired for the third time.

  An administrator ID password DB 404 shown in FIG. 10 is a database that stores information about an administrator who manages the processing terminal 200 (such as an administrator of a store where the electronic pen 100 is installed). This database 404 is, for example, a collection of records in which data such as a password 3002, location information 3003, and usage type 3004 are associated with each other using an administrator ID 3001 as a key. The manager ID 3001 is a value uniquely assigned to the manager of the processing terminal 200 in a store or office where the electronic pen 100 and the processing terminal 200 are installed. The password 3002 is a password required when using the administrator ID 3001. Further, the location information 3003 stores information (store name, etc.) such as a store or an office where the electronic pen 100 and the processing terminal 200 are installed. Further, the usage type 3004 stores a value corresponding to the usage usage of the writer determination in the corresponding store from the value of the usage type 7001 in a usage DB 408 (FIG. 14) described later.

  A coordinate / vein data registration DB 405 shown in FIG. 11 is a database for registering writing data acquired during writing and finger vein data (biological information) obtained during writing. This database 405 uses, for example, a writer's user ID 4001 as a key, a date 4002 which is a writing execution time, a time 4003 which is a writing execution time, a coordinate 4004 which is a writing coordinate of writing data, and a start / end indicating that writing has started and ended Flag 4005 (stores “1” for start, stores “2” for end), vein acquisition flag 4006 stores “1” when finger vein data is acquired during writing, acquired during writing Data such as an image ID 4007 that stores a value uniquely assigned to finger vein data, a login ID 4008 that was used when the user logged in the processing terminal 200, and an image 4009 that stores finger vein data corresponding to the image ID 4007 Is a set of records associated with each other.

  The vein data discrimination information DB 406 shown in FIG. 12 is a database for registering authentication results of finger vein data acquired during writing and finger vein data (first to third images) in the vein data DB 403 (FIG. 9). is there. This database 406 uses a user ID 5001 as a user ID of the writer as a key, an image ID 5002 as an ID of vein data acquired during writing, and a determination result 5003 as an authentication result of the image ID 5002 (“1” when authentication is successful). In the case of authentication failure, “0” is stored), and a record such as a start flag 5004 storing “1” is associated with a record storing vein data first acquired by the writer starting writing. It is a collection of records.

  The identification certificate DB 407 shown in FIG. 13 is a master database in which certificate information used for identity verification at the time of user registration is registered, and a type 6001 and an identification certificate that are uniquely assigned to each identification certificate. The certificate 6002 is stored.

  The usage DB 408 shown in FIG. 14 indicates a ratio of successful authentication by matching the finger vein data obtained in writing with the finger vein data in the vein data DB 403 = the reference value (hereinafter referred to as a threshold) of the writer authentication conformity rate. This is a master database stored for each use (eg, for credit card settlement, for check signing, for writing a deed certificate, etc.). If the writer authentication conformity rate exceeds the threshold value specified for each application, the writer is determined to be the principal. The usage type 7001 is assigned a unique number for each usage of the system 1, the usage 7002 stores the usage of the system 1, and the threshold 7003 stores a threshold value specified for each usage. .

  The login information DB 409 shown in FIG. 15 is a database for managing the login information of the administrator of the processing terminal 200. The login ID 8001 stores the ID used when the administrator logs in to the processing terminal 200, and stores the login time. It consists of data such as a login time 8002 and a system end time 8003 storing the time when the processing terminal 200 is stopped.

  A coordinate data acquisition information DB 410 shown in FIG. 16 is a database for storing coordinate data acquired from the electronic pen 100, and a data acquisition ID 9001 that is an ID uniquely assigned to each writing data by the electronic pen 100 is used as a key. This is a set of records in which data such as a date 9002 indicating a data acquisition date, an acquisition time 9003 when writing data is acquired, and coordinates 9004 which are writing coordinates included in the writing data are associated with each other.

  The vein data acquisition information DB 411 shown in FIG. 17 is a database that acquires finger vein data from the electronic pen 100 and stores it, and uses the data acquisition ID 9001 and the agreed data acquisition ID 10001 in the coordinate data acquisition information DB 410 (FIG. 16) as keys. As the writing data acquisition date, date 10002, acquisition time 1003 when writing data is acquired, image ID 10004 uniquely assigned to the image of finger vein data acquired during writing, image data 10005 which is finger vein data acquired during writing It is a collection of records that correspond to each other.

  The user information DB 412 shown in FIG. 18 holds time information when the electronic pen user uses the processing terminal 200, and an authentication time 11002, which is a time when writing is started with the user ID 11001 of the user as a key. It is an aggregate of records in which an end time 11003, which is the time when writing is ended, and a data acquisition ID 11004 that is uniquely assigned to the writing data are associated with each other.

--- Processing flow example 1 ---
Hereinafter, the actual procedure of the writer determination method in the present embodiment will be described with reference to the drawings. Various operations corresponding to the writer determination method described below are realized by a program that is read and executed in the memory of the electronic pen 100, the processing terminal 200, the management server 300, and the DB server 400 that constitute the system 1. The And this program is comprised from the code | cord | chord for performing the various operation | movement demonstrated below.

  FIG. 19 is a diagram illustrating a processing flow example 1 of the writer determination method according to the present embodiment. Here, as the writing start preparation process, a process flow when the administrator of the processing terminal 200 starts up the processing terminal 200 to perform login processing and searches for personal information related to the writing person is shown. In this case, for example, the screen display function unit 205 of the processing terminal 200 displays the data of the login screen 700 (FIG. 27) on the display 205 via the display unit 208 (S101) in response to the activation of the processing terminal 200.

  In addition, the data acquisition function 202 of the processing terminal 200 receives and acquires an administrator ID 3001 and a password 3002 via the login screen 700 and passes the data to the data transmission function unit 204. The data transmission function unit 204 sends a login request including the data to the data acquisition function unit 303 of the management server 300.

  At this time, the login processing unit 307 of the management server 300 executes a login process in response to the login request sent from the data transmission function unit 204 (S102). In this login process (S102), the login processing unit 307 of the management server 300 compares the administrator ID 3001 and password 3002 included in the login request with the administrator ID password DB 404 to perform authentication related to the administrator. The login processing unit 307 stores the login ID used for login in the login ID 8001 of the login information DB 409 (FIG. 15) and the login time in the login time 8002. At the time of logoff from the processing terminal 300, the login processing unit 307 stores the logoff time in the end time 8003 of the login information DB 409.

  After executing the above login process, the login processing unit 307 of the management server 300 transmits the data of the menu screen 710 (FIG. 28) to the data acquisition function 203 of the processing terminal 200. In response, the screen display function unit 205 of the processing terminal 200 displays the menu screen 710 (S103).

  The data acquisition function 202 of the processing terminal 200 is input by the administrator or writer through the input device 206 via the screen 710 when the “new registration” button is pressed on the menu screen 710 (S104: YES). Obtain new scribe registration information. In this case, the data acquisition function 202 passes the registration information of the new writer to the data transmission function unit 204, and the data transmission function unit 204 sends a registration request including the registration information to the data acquisition function unit of the management server 300. It transmits to 303 (S105).

  The data acquisition function unit 303 of the management server 300 receives the registration information and passes it to the personal information management unit 311. The personal information manager 311 performs the personal information registration process (S107) shown in FIG. The flow illustrated in FIG. 26 will be described later. After the completion of the new registration process, the personal information management unit 311 of the management server 300 transmits personal information related to the new writer and a confirmation request message to the processing terminal 200 (S111).

  Meanwhile, the data acquisition function unit 203 of the processing terminal 200 receives the personal information and the confirmation request message and displays them on the display 205 (S113). When the information that the personal information is correct is input by the input device 206 (S114: YES), the data acquisition function unit 203 requests the storage of the new writer information to be stored in the personal information management unit of the management server 300. 311 (S116a). In response to the storage request, the personal information management unit 311 of the management server 300 performs a storage process (S116) on the registration information of the new writer. In this storage process, the corresponding data is stored in the fields of the user ID 11001, the authentication time 11002, and the data acquisition ID 11004 of the use user information DB 412 (FIG. 18). After step S116, the process proceeds to step S120 (FIG. 20).

  If information indicating that the personal information is not correct is input through the input device 206 in step 114 (S114: No), the process proceeds to step S115, and the screen display function unit 205 of the processing terminal 200 is restarted. After the processing request message is displayed on the display 205, the processing returns to the menu screen display in step S103.

  On the other hand, when the “Search” button is pressed on the menu screen 710 (FIG. 28) (S104: No), the screen display function unit 205 of the processing terminal 200 displays the screen 730 (FIG. 30) on the display 205. To do. At this time, the data acquisition function unit 203 of the processing terminal 200 acquires the writer's name and date of birth data via the screen 730. Subsequently, the screen display function unit 205 of the processing terminal 200 displays a screen 740 (FIG. 31) including a finger vein data reading message on the display 205. At this time, the data request function unit 202 of the processing terminal 200 transmits an activation request to the electronic pen 100 via the cable 31 to activate the electronic pen 100. At this time, the writer is holding the electronic pen 100.

  On the other hand, the data acquisition management unit 129 of the electronic pen 100 acquires finger vein data from the imaging unit 115 and the light source 116 for the finger of the writer holding the electronic pen 100. The data acquisition management unit 129 of the electronic pen 100 transmits the acquired finger vein data to the data acquisition function 203 of the processing terminal 200 via the communication unit 125.

  The data transmission function unit 204 of the processing terminal 200 manages the writer's name, date of birth data, and finger vein data acquired from the electronic pen 100 acquired through the screen 730 together with a search processing request. The data is transmitted to the data acquisition function unit 303 of 300 (S106).

  The personal information management unit 311 of the management server 300 receives the writer's name, date of birth, and finger vein data from the processing terminal 200 (S108), and uses the received data, the individual shown in FIG. An information search process (S109) is executed. By this search processing, the personal information management unit 311 acquires personal information registered in the DB server 400 for the writer.

  If no matching registration information is found in the user information DB 402 and vein data DB 403 as a result of step S109 (S110: No), the personal information management unit 311 sends a re-input request message to the processing terminal 200. Transmit (S112), and the process proceeds to step S113. On the other hand, as a result of the step S109, when matching registration information can be searched in the user information DB 402 and vein data DB 403 (S110: YES), the personal information management unit 311 searches the personal information and its confirmation request message. Is transmitted (S111).

  At this time, the processing terminal 200 receives and displays personal information and a confirmation request message from the management server 300 (S113). When the information that the personal information is correct is input by the input device 206 (S114: YES), the data acquisition function unit 203 requests the storage of the new writer information to be stored in the personal information management unit of the management server 300. 311 (S116a). In response to the storage request, the personal information management unit 311 of the management server 300 performs a storage process (S116) on the registration information of the new writer. In this storage process, the corresponding data is stored in the fields of the user ID 11001, the authentication time 11002, and the data acquisition ID 11004 of the use user information DB 412 (FIG. 18). After step S116, the process proceeds to step S120 (FIG. 20).

  If information indicating that the personal information is not correct is input through the input device 206 in step 114 (S114: No), the process proceeds to step S115, and the screen display function unit 205 of the processing terminal 200 is restarted. After the processing request message is displayed on the display 205, the processing returns to the menu screen display in step S103.

--- Processing flow example 2 ---
FIG. 20 is a diagram showing a processing flow example 2 of the writer determination method of the present embodiment. Here, the flow regarding the writing start process is shown after receiving the above-mentioned preparation process before starting writing. Note that, by the processing up to step S116 in the preprocessing flow example 1, identification of the writer who intends to perform writing using the electronic pen 100 is completed.

  In this case, the screen display function unit 205 of the processing terminal 200 displays on the display 205 a message (preliminarily stored in the storage unit) requesting implementation of the electronic pen to be used (S120). Further, the data request function unit 202 of the processing terminal 200 transmits a writing start request to the electronic pen 100 connected by the cable 31 (S121).

  Meanwhile, the data acquisition management unit 129 of the electronic pen 100 receives the writing start request (S122) and performs energization confirmation of the movable switch unit 117 (S123). For example, in the movable switch unit 117, the glass plate 119 rotates and pushes the switch 118 downward to turn on the switch = the battery 110 to the imaging unit 115 or the light source. Whether or not the drive current is supplied to 116 is determined.

  As a result of the energization confirmation, if the switch 118 of the movable switch unit 117 is in an OFF state and the finger vein data cannot be acquired (S124, S125: No), the data acquisition management unit 129 Transmits error information to the data acquisition function unit 203 of the processing terminal 200 (S131). The data transmission function unit 204 of the processing terminal 200 transmits error information to the data acquisition function unit 303 of the management server 300 (S132). In this case, the data acquisition function unit 303 of the management server 300 receives the error information, and the data request function unit 302 transmits a retry message to the processing terminal 200 (S133). Accordingly, the process proceeds to the process of S120 in which the screen display function unit 205 of the processing terminal 200 displays the writer authentication execution request message again. If an error is detected in step S125 even after the retry is performed, the data request function unit 302 of the management server 300 sends a message to the processing terminal 200 so that the process is performed from the beginning. After displaying this message, the screen display function unit 205 of the processing terminal 200 performs forced termination processing such as returning to the menu screen 710.

  On the other hand, if it is determined in step S125 that the energization confirmation result indicates that the switch 118 of the movable switch unit 117 is in an on state and finger vein data can be acquired (S124, S125: YES), the data acquisition management unit 129 of the electronic pen 100, for example, vibrates the vibrator 111 and turns on the LED indicator 112 (S126) to notify the writer that the writing can be started. Further, the data acquisition management unit 129 of the electronic pen 100 notifies the data acquisition function unit 203 of the processing terminal 200 that the electronic pen 100 is ready to start writing (S127).

  On the other hand, the data acquisition function unit 203 of the processing terminal 200 receives a writing start ready state notification from the electronic pen 100, and the data transmission function unit 204 can start writing to the data acquisition function unit 303 of the management server 300. Is sent (S128). In this case, the data acquisition function unit 303 of the management server 300 receives a notification that writing can be started, and the data request function unit 302 transmits a writing start message to the data acquisition function unit 203 of the processing terminal 200 (S129). ). The screen display function unit 205 of the processing terminal 200 receives the writing start message from the management server 300 and performs display processing on the display 205 (S130). By the process so far, preparation of writing using the electronic pen 100 by the writer has been completed.

--- Processing flow example 3 ---
FIG. 21 is a diagram showing a processing flow example 3 of the writer determination method of the present embodiment. Here, a flow for acquiring writing data and finger vein data is shown. In this case, it is assumed that the writer starts writing on the electronic pen compatible paper 5 using the electronic pen 100 after the execution of step S130 of the processing flow example 2. At this time, a handwriting is generated on the electronic pen compatible paper 5 by a writing operation using the writing tool 128 of the electronic pen 100.

  At this time, the writing reading unit 130 of the electronic pen 100 reads the coordinate data of the handwriting generated on the electronic pen-compatible paper 5 = writing coordinates from the dots 127 arranged on the electronic pen-compatible paper 5. Reading is performed using the optical unit 114 (the light source 121 and the imaging unit 120) and received from the optical unit 114 (S201). At the timing when writing coordinate reception starts from the optical unit 114, the writing reading unit 130 numbers data acquisition IDs that do not overlap for each data of the writing coordinates (the numbering method increments the number by 1 in the order of data reception). Etc.) The value of this data acquisition ID is a unique value for each writing, and serves as a key for specifying writing coordinates and finger vein data.

  Subsequently, when the writing time notifying unit 131 of the electronic pen 100 receives the data of the writing coordinates from the optical unit 114, the signal indicating that the reception of the data of the writing coordinates is started = the start notification of the acquisition of the writing coordinates, The data is transmitted to the data acquisition function unit 203 of the terminal 200 (S202). On the other hand, the writing reading unit 130 registers the data of the writing coordinates in the memory 122 (S211). The handwritten coordinate data may be temporarily stored in the storage unit 124 until it is transmitted to the processing terminal 200. In addition, the writing reading unit 130 may perform an error check of registered data in accordance with the data registration of the writing coordinates (S212).

  Subsequently, in the processing terminal 200, when the data acquisition function unit 203 receives a writing coordinate acquisition start notification from the electronic pen 100 (S203), the data requesting function 202 receives a writing coordinate acquisition end notification. Then, an acquisition request signal for finger vein data, which is biometric information, is transmitted to the acquisition completion notification unit 132 of the electronic pen 100 at regular intervals or at random timings (S204).

  On the other hand, the acquisition completion notification unit 132 of the electronic pen 100 receives the finger vein data acquisition request signal from the data request function 202 of the processing terminal 200 (S205), and the light source 116 and the imaging unit 115 perform the writing. The person's finger vein data is acquired. Further, the writing coordinates and writing time of the character being written at the time of finger vein data acquisition are acquired from the optical unit 114 (S206). The acquisition completion notification unit 132 registers the handwritten coordinates, writing time, and finger vein data acquired here in the memory 122 (S207). These data are saved in the storage unit 124 until they are transmitted to the processing terminal 200.

  Also, the acquisition completion notification unit 132 of the electronic pen 100 transmits a finger vein data acquisition completion notification to the data acquisition function unit 203 of the processing terminal 200 at the timing when the step S207 is completed (S208). . Note that transmission of finger vein data or the like to the processing terminal 200 may be performed immediately after data acquisition from the optical unit 114.

  Thereafter, in the electronic pen 100, the pressure sensor 113 does not sense writing pressure = writing pressure (or when the writing pressure is equal to or lower than a predetermined reference value), and in the movable switch unit 117, the switch 118 is OFF state = The writing time notification unit 131 detects that the writer's finger is separated from the glass plate 119, and transmits a data acquisition end notification of writing coordinates to the data acquisition function unit 203 of the processing terminal 200 ( S213).

  At the same time, the data transmission unit 133 of the electronic pen 100 stores the writing coordinate data and the writing coordinates, the writing time, and the finger vein data at the time of obtaining the finger vein data stored in the storage unit 124 in the processing terminal. 200 (S214). This transfer process may be executed at a timing when the electronic pen 100 is placed on a connection interface with the processing terminal 200 such as a cradle.

  On the other hand, the data acquisition function unit 203 of the processing terminal 200 receives the writing coordinate data, the writing coordinates at the time of acquiring finger vein data, the writing time, and the finger vein data from the data transmission unit 133 of the electronic pen 100 (S215). ). The data transmission function unit 204 transmits the data received in step S215 to the data acquisition function unit 303 of the management server 300, and executes a result inquiry process (S216).

--- Processing flow example 4 ---
FIG. 22 is a diagram showing a process flow example 4 of the writer determination method of the present embodiment. Here, a processing flow for the result inquiry processing (S216) shown in the processing flow example 3 is shown. In this case, the data transmission function unit 204 of the processing terminal 200 stores the memory accumulated data (writing coordinate data, data acquisition ID, writing at the time of finger vein data acquisition) transferred from the data transmission unit 133 of the electronic pen 100 upon completion of writing. The coordinates, writing time, and finger vein data) are transmitted to the data acquisition function unit 303 of the management server 300 (S301).

  On the other hand, the data acquisition function unit 303 of the management server 300 receives the memory accumulation data (S302) and passes it to the biometric information authentication function unit 306. The biometric information authentication function unit 306 transmits a message indicating that the result is being verified to the data acquisition function unit 203 of the processing terminal 200 (S303). At this time, the screen display function unit 205 of the processing terminal 200 receives the result matching message from the management server 300 and displays it on the display 205 (S304). The biometric information authentication function 306 of the management server 300 performs a result determination process (S305) on the memory accumulated data received from the processing terminal 200. This result determination process will be described later with reference to FIG.

  The biometric information authentication function 306 of the management server 300 uses the writer authentication accuracy rate of the finger vein data being written calculated in the result determination process (S305) and the threshold value 7003 for each use purpose acquired during the login process. Compare (S306) and if it is equal to or greater than the threshold (S306: YES), the determination result is transmitted to the data acquisition function unit 203 of the processing terminal 200 (S307). On the other hand, the screen display function unit 205 of the processing terminal 200 receives the determination result and displays it on the display 205 (S308), thereby completing the process. In the screen 770 displayed at this time, the finger vein data acquisition location in the handwriting and the authentication result of the finger vein data are displayed together as shown in FIG.

  On the other hand, if the writer authentication accuracy rate does not reach the threshold value in step S306 (S306: No), the biometric information authentication function unit 306 of the management server 300 sends a message asking whether to retry the processing terminal 200. (S309). At this time, if the writers wish to retry, the data request function unit 202 of the processing terminal 200 receives a retry instruction from the writers by the input device 206 and sends it to the data acquisition function unit 303 of the management server 300. A retry request is sent (S311). In response to the retry request, the data acquisition function unit 303 of the management server 300 sends the data on the menu screen 710 to the processing terminal 200 (S312). For example, the retry may be performed up to two times, and the process may be performed again from the menu screen.

  The management server 300 may send the determination result in step S305 to the processing terminal 200 without performing the process in step S306.

  In addition, the determination result obtained in the process of step S306 is registered from the management server 300 to the coordinate / vein data registration DB 405 of the DB server 400 or the like. Therefore, not only during writing and immediately after the end of writing, but also after a certain period of time has elapsed since the end of writing, the writer or administrator can make an inquiry. At the time of this inquiry, the management server 300 presents on the processing terminal 200 a screen for inquiry processing (FIGS. 29, 32, and 33) that accepts a personal number, name, date of birth, sex, address, etc. as a search key. The DB server 400 searches the DB server 400 for past determination results regarding the writer corresponding to the search key, and returns the search results to the processing terminal 200.

--- Processing flow example 5 ---
FIG. 23 is a diagram showing a processing flow example 5 of the writer determination method of the present embodiment. Here, the detailed flow of the result determination process (S305) in the above-described process flow example 4 is shown. In this case, the data DB function unit 305 of the management server 300 includes, for example, the data of the writing coordinates, the data acquisition ID of the writing coordinates, the writing date, and the writing time among the memory accumulation data received from the electronic pen 100. A registration instruction is sent to the DB server 400 (S401). Further, the data DB management function unit 305 includes, for example, image data as finger vein data, handwritten coordinates at the time of finger vein data acquisition, data acquisition ID of the handwritten coordinates, writing date, and writing time among the memory accumulated data. A registration instruction is sent to the DB server 400 (S402).

  On the other hand, the data processing unit 415 of the DB server 400 receives the registration instruction from the management server 300, and converts the data acquisition ID, writing date, writing time, and writing coordinate data included in the registration instruction into the coordinate data. Stored in the correspondence columns 9001, 9002, 9003, 9004 of the acquisition information DB 410 (S403).

  In addition, the data processing unit 415 of the DB server 400 receives the registration instruction from the management server 300, and the image data that is the finger vein data included in the registration instruction, the handwriting coordinates at the time of obtaining the finger vein data, the handwriting The coordinate data acquisition ID, writing date, and writing time are registered in the corresponding fields 10001, 10002, 10003, 10004, and 10005 of the vein data acquisition information DB 411 (S404).

  Next, the data processing unit 415 of the DB server 400 updates the coordinate / vein data registration DB 405 of FIG. Here, the data processing unit 415 acquires the user ID 4001 from the column 11001 of the used user information DB 412 using the data acquisition ID obtained from the management server 300 in steps S403 and s404 as a search key. Further, the data processing unit 415 uses the data acquisition ID as a search key, and acquires coordinates 4004 that are handwritten coordinate data from the column 9004 of the coordinate data acquisition information DB 410. In addition, the data processing unit 415 uses the data acquisition ID as a search key, acquires the date 4002 when the handwritten coordinates are acquired from the field 9002 of the coordinate data acquisition information DB 410, and similarly acquires the time when the handwritten coordinates are acquired from the field 9003. To do. Further, the data processing unit 415 uses the data acquisition ID as a search key, and acquires an image ID 4007 and image data 4009 as finger vein data from the fields 10004 and 10005 of the vein data acquisition information DB 411.

  The data processing unit 415 stores the acquired data in the corresponding column of the coordinate / vein data registration DB 405 and performs an update process. When the finger vein data is stored in the coordinate / vein data registration DB 405, the data processing unit 415 stores “1” in the vein acquisition flag 4006. Further, the data processing unit 415 sets the start / end flag 4005 for the first record (= corresponding to the writing data and finger vein data obtained for the first time after starting writing) among the data stored in the coordinate / vein data registration DB 405. “1” is stored in the column, and “2” is stored in the last record (= corresponding to writing data and finger vein data obtained immediately after the end of writing). Further, the data processing unit 415 stores the value of the login ID 8001 of the login information DB 0409 in FIG. 15 in the column of the login ID 4008 in the coordinate / vein data registration DB 405. By using the login ID 4008 as a search key, the data processing unit 415 can specify the corresponding location information 3003 and usage type 3004 data from the administrator ID password DB 404. Further, the data of the usage type 3004 can be used as a key for acquiring the usage 7002 and threshold 7003 data from the usage DB 408.

The data processing unit 415 of the DB server 400 that has completed the update of each DB transmits DB update end information to the management server 300 (S405).
On the other hand, when the data acquisition function unit 303 of the management server 300 receives the DB update end information from the DB server 400 (S406), the data processing unit 415 of the DB server 400 is notified of the writer who is writing. An image ID of the acquired finger vein data is requested (S407).

  At this time, the data processing unit 415 of the DB server 400 receives the request for the image ID (S408), and uses the data acquisition ID used at the time of updating the DB in the steps S403 and S404 as a search key, and the coordinate / vein A record in which “1” and “2” are stored in the vein acquisition flag 4006 stored in the data registration DB 405 is searched. The records in which “1” and “2” are stored in the vein acquisition flag 4006 indicate the start and end of acquisition of handwritten coordinates. In other words, the record between them indicates the electronic pen compatible paper 5 by the electronic pen 100. It corresponds to the above-mentioned series of handwriting (for example, a sentence such as “Aiue Okeki Keko”, a character string of a predetermined number of characters, etc.).

  In addition, the data processing unit 415 includes each record group from a corresponding record in which “1” is stored in the vein acquisition flag 4006 to a corresponding record in which “2” is stored in the vein acquisition flag 4006. For the record, the user ID 4001, date 4002, time 4003, coordinates 4004, vein acquisition flag 4006, image ID 4007, login ID 4008, and image 4009 are acquired (S408). Further, the data processing unit 415 transmits the data acquired from the coordinate / vein data registration DB 405 to the data acquisition unit 303 of the management server 300 (S409).

  For example, with respect to the handwriting consisting of 10 characters “Aiueokiki Kekko”, a plurality of records (records from the start / end flag 4005 ranging from “1” to “2”) are generated for each character, and the 10 characters It is assumed that a record group including these records is transmitted to the data acquisition unit 303 of the management server 300. At this time, the data conversion function unit 304 of the management server 300 is a bit indicating the handwriting of the “aiueokikikiko” based on the data group of the coordinate 4004 which is the writing coordinate group of each record received from the DB server 400. A handwriting image in a map format or the like is generated (S410). The handwriting image is generated by, for example, plotting each handwriting coordinate of the handwriting coordinate group on a predetermined coordinate plane and connecting the handwriting coordinates based on a predetermined algorithm to generate handwriting (handwriting based on the handwriting coordinates). The existing description should be adopted for the image generation method).

  In addition, the data conversion function unit 304 identifies a record in which the vein acquisition flag 4006 is “1” from the record group, reads a value of a coordinate 4004 indicating handwritten coordinates from the corresponding record, and reads the coordinates in the handwriting image. For example, display data with a mark ◯ indicating the finger vein data acquisition location and display data of the image ID 4006 of the finger vein data acquired at the location are arranged at the corresponding position of the value 4004 (S411).

  For example, as a result of the processing terminal 200 notifying the electronic pen 100 of a finger vein data acquisition request at regular intervals (eg, every 0.3 seconds), the “Ai Uoki” written on the electronic pen 100 is used. It is assumed that finger vein data is acquired at a predetermined time during writing of the characters “a”, “u”, “o”, “ka”, and “ke” in the character string “Kukeko”. Further, for example, during the writing of the character “a”, the image ID of the finger vein data acquired with the electronic pen 100 at the time 4003 “20: 20: 21: 22” of the date 4002 “20090902” is “aaa0001”. Suppose. In this case, in the handwriting “a” in the handwriting image, the display of the image ID “aaa0001” and the circle mark is arranged at the position of the coordinates 4004 “123, 321” corresponding to the image ID “aaa0001”. It will be.

  At this time, the data conversion function unit 304 authenticates the finger vein data corresponding to the handwritten coordinates at the finger vein data acquisition time = the handwritten coordinates in the record in which the vein acquisition flag is “1” (described later). The result of step S412) is obtained from the biometric information authentication function unit 306, and the display data indicating the authentication processing result is obtained at a predetermined position in the handwriting image (for example, the acquisition position of the corresponding finger vein data in the handwriting image, or The handwritten image data is transmitted to the DB server 400 or the processing terminal 200 (S414). An example of the handwritten image data transmitted here is as shown in a screen 770 in FIG. In this screen 770, in the handwriting image 771, the display data 772 indicated by a circle indicating the finger vein data acquisition location and the display data 773 of the finger vein data image ID 4006 acquired at the location are arranged. In addition, display data 775 indicating the authentication processing result regarding each finger vein data is arranged in the lower stage of the image ID of the corresponding finger vein data in the display data column 774 of the image ID 4006.

  The biometric information authentication function unit 306 of the management server 300 performs the determination process (S412) on the finger vein data acquired during writing shown in FIG. (In the above example, “a”, “u”, “o”, “ka”, “ke” corresponding to the 5 characters) and the number of matches (the number of successful authentication), the number of mismatches (the authentication failed) The writer authentication precision is calculated from the number of records) (S413). The writer authentication conformity rate is a value calculated by the ratio of the number of matching cases in the number of matching cases, and if the value of this calculation result exceeds a predetermined threshold, the writer is a valid person If it is determined that the calculated result does not exceed a predetermined threshold, the writer is determined not to be a valid person for the sentence “Aiue Okeki Kekko”. This determination result is indicated by ◯ = authorized writer and × = illegal writer in the determination result column 776 on the screen 770. The processing flow of FIG. 25 will be described later.

--- Processing flow example 6 ---
FIG. 24 is a diagram illustrating a processing flow example 6 of the writer determination method according to the present embodiment. Here, a processing flow of personal information search processing (step S109 in processing flow example 1) is shown. In this case, the data transmission function unit 204 of the processing terminal 200 displays the search screen 730 shown in FIG. 30 on the display 205 in response to pressing of the “search” button on the menu screen 710 of FIG. The acquisition function unit 203 acquires the name and date of birth data on the screen 730 and transmits the data to the data acquisition unit 303 of the management server 300 (S501).

  The personal information management unit 311 of the management server 300 searches the user information DB 402 of the DB server 400 based on the name and date of birth information received from the processing terminal 200 (S502). At this time, the data processing unit 415 of the user information DB 402 performs a search in the user information DB 402 using the name and date of birth as keys, and returns the search result to the management server 300 (S503).

  On the other hand, the data acquisition unit 303 of 0300 in the management server receives the search result in the user information DB 402 from the DB server 400 and passes it to the personal information management unit 311. If the personal information management unit 311 cannot search the user information DB 402 for a record that matches the name and date of birth as a result of the search in step S503 (S504: No), the personal information management unit 311 stores the name, Send a message prompting you to re-enter your date of birth. On the other hand, the screen display function unit 205 of the processing terminal 200 receives the message, displays it on the display 205 (S505), and ends this flow.

  On the other hand, as a result of the search in step S503, if a record that matches the name and date of birth can be searched (S503: YES), the personal information management unit 311 displays the data reception function unit 204 of the processing terminal 200. In response to this, a finger vein data acquisition request is transmitted (S506). In this case, the data reception function unit 204 of the processing terminal 200 receives the finger vein data acquisition request transmitted by the data request function unit 302 of the management server 300, and in response thereto, the screen display function unit 205 displays a finger vein data acquisition request message on the display 205 (S507).

  At the same time, the data request function 202 of the processing terminal 200 activates the electronic pen 100. The data acquisition management unit 129 acquires finger vein data from the electronic pen 100. After acquiring finger vein data, the data acquisition management unit 129 of the electronic pen 100, for example, places the electronic pen 100 on a dedicated cradle connected to the processing terminal 200 by the cable 31, or the switch 118 If it is determined that the acquisition of the writing coordinates has been completed due to being off, the electronic pen 100 transmits the acquired finger vein data and the like to the data acquisition function unit 203 of the processing terminal 200 (S508).

  On the other hand, the data acquisition function unit 203 of the processing terminal 200 acquires the finger vein data from the electronic pen 100. The data transmission function unit 204 transmits the finger vein data and the like to the data acquisition function unit 303 of the management server 300 (S509). The data acquisition function unit 303 of the management server 300 acquires the finger vein data and passes them to the data DB function unit 305. The data DB function unit 305 performs a search process (S510) in the vein data DB 403 of the DB server 400 using as a key the user ID 1001 obtained by searching the user information DB 402 by the name and date of birth. At this time, the data processing unit 415 of the DB server 400 searches the user ID 2001 of the vein data DB 403 by using the user ID 1001 obtained from the data DB function unit 305 of the management server 300 as key information, and first images of matching users 2003, the second image 2003, and the third image 2004 are acquired, and the acquired data is transmitted to the management server 300 (S511). The data acquisition function unit 305 of the management server 300 receives the finger vein image data transmitted from the data processing unit 415 of the DB server 400 (S512), and performs the process in step S109 of the processing flow example 1 To return.

--- Processing flow example 7 ---
FIG. 25 is a diagram showing a processing flow example 7 of the writer determination method of the present embodiment. Here, step S412 in the above processing flow example will be described with respect to a writer determination process relating to finger vein data acquired during writing. In this case, the biometric authentication function 306 of the management server 300 converts the records with the vein acquisition flag 4006 from “1” from the record group to “A”, “U”, “O”, It is assumed that it is specified from the record corresponding to each character of “ka” and “ke” (S601, S602). In this case, the biometric authentication function 306 determines that the number of records specified from the records corresponding to the total of five characters “a”, “u”, “o”, “ka”, and “ke” = image 4009. Is counted (S603).

  In addition, the data acquisition function unit 303 of the management server 300 uses the data of the image 4009 (= finger vein data) specified in steps S601 and S602, the personal information search process (S109) to the personal information registration process (S107). The first image 2003, the second image 2004, and the third image 2005 that are the finger vein data of the writer acquired in step S3 are acquired from the vein data DB 403 (S604). In addition, the biometric information authentication function 306 performs collation processing (S605) between the finger vein data and the first to third images.

  In this finger vein data collation process (S605), the biometric authentication function 306 compares the data of the image 4009 with the first image 2003, the data of the image 4009 and the second image 2004, and the image 4009. The comparison between the data and the third image 2005 is executed, and if there is a match in any one or more of the comparison processes, it is determined that “the same”, that is, the writer is valid.

  When it is determined as “same” in the process of step S605 (S606: YES), the biometric information authentication function 306 counts as the number of matched cases and stores the count value in a memory (S607), and the vein data discrimination “1” is stored in the determination result 5003 of the information DB 406 as information indicating authentication success (S607). If it is not determined as “same” in step S605 (S606: No), the biometric information authentication function 306 counts as the number of mismatches and stores the count value in the memory (S609). “0” is stored in the determination result 5003 of the data determination information DB 406 as information indicating authentication failure (S610).

  Further, the data DB function unit 305 of the management server 300 uses the user ID 1001 acquired in the personal information search processing (S109) to the personal information registration processing (S107) as the vein data discrimination information registration (S611), the processing flow. The image ID 4006 inherited from Example 4 and the start flag 4005 inherited from Process Flow Example 4 are set in the user ID 5001, image ID 5002, and start flag 5004 of the vein data discrimination information DB 406, and the data set here Is transmitted to the data processing unit 415 of the DB server 400.

  On the other hand, the data processing unit 415 of the DB server 400 updates the vein data determination information DB 406 with the contents set in step S611 in the management server 300 as vein data determination information registration (S612). DB update information is transmitted to the data acquisition function unit 303 of the management server 300 (S613). In this case, the data acquisition function unit 303 of the management server receives the DB update information (S614) and completes a series of processes. Such a series of processes is performed on each finger vein data acquired during writing (S615), and the above-described step S601 is repeated until there is no finger vein data to be processed.

--- Processing flow example 8 ----
FIG. 26 is a diagram illustrating a processing flow example 8 of the writer determination method according to the present embodiment. Here, the personal information registration process (S107) in process flow example 1 will be described. In this case, the personal information management unit 311 of the management server 300 receives the pressing data of the new registration button on the menu screen 710 shown in FIG. 28 from the processing terminal 200 and transmits a message confirming the new registration (S701). .

  At this time, the data acquisition function unit 203 of the processing terminal 200 receives the message and passes it to the screen display function unit 205. The screen display function unit 205 displays the message on the display 205 (S702). When the writer or administrator instructs new registration with the input device 206 of the processing terminal 200 (S703: YES), the data acquisition function unit 203 displays the name, date of birth, sex, and address of the writer. And the like are acquired via the input device 206 (S704). The data acquisition function unit 203 displays a vein data acquisition request message on the display 205 and prompts the writer to read finger vein data.

  It is assumed that the writer places a finger on the glass plate 119 of the electronic pen 100 and the imaging unit 115 and the light source 116 read the finger vein data. The finger vein data is read three times, for example, and the finger information data acquired thereby is transmitted from the electronic pen 100 to the processing terminal 200 (S706). The processing terminal 200 receives the finger vein data and passes it to the data transmission function unit 204. The data transmission function unit 204 stores the personal information (name, date of birth, etc.) entered on the menu screen 710 or the like and the finger vein data obtained from the electronic pen 100 together with the registration request. The data is transmitted to the data acquisition function unit 303 of the management server 300 (S708).

  In this case, the data acquisition function unit 303 of the management server 300 receives the registration request including the personal information and finger vein data (S709), and passes it to the personal information management function unit 310. The personal information management function unit 310 sends a personal information search request to the data processing unit 415 of the DB server 400 to check whether finger vein data and personal information obtained from the electronic pen 100 have already been registered. A search using the finger vein data in the vein data DB 403 as a key is executed (S710).

  The data processing unit 415 of the DB server 400 executes search processing in response to the search request, and transmits the search result to the data acquisition function unit 303 of the management server 300 (S711). As a result of the search, when the finger vein data identical to the finger vein data obtained from the electronic pen 100 can be searched by the DB server 400 (S712: YES), the management server 300 notifies the processing terminal 200 to that effect. At this time, the screen display function 204 of the processing terminal 200 receives the notification, displays a message indicating that finger vein data has been registered on the display 205 (S713), and completes this flow. On the other hand, when the finger vein data identical to the finger vein data obtained from the electronic pen 100 cannot be retrieved by the DB server 400 as a result of the search (S712: No), the personal information management function unit 310 of the management server 300 Assigns a user ID for the corresponding finger vein data and personal information (S715), and sends a registration request for the finger vein data and personal information to the DB server 400 (S715).

  On the other hand, the data processing unit 415 of the DB server 400 stores the user ID assigned by the management server 300 in the user ID 1001 of the user information DB 402 and the user ID 2001 of the vein data DB 403, respectively, in step S704. The name of the obtained writer is stored in the name 1002 of the user information DB 402 and in the name 2002 of the vein data DB 403. Similarly, the date of birth of the writer is entered in the date 1003 of the user information DB 402, the address of the writer in the address 1004, and the identification information (license number, etc.) of the writer. In the number 1005, the writer's identification certificate type is stored in the identification certificate type 1006. The finger vein data read three times with the electronic pen 100 in step S706 is set in each item of the first image 2003, the second image 2004, and the third image 2005 of the vein data DB 403.

  In this way, the data processing unit 415 updates the user information DB 402 and the vein data DB 403 (S716, S717). In addition, the data processing unit 415 transmits the update results in the steps S716 and S717 to the data acquisition function unit 303 of the management server 300. On the other hand, the data acquisition function unit 303 of the management server 300 receives the registration result from the DB server 400 (S718), and this flow is completed.

  The said writer determination system 1 of this embodiment is good also as the following structures. That is, the writing time notifying unit of the electronic pen detects that there is no acquisition of new writing coordinates for a certain period of time, detects that there is no storage of new writing data in the storage unit for a certain period of time, and the writing pressure provided for the electronic pen. Sending the completion notification of the writing coordinate acquisition to the information processing apparatus triggered by either the detection that the measured writing pressure at the sensor has decreased to the reference value or the reception of the instruction to end the writing at a predetermined interface provided in the electronic pen It is good also as.

  In addition, the result display unit of the information processing device receives the personality confirmation request of the writer at the input unit provided in the information processing device, and stores the written data group and the living body stored in the storage unit. Reading the information data group, collating each biological information included in the biological information data group with the biological information in the storage unit, and executing an authentication process on the biological information at the writing coordinates at each acquisition time obtained for the writer Then, a handwritten image is generated from the handwritten coordinate group included in the handwritten data group, the handwritten coordinate at each acquisition time is compared with the handwritten coordinate group, and the handwritten coordinate at each acquisition time in the handwritten image. The display data indicating the result of the authentication processing of the biometric information corresponding to the handwritten coordinates at the corresponding acquisition time is arranged at each position in the handwriting image specified here, and the display data Displayed on the output unit arranged handwriting image may be.

As described above, according to the present embodiment, it is possible to perform authentication of a writer not only at the start of writing or after the end of writing, but also at the timing during writing by the writer. Moreover, it is possible to display not only the written contents such as the handwriting entered with the electronic pen but also the authentication timing in the handwriting and the authentication result. Therefore, if such a display is performed during writing, the result of personal authentication can be confirmed on the spot during writing, and the authenticity of the writer, prevention of falsification of written content, impersonation of the writer, and the like can be prevented. Furthermore, by storing the data such as the handwriting and the authentication result, it is possible to realize the writer confirmation regarding the handwriting even after the completion of the writing.
That is, it is possible to confirm the identity of the writer even during writing and after writing.

  As mentioned above, although embodiment of this invention was described concretely based on the embodiment, it is not limited to this and can be variously changed in the range which does not deviate from the summary.

DESCRIPTION OF SYMBOLS 1 Writer determination system 5 Electronic pen corresponding | compatible paper 10 Data acquisition instruction | indication part 20 Result display part 30 WAN line 31 Cable 35 LAN
50 Information processing device (processing terminal + management server + DB server)
100 Electronic pen 105 Clock function 110 Battery 111 Vibrator 112 LED indicator 113 Pressure sensor 114 Optical unit 115 Imaging unit (for vein authentication)
116 Light source (for vein authentication)
117 Movable switch unit 118 Switch 119 Glass plate 120 Imaging unit (for writing information)
121 Light source (for writing information)
122, 222, 322, 422 Memory 123, 223, 323, 423 CPU
124, 224, 324, 424 Storage unit 125 Communication unit 126 Power supply device 127 Writing coordinate 128 Writing tool 129 Data acquisition management unit 130 Writing reading unit 131 Writing time notification unit 132 Acquisition completion notification unit 133 Data transmission unit 140, 225, 325, 425 Program 200 Processing terminal 201 First communication unit 202 Data request function unit 203 Data acquisition function unit 204 Data transmission function unit 205 Display device (output unit)
206 Keyboard / mouse device (input unit)
207 Second communication unit 300 Management server 301 HTTP server 302 Data request function unit 303 Data acquisition function unit 304 Data conversion function unit 305 Data DB function unit 306 Biometric information authentication function unit 307 Login processing unit 308 Display (output unit)
309 Keyboard / Mouse (Input section)
310 Personal Information Management Function Unit 311 Communication Unit 400 DB Server 401 Communication Unit 402 User Information DB
403 Vein data DB
405 Coordinate and vein data registration DB
406 Vein data discrimination information DB
407 ID card DB
408 Application DB
409 Login information DB
410 Coordinate data acquisition information DB
411 vein data acquisition information DB
413 Display 414 Mouse / keyboard 415 Data processing unit

Claims (6)

A computer system in which an electronic pen and an information processing apparatus that holds biological information of the electronic pen user in advance in a storage unit are connected to be communicable,
The electronic pen is
A biological information sensor provided at a place where the writer holds the hand,
The writing content by the writer on the predetermined paper is read by the optical device to acquire the writing coordinates, and the writing reading unit that stores the writing data including the writing coordinates and the acquisition time of the writing coordinates in the storage unit;
A writing time for transmitting a writing coordinate acquisition start notification to the information processing device in response to the start of acquisition of the writing coordinates, and a writing coordinate acquiring end notification to the information processing device in response to the end of acquisition of the writing coordinates. A notification unit;
When the biometric information acquisition request is received from the information processing device after the start notification is transmitted, the biometric information acquisition of the biometric part of the writer at the grip location by the biometric information sensor and the biometric information The acquisition of the handwritten coordinates from the optical device at the time of acquisition is performed, and the biological information including the biological information, the written coordinates associated with the biological information, and the acquisition time of the biological information is stored in the storage unit, and the biological information An acquisition completion notification unit that returns an acquisition completion notification to the information processing device;
A data transmission unit that reads out the writing data group and the biological information data group related to the writer from the storage unit and transmits them to the information processing device;
The information processing apparatus is
When receiving a start notification of writing coordinate acquisition from the electronic pen, transmitting a biometric information acquisition request to the electronic pen, and receiving a biometric information acquisition completion notification returned from the electronic pen in response to the acquisition request; A data acquisition instruction unit that repeatedly executes at predetermined intervals until receiving an end notification of writing coordinate acquisition from the electronic pen,
The writing data group and the biological information data group transmitted from the electronic pen are received and stored in a storage unit, and each biological information included in the biological information data group is collated with the biological information in the storage unit, Execute authentication processing related to biometric information at the writing coordinates at each acquisition time obtained for the writer, generate a handwriting image from the writing coordinates group included in the writing data group, and write coordinates and the writing coordinates at each acquisition time The position of the handwritten coordinates at each acquisition time in the handwriting image by collating with a group, and the living body corresponding to the handwriting coordinates at the corresponding acquisition time at each position in the handwritten image specified here Arranging display data indicating the result of the authentication processing of information, and a result display unit for displaying a handwriting image in which the display data is arranged on an output unit,
The writer determination system characterized by this. The writing time notifying part of the electronic pen is
Detection that there is no acquisition of new writing coordinates for a certain period of time, detection that there is no storage of new writing data in the storage unit for a certain period of time, and measurement pen pressure with the pen pressure sensor provided in the electronic pen is reduced to a reference value Sending the end notification of the writing coordinate acquisition to the information processing device triggered by either the detection of the fact that it has been done, or the acceptance of the instruction to end the writing at a predetermined interface provided in the electronic pen,
The writer determination system according to claim 1. The result display unit of the information processing apparatus
When the input unit provided in the information processing apparatus accepts a writer's identity confirmation request, the writing data group and the biological information data group stored in the storage unit are read out, and the biological information data group The biometric information included in the storage unit is collated with the biometric information in the storage unit, the authentication process related to the biometric information at the writing coordinates at each acquisition time obtained for the writer is executed, and the writing coordinate group includes the writing coordinate group. Generate a handwritten image, collate the handwritten coordinates at each acquisition time with the handwritten coordinate group, specify the position of the handwritten coordinates at each acquisition time in the handwritten image, and specify the handwriting specified here Display data indicating the result of the authentication processing of the biometric information corresponding to the handwritten coordinates at the corresponding acquisition time is arranged at each position in the image, and the handwriting image on which the display data is arranged is displayed on the output unit.
The writer determination system according to claim 1 or 2. An electronic pen that is equipped with a biological information sensor at a location held by a writer and can communicate with an information processing device,
A process of acquiring writing coordinates by reading the writing content by the writer on a predetermined sheet with an optical device, and storing writing data including the writing coordinates and the acquisition time of the writing coordinates in a storage unit;
In response to the start of the acquisition of the writing coordinates, a start notification of the acquisition of the writing coordinates is transmitted to the information processing apparatus, and in response to the end of the acquisition of the writing coordinates, a process of transmitting an end notification of the acquisition of the writing coordinates to the information processing apparatus;
When the biometric information acquisition request is received from the information processing device after the start notification is transmitted, the biometric information acquisition of the biometric part of the writer at the grip location by the biometric information sensor and the biometric information The acquisition of the handwritten coordinates from the optical device at the time of acquisition is performed, and the biological information including the biological information, the written coordinates associated with the biological information, and the acquisition time of the biological information is stored in the storage unit, and the biological information Processing to return an acquisition completion notification to the information processing device;
Executing a process of reading a writing data group and a biological information data group related to the writer from the storage unit and transmitting them to the information processing device;
An information processing apparatus that holds biological information of an electronic pen user in a storage unit in advance,
When receiving a start notification of writing coordinate acquisition from the electronic pen, transmitting a biometric information acquisition request to the electronic pen, and receiving a biometric information acquisition completion notification returned from the electronic pen in response to the acquisition request; Is repeatedly executed at a predetermined interval until a notification of completion of writing coordinate acquisition is received from the electronic pen,
The writing data group and the biological information data group transmitted from the electronic pen are received and stored in a storage unit, and each biological information included in the biological information data group is collated with the biological information in the storage unit, Execute authentication processing related to biometric information at the writing coordinates at each acquisition time obtained for the writer, generate a handwriting image from the writing coordinates group included in the writing data group, and write coordinates and the writing coordinates at each acquisition time The position of the handwritten coordinates at each acquisition time in the handwriting image by collating with a group, and the living body corresponding to the handwriting coordinates at the corresponding acquisition time at each position in the handwritten image specified here Arranging display data indicating the result of the authentication process of information, and executing a process of displaying a handwriting image in which the display data is arranged on the output unit;
The writer determination method characterized by this. An optical device that reads the content on the electronic pen compatible paper,
A communication interface for communicating with other devices;
A biological information sensor provided at a place where the writer holds the hand,
The writing content by the writer on the predetermined paper is read by the optical device to acquire the writing coordinates, and the writing reading unit that stores the writing data including the writing coordinates and the acquisition time of the writing coordinates in the storage unit;
A writing time for transmitting a writing coordinate acquisition start notification to the information processing device in response to the start of acquisition of the writing coordinates, and a writing coordinate acquiring end notification to the information processing device in response to the end of acquisition of the writing coordinates. A notification unit;
When the biometric information acquisition request is received from the information processing device after the start notification is transmitted, the biometric information acquisition of the biometric part of the writer at the grip location by the biometric information sensor and the biometric information The acquisition of the handwritten coordinates from the optical device at the time of acquisition is performed, and the biological information including the biological information, the written coordinates associated with the biological information, and the acquisition time of the biological information is stored in the storage unit, and the biological information An acquisition completion notification unit that returns an acquisition completion notification to the information processing device;
A data transmission unit that reads out the writing data group and the biological information data group related to the writer from the storage unit and transmits them to the information processing device;
An electronic pen comprising: A storage unit for storing biometric information of the electronic pen user in advance;
A communication unit for communicating with other devices;
When receiving a start notification of writing coordinate acquisition from the electronic pen, transmitting a biometric information acquisition request to the electronic pen, and receiving a biometric information acquisition completion notification returned from the electronic pen in response to the acquisition request; A data acquisition instruction unit that repeatedly executes at predetermined intervals until receiving an end notification of writing coordinate acquisition from the electronic pen,
The writing data group and the biological information data group transmitted from the electronic pen are received and stored in a storage unit, and each biological information included in the biological information data group is collated with the biological information in the storage unit, Execute authentication processing related to biometric information at the writing coordinates at each acquisition time obtained for the writer, generate a handwriting image from the writing coordinates group included in the writing data group, and write coordinates and the writing coordinates at each acquisition time The position of the handwritten coordinates at each acquisition time in the handwriting image by collating with a group, and the living body corresponding to the handwriting coordinates at the corresponding acquisition time at each position in the handwritten image specified here A result display unit that arranges display data indicating a result of the authentication processing of information, and displays a handwriting image in which the display data is arranged on the output unit;
An information processing apparatus comprising: