TW202319939A - Biometrics willingness signature generating device, system and the method for electronics document - Google Patents

Abstract

It is to provide a biometrics willingness signature generating device comprising a display unit, a face recognition unit and a document processing unit. The display unit shows a signature block and a confirm button. The signature block generates a signature data based on a handwriting input from user operations. When the confirm button is operated, the face recognition unit captures a real-time image and compares it with a registration database. If the comparison result is positive, the face recognition unit records a face picture according to the real-time image, so that the document processing unit is able to produce a signature with a facial picture, and apply such signature into a documentation. The provided device is able to improve the reliability of the electronic signature document for the party's signature and to solve the doubt of misusing other's signatures without consent.

Description

Electronic document automatic signature device, system and method integrating biometric information

A signature device, system and method thereof, especially an electronic document automatic signature device, system and method integrating biometric information.

Due to the advancement of science and technology, many industries have successively carried out paperless operation procedures. In the past, in paper-based procedures, both parties could sign on paper, but with the prevalence of paperless, electronic signatures are getting more and more attention. However, the electronic signature has the problem of being copied. The electronic signature can be copied on the electronic document by copying and pasting. Although it is simple, it is really doubtful whether it is signed by the person himself.

In view of the above problems, the present invention provides an electronic document automatic signature device integrating biometric information, including a confirmation button, a display unit, a facial recognition unit and a document processing unit. The display unit displays the signature block, and the signature block generates signature data according to the user's handwriting. The facial recognition unit captures a real-time image when the confirmation button is operated, compares the real-time image with the identity registration data, and extracts the facial area image from the real-time image when the comparison matches. The document processing unit is connected to the display unit and the facial recognition unit, combines the signature data and the facial area image to generate a face signature file, and writes the face signature file into the document file to generate a signed document file.

In addition, the present invention also provides an electronic document automatic signature system integrating biometric information, including a transmission unit for receiving document files and the aforementioned electronic document automatic signature device, which writes a face signature file into the document file to generate a signed document file.

In addition, the present invention also provides an electronic document automatic signature method integrating biometric information, including:

Display the signature block and confirm button;

Generate signature data according to the user's handwriting in the signature block;

Capture real-time images when confirming button operations;

Compare the real-time image with the identity registration information, and extract the face area image from the real-time image when the comparison matches;

Combining the signature data with the face region image to generate a face signature file; and

Write the face signature file into the document file to generate a signed document file.

The electronic document automatic signature device, system and method for integrating biometric information provided by the present invention verify the real-time image of the signature through face recognition, and then load the signature file containing the face image into the electronic document to enhance electronic signature The document is the reliability and authenticity of the signature of the party, and it can solve the doubts about the signature of the copied copy. Furthermore, face recognition can also be combined with multiple biometric verification methods, and the face signature files generated through this multi-factor authentication method can record more user characteristics, enhancing the reliability and authenticity of the signed document. At the same time, because through real-time identity verification, it can further provide a convenient way to automatically load signatures on documents by swiping your face, which solves the inconvenience of multiple signatures required for multi-page signatures.

Specific embodiments are listed below to describe the content of the present invention in detail, and drawings are used as auxiliary descriptions. The symbols mentioned in the manual refer to the symbol description.

In addition, the connection between units or modules referred to below refers to data transmission, which can be one-way data transmission or two-way data transmission, and data transmission can be, for example, the reception or sending of messages or images , receiving or issuing instructions, etc., are not limited to the foregoing.

The data transmission mentioned above may include the use of direct electrical connection, or the use of communication protocols (Low Power Wide Area, LoRa), Bluetooth (Bluetooth), WiFi, ZigBee and other wireless communication technologies, or the use of fixed network, Coaxial cable or ADSL (Asymmetric Digital Subscriber Loop), or mobile network (3G, 4G, 5G mobile Internet) and other Internet methods for information transmission, but the above-mentioned communication methods are just examples and not limited to this.

Please refer to FIG. 1 , an electronic document automatic signature device 10 integrating biometric information of the present invention includes a display unit 11 , a confirmation button 112 , a facial recognition unit 12 and a document processing unit 13 .

The display unit 11 displays a signature block 111. The signature block 111 can generate signature data according to the user's handwriting, wherein the display unit 11 can be a touch screen for the user to use a finger or a stylus for handwriting, or the display unit The signature block 111 of 11 can display a handwritten image by a handwriting input device (such as a tablet) to generate signature data.

The confirmation button 112 can be a physical button or a virtual button. The following will take the confirmation button 112 being a virtual button as an example for illustration, but it is not limited thereto. In some implementations, the display unit 11 displays the signature block 111 and the confirmation button 112. Therefore, the area displayed by the display unit 11 can be divided into at least two, one area can display the signature block 111, and the other area can display the signature block 111. The confirmation button 112, in some implementations, the area displayed by the display unit 11 may include other display areas to display other information.

The manner in which the confirmation button 112 is operated can be, but not limited to, the user directly clicks the confirmation button 112 on the touch screen (display unit 11 ), or presses a specific input key indirectly according to the instruction displayed on the display unit 11. The confirm button 112 is operated.

Please refer to FIG. 1 and FIG. 2 together. The face recognition unit 12 captures the real-time image when the confirmation button 112 is operated, and compares the real-time image with the identity registration data. Image capture extracts facial area images. Therefore, the captured image of the facial region is an image after identity verification, and can record the image of the moment when the user presses the confirmation button 112 . In addition, the face region image is a part of the real-time image clipped and edited, for example, only the face region above the neck is captured. Here, the face area image is an edited partial real-time image, and its clipping range and editing method can be adjusted according to actual needs. In other words, the facial area image is a part of the real-time image after image processing, and is not exactly the same as the real-time image.

The aforementioned identity registration information is the identity information pre-registered in the cloud server, the computer host database of the agreed company, or the personal device with the electronic document automatic signature device 10 integrating biometric information, which includes name, facial features, Voiceprint features, fingerprint features, vein pattern features, etc., but not limited to the aforementioned. Therefore, the pre-registered identity registration data can be used as the basis for the procedure of comparing the real-time image with the identity registration data.

The electronic document automatic signature device 10 integrating biometric information can be applied to electronic devices such as smart phones, tablet computers, notebook computers, smart watches, and personal computers.

The display unit 11 may be, but not limited to, a display screen, a display, a display panel, a touch screen, and the like.

The face recognition unit 12 has an image capture device and a face recognition function. For example, it can be a built-in lens or an external camera of the electronic document automatic signature device 10 integrating biometric information. limit.

The document processing unit 13 is connected to the display unit 11 and the face recognition unit 12, combines the signature data and the facial area image to generate a face signature file, and writes the face signature file into the document file to generate a signed document file. In other words, the file processing unit 13 can receive the signature data generated by the display unit 11 and the facial region image generated by the face recognition unit 12 , and combine the signature data and the facial region image to generate a face signature file. Therefore, when the user executes the electronic signature, he can perform facial recognition at the same time or in advance to verify the identity of the signer, and the signature file written into the file will contain the verified face image, and because each signature is generated The facial area image will be different, and each face signature file will also be different, so that the signed document is more authentic and reliable, and it is easier to identify whether it is signed by this time, instead of simply loading or copying the existing signature files.

For example, a user can use a smart phone with an electronic document automatic signature device 10 integrating biometric information to open a document file that needs to be signed (such as a PDF file, a WORD file of an insurance policy, or a PDF file, a WORD file of a contract, etc.), The display unit 11 will display a signature block 111 and a confirmation button 112. When the user completes the signature and clicks the confirmation button 112, the face recognition unit 12 will perform face recognition to determine the identity of the user. When the face recognition unit 12 judges that the identity matches the registered identity, the document processing unit 13 will make a face signature file accordingly and write the face signature file into the document file to become a signed document file. Therefore, the signature of the signed document file is not only authenticated, but also records the current image of the signed document to increase the authenticity of the signature. Furthermore, the user's personal information (such as signature data, facial area images, etc.) is stored in the user's personal device, and does not need to be transmitted to other people's device hosts or cloud devices, which also increases the security of personal information.

In some implementations, the electronic document automatic signature device 10 integrating biometric information can also be applied to a remote insurance application system, for example, an insurance company sends an insurance policy document to a client with an electronic document automatic signature device 10 integrating biometric information The electronic device confirms the signature, and the facial recognition unit 12 can capture the customer's identity registration data stored in the insurance company's database in advance for facial feature comparison, and only write the face signature file into the document file when the identity comparison matches. .

In some implementations, the file processing unit 13 includes a hash data module 18 to generate complex hash data. The file processing unit 13 adds a hash data to the signature data and the face area image respectively, or adds a hash data to the signature data and the face area image and biometric images respectively add a hash data. In this way, a set of hash numbers (that is, hash data) can be given to each image (such as signature data, real-time images, facial area images, and biometric images) contained in the face signature file, such as generated by a hash algorithm. The strength is at least 8 or more hexadecimal hash numbers (Hashcode).

Please refer to Figure 2. For example, when matching facial features, the image of the facial area captured by the hash algorithm will obtain a hash number of "12345678", and the signature data will also obtain a hash number of "87654321" through the hash algorithm. , the face signature file made by the file processing unit 13 based on the facial area image and signature data will also contain the aforementioned two sets of hash numbers, which are used to indicate that the image source of the face signature file is from the face corresponding to the hash number "12345678". The image of the local area and the signature data corresponding to the hash number "87654321" can ensure that the source of the face signature file and the included image are not tampered with and verified. For example, in the future, if a third-party unit wants to verify whether the face signature file on this signed document is authentic, it can use the hash number contained in the face signature file to compare the identity verification image record of the user's signature process, and the comparison is consistent, that is The source of the face signature file can be verified.

In addition, in some implementations, the signature data can be converted into digital data by the hash data module 18, encrypted and then converted into a hash data corresponding to the signature data; and the face area image can be converted into another set The digital data is encrypted and converted into a hash data corresponding to the image of the face area. That is to say, the hash data module 18 of the file processing unit 13 can convert the image data into digital data of a certain length by mathematical algorithm or other methods, and encrypt it with the private key of the signer to form an encrypted digital data, and then The encrypted digital data is then converted into a hash number with at least 8 or 10 digits by a hash algorithm. In the future, when it is necessary to verify the authenticity of the face signature file, the hash number can be restored to encrypted digital data through a hash algorithm, and the encrypted digital data can be verified using the public key. In this way, the information security of the face signature file is increased.

In some implementations, please refer to FIG. 1 and FIG. 3 , the electronic document automatic signature device 10 integrating biometric information can further be provided with a biometric feature extraction unit 14, connected to the document processing unit 13, and operated on the confirmation button 112 When the biometric data is retrieved, the biometric data is compared with the identity registration data. When the comparison matches, the biometric extraction unit 14 generates a biometric image according to the biometric data, and the document processing unit 13 combines the signature data, the biometric image and The face area image generates a face signature file. In other words, in addition to receiving the signature data generated by the display unit 11 and the facial area image generated by the face recognition unit 12, the document processing unit 13 can also receive the biometric image generated by the biometric feature capture unit 14, and The signature data, facial area images and biometric images are combined to generate a face signature file. Here, the biometric data may include fingerprint features, voiceprint features, iris features, finger vein features, etc., but not limited thereto. Therefore, users need to go through multiple biometric verifications (such as multi-factor authentication methods such as face and fingerprint, face and iris, face and fingerprint, and finger veins), and only after more accurate verification of identity will they be listed on the file. Load the face signature file.

For example, as shown in Figure 3, the signature data and the facial area image and fingerprint image (biometric image) captured at the moment of the signature are made into a face signature file and written into the file file, thereby recording the signature at the same time The currently compared identity data can record multiple biometric characteristics of the user signing the document to strengthen the authenticity of the signed document. In addition, the images contained in the face signature file (face area image, signature data and biometric image) can also generate a set of hash numbers for verification through the hash data module 18 . Furthermore, the hash data module 18 can also convert each image (face area image, signature data and biometric image) contained in the face signature file into a set of digital data respectively, and each set of digital data is encrypted separately. , and finally convert each set of encrypted digital data into corresponding hash data. The process is as described above, and will not be repeated here.

In addition, in some implementations, the biometric feature capture unit 14 may have the function of the operation confirmation button 112 . For example, when the user presses the fingerprint on the fingerprint input device (biometric feature capture unit 14), the pressing action also operates the confirmation button 112, so that the face recognition unit 12 captures a real-time image and the biometric feature capture unit 14 Capturing biometric data can be performed simultaneously.

Further, in some implementations, please refer to FIG. 1 and FIG. 3 again, the file processing unit 13 may further be provided with an appended data module 16 to generate appended data. In the process of document processing unit 13 making the face signature file, add additional note data through the note data module 16, file processing unit 13 combines signature data, facial area image and additional note data to generate face signature file or combines signature data, biological The feature image, facial area image and annotation data generate a face signature file. In other words, in addition to signature data, facial area images, biometric images, hash data, etc., the face signature file can also add annotation data. Here, the appended information can be, for example, the time of signing, telephone number, etc., as shown in Figure 3, "Signatory: Wang O Ming", "Date of Signature" and "Telephone" and other descriptions, so as to determine the date of signing, and together Leave a contact number for follow-up contact or confirmation. Here, the appended data are signing time, phone number, etc., for example only, and the user can set the content of the appended data according to their needs.

In addition, in some implementations, the document processing unit 13 may encrypt the signed document file according to predetermined conditions to restrict access to the signed document file. Here, the predetermined conditions may include but not limited to conditions such as restricting printing (cannot print or enter a password to print), restrict copying (cannot copy or enter a password to copy), read passwords, etc., to restrict access to signed documents File access authority, improve the confidentiality or confidentiality of files. In addition, the content on the signed document cannot be tampered with and the signature cannot be copied and stolen by others, so as to ensure the rights and interests of users.

In some implementations, please refer back to Figure 1, the file processing unit 13 also includes a storage module 15, which stores identity registration data, face signature files, file files and signed file files, and no signature data is generated in the signature block 111 , and when the face recognition unit 12 compares the real-time image with the identity registration data, the file processing unit 13 writes the face signature file stored in the storage module 15 into the file file. In other words, the electronic document automatic signature device 10 integrating biometric information can pre-store the user's face signature file and identity registration data for identity verification, and then the user only needs to press the confirmation button 112 and pass identity verification (single-factor face recognition Identity verification, or multi-factor authentication using face recognition combined with biometric identification), the face signature file corresponding to identity verification can be written into the document, especially for documents that require multiple pages of continuous signatures (such as insurance documents) Sign, providing a more convenient way to sign.

In some implementations, as shown in FIG. 1, the file processing unit 13 can further be provided with an editing module 17. When the display unit 11 displays the face signature file, the display unit 11 generates an editing instruction according to the user operation, and the editing The module 17 adjusts the relative position of the signature data and the face area image according to the editing command to regenerate the face signature file. Therefore, when the document is loaded into the face signature file, the user can also adjust the relative position of the image in the face signature file (such as the signature data and the face image) according to the size of the signature form of the document, such as the face image Located at the upper right or upper left of the signature, or move the face image to the lower right or lower left of the signature.

Further, in some implementations, the editing module 17 can regenerate the facial region image by adjusting the image parameters of the facial region image according to the editing command input by the user. The aforementioned editing command may be to adjust the image clarity of the facial area image, or to make the image transparent, or to apply a filter to add special effects, etc.

In addition, in some implementations, the electronic document automatic signature device 10 integrating biometric information also includes a recording unit (not shown in the figure) to record the digital traces of the user's execution of the signature process, and generate trace detailed data based on these digital traces. To the file processing unit 13, the file processing unit 13 combines the trajectory detailed data to generate a face signature file. The digital trace can be, but not limited to, the operation process of generating the face signature file, and the editing record of the real-time image of the user executing the signature, etc. The recording unit is connected to the facial recognition unit 12 , the file processing unit 13 and the biometric feature extraction unit 14 . In this way, the signed document file generated by the electronic document automatic signature device 10 integrating biometric information has a complete digital track record, so that the source of the signature can be traced and its authenticity verified through the digital track in the future.

In addition, please refer to FIG. 4 , which is an electronic document automatic signature system 1 integrating biometric information according to the present invention. The electronic document automatic signature system 1 integrating biometric information can be mainly composed of an electronic document automatic signature device 10 integrating biometric information and a transmission unit 20, wherein the transmission unit 20 receives the document file, and automatically signs the electronic document through the integrated biometric information The device 10 creates a face signature file and writes it into a document file to generate a signed document file. The creation and writing of the face signature file is the same as the above-mentioned content, and will not be repeated here. Here, the electronic document automatic signature system 1 integrating biometric information may be, but not limited to, electronic devices such as smart phones, tablet computers, notebook computers, smart watches, and personal computers.

For example, the host computer that provides the document file can send an authorization code or electronic certificate to the user's mobile phone (electronic document automatic signature system 1 integrating biometric information), and when the user finishes signing the document on the mobile phone, the document is provided The host of the file can confirm that the received signed document has been authenticated through the authorization code or electronic certificate, and also ensure that the user's personal information, such as the signature file, facial features, and biometrics, are stored in the user's personal device. Such personal information will not be leaked to other units to increase the security of personal information.

In some implementations, where the transmission unit 20 receives the real-time image of the witness, the file processing unit 13 combines the signature data, the real-time image of the witness and the facial area image to generate a face signature file, or combines the signature data, the real-time image of the witness, The biometric image and the facial area image generate a face signature file, and write the face signature file into a document file to generate a signed document file.

The real-time image of the witness may be the current image of the person who witnesses the user executing the electronic signature. For example, please refer to Figure 5. When the user signs the electronic document through the electronic document automatic signature device 10 integrating biometric information, and at the same time uses the application program to make real-time video chat with the witness online, the witness can use the terminal used The content displayed on the screen of the device witnesses the process of the user executing the electronic signature. Therefore, when the user clicks the confirmation button 112, the electronic document automatic signature device 10 integrating biometric information will not only capture the real-time image of the user, but also receive To the live images of the witnesses captured by the terminal devices used by the witnesses for synchronous connection. In this way, the document processing unit 13 can generate a face signature file with the real-time image of the witness, and generate a signed document file accordingly. In this way, the generated face signature file also records the image data of the current witness, which strengthens the authenticity and reliability of the signed face signature file.

In addition, please refer to FIG. 6 , a method for automatically signing electronic documents integrating biometric information includes the following steps S100-S105.

Step S100 : Display the signature block 111 and the confirmation button 112 .

The area displayed by the display unit 11 can be divided into at least two areas, one area can display the signature block 111 , and the other area can display the confirmation button 112 . In some implementations, the area displayed by the display unit 11 may include other display areas for displaying other information.

Step S101 : Generate signature data according to the user's handwriting in the signature block 111 .

The signature block 111 can generate signature data according to the user's handwriting, wherein the display unit 11 can be a touch screen for the user to write with a finger or a stylus, or the signature block 111 of the display unit 11 can display handwriting Signature data is generated by inputting a screen handwritten by a device (such as a handwriting tablet).

Step S102: Capture a real-time image when the confirmation button 112 is operated.

When the confirmation button 112 is operated (for example, pressed, clicked), a real-time image can be captured through the face recognition unit 12 . The manner in which the confirmation button 112 is operated can be, but not limited to, the user directly clicks the confirmation button 112 on the touch screen (display unit 11 ), or presses a specific input key indirectly according to the instruction displayed on the display unit 11. To operate the confirmation button 112 , for example, press a physical confirmation button 112 , or press the biometric feature capture unit 14 to capture a fingerprint while also operating the confirmation button 112 .

Step S103: Compare the real-time image with the identity registration data, and extract the face region image from the real-time image when the comparison is matched.

Among them, the pre-registered identity registration data is the basis for the process of comparing the real-time image with the identity registration data, and the identity registration data includes, for example, name, facial features, voiceprint features, fingerprint features, finger vein pattern features and other identity information, but Not limited to the foregoing.

The face recognition unit 12 can compare the captured real-time image with the pre-registered identity registration data, and when the comparison is matched, the face recognition unit 12 can extract the facial area image from the real-time image. Wherein, the facial area image is a partial image cut out and edited from the real-time image, which is as described above and will not be repeated here.

For example, when a user uses a mobile phone to execute an electronic signature, he first presses the confirmation button 112, and then the mobile phone starts image shooting, and compares whether the real-time image matches the pre-stored identity registration information. According to the identity of the person, the image of the face area is captured. If the verification is inconsistent, the display unit 11 can display a warning that the verification is inconsistent.

Step S104: Combining the signature data and the facial area image to generate a face signature file.

The file processing unit 13 can receive the signature data generated by the display unit 11 and the face region image generated by the face recognition unit 12, and combine the signature data and the face region image to generate a face signature file.

Step S105: Write the face signature file into the document file to generate a signed document file.

The document processing unit 13 will create a face signature file and write the face signature file into the document file to become a signed document file. Therefore, the signature of the signed document file is not only authenticated, but also records the current image of the signed document to increase the authenticity of the signature.

Further, in some implementation aspects, the method for automatic signature of electronic documents further includes steps S1042 and S1043 after the step S101 of generating signature data.

Step S1042: Add hash data to the signature data.

In addition, in some implementation aspects, the step S1042 may include converting the signature data into a digital data, encrypting it and converting it into a hash data corresponding to the signature data.

And after the step S103 of extracting the face area image, step S1043 is further included.

Step S1043: Add another hash data to the face area image.

For example, please refer to Figure 5, each image (signature data and face area image) contained in the face signature file generates a hash number, and the hash number is a combination of hexadecimal numbers with more than 8 digits. That is to say, the signature image and the face area image are hashed by the hash algorithm to generate a hash number with a strength of at least 8 bits or more in hexadecimal (please refer to Figure 2 as well), and when the face signature file is generated, it is also The hash number calculated by each image is displayed or recorded in the face signature file. In this way, the face signature file generated by the face area image with hash data and the signature data with hash data can be used to trace the source of the image to confirm its authenticity when verifying the authenticity of the signature in the future.

In addition, in some implementation aspects, step S1043 includes converting the face region image into digital data, encrypting it and converting it into a hash data corresponding to the face region image.

In some implementations, please refer to FIG. 7 , wherein after the step S102 of capturing the real-time image when the confirmation button 112 is operated, step S1044 is included, and after the step S103 of comparing the real-time image with the identity registration data, the step is included S1045. In this way, the current image of the witness who witnessed the user's signature is also recorded in the generated face signature file.

Step S1044: Receive the instant video of the witness.

The transmission unit 20 of the electronic document automatic signature system 1 integrating biometric information can receive a real-time image of a witness captured from a terminal device. image. Please refer to the preceding paragraphs for relevant instructions, and will not repeat them here.

Step S1045: Combining the signature data, the real-time image of the witness and the facial area image to generate a face signature file. In this embodiment, step S104 is replaced by step S1045, and the face signature in the signed document file generated in step S105 immediately includes the real-time image of the witness.

In addition, in some implementations, after the step S1044 of receiving the real-time image of the witness, it may include the step of adding another set of hash data to the real-time image of the witness (not shown in the figure), and the step of adding hash data to the signature data S1042, and step S1043 of adding another set of hash data to the face area image. In this way, all the images in the generated face signature file (signature data, witness real-time image and face area image) each have a set of hash data added, and the face signature file can be traced through the hash algorithm in the future. Image source to verify the authenticity of this face signature file.

In some implementations, the electronic document automatic signature method can further include the steps of biometric identification, which includes steps S201, S202, and S203, and these steps can be performed simultaneously with the face recognition in step S103, or can be performed on the face It is performed after (as shown in FIG. 8 ) or before step S103 of identification.

Step S201: Capture biometric data.

For example, the biometric feature capturing unit 14 can capture the biometric feature data when the confirmation button 112 is operated, and capture the biometric feature data when the step S102 occurs, or after the step S102.

Step S202: Compare the biometric data with the identity registration data, and generate a biometric image when the comparison matches.

The biometric feature capture unit 14 can compare the captured biometric feature data with the pre-registered identity registration data, and when the comparison matches, the biometric feature capture unit 14 generates a biometric feature image according to the biometric feature data.

Step S203: Combining the signature data, the biometric image and the facial area image to generate a face signature file.

In some implementations, step S104 can be replaced with step S203, which means that when only face recognition is performed in the single-factor identity recognition state, step S104 will be executed: combine the signature data and the face area image to generate a face signature file . When there is multi-factor identification for face recognition and biometric verification, step S203 will be executed: combining the signature data, the biometric image and the facial area image to generate a face signature file.

The file processing unit 13 can receive the biometric image generated by the biometric capturing unit 14, and combine the signature data, the facial area image and the biometric image to generate a face signature file.

In this way, users need to go through multiple biometric verifications, such as face recognition and fingerprint recognition at the same time, or face recognition, fingerprint recognition and finger vein pattern recognition at the same time. The face signature file will be loaded on the file.

Further, in some implementation aspects, after the step S202 of generating the biometric image, step S2031 is further included.

Step S2031: Add hash data to the biometric image.

In addition, in some implementation aspects, step S2031 includes: converting the biometric image into digital data, encrypting it and converting it into a hash data corresponding to the biometric image.

Here, the generation of the hash data is as described in the previous paragraph, and will not be repeated here.

As shown in FIG. 8 , the images contained in such a face signature file (signature data, face area image and biometric image) may each have a set of hash numbers for verification. That is to say, when the face signature file is generated, the hash number calculated by each image is also displayed or recorded in the face signature file at the same time.

In some implementation aspects, after the step of generating the face signature file (such as step S104 or S203), step S1041 is further included.

Step S1041: Add supplementary information to the face signature file.

In the process of making the face signature file by the document processing unit 13, the supplementary data is added through the supplementary data module 16, and the document processing unit 13 combines the signature data, facial area images and supplementary data to generate a face signature file or combines signature data and biometric features. The image, the facial area image, and the annotation data are added to generate a face signature file, which is as described above and will not be repeated here.

In some implementation aspects, the method for automatically signing electronic files may further include step S106.

Step S106: Encrypt the signed document file according to a predetermined condition to restrict access to the signed document file.

For example, as shown in FIG. 8 , the document processing unit 13 may encrypt the signed document file according to predetermined conditions to restrict access to the signed document file. Here, the predetermined conditions may include, but not limited to, restrictions on printing (cannot print or enter a password to print), limit copying (cannot copy or enter a password to copy), read passwords and other conditions, as mentioned above, I won't repeat it here.

In addition, in some implementations, please refer to FIG. 9 , the automatic signature method of electronic documents can be multi-factor biometric verification plus the real-time image of the witness, wherein after step S102, the step S1044 of receiving the real-time image of the witness is included , and steps S201, S202, and S204 of biometric identification, and step S204 is after step S202 of comparing the biometric data with the identity registration data.

Step S204: Combining the signature data, the real-time image of the witness, the biometric image and the facial area image to generate a face signature file. In this embodiment, step S203 is replaced by step S204, and the face signature in the signed document file generated in step S105 immediately includes the real-time image of the witness.

In addition, in some implementations, after the step S1044 of receiving the real-time image of the witness, it may further include the step of adding hash data to the real-time image of the witness, the step S1042 of adding hash data to the signature data, and the step of adding hash data to the face area image Step S1043 of adding another set of hash data, and step S2031 of adding hash data to the biometric image. In this way, all images (signature data, real-time images of witnesses, biometric images, and facial area images) in the face signature file can be traced back to the source of the image through a hash algorithm in the future to verify the authenticity of the signature file.

In addition, in some implementations, please refer to FIG. 10 , the method for automatically signing electronic documents may further include a step of automatically loading stored signature data, which is described as step S107 as follows.

Step S107: When the signature block 111 does not generate signature data and compare the real-time image with the identity registration data, write the generated face signature file into the document file.

When the signature block 111 does not generate the signature data and the face recognition unit 12 compares the real-time image with the identity registration data, the file processing unit 13 writes the stored face signature file into the file file, as mentioned above, I won't repeat it here.

In summary, the electronic document automatic signature device, system and method for integrating biometric information provided by the present invention are to verify the real-time image of the signature through facial recognition, and then load the signature file containing the face image into the electronic document. It is used to enhance the reliability and authenticity of electronically signed documents for the signature of the parties, and can solve the doubts about the signature of the stolen copy. Furthermore, face recognition can be combined with multiple biometric verification methods, and the face signature files generated by this multi-factor authentication method can record more user characteristics, strengthening the reliability and authenticity of the signed documents . At the same time, because through real-time identity verification, it can further provide a convenient way to automatically load signatures on documents by swiping your face, which solves the inconvenience of multiple signatures required for multi-page signatures.

Although the technical content of the present invention has been disclosed above with preferred embodiments, it is not intended to limit the present invention. Any modification and modification made by those skilled in the art without departing from the spirit of the present invention should be covered by the present invention. Therefore, the scope of protection of the present invention should be defined by the scope of the appended patent application.

1: Electronic document automatic signature system integrating biometric information 10: Electronic document automatic signature device integrating biometric information 11: Display unit 111: Signature block 112:Confirm button 12: Face recognition unit 13: File processing unit 14: Biometric feature extraction unit 15: Storage module 16: Note data module 17:Edit module 18: Hash data module 20: Transmission unit S100~S107, S1041~S1045, S201~S204, S2031: steps

[Fig. 1] is a block diagram of an electronic document automatic signature device integrating biometric information according to an embodiment of the present invention. [Fig. 2] It is a schematic diagram (1) of automatic signature of electronic documents integrating biometric information according to an embodiment of the present invention. [Fig. 3] It is a schematic diagram (2) of an electronic document automatic signature integrating biometric information according to an embodiment of the present invention. [Fig. 4] is a block diagram of an electronic document automatic signature system integrating biometric information according to an embodiment of the present invention. [Fig. 5] It is a schematic diagram (3) of an electronic document automatic signature integrating biometric information according to an embodiment of the present invention. [Fig. 6] is a flow chart (1) of an electronic document automatic signature method integrating biometric information according to an embodiment of the present invention. [Fig. 7] is a flow chart (2) of an electronic document automatic signature method integrating biometric information according to an embodiment of the present invention. [Fig. 8] is a flow chart (3) of an electronic document automatic signature method integrating biometric information according to an embodiment of the present invention. [Fig. 9] is a flowchart (4) of an electronic document automatic signature method integrating biometric information according to an embodiment of the present invention. [Fig. 10] is a flowchart (5) of an electronic document automatic signature method integrating biometric information according to an embodiment of the present invention.

10: Electronic document automatic signature device integrating biometric information

11: Display unit

111: Signature block

112:Confirm button

12: Face recognition unit

13: File processing unit

14: Biometric feature extraction unit

15: Storage module

16: Note data module

17:Edit module

18: Hash data module

Claims (22)

An electronic document automatic signature device integrating biometric information, comprising: a confirmation button; A display unit, displaying a signature block, the signature block generates a signature data according to the user's handwriting; A facial recognition unit, which captures a real-time image when the confirmation button is operated, compares the real-time image with an identity registration data, and extracts a facial area image from the real-time image when the comparison matches; and A file processing unit, connecting the display unit and the face recognition unit, combining the signature data and the facial area image to generate a face signature file, and writing the face signature file into a file file to generate a signed file file . The electronic document automatic signature device integrating biometric information as described in claim 1 further includes: A biometric feature extraction unit, connected to the document processing unit, captures a biometric feature data when the confirm button is operated, compares the biometric feature data with the identity registration data, and generates a biometric feature image when the comparison matches, The document processing unit combines the signature data, the biometric image and the facial area image to generate the face signature file. The electronic document automatic signature device integrating biometric information as described in claim 1 or 2, wherein the document processing unit includes a hash data module to generate complex hash data, and the document processing unit combines the signature data and the face area One of the hash data is added to the image, or one of the hash data is added to the signature data, the facial area image and the biometric image. The electronic document automatic signature device integrating biometric information as described in claim 3, wherein the hash data module converts the signature data into a digital data, encrypts it and converts it into a hash data corresponding to the signature data, The facial area image is converted into the digital data, encrypted and converted into a hash data corresponding to the facial area image, or the biological feature image is converted into the digital data, encrypted and converted into the corresponding biological feature One of the hash data for the image. The electronic document automatic signature device integrating biometric information as described in Claim 1, wherein the document processing unit encrypts the signed document file according to a predetermined condition and restricts access to the signed document file. The electronic document automatic signature device integrating biometric information as described in claim 1, wherein the document processing unit includes a storage module for storing the identity registration information, the face signature file, the document file and the signed document file, When the signature block does not generate the signature data and the face recognition unit compares the real-time image with the identity registration data, the document processing unit writes the stored face signature file into the document file. The electronic document automatic signature device integrating biometric information as described in Claim 1, wherein the document processing unit includes a supplementary data module to generate supplementary data, and the document processing unit adds the supplementary data to the face signature file. The electronic document automatic signature device integrating biometric information as described in claim 1, wherein the document processing unit includes an editing module, and when the display unit displays the face signature file, the display unit generates according to the user operation An editing instruction, the editing module adjusts the relative position of the signature data and the facial area image according to the editing instruction to regenerate the face signature file. The electronic document automatic signature device integrating biometric information as described in Claim 8, wherein the editing module adjusts an image parameter of the facial region image according to an operation instruction to regenerate the facial region image. An electronic document automatic signature system integrating biometric information, including: a transmission unit for receiving a document file; and An electronic document automatic signature device according to any one of claims 1 to 9, write the face signature file into the document file to generate the signed document file. The electronic document automatic signature system integrating biometric information as described in claim 10, wherein the transmission unit receives a real-time image of a witness, and the document processing unit combines the signature data, the real-time image of the witness and the facial area image, Or combine the signature data, the real-time image of the witness, the biometric image and the facial area image to generate the face signature file, and write the face signature file into the document file to generate the signed document file. An electronic document automatic signature method integrating biometric information, comprising: Display a signature block and a confirmation button; Generate a signature data based on the user's handwriting in the signature block; capturing a real-time image when the confirmation button is operated; Comparing the real-time image with an identity registration information, and extracting a facial area image from the real-time image when the comparison is matched; Combining the signature data with the face region image to generate a face signature file; and Write the face signature file into a document file to generate a signed document file. The electronic document automatic signature method integrating biometric information as described in claim 12, wherein after the step of generating the signature data, it further includes: adding a hash data to the signature data; and the step of extracting the facial region image After that, it further includes: adding another hash data to the face region image. The electronic document automatic signature method integrating biometric information as described in claim 13, wherein the step of adding the hash data to the signature data includes: converting the signature data into a digital data, encrypting it and converting it into the corresponding One hash data of the signature data; the step of adding another hash data to the face area image includes: converting the face area image into the digital data, encrypting it and converting it into the corresponding face area image A hash data. The electronic document automatic signature method integrating biometric information as described in claim 12, wherein after the step of capturing the real-time image when the confirmation button is operated, it further includes: receiving a real-time image of a witness; After the steps of the real-time image and the identity registration data, it further includes: combining the signature data, the real-time image of the witness and the facial area image to generate the face signature file. The electronic document automatic signature method integrating biometric information as described in claim 12, which further includes: Retrieve a biometric data; Comparing the biometric data with the identity registration data, and generating a biometric image when the comparison matches; and After the step of comparing the real-time image with the identity registration information, it further includes: Combining the signature data, the biometric image and the facial region image to generate the face signature file. The electronic document automatic signature method integrating biometric information as described in Claim 16, further includes: adding a hash data to the biometric image after the step of generating the biometric image. The electronic document automatic signature method integrating biometric information as described in claim 17, wherein the step of adding the hash data to the biometric image includes: converting the biometric image into the digital data, encrypting it and converting it to A hash data corresponding to the biometric image. The electronic document automatic signature method integrating biometric information as described in claim 16, wherein after the step of capturing the real-time image when the confirmation button is operated, it further includes: receiving a real-time image of a witness; After the steps of the real-time image and the identity registration data, it further includes: combining the signature data, the real-time image of the witness, the biometric image and the facial area image to generate the face signature file. The electronic document automatic signature method integrating biometric information as described in Claim 12, wherein after the step of generating the signed document file, further includes: encrypting the signed document file according to a predetermined condition and restricting the access of the signed document file . The electronic document automatic signature method integrating biometric information as described in claim 12, wherein after the step of generating the face signature file, it further includes: the signature data is not generated in the signature block and compared with the real-time image and When the identity registration information matches, write the generated face signature file into the document file. In the electronic document automatic signature method integrating biometric information as described in claim 12, the step of generating the face signature file includes: adding a note to the face signature file.

Images