TW201947448A - Method for generating and verifying an electronic signature with a digital watermark, and electronic device to generate a signature track data according to the track information of all the signing track of a signer for each image received after the movie obtains the signature message summary - Google Patents

Abstract

An electronic device executes a method for generating an electronic signature with a digital watermark. During a shooting period for generating a movie, a summary of a signature message is obtained according to the document data related to a document and a mathematical function. For each image received after the movie obtains the signature message summary, a signature track data is generated according to the track information of all the signing track of a signer received before the time when the image was received. The signature track data is added to the image. When the signature message summary is obtained, the electronic device adds a digital watermark including the signature message summary to the movie, to generate an electronic signature including the movie. In addition, the present invention also provides an electronic signature verification method and an electronic device.

Description

Electronic signature generation and verification method with digital watermark and electronic device

The invention relates to a method for checking the legality, verification or signature of data, in particular to a method and an electronic device for generating and verifying an electronic signature with a digital watermark.

In order to improve the inconvenience of applying for an electronic certificate for traditional electronic signatures, and the general public ’s distrust of the illegible key of the electronic certificate for the signature of physical entities, the electronic signature method with anti-counterfeiting function of the Republic of China Patent No. I493380 In order to verify the signature by combining the writing action image and the handwriting track, confirm that the signature actually comes from the intended signatory, and then use a simple method to achieve the purpose of authenticating the identity and improve the reliability.

However, when the system authentication combines the signature of the handwriting motion image and the handwritten trajectory, since there is not much difference between each signature, the interested person with the user's signature of the handwriting motion image and the handwritten trajectory uses this dynamic image and the signer's handwriting When the signature track is in different documents, the system cannot prove that the partner is the source of the signed content of the documents.

Therefore, an object of the present invention is to provide a method for generating an electronic signature with a digital watermark, which can prove that the signer is the source of the signed content of the document and the signed content is only related to the document.

Therefore, the method for generating an electronic signature with a digital watermark of the present invention is implemented by a processing unit, which is electrically connected to a photographing unit and an input unit, and the photographing unit is used to photograph and sign a document during a photographing period. Signatories to generate a movie including multiple frames of images, the document information is related to a document, and the movie is transmitted to the processing unit, and the input unit is used to generate and transmit multiple related to the signature during the shooting period The trajectory information of the signed trajectory is sent to the processing unit. The electronic signature generation method with a digital watermark includes a step (A), a step (B), a step (C), and a step (D).

In step (A), during the shooting period, the processing unit obtains a signature message summary related to the document according to the document and a mathematical function.

In step (B), the processing unit, during the shooting period, for each image received by the movie after obtaining the signature message summary, after receiving the image, All the track information received before the image receiving time generates a signature track data, and the signature track data is added to the image.

In step (C), the processing unit adds a digital watermark including the signature message summary to the movie during the shooting period when the signature message summary is obtained.

In step (D), the processing unit generates an electronic signature including the film processed in steps (B) and (C), and adds the electronic signature to the document.

Therefore, another object of the present invention is to provide an electronic signature verification method with a digital watermark that can prove that the signer is the source of the signed content of the document and the signed content is only related to the document. It is implemented by a processing unit, which is electrically connected to a storage unit. The storage unit stores a document related to a document and includes an electronic signature. The electronic signature includes a movie including a multi-frame correlation. An image of a signature trajectory data of a signer and the signer, and a plurality of digital watermarks, each digital watermark has a verification code, the method includes a step (A), a step (B), a step (C), a step (D), and a step (E).

In step (A), the processing unit determines whether a target digital watermark can be obtained from the movie.

In step (B), when the processing unit determines that the target digital watermark can be obtained from the movie, the verification code is obtained according to the target digital watermark.

In step (C), the processing unit obtains a verification message summary related to the document material according to the document material and the mathematical function.

In step (D), the processing unit determines whether the verification code obtained in step (B) is the same as the message digest for verification.

In step (E), when the processing unit determines that the verification code is the same as the verification message digest, it generates an electronic signature valid message indicating that the electronic signature is valid.

Therefore, another object of the present invention is to provide an electronic device that can prove that the signer is the source of the signed content of the document and the signed content is only related to the document. The electronic device includes a photographing unit, an input unit, and a processing unit electrically connected to the photographing unit and the input unit.

The shooting unit is used to shoot a signer who is signing a document during a shooting period, so as to generate a movie including multiple frames of images, and the document is related to a document.

The input unit is used to generate and transmit a plurality of track information related to the signing track of the signer during the shooting period.

During the shooting period, the processing unit obtains a signed message summary related to the document according to the document data and a mathematical function, and during the shooting period, obtains the signed message summary for the movie from the For each image received by the shooting unit, after receiving the image, a signature track data is generated based on all the track information received from the input unit before the image receiving time of the received image, and the signature track is Data is added to the image, and during the shooting period, when the signature message summary is obtained, a digital watermark including the signature message summary is added to the movie. Finally, the processing unit generates and includes the processed The unit processes the electronic signature of the movie and adds the electronic signature to the document.

Therefore, another object of the present invention is to provide an electronic device that can prove that the signer is the source of the signed content of the document and the signed content is only related to the document. The electronic device includes a storage unit and a processing unit electrically connected to the storage unit.

The storage unit stores a document related to a document and including an electronic signature. The electronic signature includes a movie including a plurality of frames of images related to a signer and the signature track data of the signer. And multiple digital watermarks, each digital watermark has a verification code.

The processing unit determines whether a target digital watermark can be obtained from the movie. When the processing unit determines that the target digital watermark can be obtained from the movie, the processing unit obtains the verification code according to the target digital watermark, and according to The document material and the mathematical function obtain a verification message summary related to the document material, and then determine whether the verification code obtained is the same as the verification message summary, and when the processing unit determines that the verification code and the verification When the message digest is the same, the processing unit generates an electronic signature valid message indicating that the electronic signature is valid.

The function of the present invention is: when generating an electronic signature, obtain the signature message summary related to the document information, and then add the digital watermark including the signature message summary to the digital watermark received after the signature message summary is received. And verify the validity of the electronic signature with the target digital watermark of the electronic signature when verifying the electronic signature, thereby strengthening the unique binding relationship between the images of the electronic signature and the document. To improve the non-repudiation of electronic signatures.

Referring to FIG. 1, a first embodiment of a signature electronic device 100 according to the present invention includes a photographing unit 11, an input unit 12, and a signature processing unit 14. The signature electronic device 100 is used to generate an electronic signature.

The shooting unit 11 is used to shoot a signer who is signing a document during a shooting period to generate a movie including multiple frames of images. The document is related to a document 90 and includes a document related to the document 90. Abstract (see Figure 2).

The input unit 12 is used for generating and transmitting a plurality of track information related to the signing track of the signer during the shooting period, and each track information includes a coordinate position related to the input unit.

The signature processing unit 14 is electrically connected to the photographing unit 11 and the input unit 12.

It should be particularly noted that the signature electronic device 100 is, for example, a smart tablet or a smart phone, and the input unit 12 is, for example, a touch screen.

Referring to FIG. 1, FIG. 3, FIG. 4, and FIG. 5, a first embodiment of a method for generating an electronic signature with a digital watermark according to the present invention is implemented by the first embodiment of the electronic device 100 for signature and signature of the present invention, and includes Steps 201 to 204.

In step 201, during the shooting period of the photographing unit 11, the signature processing unit 14 obtains a signature message summary related to the document summary of the document according to the document summary of the document and a mathematical function. (message digest). It is worth noting that, in this embodiment, the document material is, for example, an electronic file in a format such as pdf or doc, and the mathematical function is, for example, a hash function, that is, the signature processing unit 14 hashes the document digest. Function operation to obtain the signature message summary, but not limited to this.

In step 202, during the shooting period of the shooting unit 11, for each image received after obtaining the signature message summary, after the signature processing unit 14 receives the image from the shooting unit 11, , The signature processing unit 14 generates a signature track data 92 according to all track information received before the image receiving time of the received image, and adds the signature track data 92 to the image, that is, in the shooting unit 11 While shooting the signer 93, the signer 93 uses the input unit 12 to sign, so that the signature processing unit 14 generates the image with the signature track data 92. In this embodiment, the signature track data 92 is, for example, a signature track map.

In step 203, during the shooting period of the shooting unit 11, when the signature processing unit 14 obtains the signature message summary, the signature processing unit 14 adds a digital watermark 91 including the signature message summary. Joined the movie 94. It is worth noting that, in this embodiment, the signature processing unit 14 periodically adds the digital watermark 91 to the film 94. In other embodiments, the signature processing unit 14 can also randomly add The digital watermark 91 is added to the film 94, but is not limited thereto.

It is worth noting that, in this embodiment, the digital watermark 91 is a visible digital watermark, and the signature processing unit 14 adds text that is visible and includes a summary of the signature message to the images.

It should be noted again that, in this embodiment, step 203 is after step 202. In other embodiments, step 203 may be before step 202.

In step 204, the signature processing unit 14 generates an electronic signature 95 including the film 94 processed in steps 202 and 203, and adds the electronic signature 95 and the signature track data 92 to the document data.

In the first embodiment of the method for generating an electronic signature with a digital watermark according to the present invention, the signature processing unit 14 adds the visible signature information abstract of the document summary related to the document material, and then adds a visible text The digital watermark 91 to the film 94 to generate the electronic signature, thereby strengthening the unique binding relationship between the images of the electronic signature and the document and improving the undeniable of the electronic signature Sex.

Referring to FIG. 6, a second embodiment of the electronic signature device 100 of the present invention is similar to the first embodiment of the electronic signature device 100 of the present invention, except that the second embodiment further includes a communication unit. 13. The communication unit 13 is connected to a time stamp server 6 via a communication network 5.

Referring to FIG. 6 and FIG. 7, a second embodiment of a method for generating an electronic signature with a digital watermark according to the present invention is implemented by the second embodiment of the electronic signature device 100 according to the present invention, and includes steps 401 to 405.

In step 401, during the shooting period of the shooting unit 11, the signature processing unit 14 obtains a document message digest related to the document summary of the document according to the document summary of the document and a mathematical function.

In step 402, during the photographing period of the photographing unit 11, the signature processing unit 14 obtains an information related to the current time and the document message summary according to a current time, the document message summary, and the mathematical function. A summary of the signature message.

It is worth noting that, in this embodiment, the signature processing unit 14 obtains the signature message summary through the time stamp server 6, and the signature processing unit 14 passes the document message summary through the communication unit 13 via The communication network 5 transmits to the time stamp server 6, so that the time stamp server 6 generates the signature message digest based on the current time, the document message digest, and the mathematical function, and encrypts the signature with a private key. The signature message digest is transmitted to the signature processing unit 14 via the communication unit 13.

In other embodiments, the time stamp server 6 may directly transmit the signature message digest to the signature processing unit 14 through the communication unit 13 without encrypting the signature message digest, or the signature processing unit 14 directly. The signature message summary is generated according to the current time, the document message summary, and the mathematical function, without limitation.

It should be noted again that in this embodiment, the signature processing unit 14 obtains the signature message summary based on the current time, the document message summary, and the mathematical function. In other embodiments, the signature seal The processing unit 14 may also be based on the current time, a document number of the document, a device identification code related to the electronic signature device 100, and an Internet Protocol address related to the electronic signature device 100. At least one of them, the document message summary, and the mathematical function can obtain the signature message summary, but not limited to this.

In step 403, during the shooting period of the shooting unit 11, for each image received after obtaining the signature message summary, after the signature processing unit 14 receives the image from the shooting unit 11, The signature processing unit 14 generates a signature track data according to all the track information received before the image receiving time of the received image, and adds the signature track data to the image.

In step 404, during the shooting period of the photographing unit 11, when the signature processing unit 14 obtains the signature message digest, the signature processing unit 14 adds a digital watermark including the signature message digest. In the movie.

It is worth noting that, in this embodiment, the digital watermark is an invisible digital audio watermark, and the signature processing unit 14 converts the signature message digest into one (binary code) as the digital watermark. For each image, a plurality of target pixels of the image are randomly selected, and each bit of the binary encoding sequentially replaces some bits of the target pixels to add the digital watermark to the video. in. For example, the image generated by the shooting unit 11 is an RGB full-color image, that is, three colors of red, green, and blue each occupy 8 bits. When the binary encoding is 8 bits, for example, 10000001, the signature processing unit 14 will randomly take 3 target pixels, such as R: 00100110 G: 11101001 B: 11001000 first target pixel, R: 00100110 G: 11001001 B: 11101001 second target pixel, and R: 11001000 G : 00100111 B: the third target pixel of 11101001, the signature processing unit 14 sequentially replaces each bit of the binary code in order to replace the last bit of the target pixels (excluding the blue of the third pixel) So that the first pixel becomes R: 0010011 1 G: 1110100 0 B: 1100100 0 , the second pixel becomes R: 0010011 0 G: 1100100 0 B: 1110100 0 and the third pixel becomes R: 1100100 0 G: 0010011 1 B: 11101001. It is worth noting that in other invisible digital audio watermark implementations, the film used by the shooting unit 11 also includes a video audio, and the signature processing unit 14 can also convert the signature message summary. Forming the digital audio watermark as the digital watermark, superimposing the digital watermark on the video audio, adding the digital watermark to the video, converting the digital watermark and adding the digital watermark For example, the signature message digest is encoded into a bit string, and then the bit string is embedded in the video audio, but not limited to this.

It should be noted again that, in this embodiment, step 404 is after step 403. In other embodiments, step 404 may be before step 403.

In step 405, the signature processing unit 14 generates position information including the target pixels of each image, a combination of partial bits related to the target pixels into the combined sequence information of the binary code, and step 403. In step 404, the electronic signature of the film is processed, and the electronic signature and the signature track data are added to the document data.

In the second embodiment of the above-mentioned method for generating an electronic signature with a digital watermark according to the present invention, the signature processing unit 14 obtains the document message digest of the document abstract related to the document material, and then transmits the document signature via the communication unit 13 The document message digest is transmitted to the time stamp server 6, and the time stamp server 6 generates and transmits the signature message digest to the signature processing unit 14 according to the current time, the document message digest, and the mathematical function, And add the invisible digital watermark to the signature processing unit 14 in order to replace the part of the target pixel of the movie with the abstract of the signature message to generate the electronic signature, thereby strengthening the electronic signature The unique binding relationship between the images of the signature and the document, and the non-repudiation of the electronic signature.

Referring to FIG. 8, a first embodiment of a verification electronic device 300 of the present invention includes a storage unit 31 and a verification processing unit 32 electrically connected to the storage unit 31. The verification electronic device 300 is used to verify an electronic signature to be verified.

The storage unit 31 stores the electronic signature to be verified, a document related to a document, a count value, and a threshold value, and the document includes a document summary related to the document. The electronic signature to be verified includes a film, the film having a plurality of frames of a first image related to a signing track data of a signer and the signer, each having a digital watermark, and a plurality of frames related to the signature And the second image of the signature track data of the signer and the signer without the digital watermark, each digital watermark has a verification code. It is worth noting that, in this embodiment, the document data is, for example, an electronic file in a format such as pdf or doc, and the mathematical function is, for example, a hash function, but not limited thereto.

Referring to FIG. 8 and FIG. 9, a first embodiment of an electronic signature verification method with a digital watermark according to the present invention is implemented by the first embodiment of the verification electronic device 300 of the present invention, and includes steps 501-510.

In step 501, the verification processing unit 32 randomly selects multiple frames of target images from the images of the movie stored in the storage unit 31.

In step 502, the verification processing unit 32 determines whether at least two digital watermarks to be compared can be obtained from the target images of the film. When the verification processing unit 32 determines that at least two digital watermarks to be compared cannot be obtained from the target images of the film, step 503 is performed; and when the verification processing unit 32 determines that the target images of the film can be obtained When at least two digital watermarks to be compared are obtained, step 506 is performed.

In step 503, the verification processing unit 32 determines whether the count value is greater than the threshold value. When the verification processing unit 32 determines that the count value is not greater than the threshold value, proceed to step 504; and when the verification processing unit 32 determines that the count value is greater than the threshold value, proceed to step 505.

In step 504, the verification processing unit 32 adds one to the count value, and repeats step 501 to randomly select other target images.

In step 505, the verification processing unit 32 generates an electronic signature invalid message indicating that the electronic signature to be verified is invalid.

In step 506, the verification processing unit 32 determines whether the at least two comparative digital watermarks to be compared are all the same to determine whether a target digital watermark can be obtained from the target images of the film. When the verification processing unit 32 determines When the at least two comparison digital watermarks are the same, it is determined that the target digital watermark can be obtained from the target images of the movie, and the verification processing unit 32 uses the digital watermarks of the target images of the movie as The target digital watermark, and proceed to step 507; and when the verification processing unit 32 determines that the at least two digital watermarks to be compared are not identical, it determines that the target digital watermark cannot be obtained from the target images of the movie Watermark, and proceed to step 503.

It should be particularly noted that, in other embodiments, in step 502, the verification processing unit 32 may determine whether a digital watermark to be compared can be obtained from the target images of the movie. When the verification processing unit 32 determines When the target digital watermark can be obtained from the target images of the movie, the target digital watermark is used as the target digital watermark, and step 507 is performed; and when the verification processing unit 32 determines that the When the digital watermark to be compared is obtained from the target images of the film, step 503 is performed.

In step 507, the verification processing unit 32 obtains the verification code according to the target digital watermark.

It is worth noting that, in this embodiment, the target digital watermark is a visible digital watermark, that is, the digital watermark of each first image is a text with a summary of the document message, and the verification processing unit 32 uses Character recognition technology obtains the verification code according to the target digital watermark, but is not limited to this.

In other embodiments in which the target digital watermark is an invisible digital watermark, the storage unit 31 further stores position information of a plurality of target pixels related to each first image and a part of bits related to the target pixels. The combination order information of the element, in step 507, the verification processing unit 32 obtains the target pixel of the target image according to the target image having the target digital watermark and the corresponding position information, and the target having the target digital watermark The image and the corresponding combination sequence information are combined with some bits in the target pixel to obtain the verification code.

In step 508, the verification processing unit 32 obtains a verification message digest related to the document summary of the document according to the document summary and the mathematical function of the document.

In step 509, the verification processing unit 32 determines whether the obtained verification code is the same as the message digest for verification. When the verification processing unit 32 determines that the verification code is different from the verification message digest, step 505 is performed; and when the verification processing unit 32 determines that the verification code is the same as the verification message digest, step 510 is performed.

In step 510, the verification processing unit 32 generates an electronic signature validity message indicating that the electronic signature to be verified is valid.

With reference to FIG. 3, for example, the digital watermark 91 verification code (ie, AB123CD45E) of the movie is obtained through steps 501 to 507, and the document summary is calculated as a hash function in step 508 to obtain the verification message. After the digest, if the verification message digest is equal to the verification code, that is, the verification message digest is also AB123CD45E, it means that the electronic signature to be verified is valid.

In the first embodiment of the electronic signature verification method of the present invention with a digital watermark, the verification processing unit 32 randomly selects the target images of the film and determines whether at least two can be obtained from the target images of the film. After comparing the digital watermarks, it is determined whether the obtained at least two compared digital watermarks are the same, to determine that the obtained digital watermarks are correct, to improve the accuracy of the digital watermark verification, and then, from the target, The digital watermark obtains the verification code, and obtains the verification message digest according to the document abstract and the mathematical function of the document material, and then determines whether the verification code obtained in the step is the same as the verification message digest to verify the verification. The validity of the electronic signature is to be verified, thereby improving the non-repudiation of the electronic signature.

A second embodiment of the verification electronic device 300 of the present invention is similar to the first embodiment of the verification electronic device 300 of the present invention (as shown in FIG. 8). The only difference is that the to-be-verified stored in the storage unit 31 is The electronic signature also includes a verification data, which has a time. In other embodiments, the verification data may have at least one of the time, a document number, a device identification code, and an Internet Protocol address. One. Referring to FIG. 8 and FIG. 10, a second embodiment of an electronic signature verification method with a digital watermark according to the present invention is similar to the first embodiment, and is implemented by the second embodiment of the verification electronic device 300 of the present invention, and includes Steps 601 to 611, where steps 601 to 607 and 611 are respectively the same as steps 501 to 507 and 509 (see FIG. 9), and the differences are described below.

In step 608, the verification processing unit 32 obtains a document message digest related to the document material according to the document abstract and the mathematical function of the document material.

In step 609, the verification processing unit 32 obtains a verification message digest related to the time and the document message summary according to the time of the verification information, the document message summary, and the mathematical function. It is worth noting that in other embodiments in which the verification data has at least one of the time, the document number, the device identification code, and the Internet Protocol address, the verification processing unit 32 is based on the verification The at least one of the data, the document message digest, and the mathematical function obtain the message digest for verification.

In step 610, the verification processing unit 32 determines whether the obtained verification code is the same as the message digest for verification. When the verification processing unit 32 determines that the verification code is different from the verification message digest, step 605 is performed; and when the verification processing unit 32 determines that the verification code is the same as the verification message digest, step 611 is performed.

In the second embodiment of the electronic signature verification method of the present invention with a digital watermark, the digital watermark is converted into the verification code, and the document message summary is obtained according to the document abstract and the mathematical function of the document. , And then obtain the verification message summary based on the time of the verification data, the document message summary, and the mathematical function, and then determine whether the verification code obtained in the step is the same as the verification message summary to verify the pending verification Whether the electronic signature is effective, thereby improving the non-repudiation of the electronic signature.

A third embodiment of the verification electronic device 300 according to the present invention is similar to the second embodiment of the verification electronic device 300 according to the present invention (see FIG. 8), except that the difference is that the to-be-verified stored in the storage unit 31 The electronic signature includes that the video also has an audio, the audio has a video audio and an audio watermark, and the audio watermark includes a verification code.

Referring to FIG. 8 and FIG. 11, a third embodiment of an electronic signature verification method with a digital watermark according to the present invention is similar to the second embodiment, and is implemented by the third embodiment of the verification electronic device 300 of the present invention, and It includes steps 801 to 807, where steps 802, 804, 805, and 807 are respectively the same as steps 605, 608, 609, and 611 (see FIG. 10). The differences are described below.

In step 801, the verification processing unit 32 determines whether the audio watermark can be separated from the audio of the movie, that is, determines whether a target digital watermark can be obtained from the movie. When the verification processing unit 32 determines that the audio watermark cannot be separated from the audio of the movie, that is, when it is determined that the target digital watermark cannot be obtained from the movie, step 802 is performed; and when the verification processing unit 32 determines that When the audio watermark can be separated from the audio of the movie, that is, when it is determined that the target digital watermark can be obtained from the movie, step 803 is performed.

In step 803, the verification processing unit 32 separates the audio watermark from the audio of the movie as the target digital watermark, and converts the target digital watermark into the verification code.

In step 806, the verification processing unit 32 determines whether the obtained verification code is the same as the message digest for verification. When the verification processing unit 32 determines that the verification code is different from the verification message digest, step 802 is performed; and when the verification processing unit 32 determines that the verification code is the same as the verification message digest, step 807 is performed.

In the first embodiment of the electronic signature verification method of the present invention with a digital watermark, the verification processing unit 32 separates the audio watermark from the audio of the film, and converts the audio watermark into the verification code. The document message summary is obtained according to the document summary and the mathematical function of the document information, and then the verification message summary is obtained according to the time of the verification information, the document message summary, and the mathematical function, and then the step is determined. Whether the obtained verification code is the same as the message digest for verification to verify whether the electronic signature to be verified is valid, thereby improving the non-repudiation of the electronic signature.

To sum up, the method and device for generating and verifying an electronic signature with a digital watermark according to the present invention. When generating an electronic signature, the signature processing unit 14 obtains the verification code related to the document data, and then includes the verification code. The digital watermark of the signature message digest is added to the video received after obtaining the signature message digest to generate the electronic signature, and when verifying the electronic signature, the verification processing unit 32 uses the to-be-verified electronic The digital watermark of the signature verifies whether the electronic signature to be verified is valid, thereby strengthening the unique binding relationship between the images of the electronic signature and the document, so as to improve the non-repudiation of the electronic signature. Can achieve the purpose of the invention.

However, the above are only examples of the present invention. When the scope of implementation of the present invention cannot be limited by this, any simple equivalent changes and modifications made according to the scope of the patent application and the contents of the patent specification of the present invention are still Within the scope of the invention patent.

100‧‧‧Signed electronic device

91‧‧‧digital watermark

11‧‧‧ shooting unit

92‧‧‧Signed track data

12‧‧‧ input unit

93‧‧‧ signatories

13‧‧‧Communication Unit

94‧‧‧ Video

14‧‧‧Signature processing unit

95‧‧‧Electronic signature

300‧‧‧ Verification electronics

201 ~ 204‧‧‧step

31‧‧‧Storage unit

401 ~ 405‧‧‧ steps

32‧‧‧ Verification Processing Unit

501 ~ 510‧‧‧step

5‧‧‧Communication Network

601 ~ 611‧‧‧step

6‧‧‧time stamp server

801 ~ 807‧‧‧step

90‧‧‧Documents

Other features and effects of the present invention will be clearly presented in the embodiments with reference to the drawings, in which: FIG. 1 is a block diagram illustrating a first embodiment of an electronic device for generating an electronic signature of the present invention FIG. 2 is a schematic diagram illustrating a document of the first embodiment of the electronic device; FIG. 3 is a schematic diagram illustrating that the first embodiment of the electronic device will include a digital watermark including a summary of the signature message Add a video; FIG. 4 is a schematic diagram illustrating the first embodiment of the electronic device adding an electronic signature and a signature track data to the document; FIG. 5 is a flowchart illustrating the present invention having a digital watermark A first embodiment of a method for generating an electronic signature; FIG. 6 is a block diagram illustrating a second embodiment of an electronic device for generating an electronic signature according to the present invention; FIG. 7 is a flowchart illustrating that the present invention has A second embodiment of a method for generating an electronic signature of a digital watermark; FIG. 8 is a block diagram illustrating a first embodiment of an electronic device for verifying an electronic signature of the present invention. ； FIG. 9 is a flowchart illustrating a first embodiment of the electronic signature verification method with a digital watermark according to the present invention; FIG. 10 is a flowchart illustrating an electronic signature verification method with a digital watermark according to the present invention; A second embodiment; and FIG. 11 is a flowchart illustrating a third embodiment of the electronic signature verification method with a digital watermark according to the present invention.

Claims (34)

A method for generating an electronic signature with a digital watermark is implemented by a processing unit. The processing unit is electrically connected to a photographing unit and an input unit. The photographing unit is used to photograph a signature that is used to sign a document during a photographing period. To generate a movie including multiple frames of images, the document data is related to a document, and the movie is transmitted to the processing unit, and the input unit is used to generate and transmit multiple related to the signatory during the shooting period The track information of the signed track is sent to the processing unit, and the method includes the following steps: (A) during the shooting period, obtaining a summary of the signature message related to the file according to the file and a mathematical function; (B) During the shooting period, for each image received by the movie after obtaining the summary of the signature message, after receiving the image, according to all track information received before the time when the image received the image was received Generate a signature track data and add the signature track data to the image; (C) During the shooting period, when the summary of the signature message is obtained , Adding a digital watermark including the summary of the signature message to the film; and (D) generating an electronic signature including the film processed in steps (B) and (C), and applying the electronic signature Add the documentation. The method for generating an electronic signature with a digital watermark as described in claim 1, wherein, in step (A), the method is further based on a current time, a document number of the document material, and an associated one including the processing unit. A device identification code of the electronic device and at least one of Internet protocol addresses related to the electronic device to obtain the signature message summary. In step (D), the electronic signature further includes the at least one By. According to the method for generating an electronic signature with a digital watermark according to claim 1, the processing unit is further electrically connected to a communication unit, and the communication unit is connected to a time stamp server via a communication network, wherein, in step (A), The document is transmitted to the time stamp server via the communication unit, so that the time stamp server generates and transmits the signature message summary to the communication unit via the communication unit to the current time, the document data, and the mathematical function. The processing unit further enables the processing unit to obtain the signature message summary. In step (D), the electronic signature further includes the current time. The method for generating an electronic signature with a digital watermark according to claim 1, the processing unit is also electrically connected to a communication unit, and the communication unit is connected to a time stamp server via a communication network, wherein step (A) includes the following Steps: (A-1) during the shooting period, obtain a document message summary related to the document material according to the document material and the mathematical function; and (A-2) transmit the document message summary to the document unit via the communication unit Timestamp server, so that the timestamp server generates and sends the signature message summary to the processing unit via the communication unit based on the current time, the document message summary, and the mathematical function, so that the processing unit obtains The signature message summary; in step (D), the electronic signature also includes the current time. The method for generating an electronic signature with a digital watermark according to claim 1, wherein, in step (A), the mathematical function is a hash function. The method for generating an electronic signature with a digital watermark according to claim 1, wherein, in step (C), for each image received by the movie after obtaining the signature message summary, the image is received. After the image, the processing unit adds the visible text including the signature message summary as the digital watermark to the image to add the digital watermark to the film. The method for generating an electronic signature with a digital watermark according to claim 1, wherein, in step (C), for each image received by the movie after obtaining the signature message summary, the image is received. After the image, the processing unit converts the signature message digest into a (binary code) as the digital watermark, and for each image, randomly selects multiple target pixels of the image, and each of the binary coded One bit, sequentially replacing some bits of the target pixels to add the digital watermark to the movie. In step (D), the electronic signature also includes the target pixel of each image. The position information and some bits related to the target pixels are combined into the combined sequence information of the binary code. According to the method for generating an electronic signature with a digital watermark according to claim 1, the film generated by the shooting unit further includes a video audio, wherein in step (C), the processing unit converts the signature message digest into a digest An audio watermark is formed as the digital watermark, and the audio watermark is superimposed on the video audio to add the digital watermark to the video. An electronic signature verification method with a digital watermark is implemented by a processing unit. The processing unit is electrically connected to a storage unit. The storage unit stores a document related to a document and including an electronic signature. The electronic signature The chapter includes a video, which includes multiple frames of images related to a signer and a signature track data of the signer, and a plurality of digital watermarks. Each digital watermark has a verification code. The method includes the following steps: : (A) determine whether a target digital watermark can be obtained from the film; (B) when it is determined that the target digital watermark can be obtained from the film, obtain the verification code based on the target digital watermark; (C) according to The document data and the mathematical function obtain a verification message summary related to the document data; (D) determine whether the verification code obtained in step (B) is the same as the verification message summary; and (E) when it is judged When the verification code is the same as the verification message digest, an electronic signature valid message indicating that the electronic signature is valid is generated. The method for verifying an electronic signature with a digital watermark according to claim 9, the electronic signature further comprising a time, a document number, a device identification code, and at least one of an Internet Protocol address The verification data, wherein, in step (C), the verification message digest is also obtained based on the verification data. The method for verifying an electronic signature with a digital watermark according to claim 10, step (C) includes the following sub-steps: (C-1) obtaining a document message summary according to the document data and the mathematical function; and (C-2 ) Obtain the verification message summary based on the verification information, the document message summary, and the mathematical function. According to the electronic signature verification method with a digital watermark as described in claim 9, the images also have a plurality of frames of a first image each having a digital watermark and a plurality of frames of a second image not having the digital watermark. Among them, step (A) includes the following sub-steps: (A-1) randomly selecting multiple frames of the target image from the images of the film; and (A-2) determining whether the target digital float can be obtained from the target images Watermark to determine if the target digital watermark is available from the movie. According to the electronic signature verification method with a digital watermark as described in claim 12, the digital watermark of each first image is a text with the verification code, wherein in step (B), the processing unit uses A character recognition technology obtains the verification code according to the target digital watermark. The method for verifying an electronic signature with a digital watermark according to claim 12, the electronic signature further includes position information of a plurality of target pixels related to each first image and a part of bits related to the target pixels Step (B) includes the following sub-steps: (B-1) obtaining a target pixel of the target image according to the target image having the target digital watermark and the corresponding position information; and (B- 2) According to the target image with the target digital watermark and the corresponding combination sequence information, combining some bits in the target pixel to obtain the verification code. According to the electronic signature verification method with a digital watermark as described in claim 12, the storage unit further stores a count value and a threshold value, and further includes the following steps after step (A): (F) When it is determined that the When the target images obtain the target digital watermark, determine whether the count value is greater than the threshold value; (G) When it is determined that the count value is greater than the threshold value, an electronic signature indicating that the electronic signature is invalid is generated Invalid message; and (H) when it is determined that the count value is not greater than the threshold value, increase the count value by one, and repeat step (A). The method for verifying an electronic signature with a digital watermark as described in claim 9, the video of the electronic signature further includes an audio, the audio includes a video audio and an audio watermark, wherein step (B) includes the following Steps: (B-1) separating the audio into an audio watermark; and (B-2) converting the audio watermark into the verification code. According to the electronic signature verification method with a digital watermark as described in claim 9, the images also have a plurality of frames of a first image each having a digital watermark and a plurality of frames of a second image not having the digital watermark. Among them, step (A) includes the following sub-steps: (A-1) randomly selecting multiple frames of target images from the images to determine whether at least two digital watermarks to be compared can be obtained from the target images; and (A- 2) When it is determined that the at least two comparative digital watermarks can be obtained from the target images, determine whether the at least two comparative digital watermarks are the same to determine whether the target digital watermark can be obtained from the movie In step (B), when it is determined that the at least two comparative digital watermarks to be compared are the same, it is determined that the target digital watermark can be obtained from the movie, and the digital watermarks of the target images are used as the target digital watermarks. Watermark. An electronic device for generating an electronic signature includes: a photographing unit for photographing a signer who is signing a document during a photograph to generate a movie including multiple frames of image, the document is related to a A document; an input unit for generating and transmitting a plurality of trajectory messages related to the signing trajectory of the signatory during the shooting period; a processing unit electrically connecting the shooting unit and the input unit; wherein, during the shooting period Within the processing unit, a signature message summary related to the document is obtained according to the document material and a mathematical function, and during the shooting period, the movie is received from the shooting unit after obtaining the signature message summary. After receiving the image, after receiving the image, a signature track data is generated according to all the track information received from the input unit before the image receiving time of the received image, and the signature track data is added to the In the image, and during the shooting period, when the summary of the signature message is obtained, a digital floating water including the summary of the signature message It is added to the film, and finally, the processing unit generates the electronic signature including the film processed by the processing unit, and adds the electronic signature to the document. The electronic device according to claim 18, wherein the processing unit is further based on a current time, a document number of the file, a device identification code related to the electronic device, and an Internet network related to the electronic device. At least one of the road agreement addresses obtains the signature message summary, and the electronic signature also includes the at least one. The electronic device according to claim 18, further comprising a communication unit electrically connected to the processing unit, the communication unit is connected to a time stamp server via a communication network, wherein the processing unit transmits the document data to the communication unit via the communication unit The time stamp server, so that the time stamp server generates and sends the signature message summary to the processing unit via the communication unit according to a current time, the document data, and the mathematical function, so that the processing unit obtains The signature message summary, the electronic signature also includes the current time. The electronic device according to claim 18, further comprising a communication unit electrically connected to the processing unit, and the communication unit is connected to a time stamp server via a communication network, wherein during the shooting period, the processing unit is based on the documents and The mathematical function obtains a document message summary related to the document data, and transmits the document message summary to the time stamp server via the communication unit, so that the time stamp server is based on the current time, the document message summary, And the mathematical function, the signature message digest is generated and transmitted to the processing unit via the communication unit, so that the processing unit obtains the signature message digest, and the electronic signature also includes the current time. The electronic device according to claim 18, wherein the mathematical function is a hash function. The electronic device according to claim 18, wherein, for each image received by the movie after obtaining the summary of the signature message, after receiving the image, the processing unit will be visible and include the signature The text of the message summary is added to the images as the digital watermark to add the digital watermark to the video. The electronic device according to claim 18, wherein, for each image received after the movie obtains the signature message summary, after receiving the image, the processing unit converts the signature message summary into a ( Binary encoding) as the digital watermark, and for each image, randomly select multiple target pixels of the image, and replace each bit of the target pixel in order by each bit of the binary encoding. To add the digital watermark to the movie, the electronic signature also includes the position information of the target pixels of each image and some bits related to the target pixels are combined into the combination order of the binary code Information. According to the electronic device of claim 18, the video generated by the shooting unit further includes a video audio, wherein the processing unit converts the signature message digest into an audio watermark as the digital watermark, and converts the audio A watermark is superimposed on the video audio to add the digital watermark to the video. An electronic device for verifying an electronic signature includes: a storage unit that stores a document related to a document and an electronic signature, the electronic signature includes a movie, and the movie includes a plurality of frames related to one An image of a signed trajectory data of the signer and the signer, and a plurality of digital watermarks, each digital watermark has a verification code; a processing unit electrically connected to the storage unit; wherein the processing unit determines whether the The film obtains a target digital watermark. When the processing unit determines that the target digital watermark can be obtained from the film, the processing unit obtains the verification code according to the target digital watermark, and according to the documentation and the mathematical function To obtain a verification message summary related to the document, and then determine whether the verification code obtained is the same as the verification message summary. When the processing unit determines that the verification code is the same as the verification message summary, the The processing unit generates an electronic signature valid message indicating that the electronic signature is valid. The digital signature verification method with a digital watermark according to claim 26, wherein the electronic signature further includes at least one of a time, a document number, a device identification code, and an Internet Protocol address The processing unit also obtains the verification message summary based on the verification data. The electronic device according to claim 27, wherein the processing unit obtains a document message summary according to the document data and the mathematical function, and obtains the message summary for verification according to the verification data, the document message summary, and the mathematical function. . The electronic device according to claim 26, wherein the images further include a plurality of frames of a first image each having a digital watermark and a plurality of frames of a second image not having the digital watermark. The target image randomly selects multiple frames of target images, and determines whether the target digital watermark can be obtained from the target images, to determine whether the target digital watermark can be obtained from the movie. The electronic device according to claim 29, wherein the digital watermark of each first image stored in the storage unit is a text with the verification code, and the processing unit uses a character recognition technology to identify the digital float according to the target digital The watermark obtains the verification code. The electronic device according to claim 29, wherein the electronic signature stored in the storage unit further includes position information of a plurality of target pixels related to each first image and a portion of bits of the target pixels Combination order information, the processing unit obtains target pixels of the target image according to the target image with the target digital watermark and the corresponding position information, and according to the target image with the target digital watermark and the corresponding combination order Information to combine some bits in the target pixel to obtain the verification code. The electronic device according to claim 29, wherein the storage unit further stores a count value and a threshold value, and when the processing unit determines that the target digital watermark cannot be obtained from the target images, the processing unit determines the Whether the count value is greater than the threshold value. When the processing unit determines that the count value is greater than the threshold value, the processing unit generates an electronic signature invalidation message indicating that the electronic signature is invalid. When the processing unit determines the count When the value is not greater than the threshold value, the processing unit adds one to the count value, and then randomly selects multiple frames of target images from the images stored in the storage unit, and then determines whether a target digital float can be obtained from the target images. Watermark. According to the electronic device of claim 26, the video of the electronic signature further includes an audio, the audio includes a video audio and an audio watermark, wherein the processing unit separates the audio into an audio watermark, and The audio watermark is converted into the verification code. According to the electronic device according to claim 26, the images further include a plurality of frames of a first image each having a digital watermark and a plurality of frames of a second image not having the digital watermark, wherein the processing unit self-stores The images stored by the unit randomly select multiple target images, and determine whether at least two comparative digital watermarks can be obtained from the target images. When the processing unit determines that the at least two comparative images can be obtained from the target images When the logarithmic digital watermark is used, the processing unit determines whether the at least two logarithmic digital watermarks to be compared are all the same to determine whether the target digital watermark can be obtained from the movie. When the watermarks are the same, it is determined that the target digital watermark can be obtained from the movie, and the processing unit uses the digital watermarks of the target images as the target digital watermark.