CN110474773B - Electronic signature generation and verification method with digital watermark and electronic device - Google Patents

Electronic signature generation and verification method with digital watermark and electronic device Download PDF

Info

Publication number
CN110474773B
CN110474773B CN201810812416.1A CN201810812416A CN110474773B CN 110474773 B CN110474773 B CN 110474773B CN 201810812416 A CN201810812416 A CN 201810812416A CN 110474773 B CN110474773 B CN 110474773B
Authority
CN
China
Prior art keywords
signature
digital watermark
processing unit
video
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810812416.1A
Other languages
Chinese (zh)
Other versions
CN110474773A (en
Inventor
吴右任
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thinkcloud Digital Technology Co ltd
Original Assignee
Thinkcloud Digital Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thinkcloud Digital Technology Co ltd filed Critical Thinkcloud Digital Technology Co ltd
Publication of CN110474773A publication Critical patent/CN110474773A/en
Application granted granted Critical
Publication of CN110474773B publication Critical patent/CN110474773B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/08—Key distribution or management, e.g. generation, sharing or updating, of cryptographic keys or passwords
    • H04L9/0861—Generation of secret information including derivation or calculation of cryptographic keys or passwords
    • H04L9/0863—Generation of secret information including derivation or calculation of cryptographic keys or passwords involving passwords or one-time passwords
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/08—Key distribution or management, e.g. generation, sharing or updating, of cryptographic keys or passwords
    • H04L9/0861—Generation of secret information including derivation or calculation of cryptographic keys or passwords
    • H04L9/0866—Generation of secret information including derivation or calculation of cryptographic keys or passwords involving user or device identifiers, e.g. serial number, physical or biometrical information, DNA, hand-signature or measurable physical characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/32—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
    • H04L9/3226—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials using a predetermined code, e.g. password, passphrase or PIN
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/32—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
    • H04L9/3236—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials using cryptographic hash functions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/32—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
    • H04L9/3297—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials involving time stamps, e.g. generation of time stamps
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835—Generation of protective data, e.g. certificates
    • H04N21/8358—Generation of protective data, e.g. certificates involving watermark
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L2209/00—Additional information or applications relating to cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00
    • H04L2209/60—Digital content management, e.g. content distribution
    • H04L2209/608—Watermarking

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Editing Of Facsimile Originals (AREA)
  • Image Processing (AREA)

Abstract

An electronic signature generation method with digital watermark is executed by an electronic device, during a shooting period for generating video, a signature message abstract is obtained according to file data and a mathematical function related to a file, for each image received after the signature message abstract is obtained by the video, signature track data is generated according to track information of all signature tracks related to a signer received before the receiving time of the image is received, the signature track data is added into the image, and when the signature message abstract is obtained, the electronic device adds the digital watermark including the signature message abstract into the video to generate the electronic signature including the video. In addition, the invention also provides an electronic signature verification method and an electronic device.

Description

Electronic signature generation and verification method with digital watermark and electronic device
Technical Field
The present invention relates to a method for checking data validity, verifying or signing, and more particularly to a method for generating and verifying an electronic signature with digital watermark and an electronic device.
Background
In order to improve the inconvenience of applying for an electronic certificate in the conventional electronic signature and the distrust of the general public accustomed to entity signature on the secret key messy code of the electronic certificate, the electronic signature method with the anti-counterfeiting function of taiwan patent No. I493380 is used for confirming that the signature really comes from an expected signer by combining the signature of a written action image and a handwritten track, thereby achieving the purpose of authenticating the identity and improving the reliability by a simple method.
However, when the system authenticates the signature combining the handwriting image and the handwriting trace, since each signature has a small difference, the system cannot distinguish that the signature content of the document data is an intended signer of the same document data or an intended signer of other documents when the dynamic image and the signer handwriting signature trace are used for different document data by a malicious person who has the signature of the user handwriting image and the handwriting trace.
Disclosure of Invention
The invention aims to provide an electronic signature generation method with digital watermark, which can prove that a signer is the source of the signed content of the document data, and the signed content only relates to the document data.
The electronic signature generation method with the digital watermark is implemented by a processing unit, the processing unit is electrically connected with a shooting unit and an input unit, the shooting unit is used for shooting a signer signing document data during shooting so as to generate a video comprising a plurality of frames of images, the document data is relevant to a document and transmits the video to the processing unit, the input unit is used for generating and transmitting a plurality of track messages relevant to the signing track of the signer to the processing unit during the shooting period, and the electronic signature generation method with the digital watermark comprises a step (A), a step (B), a step (C) and a step (D).
In the step (a), the processing unit obtains a signature message digest related to the document data according to the document data and a mathematical function during the shooting period.
In the step (B), the processing unit generates, for each image received after obtaining the digest of the signature message from the video during the shooting period, signature trajectory data based on all trajectory messages received before the image receiving time since the image was received after receiving the image, and adds the signature trajectory data to the image.
In the step (C), the processing unit adds a digital watermark including the signature message digest to the video when the signature message digest is obtained during the shooting period.
In the step (D), the processing unit generates an electronic signature including the video subjected to the processing of the steps (B) and (C), and adds the electronic signature to the document data.
Preferably, in the method for generating an electronic signature with digital watermark of the present invention, in step (a), the signature message digest is further obtained according to at least one of a current time, a file number of the file data, a device identifier associated with an electronic device including the processing unit, and an internet protocol address associated with the electronic device, and in step (D), the electronic signature further includes the at least one.
Preferably, in the method for generating an electronic signature with a digital watermark of the present invention, the processing unit is further electrically connected to a communication unit, the communication unit is connected to a timestamp server via a communication network, in step (a), the file data is transmitted to the timestamp server via the communication unit, so that the timestamp server generates and transmits the signature message digest to the processing unit via the communication unit according to a current time, the file data, and the mathematical function, thereby enabling the processing unit to obtain the signature message digest, and in step (D), the electronic signature further includes the current time.
Preferably, in the method for generating an electronic signature with a digital watermark according to the present invention, the processing unit is further electrically connected to a communication unit, the communication unit is connected to a timestamp server via a communication network, and step (a) includes the following sub-steps:
(A-1) obtaining a document message digest associated with the document data according to the document data and the mathematical function during the photographing period; and
(a-2) transmitting the document message digest to the time stamp server via the communication unit, so that the time stamp server generates and transmits the signature message digest to the processing unit via the communication unit according to the current time, the document message digest, and the mathematical function, thereby making the processing unit obtain the signature message digest;
in step (D), the electronic signature further includes the current time.
Preferably, in the method for generating an electronic signature with a digital watermark of the present invention, in step (a), the mathematical function is a hash function.
Preferably, in the method for generating an electronic signature with a digital watermark of the present invention, in step (C), for each image received after obtaining the digest of the signature message from the video, after receiving the image, the processing unit adds the visible text including the digest of the signature message as the digital watermark to the image, so as to add the digital watermark to the video.
Preferably, in the step (C), for each image received after the video obtains the signature message digest, after receiving the image, the processing unit converts the signature message digest into a binary code as the digital watermark, and for each image, randomly selects a plurality of target pixels of the image, and sequentially replaces part of the target pixels with each bit of the binary code to add the digital watermark to the video.
Preferably, in the method for generating an electronic signature with a digital watermark of the present invention, the video generated by the capturing unit further includes a video and an audio, and in step (C), the processing unit converts the digest of the signature message into an audio watermark to serve as the digital watermark, and superimposes the audio watermark on the video and the audio to add the digital watermark to the video.
Another object of the present invention is to provide an electronic signature verification method with digital watermark that can prove that a signer is the source of the signed content of the document data and that the signed content is related only to the document data. Implemented by a processing unit electrically connected to a storage unit, the storage unit storing document data associated with a document and including an electronic signature, the electronic signature including a video including an image having a plurality of frames of signature track data associated with a signer and the signer, and a plurality of digital watermarks, each digital watermark having a verification code, the method comprising step (a), step (B), step (C), step (D), and step (E).
In the step (a), the processing unit determines whether a target digital watermark is obtainable from the video.
In the step (B), when the processing unit determines that the target digital watermark is obtainable from the video, the verification code is obtained based on the target digital watermark.
In the step (C), the processing unit obtains a message digest for verification associated with the document data based on the document data and the mathematical function.
In the step (D), the processing unit determines whether the verification code obtained in the step (B) is identical to the verification-use message digest.
In the step (E), when the processing unit determines that the verification code is identical to the message digest for verification, an electronic signature valid message indicating that the electronic signature is valid is generated.
Preferably, in the method for verifying an electronic signature with a digital watermark of the present invention, the electronic signature further includes verification data of at least one of time, document number, device identifier, and internet protocol address, and in step (C), the message digest for verification is further obtained according to the verification data.
Preferably, the electronic signature verification method with digital watermark of the present invention, step (C) includes the following sub-steps:
(C-1) obtaining a document message digest according to the document data and the mathematical function; and
(C-2) obtaining the verification message digest according to the verification data, the document message digest, and the mathematical function.
Preferably, the electronic signature verification method with digital watermark of the present invention, the image further has a plurality of frames of first images each having a digital watermark and a plurality of frames of second images not having the digital watermark, step (a) includes the following sub-steps:
(A-1) randomly selecting a plurality of frames of target images from the images of the video; and
(a-2) determining whether the target digital watermark is obtainable from the target image to determine whether the target digital watermark is obtainable from the video.
Preferably, in the method for verifying electronic signatures with digital watermarks of the present invention, the digital watermark of each first image is a character having the verification code, and in step (B), the processing unit obtains the verification code according to the target digital watermark by using a character recognition technique.
Preferably, the electronic signature verification method with digital watermark of the present invention, the electronic signature further includes position information of a plurality of target pixels associated with each first image and combination sequence information of partial bits associated with the target pixels, the step (B) includes the following sub-steps:
(B-1) obtaining a target pixel of the target image according to the target image with the target digital watermark and the corresponding position information; and
and (B-2) combining partial bits in the target pixels according to the target image with the target digital watermark and the corresponding combination sequence information to obtain the verification code.
Preferably, in the method for verifying an electronic signature with a digital watermark of the present invention, the storage unit further stores a count value and a threshold, and further comprises the following steps after the step (a):
(F) when it is determined that the target digital watermark is not obtainable from the target image, determining whether the count value is greater than the threshold value;
(G) generating an electronic signature invalidity message indicating that the electronic signature is invalid when it is determined that the count value is greater than the threshold value; and
(H) when it is determined that the count value is not greater than the threshold value, incrementing the count value by one, and repeating step (a).
Preferably, in the method for verifying an electronic signature with a digital watermark of the present invention, the video of the electronic signature further includes an audio, the audio includes a video audio and an audio watermark, and step (B) includes the following steps:
(B-1) separating the audio into audio watermarks; and
(B-2) converting the audio watermark into the verification code.
Preferably, the electronic signature verification method with digital watermark of the present invention, the image further has a plurality of frames of first images each having a digital watermark and a plurality of frames of second images not having the digital watermark, step (a) includes the following sub-steps:
(A-1) randomly selecting a plurality of frames of target images from the images, and judging whether at least two digital watermarks to be compared can be obtained from the target images; and
(a-2) when it is determined that the at least two digital watermarks to be compared can be obtained from the target image, determining whether the at least two digital watermarks to be compared are identical to each other to determine whether the target digital watermark can be obtained from the video;
in the step (B), when it is determined that the at least two digital watermarks to be compared are the same, it is determined that the target digital watermark can be obtained from the video, and the digital watermark of the target image is used as the target digital watermark.
It is a further object of the present invention to provide an electronic device that can prove that a signer is the source of signed content of document data and that the signed content is related only to the document data. The electronic device comprises a shooting unit, an input unit and a processing unit electrically connected with the shooting unit and the input unit.
The photographing unit is used for photographing a signer signing document data during photographing to generate a video comprising a plurality of frames of images, wherein the document data is relevant to a document.
The input unit is used for generating and transmitting a plurality of track messages related to the signing track of the signer in the shooting period.
During the shooting period, the processing unit obtains the signature message abstract related to the document data according to the document data and the mathematical function, and during the shooting period, for each image of the video received from the capture unit after obtaining the signature message digest, generating signature track data based on all track messages received from the input unit before an image receiving time from the reception of the image, and adding the signature track data to the image, and during the photographing period, when the signature message digest is obtained, adding a digital watermark including the signature message digest to the video, and finally, the processing unit generates the electronic signature including the video processed by the processing unit, and adds the electronic signature to the document data.
Preferably, in the electronic device of the present invention, the processing unit further obtains the signature message digest according to at least one of a current time, a file number of the file data, a device identifier associated with the electronic device, and an internet protocol address associated with the electronic device, and the electronic signature further includes the at least one.
Preferably, the electronic device of the present invention further includes a communication unit electrically connected to the processing unit, the communication unit is connected to a timestamp server via a communication network, and the processing unit transmits the document data to the timestamp server via the communication unit, so that the timestamp server generates and transmits the signature message digest to the processing unit via the communication unit according to the current time, the document data, and the mathematical function, thereby enabling the processing unit to obtain the signature message digest, and the electronic signature further includes the current time.
Preferably, the electronic device of the present invention further includes a communication unit electrically connected to the processing unit, the communication unit is connected to a timestamp server via a communication network, during the shooting period, the processing unit obtains a document message digest related to the document data according to the document data and the mathematical function, and transmits the document message digest to the timestamp server via the communication unit, so that the timestamp server generates and transmits the signature message digest to the processing unit via the communication unit according to the current time, the document message digest, and the mathematical function, thereby enabling the processing unit to obtain the signature message digest, and the electronic signature further includes the current time.
Preferably, in the electronic device of the present invention, the mathematical function is a hash function.
Preferably, in the electronic device of the present invention, for each image received after the video obtains the digest of the signature message, after receiving the image, the processing unit adds the visible text including the digest of the signature message as the digital watermark to the image, so as to add the digital watermark to the video.
Preferably, in the electronic device of the present invention, after receiving the image of each image received after obtaining the digest of the signature message from the video, the processing unit converts the digest of the signature message into a binary code to be used as the digital watermark, and for each image, randomly selects a plurality of target pixels of the image, and sequentially replaces part of the target pixels with each bit of the binary code to add the digital watermark to the video.
Preferably, in the electronic device of the present invention, the video generated by the capturing unit further includes a video and an audio, and the processing unit converts the digest of the signature message into an audio watermark to serve as the digital watermark, and superimposes the audio watermark on the video and the audio to add the digital watermark to the video.
It is a further object of this invention to provide an electronic device that can prove that a signer is the source of signed content of document data and that the signed content is related only to the document data. The electronic device comprises a storage unit and a processing unit electrically connected with the storage unit.
The storage unit stores document data associated with a document and including an electronic signature including a video including an image having a plurality of frames of signature track data associated with a signer and the signer, and a plurality of digital watermarks each having a verification code.
The processing unit determines whether a target digital watermark can be obtained from a video, when the processing unit determines that the target digital watermark can be obtained from the video, the processing unit obtains the verification code according to the target digital watermark, obtains a message digest for verification related to the document data according to the document data and the mathematical function, determines whether the obtained verification code is the same as the message digest for verification, and generates an electronic signature valid message indicating that the electronic signature is valid when the processing unit determines that the verification code is the same as the message digest for verification.
Preferably, in the electronic device of the present invention, the electronic signature further includes verification data of at least one of time, document number, device identifier, and network internet protocol address, and the processing unit further obtains the message digest for verification according to the verification data.
Preferably, in the electronic device of the present invention, the processing unit obtains a document message digest according to the document data and the mathematical function, and obtains the message digest for verification according to the verification data, the document message digest, and the mathematical function.
Preferably, in the electronic device of the present invention, the image further has a plurality of frames of first images each having a digital watermark and a plurality of frames of second images each not having the digital watermark, and the processing unit randomly selects a plurality of frames of target images from the images and determines whether the target digital watermark can be obtained from the target images, so as to determine whether the target digital watermark can be obtained from the video.
Preferably, in the electronic device of the present invention, the digital watermark of each first image stored in the storage unit is a character with the verification code, and the processing unit obtains the verification code according to the target digital watermark by using a character recognition technology.
Preferably, in the electronic device of the present invention, the electronic signature stored in the storage unit further includes position information of a plurality of target pixels associated with each first image and combination sequence information of partial bits associated with the target pixels, and the processing unit obtains the target pixels of the target image according to the target image with the target digital watermark and the corresponding position information, and combines partial bits in the target pixels according to the target image with the target digital watermark and the corresponding combination sequence information to obtain the verification code.
Preferably, in the electronic device of the present invention, the storage unit further stores a count value and a threshold value, when the processing unit determines that the target digital watermark cannot be obtained from the target image, the processing unit determines whether the count value is greater than the threshold value, when the processing unit determines that the count value is greater than the threshold value, the processing unit generates an electronic signature invalidation message indicating that the electronic signature is invalid, when the processing unit determines that the count value is not greater than the threshold value, the processing unit adds one to the count value, and randomly selects multiple frames of target images from the images stored in the storage unit, and then determines whether the target digital watermark can be obtained from the target images.
Preferably, in the electronic device of the present invention, the video of the electronic signature further includes an audio, the audio includes a video audio and an audio watermark, and the processing unit separates the audio from the audio watermark and converts the audio watermark into the verification code.
Preferably, the electronic device of the present invention, the image further has a plurality of frames of first images each having a digital watermark and a plurality of frames of second images not having the digital watermark, the processing unit randomly selects a plurality of frames of target images from the images stored in the storage unit and judges whether at least two digital watermarks to be compared can be obtained from the target images, when the processing unit determines that the at least two digital watermarks to be compared can be obtained from the target image, the processing unit determines whether the at least two digital watermarks to be compared are the same, to determine whether the target digital watermark can be obtained from the video, when the processing unit determines that the at least two digital watermarks to be compared are the same, i.e. it is decided that the target digital watermark can be obtained from the video, the processing unit takes the digital watermark of the target image as the target digital watermark.
The invention has the beneficial effects that: when the electronic signature is generated, the signature message abstract relevant to the file data is obtained, the digital watermark comprising the signature message abstract is added into the image received after the signature message abstract is obtained, and when the electronic signature is verified, the target digital watermark of the electronic signature is used for verifying whether the electronic signature is effective or not, so that the unique binding relationship between the image of the electronic signature and the file data is strengthened, and the non-repudiation of the electronic signature is improved.
Drawings
Other features and effects of the present invention will become apparent from the following detailed description of the embodiments with reference to the accompanying drawings, in which:
FIG. 1 is a block diagram illustrating a first embodiment of an electronic device for generating an electronic signature in accordance with the present invention;
FIG. 2 is a diagram illustrating a document data of the first embodiment of the electronic device;
FIG. 3 is a diagram illustrating the first embodiment of the electronic device adding a digital watermark including a digest of the signature message to a video;
FIG. 4 is a diagram illustrating the first embodiment of the electronic device adding an electronic signature and signature track data to the document data;
FIG. 5 is a flowchart illustrating a first embodiment of a method for generating an electronic signature with digital watermark according to the present invention;
FIG. 6 is a block diagram illustrating a second embodiment of an electronic device for generating an electronic signature in accordance with the present invention;
FIG. 7 is a flowchart illustrating a second embodiment of the method for generating an electronic signature with digital watermark according to the present invention;
FIG. 8 is a block diagram illustrating a first embodiment of an electronic device for authenticating an electronic signature in accordance with the present invention;
FIG. 9 is a flowchart illustrating a first embodiment of the method for verifying an electronic signature with digital watermark according to the present invention;
FIG. 10 is a flowchart illustrating a second embodiment of the method for verifying an electronic signature with digital watermark according to the present invention; and
FIG. 11 is a flowchart illustrating a third embodiment of the method for verifying an electronic signature with digital watermark according to the present invention.
Detailed Description
Referring to fig. 1, a first embodiment of a signature electronic device 100 of the present invention includes a shooting unit 11, an input unit 12, and a processing unit 14. The electronic device 100 is used for generating an electronic signature.
The photographing unit 11 is used for photographing a signer signing a document data during a photographing period to generate a video including a plurality of frames of images, the document data being related to a document 90 and including a document digest (as shown in fig. 2) related to the document 90.
The input unit 12 is used for generating and transmitting a plurality of track messages related to the signing track of the signer during the shooting period, and each track message comprises a coordinate position related to the input unit.
The processing unit 14 is electrically connected to the shooting unit 11 and the input unit 12.
It is to be noted that the electronic device 100 is, for example, a smart tablet or a smart phone, and the input unit 12 is, for example, a touch screen.
Referring to fig. 1, 3, 4 and 5, a first embodiment of the method for generating an electronic signature with digital watermark of the present invention is implemented by the first embodiment of the electronic device 100 for signing a signature of the present invention, and includes steps 201 to 204.
In step 201, during the shooting period of the shooting unit 11, the processing unit 14 obtains a signature message digest (message digest) related to the document digest of the document data according to the document digest of the document data and a mathematical function. It should be noted that, in the embodiment, the document data is, for example, an electronic document in pdf or doc format, and the mathematical function is, for example, a hash function (hash function), that is, the processing unit 14 performs a hash function operation on the document digest to obtain the signature message digest, but not limited thereto.
In step 202, during the shooting period of the shooting unit 11, for each image received after obtaining the digest of the signature message, after the processing unit 14 receives the image from the shooting unit 11, the processing unit 14 generates a signature track data 92 according to all track messages received before the image receiving time of the received image, and adds the signature track data 92 to the image, that is, while the shooting unit 11 shoots the signer 93, the signer 93 signs by using the input unit 12, so that the processing unit 14 combines the track messages and the image to generate the image with the signature track data 92. In this embodiment, the signature trace data 92 is, for example, a signature trace graph, and the signature trace data 92 is added to the image corresponding to the receiving time.
In step 203, during the capturing period of the capturing unit 11, when the processing unit 14 obtains the signature message digest, the processing unit 14 adds a digital watermark 91 including the signature message digest to the video 94. It is noted that in the present embodiment, the processing unit 14 adds the digital watermark 91 to the video 94 periodically, and in other embodiments, the processing unit 14 can add the digital watermark 91 to the video 94 randomly, which is not limited to this.
It is noted that in the present embodiment, the digital watermark 91 is a visible digital watermark, and the processing unit 14 adds text that is visible and includes the digest of the signature message to the image of the video.
It is further noted that in the present embodiment, step 203 is after step 202, and in other embodiments, step 203 may be before step 202.
In step 204, the processing unit 14 generates the electronic signature 95 including the video 94 processed in steps 202 and 203, and adds the electronic signature 95 and the signature track data 92 to the document data.
In the first embodiment of the method for generating an electronic signature with a digital watermark according to the present invention, after obtaining the signature message digest of the document digest related to the document data, the processing unit 14 adds the visible digital watermark 91 to the image of the video 94 in a text manner to generate the electronic signature, thereby enhancing the unique binding relationship between the image of the electronic signature and the document data and improving the non-repudiation of the electronic signature.
Referring to fig. 6, a second embodiment of the electronic signature device 100 of the present invention is similar to the first embodiment of the electronic signature device 100 of the present invention, and the differences are: the second embodiment further comprises a communication unit 13, wherein the communication unit 13 is connected to a TimeStamp Server (TimeStamp Server)6 via a communication network 5.
Referring to fig. 6 and 7, a second embodiment of the method for generating an electronic signature with digital watermark according to the present invention is implemented by the second embodiment of the electronic device 100 for signing according to the present invention, and includes steps 401 to 405.
In step 401, during the capturing period of the capturing unit 11, the processing unit 14 obtains a document message digest related to the document digest of the document data according to the document digest of the document data and a mathematical function.
In step 402, during the capturing period of the capturing unit 11, the processing unit 14 obtains a signature message digest associated with a current time and the document message digest according to the current time, the document message digest, and the mathematical function.
It should be noted that, in this embodiment, the processing unit 14 obtains the signature message digest by the timestamp server 6, and the processing unit 14 transmits the document message digest to the timestamp server 6 via the communication unit 13 via the communication network 5, so that the timestamp server 6 generates the signature message digest according to the current time, the document message digest, and the mathematical function, and encrypts the signature message digest by a private key and transmits the encrypted signature message digest to the processing unit 14 via the communication unit 13.
In other embodiments, the timestamp server 6 may also directly transmit the signature message digest to the processing unit 14 via the communication unit 13 without encrypting the signature message digest, or the processing unit 14 may directly generate the signature message digest according to the current time, the document message digest, and the mathematical function, without being limited thereto.
It is further noted that, in the present embodiment, the processing unit 14 obtains the signature message digest according to the current time, the document message digest, and the mathematical function, in other embodiments, the processing unit 14 may also obtain the signature message digest according to at least one of the current time, a document number of the document data, a device identifier associated with the electronic device 100, and a network internet protocol address associated with the electronic device 100, the document message digest, and the mathematical function, but not limited thereto.
In step 403, during the capturing period of the capturing unit 11, for each image received after obtaining the digest of the signature message, after the processing unit 14 receives the image from the capturing unit 11, the processing unit 14 generates signature trace data according to all trace messages received before the image receiving time of the received image, and adds the signature trace data to the image.
In step 404, when the processing unit 14 obtains the signature message digest during the capturing period of the capturing unit 11, the processing unit 14 adds a digital watermark including the signature message digest to the video.
It should be noted that, in the embodiment, the digital watermark is invisible, the processing unit 14 converts the digest of the signature message into a (binary code) as the digital watermark, and for each image, randomly selects a plurality of target pixels of the image, and sequentially replaces a part of bits of the target pixels with each bit of the binary code, so as to add the digital watermark to the video. For example, the image generated by the capturing unit 11 is an RGB full-color image, i.e. 3 colors of red, green and blue occupy 8 bits each, when the binary code is 8 bits, such as 10000001, the processing unit 14 will randomly fetch 3 target pixels, such as R: 00100110G: 11101001B: 11001000, first target pixel, R: 00100110G: 11001001B: 11101001, and R: 11001000G: 00100111B: 11101001, the processing unit 14 sequentially replaces each bit of the binary code with the last bit of the target pixel (excluding the blue color of the third pixel) so that the first pixel becomes R: 00100111G: 11101000B: 11001000, the second pixel becomes R: 00100110G: 11001000B: 11101000, the third pixel becomes R: 11001000G: 00100111B: 11101001. it should be noted that in other embodiments of invisible digital watermark, the video generated by the capturing unit 11 also includes a video audio, and the processing unit 14 can also convert the signature message digest into the digital audio watermark as the digital watermark, and superimpose the digital watermark on the video audio to add the digital watermark to the video, convert into the digital watermark, and add the digital watermark by, for example, encoding the signature message digest into a bit string, and embedding the bit string into the video audio, but not limited thereto.
It is further noted that in the present embodiment, step 404 is after step 403, and in other embodiments, step 404 may be before step 403.
In step 405, the processing unit 14 generates the combination sequence information including the position information of the target pixel of each image, the partial bit combination associated with the target pixel into the binary code, and the electronic signature of the video processed in steps 403 and 404, and adds the electronic signature and the signature track data to the document data.
In the second embodiment of the method for generating an electronic signature with a digital watermark according to the present invention, after the processing unit 14 obtains the file message digest related to the file digest of the file data, the communication unit 13 transmits the file message digest to the time stamp server 6, and the time stamp server 6 generates and transmits the signature message digest to the processing unit 14 according to the current time, the file message digest, and the mathematical function, and adds the invisible digital watermark to the signature message digest in the processing unit 14 in a manner of replacing part of bits of the target pixel of the video to generate the electronic signature, thereby enhancing the unique binding relationship between the image of the electronic signature and the file data and improving the non-repudiation of the electronic signature.
Referring to fig. 8, a first embodiment of the verification electronic device 300 of the present invention includes a memory unit 31 and a processing unit 32 electrically connected to the memory unit 31. The verification electronic device 300 is used for verifying an electronic signature to be verified.
The storage unit 31 stores the electronic signature to be verified, file data related to a file, a count value, and a threshold value, the file data including a document digest related to the document. The electronic signature to be verified comprises a video, a plurality of first images and a plurality of second images, wherein the video comprises a plurality of first images which are related to signature track data of a signer and respectively comprise a digital watermark, the plurality of second images are related to the signature track data of the signer and do not comprise the digital watermark, and each digital watermark comprises a verification code. It should be noted that, in the embodiment, the document data is, for example, an electronic document in pdf or doc format, and the mathematical function is, for example, a hash function, but not limited thereto.
Referring to fig. 8 and 9, a first embodiment of the electronic signature verification method with digital watermark of the present invention is implemented by the first embodiment of the verification electronic device 300 of the present invention, and includes steps 501 to 510.
In step 501, the processing unit 32 randomly selects a plurality of frames of target images from the images of the video stored in the storage unit 31.
In step 502, the processing unit 32 determines whether at least two digital watermarks to be compared can be obtained from the target image of the video. When the processing unit 32 determines that at least two digital watermarks to be compared cannot be obtained from the target image of the video, step 503 is performed; when the processing unit 32 determines that at least two digital watermarks to be compared can be obtained from the target image of the video, step 506 is performed.
In step 503, the processing unit 32 determines whether the count value is greater than the threshold value. When the processing unit 32 determines that the count value is not greater than the threshold, go to step 504; when the processing unit 32 determines that the count value is greater than the threshold value, step 505 is performed.
In step 504, the processing unit 32 increments the count value by one, and repeats step 501 to randomly select other target images.
In step 505, the processing unit 32 generates an electronic signature invalid message indicating that the electronic signature to be verified is invalid.
In step 506, the processing unit 32 determines whether the at least two digital watermarks to be compared are the same to determine whether a target digital watermark can be obtained from the target image of the video, and when the processing unit 32 determines that the at least two digital watermarks to be compared are the same, the processing unit 32 determines that the target digital watermark can be obtained from the target image of the video, and the processing unit 32 takes the digital watermark of the target image of the video as the target digital watermark, and performs step 507; when the processing unit 32 determines that the at least two digital watermarks to be compared are not completely the same, it is determined that the target digital watermark cannot be obtained from the target image of the video, and step 503 is performed.
It is to be noted that, in other embodiments, in step 502, the processing unit 32 may determine whether a to-be-compared digital watermark can be obtained from the target image of the video, and when the processing unit 32 determines that the to-be-compared digital watermark can be obtained from the target image of the video, the to-be-compared digital watermark is taken as the target digital watermark, and step 507 is performed; and when the processing unit 32 determines that the digital watermark to be compared is not obtainable from the target image of the video, step 503 is performed.
In step 507, the processing unit 32 obtains the verification code according to the target digital watermark.
It should be noted that, in the embodiment, the target digital watermark is a visible digital watermark, that is, the digital watermark of each first image is a text with the digest of the document message, and the processing unit 32 obtains the verification code according to the target digital watermark by using a character recognition (character recognition) technique, but not limited thereto.
In another embodiment where the target digital watermark is invisible, the storage unit 31 further stores position information of a plurality of target pixels associated with each first image and combination sequence information of partial bits associated with the target pixels, and in step 507, the processing unit 32 obtains the target pixels of the target image according to the target image with the target digital watermark and the corresponding position information, combines partial bits in the target pixels according to the target image with the target digital watermark and the corresponding combination sequence information, and obtains the verification code.
In step 508, the processing unit 32 obtains a verification message digest related to the document digest of the document data according to the document digest of the document data and the mathematical function.
In step 509, the processing unit 32 determines whether the verification code and the verification message digest are the same. When the processing unit 32 determines that the verification code is not the same as the verification message digest, go to step 505; when the processing unit 32 determines that the verification code is the same as the verification message digest, step 510 is performed.
In step 510, the processing unit 32 generates an electronic signature valid message indicating that the electronic signature to be verified is valid.
Referring to fig. 3, for example, after obtaining the verification code (i.e., AB123CD45E) of the digital watermark 91 of the video through steps 501 to 507 and performing hash function calculation on the document digest in step 508 to obtain the message digest for verification, if the message digest for verification is equal to the verification code, i.e., the message digest for verification is also AB123CD45E, it indicates that the electronic signature to be verified is valid.
In the first embodiment of the method for verifying an electronic signature with a digital watermark according to the present invention, the processing unit 32 randomly selects the target image of the video, determines whether at least two digital watermarks to be compared can be obtained from the target image of the video, determines whether the obtained at least two digital watermarks to be compared are the same, determines that the obtained digital watermarks are correct, and improves the correctness of digital watermark verification, and then obtains the verification code from the target digital watermark, and obtains the message digest for verification according to the file digest of the file data and the mathematical function, and then determines whether the obtained verification code is the same as the message digest for verification, so as to verify whether the electronic signature to be verified is valid, thereby improving the non-repudiation of the electronic signature.
A second embodiment of the verification electronic device 300 of the present invention is similar to the first embodiment of the verification electronic device 300 of the present invention (see fig. 8), and the differences are only: the electronic signature to be verified stored in the storage unit 31 further includes verification data, and the verification data has a time, and in other embodiments, the verification data may have at least one of the time, a file number, a device identifier, and a network internet protocol address. Referring to fig. 8 and 10, a second embodiment of the electronic signature verification method with digital watermark of the present invention is similar to the first embodiment, and is implemented by the second embodiment of the verification electronic device 300 of the present invention, and includes steps 601 to 611, wherein steps 601 to 607, 611 are respectively the same as steps 501 to 507, 509 (as fig. 9), and the difference therebetween is described below.
In step 608, the processing unit 32 obtains a document message digest related to the document data according to the document digest of the document data and the mathematical function.
In step 609, the processing unit 32 obtains a message digest for verification related to the time and the document message digest according to the time of the verification data, the document message digest, and the mathematical function. It is noted that in other embodiments where the verification data includes at least one of the time, the document number, the device identifier, and the ip address, the processing unit 32 obtains the message digest for verification based on the at least one of the verification data, the document message digest, and the mathematical function.
In step 610, the processing unit 32 determines whether the verification code and the verification message digest are the same. When the processing unit 32 determines that the verification code is not the same as the message digest for verification, go to step 605; when the processing unit 32 determines that the verification code is the same as the verification message digest, step 611 is performed.
In the second embodiment of the electronic signature verification method with digital watermark of the present invention, the digital watermark is converted into the verification code, the document message digest is obtained according to the document digest and the mathematical function of the document data, the verification message digest is obtained according to the time of the verification data, the document message digest and the mathematical function, and then whether the obtained verification code is the same as the verification message digest is determined to verify whether the electronic signature to be verified is valid, thereby improving the non-repudiation of the electronic signature.
A third embodiment of the verification electronic device 300 of the present invention is similar to the second embodiment of the verification electronic device 300 of the present invention (see fig. 8), and the differences are only: the video included in the electronic signature to be verified stored in the storage unit 31 also has an audio, the audio has a video audio and an audio watermark, and the audio watermark includes a verification code.
Referring to fig. 8 and 11, a third embodiment of the electronic signature verification method with digital watermark of the present invention is similar to the second embodiment, and is implemented by the third embodiment of the verification electronic device 300 of the present invention, and includes steps 801 to 807, wherein steps 802, 804, 805, and 807 are respectively the same as steps 605, 608, 609, and 611 (as shown in fig. 10), and the difference therebetween is described below.
In step 801, the processing unit 32 determines whether the audio watermark can be separated from the audio of the video, i.e., whether a target digital watermark can be obtained from the video. When the processing unit 32 determines that the audio watermark cannot be separated from the audio of the video, i.e., determines that the target digital watermark cannot be obtained from the video, step 802 is performed; and when the processing unit 32 determines that the audio watermark can be separated from the audio of the video, i.e., determines that the target digital watermark can be obtained from the video, then step 803 is performed.
In step 803, the processing unit 32 separates the audio watermark from the audio of the video as the target digital watermark and converts the target digital watermark into the verification code.
In step 806, the processing unit 32 determines whether the verification code and the verification message digest obtained are the same. When the processing unit 32 determines that the verification code is not the same as the verification message digest, go to step 802; when the processing unit 32 determines that the verification code is the same as the verification message digest, step 807 is performed.
In the first embodiment of the method for verifying an electronic signature with a digital watermark according to the present invention, the processing unit 32 separates the audio watermark from the audio of the video, converts the audio watermark into the verification code, obtains the document message digest according to the document digest of the document data and the mathematical function, obtains the message digest for verification according to the time of the verification data, the document message digest, and the mathematical function, and then determines whether the verification code obtained in the step is the same as the message digest for verification to verify whether the electronic signature to be verified is valid, thereby improving non-repudiation of the electronic signature.
In summary, the electronic signature generation and verification method and electronic device with digital watermark of the present invention, when generating an electronic signature, the processing unit 14 obtains the verification code related to the document data, and then adds the digital watermark including the signature message digest to the video received after obtaining the signature message digest to generate the electronic signature, and when verifying the electronic signature, the processing unit 32 verifies whether the electronic signature to be verified is valid by the digital watermark of the electronic signature to be verified, thereby strengthening the unique binding relationship between the image of the electronic signature and the document data to improve the non-repudiation of the electronic signature, and thus the object of the present invention can be achieved.
The above description is only an example of the present invention, but not intended to limit the scope of the present invention, and all simple equivalent changes and modifications made in the claims and the specification of the present invention are within the scope of the present invention.

Claims (32)

1. An electronic signature generating method with digital watermark, implemented by a processing unit, the processing unit electrically connected to a shooting unit and an input unit, the shooting unit for shooting a signer signing document data during shooting to generate a video including a plurality of frames of images and transmitting the video to the processing unit, the document data relating to a document, the input unit for generating and transmitting a plurality of track messages relating to the signer's signing track to the processing unit during the shooting, the method comprising: the method comprises the following steps:
(A) in the shooting period, obtaining a signature message abstract related to the document data according to the document data and a mathematical function;
(B) during the shooting period, for each image received by the video after obtaining the signature message abstract, after receiving the image, generating signature track data according to all track messages received before the image receiving time of the received image, and adding the signature track data into the image;
(C) adding a digital watermark comprising the signature message digest into the video when the signature message digest is obtained in the shooting period; and
(D) generating an electronic signature including the video processed by the steps (B) and (C), and adding the electronic signature to the document data.
2. The method of generating an electronic signature with a digital watermark of claim 1, wherein: in step (a), the signature message digest is further obtained according to at least one of a current time, a file number of the file data, a device identifier associated with an electronic device including the processing unit, and a network internet protocol address associated with the electronic device, and in step (D), the electronic signature further includes the at least one.
3. The method of generating an electronic signature with a digital watermark of claim 1, wherein: the processing unit is further electrically connected with a communication unit, the communication unit is connected with a time stamp server through a communication network, in the step (A), the file data is transmitted to the time stamp server through the communication unit, so that the time stamp server generates and transmits the signature message digest to the processing unit through the communication unit according to the current time, the file data and the mathematical function, and further the processing unit obtains the signature message digest, and in the step (D), the electronic signature also comprises the current time.
4. The method of generating an electronic signature with a digital watermark of claim 1, wherein: the processing unit is also electrically connected to a communication unit, the communication unit being connected to a timestamp server via a communication network, step (a) comprising the sub-steps of:
(A-1) obtaining a document message digest associated with the document data according to the document data and the mathematical function during the photographing period; and
(a-2) transmitting the document message digest to the time stamp server via the communication unit, so that the time stamp server generates and transmits the signature message digest to the processing unit via the communication unit according to the current time, the document message digest, and the mathematical function, thereby making the processing unit obtain the signature message digest;
in step (D), the electronic signature further includes the current time.
5. The method of generating an electronic signature with a digital watermark of claim 1, wherein: in step (a), the mathematical function is a hash function.
6. The method of generating an electronic signature with a digital watermark of claim 1, wherein: in step (C), for each image received after the video obtains the digest of the signature message, after receiving the image, the processing unit adds the visible text including the digest of the signature message as the digital watermark to the image, so as to add the digital watermark to the video.
7. The method of generating an electronic signature with a digital watermark of claim 1, wherein: in step (C), for each image received after the video obtained the signature message digest, after receiving the image, the processing unit converts the signature message digest into a binary code to serve as the digital watermark, and for each image, randomly selects a plurality of target pixels of the image, and sequentially replaces part of the target pixels with each bit of the binary code to add the digital watermark to the video.
8. The method of generating an electronic signature with a digital watermark of claim 1, wherein: in step (C), the processing unit converts the digest of the signature message into an audio watermark as the digital watermark, and superimposes the audio watermark on the video audio to add the digital watermark to the video.
9. An electronic signature verification method with digital watermarks, implemented by a verification processing unit electrically connected to a storage unit, the storage unit storing document data related to a document and including an electronic signature, the electronic signature including a video, the video including a plurality of images including signature track data related to a signer and the signer, and a plurality of digital watermarks, each digital watermark being a text having a verification code related to a signature message digest of the document data, the signature message digest being obtained according to the document data and a mathematical function, the method comprising: the method comprises the following steps:
(A) determining whether a target digital watermark is available from the video;
(B) when it is determined that the target digital watermark is obtainable from the video, obtaining the verification code from the target digital watermark using a character recognition technique;
(C) obtaining a message abstract for verification related to the document data according to the document data and the mathematical function;
(D) determining whether the verification code obtained in step (B) is the same as the message digest for verification; and
(E) when the verification code is judged to be the same as the message digest for verification, an electronic signature valid message indicating that the electronic signature is valid is generated.
10. The method of claim 9, wherein the method further comprises: the electronic signature further includes verification data of at least one of time, document number, device identifier, and network internet protocol address, and in step (C), the message digest for verification is further obtained according to the verification data.
11. The electronic signature verification method with digital watermark as claimed in claim 10, step (C) comprising the sub-steps of:
(C-1) obtaining a document message digest according to the document data and the mathematical function; and
(C-2) obtaining the verification message digest according to the verification data, the document message digest, and the mathematical function.
12. The method of claim 9, wherein the method further comprises: the image also having a plurality of frames of a first image each having a digital watermark and a plurality of frames of a second image not having the digital watermark, step (a) comprising the sub-steps of:
(A-1) randomly selecting a plurality of frames of target images from the images of the video; and
(a-2) determining whether the target digital watermark is obtainable from the target image to determine whether the target digital watermark is obtainable from the video.
13. The method of claim 12, wherein the method further comprises: the storage unit further stores a count value and a threshold value, and further comprises the following steps after the step (A):
(F) when it is determined that the target digital watermark is not obtainable from the target image, determining whether the count value is greater than the threshold value;
(G) generating an electronic signature invalidity message indicating that the electronic signature is invalid when it is determined that the count value is greater than the threshold value; and
(H) when it is determined that the count value is not greater than the threshold value, incrementing the count value by one, and repeating step (a).
14. The method of claim 9, wherein the method further comprises: the video of the electronic signature further comprises audio, the audio comprising video audio and an audio watermark, step (B) comprising the steps of:
(B-1) separating the audio into audio watermarks; and (B-2) converting the audio watermark into the verification code.
15. The method of claim 9, wherein the method further comprises: the image also having a plurality of frames of a first image each having a digital watermark and a plurality of frames of a second image not having the digital watermark, step (a) comprising the sub-steps of:
(A-1) randomly selecting a plurality of frames of target images from the images, and judging whether at least two digital watermarks to be compared can be obtained from the target images; and
(a-2) when it is determined that the at least two digital watermarks to be compared can be obtained from the target image, determining whether the at least two digital watermarks to be compared are identical to each other to determine whether the target digital watermark can be obtained from the video;
in the step (B), when it is determined that the at least two digital watermarks to be compared are the same, it is determined that the target digital watermark can be obtained from the video, and the digital watermark of the target image is taken as the target digital watermark.
16. An electronic signature verification method with digital watermarks is implemented by a verification processing unit which is electrically connected with a storage unit, the storage unit stores document data related to a document and including an electronic signature, the electronic signature comprises a video, the video comprises a plurality of frames of images related to signature track data of a signer and the signer, and a plurality of digital watermarks, each digital watermark comprises a verification code related to a signature message abstract of the document data, the signature message abstract is obtained according to the document data and a mathematical function, the images also comprise a plurality of first images respectively provided with digital watermarks and a plurality of second images without the digital watermarks, the electronic signature also comprises position information of a plurality of target pixels related to each first image and combination sequence information of partial bits related to the target pixels, the method is characterized in that:
(A) determining whether a target digital watermark is available from the video;
(B) when it is determined that the target digital watermark is obtainable from the video, obtaining the verification code based on the target digital watermark, step (B) comprising the sub-steps of:
(B-1) obtaining a target pixel of the target image according to the target image with the target digital watermark and the corresponding position information; and
(B-2) combining a part of bits in the target pixel according to the target image having the target digital watermark and the corresponding combination order information to obtain the verification code;
(C) obtaining a message abstract for verification related to the document data according to the document data and the mathematical function;
(D) determining whether the verification code obtained in step (B) is the same as the message digest for verification; and
(E) when the verification code is judged to be the same as the message digest for verification, an electronic signature valid message indicating that the electronic signature is valid is generated.
17. An electronic device for generating an electronic signature, comprising: comprises the following steps:
a photographing unit for photographing a signer who signs document data during photographing to generate a video including a plurality of frames of images, the document data relating to a document;
an input unit for generating and transmitting a plurality of track messages related to the signing track of the signer in the shooting period;
the processing unit is electrically connected with the shooting unit and the input unit;
wherein, during the shooting period, the processing unit obtains the signature message abstract related to the document data according to the document data and the mathematical function, and during the shooting period, for each image of the video received from the capture unit after obtaining the signature message digest, generating signature track data based on all track messages received from the input unit before an image receiving time from the reception of the image, and adding the signature track data to the image, and during the photographing period, when the signature message digest is obtained, adding a digital watermark including the signature message digest to the video, and finally, the processing unit generates the electronic signature including the video processed by the processing unit, and adds the electronic signature to the document data.
18. The electronic device of claim 17, wherein: the processing unit further obtains the signature message digest according to at least one of a current time, a file number of the file data, a device identifier associated with the electronic device, and a network internet protocol address associated with the electronic device, wherein the electronic signature further includes the at least one.
19. The electronic device of claim 17, wherein: the electronic signature device further comprises a communication unit electrically connected with the processing unit, the communication unit is connected with a timestamp server through a communication network, the processing unit transmits the file data to the timestamp server through the communication unit, so that the timestamp server generates and transmits the signature message digest to the processing unit through the communication unit according to the current time, the file data and the mathematical function, and then the processing unit obtains the signature message digest, and the electronic signature also comprises the current time.
20. The electronic device of claim 17, wherein: the electronic signature device also comprises a communication unit which is electrically connected with the processing unit, the communication unit is connected with a timestamp server through a communication network, the processing unit obtains a file message abstract related to the file data according to the file data and the mathematical function in the shooting period, and the file message abstract is transmitted to the timestamp server through the communication unit, so that the timestamp server generates and transmits the signature message abstract to the processing unit through the communication unit according to the current time, the file message abstract and the mathematical function, the processing unit obtains the signature message abstract, and the electronic signature also comprises the current time.
21. The electronic device of claim 17, wherein: the mathematical function is a hash function.
22. The electronic device of claim 17, wherein: for each image received after the video obtains the signature message digest, after receiving the image, the processing unit adds the visible text including the signature message digest as the digital watermark to the image so as to add the digital watermark to the video.
23. The electronic device of claim 17, wherein: for each image received after the video obtains the signature message digest, after the image is received, the processing unit converts the signature message digest into a binary code to be used as the digital watermark, for each image, a plurality of target pixels of the image are randomly selected, each bit of the binary code is sequentially substituted for a part of the bits of the target pixels, so that the digital watermark is added to the video, and the electronic signature further comprises position information of the target pixels of each image and combination sequence information related to the part of the bits of the target pixels to form the binary code.
24. The electronic device of claim 17, wherein: the video generated by the shooting unit further comprises video and audio, the processing unit converts the signature message abstract into an audio watermark to serve as the digital watermark, and the audio watermark is superposed on the video and audio so as to add the digital watermark into the video.
25. An electronic device for verifying an electronic signature, comprising: comprises the following steps:
the electronic signature comprises a video and a plurality of digital watermarks, wherein the video comprises a plurality of frames of images of signature track data related to signers and signers, each digital watermark is a character of a verification code of a signature message abstract related to the document data, and the signature message abstract is obtained according to the document data and a mathematical function;
the processing unit is electrically connected with the storage unit;
the processing unit determines whether a target digital watermark can be obtained from the video, when the processing unit determines that the target digital watermark can be obtained from the video, the processing unit obtains the verification code according to the target digital watermark by using a character recognition technology, obtains a message digest for verification related to the document data according to the document data and the mathematical function, determines whether the obtained verification code is the same as the message digest for verification, and generates an electronic signature valid message indicating that the electronic signature is valid when the processing unit determines that the verification code is the same as the message digest for verification.
26. The electronic device of claim 25, wherein: the electronic signature also comprises verification data of at least one of time, file number, device identifier and network internet protocol address, and the processing unit also obtains the message abstract for verification according to the verification data.
27. The electronic device of claim 26, wherein: the processing unit obtains a document message abstract according to the document data and the mathematical function, and obtains the message abstract for verification according to the verification data, the document message abstract and the mathematical function.
28. The electronic device of claim 25, wherein: the image also has a plurality of frames of first images each having a digital watermark and a plurality of frames of second images not having the digital watermark, and the processing unit randomly picks a plurality of frames of target images from the images and determines whether the target digital watermark can be obtained from the target images to determine whether the target digital watermark can be obtained from the video.
29. The electronic device of claim 28, wherein: the storage unit further stores a count value and a threshold value, the processing unit determines whether the count value is larger than the threshold value when the processing unit determines that the target digital watermark is not obtainable from the target image, the processing unit generates an electronic signature invalidity message indicating that the electronic signature is invalid when the processing unit determines that the count value is larger than the threshold value, the processing unit increments the count value when the processing unit determines that the count value is not larger than the threshold value, and randomly selects a plurality of frames of target images from the images stored in the storage unit, and then determines whether the target digital watermark is obtainable from the target images.
30. The electronic device of claim 25, wherein: the video of the electronic signature also comprises audio, the audio comprises video audio and audio watermark, the processing unit separates the audio from the audio watermark and converts the audio watermark into the verification code.
31. The electronic device of claim 25, wherein: the image also has a plurality of frames of first images each having a digital watermark and a plurality of frames of second images not having the digital watermark, the processing unit randomly selects a plurality of frames of target images from the images stored in the storage unit and judges whether at least two digital watermarks to be compared can be obtained from the target images, when the processing unit determines that the at least two digital watermarks to be compared can be obtained from the target image, the processing unit determines whether the at least two digital watermarks to be compared are the same, to determine whether the target digital watermark can be obtained from the video, when the processing unit determines that the at least two digital watermarks to be compared are the same, i.e. it is decided that the target digital watermark can be obtained from the video, the processing unit takes the digital watermark of the target image as the target digital watermark.
32. An electronic device for verifying an electronic signature, comprising: comprises the following steps:
a storage unit that stores document data related to a document and an electronic signature, the electronic signature including a video including an image having a plurality of frames of signature track data related to a signer and the signer, and a plurality of digital watermarks each having a verification code of a signature information digest related to the document data, the signature information digest being obtained according to the document data and a mathematical function, the image further having a plurality of frames of first images each having a digital watermark and a plurality of frames of second images each not having the digital watermark, the electronic signature further including position information related to a plurality of target pixels of each first image and combination order information related to partial bits of the target pixels;
the processing unit is electrically connected with the storage unit;
wherein the processing unit determines whether a target digital watermark is obtainable from the video, when the processing unit determines that the target digital watermark is obtainable from the video, the processing unit obtains a target pixel of the target image according to the target image with the target digital watermark and the corresponding position information, and according to the target image with the target digital watermark and the corresponding combination sequence information, combining partial bits in the target pixel, to obtain the verification code, and according to the document data and the mathematical function, to obtain a message abstract for verification related to the document data, and then to determine whether the obtained verification code is the same as the message abstract for verification, when the processing unit determines that the verification code is identical to the message digest for verification, the processing unit generates an electronic signature valid message indicating that the electronic signature is valid.
CN201810812416.1A 2018-05-11 2018-07-23 Electronic signature generation and verification method with digital watermark and electronic device Active CN110474773B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TW107116101 2018-05-11
TW107116101A TWI668594B (en) 2018-05-11 2018-05-11 Electronic signature generation and verification method with digital watermark and electronic device

Publications (2)

Publication Number Publication Date
CN110474773A CN110474773A (en) 2019-11-19
CN110474773B true CN110474773B (en) 2022-07-05

Family

ID=68316512

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810812416.1A Active CN110474773B (en) 2018-05-11 2018-07-23 Electronic signature generation and verification method with digital watermark and electronic device

Country Status (2)

Country Link
CN (1) CN110474773B (en)
TW (1) TWI668594B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111125646A (en) * 2019-12-04 2020-05-08 智慧神州(北京)科技有限公司 Electronic certificate generation method and device, storage medium and processor
CN113961905B (en) * 2021-12-20 2022-03-11 四川特号商盟科技有限公司 Storage method of on-line agreement signing data
TWI831646B (en) * 2023-03-15 2024-02-01 臺灣網路認證股份有限公司 Certificate issuance and document signing system and method thereof

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW531713B (en) * 2001-05-31 2003-05-11 Jung-Sing Jwo Hand-writing digital signature system and method
TW201040778A (en) * 2009-05-15 2010-11-16 Ji Jun Information Service Co Ltd Safety transmission system for portable electronic document
CN101908957A (en) * 2009-06-04 2010-12-08 机骏电脑有限公司 System for safely transmitting mobile electronic document
KR101301733B1 (en) * 2013-03-27 2013-09-10 주식회사 시큐에프엔 Method for providing digital signature on the basis of biometrics and method for verifying the digitally signed electronic document, and terminal, server, and computer-readable recording medium using the same
CN104281444A (en) * 2013-07-05 2015-01-14 云想数位科技股份有限公司 Electronic signature method
CN107959570A (en) * 2016-10-14 2018-04-24 云想科技股份有限公司 Electronic signature method with anti-counterfeiting function

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000152148A (en) * 1998-11-13 2000-05-30 Hitachi Ltd Electronic camera
US7187780B2 (en) * 2001-12-13 2007-03-06 Digimarc Corporation Image processing methods using reversible watermarking
US7515730B2 (en) * 2001-12-13 2009-04-07 Digimarc Corporation Progressive image quality control using watermarking
CN103310403B (en) * 2013-05-14 2016-03-09 深圳市威富多媒体有限公司 Hand-written feature and digital document visible watermark fusion method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW531713B (en) * 2001-05-31 2003-05-11 Jung-Sing Jwo Hand-writing digital signature system and method
TW201040778A (en) * 2009-05-15 2010-11-16 Ji Jun Information Service Co Ltd Safety transmission system for portable electronic document
CN101908957A (en) * 2009-06-04 2010-12-08 机骏电脑有限公司 System for safely transmitting mobile electronic document
KR101301733B1 (en) * 2013-03-27 2013-09-10 주식회사 시큐에프엔 Method for providing digital signature on the basis of biometrics and method for verifying the digitally signed electronic document, and terminal, server, and computer-readable recording medium using the same
CN104281444A (en) * 2013-07-05 2015-01-14 云想数位科技股份有限公司 Electronic signature method
CN107959570A (en) * 2016-10-14 2018-04-24 云想科技股份有限公司 Electronic signature method with anti-counterfeiting function

Also Published As

Publication number Publication date
CN110474773A (en) 2019-11-19
TW201947448A (en) 2019-12-16
TWI668594B (en) 2019-08-11

Similar Documents

Publication Publication Date Title
TWI624795B (en) Electronic signature generation method and system
CN111628868B (en) Digital signature generation method and device, computer equipment and storage medium
US10122710B2 (en) Binding a data transaction to a person's identity using biometrics
US11418677B2 (en) Method for preventing image modification, image capturing device and image verification method
US5907619A (en) Secure compressed imaging
CN110474773B (en) Electronic signature generation and verification method with digital watermark and electronic device
US8230216B2 (en) Information processing apparatus, control method therefor, information processing system, and program
KR20070042511A (en) Systems and methods for digital content security
CN112422751B (en) Calling method and system for displaying calling party multimedia identity based on called party
US7240205B2 (en) Systems and methods for verifying documents
CN103902925A (en) Method and equipment for digital document signature
KR20190005346A (en) Encryption and decryption method for steganography data based on moving picture
US20070253592A1 (en) Method and System for Protecting and Authenticating a Digital Image
Jansirani et al. Hi-tech authentication for pslette images using digital signature and data hiding.
Ziaullah et al. Image feature based authentication and digital signature for wireless data transmission
US7900051B2 (en) Secure multimedia data transmission method
KR102280505B1 (en) System and method for providing authenticity and integrity of electronic document
CN109214163B (en) Identity authentication method and device
CN109391616B (en) Information management method and terminal
CN117336099B (en) Signing method and signing system for intelligent contract based on block chain technology
CN116522382B (en) Application program user information protection method and system
Kumar et al. LDPC based image authentication system
CN112287399B (en) Digital signature method, system and device
Alla et al. Secure transmission of authenticated messages using new encoding scheme and steganography
Angulo Image Authentication Scheme with Tamper Localization using Reversible Watermarking

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant