CN111464555B - File signing confirmation method based on client screen video, service server, authentication server and client - Google Patents

File signing confirmation method based on client screen video, service server, authentication server and client Download PDF

Info

Publication number
CN111464555B
CN111464555B CN202010290759.3A CN202010290759A CN111464555B CN 111464555 B CN111464555 B CN 111464555B CN 202010290759 A CN202010290759 A CN 202010290759A CN 111464555 B CN111464555 B CN 111464555B
Authority
CN
China
Prior art keywords
task
file
user
app
signing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010290759.3A
Other languages
Chinese (zh)
Other versions
CN111464555A (en
Inventor
葛峰
曹容端
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Weslink Network Technology Co ltd
Original Assignee
Jiangsu Weslink Network Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Weslink Network Technology Co ltd filed Critical Jiangsu Weslink Network Technology Co ltd
Priority to CN202010290759.3A priority Critical patent/CN111464555B/en
Publication of CN111464555A publication Critical patent/CN111464555A/en
Application granted granted Critical
Publication of CN111464555B publication Critical patent/CN111464555B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/08Network architectures or network communication protocols for network security for authentication of entities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/08Network architectures or network communication protocols for network security for authentication of entities
    • H04L63/0861Network architectures or network communication protocols for network security for authentication of entities using biometrical features, e.g. fingerprint, retina-scan

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Computer Security & Cryptography (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

A file signing and confirming method based on client screen video fully uses the video capability of intelligent equipment, when a party needs to sign an electronic file, a content page of the file to be signed and a field face video of the party are enabled to synchronously appear on a screen of the equipment through a technical system, the whole operation process of the party on the file is recorded in real time through a screen recording method, and meanwhile, the signing and confirming of the electronic file with high anti-repudiation performance is completed through a human-computer interaction random authentication technology. The invention does not need to rely on intermediate media such as digital certificates and the like, and the signing confirmation is directly completed by the principal on site; the whole process of video screen recording ensures the real signing process of the signer, and has high-strength resistance; the random authentication adopted by the signing confirmation is highly associated with the content of the file, so that the electronic file is effectively prevented from being maliciously replaced.

Description

File signing confirmation method based on client screen video, service server, authentication server and client
Technical Field
The invention relates to the field of electronic document signing, in particular to a method for realizing reliable and anti-repudiation signing confirmation of an electronic file under the condition of no third-party digital certificate authentication, and specifically relates to a file signing confirmation method based on a client screen video.
Background
The common signing of the electronic document is widely established on the premise of having similar Ukey or other digital certificate intermediate media and random code verification, the digital certificate is obtained by carrying out identity authentication on a user, when the user needs to sign, the user is signed by the certificate, or the identity of the user is verified by the random code, and the correct verification code is input to represent the signing completion; whether the digital certificate or the verification code is adopted, the signature behavior is separated from the entity of the user, all related sources need to be established in the reliability degree when the digital certificate is authenticated and issued, and the user only controls the private key of the certificate, only under the condition that the user performs safety management and only control on the private key, the signature is technically presumed to be completed only by the user, and for the short message verification code mode, the short message verification code mode is established on the basis of absolute trust of a short message sending and a verifier, and in fact, the establishment of the trust is not difficult.
How to make the signing behavior of the electronic document not depend on intermediate media such as a digital certificate or a short message verification code and the like is very practical, and the method is just like paper signature in a physical environment, and has great practical significance for directly finishing reliable and repudiation-resistant document confirmation.
Disclosure of Invention
The invention aims to solve the problems, provides a file signing and confirming method based on client screen video, fully uses the video capability of intelligent equipment, enables a file content page to be signed and a field facial video of a party to be synchronously displayed on an equipment screen through a technical system when the party needs to sign a certain electronic file, records the whole operation process of the party on the file in real time through a screen recording method, and completes highly repudiation-resistant signing and confirming of the electronic file by using a man-machine interaction random authentication technology.
The technical scheme of the invention is as follows:
the invention provides a file signing and confirming method based on a client screen video, which comprises the following steps:
s1, the signing initiator accesses the service server BS, submits the file M to be signed to the BS, and specifies the ID of the user U of the signeruWherein IDuIncluding the name and ID card number of the user;
s2, BS generates task number TaskM for file M, and adds coordinate number N to each character in file MmN, M represents a file index, n represents the number of words, and generates a web page access address AdM for M;
BS numbers task M, file M and coordinate Nm(1 … n), identity information ID of user UuSynchronously sending the coordinates to an authentication server AS and numbering the coordinates N of the TaskM, the M and the M at the same timem(1...n)、IDuAdM, establishing association and recording the association into the database of the BS; the service server BS sends the signing task to the user U;
s3, downloading and running a client App by using the intelligent device through a user U, and inputting own identity information ID 'into the App'u
S4, App calls camera of intelligent device to capture facial photo Ph of user UuAnd Ph isuTogether with ID'uPerforming real-name authentication, terminating tasks which do not pass the authentication, and performing the next step when the authentication passes;
app accesses to business server BS and submits identity information ID 'of user U to BS'uRequesting to inquire whether the task is to be processed;
s5, BS ID'uInquiring records in a BS database, informing App that no task needs to be processed and inquiring about a discovery ID 'without matching content'uAnd IDuIf the comparison is consistent, the BS returns the task number TaskM and the access address AdM to the App;
s6, accessing AdM by the App, displaying the content of the file M through the screen of the intelligent device, and simultaneously enabling the intelligent device to capture the facial image of the user U in real time by the App
Figure BDA0002450310410000031
And images are combined
Figure BDA0002450310410000032
The method comprises the steps that the files M are displayed on a screen synchronously, App detects whether a face image of a user U is captured continuously and displayed on the screen in real time, and when the face image is not captured continuously, execution of a task is stopped; when the face images are captured continuously, the App starts a screen recording program, records the contents displayed on the screen of the intelligent equipment, uploads the data generated by screen recording to an authentication server AS in real time in a video stream mode, and synchronously submits task numbers TaskM and ID 'to the AS'u
S7, AS inquires the database, the task number TaskM does not exist, App is informed to terminate the task, and if the TaskM exists, ID 'is compared'uAnd IDuIf the video stream files are consistent with the coordinate numbers N of the TaskM, the M and the M, the App is informed of task termination if the video stream files are inconsistent with the coordinate numbers N of the TaskM, the M and the M, and the video stream files are stored if the video stream files are consistent with the coordinate numbers N of the TaskM, the M and the Mm(1...n)、Nm(1...n)、IDuEstablishing association and recording the association into an AS database;
s8, the user U checks the content of the file M through the screen of the intelligent device, does not agree with signing confirmation, terminates the task, agrees with signing, clicks an agreement button on the screen, and the App sends an agreement instruction of the user U and the TaskM to an authentication server AS;
s9, AS receives userInstructions to approve signing, from coordinate number NmN in (1.. N) at randomm(a) A represents the position number of the selected random character, and the position N of the file M is inquiredm(a) Corresponding characters
Figure BDA0002450310410000033
Will Nm(a) The TaskM returns to App;
s10, App sends Nm(a) Displaying the coordinate N on the screen of the intelligent device to prompt a user U to check that the coordinate in the file M is Nm(a) The position corresponds to the character, and the user U is required to fill in an input box displayed on a screen;
s11, enabling a user U to view the file M on the screen of the intelligent device at the position Nm(a) Character corresponding to position
Figure BDA0002450310410000034
Will be provided with
Figure BDA0002450310410000035
Filling an input frame displayed on a screen;
s12, App will
Figure BDA0002450310410000036
Submitting the TaskM and the TaskM to an authentication server AS, stopping a screen recording program and stopping sending a video stream to the AS;
s13, AS receives App submission
Figure BDA0002450310410000041
Will be provided with
Figure BDA0002450310410000042
And
Figure BDA0002450310410000043
comparing, if the comparison is inconsistent, returning the task failure to the App, if the comparison is consistent, the AS synthesizes the video streams received from the App to generate a video file
Figure BDA0002450310410000044
From
Figure BDA0002450310410000045
Middle extraction random picture frame fSCVA 1 is to fSCVThe face picture of the user U contained in
Figure BDA0002450310410000046
Together with identity information IDuPerforming real name authentication, failing to pass authentication, returning task failure to App, passing authentication, and AS numbering from coordinate NmN in (1.. N) at randomm(b) Querying N in file Mm(b) Corresponding characters
Figure BDA0002450310410000047
b represents the position number of the selected random word, and f isSCVExtracting the content displayed by the file M from fSCVQuery Nm(b) Corresponding characters
Figure BDA0002450310410000048
Comparison of
Figure BDA0002450310410000049
And
Figure BDA00024503104100000410
and if the comparison is inconsistent, returning a task failure to the App, if the comparison is consistent, returning a task success to the App by the AS, and informing the service server BS that the task processing of the task number TaskM is completed.
Further, in step S4, the smart device is a smart phone, a tablet computer, or another computer device with a camera; the camera is a front camera.
Further, in step S5, the real name is authenticated as the client App to take the face photo PhuTogether with ID'uAnd submitting the data to a citizen identity database for real-name authentication.
Further, the App detects whether the face image of the user U is captured continuously in real time, and the fact that the face of the user does not leave the recognition frame is judged.
Further, in step S13, the real name authentication AS is carries out face picture
Figure BDA00024503104100000411
Together with the IDuSubmitting to a citizen identity database for real-name authentication.
A business server BS adopted by a file signing and confirming method based on client screen video comprises the following modules:
a signing task receiving module: receiving the file M submitted to be signed by the signing initiator and the identity information ID of the specified signer user UuWherein IDuIncluding the name and ID card number of the user;
a signing task generating module: generating a task number TaskM for the file M, and adding a coordinate number N to each character in the file MmN, M represents a file index, n represents the number of words, and generates a web page access address AdM for M; numbering task number TaskM, file M and coordinate number NmN, identity information ID of user UuSynchronously sending the coordinates to an authentication server AS and numbering the coordinates N of the TaskM, the M and the M at the same timem(1...n)、IDuAdM establishing association and recording the association in a database; sending the signing task to a user U;
a signing task confirmation module: receiving task query information sent by signed task query module, and obtaining ID'uInquiring records in a database, informing App that no task needs to be processed and inquiring about a discovery ID 'when no matching content exists'uAnd IDuAnd if the comparison is consistent, the task number TaskM and the access address AdM are returned to the App.
A client side App adopted by a file signing and confirming method based on a client side screen video comprises the following steps:
a signing task query module: receiving identity information ID 'input by user U'uAnd calling a camera of the intelligent equipment to capture a facial photo Ph of the user UuAnd Ph isuTogether with ID'uPerforming real-name authentication, terminating tasks for which authentication is not passed, performing authentication is passedNext, carrying out the next step; visiting business server BS, submitting identity information ID of user U to BS'uRequesting to inquire whether the task is to be processed;
a first signing process execution module: receiving a task processing query result sent by a signing task confirmation module, and prompting a user if the task processing query result does not need to be processed; to be processed, according to the received task number task and the access address AdM, access AdM is performed, the content of the file M is shown through the screen of the intelligent device, and meanwhile, the intelligent device is started to capture the face image of the user U in real time
Figure BDA0002450310410000051
And images are combined
Figure BDA0002450310410000052
Displaying on the screen synchronously with the file M, detecting in real time whether the facial image of the user U is continuously captured and displayed on the screen, and terminating the execution of the task when the facial image is not continuously captured; when the face images are captured continuously, a screen recording program is started, the contents displayed on the screen of the intelligent equipment are recorded, data generated by recording the screen are uploaded to an authentication server AS in real time in a video stream mode, and task numbers TaskM and ID 'are submitted to the AS synchronously'u
When the first signing process information comparison module sends information for terminating the task, the first signing process execution module receives the termination information and prompts a user;
a second signing process execution module: receiving an instruction of approving or not approving the signing by the user U, wherein the instruction is generated after the user checks the content of the file M on a screen, the approving and signing are not approved, the task is terminated, the approving and signing are approved, an approving button is clicked on the screen, and the instruction agreed by the user U and the TaskM are sent to an authentication server AS;
a third signing process execution module: receiving N sent by the second signing process information comparison modulem(a) And TaskM, reaction of N withm(a) Displaying the coordinate N on the screen of the intelligent device to prompt a user U to check that the coordinate in the file M is Nm(a) The position corresponds to the character, and the user U is required to fill in an input box displayed on a screen;
receiving a file M viewed by a user U on a screen of the intelligent device in Nm(a) Character corresponding to position
Figure BDA0002450310410000061
Submitting the video stream and the TaskM to an authentication server AS, stopping a screen recording program and stopping sending the video stream to the AS;
and when the third signing process information comparison module sends information for terminating the task or successfully completing the task, the third signing process execution module receives the information and prompts the user.
An authentication server AS adopted by a file signing and confirming method based on client screen video comprises the following steps:
a first signing process information comparison module: receiving a screen recording data video stream sent by a signing process execution module I of App, inquiring a database, notifying the App to terminate a task if a task number TaskM does not exist, and comparing ID 'if the task number TaskM exists'uAnd IDuIf the video stream files are consistent with the coordinate numbers N of the TaskM, the M and the M, the App is informed of task termination if the video stream files are inconsistent with the coordinate numbers N of the TaskM, the M and the M, and the video stream files are stored if the video stream files are consistent with the coordinate numbers N of the TaskM, the M and the Mm(1...n)、Nm(1...n)、IDuEstablishing association and recording the association into an AS database;
a second signing process information comparison module: receiving a user signing approval instruction sent by the signing process execution module II, and numbering from the coordinate NmN in (1.. N) at randomm(a) A represents the position number of the selected random character, and the position N of the file M is inquiredm(a) Corresponding characters
Figure BDA0002450310410000062
Will Nm(a) The TaskM returns to App;
a third signing process information comparison module: receiving the transmission of the third signing process execution module
Figure BDA0002450310410000063
Will be provided with
Figure BDA0002450310410000064
And
Figure BDA0002450310410000065
comparing, if the comparison is inconsistent, returning the task failure to the App, if the comparison is consistent, the AS synthesizes the video streams received from the App to generate a video file
Figure BDA0002450310410000071
From
Figure BDA0002450310410000072
Middle extraction random picture frame fSCVA 1 is to fSCVThe face picture of the user U contained in
Figure BDA0002450310410000073
Together with identity information IDuPerforming real name authentication, failing to pass authentication, returning task failure to App, passing authentication, and AS numbering from coordinate NmN in (1.. N) at randomm(b) Querying N in file Mm(b) Corresponding characters
Figure BDA0002450310410000074
b represents the position number of the selected random word, and f isSCVExtracting the content displayed by the file M from fSCVQuery Nm(b) Corresponding characters
Figure BDA0002450310410000075
Comparison of
Figure BDA0002450310410000076
And
Figure BDA0002450310410000077
and if the comparison is inconsistent, returning a task failure to the App, if the comparison is consistent, returning a task success to the App by the AS, and informing the service server BS that the task processing of the task number TaskM is completed.
The invention has the beneficial effects that:
the invention can fully use the video capability of the intelligent device, when a party needs to sign a certain electronic document, the content page of the document to be signed and the field face video of the party are synchronously displayed on the screen of the device through the technical system, the whole operation process of the party on the document is recorded in real time through a screen recording method, and meanwhile, the highly anti-repudiation signing confirmation of the electronic document is completed by using the human-computer interaction random authentication technology.
The invention does not need to rely on intermediate media such as digital certificates and the like, and the signing confirmation is directly completed by the principal on site; the whole process of video screen recording ensures the real signing process of the signer, and has high-strength resistance; the random authentication adopted by the signing confirmation is highly associated with the content of the file, so that the electronic file is effectively prevented from being maliciously replaced.
Additional features and advantages of the invention will be set forth in the detailed description which follows.
Drawings
The above and other objects, features and advantages of the present invention will become more apparent by describing in more detail exemplary embodiments thereof with reference to the attached drawings, in which like reference numerals generally represent like parts throughout.
Fig. 1 shows a schematic structural diagram of the present invention.
Detailed Description
Preferred embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While the preferred embodiments of the present invention are shown in the drawings, it should be understood that the present invention may be embodied in various forms and should not be limited to the embodiments set forth herein.
A business server BS adopted by a file signing and confirming method based on client screen video comprises the following modules:
a signing task receiving module: receiving the file M submitted to be signed by the signing initiator and the identity information ID of the specified signer user UuWherein IDuIncluding the name and ID card number of the user;
a signing task generating module: generating a task number TaskM for the file M, and adding a coordinate number N to each character in the file MmN, M represents a file index, n represents the number of words, and generates a web page access address AdM for M; numbering task number TaskM, file M and coordinate number NmN, identity information ID of user UuSynchronously sending the coordinates to an authentication server AS and numbering the coordinates N of the TaskM, the M and the M at the same timem(1...n)、IDuAdM establishing association and recording the association in a database; sending the signing task to a user U;
a signing task confirmation module: receiving task query information sent by signed task query module, and obtaining ID'uInquiring records in a database, informing App that no task needs to be processed and inquiring about a discovery ID 'when no matching content exists'uAnd IDuAnd if the comparison is consistent, the task number TaskM and the access address AdM are returned to the App.
A client side App adopted by a file signing and confirming method based on a client side screen video comprises the following steps:
a signing task query module: receiving identity information ID 'input by user U'uAnd calling a camera of the intelligent equipment to capture a facial photo Ph of the user UuAnd Ph isuTogether with ID'uPerforming real-name authentication, terminating tasks which do not pass the authentication, and performing the next step when the authentication passes; visiting business server BS, submitting identity information ID of user U to BS'uRequesting to inquire whether the task is to be processed;
a first signing process execution module: receiving a task processing query result sent by a signing task confirmation module, and prompting a user if the task processing query result does not need to be processed; to be processed, according to the received task number task and the access address AdM, access AdM is performed, the content of the file M is shown through the screen of the intelligent device, and meanwhile, the intelligent device is started to capture the face image of the user U in real time
Figure BDA0002450310410000091
And images are combined
Figure BDA0002450310410000092
Displaying on the screen synchronously with the file M, detecting in real time whether the facial image of the user U is continuously captured and displayed on the screen, and terminating the execution of the task when the facial image is not continuously captured; when the face images are captured continuously, a screen recording program is started, the contents displayed on the screen of the intelligent equipment are recorded, data generated by recording the screen are uploaded to an authentication server AS in real time in a video stream mode, and task numbers TaskM and ID 'are submitted to the AS synchronously'u
When the first signing process information comparison module sends information for terminating the task, the first signing process execution module receives the termination information and prompts a user;
a second signing process execution module: receiving an instruction of approving or not approving the signing by the user U, wherein the instruction is generated after the user checks the content of the file N on a screen, the approving and signing are not approved, the Task is terminated, the approving and signing are approved, an approving button is clicked on the screen, and the instruction agreed by the user U and the Task are sent to an authentication server AS;
a third signing process execution module: receiving N sent by the second signing process information comparison modulem(a) And TaskM, reaction of N withm(a) Displaying the coordinate N on the screen of the intelligent device to prompt a user U to check that the coordinate in the file M is Nm(a) The position corresponds to the character, and the user U is required to fill in an input box displayed on a screen;
receiving a file M viewed by a user U on a screen of the intelligent device in Nm(a) Character corresponding to position
Figure BDA0002450310410000093
Submitting the video stream and the TaskM to an authentication server AS, stopping a screen recording program and stopping sending the video stream to the AS;
in the invention, the signing confirmation adopts the coordinate content in the file to carry out random authentication, and the authentication process is highly associated with the content of the file, thereby effectively avoiding the electronic file from being maliciously replaced.
And when the third signing process information comparison module sends information for terminating the task or successfully completing the task, the third signing process execution module receives the information and prompts the user.
An authentication server AS adopted by a file signing and confirming method based on client screen video comprises the following steps:
a first signing process information comparison module: receiving a screen recording data video stream sent by a signing process execution module I of App, inquiring a database, notifying the App to terminate a task if a task number TaskM does not exist, and comparing ID 'if the task number TaskM exists'uAnd IDuIf the video stream files are consistent with the coordinate numbers N of the TaskM, the M and the M, the App is informed of task termination if the video stream files are inconsistent with the coordinate numbers N of the TaskM, the M and the M, and the video stream files are stored if the video stream files are consistent with the coordinate numbers N of the TaskM, the M and the Mm(1…n)、Nm(1...n)、IDuEstablishing association and recording the association into an AS database;
a second signing process information comparison module: receiving a user signing approval instruction sent by the signing process execution module II, and numbering from the coordinate NmN in (1.. N) at randomm(a) A represents the position number of the selected random character, and the position N of the file M is inquiredm(a) Corresponding characters
Figure BDA0002450310410000101
Will Nm(a) The TaskM returns to App;
a third signing process information comparison module: receiving the transmission of the third signing process execution module
Figure BDA0002450310410000102
Will be provided with
Figure BDA0002450310410000103
And
Figure BDA0002450310410000104
comparing, if the comparison is inconsistent, returning the task failure to the App, if the comparison is consistent, the AS synthesizes the video streams received from the App to generate a video file
Figure BDA0002450310410000105
From
Figure BDA0002450310410000106
Middle extraction random picture frame fSCVA 1 is to fSCVThe face picture of the user U contained in
Figure BDA0002450310410000107
Together with identity information IDuPerforming real name authentication, failing to pass authentication, returning task failure to App, passing authentication, and AS numbering from coordinate NmN in (1.. N) at randomm(b) Querying N in file Mm(b) Corresponding characters
Figure BDA0002450310410000108
b represents the position number of the selected random word, and f isSCVExtracting the content displayed by the file M from fSCVQuery Nm(b) Corresponding characters
Figure BDA0002450310410000109
Comparison of
Figure BDA00024503104100001010
And
Figure BDA00024503104100001011
and if the comparison is inconsistent, returning a task failure to the App, if the comparison is consistent, returning a task success to the App by the AS, and informing the service server BS that the task processing of the task number TaskM is completed.
The whole signing process video recording screen ensures the real signing process of the signer, and has high-strength anti-denial performance.
In the specific implementation:
the invention provides a file signing and confirming method based on a client screen video, which comprises the following steps:
s1, the signing initiator accesses the service server BS, submits the file M to be signed to the BS, and specifies the ID of the user U of the signeruWherein IDuIncluding the name and ID card number of the user;
s2, BS isThe file M generates a task number TaskM, and simultaneously, a coordinate number N is added to each character in the file MmN, M represents a file index, n represents the number of words, and generates a web page access address AdM for M;
BS numbers task M, file M and coordinate NmN, identity information ID of user UuSynchronously sending the coordinates to an authentication server AS and numbering the coordinates N of the TaskM, the M and the M at the same timem(1...n)、IDuAdM, establishing association and recording the association into the database of the BS; the service server BS sends the signing task to the user U;
s3, downloading and running a client App by using the intelligent device through a user U, and inputting own identity information ID 'into the App'u
S4, App calls camera of intelligent device to capture facial photo Ph of user UuAnd Ph isuTogether with ID'uPerforming real-name authentication, terminating tasks which do not pass the authentication, and performing the next step when the authentication passes;
app accesses to business server BS and submits identity information ID 'of user U to BS'uRequesting to inquire whether the task is to be processed;
s5, BS ID'uInquiring records in a BS database, informing App that no task needs to be processed and inquiring about a discovery ID 'without matching content'uAnd IDuIf the comparison is consistent, the BS returns the task number TaskM and the access address AdM to the App;
s6, accessing AdM by the App, displaying the content of the file M through the screen of the intelligent device, and simultaneously enabling the intelligent device to capture the facial image of the user U in real time by the App
Figure BDA0002450310410000111
And images are combined
Figure BDA0002450310410000112
The method comprises the steps that the files M are displayed on a screen synchronously, App detects whether a face image of a user U is captured continuously and displayed on the screen in real time, and when the face image is not captured continuously, execution of a task is stopped; app starts when facial images are continuously capturedA screen recording program which records the content displayed on the screen of the intelligent equipment, uploads the data generated by screen recording to an authentication server AS in real time in a video stream mode, and synchronously submits task numbers TaskM and ID 'to the AS'u
S7, AS inquires the database, the task number TaskM does not exist, App is informed to terminate the task, and if the TaskM exists, ID 'is compared'uAnd IDuIf the video stream files are consistent with the coordinate numbers N of the TaskM, the M and the M, the App is informed of task termination if the video stream files are inconsistent with the coordinate numbers N of the TaskM, the M and the M, and the video stream files are stored if the video stream files are consistent with the coordinate numbers N of the TaskM, the M and the Mm(1...n)、Nm(1...n)、IDuEstablishing association and recording the association into an AS database;
s8, the user U checks the content of the file M through the screen of the intelligent device, does not agree with signing confirmation, terminates the task, agrees with signing, clicks an agreement button on the screen, and the App sends an agreement instruction of the user U and the TaskM to an authentication server AS;
s9, AS receives the order of user' S approval, and sends the order to coordinate number NmN in (1.. N) at randomm(a) A represents the position number of the selected random character, and the position N of the file M is inquiredm(a) Corresponding characters
Figure BDA0002450310410000121
Will Nm(a) The TaskM returns to App;
s10, App sends Nm(a) Displaying the coordinate N on the screen of the intelligent device to prompt a user U to check that the coordinate in the file M is Nm(a) The position corresponds to the character, and the user U is required to fill in an input box displayed on a screen;
s11, enabling a user U to view the file M on the screen of the intelligent device at the position Nm(a) Character corresponding to position
Figure BDA0002450310410000122
Will be provided with
Figure BDA0002450310410000123
Filling an input frame displayed on a screen;
s12, App will
Figure BDA0002450310410000124
Submitting the TaskM and the TaskM to an authentication server AS, stopping a screen recording program and stopping sending a video stream to the AS;
s13, AS receives App submission
Figure BDA0002450310410000125
Will be provided with
Figure BDA0002450310410000126
And
Figure BDA0002450310410000127
comparing, if the comparison is inconsistent, returning the task failure to the App, if the comparison is consistent, the AS synthesizes the video streams received from the App to generate a video file
Figure BDA0002450310410000128
From
Figure BDA0002450310410000129
Middle extraction random picture frame fSCVA 1 is to fSCVThe face picture of the user U contained in
Figure BDA00024503104100001210
Together with identity information IDuPerforming real name authentication, failing to pass authentication, returning task failure to App, passing authentication, and AS numbering from coordinate NmN in (1.. N) at randomm(b) Querying N in file Mm(b) Corresponding characters
Figure BDA0002450310410000131
b represents the position number of the selected random word, and f isSCVExtracting the content displayed by the file M from fSCVQuery Nm(b) Corresponding characters
Figure BDA0002450310410000132
Comparison of
Figure BDA0002450310410000133
And
Figure BDA0002450310410000134
and if the comparison is inconsistent, returning a task failure to the App, if the comparison is consistent, returning a task success to the App by the AS, and informing the service server BS that the task processing of the task number TaskM is completed.
Further, in step S4, the smart device is a smart phone, a tablet computer, or another computer device with a camera; the camera is a front camera.
Further, in step S5, the real name is authenticated as the client App to take the face photo PhuTogether with ID'uAnd submitting the data to a citizen identity database for real-name authentication.
Further, the App detects whether the face image of the user U is captured continuously in real time, and the fact that the face of the user does not leave the recognition frame is judged.
Further, in step S13, the real name authentication AS is carries out face picture
Figure BDA0002450310410000135
Together with the IDuSubmitting to a citizen identity database for real-name authentication.
Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments.

Claims (8)

1. A file signing and confirming method based on a client-side screen video is characterized by comprising the following steps:
s1, the signing initiator accesses the service server BS, submits the file M to be signed to the BS, and specifies the ID of the user U of the signeruWherein IDuIncluding the name and ID card number of the user;
s2, BS generates task number TaskM for file M, and adds coordinate number N to each character in file MmN, M represents a file index, n represents the number of words, and generates a web page access address AdM for M;
BS numbers task M, file M and coordinate NmN, identity information ID of user UuSynchronously sending the coordinates to an authentication server AS and numbering the coordinates N of the TaskM, the M and the M at the same timem(1...n)、IDuAdM, establishing association and recording the association into the database of the BS; the service server BS sends the signing task to the user U;
s3, downloading and running a client App by using the intelligent device through a user U, and inputting own identity information ID 'into the App'u
S4, App calls camera of intelligent device to capture facial photo Ph of user UuAnd Ph isuTogether with ID'uPerforming real-name authentication, terminating tasks which do not pass the authentication, and performing the next step when the authentication passes;
app accesses to business server BS and submits identity information ID 'of user U to BS'uRequesting to inquire whether the task is to be processed;
s5, BS ID'uInquiring records in a BS database, informing App that no task needs to be processed and inquiring about a discovery ID 'without matching content'uAnd IDuIf the comparison is consistent, the BS returns the task number TaskM and the access address AdM to the App;
s6, accessing AdM by the App, displaying the content of the file M through the screen of the intelligent device, and simultaneously enabling the intelligent device to capture the facial image of the user U in real time by the App
Figure FDA0002450310400000011
And images are combined
Figure FDA0002450310400000012
The method comprises the steps that the files M are displayed on a screen synchronously, App detects whether a face image of a user U is captured continuously and displayed on the screen in real time, and when the face image is not captured continuously, execution of a task is stopped; when the face is facingWhen the images are captured continuously, the App starts a screen recording program, records the content displayed on the screen of the intelligent equipment, uploads the data generated by screen recording to an authentication server AS in real time in a video stream mode, and synchronously submits task numbers TaskM and ID 'to the AS'u
S7, AS inquires the database, the task number TaskM does not exist, App is informed to terminate the task, and if the TaskM exists, ID 'is compared'uAnd IDuIf the video stream files are consistent with the coordinate numbers N of the TaskM, the M and the M, the App is informed of task termination if the video stream files are inconsistent with the coordinate numbers N of the TaskM, the M and the M, and the video stream files are stored if the video stream files are consistent with the coordinate numbers N of the TaskM, the M and the Mm(1...n)、Nm(1...n)、IDuEstablishing association and recording the association into an AS database;
s8, the user U checks the content of the file M through the screen of the intelligent device, does not agree with signing confirmation, terminates the task, agrees with signing, clicks an agreement button on the screen, and the App sends an agreement instruction of the user U and the TaskM to an authentication server AS;
s9, AS receives the order of user' S approval, and sends the order to coordinate number NmN in (1.. N) at randomm(a) A represents the position number of the selected random character, and the position N of the file M is inquiredm(a) Corresponding characters
Figure FDA0002450310400000021
Will Nm(a) The TaskM returns to App;
s10, App sends Nm(a) Displaying the coordinate N on the screen of the intelligent device to prompt a user U to check that the coordinate in the file M is Nm(a) The position corresponds to the character, and the user U is required to fill in an input box displayed on a screen;
s11, enabling a user U to view the file M on the screen of the intelligent device at the position Nm(a) Character corresponding to position
Figure FDA0002450310400000022
Will be provided with
Figure FDA0002450310400000023
Filling an input box displayed on a screen;
s12, App will
Figure FDA0002450310400000024
Submitting the TaskM and the TaskM to an authentication server AS, stopping a screen recording program and stopping sending a video stream to the AS;
s13, AS receives App submission
Figure FDA0002450310400000025
Will be provided with
Figure FDA0002450310400000026
And
Figure FDA0002450310400000027
comparing, if the comparison is inconsistent, returning the task failure to the App, if the comparison is consistent, the AS synthesizes the video streams received from the App to generate a video file
Figure FDA0002450310400000028
From
Figure FDA0002450310400000029
Middle extraction random picture frame fSCVA 1 is to fSCVThe face picture of the user U contained in
Figure FDA00024503104000000210
Together with identity information IDuPerforming real name authentication, failing to pass authentication, returning task failure to App, passing authentication, and AS numbering from coordinate NmN in (1.. N) at randomm(b) Querying N in file Mm(b) Corresponding characters
Figure FDA0002450310400000031
b represents the position number of the selected random word, and f isSCVExtracting the content displayed by the file M from fSCVQuery Nm(b) Corresponding textCharacter (Chinese character)
Figure FDA0002450310400000032
Comparison of
Figure FDA0002450310400000033
And
Figure FDA0002450310400000034
and if the comparison is inconsistent, returning a task failure to the App, if the comparison is consistent, returning a task success to the App by the AS, and informing the service server BS that the task processing of the task number TaskM is completed.
2. The client-side-screen-video-based file signing and verifying method of claim 1, wherein in step S4, the smart device is a smart phone, a tablet computer or other computer device with a camera; the camera is a front camera.
3. The client screen recording-based file signing validation method of claim 1, wherein in step S5, real name authentication is that the client App sends facial photo PhuTogether with ID'uAnd submitting the data to a citizen identity database for real-name authentication.
4. The client-side-screen-video-based file signing confirmation method of claim 1, wherein the App detects whether the facial image of the user U is continuously captured in real time to judge whether the face of the user has left the recognition box.
5. The client-side-screen-recording-based file signing validation method of claim 1, wherein in step S13, the real-name authentication is AS to identify the facial picture
Figure FDA0002450310400000035
Together with the IDuSubmitting to a citizen identity database for real-name authentication.
6. A service server BS for use in the method for client-side-screen-recording-based document signing validation according to any one of claims 1 to 5, characterized in that the server comprises the following modules:
a signing task receiving module: receiving the file M submitted to be signed by the signing initiator and the identity information ID of the specified signer user UuWherein IDuIncluding the name and ID card number of the user;
a signing task generating module: generating a task number TaskM for the file M, and adding a coordinate number N to each character in the file MmN, M represents a file index, n represents the number of words, and generates a web page access address AdM for M; numbering task number TaskM, file M and coordinate number NmN, identity information ID of user UuSynchronously sending the coordinates to an authentication server AS and numbering the coordinates N of the TaskM, the M and the M at the same timem(1...n)、IDuAdM establishing association and recording the association in a database; sending the signing task to a user U;
a signing task confirmation module: receiving task query information sent by signed task query module, and obtaining ID'uInquiring records in a database, informing App that no task needs to be processed and inquiring about a discovery ID 'when no matching content exists'uAnd IDuAnd if the comparison is consistent, the task number TaskM and the access address AdM are returned to the App.
7. A client App for use in the method for signature validation of a file based on a client screen recording according to any one of claims 1 to 5, wherein the client App comprises:
a signing task query module: receiving identity information ID 'input by user U'uAnd calling a camera of the intelligent equipment to capture a facial photo Ph of the user UuAnd Ph isuTogether with ID'uPerforming real-name authentication, terminating tasks which do not pass the authentication, and performing the next step when the authentication passes; visiting business server BS, submitting identity information ID of user U to BS'uRequesting to inquire whether the task is to be processed;
a first signing process execution module: receiving a task processing query result sent by a signing task confirmation module, and prompting a user if the task processing query result does not need to be processed; to be processed, according to the received task number task and the access address AdM, access AdM is performed, the content of the file M is shown through the screen of the intelligent device, and meanwhile, the intelligent device is started to capture the face image of the user U in real time
Figure FDA0002450310400000041
And images are combined
Figure FDA0002450310400000042
Displaying on the screen synchronously with the file M, detecting in real time whether the facial image of the user U is continuously captured and displayed on the screen, and terminating the execution of the task when the facial image is not continuously captured; when the face images are captured continuously, a screen recording program is started, the contents displayed on the screen of the intelligent equipment are recorded, data generated by recording the screen are uploaded to an authentication server AS in real time in a video stream mode, and task numbers TaskM and ID 'are submitted to the AS synchronously'u
When the first signing process information comparison module sends information for terminating the task, the first signing process execution module receives the termination information and prompts a user;
a second signing process execution module: receiving an instruction of approving or not approving the signing by the user U, wherein the instruction is generated after the user checks the content of the file M on a screen, the approving and signing are not approved, the task is terminated, the approving and signing are approved, an approving button is clicked on the screen, and the instruction agreed by the user U and the TaskM are sent to an authentication server AS;
a third signing process execution module: receiving N sent by the second signing process information comparison modulem(a) And TaskM, reaction of N withm(a) Displaying the coordinate N on the screen of the intelligent device to prompt a user U to check that the coordinate in the file M is Nm(a) The position corresponds to the character, and the user U is required to fill in an input box displayed on a screen;
receiving a file M viewed by a user U on a screen of the intelligent device in Nm(a) Position correspondenceCharacter of
Figure FDA0002450310400000051
Submitting the video stream and the TaskM to an authentication server AS, stopping a screen recording program and stopping sending the video stream to the AS;
and when the third signing process information comparison module sends information for terminating the task or successfully completing the task, the third signing process execution module receives the information and prompts the user.
8. An authentication server AS for use in the method for client-side-screen-recording-based document signing validation according to any of claims 1 to 5, the authentication server AS comprising:
a first signing process information comparison module: receiving a screen recording data video stream sent by a signing process execution module I of App, inquiring a database, notifying the App to terminate a task if a task number TaskM does not exist, and comparing ID 'if the task number TaskM exists'uAnd IDuIf the video stream files are consistent with the coordinate numbers N of the TaskM, the M and the M, the App is informed of task termination if the video stream files are inconsistent with the coordinate numbers N of the TaskM, the M and the M, and the video stream files are stored if the video stream files are consistent with the coordinate numbers N of the TaskM, the M and the Mm(1...n)、Nm(1...n)、IDuEstablishing association and recording the association into an AS database;
a second signing process information comparison module: receiving a user signing approval instruction sent by the signing process execution module II, and numbering from the coordinate NmN in (1.. N) at randomm(a) A represents the position number of the selected random character, and the position N of the file M is inquiredm(a) Corresponding characters
Figure FDA0002450310400000052
Will Nm(a) The TaskM returns to App;
a third signing process information comparison module: receiving the transmission of the third signing process execution module
Figure FDA0002450310400000053
Will be provided with
Figure FDA0002450310400000054
And
Figure FDA0002450310400000055
comparing, if the comparison is inconsistent, returning the task failure to the App, if the comparison is consistent, the AS synthesizes the video streams received from the App to generate a video file
Figure FDA0002450310400000056
From
Figure FDA0002450310400000057
Middle extraction random picture frame fSCVA 1 is to fSCVThe face picture of the user U contained in
Figure FDA0002450310400000061
Together with identity information IDuPerforming real name authentication, failing to pass authentication, returning task failure to App, passing authentication, and AS numbering from coordinate NmN in (1.. N) at randomm(b) Querying N in file Mm(b) Corresponding characters
Figure FDA0002450310400000062
b represents the position number of the selected random word, and f isSCVExtracting the content displayed by the file M from fSCVQuery Nm(b) Corresponding characters
Figure FDA0002450310400000063
Comparison of
Figure FDA0002450310400000064
And
Figure FDA0002450310400000065
if the comparison is inconsistent, the task is failed to be returned to the App, if the comparison is consistent, the AS returns the task success to the App and informs the service server BS of the task number TaskMAnd the task processing is completed.
CN202010290759.3A 2020-04-14 2020-04-14 File signing confirmation method based on client screen video, service server, authentication server and client Active CN111464555B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010290759.3A CN111464555B (en) 2020-04-14 2020-04-14 File signing confirmation method based on client screen video, service server, authentication server and client

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010290759.3A CN111464555B (en) 2020-04-14 2020-04-14 File signing confirmation method based on client screen video, service server, authentication server and client

Publications (2)

Publication Number Publication Date
CN111464555A CN111464555A (en) 2020-07-28
CN111464555B true CN111464555B (en) 2021-10-15

Family

ID=71680464

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010290759.3A Active CN111464555B (en) 2020-04-14 2020-04-14 File signing confirmation method based on client screen video, service server, authentication server and client

Country Status (1)

Country Link
CN (1) CN111464555B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113673988A (en) * 2021-08-02 2021-11-19 苏州优炫智能科技有限公司 Electronic contract online transaction method and transaction system
CN113821768A (en) * 2021-09-22 2021-12-21 北京金和网络股份有限公司 Electronic collaboration security guarantee method
CN114676409A (en) * 2022-02-28 2022-06-28 广西柳钢东信科技有限公司 Online electronic signing method based on mobile phone screen video and AI voice synthesis
CN115904296B (en) * 2023-03-09 2023-05-09 江苏北弓智能科技有限公司 Double-record screen-throwing signing service system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105591744A (en) * 2014-10-24 2016-05-18 金联汇通信息技术有限公司 Network real-name authentication method and system
CN109190347A (en) * 2018-08-17 2019-01-11 江苏诺安科技有限公司 A kind of electric endorsement method
CN110098932A (en) * 2019-05-16 2019-08-06 江苏慧世联网络科技有限公司 A kind of electronic document signature method based on safe electronic notarization technology
CN110557376A (en) * 2019-08-01 2019-12-10 平安科技(深圳)有限公司 Electronic contract signing method, electronic contract signing device, computer equipment and storage medium
CN110943844A (en) * 2019-11-22 2020-03-31 江苏慧世联网络科技有限公司 Electronic document security signing method and system based on local service of webpage client

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106295405B (en) * 2016-07-25 2019-02-12 飞天诚信科技股份有限公司 A kind of method and server for concluding electronic contract

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105591744A (en) * 2014-10-24 2016-05-18 金联汇通信息技术有限公司 Network real-name authentication method and system
CN109190347A (en) * 2018-08-17 2019-01-11 江苏诺安科技有限公司 A kind of electric endorsement method
CN110098932A (en) * 2019-05-16 2019-08-06 江苏慧世联网络科技有限公司 A kind of electronic document signature method based on safe electronic notarization technology
CN110557376A (en) * 2019-08-01 2019-12-10 平安科技(深圳)有限公司 Electronic contract signing method, electronic contract signing device, computer equipment and storage medium
CN110943844A (en) * 2019-11-22 2020-03-31 江苏慧世联网络科技有限公司 Electronic document security signing method and system based on local service of webpage client

Also Published As

Publication number Publication date
CN111464555A (en) 2020-07-28

Similar Documents

Publication Publication Date Title
CN111464555B (en) File signing confirmation method based on client screen video, service server, authentication server and client
CN110098932B (en) Electronic document signing method based on safe electronic notarization technology
KR101883156B1 (en) System and method for authentication, user terminal, authentication server and service server for executing the same
US7086085B1 (en) Variable trust levels for authentication
EP2929479B1 (en) Method and apparatus of account login
US7337324B2 (en) System and method for non-interactive human answerable challenges
CN108764848B (en) Electronic contract signing method and system
TWI616821B (en) Bar code generation method, bar code based authentication method and related terminal
US7996677B2 (en) Digitally certified stationery
KR101896351B1 (en) Giving and taking about writing with hand and non-face-to-face type electric contract system, and method thereof
CN110598460B (en) Block chain-based electronic signature method and device and storage medium
CN110930150A (en) Voucher generation method, voucher signature device, voucher verification method, voucher generation device, voucher verification device, and storage medium
CN115022047A (en) Account login method and device based on multi-cloud gateway, computer equipment and medium
CN111681141B (en) File authentication method, file authentication device and terminal equipment
CN106559433B (en) Method and system for fixing electronic evidence and user identity by using digital certificate
US20160344558A1 (en) System and Method for Obtaining Authorization
CN113626880B (en) Mobile interactive electronic signature method
CN108833105B (en) Electronic signature method and device
TWI809552B (en) Biometrics willingness signature generating device, system and the method for electronics document
CN115310141A (en) Document authentication method based on notarization and signing of notarization system
CN111641604B (en) Signing method based on online banking certificate and signing system based on online banking certificate
CN111681009A (en) Multi-platform centralized authentication and authorization system and method, authentication and authorization and service device
CN109544325A (en) Switching method, device and the computer equipment of face label system based on data processing
US11971929B2 (en) Secure signing method, device and system
EP1970849A1 (en) System and method for registering and certifying activity and/or communication between terminals

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant