CN113468987A - Electronic handwriting authentication method, system, electronic equipment and storage medium - Google Patents

Electronic handwriting authentication method, system, electronic equipment and storage medium Download PDF

Info

Publication number
CN113468987A
CN113468987A CN202110673575.XA CN202110673575A CN113468987A CN 113468987 A CN113468987 A CN 113468987A CN 202110673575 A CN202110673575 A CN 202110673575A CN 113468987 A CN113468987 A CN 113468987A
Authority
CN
China
Prior art keywords
electronic
module
electronic signature
signature
difference
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110673575.XA
Other languages
Chinese (zh)
Other versions
CN113468987B (en
Inventor
吴乐琴
覃勋辉
刘科
杨云鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Sign Digital Technology Co ltd
Original Assignee
Aoxiong Online Chongqing Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aoxiong Online Chongqing Technology Co ltd filed Critical Aoxiong Online Chongqing Technology Co ltd
Priority to CN202110673575.XA priority Critical patent/CN113468987B/en
Publication of CN113468987A publication Critical patent/CN113468987A/en
Application granted granted Critical
Publication of CN113468987B publication Critical patent/CN113468987B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures

Landscapes

  • Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The application discloses an electronic handwriting authentication method, a system, electronic equipment and a storage medium, belonging to the technical field of electronic signature, wherein the method comprises the following steps: receiving two pieces of electronic signature data to be compared; extracting electronic signature characteristics according to the electronic signature data; respectively restoring the two pieces of electronic signature data into two original signature images; calculating to obtain a difference interval according to the electronic signature characteristics; marking corresponding differences on the two original signature images according to the difference interval; and generating an identification report according to the difference interval and the characteristics. The system comprises: the device comprises a data receiving module, a feature extraction module, an image restoration module, a calculation module, a marking module and a report generation module; the method solves the problem that the traditional signature authentication mode needs to be assisted to carry out electronic handwriting analysis authentication in actual needs, and is accurate in calculation, simple in algorithm and high in efficiency.

Description

Electronic handwriting authentication method, system, electronic equipment and storage medium
Technical Field
The invention belongs to the technical field of electronic signatures, and particularly relates to an electronic handwriting authentication method, an electronic handwriting authentication system, electronic equipment and a storage medium.
Background
At present, with the popularization and promotion of networking and informatization, electronic signatures begin to become more and more popular. In the field of signature verification, as signatures are being electronized, quantitative analysis thereof is becoming more and more accessible and necessary.
In the traditional identification process of signature handwriting identity, the main method is to rely on the visual observation of handwriting by related experts, limited measurement quantification and combine the experience to give qualitative conclusion. The mode has certain improvement space, and certain errors can be caused by manual observation; in addition, the efficiency of the comparison analysis by pure manpower is insufficient,
in the prior art, although a part of algorithm schemes for signature verification exist, no system solution aiming at showing the mathematical characteristics of signature data to assist the traditional signature analysis verification is provided.
Aiming at the problem that the traditional signing mode needs to be assisted to carry out electronic handwriting analysis and identification in the prior art, an effective solution is not provided at present.
Disclosure of Invention
In order to solve the defects in the prior art, the application provides an electronic handwriting authentication method, an electronic handwriting authentication system, an electronic device and a storage medium, which just conform to the trend of signature electronization, process and analyze the electronic signature by virtue of the advantages of structuralization and high efficiency of a computer algorithm aiming at the innovation of an improved space of the traditional handwriting authentication, and display the result to an authentication analyst to assist the authentication analyst in handwriting authentication.
In a first aspect, the present application provides an electronic handwriting authentication method, including the following steps:
receiving two pieces of electronic signature data to be compared;
extracting electronic signature characteristics according to the electronic signature data;
respectively restoring the two pieces of electronic signature data into two original signature images;
calculating to obtain a difference interval according to the electronic signature characteristics;
marking corresponding differences on the two original signature images according to the difference interval;
and generating an identification report according to the difference interval and the characteristics.
The electronic signature data should at least include: the system comprises an X coordinate sequence, a Y coordinate sequence and a time sequence of signatures, wherein the time sequence is a sequence formed by time points which are in one-to-one correspondence with the X coordinate sequence and the Y coordinate sequence.
The electronic signature features include at least one of the following features: velocity, acceleration, azimuth, curvature, angular velocity, angular acceleration, total acceleration.
And calculating to obtain a difference interval according to the electronic signature characteristics, wherein the process is as follows:
preprocessing the two pieces of electronic signature data or the electronic signature characteristics;
standardizing the preprocessed electronic signature data or electronic signature characteristics to obtain two standardized sequences;
calculating Euclidean distances from each point of one standardized sequence to each point of the other sequence to form a first matrix;
creating an accumulated distance matrix with the same number of rows and columns as the first matrix;
initializing the accumulative distance matrix;
completing the initialized accumulative distance matrix;
calculating the shortest path in the accumulated distance matrix after completion;
according to the shortest path, performing interpolation processing on the two standardized sequences to obtain two standardized sequences with the same length;
and calculating the difference degree between the two standardized sequences with the same length, wherein the difference degree is a difference interval.
Marking corresponding differences on the two original signature images according to the difference interval, and the method comprises the following steps:
setting a transverse threshold and a longitudinal threshold of the difference interval;
when the difference interval is larger than the longitudinal threshold value, the difference of the two original signature images exists on the corresponding point of the difference interval, and the corresponding point is marked;
when the difference interval is less than or equal to the longitudinal threshold, the two original signature images do not have difference at the corresponding points of the difference interval, and marking is not needed;
if the difference interval of a plurality of continuous points is larger than a longitudinal threshold value, comparing the points of the plurality of continuous points with the transverse threshold value, if the points are larger than the transverse threshold value, indicating that the plurality of continuous points are in a departure interval, and marking the plurality of continuous points; if the point number is less than or equal to the transverse threshold value, the non-exclusive interval does not exist, and marking is not needed.
The shortest path in the accumulated distance matrix after completion of calculation is as follows: and searching the shortest path from the rightmost lower corner of the supplemented accumulated distance matrix to the upper left corner after the completion, and recording a series of row and column positions.
In a second aspect, the present application provides an electronic handwriting authentication system, comprising:
the device comprises a data receiving module, a feature extraction module, an image restoration module, a calculation module, a marking module and a report generation module;
the data receiving module, the feature extraction module, the image restoration module, the calculation module, the marking module and the report generation module are sequentially connected;
the data receiving module is used for receiving two pieces of electronic signature data to be compared;
the characteristic extraction module is used for extracting electronic signature characteristics according to the electronic signature data;
the image restoration module is used for restoring the two pieces of electronic signature data into two original signature images respectively;
the calculation module is used for calculating to obtain a difference interval according to the electronic signature characteristics;
the marking module is used for marking corresponding differences on the two original signature images according to the difference interval;
and the report generating module is used for generating an identification report according to the difference interval and the electronic signature characteristics.
An electronic handwriting authentication system further comprising: and the user interaction interface is respectively connected with the image restoration module and the marking module and is used for interactively marking the difference of the two original signature images with the user and interactively restoring the two original signature images with the user.
In a third aspect, the present application provides an electronic device, comprising:
one or more processors;
a memory;
one or more application programs stored in the memory and configured to be loaded and executed by the one or more processors to perform the electronic handwriting authentication method.
In a third aspect, the present application proposes a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the method for electronic handwriting authentication according to the first aspect or any one of the possible implementations of the first aspect.
The beneficial effect that this application reached:
the method has the advantages of accurate calculation, simple algorithm and high efficiency, and can preset necessary information and calculation modes of quantitative signature identification, present the necessary information and the calculation modes to a user and assist in signature identification. The signature verification method has high efficiency, science and reproducibility, and the quality level of signature verification is obviously improved.
Drawings
FIG. 1 is a flow chart of an electronic handwriting authentication method according to an embodiment of the present application;
FIG. 2 is a flowchart illustrating a method for calculating a difference interval according to an embodiment of the present disclosure;
FIG. 3 is a flowchart of an embodiment of the present application for marking a difference interval between two original signature images;
FIG. 4 is a functional block diagram of an electronic handwriting authentication system according to an embodiment of the present application;
FIG. 5 is a schematic diagram of an electronic device according to an embodiment of the present disclosure;
FIG. 6 is a flow chart of the present application, embodiment 1;
FIG. 7 is a graph of two signatures in accordance with example 1 of the present application, wherein (a) is a first signature and (b) is a second signature;
FIG. 8 shows two rotated images of the present application, in which (a) is the first rotated image and (b) is the second rotated image;
fig. 9 is a picture of a first signature dynamic image and a second signature dynamic image in the dynamic image of embodiment 1 of the present application;
FIG. 10 is a schematic diagram of the difference interval in example 1 of the present application;
FIG. 11 is a schematic view showing a part of a difference in font of embodiment 1 of the present application;
wherein,
100-electronic device, 101-processor, 102-bus, 103-memory.
Detailed Description
The present application is further described below with reference to the accompanying drawings. The following examples are only for illustrating the technical solutions of the present invention more clearly, and the protection scope of the present application is not limited thereby.
In a first aspect, the present application provides an electronic handwriting authentication method, as shown in fig. 1, including the following steps:
step S1: receiving two pieces of electronic signature data to be compared;
the electronic signature data should at least include: the system comprises an X coordinate sequence, a Y coordinate sequence and a time sequence of signatures, wherein the time sequence is a sequence formed by time points which are in one-to-one correspondence with the X coordinate sequence and the Y coordinate sequence.
To assist in the analytical authentication of electronic signatures, the user is required to send sequence data of the electronic signature, i.e., two copies of the electronically signed data to be compared, into the system. The method supports various incoming forms, and can directly transmit the data stream recorded with the signature sequence data to the system; or data collected on a collection device in the field. The system records the data transmitted by the user each time and stores the data in the database for the next use. Therefore, the data is not required to be uploaded every time, and the previously incoming data can be selected. At present, the method requires that the attribute that the incoming data must contain is the X coordinate of the signature, the Y coordinate and the timestamp T, i.e. the X coordinate sequence, the Y coordinate sequence and the time sequence corresponding to the signature, and these three attributes of the incoming data must be named strictly according to "X", "Y" and "T". Meanwhile, the system also supports quantitative analysis on other information acquired by the data of the user. A common additional attribute is pen pressure P, and some devices may also collect other information such as the tilt angle between the pen and the writing surface. The user needs to properly name the additional attributes in a manner that the user can understand the additional attributes, and all the attributes are not renameable.
Meanwhile, the method also supports the user to download the signed sequence data from the own database for customized analysis.
Step S2: extracting electronic signature characteristics according to the electronic signature data;
the electronic signature features include at least one of the following features: velocity, acceleration, azimuth, curvature, angular velocity, angular acceleration, total acceleration.
According to the data transmitted by the user, the system performs corresponding feature calculation, and then performs visualization and graphical processing on the derived features obtained by calculation and the homologous features (including X, Y coordinates, time stamps, pressure, pen point switch states, rotation angles along coordinate axes, rotation of pen axes, pen azimuth angles, pen point inclination angles and the like) and returns. The arithmetic derivative features currently available are derived based primarily on X, Y, T information, including but not limited to velocity, acceleration, azimuth, curvature, angular velocity, angular acceleration, and overall acceleration. Meanwhile, each characteristic curve graph is correspondingly marked according to the corner so as to correspond to the signature graph. Partial derivative feature calculations were chosen here as an illustration.
Several examples of calculations of derived features are illustrated below, and other features may be calculated as follows:
before calculating other derived features, the following difference calculation needs to be performed:
because the feature of the electronic signature picture is also the numerical value corresponding to each sequence point, the difference inside each index needs to be calculated by using a weighted moving average mode:
Figure BDA0003119780280000051
wherein, width is the width of single tail of the moving average window, λ is a section of weight sequence, and c is a constant which can be flexibly set according to the conditions of width and λ to control the whole size of the sequence value.
And (3) calculating the speed:
the velocity sequence v is calculated in the following mannern
Figure BDA0003119780280000061
Wherein dx is a differential sequence of the X coordinate sequence, dy is a differential sequence of the Y coordinate sequence, and dt is a differential sequence of the timestamp. N is the index number of the point location in the sequence, in other words, an electronic signature composed of N point locations, each of which must contain the information of the X coordinate, the Y left side and the timestamp T, wherein the X coordinate information of the nth point is Xn
And (3) azimuth calculation:
for the azimuth sequence, before calculating the azimuth, the entire signature image needs to be rotated.
After the rotation step is completed, the sequence of azimuths angle is calculated as followsn
Figure BDA0003119780280000062
Where, ε is a very small positive number to deal with the case where dx is 0.
And (3) curvature calculation:
the curvature was calculated using the following formula:
Figure BDA0003119780280000063
where dangle is the difference in azimuth.
Step S3: respectively restoring the two pieces of electronic signature data into two original signature images;
and performing rotation correction on the font according to the two received electronic signature data, and returning two original signature images. In the method for restoring the signature image, continuous point locations on a sequence are sequentially connected in a sequential drawing mode, and the thickness of a connecting line of the two points is determined according to pressure. The original signature images include a static image and a dynamic signature process and are marked at the corners and two original signature images are returned, this is the first return. The system would then require the user to confirm that the rotation was correct. If the rotation correction is incorrect, the user interaction interface is needed to be used, the signature image is manually rotated by the user, and then the system can rotate and correct the electronic signature data according to the operation of the user. If the automated rotational correction is correct, or the signature sequence data is adjusted according to the manual correction of the user, the system proceeds to the next step.
The reason why the corner marking is required is: 1. for the analysis of the assistant appraisers, the information value of the corners is generally considered to be higher (relative to other points, but not all), and some characteristics and habits of writers can be exposed; 2. the signature also has a certain marking effect, for example, the authenticator is interested in a certain section of the signature, which is located between the rotation angle signatures n and m, and he can correspondingly look at the speed, acceleration, rotation angle and other curves between n and m. The process of marking the corner is as follows: according to the supplementary angle of the included angle of two vectors formed by continuous three points on the sequence in sequence, if the supplementary angle is smaller than or equal to a preset angle, the point is considered as a corner point, under special conditions, the three points form a straight line when the supplementary angle is equal to 180 degrees, and the preset angle is generally 145 degrees.
And feeding back the derived characteristics and the source characteristics (including the characteristics originally contained in the user uploading data) to the user side in a visual graph mode, so that the user can view the conditions of the characteristics. In addition to looking at the visualization of individual signatures, signatures identify the most dominant or alignment between different signatures. Therefore, the method and the device support the user to select two different signatures, and the two signatures are specially processed to show the comparison condition.
Step S4: calculating to obtain a difference interval according to the electronic signature characteristics;
calculating to obtain a difference interval according to the electronic signature characteristics, as shown in fig. 2, the process is as follows:
step S4.1: preprocessing the two pieces of electronic signature data or the electronic signature characteristics;
the pretreatment comprises the following steps:
first, in the length of the sequence, the present application will rely on a Dynamic Time Warping (Dynamic Time Warping) method to align the overall strokes of two signatures. The method of stroke length alignment will be briefly presented here.
Requiring the electronic signature data or the electronic signature characteristics in the two signatures to have the same type and quantity attributes;
the necessary attributes are the X coordinate and the Y coordinate of the signature sequence, and other attributes can influence the distance of each point between the sequences and need to be selected according to the actual use condition;
the electronic signature data or electronic signature features need to be arranged in sequence in time order.
Step S4.2: standardizing the preprocessed electronic signature data or electronic signature characteristics to obtain two standardized sequences, wherein the specific process is as follows:
the average value of the corresponding attribute of the sequence is subtracted from the attribute value of each point of the sequence, and then the difference is divided by the standard deviation. It is assumed that both sequences are sequences of electronic signatures comprising X-coordinate, Y-coordinate, pen pressure P. Let S be the normalized sequence and f be the original sequence, then:
Figure BDA0003119780280000071
where a represents one of the X, Y, P attributes and i is the sequence number f mean of the point in the sequenceaMean, f _ std, representing the property of the original sequence aaRepresenting the standard deviation of the original sequence a property.
Step S4.3: calculating Euclidean distances from each point of one standardized sequence to each point of the other sequence to form a first matrix;
after normalization, the euclidean distance from each point in the two sequences to each point in the other sequence is continued to form a two-dimensional first matrix d. Assuming that the two sequences of electronic signatures are a and b in length, respectively, d is a matrix of a b. Assuming that S1 is a normalized sequence of length a and S2 is a normalized sequence of length b, the following sequences are present:
dn,m=||S1n-S2m||2
wherein 1 < n < a, 1 < m < b.
Step S4.4: creating an accumulated distance matrix with the same number of rows and columns as the first matrix;
step S4.5: initializing the accumulative distance matrix;
initializing the first row and the first column of D, then:
Figure BDA0003119780280000081
Figure BDA0003119780280000082
wherein 1 < n < a, 1 < m < b.
Step S4.6: completing the initialized accumulative distance matrix;
and (3) completing the accumulated distance matrix D, wherein the method comprises the following steps:
Dn,m=dn,m+min(Dn-1,m,Dn-1,m-1,Dn,m-1)
wherein, 1 < n < ═ a, 1 < m < ═ b. The calculation order is from top left to bottom right of the matrix.
Step S4.7: calculating the shortest path in the accumulated distance matrix after completion;
the shortest path in the accumulated distance matrix after completion of calculation is as follows: and searching the shortest path from the rightmost lower corner of the supplemented accumulated distance matrix to the upper left corner after the completion, and recording a series of row and column positions.
E.g., the current path position is in the lower right corner, i.e., D _ (a, b), then (a, b) is recorded. The next path position is min (D)a-1,b,Da-1,b-1,Da,b-1) The corresponding smallest point in the cumulative distance matrix. Assuming that D _ (a-1, b-1) is the minimum of the three, the current position is modified to D _ (a-1, b-1) and (a-1, b-1) is added to the path record.
Step S4.8: according to the shortest path, performing interpolation processing on the two standardized sequences to obtain two standardized sequences with the same length;
the row position record of all row-column pairs in the path record is the point appearance sequence of the row sequence, and the column position record is the point appearance sequence of the column sequence. For example, a is 3, b is 4, and the path is recorded as [ (1, 1), (2, 2), (2, 3), (3, 4) ]. Then the order of appearance of the points corresponding to the first sequence (the sequence with the length of 3) is [1, 2, 2, 3], i.e. the second point of the sequence a corresponds to two points 2 and 3 on b. In other words, interpolation processing is required between two points 2 and 3 in the sequence a. Based on some formed interpolation theory, interpolation processing is carried out between the two points 2 and 3 of a, so that the lengths of the last two signature sequences are consistent, and the curve is smooth.
Step S4.9: and calculating the difference degree between the two standardized sequences with the same length, wherein the difference degree is a difference interval.
Step S5: marking corresponding differences on the two original signature images according to the difference interval;
marking corresponding differences on the two original signature images according to the difference interval, as shown in fig. 3, comprising the following steps:
step S5.1: setting a transverse threshold and a longitudinal threshold of the difference interval;
step S5.2: when the difference interval is larger than the longitudinal threshold value, the difference of the two original signature images exists on the corresponding point of the difference interval, and the corresponding point is marked;
step S5.3: when the difference interval is less than or equal to the longitudinal threshold, the two original signature images do not have difference at the corresponding points of the difference interval, and marking is not needed;
step S5.4: if the difference interval of a plurality of continuous points is larger than a longitudinal threshold value, comparing the number of the points of the plurality of continuous points with the transverse threshold value;
step S5.5: if the number of points is larger than the transverse threshold value, the continuous points are in a departure interval, and then the continuous points are marked;
step S5.6: if the point number is less than or equal to the transverse threshold value, the non-exclusive interval does not exist, and marking is not needed.
The application also compares various aspects of the characteristics of the two signatures. Two electronic signatures with aligned sequence lengths and standardized attributes are obtained in the previous calculation, and it will be described how to perform alignment of each feature and automatically find out the separated regions based on two standardized electronic signature sequences with uniform length.
Let S1 and S2 be two single attribute sequences with uniform and standardized lengths, respectively, and let S _ diff be | S1-S2 |. S _ diff represents the difference between the sequences S1 and S2. Two thresholds are set to be the horizontal threshold and the vertical threshold of the difference interval respectively, and the two thresholds can be adjusted according to the individual requirements of users on visualization of the difference interval. The vertical threshold is used to determine whether there is a significant difference between certain points S1 and S2. For example, if the default vertical threshold is set to 1.3, the sequence number corresponding to the point where S _ diff > 1.3 is considered to be the sequence number of the difference between the original S1 and S2 sequences. The lateral threshold is to cope with the situation of single point mutation. Sometimes, the numerical value of some points is mutated, but the numerical value is usually at the point, and the front and the back are all non-discrete intervals. If the user wishes to view a more continuous integrated outlier, a lateral threshold can be set. For example, if the lateral threshold is set to 3, three consecutive points are necessary, and that segment is determined as the departure interval.
After the departure interval is found out, the corresponding interval is marked on the font picture, so that the user can conveniently correspond the departure interval to the position of the departure interval on the font.
Step S6: and generating an identification report according to the difference interval and the characteristics.
In the process of displaying the visual comparison graph, the comparison basis is determined according to the difference degree of the curves and a certain method, and the distance between the features is converted into the percentage of the similarity. The user is provided with a comparison of the similarity, which is at the level of each feature.
At the same time, the application can automatically generate a report of the identification. The similarity under the single characteristic is displayed as a reference when an auxiliary identification report is finally given, and an identification instruction is given by matching with corresponding characters. In addition, the present application integrates all features to give overall similarity opinions and appraisal opinions (whether the same person, not the same person, possibly not the same person, etc.). The automatically generated identification conclusion document also supports the manual modification of a user, and finally downloads and prints the identification conclusion.
In addition, the method and the device support uploading of a plurality of authentic works as a comparison basis and judge whether a new signature is counterfeit or not.
In a second aspect, the present application provides an electronic handwriting authentication system, as shown in fig. 4, comprising:
the device comprises a data receiving module, a feature extraction module, an image restoration module, a calculation module, a marking module and a report generation module;
the data receiving module, the feature extraction module, the image restoration module, the calculation module, the marking module and the report generation module are sequentially connected;
the data receiving module is used for receiving two pieces of electronic signature data to be compared;
the characteristic extraction module is used for extracting electronic signature characteristics according to the electronic signature data;
the image restoration module is used for restoring the two pieces of electronic signature data into two original signature images respectively;
the calculation module is used for calculating to obtain a difference interval according to the electronic signature characteristics;
the marking module is used for marking corresponding differences on the two original signature images according to the difference interval;
and the report generating module is used for generating an identification report according to the difference interval and the electronic signature characteristics.
An electronic handwriting authentication system further comprising: and the user interaction interface is respectively connected with the image restoration module and the marking module and is used for interactively marking the difference of the two original signature images with the user and interactively restoring the two original signature images with the user.
Sometimes the algorithm is relied on to automatically find the departure interval and align it with, and not always meet the user's requirements. Therefore, the system also supports the user to custom view the concerned signature interval. To support this functionality, the present system may enable user and machine interaction. Selecting an interesting stroke interval on the font picture by a user, and checking the expression of the interval on a certain characteristic curve; or the user selects an interested curve interval on a certain characteristic and checks the corresponding stroke of the interval on the signature font. If the user only selects one signature, the system correspondingly marks the corresponding interval on the other aligned signature; if the user has selected a target interval on both signatures that he or she believes to correspond to or wants to learn the detailed information, the system will align the two intervals and then display the image and the information about the characteristic curve.
In addition, the system can also utilize the human-machine interaction function to analyze some overall characteristics of the signature, including but not limited to font and layout characteristics. Taking the font and the layout characteristics as an example, such an overall analysis needs an external rectangle with a strict font, and the system can automatically find the external rectangle of the font by an algorithm, but sometimes, such an automatically outlined rectangle may not meet the requirements of a user, so that the user may be required to outline the external rectangle of the font by means of a human-computer interaction function.
In a third aspect, the present application provides an electronic device, as shown in fig. 5, including:
one or more processors;
a memory;
one or more application programs stored in the memory and configured to be loaded and executed by the one or more processors to perform the electronic handwriting authentication method.
As shown in fig. 5, the electronic apparatus 100 includes: a processor 101 and a memory 103. Wherein the processor 101 is coupled to the memory 103, such as via a bus 102.
The structure of the electronic device 100 is not limited to the embodiment of the present application.
The processor 101 may be a CPU, general purpose processor, DSP, ASIC, FPGA or other programmable logic device, transistor logic device, hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. The processor 101 may also be a combination of computing functions, e.g., comprising one or more microprocessors, DSPs, and microprocessors.
Bus 102 may include a path that conveys information between the aforementioned components. The bus 102 may be a PCI bus or an EISA bus, etc. The bus 102 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in FIG. 5, but this is not intended to represent only one bus or type of bus.
The memory 103 may be, but is not limited to, a ROM or other type of static storage device that can store static information and instructions, a RAM or other type of dynamic storage device that can store information and instructions, an EEPROM, a CD-ROM or other optical disk storage, optical disk storage (including compact disk, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.
In a third aspect, the present application proposes a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the method for electronic handwriting authentication according to the first aspect or any one of the possible implementations of the first aspect.
Example 1:
one embodiment of the method and system of the present application is detailed below, as shown in fig. 6:
step 1: new signature comparison analysis requirements;
step 2: two signatures that are selected for comparison are received. Taking Wangdan as an example, as shown in FIG. 7, (a) is the first signature, and (b) is the second signature.
And step 3: and restoring the original signature, automatically rotating the original signature, returning the original signature to the user, and requesting interaction. If the user is satisfied with the rotation result, the subsequent step is carried out, if the user is not satisfied with the rotation result, manual rotation is carried out, then the system carries out correction rotation according to the rotation result of the user, and after sample rotation, as shown in fig. 8, (a) is the first image after signature rotation, and (b) is the second image after signature rotation.
And 4, step 4: the signature image is returned after the strokes are aligned and marked in segments, in this embodiment, static and dynamic images are adopted, as shown in fig. 9, fig. 9 only captures one frame of picture in the dynamic image as an example, (a) is a screenshot of a first signature dynamic image, and (b) is a screenshot of a second signature dynamic image.
And 5: after the characteristic lengths are unified and normalized, the difference interval is screened out according to a threshold value, taking pressure as an example, as shown in fig. 10. Wherein the difference interval is shown in the dark rectangle.
Step 6: returning to each normalized characteristic curve and the labeled difference interval thereof, and labeling a difference part on the font according to the difference interval, as shown in fig. 11, wherein the dark part is the corresponding difference interval labeled on the font.
And 7: the method comprises the steps of requesting for interaction, wherein a user interaction interface is adopted for request interaction in the embodiment, so that a user can customize an external rectangle or an analysis interval;
and 8: the system judges whether interaction return data is received or not;
and step 9: and if the interaction return data is received, performing corresponding processing and displaying according to the user data.
Step 10: if the interactive return data is not received, automatically generating an authentication report;
step 11: judging whether manual modification is needed;
step 12: if the user needs to manually modify the authentication report, the user carries out user-defined modification by using a user interaction interface, and the user edits the authentication report;
step 13: if manual modification is not required, an authentication report is printed.
The above embodiment employs a user interactive interface and requires printing of an authentication report, completing the comparison and analysis of the two signatures.
The present applicant has described and illustrated embodiments of the present invention in detail with reference to the accompanying drawings, but it should be understood by those skilled in the art that the above embodiments are merely preferred embodiments of the present invention, and the detailed description is only for the purpose of helping the reader to better understand the spirit of the present invention, and not for limiting the scope of the present invention, and on the contrary, any improvement or modification made based on the spirit of the present invention should fall within the scope of the present invention.

Claims (10)

1. An electronic handwriting authentication method is characterized by comprising the following steps,
receiving two pieces of electronic signature data to be compared;
extracting electronic signature characteristics according to the electronic signature data;
respectively restoring the two pieces of electronic signature data into two original signature images;
calculating to obtain a difference interval according to the electronic signature characteristics;
marking corresponding differences on the two original signature images according to the difference interval;
and generating an identification report according to the difference interval and the characteristics.
2. The electronic handwriting authentication method of claim 1,
the electronic signature data should at least include: the system comprises an X coordinate sequence, a Y coordinate sequence and a time sequence of signatures, wherein the time sequence is a sequence formed by time points which are in one-to-one correspondence with the X coordinate sequence and the Y coordinate sequence.
3. The electronic handwriting authentication method of claim 1,
the electronic signature features include at least one of the following features: velocity, acceleration, azimuth, curvature, angular velocity, angular acceleration, total acceleration.
4. The electronic handwriting authentication method of claim 1,
and calculating to obtain a difference interval according to the electronic signature characteristics, wherein the process is as follows:
preprocessing the two pieces of electronic signature data or the electronic signature characteristics;
standardizing the preprocessed electronic signature data or electronic signature characteristics to obtain two standardized sequences;
calculating Euclidean distances from each point of one standardized sequence to each point of the other sequence to form a first matrix;
creating an accumulated distance matrix with the same number of rows and columns as the first matrix;
initializing the accumulative distance matrix;
completing the initialized accumulative distance matrix;
calculating the shortest path in the accumulated distance matrix after completion;
according to the shortest path, performing interpolation processing on the two standardized sequences to obtain two standardized sequences with the same length;
and calculating the difference degree between the two standardized sequences with the same length, wherein the difference degree is a difference interval.
5. The electronic handwriting authentication method of claim 1,
marking corresponding differences on the two original signature images according to the difference interval, and the method comprises the following steps:
setting a transverse threshold and a longitudinal threshold of the difference interval;
when the difference interval is larger than the longitudinal threshold value, the difference of the two original signature images exists on the corresponding point of the difference interval, and the corresponding point is marked;
when the difference interval is less than or equal to the longitudinal threshold, the two original signature images do not have difference at the corresponding points of the difference interval, and marking is not needed;
if the difference interval of a plurality of continuous points is larger than a longitudinal threshold value, comparing the number of the points of the plurality of continuous points with the transverse threshold value;
if the number of points is larger than the transverse threshold value, the continuous points are in a departure interval, and then the continuous points are marked;
if the point number is less than or equal to the transverse threshold value, the non-exclusive interval does not exist, and marking is not needed.
6. The electronic handwriting authentication method of claim 1,
the shortest path in the accumulated distance matrix after completion of calculation is as follows: and searching the shortest path from the rightmost lower corner of the supplemented accumulated distance matrix to the upper left corner after the completion, and recording a series of row and column positions.
7. An electronic handwriting authentication system, characterized in that,
the device comprises a data receiving module, a feature extraction module, an image restoration module, a calculation module, a marking module and a report generation module;
the data receiving module, the feature extraction module, the image restoration module, the calculation module, the marking module and the report generation module are sequentially connected;
the data receiving module is used for receiving two pieces of electronic signature data to be compared;
the characteristic extraction module is used for extracting electronic signature characteristics according to the electronic signature data;
the image restoration module is used for restoring the two pieces of electronic signature data into two original signature images respectively;
the calculation module is used for calculating to obtain a difference interval according to the electronic signature characteristics;
the marking module is used for marking corresponding differences on the two original signature images according to the difference interval;
and the report generating module is used for generating an identification report according to the difference interval and the electronic signature characteristics.
8. The electronic handwriting authentication system of claim 7,
the system further comprises: and the user interaction interface is respectively connected with the image restoration module and the marking module and is used for interactively marking the difference of the two original signature images with the user and interactively restoring the two original signature images with the user.
9. An electronic device, comprising:
one or more processors;
a memory;
one or more application programs stored in the memory and configured to be loaded and executed by the one or more processors to perform the electronic handwriting authentication method of any of claims 1-6.
10. A computer-readable storage medium, characterized in that,
stored thereon a computer program which can be loaded and run by a processor to perform the method of electronic handwriting authentication of any of claims 1 to 6.
CN202110673575.XA 2021-06-17 2021-06-17 Electronic handwriting authentication method, system, electronic equipment and storage medium Active CN113468987B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110673575.XA CN113468987B (en) 2021-06-17 2021-06-17 Electronic handwriting authentication method, system, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110673575.XA CN113468987B (en) 2021-06-17 2021-06-17 Electronic handwriting authentication method, system, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN113468987A true CN113468987A (en) 2021-10-01
CN113468987B CN113468987B (en) 2023-04-18

Family

ID=77870364

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110673575.XA Active CN113468987B (en) 2021-06-17 2021-06-17 Electronic handwriting authentication method, system, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113468987B (en)

Citations (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1445723A (en) * 2002-03-19 2003-10-01 株式会社富士通基本软件技术 Hand-wirte signature recognition program, method and device
CN1492365A (en) * 2002-06-13 2004-04-28 国际商业机器公司 Electronic signature verifying method and device
CN101393606A (en) * 2008-10-27 2009-03-25 浙江大学 Hand-writing verification method based visualization
CN101526992A (en) * 2008-03-03 2009-09-09 汉王科技股份有限公司 Method and device for recognizing handwritten signature and starting system by handwritten signature
CN102509117A (en) * 2011-09-30 2012-06-20 成都君晟科技有限公司 DTW (dynamic time warping) based method for automatically distinguishing abnormal measurements from plantar pressure measurement
CN102831391A (en) * 2012-07-06 2012-12-19 重庆傲雄信息技术有限公司 Method and system for recording and recognizing signature of electronic passport
CN103136546A (en) * 2013-02-05 2013-06-05 深圳市威富多媒体有限公司 Multi-dimension authentication method and authentication device of on-line signature
CN103593673A (en) * 2013-10-27 2014-02-19 沈阳建筑大学 On-line handwritten signature authentication method based on dynamic threshold
CN103927532A (en) * 2014-04-08 2014-07-16 武汉汉德瑞庭科技有限公司 Handwriting registration method based on stroke characteristics
CN104166499A (en) * 2014-07-10 2014-11-26 武汉汉德瑞庭科技有限公司 Handwriting practice system and practice handwriting automatic detecting and evaluating method
CN104200239A (en) * 2014-09-09 2014-12-10 河海大学常州校区 Image feature fusion identification based signature authentic identification system and method
CN104517094A (en) * 2013-09-30 2015-04-15 阿里巴巴集团控股有限公司 Identity authentication method and identity authentication device
CN104679538A (en) * 2013-11-28 2015-06-03 阿里巴巴集团控股有限公司 Method and client side for using handwriting to execute operation
CN104715256A (en) * 2015-03-04 2015-06-17 南昌大学 Auxiliary calligraphy exercising system and evaluation method based on image method
CN105556566A (en) * 2013-10-25 2016-05-04 株式会社和冠 Dynamic handwriting verification, handwriting-baseduser authentication, handwriting data generation, and handwriting data preservation
CN105740830A (en) * 2016-02-03 2016-07-06 西南大学附属中学校 Verification means based electronic signature identification method
CN107103289A (en) * 2017-04-06 2017-08-29 武汉理工大学 The method and system of writer verification are carried out using person's handwriting contour feature
CN107992803A (en) * 2017-11-10 2018-05-04 深圳市金立通信设备有限公司 A kind of verification method of electronic signature, terminal device and computer-readable medium
CN108139856A (en) * 2016-08-31 2018-06-08 华为技术有限公司 Signature authentication method, terminal, writing pencil and system
CN108154136A (en) * 2018-01-15 2018-06-12 众安信息技术服务有限公司 For identifying the method, apparatus of writing and computer-readable medium
CN110110605A (en) * 2019-04-10 2019-08-09 北京瀚海云鉴科技有限公司 A kind of Chinese Painting and Calligraphy handwriting verification sample database system
CN110222660A (en) * 2019-06-12 2019-09-10 河海大学常州校区 A kind of signature false distinguishing method and system merged based on dynamic with static nature
CN110232727A (en) * 2019-04-22 2019-09-13 浙江工商大学 A kind of continuous posture movement assessment intelligent algorithm
CN110458145A (en) * 2019-08-22 2019-11-15 司法鉴定科学研究院 A kind of offline person's handwriting Individual Identification System and method based on two-dimentional behavioral characteristics
CN110490153A (en) * 2019-08-22 2019-11-22 司法鉴定科学研究院 A kind of offline person's handwriting Individual Identification System and method based on Three-Dimensional Dynamic feature
CN111178254A (en) * 2019-12-27 2020-05-19 上海眼控科技股份有限公司 Signature identification method and device
CN111950334A (en) * 2019-05-17 2020-11-17 重庆傲雄在线信息技术有限公司 Method for recognizing electronic handwritten signature based on SVM
CN112084470A (en) * 2020-07-14 2020-12-15 深圳市能信安技术有限公司 User identity authentication method and device, user terminal and server
CN112487853A (en) * 2019-09-12 2021-03-12 广州慧睿思通信息科技有限公司 Handwriting comparison method and system, electronic equipment and storage medium
JP2021086255A (en) * 2019-11-26 2021-06-03 松本 隆 Pen input personal authentication method

Patent Citations (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1445723A (en) * 2002-03-19 2003-10-01 株式会社富士通基本软件技术 Hand-wirte signature recognition program, method and device
CN1492365A (en) * 2002-06-13 2004-04-28 国际商业机器公司 Electronic signature verifying method and device
CN101526992A (en) * 2008-03-03 2009-09-09 汉王科技股份有限公司 Method and device for recognizing handwritten signature and starting system by handwritten signature
CN101393606A (en) * 2008-10-27 2009-03-25 浙江大学 Hand-writing verification method based visualization
CN102509117A (en) * 2011-09-30 2012-06-20 成都君晟科技有限公司 DTW (dynamic time warping) based method for automatically distinguishing abnormal measurements from plantar pressure measurement
CN102831391A (en) * 2012-07-06 2012-12-19 重庆傲雄信息技术有限公司 Method and system for recording and recognizing signature of electronic passport
CN103136546A (en) * 2013-02-05 2013-06-05 深圳市威富多媒体有限公司 Multi-dimension authentication method and authentication device of on-line signature
CN104517094A (en) * 2013-09-30 2015-04-15 阿里巴巴集团控股有限公司 Identity authentication method and identity authentication device
CN105556566A (en) * 2013-10-25 2016-05-04 株式会社和冠 Dynamic handwriting verification, handwriting-baseduser authentication, handwriting data generation, and handwriting data preservation
CN103593673A (en) * 2013-10-27 2014-02-19 沈阳建筑大学 On-line handwritten signature authentication method based on dynamic threshold
CN104679538A (en) * 2013-11-28 2015-06-03 阿里巴巴集团控股有限公司 Method and client side for using handwriting to execute operation
CN103927532A (en) * 2014-04-08 2014-07-16 武汉汉德瑞庭科技有限公司 Handwriting registration method based on stroke characteristics
CN104166499A (en) * 2014-07-10 2014-11-26 武汉汉德瑞庭科技有限公司 Handwriting practice system and practice handwriting automatic detecting and evaluating method
CN104200239A (en) * 2014-09-09 2014-12-10 河海大学常州校区 Image feature fusion identification based signature authentic identification system and method
CN104715256A (en) * 2015-03-04 2015-06-17 南昌大学 Auxiliary calligraphy exercising system and evaluation method based on image method
CN105740830A (en) * 2016-02-03 2016-07-06 西南大学附属中学校 Verification means based electronic signature identification method
CN108139856A (en) * 2016-08-31 2018-06-08 华为技术有限公司 Signature authentication method, terminal, writing pencil and system
CN107103289A (en) * 2017-04-06 2017-08-29 武汉理工大学 The method and system of writer verification are carried out using person's handwriting contour feature
CN107992803A (en) * 2017-11-10 2018-05-04 深圳市金立通信设备有限公司 A kind of verification method of electronic signature, terminal device and computer-readable medium
CN108154136A (en) * 2018-01-15 2018-06-12 众安信息技术服务有限公司 For identifying the method, apparatus of writing and computer-readable medium
CN110110605A (en) * 2019-04-10 2019-08-09 北京瀚海云鉴科技有限公司 A kind of Chinese Painting and Calligraphy handwriting verification sample database system
CN110232727A (en) * 2019-04-22 2019-09-13 浙江工商大学 A kind of continuous posture movement assessment intelligent algorithm
CN111950334A (en) * 2019-05-17 2020-11-17 重庆傲雄在线信息技术有限公司 Method for recognizing electronic handwritten signature based on SVM
CN110222660A (en) * 2019-06-12 2019-09-10 河海大学常州校区 A kind of signature false distinguishing method and system merged based on dynamic with static nature
CN110458145A (en) * 2019-08-22 2019-11-15 司法鉴定科学研究院 A kind of offline person's handwriting Individual Identification System and method based on two-dimentional behavioral characteristics
CN110490153A (en) * 2019-08-22 2019-11-22 司法鉴定科学研究院 A kind of offline person's handwriting Individual Identification System and method based on Three-Dimensional Dynamic feature
CN112487853A (en) * 2019-09-12 2021-03-12 广州慧睿思通信息科技有限公司 Handwriting comparison method and system, electronic equipment and storage medium
JP2021086255A (en) * 2019-11-26 2021-06-03 松本 隆 Pen input personal authentication method
CN111178254A (en) * 2019-12-27 2020-05-19 上海眼控科技股份有限公司 Signature identification method and device
CN112084470A (en) * 2020-07-14 2020-12-15 深圳市能信安技术有限公司 User identity authentication method and device, user terminal and server

Non-Patent Citations (8)

* Cited by examiner, † Cited by third party
Title
ANDREAS FISCHER 等: "Robust Score Normalization for DTW-Based On-Line Signature Verification", 《2015 13TH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR)》 *
DAIGO MURAMATSU 等: "Effectiveness of Pen Pressure, Azimuth, and Altitude Features for Online Signature Verification", 《ICB 2007》 *
GHAZALEH TAHERZADEH 等: "Evaluation of Online Signature Verification Features", 《ICACT2011》 *
MOHAMMAD E. YAHYATABAR 等: "Online signature verification using double-stage feature extraction modelled by dynamic feature stability experiment", 《IET BIOMETRICS》 *
YU JIA 等: "A Two-Stage Method for Online Signature Verification Using Shape Contexts and Function Features", 《SENSORS》 *
忆风梅 等: "浅谈刑事技术工作中数码图像技术的应用", 《河南公安高等专科学校学报》 *
涂舜: "电子签名笔迹的动态特征:种类、价值及其运用", 《证据科学》 *
王杰锋 等: "移动终端手势识别中DTW匹配算法研究", 《计算机工程与应用》 *

Also Published As

Publication number Publication date
CN113468987B (en) 2023-04-18

Similar Documents

Publication Publication Date Title
CN111476227B (en) Target field identification method and device based on OCR and storage medium
TWI607387B (en) Character recognition systems and character recognition methods thereof
CN105528604B (en) A kind of bill automatic identification and processing system based on OCR
CN109740606B (en) Image identification method and device
CN112446351B (en) Intelligent identification method for medical bills
CN111046881B (en) Pointer type instrument reading identification method based on computer vision and deep learning
Li et al. Automatic comic page segmentation based on polygon detection
CN107403128A (en) A kind of item identification method and device
CN113673519B (en) Character recognition method based on character detection model and related equipment thereof
CN111738252B (en) Text line detection method, device and computer system in image
CN114881698A (en) Advertisement compliance auditing method and device, electronic equipment and storage medium
CN112036295A (en) Bill image processing method, bill image processing device, storage medium and electronic device
CN100371945C (en) Computer assisted calligraphic works distinguishing method between true and false
CN115620014B (en) Pipeline instrument flow chart information extraction method and equipment based on deep learning
CN113673500A (en) Certificate image recognition method and device, electronic equipment and storage medium
CN113158895A (en) Bill identification method and device, electronic equipment and storage medium
CN112668580A (en) Text recognition method, text recognition device and terminal equipment
CN111639643A (en) Character recognition method, character recognition device, computer equipment and storage medium
CN111476090B (en) Watermark identification method and device
CN113468987B (en) Electronic handwriting authentication method, system, electronic equipment and storage medium
CN116563876A (en) Invoice identification method
CN112396048A (en) Picture information extraction method and device, computer equipment and storage medium
CN111414728A (en) Numerical data display method and device, computer equipment and storage medium
CN111539424A (en) Image processing method, system, device and medium based on OCR
CN115527067A (en) Method, system and storage medium for verifying contents of image-text printed matter

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20220406

Address after: 401121 no.17-1, building 13, No.106, west section of Jinkai Avenue, Yubei District, Chongqing

Applicant after: CHONGQING AOS ONLINE INFORMATION TECHNOLOGY CO.,LTD.

Address before: 401121 no.17-1, building 13, No.106, west section of Jinkai Avenue, Yubei District, Chongqing

Applicant before: AoXiong online (Chongqing) Technology Co.,Ltd.

GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address
CP03 Change of name, title or address

Address after: 401121 no.17-1, building 13, No.106, west section of Jinkai Avenue, Yubei District, Chongqing

Patentee after: Chongqing Sign Digital Technology Co.,Ltd.

Country or region after: China

Address before: 401121 no.17-1, building 13, No.106, west section of Jinkai Avenue, Yubei District, Chongqing

Patentee before: CHONGQING AOS ONLINE INFORMATION TECHNOLOGY CO.,LTD.

Country or region before: China