WO2020098099A1

WO2020098099A1 - Text accuracy calculation method and apparatus based on semantic parsing, and computer device

Info

Publication number: WO2020098099A1
Application number: PCT/CN2018/124399
Authority: WO
Inventors: 吴建财; 邹芳; 邢艳
Original assignee: 平安科技（深圳）有限公司
Priority date: 2018-11-13
Filing date: 2018-12-27
Publication date: 2020-05-22
Also published as: CN109657210A; CN109657210B

Abstract

The present application relates to a text accuracy calculation method and apparatus based on semantic parsing, and a computer device. The method comprises: when any position, except a starting point, of a template text starts to be transferred, a calculation trajectory generates a trajectory matrix; calculate the similarity of each trajectory in the trajectory matrix; screen one trajectory having the highest similarity to obtain a first trajectory; obtain a new template text; then compare a part of a transferred text with the new template text; and calculate the accuracy of the part of the transferred text.

Description

Text accuracy calculation method, device and computer equipment based on semantic analysis

This application requires the priority of the Chinese patent application submitted to the China Patent Office on November 13, 2018, with the application number 2018113472352, the application name is "text-accuracy calculation method, device, and computer equipment based on semantic analysis", and its entire content Incorporated by reference in this application.

Technical field

The present application relates to the technical field of semantic parsing, in particular to a method, device, and computer equipment for calculating text accuracy based on semantic parsing.

Background technique

When calculating the accuracy of ASR (speech recognition) engine transfer, the commonly used algorithm is the edit distance algorithm. The algorithm calculates the similarity between the transferred text and the template text by counting the minimum edit operations (the edit operations include: replacing a character with another character, inserting a character, and deleting a character) times. Degree (transfer accuracy). However, in the scenario where the real-time transfer accuracy of the ASR engine is concerned, the calculation result of the algorithm is not satisfactory. Because the algorithm always compares the text that has been transferred with the entire text of the template text, when only part of the text is transferred, the algorithm cannot accurately calculate the text of the part of the transferred text Transfer accuracy. Therefore, the editing distance is not applicable in the scenario where the real-time transfer accuracy of the ASR engine is concerned.

technical problem

In view of the inadequacy of the existing technology, this application proposes a method, device, and computer equipment for calculating text accuracy based on semantic analysis, which aims to solve the existing text transfer accuracy algorithm and convert the text that has been transferred and the template text Compare all the texts, and when some texts are transferred, the accuracy of the text transfer cannot be accurately calculated.

Technical solution

The technical solutions proposed in this application are:

A text accuracy calculation method based on semantic analysis, the method includes:

Get the part of the transferred text starting from any position of the template text except the starting point;

The length of the template text characters is increased by two characters as the number of columns, and the length of the partially transferred text characters is increased by two characters as the number of lines, and an editing distance matrix is established;

Calculate the value of each element in the editing distance matrix according to the partially transferred text and the template text;

Record the calculated trajectory of each element in the edit distance matrix, and generate a trajectory matrix corresponding to the edit distance matrix;

Calculating the similarity of each trajectory in the trajectory matrix, filtering a trajectory with the highest degree of similarity between the partially transferred text and the template text to obtain a first trajectory;

According to the first trajectory, determine the start point and end point of the partially transferred text on the template text, and obtain the first start point and the first end point;

Obtain a new template text from the template text according to the first start point and the first end point;

Compare the partially transferred text with the new template text, and calculate the accuracy of the partially transferred text through an edit distance algorithm.

The present application also provides a text accuracy calculation device based on semantic analysis. The device includes:

The first obtaining module is used to obtain the part of the transferred text starting from any position of the template text except the starting point;

Establishing a module, used to increase the length of the template text characters by two characters as the number of columns, and the length of the partially transferred text characters by two characters as the number of rows, to establish an editing distance matrix;

A first calculation module, configured to calculate the value of each element in the edit distance matrix according to the partially transferred text and the template text;

A generating module, used to record the calculated trajectory of each element in the edit distance matrix, and generate a trajectory matrix corresponding to the edit distance matrix;

The screening module is used to calculate the similarity of each trajectory in the trajectory matrix, filter a trajectory with the highest similarity between the partially transferred text and the template text, and obtain a first trajectory;

An obtaining module, configured to determine a starting point and an end point of the partially transferred text on the template text according to the first trajectory, and obtain a first starting point and a first end point;

A second obtaining module, configured to obtain a new template text from the template text according to the first start point and the first end point;

The second calculation module is used to compare the partially transferred text with the new template text, and calculate the accuracy of the partially transferred text through an edit distance algorithm.

The present application also provides a computer device, including a memory and a processor, where the memory stores a computer program, and when the processor executes the computer program, the steps of any one of the above methods are implemented.

The present application also provides a computer non-volatile readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method described in any one of the above are implemented.

Beneficial effect

According to the above technical solution, the present application has a beneficial effect: when the template text starts to be transferred at any position other than the starting point, an editing distance matrix is established, the values of each element in the editing distance matrix are calculated, and according to each element in the editing distance matrix Calculate the trajectory of the value to generate a trajectory matrix, calculate the similarity of each trajectory in the trajectory matrix, filter the trajectory with the highest similarity to obtain the first trajectory, and obtain the corresponding start and end points of the partially transferred text on the template text according to the first trajectory, In order to obtain the new template text, and then compare the part of the transferred text with the new template text, calculate the accuracy of the part of the transferred text, aiming to solve the existing text transfer accuracy algorithm, the text has been transferred and The entire text of the template text is compared. When part of the text is transferred, the accuracy of the text transfer cannot be accurately calculated.

BRIEF DESCRIPTION

FIG. 1 is a flowchart of applying a text resolution calculation method based on semantic analysis provided by an embodiment of the present application;

2 is a functional block diagram of a text accuracy calculation device based on semantic analysis provided by an embodiment of the present application;

FIG. 3 is a schematic block diagram of a structure of a computer device provided by using an embodiment of the present application.

Best Mode of the Invention

As shown in FIG. 1, an embodiment of the present application provides a method for calculating text accuracy based on semantic analysis. The method includes the following steps:

Step S101: Acquire part of the transferred text starting from any position of the template text except the starting point.

The template text is transferred from any position other than the starting point, and the template text is not all transferred, that is, it is transferred from any character of the template text, but does not include the first character. If it is transferred from the non-first character of the template text, the end point of the transfer is any character after the one character that was started to be transferred in the template text, where one character that was started to be transferred in the template text Any subsequent character includes a character that is initially transferred in the template text.

Since it is not the transfer of all characters of the template text, for this reason, the text obtained from the transfer of the template text at any position other than the starting point is called partial transfer text.

The template text is a correct text and is used to compare the text with the part of the transliterated text.

The above-mentioned transliteration refers to transcribing speech into text through an ASR (speech recognition) engine.

In step S102, the length of the template text characters is increased by two characters as the number of columns, and the length of the partially transferred text characters is increased by two characters as the number of rows to establish an edit distance matrix.

In this embodiment, the template text is text text excluding punctuation marks. Part of the transliterated text is text with punctuation marks removed.

Obtain the length of the template text characters, and increase the length of two characters according to the length of the template text characters as the number of columns. Get the length of partially transferred text characters, increase the length of two characters according to the length of partially transferred text characters, as the number of lines, and then increase the length of the two characters of the template text characters as the number of columns, and partially transfer The length of the text characters is increased by the length of two characters to the number of lines, and an edit distance matrix is established. The length of the template text characters is increased by two characters as the number of columns, and the length of the partially transferred text characters is increased by two characters as the number of rows. The purpose is to enter the template text on the first row and the first column, Partially transfer text, and enter the initial value in the second row and second column.

Specifically, after step S102 and before step S103, it includes:

Input characters of the template text from the third element of the first row of the edit distance matrix;

Starting from the third element of the first column of the edit distance matrix, input the characters of the partially transferred text;

Define that the value of the second element in the second row of the edit distance matrix is 0;

Initialize the value of each element in the second row of the editing distance matrix with the value of the second element in the second row of the editing distance matrix increasing by a value of 1 in turn;

The value of each element in the second column of the edit distance matrix is sequentially incremented by a value of 1 to initialize the value of each element in the second column of the edit distance matrix.

Enter the characters of the template text in the first row of the editing distance matrix, specifically, the characters of the template text starting from the third element of the first row of the editing distance matrix. Correspondingly, the characters of the partially transferred text are input in the first column of the edit distance matrix, specifically, the characters of the partially transferred text are input starting from the third element of the first column of the edit distance matrix. The first row of the edit distance matrix and the third element of the first column start to input the characters of the template text and the characters of the partially transferred text, so that each character of the template text and the characters of the partially transferred text exist in the edit distance matrix The corresponding relationship is also to provide a corresponding positional relationship for the initial values of the second row and the second column. First, define the value of the second element in the second row of the edit distance matrix as 0. Then, increment the value 1 by the value of the second element in the second row of the edit distance matrix as 0 to initialize the edit distance matrix The values of the elements in the second row of, for example, the values of the second, third, fourth, and fifth elements in the second row of the edit distance matrix are 0, 1, 2, and 3, respectively. The value of the second element in the second row of the edit distance matrix is defined as 0. In essence, the value of the second element in the second column of the edit distance matrix is also defined as 0, because the second row of the edit distance matrix The second element in the editing distance matrix is in the same position as the second element in the second column of the edit distance matrix, even if the same element, the second element in the second column of the editing distance matrix is in order of 0 Increment the value 1 to initialize the value of each element in the second column of the edit distance matrix. For example, the values of the second, third, fourth, and fifth elements in the second column of the edit distance matrix are 0, 1, 2, and 3, respectively. . After initializing the values in the second column and second row of the edit distance matrix, it is possible to calculate the values of the elements in the edit distance matrix.

Step S103: Calculate the value of each element in the edit distance matrix according to the partially transferred text and the template text.

According to the partial transfer text and template text, that is, in the edit distance matrix, whether the characters of the partial transfer text correspond to the characters of the template text are equal, the calculation method of the value of each element in the edit distance matrix is determined, and then the edit distance matrix is calculated The value of each element in.

In this embodiment, the value of each element in the edit distance matrix that has not been initialized is determined by the value of one of the elements on the left, top left, and top. In step S103, it includes:

Identify the number of columns and rows of the third element in the third column of the edit distance matrix;

Identify the number of columns and rows where the third element in the third column of the edit distance matrix corresponds to the character of the template text and the character of the partially transferred text, respectively;

Judging that the number of columns where the third element in the third column of the editing distance matrix corresponds to the character of the template text corresponds to the number of rows where the third element in the third column of the editing distance matrix is Whether the characters in the transliterated text are equal;

If the number of columns of the third element in the third column of the edit distance matrix corresponds to the character of the template text and the number of rows of the third element in the third column of the edit distance matrix corresponds to If the characters of the transferred text are equal, the value of the third element in the third column of the edit distance matrix is the value of the element in the upper left corner;

If the number of columns of the third element in the third column of the edit distance matrix corresponds to the character of the template text and the number of rows of the third element in the third column of the edit distance matrix corresponds to If the characters of the partially transferred text are not equal, the value of the third element in the third column of the edit distance matrix is the minimum value of the left, upper left, and upper elements plus 1;

Calculate the value of the fourth element in the third column of the edit distance matrix in sequence until the value of each element in the edit distance matrix is completed.

Since the value of each element in the editing distance matrix that has not been initialized is determined by the value of one of its left, upper left, and upper elements, at the beginning of the calculation, there are values for the elements that match the left, upper left, and upper sides. Is only the third element in the third column of the edit distance matrix, or the third element in the third column of the edit distance matrix. In this embodiment, the third element in the third column of the edit distance matrix is calculated Elements, identifying the number of columns and rows of the third element in the third column of the edit distance matrix, after obtaining the number of columns and rows of the third element in the third column of the edit distance matrix , Identify the number of columns in the third element of the third column of the edit distance matrix corresponding to the characters of the template text, and the number of rows in the third element of the third column of the edit distance matrix corresponding to the part of the transferred text character. After obtaining the corresponding characters, determine that the number of columns in the third element of the third column of the edit distance matrix corresponds to the number of characters in the template text corresponds to the number of rows in the third element of the third column of the edit distance matrix Whether the characters of the partially transferred text are equal, according to whether the characters of the template text of the third element in the third column of the edit distance matrix are equal to the characters of the corresponding partially transferred text, used to determine the third column of the edit distance matrix The value of the third element in the if the number of columns where the third element in the third column of the edit distance matrix corresponds to the character of the template text and the third element in the third column of the edit distance matrix is in the row If the characters corresponding to the number corresponding to the transferred text are equal, the value of the third element in the third column of the edit distance matrix is the value of the element in the upper left corner. If the number of columns in the third element of the third column of the edit distance matrix corresponds to the character of the template text and the number of lines in the third element of the third column of the edit distance matrix corresponds to the character of the part of the transferred text If they are equal, the value of the third element in the third column of the edit distance matrix is the minimum value of the left, upper left, and upper elements plus one. After the value of the third element in the third column of the edit distance matrix is calculated, the value of the fourth element in the third column of the edit distance matrix is calculated in turn until the value of each element in the edit distance matrix is completed, That is, then calculate the value of the fourth element in the third column of the edit distance matrix, after calculating the value of each element in the third column of the edit distance matrix, and then calculate the value of each element in the fourth column of the edit distance matrix Until the calculation of the value of each element in the last column of the edit distance matrix is completed, the calculation of the value of each element in the edit distance matrix is completed.

Step S104: Record the calculated trajectory of the value of each element in the edit distance matrix, and generate a trajectory matrix corresponding to the edit distance matrix.

In the process of calculating the value of each element in the edit distance matrix, record the calculation trajectory of the value of each element in the edit distance matrix, that is, which element determines the value of each element in the edit distance matrix. After completing the calculation of the values of each element in the editing distance matrix, the calculation trajectory that records the values of each element in the editing distance matrix is also completed, thereby generating a trajectory matrix corresponding to the editing distance matrix.

In this embodiment, in step S104, it includes:

Record the calculated trajectory of each element in the edit distance matrix;

Mark the origin of the value of each element in the edit distance matrix according to the calculation trajectory of the value of each element in the edit distance matrix;

After the marking is completed, a trajectory matrix corresponding to the editing distance matrix is generated.

Record the calculation trajectory of the value of each element in the editing distance matrix, mark the origin of the value of each element in the editing distance matrix according to the calculation trajectory of the value of each element in the editing distance matrix, in this embodiment, use lt to indicate that the element passes The element at the upper left is calculated, with l indicating that the element is calculated from the element on the left, and t indicating that the element is calculated from the element above, for example, if you edit the third in the third column of the distance matrix The element is determined by the second element in the second column of the edit distance matrix, then enter lt in the third element in the third column of the edit distance matrix, if you edit the third element in the third column of the distance matrix The element is determined by the third element in the second column of the edit distance matrix, enter l in the third element in the third column of the edit distance matrix, if you edit the third element in the third column of the distance matrix The element is determined by the second element in the third column of the edit distance matrix, then enter t in the third element in the third column of the edit distance matrix to mark the third in the third column of the edit distance matrix The origin of each element. After the marking is completed, a trajectory matrix corresponding to the edit distance matrix is generated.

In this embodiment, the step of marking the origin of the value of each element in the edit distance matrix in the calculation trajectory according to the value of each element in the edit distance matrix includes:

Mark the origin of the value of the element in the edit distance matrix each time the calculation trajectory of the value of an element in the edit distance matrix is recorded;

Until the origin of the value of each element in the editing distance matrix is marked.

Every time the calculation track of the value of an element in the editing distance matrix is recorded, the origin of the value of the element in the editing distance matrix is immediately marked, that is, the editing distance matrix is marked while recording the calculation track of the value of each element in the editing distance matrix The origin of the value of each element in.

In some embodiments, the step of marking the origin of the value of each element in the edit distance matrix in the calculation trajectory according to the value of each element in the edit distance matrix includes:

After the calculation trajectory of recording the value of each element in the editing distance matrix is completed, the value of each element in the editing distance matrix is marked according to the calculation trajectory of the value of each element in the editing distance matrix.

After the calculation of the value of each element in the edit distance matrix is completed, the origin of the value of each element in the mark edit distance matrix will be triggered until the origin of the value of each element in the mark edit distance matrix is completed. That is, the calculation trajectory of the value of each element in the unedited edit distance matrix does not cause the origin of the value of each element in the edited edit distance matrix.

Step S105: Calculate the similarity of each trajectory in the trajectory matrix, filter a trajectory with the highest similarity between the partially transferred text and the template text, and obtain a first trajectory.

After generating the trajectory matrix, calculate the similarity of each trajectory in the trajectory matrix. After calculating the similarity of each trajectory, filter the trajectory with the highest similarity between the partially transferred text and the template text to obtain the first trajectory. It is considered that the partially transferred text corresponds to the track on the template text.

In this embodiment, the step of calculating the similarity of each trajectory in the trajectory matrix includes:

Identifying the number of characters of the partially transferred text in each track in the track matrix that are equal to the corresponding characters of the template text to obtain an equal number of characters;

Comparing the character length of the partially transferred text in each track in the track matrix with the corresponding character length of the template text, and selecting the long length as the total number of characters;

The ratio of the number of equal characters of each track in the track matrix to the total number of corresponding characters is calculated to obtain the similarity of each track in the track matrix.

After generating the trajectory matrix, identify the number of characters of partially transferred text in each trajectory of the trajectory matrix equal to the characters of the corresponding template text to obtain the equal number of characters, after obtaining the equal number of characters in each trajectory in the trajectory matrix , Compare the character length of the partially transferred text in each track in the track matrix with the length of the character of the corresponding template text, and select the long length as the total number of characters, if the length of the part of the transferred text in a track in the track matrix is greater than Corresponding to the length of the characters of the template text, the length of the characters selected as part of the transferred text in a track in the track matrix is the total number of characters. If the length of the characters of the partially transferred text in a track in the track matrix is less than the length of the characters of the corresponding template text, the length of the characters of the template text selected in a track in the track matrix is the total number of characters. After the long length is selected as the total number of characters, the ratio of the number of equal characters of each track in the track matrix to the corresponding total number of characters is calculated, and after the calculation of the ratio is completed, the similarity of each track in the track matrix is obtained.

Step S106: According to the first trajectory, determine a start point and an end point of the partially transferred text on the template text to obtain a first start point and a first end point.

After the first trajectory is obtained, according to the first trajectory, since the first trajectory has a start point and an end point in the trajectory matrix, the start point and the end point corresponding to the part of the transferred text on the template text are determined, thereby obtaining the first start point and the first end point.

In this embodiment, in step S106, it includes:

Mark the first element and the last element in the first track;

Mark the characters of the template text corresponding to the first element and the last element in the first track to obtain a first start point and a first end point.

After obtaining the first track, mark the first element in the first track, according to the first element in the first track, obtain the characters of the template text on the column corresponding to the first element in the first track, and mark the corresponding template text Character to obtain the first starting point.

After obtaining the first track, mark the last element in the first track, and according to the last element in the first track, obtain the character of the template text on the column corresponding to the last element in the first track, and mark the character of the corresponding template text, Thereby obtaining the first end point.

Step S107: Acquire a new template text from the template text according to the first start point and the first end point.

After obtaining the first start point and the first end point, according to the first start point and the first end point of the template text, the text between the two points is obtained, including the characters corresponding to the first start point and the first end point of the template, respectively. Get the new template text.

In this embodiment, in step S107, it includes:

Intercept characters between the first start point and the first end point, where the characters between the first start point and the first end point include characters corresponding to the first start point and the first end point character;

Generate text based on the intercepted characters to obtain the new template text.

After the first start point and the first end point are obtained, characters between the first start point and the first end point of the template text are intercepted, wherein the characters between the first start point and the first end point of the template text include the first start point of the template text corresponding to Character corresponding to the first end point. After the intercepted characters, according to the intercepted characters, the text in the same format as the template text is generated to obtain the new template text.

Step S108: Compare the partially transferred text with the new template text, and calculate an accuracy rate of the partially transferred text through an edit distance algorithm.

After obtaining the new template text, part of the transferred text is compared with the new template text, not the template text. The accuracy of the part of the transferred text is calculated by the edit distance algorithm, thereby solving the accuracy of the existing text. The rate algorithm compares the text that has been transferred to the entire text of the template text. When part of the text is transferred, the problem of the accuracy of the text transfer cannot be accurately calculated.

In summary, when the template text starts to be transferred at any position other than the starting point, an edit distance matrix is established, the value of each element in the edit distance matrix is calculated, and it is generated according to the calculated trajectory of the value of each element in the edit distance matrix Trajectory matrix, calculate the similarity of each trajectory in the trajectory matrix, select the trajectory with the highest similarity to obtain the first trajectory, and obtain the corresponding start and end points of the partially transferred text on the template text according to the first trajectory, thereby obtaining the new template text Then compare part of the transferred text with the new template text, calculate the accuracy of the part of the transferred text, aim to solve the existing text transfer accuracy algorithm, the text has been transferred and the template text of all the text In contrast, when part of the text is transliterated, the accuracy of the transliteration of the text cannot be accurately calculated.

As shown in FIG. 2, an embodiment of the present application proposes a device 1 for calculating text accuracy based on semantic analysis. The device 1 includes a first acquiring module 11, a establishing module 12, a first calculating module 13, a generating module 14, and a filtering module 15 , An acquisition module 16, a second acquisition module 17, and a second calculation module 18.

The first acquiring module 11 is configured to acquire the partially transferred text starting from any position of the template text except the starting point.

The establishment module 12 is used to establish the editing distance matrix by using the length of the template text characters to increase the length of two characters as the number of columns, and the length of the partially transferred text characters to increase the length of the two characters as the number of lines.

Specifically, the device 1 includes:

A first input module for inputting characters of the template text starting from the third element of the first row of the editing distance matrix;

A second input module for inputting characters of the partially transferred text starting from the third element of the first column of the editing distance matrix;

A definition module, used to define the value of the second element in the second row of the edit distance matrix as 0;

The first initialization module is used to sequentially increment the value 1 by the value of the second element in the second row of the edit distance matrix to initialize the value of each element of the second row of the edit distance matrix;

A second initialization module is used to sequentially increment the value 1 by the value of the second element in the second column of the edit distance matrix to initialize the value of each element of the second column of the edit distance matrix.

The first calculation module 13 is configured to calculate the value of each element in the edit distance matrix according to the partially transferred text and the template text.

In this embodiment, the value of each element in the edit distance matrix that has not been initialized is determined by the value of one of the elements on the left, top left, and top. The first calculation module 13 includes:

A first identification module, used to identify the number of columns and rows of the third element in the third column of the editing distance matrix;

A second recognition module, used to recognize the number of columns and rows where the third element in the third column of the edit distance matrix corresponds to the characters of the template text and the characters of the partially transferred text, respectively;

The first judgment module is used to judge the number of columns where the third element in the third column of the edit distance matrix corresponds to the character of the template text and the third element in the third column of the edit distance matrix Whether the number of rows of elements corresponds to whether the characters of the partially transferred text are equal; if the number of columns of the third element in the third column of the editing distance matrix corresponds to the characters of the template text and the editing distance If the number of rows of the third element in the third column of the matrix is equal to the characters of the partially transferred text, the value of the third element in the third column of the edit distance matrix is the element at the upper left corner If the number of columns where the third element in the third column of the edit distance matrix corresponds to the character of the template text and the third element in the third column of the edit distance matrix are in the row The numbers corresponding to the characters of the partially transferred text are not equal, then the value of the third element in the third column of the edit distance matrix is the minimum value of the left, upper left, and upper elements plus 1;

The first sub-calculation module is used to sequentially calculate the value of the fourth element in the third column of the edit distance matrix until the calculation of the value of each element in the edit distance matrix is completed.

The generating module 14 is configured to record the calculated trajectory of each element in the edit distance matrix and generate a trajectory matrix corresponding to the edit distance matrix.

In this embodiment, the generation module 14 includes:

The first recording module is used to record the calculation track of the values of each element in the editing distance matrix;

The first marking module is used to mark the origin of the value of each element in the editing distance matrix according to the calculation trajectory of the value of each element in the editing distance matrix;

The first generating module is used to generate a trajectory matrix corresponding to the editing distance matrix after the marking is completed.

In this embodiment, the first marking module includes:

The first sub-marking module is used to mark the origin of the value of the element in the edit distance matrix each time the calculation track of the value of an element in the edit distance matrix is recorded;

The first sub-marking completion module is used to mark the origin of the value of each element in the editing distance matrix.

In some embodiments, the first marking module includes:

The second sub-marking module is used to mark each element in the editing distance matrix according to the calculation track of the value of each element in the editing distance matrix after completing the calculation of the track for calculating the value of each element in the editing distance matrix The origin of the value.

The filtering module 15 is configured to calculate the similarity of each trajectory in the trajectory matrix, filter a trajectory with the highest similarity between the partially transferred text and the template text, and obtain a first trajectory.

After generating the trajectory matrix, calculate the similarity of each trajectory in the trajectory matrix. After calculating the similarity of each trajectory, filter the trajectory with the highest similarity between the partially transferred text and the template text to obtain the first trajectory It is considered that the partially transferred text corresponds to the track on the template text.

In this embodiment, the screening module 15 includes:

A third recognition module, used to recognize the number of characters of the partially transferred text in each track in the track matrix equal to the corresponding characters of the template text to obtain an equal number of characters;

The first comparison module is used to compare the length of the characters of the partially transferred text in each trajectory in the trajectory matrix with the corresponding length of the characters of the template text, and select the length as the total number of characters;

A third calculation module is used to calculate the ratio of the number of equal characters of each track in the track matrix to the total number of corresponding characters, to obtain the similarity of each track in the track matrix.

The obtaining module 16 is configured to determine the starting point and the ending point of the partially transferred text on the template text according to the first trajectory, and obtain the first starting point and the first ending point.

After obtaining the first trajectory, according to the first trajectory, since the first trajectory has a start point and an end point in the trajectory matrix, the start point and the end point corresponding to the part of the transferred text on the template text are determined to obtain the first start point and the first end point.

In this embodiment, the obtaining module 16 includes:

A second marking module, used to mark the first element and the last element in the first track;

The first obtaining module is configured to mark the characters of the template text corresponding to the first element and the last element in the first track to obtain a first start point and a first end point.

The second obtaining module 17 is configured to obtain a new template text from the template text according to the first start point and the first end point.

In this embodiment, the second acquisition module 17 includes:

An interception module, configured to intercept characters between the first start point and the first end point, wherein characters between the first start point and the first end point include characters corresponding to the first start point and the The character corresponding to the first end point;

The second sub-acquisition module is used for generating text according to the intercepted characters and acquiring the new template text.

The second calculation module 18 is used to compare the partially transferred text with the new template text, and calculate the accuracy of the partially transferred text through an edit distance algorithm.

As shown in FIG. 3, a computer device is also provided in an embodiment of the present application. The computer device may be a server, and its internal structure may be as shown in FIG. The computer device includes a processor, memory, network interface, and database connected by a system bus. Among them, the processor designed by the computer is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The memory device provides an environment for operating systems and computer programs in non-volatile storage media. The database of the computer device is used to store data such as a model of a text accuracy calculation method based on semantic analysis. The network interface of the computer device is used to communicate with external terminals through a network connection. The computer program is executed by the processor to realize a text accuracy calculation method based on semantic analysis.

The above-mentioned processor executes the steps of the above-mentioned method for calculating the text accuracy based on semantic analysis: acquiring part of the transferred text starting from any position of the template text except the starting point; adding two characters by the length of the template text characters The length is the number of columns, and the length of the part of the transferred text characters is increased by the length of two characters as the number of lines, and an edit distance matrix is established; based on the part of the transferred text and the template text, the edit distance matrix is calculated The value of each element in the editing distance; record the calculated track of the value of each element in the editing distance matrix to generate a track matrix corresponding to the editing distance matrix; calculate the similarity of each track in the track matrix and filter the partial transfer A track with the highest similarity between the written text and the template text to obtain a first track; based on the first track, determine the corresponding starting point and end point of the partially transferred text on the template text to obtain the first starting point and The first end point; according to the first start point and the first end point, obtain a new template text from the template text; compare the partially transliterated text with the new template text, and calculate by the edit distance algorithm The accuracy rate of the transliterated text.

Those skilled in the art can understand that the structure shown in FIG. 3 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied.

An embodiment of the present application also provides a computer non-volatile readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, a text accuracy calculation method based on semantic analysis is implemented, specifically: acquiring The part of the transferred text starting from any position other than the starting point of the template text; the length of the template text characters is increased by two characters as the number of columns, and the length of the part of the transferred text characters is increased by two The length of the characters is the number of lines, and an edit distance matrix is established; based on the partially transferred text and the template text, the value of each element in the edit distance matrix is calculated; the value of each element in the edit distance matrix is recorded Calculate the trajectory to generate a trajectory matrix corresponding to the editing distance matrix; calculate the similarity of each trajectory in the trajectory matrix, filter a trajectory with the highest similarity between the partially transferred text and the template text to obtain the first trajectory ; According to the first trajectory, determine the start point and end point of the partially transferred text on the template text to obtain the first start point and the first end point; according to the first start point and the first end point, from Obtain the new template text from the template text; compare the partially transferred text with the new template text, and calculate the accuracy of the partially transferred text through an edit distance algorithm.

Claims

A text accuracy calculation method based on semantic analysis, characterized in that the method includes:

Get the part of the transferred text starting from any position of the template text except the starting point;

The length of the template text characters is increased by two characters as the number of columns, and the length of the partially transferred text characters is increased by two characters as the number of lines, and an editing distance matrix is established;

Calculate the value of each element in the editing distance matrix according to the partially transferred text and the template text;

Record the calculated trajectory of each element in the edit distance matrix, and generate a trajectory matrix corresponding to the edit distance matrix;

Calculating the similarity of each trajectory in the trajectory matrix, filtering a trajectory with the highest degree of similarity between the partially transferred text and the template text to obtain a first trajectory;

According to the first trajectory, determine the start point and end point of the partially transferred text on the template text, and obtain the first start point and the first end point;

Obtain a new template text from the template text according to the first start point and the first end point;

Compare the partially transferred text with the new template text, and calculate the accuracy of the partially transferred text through an edit distance algorithm.
The method for calculating text accuracy based on semantic analysis according to claim 1, characterized in that, in the method, the length of the template text character is increased by two characters as the number of columns, and the text character is partially transferred After the step of establishing the editing distance matrix, before the step of calculating the value of each element in the editing distance matrix based on the partial transfer text and the template text ,include:

Input characters of the template text from the third element of the first row of the edit distance matrix;

Starting from the third element of the first column of the edit distance matrix, input the characters of the partially transferred text;

Define that the value of the second element in the second row of the edit distance matrix is 0;

Initialize the value of each element in the second row of the editing distance matrix with the value of the second element in the second row of the editing distance matrix increasing by a value of 1 in turn;

The value of each element in the second column of the edit distance matrix is sequentially incremented by a value of 1 to initialize the value of each element in the second column of the edit distance matrix.
The method for calculating text accuracy based on semantic analysis according to claim 2, wherein the value of each element in the editing distance matrix that is not initialized is determined by the value of one of the elements in the left, upper left, and upper Determined by the value, the step of calculating the value of each element in the editing distance matrix based on the partially transferred text and the template text includes:

Identify the number of columns and rows of the third element in the third column of the edit distance matrix;

Identify the number of columns and rows where the third element in the third column of the edit distance matrix corresponds to the character of the template text and the character of the partially transferred text;

Judging that the number of columns where the third element in the third column of the editing distance matrix corresponds to the character of the template text corresponds to the number of rows where the third element in the third column of the editing distance matrix is Whether the characters in the transliterated text are equal;

If the number of columns of the third element in the third column of the edit distance matrix corresponds to the character of the template text and the number of rows of the third element in the third column of the edit distance matrix corresponds to If the characters of the transferred text are equal, the value of the third element in the third column of the edit distance matrix is the value of the element in the upper left corner;

If the number of columns of the third element in the third column of the edit distance matrix corresponds to the character of the template text and the number of rows of the third element in the third column of the edit distance matrix corresponds to If the characters of the partially transferred text are not equal, the value of the third element in the third column of the edit distance matrix is the minimum value of the left, upper left, and upper elements plus 1;

Calculate the value of the fourth element in the third column of the edit distance matrix in sequence until the value of each element in the edit distance matrix is completed.
The method for calculating text accuracy based on semantic analysis according to claim 1, characterized in that a trajectory matrix corresponding to the edit distance matrix is generated in the calculation trajectory that records the value of each element in the edit distance matrix The steps include:

Record the calculated trajectory of each element in the edit distance matrix;

Mark the origin of the value of each element in the edit distance matrix according to the calculation trajectory of the value of each element in the edit distance matrix;

After the marking is completed, a trajectory matrix corresponding to the editing distance matrix is generated.
The method for calculating text accuracy based on semantic analysis according to claim 1, wherein the step of calculating the similarity of each trajectory in the trajectory matrix includes:

Identifying the number of characters of the partially transferred text in each track in the track matrix that are equal to the corresponding characters of the template text to obtain an equal number of characters;

Comparing the character length of the partially transferred text in each track in the track matrix with the corresponding character length of the template text, and selecting the long length as the total number of characters;

The ratio of the number of equal characters of each track in the track matrix to the total number of corresponding characters is calculated to obtain the similarity of each track in the track matrix.
The method for calculating text accuracy based on semantic analysis according to claim 1, characterized in that, according to the first trajectory, the start point and the end point of the partially transferred text on the template text are determined, The steps to obtain the first start point and the first end point include:

Mark the first element and the last element in the first track;

Mark the corresponding characters of the template text according to the first element and the last element in the first track to obtain the first start point and the first end point, respectively.
The text accuracy calculation method based on semantic analysis according to claim 6, characterized in that in the step of acquiring a new template text from the template text according to the first start point and the first end point ,include:

Intercept characters between the first start point and the first end point, where the characters between the first start point and the first end point include characters corresponding to the first start point and the first end point character;

Generate text based on the intercepted characters to obtain the new template text.
A text accuracy calculation device based on semantic analysis, characterized in that the device includes:

The first obtaining module is used to obtain the part of the transferred text starting from any position of the template text except the starting point;

Establishing a module, used to increase the length of the template text characters by two characters as the number of columns, and the length of the partially transferred text characters by two characters as the number of rows, to establish an editing distance matrix;

A first calculation module, configured to calculate the value of each element in the edit distance matrix according to the partially transferred text and the template text;

A generating module, used to record the calculated trajectory of each element in the edit distance matrix, and generate a trajectory matrix corresponding to the edit distance matrix;

The screening module is used to calculate the similarity of each trajectory in the trajectory matrix, filter a trajectory with the highest similarity between the partially transferred text and the template text, and obtain a first trajectory;

An obtaining module, configured to determine a starting point and an end point of the partially transferred text on the template text according to the first trajectory, and obtain a first starting point and a first end point;

A second obtaining module, configured to obtain a new template text from the template text according to the first start point and the first end point;

The second calculation module is used to compare the partially transferred text with the new template text, and calculate the accuracy of the partially transferred text through an edit distance algorithm.
The text accuracy calculation device based on semantic analysis according to claim 8, characterized in that the device comprises:

A first input module for inputting characters of the template text starting from the third element of the first row of the editing distance matrix;

A second input module for inputting characters of the partially transferred text starting from the third element of the first column of the editing distance matrix;

A definition module, used to define the value of the second element in the second row of the edit distance matrix as 0;

The first initialization module is used to sequentially increment the value 1 by the value of the second element in the second row of the edit distance matrix to initialize the value of each element of the second row of the edit distance matrix;

A second initialization module is used to sequentially increment the value 1 by the value of the second element in the second column of the edit distance matrix to initialize the value of each element of the second column of the edit distance matrix.
The text accuracy calculation device based on semantic analysis according to claim 9, wherein the first calculation module comprises:

A first identification module, used to identify the number of columns and rows of the third element in the third column of the editing distance matrix;

A second recognition module, used to recognize the number of columns and rows where the third element in the third column of the edit distance matrix corresponds to the characters of the template text and the characters of the partially transferred text, respectively;

The first judgment module is used to judge the number of columns where the third element in the third column of the edit distance matrix corresponds to the character of the template text and the third element in the third column of the edit distance matrix Whether the number of rows of elements corresponds to whether the characters of the partially transferred text are equal; if the number of columns of the third element in the third column of the editing distance matrix corresponds to the characters of the template text and the editing distance If the number of rows of the third element in the third column of the matrix is equal to the characters of the partially transferred text, the value of the third element in the third column of the edit distance matrix is the element at the upper left corner If the number of columns where the third element in the third column of the edit distance matrix corresponds to the character of the template text and the third element in the third column of the edit distance matrix are in the row The numbers corresponding to the characters of the partially transferred text are not equal, then the value of the third element in the third column of the edit distance matrix is the minimum value of the left, upper left, and upper elements plus 1;

The first sub-calculation module is used to sequentially calculate the value of the fourth element in the third column of the edit distance matrix until the calculation of the value of each element in the edit distance matrix is completed.
The text accuracy calculation device based on semantic analysis according to claim 8, characterized in that the generation module comprises:

The first recording module is used to record the calculation track of the values of each element in the editing distance matrix;

The first marking module is used to mark the origin of the value of each element in the editing distance matrix according to the calculation trajectory of the value of each element in the editing distance matrix;

The first generating module is used to generate a trajectory matrix corresponding to the editing distance matrix after the marking is completed.
The text accuracy calculation device based on semantic analysis according to claim 8, characterized in that the screening module comprises:

A third recognition module, used to recognize the number of characters of the partially transferred text in each track in the track matrix equal to the corresponding characters of the template text to obtain an equal number of characters;

The first comparison module is used to compare the length of the characters of the partially transferred text in each trajectory in the trajectory matrix with the corresponding length of the characters of the template text, and select the length as the total number of characters;

A third calculation module is used to calculate the ratio of the number of equal characters of each track in the track matrix to the total number of corresponding characters, to obtain the similarity of each track in the track matrix.
The text accuracy calculation device based on semantic analysis according to claim 8, wherein the obtaining module comprises:

A second marking module, used to mark the first element and the last element in the first track;

The first obtaining module is configured to mark characters of the template text corresponding to the first element and the last element in the first track, and obtain a first start point and a first end point, respectively.
The text accuracy calculation device based on semantic analysis according to claim 13, wherein the second acquisition module includes:

An interception module, configured to intercept characters between the first start point and the first end point, wherein characters between the first start point and the first end point include characters corresponding to the first start point and the The character corresponding to the first end point;

The second sub-acquisition module is used to generate text according to the intercepted characters and obtain the new template text.
A computer device includes a memory and a processor, and the memory stores a computer program, wherein the processor implements a semantic accuracy-based text accuracy calculation method when the processor executes the computer program, the method includes:

Get the part of the transferred text starting from any position of the template text except the starting point;

The length of the template text characters is increased by two characters as the number of columns, and the length of the partially transferred text characters is increased by two characters as the number of lines, and an editing distance matrix is established;

Calculate the value of each element in the editing distance matrix according to the partially transferred text and the template text;

Record the calculated trajectory of each element in the edit distance matrix, and generate a trajectory matrix corresponding to the edit distance matrix;

Calculating the similarity of each trajectory in the trajectory matrix, filtering a trajectory with the highest degree of similarity between the partially transferred text and the template text to obtain a first trajectory;

According to the first trajectory, determine the start point and end point of the partially transferred text on the template text, and obtain the first start point and the first end point;

Obtain a new template text from the template text according to the first start point and the first end point;

Compare the partially transferred text with the new template text, and calculate the accuracy of the partially transferred text through an edit distance algorithm.
The computer device according to claim 15, wherein the length of the template text characters is increased by two characters as the number of columns, and the length of the partially transferred text characters is increased by two characters The length is the number of lines, and after the step of establishing the editing distance matrix, before the step of calculating the value of each element in the editing distance matrix based on the partially transferred text and the template text, it includes:

Input characters of the template text from the third element of the first row of the edit distance matrix;

Starting from the third element of the first column of the edit distance matrix, input the characters of the partially transferred text;

Define that the value of the second element in the second row of the edit distance matrix is 0;

Initialize the value of each element in the second row of the editing distance matrix with the value of the second element in the second row of the editing distance matrix increasing by a value of 1 in turn;

The value of each element in the second column of the edit distance matrix is sequentially incremented by a value of 1 to initialize the value of each element in the second column of the edit distance matrix.
The computer device according to claim 16, characterized in that the value of each element in the editing distance matrix that is not initialized is determined by the value of one of the elements on the left, upper left corner, and upper side. The step of calculating the value of each element in the edit distance matrix according to the partially transferred text and the template text includes:

Identify the number of columns and rows of the third element in the third column of the edit distance matrix;

Identify the number of columns and rows where the third element in the third column of the edit distance matrix corresponds to the character of the template text and the character of the partially transferred text, respectively;

Judging that the number of columns where the third element in the third column of the editing distance matrix corresponds to the character of the template text corresponds to the number of rows where the third element in the third column of the editing distance matrix is Whether the characters in the transliterated text are equal;

If the number of columns of the third element in the third column of the edit distance matrix corresponds to the character of the template text and the number of rows of the third element in the third column of the edit distance matrix corresponds to If the characters of the transferred text are equal, the value of the third element in the third column of the edit distance matrix is the value of the element in the upper left corner;

If the number of columns of the third element in the third column of the edit distance matrix corresponds to the character of the template text and the number of rows of the third element in the third column of the edit distance matrix corresponds to If the characters of the partially transferred text are not equal, the value of the third element in the third column of the edit distance matrix is the minimum value of the left, upper left, and upper elements plus 1;

Calculate the value of the fourth element in the third column of the edit distance matrix in sequence until the value of each element in the edit distance matrix is completed.
The computer device according to claim 15, wherein the step of generating a trajectory matrix corresponding to the editing distance matrix in the calculation trajectory of recording the values of the elements in the editing distance matrix includes:

Record the calculated trajectory of each element in the edit distance matrix;

Mark the origin of the value of each element in the edit distance matrix according to the calculation trajectory of the value of each element in the edit distance matrix;

After the marking is completed, a trajectory matrix corresponding to the editing distance matrix is generated.
A computer non-volatile readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, a text accuracy calculation method based on semantic analysis is implemented. The method includes:

Get the part of the transferred text starting from any position of the template text except the starting point;

The length of the template text characters is increased by two characters as the number of columns, and the length of the partially transferred text characters is increased by two characters as the number of lines, and an editing distance matrix is established;

Calculate the value of each element in the editing distance matrix according to the partially transferred text and the template text;

Record the calculated trajectory of each element in the edit distance matrix, and generate a trajectory matrix corresponding to the edit distance matrix;

Calculating the similarity of each trajectory in the trajectory matrix, filtering a trajectory with the highest degree of similarity between the partially transferred text and the template text to obtain a first trajectory;

According to the first trajectory, determine the start point and end point of the partially transferred text on the template text, and obtain the first start point and the first end point;

Obtain a new template text from the template text according to the first start point and the first end point;

Compare the partially transferred text with the new template text, and calculate the accuracy of the partially transferred text through an edit distance algorithm.
The computer non-volatile readable storage medium according to claim 19, wherein the length of the template text character is increased by two characters as the number of columns, and the partially transferred text character is used After the step of establishing the editing distance matrix, before the step of calculating the value of each element in the editing distance matrix based on the partial transfer text and the template text ,include:

Input characters of the template text from the third element of the first row of the edit distance matrix;

Starting from the third element of the first column of the edit distance matrix, input the characters of the partially transferred text;

Define that the value of the second element in the second row of the edit distance matrix is 0;

Initialize the value of each element in the second row of the editing distance matrix with the value of the second element in the second row of the editing distance matrix increasing by a value of 1 in turn;

The value of each element in the second column of the edit distance matrix is sequentially incremented by a value of 1 to initialize the value of each element in the second column of the edit distance matrix.