CN111783393A

CN111783393A - Method, device and storage medium for synchronizing handwritten notes during bilingual contrast reading

Info

Publication number: CN111783393A
Application number: CN202010613005.7A
Authority: CN
Inventors: 程超; 成湘均
Original assignee: Ireader Technology Co Ltd; Zhangyue Technology Co Ltd
Current assignee: Ireader Technology Co Ltd; Zhangyue Technology Co Ltd
Priority date: 2020-06-30
Filing date: 2020-06-30
Publication date: 2020-10-16

Abstract

The invention discloses a method, equipment and a storage medium for synchronizing handwritten notes during bilingual contrast reading, wherein the method comprises the following steps: monitoring a handwriting operation instruction generated by executing handwriting input on a first area of a reading interface; drawing a handwritten note line in a first area in response to a handwritten operation instruction, and acquiring a first text character in a preset range near the handwritten note line in the first area; searching a second text character corresponding to the first text character in the second area; and drawing the handwritten note line in the second area according to the relative position parameters of the handwritten note line and the first text character in the first area and the position of the second text character in the second area. According to the scheme of the invention, in response to the operation of executing handwriting input in the first area by a user, the handwritten note line can be synchronously mapped in the second area while the handwritten note line is drawn in the first area, so that the synchronization of the handwritten note line in the two areas is realized.

Description

Method, device and storage medium for synchronizing handwritten notes during bilingual contrast reading

Technical Field

The invention relates to the technical field of internet, in particular to a method, equipment and a storage medium for synchronizing handwritten notes during bilingual contrast reading.

Background

In recent years, with the development of internet technology and terminal technology, the daily life pattern has changed greatly, and a great deal of daily activities have shifted from offline to online, such as shopping, ordering, and the like, wherein a typical shift is from paper book reading to electronic book reading, and the electronic book reading can be realized through reading a website, a reading application or a dedicated reading device (such as a reader). Meanwhile, during reading of an electronic book, especially in a learning mode, it is often necessary to look up translations of certain words in the text of the electronic book. In order to facilitate the user to check the translation, the bilingual comparison reading function is provided, so that the original text content and the translation content are respectively displayed in different areas in the reading interface, and the user can conveniently check the translation corresponding to each original text word in the original text content without performing complicated operation.

Meanwhile, in the contrast reading process, some note labels are inevitably needed to be made on the original text content or the translated content, but because the areas for displaying the original text content and the translated content are independent, the note labels in the two areas are correspondingly and completely independent, and further note synchronization cannot be realized, and the contrast reading of a user is influenced.

Disclosure of Invention

In view of the above problems, embodiments of the present invention are proposed to provide a handwritten note synchronization method, apparatus and storage medium when bilingual contrast reading overcomes or at least partially solves the above problems.

According to an aspect of the embodiments of the present invention, there is provided a method for synchronizing handwritten notes during bilingual cross-reading, including:

monitoring a handwriting operation instruction generated by executing handwriting input on a first area of a reading interface;

responding to the handwriting operation instruction, drawing a handwriting note line in the first area, and acquiring a first text character in a preset range near the handwriting note line in the first area;

searching a second text character corresponding to the first text character in a second area of the reading interface, wherein the first text character and the second text character have a corresponding relation between original text and translation;

drawing the handwritten note line in the second area according to the relative position parameters of the handwritten note line and the first text character in the first area and the position of the second text character in the second area.

According to another aspect of embodiments of the present invention, there is provided a computing device including: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is configured to store at least one executable instruction that causes the processor to:

According to yet another aspect of the embodiments of the present invention, there is provided a computer storage medium having at least one executable instruction stored therein, the executable instruction causing a processor to:

According to the handwritten note synchronization method, device and storage medium during bilingual contrast reading of the embodiment of the invention, in response to a handwriting operation instruction generated by executing handwriting input on a first area of a reading interface, a handwritten note line is drawn in the first area in real time, and a first text character in a preset range near the handwritten note line in the first area is obtained, so that the position of the synchronized handwritten note line is subsequently positioned in a second area; and drawing the handwritten note line in the second area according to the relative position parameters of the handwritten note line and the first text character in the first area and the position of the second text character in the second area by searching for the second text character in the second area so as to accurately position the position of the synchronous handwritten note line in the second area, thereby realizing the synchronous drawing of the handwritten note line. Therefore, in the embodiment, in the contrast reading mode, in response to the handwriting operation instruction generated in the first area, the synchronous handwritten note lines can be drawn at the reasonable position in the second area while the handwritten note lines are drawn in the first area, so that the synchronization of the handwritten note in two independent areas is realized, and the contrast reading experience of a user is improved; and the position of the handwritten note line is determined and drawn through the relative position parameters, so that the determined target position is not correct when the first text character and the second text character do not correspond word by word line, and the position accuracy of note synchronization is improved.

The foregoing description is only an overview of the technical solutions of the embodiments of the present invention, and the embodiments of the present invention can be implemented according to the content of the description in order to make the technical means of the embodiments of the present invention more clearly understood, and the detailed description of the embodiments of the present invention is provided below in order to make the foregoing and other objects, features, and advantages of the embodiments of the present invention more clearly understandable.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the embodiments of the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

fig. 1 shows a flowchart of a method for synchronizing handwritten notes during bilingual contrast reading according to an embodiment of the present invention;

FIG. 2 is a flow chart illustrating a method for synchronizing handwritten notes during bilingual cross-reading according to another embodiment of the present invention;

FIG. 3a is a schematic diagram of a first region and a second region of a left-right partition of a portrait screen;

FIG. 3b is a schematic diagram of a first region and a second region partitioned from above and below the vertical screen;

FIG. 3c is a schematic view of the first and second regions of the left and right subdivisions of the landscape;

FIG. 4 is a flow chart illustrating a method for synchronizing handwritten notes during bilingual cross-reading according to yet another embodiment of the present invention;

fig. 5 is a schematic structural diagram of a computing device provided by an embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

Fig. 1 shows a flowchart of a method for synchronizing handwritten notes during bilingual contrast reading according to an embodiment of the present invention. The method is used in a touch screen device for providing e-book reading, such as a mobile phone, a tablet and the like, at the time, a handwritten note refers to a note which is written on a screen by a user using a finger, or can also be used in an e-book reader, and the e-book reader needs to have a handwriting function, such as an electromagnetic handwriting function, at the time, the handwritten note refers to a note which is written on an ink screen by a user using an electromagnetic pen, and by using the method, synchronous mapping of handwritten note lines in the first area and the second area can be realized. And, the method is performed by the above-mentioned touch screen device or e-book reader.

As shown in fig. 1, the method comprises the steps of:

step S110: and monitoring a handwriting operation instruction generated by executing handwriting input on the first area of the reading interface.

The embodiment of the invention is premised on entering a bilingual cross-reading mode, in which a reading interface is divided into two areas (referred to as a first area and a second area herein), one of which is used for displaying original text content and the other of which is used for displaying translation content of the original text content, and the embodiment of the invention is to realize synchronization of handwritten notes between the first area and the second area.

In this step, the content displayed in the first area may be original text content or translated content. Specifically, monitoring whether a first area of the reading interface receives a handwriting operation instruction triggered by touch operation or electromagnetic pen input operation, if so, indicating that a handwritten note is generated, and executing step S120; if not, then continue monitoring.

Step S120: and responding to the handwriting operation instruction, drawing a handwriting note line in the first area, and acquiring a first text character in a preset range near the handwriting note line in the first area.

After the handwriting operation instruction is monitored, a handwriting note line is drawn in a first area where the user executes handwriting input, and the handwriting note line can be a complete handwriting note line corresponding to one-time complete handwriting input or a real-time handwriting note line corresponding to the handwriting input. Then, the first text character is obtained in a preset range near the handwritten note line, so that the position of the handwritten note is positioned and synchronously mapped in the second area according to the first text character. The preset range may be set according to an actual situation, and is not specifically limited in the present invention, for example, the preset range is a range covered by a handwritten note line, or a range in which a distance between the handwritten note line and the handwritten note line is within a preset distance.

Step S130: and searching a second text character corresponding to the first text character in a second area of the reading interface, wherein the first text character and the second text character have the corresponding relation between the original text and the translation.

The translation content is obtained by translating the original text content in advance, and the text characters in the original text content and the text characters in the translation content have the corresponding relation between the original text and the translation. By searching for a second text character in the second area that has a textual and translated correspondence with the first text character, characters in the second area that are near the handwritten note line can be located.

Step S140: and drawing the handwritten note line in the second area according to the relative position parameters of the handwritten note line and the first text character in the first area and the position of the second text character in the second area.

Specifically, according to the relative position parameters of the handwritten note bar and the first text character in the first area and the position of the second text character in the second area, the target position which is consistent with the relative position of the second text character and the relative position parameters is determined in the second area, and then the handwritten note bar is drawn at the target position. By determining the target position in the second area according to the relative position parameter and drawing the handwritten note line, the fact that the determined target position is incorrect due to the fact that the first text character and the second text character do not correspond word by word line can be avoided. For example, the content of the original text in chinese is displayed in the first area, the first text characters are 3 characters, the content of the translation in english is displayed in the second area, and the second text characters corresponding to the first text characters are 5 characters.

According to the handwritten note synchronization method during bilingual contrast reading provided by the embodiment, in response to a handwritten operation instruction generated by executing handwritten input on a first area of a reading interface, a handwritten note bar is drawn in the first area in real time, and a first text character in a preset range near the handwritten note bar in the first area is acquired, so that the position of the synchronized handwritten note bar is subsequently positioned in a second area; and drawing the handwritten note line in the second area according to the relative position parameters of the handwritten note line and the first text character in the first area and the position of the second text character in the second area by searching for the second text character in the second area so as to accurately position the position of the synchronous handwritten note line in the second area, thereby realizing the synchronous drawing of the handwritten note line. Therefore, in the embodiment, in the contrast reading mode, in response to the handwriting operation instruction generated in the first area, the synchronous handwritten note lines can be drawn at the reasonable position in the second area while the handwritten note lines are drawn in the first area, so that the synchronization of the handwritten note in two independent areas is realized, and the contrast reading experience of a user is improved; and the position of the handwritten note line is determined and drawn through the relative position parameters, so that the determined target position is not correct when the first text character and the second text character do not correspond word by word line, and the position accuracy of note synchronization is improved.

Fig. 2 is a flowchart illustrating a method for synchronizing handwritten notes during bilingual cross-reading according to another embodiment of the present invention. In this embodiment, a description will be given mainly of a manner of performing one handwritten note synchronization in the second area after completing one complete handwriting input operation.

As shown in fig. 2, the method comprises the steps of:

step S210: and monitoring a handwriting operation instruction generated by executing handwriting input on the first area of the reading interface.

In a bilingual comparison reading mode, a reading interface comprises a first area and a second area, wherein the first area is used for displaying original text content, and the second area is used for displaying translation content of the original text content; or the second area is used for displaying the original text content, and the first area is used for displaying the translation content of the original text content. And the first area and the second area are partitions arranged up and down, or the first area and the second area are partitions arranged left and right.

Fig. 3a to 3c are schematic diagrams illustrating the first region and the second region in three divisional manners. Fig. 3a is a schematic diagram of a first area and a second area of a left-right partition of the vertical screen, as shown in fig. 3a, the first area is on the left, and the second area is on the right. FIG. 3b is a schematic diagram of the first area and the second area partitioned from the top to the bottom of the vertical screen, as shown in FIG. 3b, the first area is on the top and the second area is on the bottom. Fig. 3c is a schematic diagram of the first area and the second area partitioned on the left and right of the horizontal screen, and as shown in fig. 3c, after entering a bilingual matching reading mode, the mode is automatically switched to a horizontal screen double page turning mode, wherein the first area is on the left and the second area is on the right. It should be noted that, in actual implementation, the positions of the first region and the second region are not limited to those shown in fig. 3a to 3c, and the positions of the first region and the second region may be reversed, for example, in fig. 3c, the first region may be on the right and the second region may be on the left.

And the original text contents and the translation contents in the first area and the second area are established with position correspondence, so that the line where each original text in the original text contents is located is consistent with the line where the translation text corresponding to the original text in the translation contents is located. The correspondence of the positions can be established by translation and anchoring association of the initial characters of each natural segment, for the first region and the second region of the left and right partitions, the correspondence refers to the same horizontal line, and for the first region and the second region of the upper and lower partitions, the correspondence refers to the lines with the same sequence number, for example, the lines are all the 5 th lines. After the position correspondence is established, the user scrolls the content in any one of the first area and the second area, and the other area synchronously scrolls to keep the content in the two areas symmetrical all the time.

Step S220: and responding to the handwriting operation instruction, drawing in real time in the first area to obtain a complete handwriting note line corresponding to one-time complete handwriting input, and acquiring a first text character in a preset range near the complete handwriting note line in the first area.

In this embodiment, for a complete handwritten note line drawn in the first area corresponding to one complete handwritten input, the complete handwritten note line is drawn in the second area. Wherein a complete handwriting input is defined by touching the screen and leaving the screen as a demarcation point.

Specifically, the minimum circumscribed rectangle of the complete handwritten note line is determined in the first area, the first text character is obtained according to the minimum circumscribed rectangle, the minimum circumscribed rectangle reflects the range of the width and the height covered by the complete handwritten note line, and correspondingly, the character inside the minimum circumscribed rectangle and/or the character outside the minimum circumscribed rectangle within the first preset distance can be used as the first text character to clarify the character covered by the complete handwritten note line and/or the character close to the complete handwritten note line, so that subsequent positioning in the second area is facilitated.

Further, when the first text character is obtained, the character falling into the minimum circumscribed rectangle is obtained as the first text character, wherein the character in the minimum circumscribed rectangle is the character covered with the width and the height of the complete handwritten note line, and part of the character falling into the minimum circumscribed rectangle is marked as the first text character. Or acquiring a character which is within a first preset distance range from the boundary of the minimum circumscribed rectangle as a first text character, wherein the first text character acquired in the mode is a character which is not covered by the minimum circumscribed rectangle but is closer to the boundary thereof, and the first text character acquired in the mode is equivalent to determining the peripheral range of the complete handwritten note. In addition, in some optional embodiments, the two manners may also be combined, so that the determined first text character may simultaneously limit the coverage area and the peripheral area of the complete handwritten note line, thereby facilitating more accurate positioning in the second area.

In practice, there may be a plurality of characters within the predetermined range of the handwritten note line attachment, for example, a sentence, for the case that if there is a plurality of first text characters, the first text characters forming the entity vocabulary are extracted from the plurality of first text characters, wherein the entity vocabulary includes the name vocabulary, the place vocabulary and/or the event name vocabulary, so as to reduce the number of characters, and facilitate the subsequent efficient determination of the second text character in the second region.

In this step, a handwritten note line needs to be drawn in the first area, and in actual implementation, the handwritten note line may be drawn on the handwritten layer in the first area so as to avoid affecting the originally displayed text content.

Step S230: and searching a second text character corresponding to the first text character in a second area of the reading interface, wherein the first text character and the second text character have the corresponding relation between the original text and the translation.

In the embodiment of the present invention, a specific manner for searching for the second text character in the second area is not limited, and any manner in which the second text character corresponding to the original text and the translation of the first text character can be found in actual implementation is included in the scope of the present invention. Two specific ways of finding are described below:

in the first mode, according to the corresponding relation between the vocabulary in the original text content and the vocabulary in the translation content, the second text character corresponding to the first text character is searched in the second area of the reading interface, the translation content is obtained by translating the original content in advance, the corresponding relation between the vocabulary in the original text content and the vocabulary in the translation content can be determined, and the second text character corresponding to the first text character can be accurately searched.

And secondly, searching the second text character according to the real-time translation result of the first text character and/or the line of the translation result in the second area. In this manner, after a first text character is acquired, translation processing is performed on the first text character to obtain a target text character, where in the translation processing, translation is performed in a language to which the content displayed in the second region belongs, and for example, when the language of the second region is english, the first text character is translated into english. And then, when searching for a second text character, searching for a target text character in a second area of the reading interface, and determining the second text character according to a searching result, wherein if one target text character is searched, the one target text character is determined as the second text character, and if multiple target text characters are searched, the second text character is locked from the multiple target text characters according to the positions of the multiple target text characters in the second area and the positions of the first text character in the first area respectively. In the bilingual comparison reading mode, the contents in the two areas are kept symmetrical according to lines, namely the line where a part of original text in the original text content is located is consistent with the line where the translated text of the part of original text in the translated content is located, and correspondingly, when a plurality of target text characters exist, the target text character which is consistent with the line where the first text character is located in the first area in the target text characters is determined as a second text character. By the method, the corresponding relation between the original text and the translation does not need to be searched one by one, and the second text character can be quickly positioned according to the real-time translation result and/or the line where the translation result is located.

Step S240: and determining the position of the minimum circumscribed rectangle in the second area according to the relative position parameters of the minimum circumscribed rectangle and the first text character in the first area and the position of the second text character in the second area, and drawing the complete handwritten note line in the minimum circumscribed rectangle in the second area.

Specifically, for the case that the complete handwritten note line is drawn in the second area at one time in the embodiment, when the handwritten note line is drawn in the second area according to the relative position, the position of the minimum circumscribed rectangle is determined in the second area, so that the relative position between the minimum circumscribed rectangle and the second text character meets the relative position parameter between the minimum circumscribed rectangle and the first text character in the first area, and the position of the minimum circumscribed rectangle refers to the position of the rectangular boundary; and then drawing a complete handwritten note line in the minimum circumscribed rectangle in the second area, so that the second area has the complete handwritten note line synchronized with the first area.

Further, the handwritten notes entered by the user may be a marker symbol, e.g. a marker for a word in a circle, or a label character, e.g. a text note next to a word. In practice, when the complete handwritten note line is drawn in the minimum circumscribed rectangle in the second area, if the handwritten note is a mark symbol, drawing an equal-proportion complete handwritten note line in the minimum circumscribed rectangle in the second area according to the position of the handwritten note line in the minimum circumscribed rectangle in the first area and the width-height ratio of the minimum circumscribed rectangle in the second area to the minimum circumscribed rectangle in the first area.

Or if the handwritten note is a character, performing character recognition on the complete handwritten note line to obtain a recognition character, wherein the character recognition aims at the complete handwritten note line in the handwritten layer; translating the recognition character according to the language of the content displayed in the second area to obtain a translated character; the translated character is then rendered within the minimum bounding rectangle in the second region using the printed font. For example, the complete handwritten note line is subjected to character recognition to obtain a character "good", if the second area displays English content, the character "good" is translated into a character "good", and then the character "good" is printed in the minimum circumscribed rectangle in the second area. By the mode, note synchronization is achieved for the condition that the pen is marked as the character, note characters of corresponding languages can be displayed in the two areas respectively, and the note characters in the two areas are consistent with the languages of the displayed contents.

It should be noted that, in practice, it is often necessary to distinguish whether a mark symbol or a mark character is input by a user through a certain detection means, and based on this, in some optional embodiments, for a complete handwritten note line, the complete handwritten note line may be first identified by using a character recognition technology, if a character result is identified, drawing processing is performed according to the condition of the mark character, and if a character result is not identified, drawing processing is performed according to the condition of the mark symbol, so that a detection process may be omitted.

In addition, in an alternative embodiment where there are a plurality of first text characters and a first entity text character constituting an entity vocabulary is extracted from the plurality of first text characters, correspondingly, a second entity text character corresponding to the first entity text character is searched in a second area of the reading interface, and then the handwritten note bar is always drawn in the second area according to the relative position parameters of the handwritten note bar and the first entity text character in the first area and the position of the second entity text character in the second area.

According to the handwritten note synchronization method during bilingual contrast reading provided by the embodiment, the method mainly realizes the synchronization of handwritten notes in a mode that a complete handwritten note line is drawn in a second area once after a complete handwritten input operation is completed in a first area. Drawing a complete handwritten note line in real time in a first area according to handwriting input operation, and acquiring a first text character near a minimum circumscribed rectangle of the complete handwritten note line; and then searching a second text character corresponding to the first text character in the second area, determining the position of the minimum circumscribed rectangle in the second area, enabling the relative position of the minimum circumscribed rectangle and the second text character to meet the relative position parameter of the minimum circumscribed rectangle and the first text character in the first area, and finally drawing in the minimum circumscribed rectangle in the second area once to obtain a complete handwritten note line. Therefore, according to the scheme of the embodiment, in the aspect of user perception, a real-time note line can be drawn in the first area along with the process that a user inputs a handwritten note in the first area, at the moment, synchronous drawing is not performed in the second area, then, after the input is finished (for example, after a pen is lifted), a complete handwritten note line is drawn in the first area, at the moment, the complete handwritten note line is synchronized in the second area, the synchronous operation amount can be reduced while note synchronization is realized, and after the handwriting input is finished, the synchronization is finished at one time.

Fig. 4 is a flowchart illustrating a method for synchronizing handwritten notes during bilingual cross-reading according to another embodiment of the present invention. In the present embodiment, description is mainly given in such a manner that handwritten notes are synchronized in the first area and the second area in real time following input of the handwritten notes. It should be noted that, in the embodiment corresponding to fig. 4, only the differences from the embodiment shown in fig. 2 are described, and the rest of the processes that are not described in detail can refer to the description of the corresponding steps in fig. 2, and are not described again in this embodiment.

As shown in fig. 4, the method comprises the steps of:

step S410: and monitoring a handwriting operation instruction generated by executing handwriting input on the first area of the reading interface.

Step S420: responding to the handwriting operation instruction, determining the position of a real-time handwriting note touch point in the first area, and drawing a real-time handwriting note line by connecting adjacent touch points; and acquiring a first text character in the first area within a preset range near the real-time handwritten note touch point.

In an embodiment, in the process that a user inputs a handwritten note in a first area, a real-time handwritten note line is drawn in the first area, and the real-time handwritten note line is drawn in a second area synchronously.

Specifically, in the method for synchronously handwriting the note line in real time, along with the handwriting input of the user, real-time handwriting note contact points are determined in the first area, wherein the real-time handwriting note contact points comprise contact points of a touch screen or contact points of an electromagnetic pen contacting the screen, and the real-time handwriting note line can be drawn in the first area by connecting adjacent handwriting note contact points. In the method for synchronously handwriting the note line in real time, the acquired first text character refers to a first text character in a preset range near a real-time handwriting note touch point, and is mainly acquired at a distance from the real-time handwriting note touch point, wherein a character in the first area, which is within a second preset distance range from the real-time handwriting note touch point, can be acquired as the first text character, or a character in the first area, which is closest to the real-time handwriting note touch point, can be acquired as the first text character.

Step S430: and searching a second text character corresponding to the first text character in a second area of the reading interface, wherein the first text character and the second text character have the corresponding relation between the original text and the translation.

Step S440: and determining the position of the real-time handwritten note touch point in the second area according to the relative position parameters of the real-time handwritten note touch point and the first text character in the first area and the position of the second text character in the second area, and synchronously drawing by connecting adjacent touch points to obtain the real-time handwritten note line.

Specifically, the position of the real-time handwriting note touch point in the second area is determined, so that the relative position of the real-time handwriting note touch point and the second text character in the second area meets the relative position parameter between the real-time handwriting note touch point and the first text character in the first area. And then, connecting adjacent real-time handwritten note touch points in the second area to obtain a real-time handwritten note line.

It should be noted that, in the embodiment, since the real-time handwritten note touch points are synchronously drawn in the first area and the second area, only one segment of line is usually drawn synchronously each time, and the method cannot be applied to a mode of performing character recognition in the first area and then performing drawing in the second area.

According to the handwritten note synchronization method during bilingual contrasting and reading provided by the embodiment, the method is mainly used for realizing the synchronization of handwritten notes in a mode that a real-time handwritten note line is drawn in a first area according to a handwriting operation instruction, and simultaneously the real-time handwritten note line is also drawn in a second area synchronously. The method comprises the steps that in response to a handwriting operation instruction generated in a first area, the position of a real-time handwriting note touch point is determined in the first area, a real-time handwriting note line is drawn by connecting adjacent touch points, and a first text character near the real-time handwriting note touch point is obtained; and then searching a second text character corresponding to the first text character in the second area, determining the position of a real-time handwritten note touch point near the second area and the second text character according to the relative position parameter, and drawing to obtain a real-time handwritten note line. Therefore, according to the scheme of the embodiment, in the sense of the user, along with the process that the user inputs the handwritten notes in the first area, the real-time handwritten note line is drawn in the first area, and simultaneously, the real-time handwritten note line is drawn in the second area, so that the real-time synchronization of the note lines in the first area and the second area is realized, the delay of the synchronous handwritten notes in the second area is reduced, and the real-time comparison of the handwritten notes can be realized.

The embodiment of the invention provides a nonvolatile computer storage medium, wherein at least one executable instruction is stored in the computer storage medium, and the computer executable instruction can execute the handwritten note synchronization method during bilingual comparison reading in any method embodiment.

The executable instructions may be specifically configured to cause the processor to: monitoring a handwriting operation instruction generated by executing handwriting input on a first area of a reading interface; responding to the handwriting operation instruction, drawing a handwriting note line in the first area, and acquiring a first text character in a preset range near the handwriting note line in the first area; searching a second text character corresponding to the first text character in a second area of the reading interface, wherein the first text character and the second text character have a corresponding relation between original text and translation; drawing the handwritten note line in the second area according to the relative position parameters of the handwritten note line and the first text character in the first area and the position of the second text character in the second area.

In an optional implementation manner, the first area is used for displaying original text content, and the second area is used for displaying translation content of the original text content; or the second area is used for displaying the original text content, and the first area is used for displaying the translation content of the original text content.

In an optional embodiment, the first region and the second region are partitions arranged in an up-down manner, or the first region and the second region are partitions arranged in a left-right manner.

In an alternative embodiment, the executable instructions further cause the processor to: and responding to the handwriting operation instruction, drawing in real time in the first area to obtain a complete handwriting note line corresponding to one-time complete handwriting input, and acquiring a first text character in a preset range near the complete handwriting note line in the first area.

In an alternative embodiment, the executable instructions further cause the processor to: and determining the minimum circumscribed rectangle of the complete handwritten note line in the first area, and acquiring a first text character according to the minimum circumscribed rectangle.

In an alternative embodiment, the executable instructions further cause the processor to: acquiring characters falling into the minimum circumscribed rectangle as first text characters; or acquiring characters with the boundary distance with the minimum circumscribed rectangle within a first preset distance range as first text characters.

In an alternative embodiment, the executable instructions further cause the processor to: and determining the position of the minimum circumscribed rectangle in the second area and drawing the complete handwritten note line in the minimum circumscribed rectangle in the second area according to the relative position parameters of the minimum circumscribed rectangle and the first text character in the first area and the position of the second text character in the second area.

In an alternative embodiment, the executable instructions further cause the processor to: performing character recognition on the complete handwritten note lines to obtain recognition characters; translating the recognition characters according to the language of the content displayed in the second area to obtain translated characters;

and drawing the translation character by using the printing font in the minimum bounding rectangle in the second area.

In an alternative embodiment, the executable instructions further cause the processor to: responding to the handwriting operation instruction, determining the position of a real-time handwriting note touch point in the first area, and drawing a real-time handwriting note line by connecting adjacent touch points; and acquiring a first text character in the first area within a preset range near the real-time handwritten note touch point.

In an alternative embodiment, the executable instructions further cause the processor to: and acquiring characters in the first area, wherein the distance between the characters and the real-time handwritten note contact is within a second preset distance range, and the characters are used as first text characters.

In an alternative embodiment, the executable instructions further cause the processor to: and determining the position of the real-time handwritten note touch point in the second area according to the relative position parameters of the real-time handwritten note touch point and the first text character in the first area and the position of the second text character in the second area, and synchronously drawing by connecting adjacent touch points to obtain the real-time handwritten note line.

In an alternative embodiment, if there are a plurality of the first text characters, the executable instructions further cause the processor to: extracting first entity text characters forming an entity vocabulary from the plurality of first text characters; searching a second entity text character corresponding to the first entity text character in a second area of the reading interface, and drawing the handwritten note bar in the second area according to the relative position parameters of the handwritten note bar and the first entity text character in the first area and the position of the second entity text character in the second area.

In an alternative embodiment, the entity vocabulary includes a person name vocabulary, a place name vocabulary, and/or an event name vocabulary.

In an alternative embodiment, the executable instructions further cause the processor to: and searching a second text character corresponding to the first text character in a second area of the reading interface according to the corresponding relation between the vocabulary in the original text content and the vocabulary in the translation content.

In an alternative embodiment, the executable instructions further cause the processor to: translating the first text character to obtain a target text character; and searching a target text character in a second area of the reading interface, and determining a second text character according to a searching result.

In an alternative embodiment, the executable instructions further cause the processor to: if one target text character is found, determining the one target text character as a second text character; and if multiple target text characters are found, locking a second text character from the multiple target text characters according to the positions of the multiple target text characters in a second area and the position of the first text character in the first area respectively.

In an alternative embodiment, the executable instructions further cause the processor to: and determining a target text character in the plurality of target text characters, which is consistent with the line where the first text character is located in the first area, as a second text character.

In an alternative embodiment, the executable instructions further cause the processor to: drawing a handwritten note line on the handwritten image layer in the first area; and drawing the handwritten note lines on the handwritten image layer in the second area.

Fig. 5 is a schematic structural diagram of a computing device according to an embodiment of the present invention, and the specific embodiment of the present invention does not limit the specific implementation of the computing device. As shown in fig. 5, the computing device may include: a processor (processor)502, a Communications Interface 504, a memory 506, and a communication bus 508. Wherein: the processor 502, communication interface 504, and memory 506 communicate with one another via a communication bus 508. A communication interface 504 for communicating with network elements of other devices, such as clients or other servers. The processor 502 is configured to execute the program 510, and may specifically execute the relevant steps in the foregoing method embodiment of the method for synchronizing handwritten notes during bilingual cross-reading of the computing device. In particular, program 510 may include program code that includes computer operating instructions. The processor 502 may be a central processing unit CPU or an application specific integrated circuit asic or one or more integrated circuits configured to implement embodiments of the present invention. The computing device includes one or more processors, which may be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs. And a memory 506 for storing a program 510. The memory 506 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

The program 510 may specifically be used to cause the processor 502 to perform the following operations: monitoring a handwriting operation instruction generated by executing handwriting input on a first area of a reading interface; responding to the handwriting operation instruction, drawing a handwriting note line in the first area, and acquiring a first text character in a preset range near the handwriting note line in the first area; searching a second text character corresponding to the first text character in a second area of the reading interface, wherein the first text character and the second text character have a corresponding relation between original text and translation; drawing the handwritten note line in the second area according to the relative position parameters of the handwritten note line and the first text character in the first area and the position of the second text character in the second area.

In an alternative embodiment, the program 510 further causes the processor 502 to: and responding to the handwriting operation instruction, drawing in real time in the first area to obtain a complete handwriting note line corresponding to one-time complete handwriting input, and acquiring a first text character in a preset range near the complete handwriting note line in the first area.

In an alternative embodiment, the program 510 further causes the processor 502 to: and determining the minimum circumscribed rectangle of the complete handwritten note line in the first area, and acquiring a first text character according to the minimum circumscribed rectangle.

In an alternative embodiment, the program 510 further causes the processor 502 to: acquiring characters falling into the minimum circumscribed rectangle as first text characters; or acquiring characters with the boundary distance with the minimum circumscribed rectangle within a first preset distance range as first text characters.

In an alternative embodiment, the program 510 further causes the processor 502 to: and determining the position of the minimum circumscribed rectangle in the second area and drawing the complete handwritten note line in the minimum circumscribed rectangle in the second area according to the relative position parameters of the minimum circumscribed rectangle and the first text character in the first area and the position of the second text character in the second area.

In an alternative embodiment, the program 510 further causes the processor 502 to: performing character recognition on the complete handwritten note lines to obtain recognition characters; translating the recognition characters according to the language of the content displayed in the second area to obtain translated characters; and drawing the translation character by using the printing font in the minimum bounding rectangle in the second area.

In an alternative embodiment, the program 510 further causes the processor 502 to: responding to the handwriting operation instruction, determining the position of a real-time handwriting note touch point in the first area, and drawing a real-time handwriting note line by connecting adjacent touch points; and acquiring a first text character in the first area within a preset range near the real-time handwritten note touch point.

In an alternative embodiment, the program 510 further causes the processor 502 to: and acquiring characters in the first area, wherein the distance between the characters and the real-time handwritten note contact is within a second preset distance range, and the characters are used as first text characters.

In an alternative embodiment, the program 510 further causes the processor 502 to: and determining the position of the real-time handwritten note touch point in the second area according to the relative position parameters of the real-time handwritten note touch point and the first text character in the first area and the position of the second text character in the second area, and synchronously drawing by connecting adjacent touch points to obtain the real-time handwritten note line.

In an alternative embodiment, if there are more than one first text character, the program 510 further causes the processor 502 to: extracting first entity text characters forming an entity vocabulary from the plurality of first text characters; searching a second entity text character corresponding to the first entity text character in a second area of the reading interface, and drawing the handwritten note bar in the second area according to the relative position parameters of the handwritten note bar and the first entity text character in the first area and the position of the second entity text character in the second area.

In an alternative embodiment, the program 510 further causes the processor 502 to: and searching a second text character corresponding to the first text character in a second area of the reading interface according to the corresponding relation between the vocabulary in the original text content and the vocabulary in the translation content.

In an alternative embodiment, the program 510 further causes the processor 502 to: translating the first text character to obtain a target text character; and searching a target text character in a second area of the reading interface, and determining a second text character according to a searching result.

In an alternative embodiment, the program 510 further causes the processor 502 to: if one target text character is found, determining the one target text character as a second text character; and if multiple target text characters are found, locking a second text character from the multiple target text characters according to the positions of the multiple target text characters in a second area and the position of the first text character in the first area respectively.

In an alternative embodiment, the program 510 further causes the processor 502 to: and determining a target text character in the plurality of target text characters, which is consistent with the line where the first text character is located in the first area, as a second text character.

In an alternative embodiment, the program 510 further causes the processor 502 to: drawing a handwritten note line on the handwritten image layer in the first area; and drawing the handwritten note lines on the handwritten image layer in the second area.

The algorithms or displays presented herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. In addition, embodiments of the present invention are not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of embodiments of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best modes of embodiments of the invention.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the embodiments of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that is, the claimed embodiments of the invention require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functionality of some or all of the components according to embodiments of the present invention. Embodiments of the invention may also be implemented as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing embodiments of the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. Embodiments of the invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names. The steps in the above embodiments should not be construed as limiting the order of execution unless specified otherwise.

The invention discloses: A1. a synchronization method for handwritten notes during bilingual contrast reading comprises the following steps:

monitoring a handwriting operation instruction generated by executing handwriting input on a first area of a reading interface; responding to the handwriting operation instruction, drawing a handwriting note line in the first area, and acquiring a first text character in a preset range near the handwriting note line in the first area; searching a second text character corresponding to the first text character in a second area of the reading interface, wherein the first text character and the second text character have a corresponding relation between original text and translation; drawing the handwritten note line in the second area according to the relative position parameters of the handwritten note line and the first text character in the first area and the position of the second text character in the second area.

A2. The method according to A1, wherein the first area is used for displaying original text content, and the second area is used for displaying the translated content of the original text content; or the second area is used for displaying the original text content, and the first area is used for displaying the translation content of the original text content.

A3. The method of a1 or a2, wherein the first and second regions are partitions arranged up and down, or the first and second regions are partitions arranged left and right.

A4. The method according to any one of a1-A3, wherein the drawing a handwritten note line in the first area in response to the handwriting operation instruction, and acquiring a first text character in a preset range near the handwritten note line in the first area specifically includes: and responding to the handwriting operation instruction, drawing in real time in the first area to obtain a complete handwriting note line corresponding to one-time complete handwriting input, and acquiring a first text character in a preset range near the complete handwriting note line in the first area.

A5. The method according to a4, wherein the acquiring a first text character in a preset range near the complete handwritten note line in the first area further comprises: and determining the minimum circumscribed rectangle of the complete handwritten note line in the first area, and acquiring a first text character according to the minimum circumscribed rectangle.

A6. The method of a5, wherein the obtaining a first text character according to the minimum bounding rectangle further comprises: acquiring characters falling into the minimum circumscribed rectangle as first text characters; or acquiring characters with the boundary distance with the minimum circumscribed rectangle within a first preset distance range as first text characters.

A7. The method of A5 or A6, wherein the drawing the handwritten note bar in the second area according to the relative position parameters of the handwritten note bar and a first text character in the first area and the position of the second text character in the second area further comprises: and determining the position of the minimum circumscribed rectangle in the second area and drawing the complete handwritten note line in the minimum circumscribed rectangle in the second area according to the relative position parameters of the minimum circumscribed rectangle and the first text character in the first area and the position of the second text character in the second area.

A8. The method according to a7, wherein after a complete handwritten note line corresponding to a complete handwritten input is drawn in real time in the first area, the method further comprises: performing character recognition on the complete handwritten note lines to obtain recognition characters; translating the recognition characters according to the language of the content displayed in the second area to obtain translated characters; the drawing the complete handwritten note line within the minimum bounding rectangle in the second area further comprises: and drawing the translation character by using the printing font in the minimum bounding rectangle in the second area.

A9. The method according to any one of a1-A3, wherein the drawing a handwritten note line in the first area in response to the handwriting operation instruction, and acquiring a first text character in a preset range near the handwritten note line in the first area specifically includes: responding to the handwriting operation instruction, determining the position of a real-time handwriting note touch point in the first area, and drawing a real-time handwriting note line by connecting adjacent touch points; and acquiring a first text character in the first area within a preset range near the real-time handwritten note touch point.

A10. The method of A9, wherein the obtaining a first text character within a preset range near the real-time handwritten note contact in the first area further comprises: and acquiring characters in the first area, wherein the distance between the characters and the real-time handwritten note contact is within a second preset distance range, and the characters are used as first text characters.

A11. The method of A9 or A10, wherein the drawing the handwritten note bar in the second area according to the relative position parameters of the handwritten note bar and a first text character in the first area and the position of the second text character in the second area further comprises: and determining the position of the real-time handwritten note touch point in the second area according to the relative position parameters of the real-time handwritten note touch point and the first text character in the first area and the position of the second text character in the second area, and synchronously drawing by connecting adjacent touch points to obtain the real-time handwritten note line.

A12. The method of any one of a1-a11, wherein, if the first text character is plural, the method further comprises: extracting first entity text characters forming an entity vocabulary from the plurality of first text characters; searching a second text character corresponding to the first text character in a second area of the reading interface, and drawing the handwritten note bar in the second area according to the relative position parameters of the handwritten note bar and the first text character in the first area and the position of the second text character in the second area, specifically: searching a second entity text character corresponding to the first entity text character in a second area of the reading interface, and drawing the handwritten note bar in the second area according to the relative position parameters of the handwritten note bar and the first entity text character in the first area and the position of the second entity text character in the second area.

A13. The method of a12, wherein the entity vocabulary includes a person name vocabulary, a place name vocabulary, and/or an event name vocabulary.

A14. The method of any of A1-A13, wherein the locating a second text character corresponding to the first text character in a second region of the reading interface further comprises: and searching a second text character corresponding to the first text character in a second area of the reading interface according to the corresponding relation between the vocabulary in the original text content and the vocabulary in the translation content.

A15. The method according to any one of A1-A13, wherein after the first text character in a preset range near the handwritten note line in the first area is obtained, the method further comprises the steps of translating the first text character to obtain a target text character; said locating a second text character corresponding to the first text character in a second region of the reading interface further comprises: and searching a target text character in a second area of the reading interface, and determining a second text character according to a searching result.

A16. The method of a15, wherein the determining a second text character according to the search result further comprises: if one target text character is found, determining the one target text character as a second text character; and if multiple target text characters are found, locking a second text character from the multiple target text characters according to the positions of the multiple target text characters in a second area and the position of the first text character in the first area respectively.

A17. The method according to a16, wherein the first area and the second area are left and right partitions, and the locking the second text character from the multiple target text characters according to the positions of the multiple target text characters in the second area and the position of the first text character in the first area respectively is specifically: and determining a target text character in the plurality of target text characters, which is consistent with the line where the first text character is located in the first area, as a second text character.

A18. The method according to any one of A1-A17, wherein the drawing of the handwritten note line in the first area is specifically: drawing a handwritten note line on the handwritten image layer in the first area; and drawing the handwritten note line in the second area specifically comprises: and drawing the handwritten note lines on the handwritten image layer in the second area.

The invention also discloses: B19. a computing device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus; the memory is configured to store at least one executable instruction that causes the processor to:

B20. The computing device of B19, wherein the first region is to display textual content and the second region is to display translated content of the textual content; or the second area is used for displaying the original text content, and the first area is used for displaying the translation content of the original text content.

B21. The computing device of B19 or B20, wherein the first and second regions are partitions arranged top-bottom or left-right.

B22. The computing device of any one of B19-B21, wherein the executable instructions further cause the processor to: and responding to the handwriting operation instruction, drawing in real time in the first area to obtain a complete handwriting note line corresponding to one-time complete handwriting input, and acquiring a first text character in a preset range near the complete handwriting note line in the first area.

B23. The computing device of B22, wherein the executable instructions further cause the processor to: and determining the minimum circumscribed rectangle of the complete handwritten note line in the first area, and acquiring a first text character according to the minimum circumscribed rectangle.

B24. The computing device of B23, wherein the executable instructions further cause the processor to: acquiring characters falling into the minimum circumscribed rectangle as first text characters; or acquiring characters with the boundary distance with the minimum circumscribed rectangle within a first preset distance range as first text characters.

B25. The computing device of B23 or B24, wherein the executable instructions further cause the processor to: and determining the position of the minimum circumscribed rectangle in the second area and drawing the complete handwritten note line in the minimum circumscribed rectangle in the second area according to the relative position parameters of the minimum circumscribed rectangle and the first text character in the first area and the position of the second text character in the second area.

B26. The computing device of B25, wherein the executable instructions further cause the processor to: performing character recognition on the complete handwritten note lines to obtain recognition characters; translating the recognition characters according to the language of the content displayed in the second area to obtain translated characters; and drawing the translation character by using the printing font in the minimum bounding rectangle in the second area.

B27. The computing device of any one of B19-B21, wherein the executable instructions further cause the processor to: responding to the handwriting operation instruction, determining the position of a real-time handwriting note touch point in the first area, and drawing a real-time handwriting note line by connecting adjacent touch points; and acquiring a first text character in the first area within a preset range near the real-time handwritten note touch point.

B28. The computing device of B27, wherein the executable instructions further cause the processor to: and acquiring characters in the first area, wherein the distance between the characters and the real-time handwritten note contact is within a second preset distance range, and the characters are used as first text characters.

B29. The computing device of B27 or B28, wherein the executable instructions further cause the processor to: and determining the position of the real-time handwritten note touch point in the second area according to the relative position parameters of the real-time handwritten note touch point and the first text character in the first area and the position of the second text character in the second area, and synchronously drawing by connecting adjacent touch points to obtain the real-time handwritten note line.

B30. The computing device of any one of B19-B29, wherein, if the first text character is multiple, the executable instructions further cause the processor to: extracting first entity text characters forming an entity vocabulary from the plurality of first text characters; searching a second entity text character corresponding to the first entity text character in a second area of the reading interface, and drawing the handwritten note bar in the second area according to the relative position parameters of the handwritten note bar and the first entity text character in the first area and the position of the second entity text character in the second area.

B31. The computing device of B30, wherein the entity vocabulary includes a person name vocabulary, a place name vocabulary, and/or an event name vocabulary.

B32. The computing device of any one of B19-B31, wherein the executable instructions further cause the processor to: and searching a second text character corresponding to the first text character in a second area of the reading interface according to the corresponding relation between the vocabulary in the original text content and the vocabulary in the translation content.

B33. The computing device of any one of B19-B31, wherein the executable instructions further cause the processor to: translating the first text character to obtain a target text character; and searching a target text character in a second area of the reading interface, and determining a second text character according to a searching result.

B34. The computing device of B33, wherein the executable instructions further cause the processor to: if one target text character is found, determining the one target text character as a second text character; and if multiple target text characters are found, locking a second text character from the multiple target text characters according to the positions of the multiple target text characters in a second area and the position of the first text character in the first area respectively.

B35. The computing device of B34, wherein the executable instructions further cause the processor to: and determining a target text character in the plurality of target text characters, which is consistent with the line where the first text character is located in the first area, as a second text character.

B36. The computing device of any one of B19-B35, wherein the executable instructions further cause the processor to: drawing a handwritten note line on the handwritten image layer in the first area; and drawing the handwritten note lines on the handwritten image layer in the second area.

The invention also discloses: C37. a computer storage medium having stored therein at least one executable instruction that causes a processor to: monitoring a handwriting operation instruction generated by executing handwriting input on a first area of a reading interface; responding to the handwriting operation instruction, drawing a handwriting note line in the first area, and acquiring a first text character in a preset range near the handwriting note line in the first area; searching a second text character corresponding to the first text character in a second area of the reading interface, wherein the first text character and the second text character have a corresponding relation between original text and translation; drawing the handwritten note line in the second area according to the relative position parameters of the handwritten note line and the first text character in the first area and the position of the second text character in the second area.

C38. The computer storage medium of C37, wherein the first region is to display original text content and the second region is to display translated content of the original text content; or the second area is used for displaying the original text content, and the first area is used for displaying the translation content of the original text content.

C39. The computer storage medium of C37 or C38, wherein the first and second regions are partitions arranged top and bottom or left and right.

C40. The computer storage medium of any of C37-C39, wherein the executable instructions further cause the processor to: and responding to the handwriting operation instruction, drawing in real time in the first area to obtain a complete handwriting note line corresponding to one-time complete handwriting input, and acquiring a first text character in a preset range near the complete handwriting note line in the first area.

C41. The computer storage medium of C40, wherein the executable instructions further cause the processor to: and determining the minimum circumscribed rectangle of the complete handwritten note line in the first area, and acquiring a first text character according to the minimum circumscribed rectangle.

C42. The computer storage medium of C41, wherein the executable instructions further cause the processor to: acquiring characters falling into the minimum circumscribed rectangle as first text characters; or acquiring characters with the boundary distance with the minimum circumscribed rectangle within a first preset distance range as first text characters.

C43. The computer storage medium of C41 or C42, wherein the executable instructions further cause the processor to: and determining the position of the minimum circumscribed rectangle in the second area and drawing the complete handwritten note line in the minimum circumscribed rectangle in the second area according to the relative position parameters of the minimum circumscribed rectangle and the first text character in the first area and the position of the second text character in the second area.

C44. The computer storage medium of C43, wherein the executable instructions further cause the processor to: performing character recognition on the complete handwritten note lines to obtain recognition characters; translating the recognition characters according to the language of the content displayed in the second area to obtain translated characters; and drawing the translation character by using the printing font in the minimum bounding rectangle in the second area.

C45. The computer storage medium of any of C37-C39, wherein the executable instructions further cause the processor to: responding to the handwriting operation instruction, determining the position of a real-time handwriting note touch point in the first area, and drawing a real-time handwriting note line by connecting adjacent touch points; and acquiring a first text character in the first area within a preset range near the real-time handwritten note touch point.

C46. The computer storage medium of C45, wherein the executable instructions further cause the processor to: and acquiring characters in the first area, wherein the distance between the characters and the real-time handwritten note contact is within a second preset distance range, and the characters are used as first text characters.

C47. The computer storage medium of C45 or C46, wherein the executable instructions further cause the processor to: and determining the position of the real-time handwritten note touch point in the second area according to the relative position parameters of the real-time handwritten note touch point and the first text character in the first area and the position of the second text character in the second area, and synchronously drawing by connecting adjacent touch points to obtain the real-time handwritten note line.

C48. The computer storage medium of any one of C37-C47, wherein, if the first text character is plural, the executable instructions further cause the processor to: extracting first entity text characters forming an entity vocabulary from the plurality of first text characters; searching a second entity text character corresponding to the first entity text character in a second area of the reading interface, and drawing the handwritten note bar in the second area according to the relative position parameters of the handwritten note bar and the first entity text character in the first area and the position of the second entity text character in the second area.

C49. The computer storage medium of C48, wherein the entity vocabulary includes a vocabulary of names of people, a vocabulary of places, and/or a vocabulary of names of events.

C50. The computer storage medium of any of C37-C49, wherein the executable instructions further cause the processor to: and searching a second text character corresponding to the first text character in a second area of the reading interface according to the corresponding relation between the vocabulary in the original text content and the vocabulary in the translation content.

C51. The computer storage medium of any of C37-C49, wherein the executable instructions further cause the processor to: translating the first text character to obtain a target text character; and searching a target text character in a second area of the reading interface, and determining a second text character according to a searching result.

C52. The computer storage medium of C51, wherein the executable instructions further cause the processor to: if one target text character is found, determining the one target text character as a second text character; and if multiple target text characters are found, locking a second text character from the multiple target text characters according to the positions of the multiple target text characters in a second area and the position of the first text character in the first area respectively.

C53. The computer storage medium of C52, wherein the executable instructions further cause the processor to: and determining a target text character in the plurality of target text characters, which is consistent with the line where the first text character is located in the first area, as a second text character.

C54. The computer storage medium of any of C37-C53, wherein the executable instructions further cause the processor to: drawing a handwritten note line on the handwritten image layer in the first area; and drawing the handwritten note lines on the handwritten image layer in the second area.

Claims

1. A synchronization method for handwritten notes during bilingual contrast reading comprises the following steps:

2. The method of claim 1, wherein the first area is used for displaying original text content, and the second area is used for displaying translation content of the original text content; or the second area is used for displaying the original text content, and the first area is used for displaying the translation content of the original text content.

3. The method according to claim 1 or 2, wherein the first and second regions are partitions arranged up and down, or the first and second regions are partitions arranged left and right.

4. The method according to any one of claims 1 to 3, wherein the drawing a handwritten note line in the first area in response to the handwriting operation instruction, and acquiring a first text character in a preset range near the handwritten note line in the first area specifically includes:

and responding to the handwriting operation instruction, drawing in real time in the first area to obtain a complete handwriting note line corresponding to one-time complete handwriting input, and acquiring a first text character in a preset range near the complete handwriting note line in the first area.

5. The method of claim 4, wherein the obtaining of the first text character in the first area within a preset range near the complete handwritten note line further comprises:

and determining the minimum circumscribed rectangle of the complete handwritten note line in the first area, and acquiring a first text character according to the minimum circumscribed rectangle.

6. The method of claim 5, wherein said obtaining a first text character according to the minimum bounding rectangle further comprises:

acquiring characters falling into the minimum circumscribed rectangle as first text characters; alternatively, the first and second electrodes may be,

and acquiring characters with the boundary distance with the minimum circumscribed rectangle within a first preset distance range as first text characters.

7. The method of claim 5 or 6, wherein the drawing the handwritten note bar in the second area according to the relative position parameters of the handwritten note bar and the first text character in the first area and the position of the second text character in the second area further comprises:

and determining the position of the minimum circumscribed rectangle in the second area and drawing the complete handwritten note line in the minimum circumscribed rectangle in the second area according to the relative position parameters of the minimum circumscribed rectangle and the first text character in the first area and the position of the second text character in the second area.

8. The method of claim 7, wherein after drawing a complete handwritten note line corresponding to a complete handwritten input in real time within the first area, the method further comprises:

performing character recognition on the complete handwritten note lines to obtain recognition characters;

translating the recognition characters according to the language of the content displayed in the second area to obtain translated characters;

the drawing the complete handwritten note line within the minimum bounding rectangle in the second area further comprises: and drawing the translation character by using the printing font in the minimum bounding rectangle in the second area.

9. A computing device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

10. A computer storage medium having stored therein at least one executable instruction that causes a processor to: