CN111783387A

CN111783387A - Note processing method, computing device and storage medium

Info

Publication number: CN111783387A
Application number: CN202010611264.6A
Authority: CN
Inventors: 程超; 成湘均
Original assignee: Ireader Technology Co Ltd; Zhangyue Technology Co Ltd
Current assignee: Ireader Technology Co Ltd; Zhangyue Technology Co Ltd
Priority date: 2020-06-30
Filing date: 2020-06-30
Publication date: 2020-10-16

Abstract

The invention discloses a note processing method, a computing device and a storage medium, wherein the note processing method is used for adding notes to a plurality of documents displayed simultaneously in a reading page layer, and comprises the following steps: responding to a note storage instruction, and generating document pictures of a plurality of documents according to the current page contents of the plurality of documents in the reading page layer; acquiring screen partition layout information, and dividing a note layer into note areas corresponding to a plurality of documents according to the screen partition layout information; processing the note areas to generate note pictures of the note areas; and for each document, overlapping the note picture of the note area corresponding to the document on the document picture of the document to generate a note page of the document. According to the technical scheme provided by the invention, the corresponding relation between the document and the note area can be accurately determined according to the screen partition layout information, note processing on a plurality of documents displayed simultaneously is conveniently realized, and the note processing mode is optimized.

Description

Note processing method, computing device and storage medium

Technical Field

The invention relates to the technical field of computers, in particular to a note processing method, a computing device and a storage medium.

Background

With the continuous development of electronic book readers, more and more users prefer to read documents through electronic book readers. The document display mode commonly used by the existing electronic book reader is to display the page content of a single document in the whole screen display area, and during the reading process, a user can annotate own reading thoughts, views and the like at any time in the document in a mode of adding handwritten notes. According to the existing note processing mode, a user can write own note content in the whole screen display area, and the note content in the whole screen display area can be integrally stored as the note content of the current page content of the document.

In order to meet the requirement of a user for reading a plurality of documents at the same time, some electronic book readers also provide a display mode of document double opening and the like, so that the user can open and display a plurality of documents in the screen display area at the same time. However, the existing note processing method is only suitable for a display scene in which a single document is displayed in the screen display area, and note processing cannot be performed on a plurality of documents simultaneously displayed in the screen display area.

Disclosure of Invention

In view of the above, the present invention has been made to provide a note processing method, a computing device, and a storage medium that overcome or at least partially solve the above-mentioned problems.

According to an aspect of the present invention, there is provided a note processing method for adding notes to a plurality of documents simultaneously displayed in a reading page layer, the method including:

responding to a note storage instruction, and generating document pictures of a plurality of documents according to the current page contents of the plurality of documents in the reading page layer;

acquiring screen partition layout information, and dividing a note layer into note areas corresponding to a plurality of documents according to the screen partition layout information;

processing the note areas to generate note pictures of the note areas;

and for each document, overlapping the note picture of the note area corresponding to the document on the document picture of the document to generate a note page of the document.

According to another aspect of the present invention, there is provided a computing device comprising: the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is used for storing at least one executable instruction, the executable instruction is used for adding notes to a plurality of documents displayed simultaneously in the reading page layer, and the executable instruction causes the processor to execute the following operations:

processing the note areas to generate note pictures of the note areas;

According to another aspect of the present invention, there is provided a storage medium having stored therein at least one executable instruction for taking notes on a plurality of documents simultaneously displayed in a reading page layer, the executable instruction causing a processor to:

processing the note areas to generate note pictures of the note areas;

According to the technical scheme provided by the invention, the simultaneous display of a plurality of documents is realized by partitioning the screen display area of the electronic book reader, and the note layer can be conveniently partitioned according to the screen partition layout information to obtain the note areas corresponding to a plurality of documents, so that the accurate determination of the corresponding relationship between the documents and the note areas is realized; and through overlapping the document pictures of the documents and the corresponding note pictures, note pages can be generated quickly, note processing of a plurality of simultaneously displayed documents is realized conveniently, the requirement of a user for adding notes to the simultaneously displayed documents respectively is well met, and a note processing mode is optimized.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

fig. 1a is a flow chart of a note processing method according to a first embodiment of the present invention;

FIG. 1b shows a schematic view of a screen display area;

FIG. 1c shows another schematic view of a screen display area;

FIG. 2 is a flow chart illustrating a method for processing notes according to a second embodiment of the present invention;

fig. 3 is a schematic structural diagram of a computing device according to a fourth embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

Example one

Fig. 1a is a schematic flow chart of a note processing method according to a first embodiment of the present invention, and as shown in fig. 1a, the method includes the following steps:

step S101, responding to a note storage instruction, and generating document pictures of a plurality of documents according to the current page contents of the plurality of documents in the reading page layer.

A user may utilize an electronic book reader to read documents such as electronic books. In some cases, a user needs to read a plurality of documents simultaneously, and in order to meet the requirement of the user for reading the plurality of documents simultaneously, the simultaneous display of the plurality of documents can be realized by partitioning a screen display area of an electronic book reader, wherein each area can be opened and display an independent document for the user to browse and view. As shown in FIG. 1b, the screen display area may be divided into two areas, a left area in which the page content of document 1 is displayed and a right area in which the page content of document 2 is displayed. As also shown in FIG. 1c, the screen display area may be divided into 3 areas, where the page content of document 1 is displayed in the upper area on the left side, the page content of document 3 is displayed in the lower area on the left side, and the page content of document 2 is displayed in the right area. The number of partitions and the specific partitioning manner can be set by those skilled in the art according to actual needs, and are not limited herein.

The method is used for adding notes to a plurality of documents displayed simultaneously in the reading page layer. Specifically, in order to facilitate a user to add a note, the electronic book reader may generate a note layer on the reading page layer, the user may input note content that the user wants to write on the note layer through a finger or an electromagnetic pen, and the electronic book reader may refresh and display the note content input by the user in real time. When note storage is required, triggering a note storage instruction, and in step S101, in response to the note storage instruction, the electronic book reader generates document pictures of a plurality of documents according to current page contents of the plurality of documents in the reading page layer, where the document picture of each document includes the current page content of the document.

Step S102, obtaining screen partition layout information, and dividing the note layer into note areas corresponding to a plurality of documents according to the screen partition layout information.

In order to be able to distinguish the note contents in the note map layer from the document, screen division layout information is acquired in consideration of the fact that a plurality of documents are arranged in a layout according to the screen division layout information, and the screen division layout information records information such as the number of areas obtained by dividing the screen display area, the size, the position, and the like of each area. And dividing the note layer into a plurality of note areas according to the screen partition layout information, and establishing a corresponding relation between the note areas and the documents. The division of the note area may be visible to the user, for example by showing the extent of the note area by lines, or may be invisible.

As shown in fig. 1b, the screen display area is divided into two areas, which respectively display the page contents of document 1 and document 2, then the note map layer is divided into two note areas according to the screen partition layout information, which are note area 1 and note area 2, respectively, wherein note area 1 is the note area corresponding to document 1, note area 2 is the note area corresponding to document 2, and the range of the note area is displayed by the dotted line bar in fig. 1b, so that the user can intuitively and clearly understand the range of each note area.

Step S103, processing the plurality of note areas to generate note pictures of the plurality of note areas.

The note image layers can be subjected to screenshot processing according to the area position information of the note areas, note pictures of the note areas are generated, and the note picture of each note area comprises note contents in the note area. Considering that a user may write a note bar spanning multiple note areas when writing note content on the note layer, in step S103, processing such as deleting or screenshot needs to be performed on the note bar spanning multiple note areas, so as to finally determine note pictures of multiple note areas.

And step S104, for each document, superposing the note picture of the note area corresponding to the document on the document picture of the document to generate a note page of the document.

Generally, a document corresponds to a notebook, and all the note pages of the document corresponding to the document are stored in the notebook. After the document pictures of the plurality of documents and the note pictures of the plurality of note areas are generated, for each document, a note page can be generated by overlapping the document pictures of the document and the corresponding note pictures, specifically, overlapping the note pictures on the document pictures to generate a composite picture, and taking the composite picture as the note page of the document. The page content of the document and the note content in the corresponding note area can be simultaneously displayed in the note page, so that a user can conveniently know which note content is added to which page content of the document by looking up the note page.

By using the note processing method provided by the embodiment, the multiple documents are simultaneously displayed by partitioning the screen display area of the electronic book reader, and the note layer can be conveniently partitioned according to the screen partition layout information to obtain the note areas corresponding to the multiple documents, so that the corresponding relation between the documents and the note areas is accurately determined; and through overlapping the document pictures of the documents and the corresponding note pictures, note pages can be generated quickly, note processing of a plurality of simultaneously displayed documents is realized conveniently, the requirement of a user for adding notes to the simultaneously displayed documents respectively is well met, and a note processing mode is optimized.

Example two

Fig. 2 is a flowchart illustrating a note processing method according to a second embodiment of the present invention, and as shown in fig. 2, the method is used for adding notes to a plurality of documents displayed simultaneously in a reading page layer, and the method includes the following steps:

step S201, responding to the note storage instruction, and generating document pictures of a plurality of documents according to the current page contents of the plurality of documents in the reading page layer.

In the present embodiment, the screen display area of the electronic book reader may be partitioned according to the screen partition layout information to realize simultaneous display of a plurality of documents. The screen of the electronic book reader may be an electronic ink screen, a liquid crystal touch screen, or other touch screens, which is not limited herein. The electronic book reader is provided with a reading page layer for displaying documents, a note layer is further arranged on the reading page layer, and a user can input note contents which the user wants to write on the note layer through fingers or an electromagnetic pen. When note saving is needed, for example, a user selects to quit the document or performs a page turning operation on the document, the e-book reader may automatically trigger a note saving instruction, and in addition, the user may also trigger the note saving instruction on the screen by clicking a note saving control, pressing for a long time, and the like. In step S201, in response to the note saving instruction, the electronic book reader generates document pictures of a plurality of documents according to the current page contents of the plurality of documents in the reading page layer, where the document picture of each document includes the current page content of the document.

In an optional implementation manner, for each document in the reading page layer, a background picture and a text picture corresponding to the current page content of the document may be acquired, then the background picture is set in the bottom layer, the text picture is set in the top layer, and the background picture and the text picture are synthesized to generate a document picture of the document. The background picture refers to a picture which only contains the background content of the current page of the document and does not contain the text content, and the text picture refers to a picture which only contains the text content of the current page of the document and has a transparent ground color.

In another optional implementation, considering that the plurality of documents are arranged according to the screen partition layout information, the screen partition layout information may be obtained, and the screenshot process may be performed on the reading page layer according to the screen partition layout information to generate document pictures of the plurality of documents.

Step S202, obtaining screen partition layout information, and dividing the note layer into note areas corresponding to a plurality of documents according to the screen partition layout information.

The screen partition layout information records information such as the number of areas obtained by dividing the screen display area, the size and the position of each area. And dividing the note layer into a plurality of note areas according to the screen partition layout information, and establishing a corresponding relation between the note areas and the documents so as to obtain note areas corresponding to the plurality of documents.

Step S203, performing line recognition on the note content in the note layer.

Considering that a user may write a note bar spanning two or more note areas when writing note content on a note layer, for such note bar, separate processing is also required to implement effective processing of note content, and after determining note areas corresponding to a plurality of documents, the note content in the note layer may be subjected to bar recognition by using OpenCV and the like, so as to recognize the note bar included in the note content.

Step S204, judging whether a note line spanning multiple note areas exists in the note layer; if yes, go to step S205; if not, go to step S207.

If it is determined that there is no note bar spanning multiple note areas in the note layer, which indicates that the note areas corresponding to all the note bars in the note layer can be clearly determined, step S207 is executed. If it is determined that a note bar spanning multiple note areas exists in the note layer, it is indicated that it cannot be determined which note area the note bar actually corresponds to, in order to effectively store the note bar in the note storage process, the note bar may be captured first, and when the note pictures in the multiple note areas are stored respectively, the captured image is added to the note pictures in the note areas spanned by the note bar, so as to implement maximum retention of the note bar for the user to view, and specifically, this processing process may be implemented through step S205 and step S206.

Alternatively, in a case that it is determined that there is a note bar spanning multiple note areas in the note layer, which indicates that it cannot be determined which note area the note bar actually corresponds to, the note bar spanning multiple note areas may be directly deleted from the note layer, and then step S207 is performed. The processing mode has simple processing process and higher efficiency, and is beneficial to rapidly finishing note preservation.

Step S205, determining a note area corresponding to the note line, and capturing a line picture of the note line from the note layer.

For a note bar spanning multiple note areas, the note area corresponding to the note bar may be determined from the multiple note areas according to the position information of the note bar in the note layer, for example, all the note areas spanned by the note bar may be determined as the corresponding note areas. Assuming that a note bar spans the note area 1 and the note area 2, both the note area 1 and the note area 2 can be determined as the note area corresponding to the note bar. For the processing of the line picture, the external rectangle of the note line can be identified by using the existing image processing mode, the external rectangle can be the minimum external rectangle capable of enveloping the note line, and then the screenshot processing is carried out on the note layer according to the external rectangle, so that the line picture of the note line is obtained.

And step S206, performing screenshot processing on the note image layer according to the area position information of the note areas to generate note pictures of the note areas, and adding the line pictures to the note pictures of the note areas corresponding to the note lines.

The area position information of the note area records the position information of the note area in the note layer, and then for each note area, screenshot processing is performed on the note layer according to the area position information of the note area, so that a note picture containing note content in the note area can be generated, and the generated note picture is used as the note picture of the note area. Because the note lines spanning the note areas are subjected to screenshot processing before the note pictures of the note areas are generated, the note layer can no longer contain the note lines, and the note pictures of the note areas generated by the screenshot processing of the note layer do not contain any line part of the note lines. After the note pictures of the note areas are generated, in order to achieve the maximum retention of the note lines spanning the note areas, the line picture may be added to the note picture of the note area corresponding to the note line, and specifically, the line picture may be added to a position close to the original position of the note line in the note picture, so that the original position of the note line is retained to the maximum extent, which is convenient for a user to view. Assuming that a certain note bar crosses from the upper right of the note area 1 to the upper left of the note area 2, after the note picture of the note area 1 and the note picture of the note area 2 are generated, the bar picture of the note bar may be added to the upper right position in the note picture of the note area 1, and the bar picture of the note bar may be added to the upper left position in the note picture of the note area 2.

Step S207, performing screenshot processing on the note image layer according to the area position information of the note areas, and generating note pictures of the note areas.

Under the condition that the note lines spanning multiple note areas do not exist in the note layer, the note areas corresponding to all the note lines in the note layer can be definitely determined, and then, for each note area, screenshot processing is performed on the note layer according to the area position information of the note area, so that a note picture of the note area is generated, wherein the note picture contains note contents in the note area.

Step S208, aiming at each document, superposing the note picture of the note area corresponding to the document on the document picture of the document to generate a note page of the document.

The document corresponds to the notebook, and all the note pages of the corresponding document are stored in the notebook. For the generation of the note pages, for each document, the note picture corresponding to the document is superposed on the document picture of the document, and a synthetic picture is generated as the note page of the document. The page content of the document and the note content in the corresponding note area can be simultaneously displayed in the note page for the user to view. After the note pages are generated, an association relationship can be established between the pages of the document and the note pages, so that a user can conveniently skip to view the note pages of the corresponding pages in the process of reading the document.

Step S209, recording the association relationship of the document pages according to the current page contents of the plurality of documents in the reading page layer.

In order to realize the association viewing of the note pages of the plurality of documents, the document page association relationship can be recorded according to the current page content of the plurality of documents in the reading page layer, and the document page association relationship comprises the association relationship among the pages of the plurality of documents. Specifically, when the note pages are stored, the document page association relationship may be recorded into notebooks of the plurality of documents. The specific content of the association relationship of the document pages can be set by those skilled in the art according to actual needs.

Taking the example of simultaneously displaying the document 1 and the document 2 in the screen display area shown in FIG. 1b as an example, the document page association relationship may be "document ID of document 1 + page ID of document 1 + document ID of document 2 + page ID of document 2", where the page ID of document 1 and the page ID of document 2 refer to the corresponding identifications of the page contents respectively displayed by document 1 and document 2 when the notes are added. Assuming that what is displayed in fig. 1b is page content corresponding to page id page4 of document 1 and page content corresponding to page id page9 of document 2, and in this display state, a note is added by the user, the recorded document page association relationship is "document id of document 1 + page4+ document id of document 2 + page 9", where there is an association relationship between a page corresponding to page4 of document 1 and a page corresponding to page9 of document 2.

Step S210, in response to the note viewing instruction for any target document, displays a note page of the target document.

When a user wants to view a note page of any one of the plurality of documents, a note viewing instruction for the target document may be triggered, for example, by clicking a note control in a display interface of the target document. Then in step S210, the e-book reader may display a note page of the target document for the user to view in response to the note viewing instruction for the target document.

Step S211, responding to the note association viewing instruction, searching note pages of other documents associated with the note page of the target document according to the document page association relation, and simultaneously displaying the note page of the target document and the note pages of the other associated documents.

Specifically, a note association viewing control may be set in the notebook interface, and the user may trigger the note association viewing instruction by clicking the note association viewing control. Then, in step S211, the e-book reader may respond to the note association viewing instruction to search for note pages of other documents associated with the currently displayed note page of the target document according to the document page association relationship stored in the notebook of the target document. Assuming that a note page corresponding to the page4 of the document 1 is displayed currently, it can be known from the document page association relationship that the page corresponding to the page4 of the document 1 is associated with the page9 of the document 2, that is, the note page corresponding to the page4 of the document 1 is associated with the note page corresponding to the page9 of the document 2, and then the note page corresponding to the page9 of the document 2 is displayed together with the note page corresponding to the page4 of the document 1. For example, the notebook interface may be transitioned to a partitioned display mode, thereby simultaneously displaying the note pages of the target document and the note pages of the associated other documents.

In a scenario where a plurality of documents are simultaneously displayed on a screen, there may be a case where a note area corresponding to a single document is not large enough to write all note contents for the document, and in order to facilitate a user to write note contents for a document, the electronic book reader also provides a note area selection function for the user. In general, note areas corresponding to a plurality of documents are determined in the process of dividing the note areas in step S202, as shown in fig. 1b, the default note area corresponding to the document 1 is the note area 1, and the default note area corresponding to the document 2 is the note area 2, and a user may further trigger a note area selection instruction by using a note area selection function, for example, select whether the note area 2 is the note area corresponding to the document 1 or the note area corresponding to the document 2, and then the method may further include, after step S202: and updating note areas corresponding to the plurality of documents in response to the note area selection instruction. Specifically, the note areas corresponding to the plurality of documents are updated according to the correspondence between the documents carried in the note area selection instruction and the note areas.

For a document, after the above updating, the number of the note areas corresponding to the document may be one, may also be multiple, and may even be zero, so in step S208, it is necessary to determine whether there are multiple note areas corresponding to each document. In an optional implementation manner, if there are a plurality of note areas corresponding to the document, note pictures of the note areas corresponding to the document may be respectively superimposed on the document picture of the document, so as to generate a plurality of synthetic pictures as note pages of the document. Assuming that the document 1 has two corresponding note areas, namely a note area 1 and a note area 2, the note picture of the note area 1 is superimposed on the document picture of the document 1 to generate a note page, and the note picture of the note area 2 is superimposed on the document picture of the document 1 to generate another note page, wherein the two note pages are both associated with the current page of the document 1. When the user turns over the note page corresponding to the page in the process of viewing the notebook of the document 1, the page content of the page and the note content in the note area 1 superposed on the page content are displayed, when the user performs page turning operation in a double-finger mode or the like, the note content in the note area 2 is switched to be displayed, and at the moment, the previous page content is still displayed below the note content, so that the user can conveniently view all the note content aiming at the page content.

In another optional implementation manner, if there are a plurality of note areas corresponding to the document, note pictures of the note areas corresponding to the document may be spliced, for example, spliced up and down or spliced left and right, to form a note picture, and then the spliced note picture is superimposed on the document picture of the document, so as to generate a composite picture as a note page of the document. When the user views the note pages generated in the mode, all note contents aiming at the document page can be completely displayed through one note page, the user does not need to view the note contents aiming at the page in other note areas through page turning operation, the use of the user is greatly facilitated, and the user operation is simplified.

In addition, in the present embodiment, the electronic book reader also provides a note moving function for the user, so that the user can conveniently move the note content in one note area to another note area in its entirety. Optionally, the method further comprises: receiving a trigger event aiming at any note area, determining a touch center coordinate of the trigger event, and capturing a note picture of a note area corresponding to the touch center coordinate from a note layer to serve as a note picture to be moved; detecting a moving event, determining a target note area of the note picture to be moved according to the moving track of the moving event, moving the note picture to be moved according to the moving track, and adding the note picture to be moved into the target note area.

For example, the user may trigger the note move function by pressing long, etc. in the note area. Specifically, when note movement is required, a user may trigger in a note area by long pressing and the like, and then the e-book reader receives a trigger event for the note area, determines a touch center coordinate of the trigger event, takes the note area where the touch center coordinate is located as a note area corresponding to the touch center coordinate, and captures a note picture of the note area corresponding to the touch center coordinate from a note layer as a note picture to be moved. When the movement event is detected, determining a target note area of the note picture to be moved according to the movement track of the movement event, moving the note picture to be moved according to the movement track, enabling the note picture to be moved to move along with the movement of the user finger or the electromagnetic pen, and finally adding the note picture to be moved to the target note area. If the target note area originally does not contain the note content, the note picture to be moved can be directly covered into the target note area. If the target note area originally contains the note content, the note content of the target note area can be replaced by the note picture to be moved, or the note picture to be moved and the note content of the target note area originally can be spliced, and the spliced note content is used as the note content of the target note area. Through the note moving processing mode, the user can edit note content conveniently, an animation effect of moving the note content along with gestures is brought to the user, user experience is improved beneficially, and interestingness is increased.

Considering that the size of the note area to which the moved note content originally belongs may not be consistent with the size of the target note area when note moving is performed, in order to better display the moved note content, the size of the note picture to be moved may be automatically adjusted according to the size of the target note area, so that the size of the note picture to be moved may be adapted to the size of the target note area.

By using the note processing method provided by the embodiment, the note layers are divided according to the screen partition layout information, so that the effective partition of note contents according to documents can be realized, and for the note bars spanning multiple note areas, the bar pictures obtained by intercepting are added to the note pictures of the note areas corresponding to the note bars, so that the note bars spanning multiple note areas are reserved to the greatest extent in the note processing process, and the condition that the note bars in the generated note page are incomplete or missing is avoided; in addition, the functions of note association viewing, note area selection, note moving and the like are provided, so that the note processing function is greatly enriched, the personalized requirement of a user on note processing is well met, and the use by the user is facilitated.

EXAMPLE III

The third embodiment of the present invention provides a nonvolatile storage medium, where the storage medium stores at least one executable instruction, and the executable instruction may execute the note processing method in any method embodiment described above, and is used to add notes to multiple documents displayed simultaneously in the reading page layer.

The executable instructions may be specifically configured to cause the processor to: responding to a note storage instruction, and generating document pictures of a plurality of documents according to the current page contents of the plurality of documents in the reading page layer; acquiring screen partition layout information, and dividing a note layer into note areas corresponding to a plurality of documents according to the screen partition layout information; processing the note areas to generate note pictures of the note areas; and for each document, overlapping the note picture of the note area corresponding to the document on the document picture of the document to generate a note page of the document.

In an alternative embodiment, the executable instructions further cause the processor to: performing line identification on the note content in the note layer, and judging whether a note line spanning multiple note areas exists in the note layer; and if the note lines spanning the note areas do not exist, performing screenshot processing on the note layer according to the area position information of the note areas to generate note pictures of the note areas.

In an alternative embodiment, the executable instructions further cause the processor to: and if the note lines spanning multiple note areas exist, deleting the note lines from the note layer.

In an alternative embodiment, the executable instructions further cause the processor to: if the note lines spanning the plurality of note areas exist, determining the note areas corresponding to the note lines, and intercepting line pictures of the note lines from the note layer; and performing screenshot processing on the note image layer according to the area position information of the note areas to generate note pictures of the note areas, and adding the line pictures to the note pictures of the note areas corresponding to the note lines.

In an alternative embodiment, the executable instructions further cause the processor to: determining a note area corresponding to the note line from the plurality of note areas according to the position information of the note line in the note layer; and identifying external rectangles of the note lines, and performing screenshot processing on the note layer according to the external rectangles to obtain line pictures of the note lines.

In an alternative embodiment, the executable instructions further cause the processor to: recording the association relationship of the document pages according to the current page contents of a plurality of documents in the reading page layer; displaying a note page of the target document in response to a note viewing instruction for any target document; and responding to the note association viewing instruction, searching note pages of other documents associated with the note page of the target document according to the document page association relation, and simultaneously displaying the note page of the target document and the note pages of the other associated documents.

In an alternative embodiment, the executable instructions further cause the processor to: responding to a note area selection instruction, and updating note areas corresponding to the plurality of documents; if the document corresponds to a plurality of note areas, respectively overlapping note pictures of the note areas corresponding to the document on the document picture of the document to generate a plurality of synthetic pictures as note pages of the document; or splicing the note pictures of a plurality of note areas corresponding to the document, and overlapping the spliced note pictures on the document pictures of the document to generate a synthetic picture as the note page of the document.

In an alternative embodiment, the executable instructions further cause the processor to: receiving a trigger event aiming at any note area, determining a touch center coordinate of the trigger event, and capturing a note picture of a note area corresponding to the touch center coordinate from a note layer to serve as a note picture to be moved; detecting a moving event, determining a target note area of the note picture to be moved according to the moving track of the moving event, moving the note picture to be moved according to the moving track, and adding the note picture to be moved into the target note area.

Example four

Fig. 3 is a schematic structural diagram of a computing device according to a fourth embodiment of the present invention, and the specific embodiment of the present invention does not limit the specific implementation of the computing device.

As shown in fig. 3, the computing device may include: a processor (processor)302, a communication Interface 304, a memory 306, and a communication bus 308.

Wherein:

the processor 302, communication interface 304, and memory 306 communicate with each other via a communication bus 308.

A communication interface 304 for communicating with network elements of other devices, such as clients or other servers.

The processor 302 is configured to execute the program 310, and may specifically perform relevant steps in the above-described note processing method embodiment.

In particular, program 310 may include program code comprising computer operating instructions.

The processor 302 may be a central processing unit CPU, or an application specific Integrated circuit (asic), or one or more Integrated circuits configured to implement an embodiment of the present invention. The computing device includes one or more processors, which may be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.

And a memory 306 for storing a program 310. Memory 306 may comprise high-speed RAM memory and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

The program 310 is configured to add notes to a plurality of documents displayed simultaneously in the reading page layer, and may specifically be configured to cause the processor 302 to perform the following operations: responding to a note storage instruction, and generating document pictures of a plurality of documents according to the current page contents of the plurality of documents in the reading page layer; acquiring screen partition layout information, and dividing a note layer into note areas corresponding to a plurality of documents according to the screen partition layout information; processing the note areas to generate note pictures of the note areas; and for each document, overlapping the note picture of the note area corresponding to the document on the document picture of the document to generate a note page of the document.

In an alternative embodiment, program 310 further causes processor 302 to: performing line identification on the note content in the note layer, and judging whether a note line spanning multiple note areas exists in the note layer; and if the note lines spanning the note areas do not exist, performing screenshot processing on the note layer according to the area position information of the note areas to generate note pictures of the note areas.

In an alternative embodiment, program 310 further causes processor 302 to: and if the note lines spanning multiple note areas exist, deleting the note lines from the note layer.

In an alternative embodiment, program 310 further causes processor 302 to: if the note lines spanning the plurality of note areas exist, determining the note areas corresponding to the note lines, and intercepting line pictures of the note lines from the note layer; and performing screenshot processing on the note image layer according to the area position information of the note areas to generate note pictures of the note areas, and adding the line pictures to the note pictures of the note areas corresponding to the note lines.

In an alternative embodiment, program 310 further causes processor 302 to: determining a note area corresponding to the note line from the plurality of note areas according to the position information of the note line in the note layer; and identifying external rectangles of the note lines, and performing screenshot processing on the note layer according to the external rectangles to obtain line pictures of the note lines.

In an alternative embodiment, program 310 further causes processor 302 to: recording the association relationship of the document pages according to the current page contents of a plurality of documents in the reading page layer; displaying a note page of the target document in response to a note viewing instruction for any target document; and responding to the note association viewing instruction, searching note pages of other documents associated with the note page of the target document according to the document page association relation, and simultaneously displaying the note page of the target document and the note pages of the other associated documents.

In an alternative embodiment, program 310 further causes processor 302 to: responding to a note area selection instruction, and updating note areas corresponding to the plurality of documents; if the document corresponds to a plurality of note areas, respectively overlapping note pictures of the note areas corresponding to the document on the document picture of the document to generate a plurality of synthetic pictures as note pages of the document; or splicing the note pictures of a plurality of note areas corresponding to the document, and overlapping the spliced note pictures on the document pictures of the document to generate a synthetic picture as the note page of the document.

In an alternative embodiment, program 310 further causes processor 302 to: receiving a trigger event aiming at any note area, determining a touch center coordinate of the trigger event, and capturing a note picture of a note area corresponding to the touch center coordinate from a note layer to serve as a note picture to be moved; detecting a moving event, determining a target note area of the note picture to be moved according to the moving track of the moving event, moving the note picture to be moved according to the moving track, and adding the note picture to be moved into the target note area.

For specific implementation of each step in the program 310, reference may be made to the description corresponding to the corresponding step in the note processing embodiment, which is not described herein again. It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the above-described device may refer to the corresponding process description in the foregoing method embodiment, and is not described herein again.

According to the scheme provided by the embodiment, the multiple documents are displayed simultaneously by partitioning the screen display area of the electronic book reader, the corresponding relation between the documents and the note area can be accurately determined according to the layout information of the screen partitions, note processing of the multiple documents displayed simultaneously is conveniently realized, the requirement that a user adds notes to the multiple documents displayed simultaneously is well met, and the note processing mode is optimized.

The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

The invention discloses: A1. a note processing method for adding notes to a plurality of documents simultaneously displayed in a reading page layer, the method comprising:

processing the note areas to generate note pictures of the note areas;

A2. The method of a1, the processing the plurality of note areas, and generating note pictures of the plurality of note areas further comprises:

performing line identification on the note content in the note map layer, and judging whether a note line spanning multiple note areas exists in the note map layer;

and if the note lines spanning the note areas do not exist, performing screenshot processing on the note layer according to the area position information of the note areas to generate note pictures of the note areas.

A3. The method of a2, the method further comprising:

and if the note lines spanning multiple note areas exist, deleting the note lines from the note layer.

A4. The method of a2, the method further comprising:

if the note lines spanning multiple note areas exist, determining the note areas corresponding to the note lines, and intercepting line pictures of the note lines from the note layer;

and performing screenshot processing on the note image layer according to the area position information of the note areas to generate note pictures of the note areas, and adding the line picture to the note pictures of the note areas corresponding to the note lines.

A5. According to the method of a4, the determining a note area corresponding to the note line and capturing a line picture of the note line from the note layer further includes:

determining a note area corresponding to the note line from a plurality of note areas according to the position information of the note line in the note layer;

and identifying the external rectangle of the note line, and performing screenshot processing on the note layer according to the external rectangle to obtain a line picture of the note line.

A6. The method of any one of a1-a5, the method further comprising:

recording the association relationship of the document pages according to the current page contents of the plurality of documents in the reading page layer;

displaying a note page of any target document in response to a note viewing instruction for the target document;

and responding to a note association viewing instruction, searching note pages of other documents associated with the note page of the target document according to the document page association relation, and simultaneously displaying the note page of the target document and the note pages of the other associated documents.

A7. The method according to any one of a1-a6, wherein after the obtaining of the screen partition layout information and the dividing of the note layer into note areas corresponding to a plurality of documents according to the screen partition layout information, the method further comprises: responding to a note area selection instruction, and updating note areas corresponding to the plurality of documents;

for each document, superimposing the note picture of the note area corresponding to the document on the document picture of the document, and generating the note page of the document specifically includes:

if the document corresponds to a plurality of note areas, respectively overlapping note pictures of the note areas corresponding to the document on the document picture of the document to generate a plurality of synthetic pictures as note pages of the document; or splicing the note pictures of the note areas corresponding to the document, and overlapping the spliced note pictures on the document pictures of the document to generate a synthetic picture as the note page of the document.

A8. The method of any one of a1-a7, the method further comprising:

receiving a trigger event aiming at any note area, determining a touch center coordinate of the trigger event, and intercepting a note picture of a note area corresponding to the touch center coordinate from the note layer to serve as a note picture to be moved;

detecting a moving event, determining a target note area of the note picture to be moved according to a moving track of the moving event, moving the note picture to be moved according to the moving track, and adding the note picture to be moved to the target note area.

The invention also discloses: B9. a computing device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

processing the note areas to generate note pictures of the note areas;

B10. The computing device of B9, the executable instructions further cause the processor to:

B11. The computing device of B10, the executable instructions further cause the processor to:

B12. The computing device of B10, the executable instructions further cause the processor to:

B13. The computing device of B12, the executable instructions further cause the processor to:

B14. The computing device of any of B9-B13, the executable instructions further cause the processor to:

B15. The computing device of any of B9-B14, the executable instructions further cause the processor to:

responding to a note area selection instruction, and updating note areas corresponding to the plurality of documents;

B16. The computing device of any of B9-B15, the executable instructions further cause the processor to:

The invention also discloses: C17. a storage medium having stored therein at least one executable instruction for taking notes on a plurality of documents simultaneously displayed in a reading page layer, the executable instruction causing a processor to:

processing the note areas to generate note pictures of the note areas;

C18. The storage medium of C17, the executable instructions further cause the processor to:

C19. The storage medium of C18, the executable instructions further cause the processor to:

C20. The storage medium of C18, the executable instructions further cause the processor to:

C21. The storage medium of C20, the executable instructions further cause the processor to:

C22. The storage medium of any one of C17-C21, the executable instructions further cause the processor to:

C23. The storage medium of any one of C17-C22, the executable instructions further cause the processor to:

C24. The storage medium of any one of C17-C23, the executable instructions further cause the processor to:

Claims

1. A note processing method for adding notes to a plurality of documents simultaneously displayed in a reading page layer, the method comprising:

processing the note areas to generate note pictures of the note areas;

2. The method of claim 1, the processing the plurality of note areas, the generating note pictures for the plurality of note areas further comprising:

3. The method of claim 2, further comprising:

4. The method of claim 2, further comprising:

5. The method according to claim 4, wherein the determining a note area corresponding to the note line and capturing a line picture of the note line from the note layer further comprises:

6. The method according to any one of claims 1-5, further comprising:

7. The method according to any one of claims 1 to 6, after the obtaining the screen partition layout information and dividing the note layer into note areas corresponding to a plurality of documents according to the screen partition layout information, the method further comprising: responding to a note area selection instruction, and updating note areas corresponding to the plurality of documents;

8. The method of any of claims 1-7, further comprising:

9. A computing device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

processing the note areas to generate note pictures of the note areas;

10. A storage medium having stored therein at least one executable instruction for taking notes on a plurality of documents simultaneously displayed in a reading page layer, the executable instruction causing a processor to:

processing the note areas to generate note pictures of the note areas;