CN109712218B - Electronic book note processing method, handwriting reading equipment and storage medium - Google Patents

Electronic book note processing method, handwriting reading equipment and storage medium Download PDF

Info

Publication number
CN109712218B
CN109712218B CN201811543712.2A CN201811543712A CN109712218B CN 109712218 B CN109712218 B CN 109712218B CN 201811543712 A CN201811543712 A CN 201811543712A CN 109712218 B CN109712218 B CN 109712218B
Authority
CN
China
Prior art keywords
note
page
content
reading
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811543712.2A
Other languages
Chinese (zh)
Other versions
CN109712218A (en
Inventor
程超
段浩亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ireader Technology Co Ltd
Zhangyue Technology Co Ltd
Original Assignee
Ireader Technology Co Ltd
Zhangyue Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ireader Technology Co Ltd, Zhangyue Technology Co Ltd filed Critical Ireader Technology Co Ltd
Priority to CN201811543712.2A priority Critical patent/CN109712218B/en
Publication of CN109712218A publication Critical patent/CN109712218A/en
Priority to PCT/CN2019/121011 priority patent/WO2020125345A1/en
Application granted granted Critical
Publication of CN109712218B publication Critical patent/CN109712218B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00Digital computers in general; Data processing equipment in general
    • G06F15/02Digital computers in general; Data processing equipment in general manually operated with input through keyboard and computation using a built-in program, e.g. pocket calculators
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text

Abstract

The invention relates to an electronic book note processing method, a handwriting reading device and a storage medium. The method comprises the following steps: responding to a note storage instruction, analyzing the original text content in the current reading page, and generating an original text picture; acquiring handwritten note content displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note content; superposing the note picture on the original text picture to generate a composite picture; the composite picture displays the handwritten note content and the original text content in an overlapping mode; determining the composite picture as a note page. The method can simultaneously display the handwritten note content and the original text content in the note page without repeatedly switching the handwritten note content and the original text content, thereby simplifying the operation of reading the note of the electronic book.

Description

Electronic book note processing method, handwriting reading equipment and storage medium
Technical Field
The application relates to the technical field of computers, in particular to an electronic book note processing method, a handwriting reading device and a storage medium.
Background
With the development of computer technology, more and more people read through electronic book readers. Present e-book readers may also support adding handwritten notes to an e-book. For example, the current ink screen electronic book reader is configured with an electromagnetic plate and an electromagnetic pen matched with the electromagnetic plate. When a user reads an electronic book by using the electronic book reader, the user can use the electromagnetic pen to scribe or write on a screen.
However, the conventional method for saving notes of an electronic book separately saves handwritten note contents and the electronic book. The handwritten note content is based on the e-book content, when a user subsequently browses the e-book notes, the electronic device cannot simultaneously display the note content and the e-book content associated with the note content, the user often needs to continuously switch the note content and the e-book content, and the operation of reading the e-book notes is complicated.
Disclosure of Invention
In view of the above, it is necessary to provide an electronic book note processing method, a handwriting reading device, and a storage medium capable of simplifying operations when reading electronic book notes, in view of the above technical problems.
In one aspect, an embodiment of the present invention provides an electronic book note processing method, including:
responding to a note storage instruction, analyzing the original text content in the current reading page, and generating an original text picture;
acquiring handwritten note content displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note content;
superposing the note picture on the original text picture to generate a composite picture; the composite picture displays the handwritten note content and the original text content in an overlapping mode;
determining the composite picture as a note page.
In another aspect, an embodiment of the present invention provides a handwriting reading apparatus, including a screen, an electromagnetic board, a memory and a processor, where the electromagnetic board is configured to detect a handwriting operation generated on the screen by an electromagnetic pen, and the memory stores a computer program, and the computer program, when executed by the processor, implements the following steps:
responding to a note storage instruction, analyzing the original text content in the current reading page, and generating an original text picture;
acquiring handwritten note content displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note content;
superposing the note picture on the original text picture to generate a composite picture; the composite picture displays the handwritten note content and the original text content in an overlapping mode;
determining the composite picture as a note page.
In another aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the following steps:
responding to a note storage instruction, analyzing the original text content in the current reading page, and generating an original text picture;
acquiring handwritten note content displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note content;
superposing the note picture on the original text picture to generate a composite picture; the composite picture displays the handwritten note content and the original text content in an overlapping mode;
determining the composite picture as a note page.
The electronic book note processing method, the handwriting reading equipment and the storage medium respond to the note storage instruction, analyze the original text content in the current reading page and generate the original text picture, wherein the original text picture comprises the original text content in the electronic book reading page; then acquiring handwritten note contents displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note contents, wherein the note picture comprises a handwritten note style; superposing the note picture on the original text picture to generate a composite picture, wherein the composite picture can display the handwritten note content and the original text content in an overlapping manner; the composite picture is determined as a note page. When a user reads the note page, the note content and the original text content do not need to be switched continuously, and the operation of reading the note of the electronic book is simplified.
Drawings
FIG. 1 is a diagram illustrating an internal structure of a computer device according to an embodiment;
FIG. 2 is a schematic view of a handwriting reading apparatus in one embodiment;
FIG. 3 is a flowchart illustrating a method for processing notes of an electronic book according to an embodiment;
FIG. 4 is a flowchart illustrating steps of generating a note picture in one embodiment;
FIG. 5 is a flowchart illustrating the steps of displaying a note page in one embodiment;
FIG. 6 is a flowchart of the steps of creating a note tag in one embodiment;
fig. 7 is a flowchart illustrating a method for processing notes of an electronic book in another embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The electronic book note processing method provided by the application can be applied to the computer equipment shown in fig. 1. The computer device may be a terminal, the computer device including a memory, a processor, a network interface, a display screen, an electromagnetic board, and an input device. The memory stores a computer program, and when the computer program is executed by the processor, the electronic book note processing method provided by the embodiment of the invention can be realized. The terminal can be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, handwriting pads, electronic ink screen readers or portable wearable devices.
The computer device may be the handwriting reading device 200 shown in fig. 2, the screen of the handwriting reading device 200 may be a touch screen, and the user may take notes on the handwriting reading device 200 through touch operation. The handwriting reading device 200 may also be configured with an electromagnetic pad and an electromagnetic pen, which a user may use to make handwritten notes on the handwriting reading device 200. The embodiment of the electronic book note processing method provided by the invention is mainly explained by taking computer equipment as handwriting reading equipment, and it can be understood that the computer equipment can also be other terminals, such as various personal computers, notebook computers, smart phones, tablet computers or portable wearable equipment.
In one embodiment, as shown in fig. 3, an electronic book note processing method is provided, which is described by taking the method as an example applied to the handwriting reading device in fig. 2, and includes the following steps:
s302, responding to the note storage instruction, analyzing the original text content in the current reading page, and generating an original text picture.
The note storage instruction is an instruction for instructing the handwriting reading equipment to store the handwriting note content in the reading page of the electronic book; the current reading page is a reading page being displayed on a screen of the handwriting reading equipment; the original text content is the content in the reading page; the original image is a generated image in which the original content is stored.
Specifically, the handwriting reading device displays a reading page of the electronic book through a screen and receives handwritten note contents input by a user. A user can trigger a note storage instruction through a screen or a key, and when the handwriting reading equipment receives the triggered note storage instruction, the original text content in the current reading page is analyzed to generate an original text picture corresponding to the original text content.
S304, acquiring the handwritten note content displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note content.
The handwritten note content is a note left by a user and comprises at least one of a handwritten annotation track or a handwritten handwriting. The note picture is a generated picture containing handwritten note content.
Specifically, after generating an original text picture corresponding to the original text content in the current reading page, the handwriting reading device acquires the handwriting note content corresponding to the current reading page, analyzes the handwriting note content, and generates a note picture containing the handwriting note content. The size of the original text picture corresponding to the current reading page can be the same as the size of the note picture.
In one embodiment, a handwriting reading device is configured with an electromagnetic pad that can receive handwritten notes left by a user using an electromagnetic pen. The handwriting reading equipment records the position coordinates of the electromagnetic strokes in the reading page in real time, displays pixel points on the upper layer of the reading page according to the position coordinates, and fills the pixel points to form a handwriting annotation track or a handwriting.
S306, overlapping the note picture on the original text picture to generate a synthetic picture; the composite picture displays the handwritten note content and the original text content in an overlapping mode.
The synthesized picture is obtained by superposing the note picture on the original picture.
Specifically, after the handwriting reading device generates the original text picture and the note picture, the original text picture and the note picture are superimposed, specifically, the note picture may be overlaid on the original text picture to obtain a synthesized picture. The composite picture can simultaneously display the handwritten note content and the original text content.
In one embodiment, the electronic book may be in a PDF Format (Portable Document Format). The handwriting reading equipment analyzes the original text content in the current reading page through a PDF open source engine to obtain a PDF scanning piece, namely an original text picture in a scanning version PDF format. And the handwriting reading equipment analyzes the handwriting note content corresponding to the current reading page to generate a note picture, and then the note picture is superposed on the original text picture to generate a synthesized picture. The composite picture may be in PDF format.
In one embodiment, the Electronic book may be in an EPUB format (Electronic Publication). The handwriting reading equipment generates a PDF scanning piece, namely an original text picture in a scanning version PDF format, through an EPUB analysis engine, generates a note picture, and then superposes the note picture on the original text picture to generate a synthetic picture. The composite picture may be in PDF format.
And S308, determining the composite picture as a note page.
Specifically, after the handwriting reading device obtains a synthesized picture according to the note picture and the original text picture, the synthesized picture is used as a note page. The note pages will be added to the notebook by the handwriting reading device. A notebook is a file that is made up of all composite pictures.
In one embodiment, step 308 is followed by the step of generating a notebook. And the handwriting reading equipment arranges the synthesized pictures belonging to the same electronic book according to the page number sequence of the reading pages corresponding to the synthesized pictures to generate the notebook corresponding to the electronic book.
In the embodiment, in response to a note saving instruction, the original content in the current reading page is analyzed to generate an original picture, wherein the original picture comprises the original content in the reading page of the electronic book; then acquiring handwritten note contents displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note contents, wherein the note picture comprises a handwritten note style; superposing the note picture on the original text picture to generate a composite picture, wherein the composite picture can display the handwritten note content and the original text content in an overlapping manner; the composite picture is determined as a note page. When a user reads the note page, the note content and the original text content do not need to be switched continuously, and the operation of reading the note of the electronic book is simplified.
As shown in fig. 4, in an embodiment, the step 302 specifically includes a step of generating a note picture, and the step specifically includes the following steps:
step 402, reading a note file corresponding to the current reading page.
The note file is a file generated by storing the handwritten note content by the handwriting reading equipment.
Specifically, after receiving the handwritten note content, the handwriting reading device stores the handwritten note content to obtain a note file corresponding to the current reading page. And after extracting the electronic book identification and the current page number of the current reading page from the note storage instruction, the handwriting reading equipment reads the note file corresponding to the current reading page according to the extracted electronic book identification and the current page number.
And step 404, drawing a note drawing layer according to the note data in the note file.
Wherein the note data is position coordinate data in the note file. The note layer is a layer file which is obtained according to note data and contains a handwritten annotation track or handwritten handwriting.
Specifically, after reading a note file corresponding to the current reading page, the handwriting reading device extracts note data in the note file, where the note data is position coordinates of pixel points scribed on the screen by the electromagnetic pen. And the handwriting reading equipment constructs an initial layer, and fills pixel points in the initial layer according to the note data to obtain a note layer. The note content formed by the filled pixel points is the same as the handwritten note content.
Step 406, converting the note content in the note layer into a note picture in a picture format.
Specifically, after the handwriting reading device obtains the note layer, a picture generation instruction is triggered, format conversion is performed on note content in the note layer according to the picture generation instruction, and a note picture in a picture format is obtained.
In the embodiment, the note file corresponding to the current reading page is read, the note layer is drawn according to the note data in the note file, the note content in the note layer is the same as the handwritten note content, and then the note content in the note layer is converted into the note picture in the picture format, so that the speed of generating the note picture is improved.
As shown in fig. 5, in an embodiment, the electronic book note processing method further includes a step of displaying a note page, where the step specifically includes the following steps:
s502, displaying the note pages in the notebook.
Specifically, a virtual bookshelf is arranged in the handwriting reading device, and the generated notebook is stored in the virtual bookshelf. Each notebook in the virtual bookshelf corresponds to an electronic book. When the display triggering operation of a certain notebook in the virtual bookshelf is detected, the handwriting reading equipment displays the note pages in the notebook through the screen.
S504, when the note page jump instruction is detected, the current page number and the next adjacent page number corresponding to the currently displayed note page are obtained from the notebook.
The note page jump instruction is an instruction for instructing the handwriting reading equipment to display a reading page in the electronic book.
Specifically, only the reading page in which the handwritten note content exists may be saved in the notebook. The method comprises the steps that a virtual skip key is added to a blank area of a note page by the handwriting reading equipment, and when the virtual skip key is triggered, the handwriting reading equipment acquires a current page number corresponding to the currently displayed note page and a next adjacent page number corresponding to a note page adjacent to the currently displayed note page.
S506, when the current page number and the next adjacent page number are not continuous, reading pages corresponding to the page number between the current page number and the next adjacent page number are obtained from the electronic book.
Specifically, when the current page number and the next adjacent page number acquired by the handwriting reading device are not consecutive in numerical value, the handwriting reading device reads the electronic book, and reads a reading page corresponding to the page number between the current page number and the next adjacent page number from the read electronic book.
And S508, displaying the reading page corresponding to the minimum page number in the acquired reading pages.
Specifically, after reading a reading page corresponding to a page number between a current page number and a next adjacent page number from the electronic book, the handwriting reading device screens the reading page corresponding to the minimum page number from the obtained reading pages, and displays the screened reading page through a screen. When the virtual jump key is triggered again, the handwriting reading device does not show the reading page read from the electronic book any more, and shows the note page corresponding to the next adjacent page number.
For example, when the handwriting reading device detects that the virtual skip key is triggered, it obtains that the current page number corresponding to the currently displayed note page is 2 and the next adjacent page number is 6, and may display the page number of the currently displayed note page from the next note page by a pop-up frame: 4. the handwriting reading equipment reads reading pages with page numbers 3, 4 and 5 from the electronic book, and displays the reading page with the page number 3 firstly. When the virtual jump key is triggered again, the handwriting reading device displays a note page with the page number of 6.
In this embodiment, a note page in a notebook is displayed, when a note page jump instruction is detected, a current page number and a next adjacent page number corresponding to the currently displayed note page are obtained from the notebook, when the current page number and the next adjacent page number are not continuous, because only a reading page with handwritten note content is stored in the notebook, a reading page corresponding to a page number between the current page number and the next adjacent page number needs to be obtained from an electronic book, a reading page corresponding to a minimum page number in the obtained reading page is displayed, and the reading page in an electronic book source file is read and displayed through the note page jump instruction, so that an operation of viewing the reading page in the electronic book is simplified when the notebook is read.
As shown in fig. 6, in an embodiment, after S308, a step of creating a note tag is further included, where the step specifically includes the following steps:
s602, determining a reading area corresponding to the handwritten note content.
The reading area is marked by the handwritten note content and is an area with original text content.
Specifically, after obtaining the note page, the handwriting reading device identifies a handwriting annotation track, such as a line or a circle, in the handwriting note content, and determines a reading area corresponding to the handwriting note content in the note page according to the position of the identified handwriting annotation track.
S604, recognizing the text content in the reading area.
Specifically, the handwriting reading device intercepts the determined reading area, performs image processing on the intercepted reading area, and identifies characters in the reading area after the image processing. For example, the handwriting reading device may recognize text content in the reading area through OCR (Optical Character Recognition).
And S606, generating abstract contents corresponding to the note pages according to the text contents.
The summary content is important information extracted from the text content in the reading area.
Specifically, the handwriting reading device processes the recognized text content, extracts characteristic nouns and sentence outlines from the text content, and takes the extracted characteristic nouns and sentence outlines as abstract content corresponding to handwritten note content in a note page.
In one embodiment, the handwriting reading equipment counts the occurrence frequency of each marked word, and extracts the words with the occurrence frequency greater than or equal to a preset frequency threshold value as characteristic nouns; the handwriting reading equipment can also recognize the name of a person or the name of a place in the text content, and the recognized name of the person or the name of the place is used as a characteristic noun.
In one embodiment, the handwriting reading device extracts the sentence outline by semantic analysis. The handwriting reading equipment extracts the long sentence in the recognized text content, determines the part-of-speech of each word in the long sentence through part-of-speech analysis, deletes words with preset parts-of-speech, such as prepositions or adverbs, and leaves a subject, a predicate and an object in the long sentence to obtain a sentence synopsis.
And S608, creating a note label of the handwritten note content in the note page according to the summary content.
The note label is a label added into the note page by the handwriting reading equipment according to the summary content.
Specifically, after the handwriting reading device extracts the summary content, the summary content is used as a note tag of the handwritten note content in the note page. The note label can be set with various viewing modes, the handwriting reading equipment can identify a blank area in a note page, and the summary content is directly displayed in the blank area in a system font; the virtual label key can also be generated in the note page, and when the virtual label key is triggered, the note label is displayed in a blank area or in a pop-up frame mode. The handwriting reading device may also present the virtual tag key in an application menu.
In the embodiment, a reading area corresponding to the handwritten note content is determined, the text content in the reading area is identified, the abstract content corresponding to the note page is generated according to the text content, the abstract content comprises key content of the text in the reading area, a note tag of the handwritten note content in the note page is created according to the abstract content, the note tag can display the abstract content, and the operation of reading the note of the electronic book is simplified.
As shown in fig. 7, in another embodiment, the electronic book note processing method further includes the following steps:
s702, recognizing the handwritten note content to obtain a recognition result.
Specifically, the handwriting reading device identifies each handwriting in the handwriting content and determines characters corresponding to each handwriting. And after the handwriting reading equipment identifies the handwriting note content, obtaining an identification result according to the determined characters.
S704, determining the character position of the handwritten note content in the reading page.
The character position is the position of the handwritten note content in the reading page.
Specifically, after the handwriting reading device obtains the recognition result of the handwritten note content, the coordinate range of the handwritten note content in the reading page is determined, and the character position of the handwritten note content in the reading page is determined according to the coordinate range.
And S706, displaying the recognition result at the character position according to the preset font to obtain the note annotation.
And the preset font is preset, and the font used by the identification result is displayed. Note annotations are annotations added into the reading page, and the recognition result is displayed in a preset font.
Specifically, the handwriting reading device acquires a preset font, displays the recognition result of the handwriting note content in the preset font at the character position, and deletes the handwriting note content. That is, the handwriting-reading device converts the handwritten note content into a note annotation that is displayed in a preset font. The handwriting reading equipment can also add a virtual annotation label at the character position, and when the virtual annotation label is triggered, the note annotation is displayed at the character position. Note annotations may be subject to editing.
In the embodiment, the handwritten note content is recognized firstly to obtain the recognition result, then the character position of the handwritten note content in the reading page is determined, note annotations are added into the reading page according to the recognition result and the character position, the note annotations show the recognition result through the preset font, the operation of reading the handwritten note content is neat and clear, and the operation of reading the handwritten note content is simplified.
It should be understood that although the various steps in the flow charts of fig. 3-7 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 3-7 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.
In one embodiment, a computer device is provided, which may be a handwriting reading device, the internal structure of which may be as shown in fig. 1. The computer device comprises a processor, a memory, a network interface, a display screen, an electromagnetic board and an input device which are connected through a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement an electronic book note processing method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, the electromagnetic plate of the computer equipment is used for receiving handwritten note contents input by an electromagnetic pen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external electromagnetic pen, a keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 1 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Further, the invention also discloses:
a1, an electronic book note processing method, comprising:
responding to a note storage instruction, analyzing the original text content in the current reading page, and generating an original text picture;
acquiring handwritten note content displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note content;
superposing the note picture on the original text picture to generate a composite picture; the composite picture displays the handwritten note content and the original text content in an overlapping mode;
determining the composite picture as a note page.
A2, according to the method of A1, in response to a note saving instruction, parsing the original content in the current reading page to generate an original picture, including:
and converting the current reading page into a PDF scanning piece.
A3, according to the method of A1, acquiring handwritten note content displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note content, including:
reading a note file corresponding to the current reading page;
drawing a note drawing layer according to note data in the note file;
and converting the note content in the note layer into a note picture in a picture format.
A4, after determining the composite picture as a notebook according to the method of A1, further comprising:
and generating the synthesized pictures belonging to the same electronic book into a notebook corresponding to the electronic book according to the page number sequence of the reading pages corresponding to the synthesized pictures.
A5, according to the method described in a4, after generating a notebook corresponding to the electronic book from the synthesized pictures belonging to the same electronic book according to the page number order of the reading pages corresponding to the synthesized pictures, the method further includes:
displaying a note page in the notebook;
when a note page jump instruction is detected, acquiring a current page number and a next adjacent page number corresponding to a currently displayed note page from the notebook;
when the current page number and the next adjacent page number are not continuous, a reading page corresponding to the page number between the current page number and the next page number is obtained from the electronic book;
and displaying the reading page corresponding to the minimum page number in the acquired reading pages.
A6, after determining the composite picture as a notebook according to the method of A1, further comprising:
determining a reading area corresponding to the handwritten note content;
identifying text content in the reading area;
generating abstract content corresponding to the note page according to the text content;
and creating a note label of handwritten note content in the note page according to the abstract content.
A7, the method of A1, further comprising:
recognizing the handwritten note content to obtain a recognition result;
determining the text position of the handwritten note content in the reading page;
and displaying the recognition result at the character position according to a preset font to obtain note annotations.
B1, a handwriting reading device comprising a screen, an electromagnetic pad for detecting handwriting by an electromagnetic pen on said screen, a memory storing a computer program that when executed by said processor performs the steps of:
responding to a note storage instruction, analyzing the original text content in the current reading page, and generating an original text picture;
acquiring handwritten note content displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note content;
superposing the note picture on the original text picture to generate a composite picture; the composite picture displays the handwritten note content and the original text content in an overlapping mode;
determining the composite picture as a note page.
B2, the apparatus according to B1, the processor when executing the computer program further realizes the steps of:
and converting the current reading page into a PDF scanning piece.
B3, the apparatus according to B1, the processor when executing the computer program further realizes the steps of:
reading a note file corresponding to the current reading page;
drawing a note drawing layer according to note data in the note file;
and converting the note content in the note layer into a note picture in a picture format.
B4, the apparatus according to B1, the processor when executing the computer program further realizes the steps of:
and generating the synthesized pictures belonging to the same electronic book into a notebook corresponding to the electronic book according to the page number sequence of the reading pages corresponding to the synthesized pictures.
B5, the apparatus according to B4, the processor when executing the computer program further realizes the steps of:
displaying a note page in the notebook;
when a note page jump instruction is detected, acquiring a current page number and a next adjacent page number corresponding to a currently displayed note page from the notebook;
when the current page number and the next adjacent page number are not continuous, a reading page corresponding to the page number between the current page number and the next page number is obtained from the electronic book;
and displaying the reading page corresponding to the minimum page number in the acquired reading pages.
B6, the apparatus according to B1, the processor when executing the computer program further realizes the steps of:
determining a reading area corresponding to the handwritten note content;
identifying text content in the reading area;
generating abstract content corresponding to the note page according to the text content;
and creating a note label of handwritten note content in the note page according to the abstract content.
B7, the apparatus according to B1, the processor when executing the computer program further realizes the steps of:
recognizing the handwritten note content to obtain a recognition result;
determining the text position of the handwritten note content in the reading page;
and displaying the recognition result at the character position according to a preset font to obtain note annotations.
C1, a computer readable storage medium having a computer program stored thereon, the computer program when executed by a processor implementing the steps of:
responding to a note storage instruction, analyzing the original text content in the current reading page, and generating an original text picture;
acquiring handwritten note content displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note content;
superposing the note picture on the original text picture to generate a composite picture; the composite picture displays the handwritten note content and the original text content in an overlapping mode;
determining the composite picture as a note page.
C2, the computer readable storage medium according to C1, the computer program, when being executed by a processor, further realizing the steps of:
and converting the current reading page into a PDF scanning piece.
C3, the computer readable storage medium according to C1, the computer program, when being executed by a processor, further realizing the steps of:
reading a note file corresponding to the current reading page;
drawing a note drawing layer according to note data in the note file;
and converting the note content in the note layer into a note picture in a picture format.
C4, the computer readable storage medium according to C1, the computer program, when being executed by a processor, further realizing the steps of:
and generating the synthesized pictures belonging to the same electronic book into a notebook corresponding to the electronic book according to the page number sequence of the reading pages corresponding to the synthesized pictures.
C5, the computer readable storage medium according to C4, the computer program, when being executed by a processor, further realizing the steps of:
displaying a note page in the notebook;
when a note page jump instruction is detected, acquiring a current page number and a next adjacent page number corresponding to a currently displayed note page from the notebook;
when the current page number and the next adjacent page number are not continuous, a reading page corresponding to the page number between the current page number and the next page number is obtained from the electronic book;
and displaying the reading page corresponding to the minimum page number in the acquired reading pages.
C6, the computer readable storage medium according to C1, the computer program, when being executed by a processor, further realizing the steps of:
determining a reading area corresponding to the handwritten note content;
identifying text content in the reading area;
generating abstract content corresponding to the note page according to the text content;
and creating a note label of handwritten note content in the note page according to the abstract content.
C7, the computer readable storage medium according to C1, the computer program, when being executed by a processor, further realizing the steps of:
recognizing the handwritten note content to obtain a recognition result;
determining the text position of the handwritten note content in the reading page;
and displaying the recognition result at the character position according to a preset font to obtain note annotations.

Claims (10)

1. An electronic book note processing method, the method being used in a handwriting reading device including an electromagnetic handwriting function, the method comprising:
responding to a note storage instruction, analyzing the original text content in the current reading page, and generating an original text picture;
acquiring handwritten note content displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note content;
superposing the note picture on the original text picture to generate a composite picture; the composite picture displays the handwritten note content and the original text content in an overlapping mode;
determining the composite picture as a note page;
generating a notebook corresponding to the electronic book according to the page number sequence of reading pages corresponding to the note pages, wherein the note pages belong to the same electronic book;
determining a reading area corresponding to the handwritten note content, and identifying text content in the reading area;
generating abstract content corresponding to the note page according to the text content;
creating a note label of handwritten note content in the note page according to the abstract content;
identifying a blank area in the note page, and displaying the summary content and/or the note tag in the blank area; generating a virtual label key in the note page, and displaying the note label in the blank area when the virtual label key is triggered;
displaying a note page in the notebook;
when a note page jump instruction is detected, acquiring a current page number and a next adjacent page number corresponding to a currently displayed note page from the notebook;
when the current page number and the next adjacent page number are not continuous, a reading page corresponding to the page number between the current page number and the next page number is obtained from the electronic book;
and displaying the reading page corresponding to the minimum page number in the acquired reading pages.
2. The method of claim 1, wherein the parsing the textual content in the current reading page in response to the note saving instruction to generate a textual picture comprises:
and converting the current reading page into a PDF scanning piece.
3. The method of claim 1, wherein the obtaining of handwritten note content displayed on an upper layer of the current reading page and generating of a note picture containing the handwritten note content comprise:
reading a note file corresponding to the current reading page;
drawing a note drawing layer according to note data in the note file;
and converting the note content in the note layer into a note picture in a picture format.
4. The method of claim 1, further comprising:
recognizing the handwritten note content to obtain a recognition result;
determining the text position of the handwritten note content in the reading page;
and displaying the recognition result at the character position according to a preset font to obtain note annotations.
5. A handwriting reading apparatus comprising a screen, an electromagnetic pad for detecting handwriting operations generated on the screen by an electromagnetic pen, a memory storing a computer program, and a processor, the computer program when executed by the processor implementing the steps of:
responding to a note storage instruction, analyzing the original text content in the current reading page, and generating an original text picture;
acquiring handwritten note content displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note content;
superposing the note picture on the original text picture to generate a composite picture; the composite picture displays the handwritten note content and the original text content in an overlapping mode;
determining the composite picture as a note page;
generating a notebook corresponding to the electronic book according to the page number sequence of reading pages corresponding to the note pages, wherein the note pages belong to the same electronic book;
determining a reading area corresponding to the handwritten note content, and identifying text content in the reading area;
generating abstract content corresponding to the note page according to the text content;
creating a note label of handwritten note content in the note page according to the abstract content;
identifying a blank area in the note page, and displaying the summary content and/or the note tag in the blank area; generating a virtual label key in the note page, and displaying the note label in the blank area when the virtual label key is triggered;
displaying a note page in the notebook;
when a note page jump instruction is detected, acquiring a current page number and a next adjacent page number corresponding to a currently displayed note page from the notebook;
when the current page number and the next adjacent page number are not continuous, a reading page corresponding to the page number between the current page number and the next page number is obtained from the electronic book;
and displaying the reading page corresponding to the minimum page number in the acquired reading pages.
6. The device of claim 5, wherein the obtaining of handwritten note content displayed on an upper layer of the current reading page and generating of a note picture containing the handwritten note content comprise:
reading a note file corresponding to the current reading page;
drawing a note drawing layer according to note data in the note file;
and converting the note content in the note layer into a note picture in a picture format.
7. A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
responding to a note storage instruction, analyzing the original text content in the current reading page, and generating an original text picture;
acquiring handwritten note content displayed on the upper layer of the current reading page, and generating a note picture containing the handwritten note content;
superposing the note picture on the original text picture to generate a composite picture; the composite picture displays the handwritten note content and the original text content in an overlapping mode;
determining the composite picture as a note page;
generating a notebook corresponding to the electronic book according to the page number sequence of reading pages corresponding to the note pages, wherein the note pages belong to the same electronic book;
determining a reading area corresponding to the handwritten note content, and identifying text content in the reading area;
generating abstract content corresponding to the note page according to the text content;
creating a note label of handwritten note content in the note page according to the abstract content;
identifying a blank area in the note page, and displaying the summary content and/or the note tag in the blank area; generating a virtual label key in the note page, and displaying the note label in the blank area when the virtual label key is triggered;
displaying a note page in the notebook;
when a note page jump instruction is detected, acquiring a current page number and a next adjacent page number corresponding to a currently displayed note page from the notebook;
when the current page number and the next adjacent page number are not continuous, a reading page corresponding to the page number between the current page number and the next page number is obtained from the electronic book;
and displaying the reading page corresponding to the minimum page number in the acquired reading pages.
8. The storage medium according to claim 7, wherein the computer program when executed by a processor performs the steps of:
and converting the current reading page into a PDF scanning piece.
9. The storage medium according to claim 7, wherein the computer program when executed by a processor performs the steps of:
reading a note file corresponding to the current reading page;
drawing a note drawing layer according to note data in the note file;
and converting the note content in the note layer into a note picture in a picture format.
10. The storage medium according to claim 7, wherein the computer program when executed by a processor performs the steps of:
recognizing the handwritten note content to obtain a recognition result;
determining the text position of the handwritten note content in the reading page;
and displaying the recognition result at the character position according to a preset font to obtain note annotations.
CN201811543712.2A 2018-12-17 2018-12-17 Electronic book note processing method, handwriting reading equipment and storage medium Active CN109712218B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201811543712.2A CN109712218B (en) 2018-12-17 2018-12-17 Electronic book note processing method, handwriting reading equipment and storage medium
PCT/CN2019/121011 WO2020125345A1 (en) 2018-12-17 2019-11-26 Electronic book note processing method, handwriting reading device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811543712.2A CN109712218B (en) 2018-12-17 2018-12-17 Electronic book note processing method, handwriting reading equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109712218A CN109712218A (en) 2019-05-03
CN109712218B true CN109712218B (en) 2021-05-04

Family

ID=66256797

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811543712.2A Active CN109712218B (en) 2018-12-17 2018-12-17 Electronic book note processing method, handwriting reading equipment and storage medium

Country Status (2)

Country Link
CN (1) CN109712218B (en)
WO (1) WO2020125345A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109712218B (en) * 2018-12-17 2021-05-04 掌阅科技股份有限公司 Electronic book note processing method, handwriting reading equipment and storage medium
CN110045847A (en) * 2019-05-14 2019-07-23 杭州电子科技大学 A kind of entity notes electronic system and method based on electromagnetic induction
CN112016278A (en) * 2019-05-28 2020-12-01 深圳市希科普股份有限公司 Learning text labeling system based on artificial intelligence
CN111338558B (en) * 2020-03-24 2021-01-19 掌阅科技股份有限公司 Method and device for displaying handwritten notes of electronic book and computer storage medium
CN111857528A (en) * 2020-07-17 2020-10-30 上海墨案智能科技有限公司 Handwriting recording method and device
CN113157189B (en) * 2021-05-20 2022-03-11 读书郎教育科技有限公司 Method for adding note content by quickly referring to original text, storage medium and electronic equipment
CN113297142B (en) * 2021-05-31 2022-01-18 深圳市小石头信息科技有限公司 Electronic file synthesis method
CN115934647B (en) * 2022-10-21 2023-10-13 广州文石信息科技有限公司 Notebook label generation method and device, storage medium and computer equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101882384A (en) * 2010-06-29 2010-11-10 汉王科技股份有限公司 Method for note management on electronic book and electronic book equipment
CN102214191A (en) * 2010-04-01 2011-10-12 宏碁股份有限公司 Electronic book reader and information collection method thereof
CN102760170A (en) * 2012-06-17 2012-10-31 上海琥智数码科技有限公司 Electronic book note-taking method based on screenshot
CN104731390A (en) * 2013-12-18 2015-06-24 深圳富泰宏精密工业有限公司 System and method for saving original handwriting
CN105446647A (en) * 2015-12-25 2016-03-30 智慧方舟科技有限公司 E-ink book and reading note implementation method and device thereof
CN107391475A (en) * 2017-07-21 2017-11-24 掌阅科技股份有限公司 Label information management method and electronic equipment based on e-book

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1271537C (en) * 2002-11-12 2006-08-23 联想(北京)有限公司 Method of converting handwritten note into literal text and traveling equipment therefor
KR101988262B1 (en) * 2013-01-22 2019-06-12 엘지전자 주식회사 Mobile terminal and control method thereof
US10108586B2 (en) * 2013-06-15 2018-10-23 Microsoft Technology Licensing, Llc Previews of electronic notes
US9274693B2 (en) * 2013-10-16 2016-03-01 3M Innovative Properties Company Editing digital notes representing physical notes
KR101675911B1 (en) * 2015-02-25 2016-11-14 주식회사 와이오즈 E-book device for displaying information by input sound
CN106095261B (en) * 2016-06-13 2020-06-09 网易(杭州)网络有限公司 Method and device for adding notes to electronic equipment
CN108008845A (en) * 2017-11-13 2018-05-08 上海雷塔智能科技有限公司 A kind of revision method that document is realized in electronic ink screen and electromagnetism notebook
CN108932097B (en) * 2018-08-15 2019-11-29 掌阅科技股份有限公司 Take down notes generation method, electronic equipment and computer storage medium
CN109712218B (en) * 2018-12-17 2021-05-04 掌阅科技股份有限公司 Electronic book note processing method, handwriting reading equipment and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102214191A (en) * 2010-04-01 2011-10-12 宏碁股份有限公司 Electronic book reader and information collection method thereof
CN101882384A (en) * 2010-06-29 2010-11-10 汉王科技股份有限公司 Method for note management on electronic book and electronic book equipment
CN102760170A (en) * 2012-06-17 2012-10-31 上海琥智数码科技有限公司 Electronic book note-taking method based on screenshot
CN104731390A (en) * 2013-12-18 2015-06-24 深圳富泰宏精密工业有限公司 System and method for saving original handwriting
CN105446647A (en) * 2015-12-25 2016-03-30 智慧方舟科技有限公司 E-ink book and reading note implementation method and device thereof
CN107391475A (en) * 2017-07-21 2017-11-24 掌阅科技股份有限公司 Label information management method and electronic equipment based on e-book

Also Published As

Publication number Publication date
WO2020125345A1 (en) 2020-06-25
CN109712218A (en) 2019-05-03

Similar Documents

Publication Publication Date Title
CN109712218B (en) Electronic book note processing method, handwriting reading equipment and storage medium
CN103959206B (en) Method and apparatus for dynamically adapting dummy keyboard
US8832541B2 (en) Method and system to convert visually orientated objects to embedded text
US20140143721A1 (en) Information processing device, information processing method, and computer program product
US20160070688A1 (en) Displaying annotations of a document by augmenting the document
CN111381751A (en) Text processing method and device
US9529438B2 (en) Printing structured documents
US20160070686A1 (en) Collecting annotations for a document by augmenting the document
CN107430683B (en) Information association method, electronic bookmark and information association system
US10509853B2 (en) Creating an annotation pane for a document by augmenting the document
US10845882B2 (en) Method, apparatus, and computer-readable medium for providing internet browsing service through tactile interface device
CN104541288A (en) Handwritten document processing apparatus and method
CN109710144B (en) Notebook page processing method, computer device and storage medium
KR20200020305A (en) Method and Apparatus for character recognition
CN108121987B (en) Information processing method and electronic equipment
US20150139547A1 (en) Feature calculation device and method and computer program product
CN111552903A (en) Page generation method and device based on HTML (Hypertext markup language) template and computer equipment
US20150058710A1 (en) Navigating fixed format document in e-reader application
JP2016085547A (en) Electronic apparatus and method
CN111199136B (en) Document content display method, device and equipment
Sandnes Lost in OCR-translation: pixel-based text reflow to the rescue: magnification of archival raster image documents in the browser without horizontal scrolling
US10127478B2 (en) Electronic apparatus and method
JP5895828B2 (en) Information processing apparatus and program
US11593570B2 (en) System and method for translating text
CN113111881A (en) Information processing apparatus and recording medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant