CN111090817A

CN111090817A - Method for displaying book extension information, electronic equipment and computer storage medium

Info

Publication number: CN111090817A
Application number: CN201911328547.3A
Authority: CN
Inventors: 务晓敏
Original assignee: Ireader Technology Co Ltd
Current assignee: Ireader Technology Co Ltd
Priority date: 2019-12-20
Filing date: 2019-12-20
Publication date: 2020-05-01

Abstract

The invention discloses a method for displaying book extension information, electronic equipment and a computer storage medium, wherein the method comprises the following steps: acquiring a book image corresponding to a target book; matching the book image with an electronic book stored in a preset electronic book database, and determining the successfully matched electronic book as a target electronic book; acquiring user interaction data corresponding to the target electronic book, and generating book extension information according to the user interaction data; and displaying the book extension information on the book image in an overlapping manner. By the method, the user interaction data of the electronic book associated with the paper book can be acquired in the process of reading the paper book by the user, and then book extension information is generated, so that the information quantity which can be acquired by the reading user of the paper book in the reading process is improved, and the reading efficiency is obviously improved.

Description

Method for displaying book extension information, electronic equipment and computer storage medium

Technical Field

The invention relates to the field of computers, in particular to a method for displaying book extension information, electronic equipment and a computer storage medium.

Background

Currently, electronic books are increasingly popular because of their portability advantages. Different from the traditional paper books, the electronic book reading process does not need to carry heavy physical books, and the electronic book can be read at any time and any place only through electronic equipment. In addition, reading hearts of reading users can be shared through the internet, so that the information quantity acquired by the users in the reading process is expanded, and the reading effect is improved.

However, in the process of implementing the present invention, the inventor finds that the above solution in the prior art has at least the following defects: although electronic books have many advantages such as portability, some users prefer to read paper books. Especially for contents requiring reading with precision, paper books are still indispensable. However, in the process of reading a paper book, a user can only read the book itself, and cannot acquire more information. Therefore, how to increase the amount of information that can be obtained by a reading user of a paper book during reading becomes a technical problem to be solved urgently at present.

Disclosure of Invention

In view of the above problems, the present invention has been made to provide a method for presenting book extension information, an electronic device, and a computer storage medium that overcome or at least partially solve the above problems.

According to one aspect of the invention, a method for displaying book extension information is provided, which comprises the following steps:

acquiring a book image corresponding to a target book;

matching the book image with an electronic book stored in a preset electronic book database, and determining the successfully matched electronic book as a target electronic book;

acquiring user interaction data corresponding to the target electronic book, and generating book extension information according to the user interaction data;

and displaying the book extension information on the book image in an overlapping manner.

According to another aspect of the present invention, there is provided an electronic apparatus including: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is configured to store at least one executable instruction that causes the processor to:

acquiring a book image corresponding to a target book;

According to yet another aspect of the present invention, there is provided a computer storage medium having at least one executable instruction stored therein, the executable instruction causing the processor to:

acquiring a book image corresponding to a target book;

In the book extension information display method, the electronic device and the computer storage medium provided by the invention, the book image of the target book can be collected in the book reading process, the target electronic book matched with the book image is screened from the electronic book database, and the book extension information is generated according to the user interaction data of the target electronic book, so that the user can browse conveniently. Therefore, in the method, the user interaction data of the electronic book associated with the paper book can be acquired in the process of reading the paper book by the user, and then the book extension information is generated, so that the information quantity which can be acquired by the reading user of the paper book in the reading process is favorably improved, and the reading efficiency is obviously improved.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

fig. 1 is a flowchart illustrating a method for displaying book extension information according to an embodiment of the present invention;

fig. 2 is a flowchart illustrating a method for displaying book extension information according to another embodiment of the present invention;

fig. 3 shows a schematic structural diagram of an electronic device according to another embodiment of the invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

Example one

Fig. 1 shows a flowchart of a method for displaying book extension information according to an embodiment of the present invention. As shown in fig. 1, the method comprises the steps of:

step S110: and acquiring a book image corresponding to the target book.

The target book is a book which is currently read by a user, can be a paper book, and can also be an electronic book displayed in other electronic equipment.

Specifically, when acquiring a book image corresponding to a target book, the acquisition may be performed by a terminal device having a shooting function. For example, a book image corresponding to a target book may be acquired by a scanning method or a photographing method. In addition, the book image corresponding to the target book may be one or more images, which may be a cover image or a text image, and the present invention is not limited thereto.

Step S120: and matching the book images with the electronic books stored in a preset electronic book database, and determining the electronic books successfully matched as target electronic books.

Specifically, key information, such as text information, picture information, and the like, included in the book image may be recognized through image recognition, and accordingly, matching is performed with the electronic books stored in the electronic book database according to the recognized key information to determine the electronic book consistent with the target book content, and the electronic book consistent with the target book content is determined as the target electronic book. In other words, the content of the target book is identified through book name matching, paragraph matching and the like, so that the corresponding electronic version book is determined.

Step S130: and acquiring user interaction data corresponding to the target electronic book, and generating book extension information according to the user interaction data.

In the process of displaying the target electronic book through the reading application, each reading user can perform various interactive operations on the target electronic book, such as comment making, note creating, idea adding and the like, correspondingly, user interactive data corresponding to the various user interactive operations are stored in the background database, and by analyzing the user interactive data of the target electronic book, part of user interactive data with high frequency of occurrence is extracted to serve as book extension information.

Of course, the specific generation mode of the book extension information is not limited, the user interaction data can be directly used as the book extension information, and various processing such as selection, deletion, expansion and the like can be further performed on the user interaction data to obtain the book extension information.

Step S140: and displaying the book extension information on the book image in an overlapping manner.

Specifically, the book extension information is displayed on the top of the book image in an overlapping manner, so that the user can browse the book image and the book extension information at the same time. For example, an additional layer may be added above the layer where the book image is located, and the book extension information may be displayed in the additional layer, where the additional layer covers the layer where the book image is located. For another example, the book extension information may be displayed in an augmented reality manner, so that the book image in which the entity exists is displayed simultaneously with the book extension information that is added separately and virtualized.

Therefore, in the display method of the book extension information, provided by the invention, the book image of the target book can be acquired in the book reading process, the target electronic book matched with the book image is screened from the electronic book database, and the book extension information is generated according to the user interaction data of the target electronic book, so that the user can browse conveniently. Therefore, in the method, the user interaction data of the electronic book associated with the paper book can be acquired in the process of reading the paper book by the user, and then the book extension information is generated, so that the information quantity which can be acquired by the reading user of the paper book in the reading process is favorably improved, and the reading efficiency is obviously improved.

Example two

Fig. 2 is a flowchart illustrating a method for displaying book extension information according to another embodiment of the present invention. As shown in fig. 2, the method comprises the steps of:

step S210: and acquiring a book image corresponding to the target book.

In this embodiment, the target book is a paper book that the user is currently reading. Specifically, a "scan" function entry may be added in an application interface of the electronic book application, through which a book image corresponding to a target book can be scanned and acquired. Optionally, the "scan" function portal supports an Augmented Reality (AR) scan function, so that scanning can be performed in an augmented reality manner. In addition, the book image corresponding to the target book may be directly acquired through the photographing function portal, and the acquiring method of the book image is not limited in the present invention.

The number of the book images corresponding to the target book may be one or more. When the book image is one sheet, the book image may be of various types such as a cover image, a head page image, a text image, and the like, and accordingly, the user scans the camera with respect to the cover portion, the head page portion, or the text portion of the target book, respectively, thereby obtaining different types of book images. In practical cases, the number of book images may be one, so as to perform subsequent processing on the single book image. Or, the number of the book images can be multiple, so that matching of the target electronic book can be performed by combining the multiple book images in the subsequent process, and the matching accuracy is improved.

Step S220: and matching the book images with the electronic books stored in a preset electronic book database, and determining the electronic books successfully matched as target electronic books.

Specifically, key information, such as text information, picture information, and the like, contained in the book image may be recognized through image recognition (such as OCR recognition and the like), and accordingly, the recognized key information is matched with the electronic book stored in the electronic book database to determine an electronic book that is consistent with the content of the target book, that is, the target electronic book.

Since the present embodiment can recognize various types of book images, in order to improve recognition efficiency, a plurality of image type templates are preset, and correspond to different portions of a book, respectively, so as to perform fast matching according to features of different types of book images. For example, the following image type templates are set in advance:

(1) a cover type template for storing cover characteristic information. Wherein the cover feature information includes a cover picture feature, a title feature, and/or an author feature. The cover picture characteristics specifically include: the size of the cover picture, the location of the cover picture, etc. The title characteristics include the font, the typesetting mode, the setting position and the like of the title. Because the design modes of covers of electronic books have a lot of commonalities, the cover type book images can be quickly identified through the cover type template.

(2) A flyleaf type template for storing flyleaf feature information. Wherein the flyleaf feature information includes: an author field characteristic, a publisher field characteristic, and/or a title field characteristic. In particular, the inventors have discovered in the course of implementing the present invention that the book fly page portion has a particular format that specifies the mutual order between the fields and the separators between the fields. For example, a plurality of fields such as an author field, a publisher field, and a title field are sequentially arranged in a specified order, and different types of fields are separated by a specified separator (e.g., a special character). Accordingly, the flyleaf type book image can be quickly recognized by the flyleaf type template.

(3) And the text type template is used for storing text characteristic information. Wherein, the text characteristic information comprises: a chapter title feature, a body text feature, and/or an illustration feature. In particular, the body portion of an electronic book typically includes the following types of text units: a chapter major title type text unit, a chapter minor title type text unit and a text unit. The font sizes and the typesetting modes of various types of text units are different. Also, the body part may contain illustration features. Accordingly, the text type book image can be quickly identified through the text type template.

Correspondingly, in the step, the book image is matched with a preset image type template so as to determine the image type of the book image; and aiming at the electronic book stored in the electronic book database, extracting a target recognition area matched with the image type from the electronic book according to the image type of the book image, and matching the extracted target recognition area with the book image. For example, the target identification area matching the cover type is an electronic book cover area, the target identification area matching the flyleaf type is an electronic book flyleaf area, and the target identification area matching the text type is an electronic book text area. Therefore, the matching range can be reduced through type judgment, and the subsequent matching efficiency is improved.

Therefore, the target electronic book is an electronic version book of the target book, and the contents of the target electronic book and the electronic version book are the same. The step has the function of quickly positioning the electronic book with the same content as the target book from the massive electronic books stored in the electronic book database.

Step S230: and acquiring user interaction data corresponding to the target electronic book, and generating book extension information according to the user interaction data.

The target electronic book can be read online through the reading application, and various interaction operations can be triggered by various reading users in the reading process aiming at the target electronic book. In specific implementation, user interaction data corresponding to the electronic book is stored through the user interaction database. Accordingly, in this step, user interaction data corresponding to the target electronic book is acquired from the user interaction database, so that book extension information is generated according to the user interaction data.

Specifically, the user interaction data includes interaction data of multiple interaction types, such as idea-type interaction data, comment-type interaction data, note-type interaction data, and label-type interaction data, so that the interaction data used for generating the book extension information needs to be screened according to the interaction types. Correspondingly, after user interaction data corresponding to the target electronic book are obtained, type interaction data corresponding to various interaction types are respectively extracted from the user interaction data; and counting the occurrence frequency of various types of interactive data in the user interactive data, and generating book extension information according to the counting result. In specific implementation, the book extension information can be generated in a plurality of ways:

in an optional mode, the occurrence frequency of the user interaction data with the same content is determined according to the similarity between the user interaction data, so that the user interaction data with higher occurrence frequency is extracted as the book extension information. For example, word segmentation processing is performed on each piece of user interaction data, and a term frequency-inverse text frequency index (TF-IDF for short) of each word segmentation is calculated, so that a word segmentation with a higher index is extracted as a feature word; then, comparing the feature words of each user interaction data, taking a plurality of pieces of user interaction data containing the same feature words as a group of interaction data sets, counting the number of the user interaction data in each interaction data set, and generating book extension information according to the user interaction data in the interaction data set with higher number. By the method, the user interaction data with high occurrence frequency can be extracted, so that the contents which are interested by most users can be conveniently mined.

In yet another alternative, the extraction is further performed in combination with the interaction type of the interaction data. For example, different type weights are set for various interaction types, for example, if a user tends to browse comment-type interaction data, the weight of the comment-type interaction data is set to be higher. Next, for each piece of user interaction data, taking the product of the occurrence number of the user interaction data and the type weight as the interaction index of the user interaction data, thereby extracting the user interaction data with a higher interaction index as the book extension information. Or, for each interaction type, counting a plurality of pieces of data with higher occurrence frequency in the user interaction data corresponding to the interaction type, and further extracting a fixed number of user interaction data for each interaction type, so as to ensure that the types of the finally generated book extension information are various.

In addition, book extension information can be further determined according to the type of the book image:

when the image type of the book image is a cover type or a title page type, it is described that the user is currently browsing the cover of the target book, and accordingly, in order to facilitate the user to comprehensively know the main content of the target book, book extension information is generated in combination with the user interaction data of the full book. Accordingly, the user interaction data of the full book is analyzed to extract hot content as book extension information.

And when the image type of the book image is the text type, indicating that the user is currently browsing the specified page in the book. Correspondingly, in order to facilitate the user to know the content matched with the current reading page, when the user interaction data corresponding to the target electronic book is acquired and the book extension information is generated according to the user interaction data, the method is implemented in the following way: firstly, a target page corresponding to a book image contained in a target electronic book is determined through a character recognition mode. Specifically, each paragraph contained in the book image is matched with a paragraph contained in an electronic book page of the target electronic book in a character matching mode, and the electronic book page successfully matched is determined as a target page, wherein the target page corresponds to the electronic version content of the current reading page of the paper book currently read by the user. Then, the user interaction data matched with the target page is screened from the user interaction data corresponding to the target electronic book. For example, the line drawing content added for the target page, comments, annotations, and the like are filtered. And finally, generating book extension information according to the screened user interaction data.

Step S240: and generating an augmented reality animation model containing book extension information, and displaying the augmented reality animation model on the book image in an overlapping mode.

Specifically, the augmented reality animation model is used for displaying the book extension information in an augmented reality display mode. In addition, in order to avoid blocking the content of the book image, the background color of the augmented reality animation model can be set to be transparent. In addition, in order to further enhance the display effect, in this step, the pixel values of the pixels of the book image are analyzed to determine the blank area and the non-blank area included in the book image. For example, the book image may be subjected to gray processing to obtain a gray value of each pixel, and the blank region and the non-blank region may be determined according to the gray value. Accordingly, the augmented reality animation model is generated according to the size and shape of the blank area, so that the size and shape of the augmented reality animation model are matched with the shape of the blank area.

In addition, since the book extension information may include a plurality of extension contents, each extension content corresponds to user interaction data of a different interaction type, different presentation styles may be set for different types of extension contents, respectively, in order to improve a presentation effect. Specifically, the display style of each piece of book extension information is set according to the interaction type of user interaction data corresponding to each piece of book extension information; and displaying the extended information of each book according to the corresponding display style. For example, if the interaction type of the user interaction data corresponding to the book extension information is a labeling type, that is, the book extension information is generated according to a key paragraph or a highlight sentence labeled in the reading process of the user, the corresponding display style is a flash special effect style, so that the attention of the user to the extension information is promoted in a flash dynamic and effective manner. For another example, if the interaction type of the user interaction data corresponding to the book extension information is a comment type, that is, the book extension information is generated according to a comment added in the user reading process, the corresponding display style is a scroll display style, so that a plurality of comment contents are displayed to the user one by one in a scroll manner. In a word, different display styles are set for different types of book extension information, so that a user can visually distinguish various types of book extension information from the aspect of the display styles, and the user focuses on the information interested by the user.

In addition, in order to facilitate user interaction, an interaction portal element is further included in the augmented reality animation model, and the method further comprises the steps of: and responding to an interaction instruction triggered by the interaction entry element, and performing interaction processing on the displayed book extension information. Wherein the interactive portal element can be of various types, including, for example: an interaction portal element for performing a sliding class operation, an interaction portal element for performing a switching class operation, and the like. Accordingly, the types of interactive processes include: a sliding type, and/or a switching type. For example, the user may perform a sliding operation on the displayed book extension information to slide to the remaining non-displayed portion, thereby implementing the item-by-item display of the plurality of pieces of book extension information. In a practical case, when one paragraph corresponds to a plurality of idea-type book extension information, the respective pieces of book extension information can be sequentially presented by a slide operation. Alternatively, the user may also perform a switching operation on the displayed book extension information, for example, the augmented reality animation model may display the annotation-type book extension information first by default, and when receiving a switching instruction, the user may sequentially switch to the comment-type book extension information and the idea-type book extension information. In a word, different types of interactive entry elements are used, so that a user can flexibly determine the display mode of the book expansion information according to actual requirements.

In addition, when the book extension information is displayed, different display modes can be flexibly selected according to the information data amount of the book extension information. Specifically, whether the information data volume of the book extension information is larger than a preset threshold value is judged; if not, the original information content of the book extension information is displayed on the book image in an overlapping mode; and if so, displaying an interactive entry element corresponding to the book extension information on the book image, and displaying the original information content of the book extension information when receiving an interactive request triggered by the interactive entry element. The information data amount of the book extension information may be the number of information entries or the number of bytes included in the information, which is not limited in the present invention. When the number of information items of the information data volume of the book extension information is small (for example, only one) and/or the number of bytes is small (for example, no more than one line), the original information content of the book extension information can be directly displayed on the book image in an overlapping manner. When the display is carried out specifically, the display can be carried out in the forms of a semitransparent floating layer and the like, the information can be acquired quickly by a user in the mode, and the reading process of the user cannot be influenced due to the fact that the information quantity is small. When the number of information items of the information data volume of the book extension information is large and/or the number of bytes is large, the interactive entry element corresponding to the book extension information can be displayed on the book image, and the original information content of the book extension information is displayed when an interactive request triggered by the interactive entry element is received. For example, the interactive entry element can show the number of entries of the book extension information in the form of icons, and the interactive entry element can avoid interference on the reading process in the form of the interactive entry element when the number of the book extension information is large.

In addition, it should be noted that, since the book extension information is mainly obtained from the user interaction data, the interaction target element of the user interaction data corresponding to the book extension information may be further determined for each piece of book extension information. The interactive target element refers to the electronic book content corresponding to the user interactive data, for example, the interactive target element corresponding to the label-type interactive data is the text content labeled by the user. Correspondingly, each piece of book expansion information is displayed in the adjacent area of the corresponding interaction target element. In this manner, each piece of book expansion information may be further clustered according to the corresponding interaction target elements to obtain book expansion information sets corresponding to the same or a same group of interaction target elements (e.g., multiple interaction target elements in a same sentence or a same paragraph are used as a group of interaction target elements), so that the book expansion information included in each book expansion information set is displayed in a neighboring area of the corresponding interaction target element or group of interaction target elements. Specifically, whether to directly display original information content of the book extension information or to display an interactive entry element corresponding to the book extension information may be determined according to whether the information data amount of the book extension information included in each book extension information set is greater than a preset threshold. For example, for the same or the same group of interaction target elements, if the information data amount of the book extension information contained in the corresponding book extension information set is not greater than a preset threshold, the original information content of the corresponding book extension information set is displayed in an overlapping manner in the adjacent area of the interaction target element; and if the information data volume of the book extended information contained in the corresponding book extended information set is larger than a preset threshold value, displaying an interactive entry element corresponding to the book extended information set in the adjacent area of the interactive target element, and displaying the original information content of the book extended information set when an interactive request triggered by the interactive entry element is received.

In summary, in the embodiment, in the process of reading a paper book by a user, user interaction data of an electronic book associated with the paper book can be acquired, so that book extension information is generated, which is helpful for increasing the amount of information that can be acquired by the reading user of the paper book in the reading process, and the reading efficiency is remarkably improved. And the type of the book image can be automatically identified by the method, so that the target electronic book can be quickly matched according to the type. And moreover, various interactions can be carried out with the user according to the received interaction instruction. In a word, the mode enables the off-line physical book and the on-line electronic book to be mutually related, so that a user can conveniently know more related information in the reading process of the physical book, and the reading effect of the physical book is improved.

EXAMPLE III

The embodiment of the application provides a non-volatile computer storage medium, wherein at least one executable instruction is stored in the computer storage medium, and the computer executable instruction can execute the method for displaying the book extension information in any method embodiment.

The executable instructions may be specifically configured to cause the processor to:

acquiring a book image corresponding to a target book;

In an alternative implementation, the executable instructions cause a processor to:

matching the book image with a preset image type template to determine the image type of the book image;

and aiming at the electronic book stored in the electronic book database, extracting a target recognition area matched with the image type from the electronic book according to the image type of the book image, and matching the extracted target recognition area with the book image.

In an alternative implementation, the preset image type template includes at least one of:

a cover type template for storing cover characteristic information; wherein the cover feature information comprises cover picture features, title features, and/or author features; the target identification area matched with the cover type is an electronic book cover area;

a flyleaf type template for storing flyleaf feature information; wherein the flyleaf feature information includes: author field characteristics, publisher field characteristics, and/or title field characteristics; and the target identification area matched with the type of the flyleaf is an electronic book flyleaf area;

and a text type template for storing text characteristic information; wherein, the text characteristic information comprises: a chapter title feature, a body text feature, and/or an illustration feature; and the target identification area matched with the text type is the text area of the electronic book.

acquiring user interaction data corresponding to the target electronic book;

respectively extracting type interaction data corresponding to various interaction types from the user interaction data;

and counting the occurrence frequency of various types of interactive data in the user interactive data, and generating book extension information according to the counting result.

In an alternative implementation, when the image type of the book image is a text type, the executable instructions cause the processor to:

determining a target page corresponding to the book image contained in the target electronic book in a character recognition mode;

screening user interaction data matched with the target page from the user interaction data corresponding to the target electronic book;

and generating book extension information according to the screened user interaction data.

In an alternative implementation, the user interaction data corresponding to the target electronic book includes at least one of: idea-class interaction data, comment-class interaction data, note-class interaction data, and annotation-class interaction data.

and generating an augmented reality animation model containing the book extension information, and displaying the augmented reality animation model on the book image in an overlapping manner.

setting the display style of each piece of book extension information according to the interaction type of the user interaction data corresponding to each piece of book extension information;

and displaying the extended information of each book according to the corresponding display style.

In an alternative implementation, the executable instructions cause a processor to: and responding to an interaction instruction triggered by the interaction entry element, and performing interaction processing on the displayed book extension information.

In an alternative implementation, the type of the interactive processing includes: a sliding type, and/or a switching type.

judging whether the information data volume of the book extension information is larger than a preset threshold value or not;

if not, the original information content of the book extension information is displayed on the book image in an overlapping mode;

and if so, displaying an interactive entry element corresponding to the book extension information on the book image, and displaying the original information content of the book extension information when receiving an interactive request triggered by the interactive entry element.

Example four

Fig. 3 is a schematic structural diagram of an electronic device according to another embodiment of the present invention, and the specific embodiment of the present invention does not limit the specific implementation of the electronic device.

As shown in fig. 3, the electronic device may include: a processor (processor)302, a communication Interface 304, a memory 306, and a communication bus 308.

Wherein: the processor 302, communication interface 304, and memory 306 communicate with each other via a communication bus 308. A communication interface 304 for communicating with network elements of other devices, such as clients or other servers. The processor 302 is configured to execute the program 310, and may specifically execute the relevant steps in the above-described embodiment of the method for displaying book extension information.

In particular, program 310 may include program code comprising computer operating instructions.

The processor 302 may be a central processing unit CPU, or an application specific Integrated circuit (asic), or one or more Integrated circuits configured to implement an embodiment of the present invention. The electronic device comprises one or more processors, which can be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.

And a memory 306 for storing a program 310. Memory 306 may comprise high-speed RAM memory and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

The program 310 may specifically be configured to cause the processor 302 to perform the following operations:

acquiring a book image corresponding to a target book;

acquiring user interaction data corresponding to the target electronic book;

and if so, displaying an interactive entry element corresponding to the book extension information on the book image, and displaying the original information content of the book extension information when receiving an interactive request triggered by the interactive entry element. The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

The invention also discloses A1. a method for displaying the book extension information, which comprises the following steps:

acquiring a book image corresponding to a target book;

A2. The method of A1, wherein the matching the book image with the electronic book stored in a preset electronic book database includes:

A3. The method of a2, wherein the preset image type template includes at least one of:

A4. The method according to any one of a1-3, wherein the acquiring user interaction data corresponding to the target electronic book, and generating book extension information according to the user interaction data includes:

acquiring user interaction data corresponding to the target electronic book;

A5. The method according to any one of a1-4, wherein, when the image type of the book image is a text type, the acquiring user interaction data corresponding to the target electronic book, and generating book extension information according to the user interaction data includes:

A6. The method of A1-5, wherein the user interaction data corresponding to the target electronic book includes at least one of: idea-class interaction data, comment-class interaction data, note-class interaction data, and annotation-class interaction data.

A7. The method according to a1-6, wherein the displaying the book extension information superimposed on the book image comprises:

A8. The method of A7, wherein the generating an augmented reality animation model containing the book extension information includes:

A9. The method according to a7 or 8, wherein the augmented reality animation model further includes an interactive entry element, the overlaying of the augmented reality animation model on the book image further includes:

and responding to an interaction instruction triggered by the interaction entry element, and performing interaction processing on the displayed book extension information.

A10. The method according to A7 or 8, wherein the type of interactive processing includes: a sliding type, and/or a switching type.

A11. The method of a1, wherein displaying the book extension information superimposed on the book image comprises:

B12. An electronic device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

acquiring a book image corresponding to a target book;

B13. The electronic device of B12, wherein the executable instructions cause the processor to:

B14. The electronic device of B13, wherein the preset image type template includes at least one of:

B15. The electronic device of any of B12-14, wherein the executable instructions cause the processor to:

acquiring user interaction data corresponding to the target electronic book;

B16. The electronic device of any of B12-15, wherein when the image type of the book image is a text type, the executable instructions cause the processor to:

B17. The electronic device of B12-16, wherein the user interaction data corresponding to the target electronic book includes at least one of: idea-class interaction data, comment-class interaction data, note-class interaction data, and annotation-class interaction data.

B18. The electronic device of B12-17, wherein the executable instructions cause the processor to:

B19. The electronic device of B18, wherein the executable instructions cause the processor to:

B20. The electronic device of B18 or 19, wherein the executable instructions cause the processor to: and responding to an interaction instruction triggered by the interaction entry element, and performing interaction processing on the displayed book extension information.

B21. The electronic device according to B18 or 19, wherein the type of interaction processing includes: a sliding type, and/or a switching type.

B22. The electronic device of B12, the executable instructions to cause a processor to:

C23. A computer storage medium having at least one executable instruction stored therein, the executable instruction causing a processor to:

acquiring a book image corresponding to a target book;

C24. The computer storage medium of C23, wherein the executable instructions cause a processor to:

C25. The computer storage medium of C24, wherein the preset image type template includes at least one of:

C26. The computer storage medium of any of C23-25, wherein the executable instructions cause a processor to:

acquiring user interaction data corresponding to the target electronic book;

C27. The computer storage medium of any of C23-26, wherein the executable instructions cause the processor to, when the image type of the book image is a body type:

C28. The computer storage medium of C23-27, wherein the user interaction data corresponding to the target electronic book includes at least one of: idea-class interaction data, comment-class interaction data, note-class interaction data, and annotation-class interaction data.

C29. The computer storage medium of C23-28, wherein the executable instructions cause a processor to:

C30. The computer storage medium of C29, wherein the executable instructions cause a processor to:

C31. The computer storage medium of C29 or 30, wherein the executable instructions cause a processor to: and responding to an interaction instruction triggered by the interaction entry element, and performing interaction processing on the displayed book extension information.

C32. The computer storage medium of C29 or 30, wherein the types of interaction processing include: a sliding type, and/or a switching type.

C33. The computer storage medium of C23, the executable instructions to cause a processor to:

Claims

1. A method for displaying book extension information comprises the following steps:

acquiring a book image corresponding to a target book;

2. The method of claim 1, wherein the matching the book image with the electronic book stored in a preset electronic book database comprises:

3. The method of claim 2, wherein the preset image type template comprises at least one of:

4. The method of any one of claims 1 to 3, wherein the obtaining user interaction data corresponding to the target electronic book, and generating book extension information according to the user interaction data includes:

acquiring user interaction data corresponding to the target electronic book;

5. The method according to any one of claims 1 to 4, wherein when the image type of the book image is a text type, the acquiring user interaction data corresponding to the target electronic book, and generating book extension information according to the user interaction data includes:

6. The method of claims 1-5, wherein the user interaction data corresponding to the target electronic book includes at least one of: idea-class interaction data, comment-class interaction data, note-class interaction data, and annotation-class interaction data.

7. The method of claims 1-6, wherein the displaying the book extension information superimposed on the book image comprises:

8. The method of claim 7, wherein the generating an augmented reality animation model containing the book extension information comprises:

9. An electronic device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

acquiring a book image corresponding to a target book;

10. A computer storage medium having at least one executable instruction stored therein, the executable instruction causing a processor to:

acquiring a book image corresponding to a target book;