CN109189879A

CN109189879A - E-book display methods and device

Info

Publication number: CN109189879A
Application number: CN201811075405.6A
Authority: CN
Inventors: 姚健; 李学朝; 张从周; 袁世培; 史景慧; 雷璐; 王艺婷; 曾晶; 方芳
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Beijing Co Ltd
Priority date: 2018-09-14
Filing date: 2018-09-14
Publication date: 2019-01-11
Anticipated expiration: 2038-09-14
Also published as: CN109189879B

Abstract

The embodiment of the invention discloses a kind of e-book display methods and devices, belong to field of computer technology.This method comprises: the content input interface of display e-book management application；The book contents inputted by content input interface are obtained, book contents are the part book contents in e-book to be checked；In the database, e-book belonging to book contents is inquired, includes the book contents at least one e-book in database；Show that the books of e-book management application show interface, books show that interface includes the book contents of e-book.The embodiment of the invention provides the functions that e-book is inquired according to book contents, extend application range, user is easy to operate without knowing that the description information of e-book can inquire complete e-book according to part book contents, requires the information reservation of user lower.

Description

Electronic book display method and device

Technical Field

The embodiment of the invention relates to the technical field of computers, in particular to an electronic book display method and device.

Background

Reading books is an important way for people to acquire information, learn knowledge and know the world, and is a common way for people to enrich spiritual life. With the gradual expansion of internet data scale and the wide application of electronic devices, people are beginning to change from reading paper books to reading electronic books when the people are in the electronic reading era.

Some electronic book websites have been produced in order to facilitate reading of electronic books. The manager of the electronic book website converts the paper book into the electronic book, and uploads the description information of the electronic book and the electronic book to the electronic book website, wherein the description information comprises a name, an introduction, an author, a publication date and the like. The user can access the electronic book website through the electronic equipment, when a certain electronic book is to be inquired, the description information such as the name, the author and the like of the electronic book can be input, so that the electronic book corresponding to the description information is inquired in the electronic book website, the user can read the electronic book on the electronic equipment, the user can read the electronic book at any time and any place without carrying the paper book, and the operation is very convenient.

According to the scheme, the user needs to know the description information of the electronic book in advance, and when the user sees a part of interested book content but does not know the description information of the electronic book to which the book content belongs, the user cannot inquire the electronic book. Therefore, the scheme has high information storage requirement on users, has limitation and is narrow in application range.

Disclosure of Invention

The embodiment of the invention provides an electronic book display method and device, which can solve the problems in the related art. The technical scheme is as follows:

in one aspect, an electronic book display method is provided, the method including:

displaying a content input interface of an electronic book management application;

acquiring book contents input through the content input interface, wherein the book contents are partial book contents in the electronic books to be inquired;

inquiring an electronic book to which the book content belongs in a database, wherein the database comprises the book content in at least one electronic book;

displaying a book display interface of the electronic book management application, the book display interface including book contents of the electronic book.

In another aspect, there is provided an electronic book display device, the device including:

the system comprises a first display module, a second display module and a display module, wherein the first display module is used for displaying a content input interface of an electronic book management application;

the acquisition module is used for acquiring book contents input through the content input interface, wherein the book contents are partial book contents in the electronic books to be inquired;

the query module is used for querying the electronic books to which the book contents belong in a database, and the database comprises the book contents in at least one electronic book;

and the second display module is used for displaying a book display interface of the electronic book management application, wherein the book display interface comprises book contents of the electronic book.

In another aspect, an ebook display device is provided, the device comprising a processor and a memory, the memory having stored therein at least one instruction, at least one program, set of codes, or set of instructions, the instruction, the program, the set of codes, or the set of instructions being loaded and executed by the processor to implement operations as performed in the ebook display method.

In yet another aspect, a computer-readable storage medium having stored therein at least one instruction, at least one program, set of codes, or set of instructions, loaded by a processor and having instructions to implement the operations as performed in the ebook display method is provided.

According to the method and the device provided by the embodiment of the invention, the content of the book input through the content input interface is obtained by displaying the content input interface of the electronic book management application, the electronic book to which the content of the book belongs is inquired in the database, the book display interface of the electronic book management application is displayed, and the content of the electronic book is displayed in the book display interface. The embodiment of the invention provides the function of inquiring the electronic books according to the contents of the books, expands the application range, can inquire the complete electronic books according to the contents of partial books without knowing the description information of the electronic books by a user, is convenient and quick to operate and has lower information storage requirement on the user.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 is a schematic illustration of an implementation environment provided by an embodiment of the invention;

FIG. 2 is a schematic diagram of an implementation environment provided by embodiments of the invention;

FIG. 3 is a flowchart of a method for creating a database according to an embodiment of the present invention;

FIG. 4 is a flowchart of a method for creating a database according to an embodiment of the present invention;

FIG. 5 is a schematic diagram illustrating an operation flow of creating a database according to an embodiment of the present invention;

FIG. 6 is a flowchart illustrating an electronic book displaying method according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of a main interface of an Ebook management application according to an embodiment of the present invention;

FIG. 8 is a schematic diagram of a content input interface provided by an embodiment of the invention;

FIG. 9 is a schematic view of a book display interface provided in an embodiment of the present invention;

FIG. 10 is a schematic view of a book display interface provided in an embodiment of the present invention;

FIG. 11 is a schematic view of a book display interface provided in an embodiment of the present invention;

FIG. 12 is a schematic view of a read-after interface provided by an embodiment of the present invention;

fig. 13 is a schematic view of an operation flow of displaying an ebook according to an embodiment of the present invention.

Fig. 14 is a schematic structural diagram of an ebook display device according to an embodiment of the present invention;

fig. 15 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

fig. 16 is a schematic structural diagram of a server according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the embodiments of the present invention will be described in further detail with reference to the accompanying drawings.

Before describing embodiments of the present invention in detail, the concepts involved are explained as follows:

1. electronic books: the digital resources are digital resources which present contents such as characters, pictures, sound, images and the like in a digital form, can store book contents by using a storage medium, and are a novel book recording form. The electronic books can be spread in a wired or wireless network and displayed to readers for reading through electronic equipment.

In terms of Format, an electronic book may be presented in DOC (Document) Format, txt (text Document) Format, PDF (Portable Document Format), EXE (executable program), or other forms. From the book content, the e-book can be a learning textbook for learning, an out-of-class book for expanding reading content, or a painting book for painting teaching, etc. From the source, an electronic book can be an electronic book converted from a paper book, and the electronic book has a corresponding original book, and the book content of the original book is the same as the book content of the electronic book. Or the electronic book may be an electronic book directly generated according to the content in a digitized form, such as a text document generated according to the text content input by the user, or a term generated according to information uploaded by the user, and the like.

The electronic book has description information for describing the electronic book, which may include a plurality of items of information such as a name, a brief introduction, an author, a publication date, and the like of the electronic book, in addition to the book content inside.

Moreover, the electronic book can be divided according to pages, corresponding index marks are set for each page, the electronic book is represented by the book content on the page and the index mark of the page where the book content is located, and the electronic book is structured.

2. Cover covering: the cover of the paper book refers to the outermost layer of the book and can be used as a protective layer to protect the book. Then for an electronic book, the cover of the electronic book refers to the first page of the electronic book, and usually only one page.

The cover of the electronic book includes information such as the name, introduction, author, publisher, and publication date of the book, and the information may be text information or image information.

3. Catalog: the book title is the order recorded before the text of the book, and the titles of the contents of each part of the book are arranged according to a certain sequence, so that the positions of the contents of each part of the book in the book can be shown, and guidance is provided for a reader to read the book.

4. The text is as follows: the book content is the main part of the book content except for the cover, the front language, the catalogue, the postscript and the annotation, and the cover, the front language, the catalogue, the postscript and the annotation of the book provide guidance, explanation and description for texts.

5. Vocabulary: refers to the smallest unit that can be used independently in a language, where one or more words can be combined into a sentence and one or more sentences can be combined into a paragraph. The vocabulary can be a word composed of one or more Chinese characters and can also be an English word.

6. Word segmentation: the method refers to a process of dividing a text content into words with minimum units according to semantics, such as splitting a sentence into a plurality of words. Where the vocabulary is the smallest unit in the text content.

7. Index identification: refers to the identifiers indicating the order of the pages in the electronic book, and each page in the electronic book has an index identifier.

The index mark can be a page number, the page number refers to a number, a number or other types of marks used for representing the page sequence on each page, and can be located at the positions of the upper side, the lower right corner and the like of the page, and a user can see the page number when reading any page and know the position of the page in the book.

8. Electronic book management application: the electronic book management system is an application for managing electronic books, and has functions of inquiring the electronic books, displaying book contents of the electronic books, learning based on the book contents, and the like.

The electronic book management application may be an application that runs independently on the electronic device, such as a system application running in an operating system, a plug-in application running in a browser, or a third-party application installed on the electronic device, or may also be an application running in an internet application.

The internet application can be an electronic payment application, an online shopping application or an instant messaging application. When the electronic book management application runs in the internet application, the developer may register a public identifier for the electronic book management application in the internet application, and recognize the electronic book management application with the public identifier. The public identity may be referred to as a public number, a service number, an enterprise number, or the like, depending on the developer. After the electronic book management application is run in the internet application, a common user in the internet application can pay attention to the public identification of the electronic book management application or establish a friend relationship with the public identification. And then, the Internet application can take the electronic book management application running in the Internet application as a medium, and realizes the function of managing the electronic books for the common user.

Fig. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present invention, where the implementation environment includes: the electronic device 101 and the server 102 are connected through a network, and the electronic device 101 and the server 102 are connected through the network.

The electronic device 101 may be a mobile phone, a computer, a tablet computer, a point-to-read machine, an e-book reader, a mini-tv, and the like, and the server 102 may be a server, a server cluster composed of a plurality of servers, or a cloud computing service center.

The electronic device 101 runs an electronic book management application, and interacts with the server 102 through the electronic book management application to jointly realize a function of managing electronic books.

In a first scenario, the ebook management application is an application running independently on the electronic device 101, the ebook management application is a front-end application associated with the server 102, and the server 102 may be referred to as an ebook management server.

In a second scenario, the electronic book management application is an application running in an internet application, and referring to fig. 2, the server 102 may include an internet application server 1021 and an electronic book management server 1022, the internet application is a front-end application associated with the internet application server 1021, and the electronic book management application is a front-end application associated with the electronic book management server 1022.

The electronic device 101 is connected to the internet application server 1021 via a network, and the internet application server 1021 is connected to the electronic book management server 1022 via a network. The internet application server 1021 is configured to provide an interface to an electronic book management server 1022 (a third party server), and after the electronic book management server 1022 accesses the internet application server 1021, the electronic book management application may register a public identifier on the internet application server 1021, so as to interact with the internet application server 1021 based on the public identifier, and share a data resource with the internet application server 1021.

In the related art, when inquiring an electronic book, a user is required to input description information such as a name and an author of the electronic book, so as to inquire the electronic book corresponding to the description information. Therefore, the user is required to know the description information of the electronic book in advance, when the user sees a part of interested book content but does not know the description information of the electronic book to which the book content belongs, the user cannot inquire the electronic book, the requirement on the information storage of the user is high, and the electronic book management system has limitations and a narrow application range.

The embodiment of the invention provides an electronic book display method, which includes the steps of obtaining book contents input through a content input interface by displaying the content input interface of an electronic book management application, inquiring an electronic book to which the book contents belong and an index mark where the book contents in the electronic book are located in a database, and displaying the book contents corresponding to the index mark in a book display interface.

In the method provided by the embodiment of the invention, because the database not only contains the description information corresponding to the electronic book, but also contains the book content in the electronic book and the index identifier of the page where the book content is located, when a certain book content is obtained, the electronic book to which the book content belongs and the index identifier in the electronic book can be inquired in the database, the book content corresponding to the index identifier is displayed for a user in the book display page of the electronic book management application, so that the user can conveniently operate the book content, and the user can inquire the whole electronic book, thereby facilitating the user to operate other book contents in the electronic book.

The embodiment of the invention can be applied to any scene of inquiring the electronic books according to the book contents, wherein the book contents can comprise at least one of text contents, voice contents and image contents.

For example, when a user sees a book of interest, the user can shoot a certain page of the book, and according to the content of the shot book, the method provided by the embodiment of the invention is adopted to inquire the electronic book corresponding to the book, and display the corresponding page in the electronic book. Then, the user can learn the book content in the electronic book, and perform operations such as follow-up reading and word dictation.

For another example, when a user hears a classical sentence in a certain famous work, the user can record a voice content including the classical sentence, and according to the recorded voice content, the method provided by the embodiment of the present invention is adopted to query an electronic book of the famous work, and a page where the classical sentence is located is displayed, so that the user can view the page where the classical sentence is located, or read the complete famous work.

For another example, when browsing network information, a user sees an interested paragraph, can capture a screenshot of the paragraph, and according to the captured image, queries an electronic book in which the paragraph is located by using the method provided by the embodiment of the present invention, and displays a page in the electronic book in which the paragraph is located.

Fig. 3 is a flowchart of a method for creating a database according to an embodiment of the present invention. An execution subject of the embodiment of the present invention is a management device, which may be an electronic device or a server in the embodiment shown in fig. 1 or fig. 2, and referring to fig. 3, the method includes:

301. the management device collects the text content and the index identification of each page in at least one electronic book.

The management device collects one or more electronic books, each electronic book may include a plurality of pages, each page has book content thereon, and each page has a unique index identifier in the electronic book, and the index identifier is used for determining the order of the pages in the electronic book.

Therefore, the electronic book is structured, the book content on each page and the corresponding index mark are used for representing the electronic book, the structural information of the electronic book is created, the structural information comprises the mapping relation between the book content on each page and the corresponding index mark, and the relation between the pages can be represented, so that the structured electronic book is obtained. Then, the electronic books stored in the database not only include the book contents, but also include the structural information of the electronic books, so that the book contents in the electronic books can be acquired according to the electronic books, and the relationship among the book contents can be known.

The book content may include text content, image content, and other contents in various formats.

In the embodiment of the present invention, the process of storing the text content is described by taking the case where the book content includes the text content, so that the management apparatus collects the text content and the index identifier of each page in at least one electronic book.

The index identifier of each page is determined according to the order of each page in the electronic book, and may be represented by a sequence number or a page number of the page. The index identifier of each page in the electronic book may be set by a user uploading the electronic book, or after the management device acquires the electronic book, the management device pages the electronic book according to the context relationship of the book content in the electronic book to obtain a plurality of pages, and determines the index identifier of each page. Alternatively, after acquiring the electronic book, the management apparatus identifies the page number included in the electronic book, and acquires the page number of each page.

Alternatively, for any page of any electronic book, when the book content on the page only includes text content, the text content is acquired, and when the book content on the page includes text content and image content, the text content may be extracted and the image content may be filtered.

The pages in each electronic book may include a cover, a catalog page, and a body page. The cover refers to a front page of the electronic book, and usually only one page, the catalog page refers to a page where the catalog of the electronic book is located, and may include one or more pages, which is specifically determined according to the length of the catalog, and the text page refers to a page where the text content of the electronic book is located, and usually includes a plurality of text pages located behind the cover and the catalog page.

In order to facilitate the distinction between the plurality of different types of pages, not only the book content on each page may be included in the electronic book, but also a page tag for indicating the type of page may be provided for each page. For example, a first mark is set for the cover page, a second mark is set for the catalog page, a third mark is set for the text page, and different marks are used for distinguishing.

The page mark of each page can be set manually by a user uploading the electronic book, or rules which different types of pages should accord with can be preset by a management device, after the electronic book is obtained, the type of each page is automatically determined according to the rules which the book content on the page accords with, and the page mark of each page is set correspondingly. For example, a page including a book name, an author, and a publication date may be determined as a front cover, a page including titles such as "first chapter", "second chapter", and the like, and a page to the right of the title provided with a corresponding page number may be determined as a directory page.

The directory page comprises a plurality of titles, the plurality of titles have a hierarchical relationship, so that a plurality of levels of titles are formed, and each last level of title corresponds to at least one text page. The target page also comprises an index identifier of the first text page corresponding to each title, and the index identifier range corresponding to any title can be determined according to the target page.

In addition, other pages, such as a preamble page, a material page for showing related materials of the electronic book, an author introduction page, and the like, may be included in the electronic book in addition to the cover, the catalog page, and the body page.

302. The management device establishes a first corresponding relation in the database according to the text content and the index identification of each page in each electronic book.

After the management device collects the text content and the index identification of each page in at least one electronic book, according to the text content and the index identification of each page in each electronic book, a corresponding relation among the text contents in the pages corresponding to the electronic book, the index identification and the index identification is established, the corresponding relation is called as a first corresponding relation, and the text content of a certain page on a certain electronic book can be determined according to the first corresponding relation.

For example, the first correspondence established may be as shown in table 1 below.

TABLE 1

By establishing the first corresponding relation, the electronic book can be structurally processed, the electronic book is represented by text contents and index marks thereof, the electronic book and the index marks in the electronic book which the electronic book belongs to can be conveniently inquired according to a certain text content, and the inquiry speed is accelerated.

In one possible implementation, when storing the electronic books in the database, a unique book identifier may be assigned to each electronic book, and the book identifier may be a name, a number, or a storage address of the electronic book. In order to reduce the data amount of the first corresponding relationship, the electronic books in the first corresponding relationship may be represented in the form of book identifications, and the book identifications may be queried first according to the first corresponding relationship, and then the corresponding electronic books are obtained according to the book identifications.

303. The management device divides the text content of each page in each electronic book into words to obtain at least one word of each page.

304. The management device establishes a second corresponding relation in the database according to at least one vocabulary and the index mark of each page in each electronic book.

For each page of each electronic book, the text content of the page consists of words, the text content can be participled to obtain at least one word of the page, the electronic book to which the text content containing the at least one word belongs is the electronic book to which the word belongs, and the index mark of the page to which the text content containing the at least one word belongs is the index mark of the page to which the at least one word belongs. Therefore, a plurality of words of at least one electronic book can be acquired by word segmentation. The reverse index can be established according to at least one vocabulary in the page corresponding to the electronic book, the index mark and the index mark, so that the corresponding relation among the vocabulary, the electronic book to which the vocabulary belongs and the index mark of the page to which the vocabulary in the electronic book belongs can be established for each vocabulary, the corresponding relation is called as a second corresponding relation, and the page of the electronic book in which the certain vocabulary is positioned can be determined according to the second corresponding relation.

For example, the established second correspondence may be as shown in table 2 below.

TABLE 2

By establishing the second corresponding relation, a large number of vocabularies can be sorted, and the corresponding relation is established by taking the vocabularies as indexes, so that the corresponding electronic books and text contents can be conveniently inquired according to the vocabularies, targeted vocabulary inquiry is realized, and the inquiry speed is increased.

In a possible implementation manner, in order to reduce the data amount of the second corresponding relationship, the electronic book in the second corresponding relationship may be represented in the form of a book identifier, and the book identifier may be queried first according to the second corresponding relationship, and then the corresponding electronic book may be obtained according to the book identifier.

The method provided by the embodiment of the invention has the advantages that the text content and the index identification of each page in at least one electronic book are collected through the management device, the first corresponding relation is established in the database according to the text content and the index identification of each page in each electronic book, the text content of each page in each electronic book is participled to obtain at least one vocabulary of each page, the second corresponding relation is established in the database according to the at least one vocabulary and the index identification of each page in each electronic book, the text content of the electronic books is structured, the book content with clear and organized structures can be provided, a user only needs to select interested part of book content in the electronic book, the electronic books can be directly inquired according to the part of book content, and the operation is convenient and rapid.

Fig. 4 is a flowchart of a method for creating a database according to an embodiment of the present invention. An execution subject of the embodiment of the present invention is a management device, which may be an electronic device or a server in the embodiment shown in fig. 1 or fig. 2, and referring to fig. 4, the method includes:

401. the management device collects the images and the index identifications of each page in at least one electronic book, and performs feature extraction on the images of each page to obtain image features.

And for each page, acquiring the image of the page, and performing feature extraction on the image to obtain the image features of the page, so as to obtain the image features of a plurality of pages.

In a possible implementation manner, for the image of each page, a preset feature extraction algorithm may be adopted to perform feature extraction, so as to obtain image features. The preset feature extraction algorithm may be a feature extraction algorithm such as FAST From Accelerated Segmentation Test (FASTs) or hard (an angular point detection algorithm).

Alternatively, in order to improve the accuracy of the image features, a feature extraction model for extracting features of the image may be trained. The electronic equipment can apply the feature extraction model to extract the features of the image of each page to obtain the image features. For the training process of the feature extraction model, a plurality of sample images and the image features of each sample image can be obtained, and the feature extraction model is obtained by training according to the image features of the sample images and the image features of each sample image by adopting a preset training algorithm. The preset training algorithm can be a deep learning algorithm, a convolutional neural network algorithm or a cyclic neural network algorithm, and different models in different forms can be obtained by training through different preset training algorithms, such as a deep learning model, a convolutional neural network model or a cyclic neural network model.

For example, an Attention (key region division) algorithm may be further used to perform region-level feature extraction on the image of each page, a plurality of key regions in the image are obtained by performing key region division on the image, feature extraction is performed on each key region respectively by using a preset feature extraction algorithm to obtain an image feature of each key region, and the image features of the plurality of key regions form the image features of the page image.

In the real life, when an image of a certain book is shot, situations such as long-distance shooting, oblique shooting, inverted shooting, local shooting, high-exposure shooting, dark shooting, fuzzy shooting and the like may occur, and when image features of the image are matched, matching errors are easy to occur, so that the image features which are accurate enough need to be obtained. In the embodiment of the invention, the feature extraction model with stronger robustness can be obtained according to the training mode of the sample image, the accuracy of the image features can be improved, and the accuracy of the query result can be further improved.

402. And the management device establishes a third corresponding relation in the database according to the image characteristics and the index identification of each page in each electronic book.

After collecting the image features and the index identifications of each page in at least one electronic book, the management device establishes a corresponding relationship between the image features and the index identifications of the electronic book and the index identifications of the pages in the electronic book to which the pages corresponding to the image features and the image features belong according to the image features and the index identifications of each page in each electronic book, and the corresponding relationship is called a third corresponding relationship.

For example, the third correspondence relationship may be as shown in table 3 below.

TABLE 3

By establishing the third corresponding relation, the electronic book can be structurally processed, the electronic book is represented by the image characteristics and the index marks thereof, the query can be conveniently carried out according to the image characteristics of a certain image, the query can be carried out according to the text content in the electronic book, the query speed is increased, and the application range is expanded.

In a possible implementation manner, in order to reduce the data amount of the third corresponding relationship, the electronic books in the third corresponding relationship may be represented in the form of book identifications, and the book identifications may be queried first according to the third corresponding relationship, and then the corresponding electronic books are obtained according to the book identifications.

403. The management device clusters the collected image features of the pages to obtain a plurality of categories and central image features of each category.

404. The management device establishes a fourth correspondence in the database according to the central image feature of each category and the image feature within each category.

Since a large number of electronic books are stored in the database, each electronic book includes a plurality of pages, the image features of the plurality of pages can be collected by performing the above steps 401 and 402, and then the image features of a certain image can be matched with the image features in the database to query the electronic book to which the image belongs. When the number of the electronic books is large, the number of the image features is too large, so that the matching time is too long, and the query speed is too slow.

Therefore, the collected multiple image features can be clustered, the multiple image features are divided into multiple categories, each category includes at least one image feature, and pages corresponding to the image features in the same category can be pages containing the contents of the same kind of books. In addition, after clustering, the central image feature of each category can be determined, and the central image feature can be used as a visual vocabulary of the corresponding category to describe book contents in the corresponding category.

Then, according to the obtained multiple categories, the central image feature of each category, and the image feature included in each category, a corresponding relationship between the central image feature and the image feature in the category to which the central image feature belongs is established, which is referred to as a fourth corresponding relationship, and the image feature in the category to which each central image feature belongs can be determined according to the fourth corresponding relationship.

The clustering of the plurality of image features refers to a process of comparing the plurality of image features, dividing the plurality of image features into a plurality of categories according to whether the image features are similar, and determining a central image feature of each category after the clustering is completed, wherein the central image feature may be an average value or other statistical values of the plurality of image features in the category to which the central image feature belongs. The Clustering algorithm used in the Clustering process may be a K-means Clustering algorithm, DBSCAN (Density-based Clustering of Applications with Noise, Density-based Clustering method with Noise), OPTICS (Ordering Points To Identify the Clustering Structure, Density Clustering algorithm for identifying a Clustering Structure by point sorting), and the like.

For example, the fourth correspondence may be as shown in table 4 below.

TABLE 4

Center image feature	Image features
		Class 1: center image feature 1	Image feature 1, image feature 3, and image feature 4
Class 2: center image feature 2	Image feature 2, image feature 3, image feature 6
		Class 3: center image feature 3	Image feature 3, image feature 4, image feature 7

There are a large number of electronic books in the database, and each electronic book may contain various types of book contents such as text, characters, animals, plants, and the like in its page. In the embodiment of the invention, the limitation of the electronic books can be removed by imaging the pages, extracting the image characteristics and clustering the image characteristics, and the pages containing the book contents of the same type are classified into the same category aiming at a plurality of pages. If pages containing characters are classified as one, pages containing puppies are classified as one, and pages containing piglets are classified as one.

In the subsequent process, when the electronic book to which a certain image belongs is queried, the target image feature of the image does not need to be matched with all the image features in the database, the class similar to the target image feature is determined according to the central image feature of each class, and the target image feature is matched with the image features in the similar classes, so that the number of the image features needing to be matched is reduced, the calculation time is saved, and the query speed is accelerated.

It should be noted that the management apparatus in the embodiments shown in fig. 3 and fig. 4 may include an electronic device and a server.

In one scenario, the management device is a server. The server creates a database, collects the electronic books uploaded by each electronic device, performs structural processing on the electronic books and stores the electronic books in the database, and the database can be accessed by a plurality of electronic devices.

In another scenario, the management apparatus includes an electronic device and a server. The server creates a database, when each electronic device acquires any electronic book, the method provided by the embodiment of the invention can be executed to perform structural processing on the electronic book, establish a corresponding relation and upload the corresponding relation to the server, and the server stores the corresponding relation uploaded by each electronic device in the database for other electronic devices to access.

Combining the embodiments shown in fig. 3 and fig. 4, the operation flow of the embodiment of the present invention may be as shown in fig. 5, through which a database of electronic books is created, and then the electronic books may be queried in the database.

The method provided by the embodiment of the invention comprises the steps of collecting images and index identifications of each page in at least one electronic book through a management device, carrying out feature extraction on the images of each page to obtain image features, establishing a third corresponding relation in a database according to the image features and the index identifications of each page in each electronic book, clustering the collected image features of a plurality of pages to obtain a plurality of categories and central image features of each category, and establishing a fourth corresponding relation in the database according to the central image features of each category and the image features in each category. The index identification of the electronic book is imaged, the image of the page of the electronic book is structurally processed, the corresponding relation of image characteristics is established, a user only needs to select interested partial book content in the electronic book, the electronic book can be inquired according to the book image of the partial book content, and the operation is convenient and rapid.

Fig. 6 is a flowchart of an electronic book display method according to an embodiment of the present invention. The execution subject of the embodiment of the present invention is a management apparatus, and referring to fig. 6, the method includes:

601. the management apparatus displays a content input interface of the electronic book management application.

When the management device runs the electronic book management application, a management interface of the electronic book management application can be displayed, and the management interface can comprise various interfaces according to different realized functions.

The content input interface is used for inputting the content of the book to be inquired, and the content of the book to be inquired can be input through the content input interface, so that inquiry can be performed according to the content of the book. The content input interface may be a main interface of the electronic book management application, or may be an interface obtained by switching from the main interface.

In a possible implementation manner, when a triggering operation of the electronic book management application by a user is detected, the management device displays a main interface of the electronic book management application, the main interface includes an acquisition option for acquiring book content, and when a selection operation of the acquisition option is detected, the management device displays a content input interface of the electronic book management application.

The triggering operation on the electronic book management application may be a clicking operation on an application icon of the electronic book management application, or may be a clicking operation on a public identifier of the electronic book management application in an identifier list of an internet application.

602. The management device acquires book contents input through the content input interface.

After the management device displays the content input interface, a user can input book content on the content input interface, the book content is part of book content in the electronic books to be inquired, and the management device acquires the book content.

Considering that a user may obtain book contents through various ways, and thus the input book contents may include various types of images, texts, voices, etc., the content input interface may include at least one of a photographing option, an image selection option, a text input field, or a voice input option, thereby providing the user with different types of options for the user to input different types of book contents.

Accordingly, step 602 may include at least one of the following steps 6021-6024:

6021. when the content input interface comprises a shooting option, shooting the book content of the original book when the triggering operation of the shooting option is detected, and obtaining a book image; the book image is used as the book content, and/or the text content is extracted from the book image and used as the book content.

When extracting text content from the book image, performing text region detection on the book image, performing text recognition on the detected text region, extracting the text content from the book image to serve as book content, and subsequently querying the electronic book according to the book content.

In one possible implementation, a text region detection model and a text recognition model may be obtained. The text region detection model is used for detecting a text region of the image to obtain the text region. The text recognition model is used for performing text recognition on the image area to obtain text content.

After acquiring the book image, the management device detects the text region in the book image based on the text region detection model to obtain the text region. And performing text recognition on the text area based on the text recognition model to obtain text content.

In relation to the training process of the text region detection model, a plurality of sample images and text region identifiers in each sample image can be obtained, and a preset training algorithm is adopted to train according to the text region identifiers in the sample images and each sample image, so that the text region detection model is obtained. The preset training algorithm may be an FCN (full convolution network) algorithm, a deep learning algorithm, a convolutional neural network algorithm, or a cyclic neural network algorithm, and different models, such as an FCN detection model, a deep learning model, a convolutional neural network model, or a cyclic neural network model, may be obtained by training using different preset training algorithms.

In the training process of the text recognition model, a plurality of sample text regions can be obtained, and a preset training algorithm is adopted for training to obtain the text recognition model. The preset training algorithm can be a deep learning algorithm, a convolutional neural network algorithm or a cyclic neural network algorithm, and different models in different forms can be obtained by training through different preset training algorithms, such as a deep learning model, a convolutional neural network model or a cyclic neural network model.

When a user sees interesting book contents in the process of reading a certain original book, the book contents can be shot through the management device to obtain a book image containing the book contents, and then the electronic book can be inquired according to the book image, so that the conversion from the original book to the electronic book is realized.

6022. When the content input interface comprises an image selection option, acquiring a book image selected by a user in an image library when the triggering operation of the image selection option is detected; the book image is used as the book content, and/or the text content is extracted from the book image and used as the book content.

The difference from the step 6021 is that when the image selection option is triggered, the image library can be directly called to display the images stored in the image library for the user, and the user can select the book image to be queried from the image library without shooting.

The process of extracting text content from the book image is similar to the step 6021, and is not described herein again.

When a user takes a book image or other users share a book image with the user, the book image may be stored in the image library. And then, the user enters a content input interface of the electronic book management application, the book image can be imported by triggering the image selection option, and the electronic book can be inquired according to the book image to obtain the complete electronic book.

6023. When the content input interface comprises a text input field, acquiring the text content input in the text input field by the user as the book content.

In one possible implementation manner, the content input interface may include a text input field in which the user inputs text content and clicks the confirmation option after the input is completed, and when the management apparatus detects a click operation on the confirmation option, the management apparatus acquires the text content input in the text input field as the book content.

When a user sees a sentence of interest, the sentence can be input in the content input interface, and the electronic book to which the sentence belongs can be queried.

6024. When the content input interface comprises a voice input option, when the triggering operation of the voice input option is detected, recording voice content, and converting the voice content into text content serving as book content.

In another possible implementation manner, the triggering operation may be a long-press operation on the voice input option, and when the long-press operation on the voice input option by the user is detected, the voice content spoken by the user is recorded, and until the user stops the long-press operation, the recorded voice content is obtained, and is subjected to voice recognition, and the voice content is converted into text content, which is used as book content.

For example, as shown in fig. 7, the main interface of the electronic book management application includes a book content acquisition option "textbook self-study", and when a click operation on the book content acquisition option is detected, a content input interface as shown in fig. 8 is displayed, where the content input interface includes a lower shooting option and a lower left image selection option. The user can click the shooting option to shoot the book content of the original book, and the shot book image is used as the book content, or the user can click the image selection option and the book image selected in the image library is used as the book content.

603. The management device inquires the electronic book to which the book content belongs and the index identification of the page where the book content in the electronic book is located in the database.

The database comprises book contents in at least one electronic book and index marks of pages where the book contents are located in the at least one electronic book. When the management device obtains the book content to be queried, the book content may be matched with the book content of each electronic book on each page in the database, so as to determine the electronic book to which the book content belongs and the index identifier of the page in which the book content is located in the electronic book.

In a possible implementation manner, each electronic book may be structurally processed in the database, and a plurality of corresponding relationships of each electronic book are stored for a user to query. And, the query process is different according to the different types of the book contents.

In the first case, when the book content is text content, the book content includes at least one vocabulary, and then the query can be performed based on the vocabulary. Accordingly, step 603 may include the following steps 6031-6033:

6031. the management device inquires the text content corresponding to the at least one vocabulary according to the first corresponding relation and the second corresponding relation.

In order to facilitate the query of the electronic book in which the book content is located, the first corresponding relationship and the second corresponding relationship may be queried according to at least one vocabulary in the book content to obtain text content including any vocabulary, that is, in a plurality of electronic books, text content including the same vocabulary as the book content is screened out, and the book content may exist in the text content.

Optionally, this step 6031 includes:

(1) and for each vocabulary in the at least one vocabulary, the management device inquires the electronic book to which the vocabulary belongs and the index identification of the page in which the vocabulary is located in the electronic book according to the second corresponding relation.

(2) And according to the first corresponding relation, inquiring the electronic book to which the vocabulary belongs in the database and the text content corresponding to the index identifier of the page in the electronic book where the vocabulary belongs, wherein the text content is the text content containing the vocabulary.

6032. And determining the text content matched with the book content, the electronic book to which the text content belongs and the index identification of the page of the text content in the electronic book from the searched text content.

6033. And taking the determined electronic book as the electronic book to which the book content belongs, and taking the determined index mark as the index mark of the page where the book content in the electronic book is located.

After text contents containing the same vocabulary as the book contents are inquired, the book contents are respectively matched with the inquired text contents, the text contents matched with the book contents are determined, the text contents are the contents identical to the book contents, the electronic book to which the text contents belong is the electronic book to which the book contents belong, and the index identification of the page where the text contents in the electronic book belong is the index identification of the page where the book contents in the electronic book belong.

In a possible implementation manner, when content matching is performed, similarity between each text content in the at least one text content and book content may be respectively calculated, the calculated similarities are sorted from large to small, a text content with the highest similarity to the book content is determined from the plurality of text contents and is used as a text content matched with the book content, and according to the first corresponding relationship, an electronic book to which the text content belongs and an index identifier of a page of the electronic book to which the text content belongs are determined and are respectively used as an index identifier of the electronic book to which the book content belongs and an index identifier of a page of the electronic book in which the book content belongs.

In the second case, when the book content is a book image, the query may be performed based on the image characteristics of the book image. Accordingly, step 603 may include the following steps 6034-6036:

6034. the management device extracts the characteristics of the book image to obtain the target image characteristics of the book image.

The specific process of performing the feature extraction is similar to the step 401, and is not described herein again.

6035. And inquiring the image features matched with the target image features, the electronic books to which the pages corresponding to the image features belong and the index identifications of the pages corresponding to the image features in the electronic books according to the third corresponding relationship and the fourth corresponding relationship.

In order to facilitate the query of the electronic book in which the book content is located, the third corresponding relationship and the fourth corresponding relationship may be queried according to the target image feature of the book content to obtain a matched image feature, that is, pages similar to the book image are screened out from a plurality of electronic books, and the pages corresponding to the book image may exist in the pages.

Optionally, this step 6035 includes:

(1) and determining a central image feature similar to the target image feature and an image feature corresponding to the central image feature according to the fourth corresponding relation.

The fourth correspondence relationship includes a plurality of categories of central image features, and each central image feature corresponds to at least one image feature. In order to reduce the amount of calculation, the target image features are not matched with each image feature, but the target image features are matched with each central image feature in the fourth corresponding relationship, central image features similar to the target image features are determined from the central image features of multiple categories, namely the categories to which the target image features belong are determined, and the image features corresponding to the central image features are the image features belonging to the same category as the target image features. At this time, the image feature that is the same as the target image feature may be searched for in the category to which the target image feature belongs, and the image features in other categories may be filtered.

In one possible implementation manner, when the target image feature is matched with each central image feature in the fourth corresponding relationship, the similarity between each central image feature and the target image feature may be respectively calculated, the calculated similarities are arranged in a descending order, and the central image feature with the highest similarity to the target image feature is determined from the plurality of central image features as the central image feature similar to the target image feature.

(2) And determining the image features matched with the target image features from the image features corresponding to the central image features.

(3) And inquiring the electronic book and the index identification corresponding to the image features matched with the target image features according to the third corresponding relation.

When the center image feature corresponds to only one image feature, the image feature is taken as an image feature matching the target image feature. Or, when the central image feature corresponds to a plurality of image features, the central image feature indicates that the plurality of image features are included in the category to which the target image feature belongs, the similarity between each image feature and the target image feature is calculated, the calculated similarities are arranged in descending order, and the image feature with the highest similarity to the target image feature is determined from the plurality of image features and is used as the image feature matched with the target image feature. And then, according to the third corresponding relation, determining the electronic book and the index mark corresponding to the image feature matched with the target image feature.

6036. And taking the determined electronic book as the electronic book to which the book content belongs, and taking the determined index mark as the index mark of the page where the book content in the electronic book is located.

In another embodiment, a mode of combining the text content and the image feature may be adopted, and for the book content to be queried, the step 6031 and 6036 are executed simultaneously to query the electronic book to which the book content belongs and the index identifier of the page in the electronic book, so that the query result is more accurate.

604. The management device displays a book presentation interface of the electronic book management application.

The management interface of the electronic book management application may further include a book display interface for displaying book contents in the queried electronic book. In the embodiment of the invention, when the electronic book and the index identifier of the page where the book content in the electronic book is located are inquired, the management device switches from the content input interface to the display of the book display interface, and the book display interface comprises the book content corresponding to the index identifier, namely the book content on the page corresponding to the index identifier.

Pages in the electronic book can include various types of pages such as a front cover, a catalog page and a text page, and when the types of the pages where the book content to be inquired by a user is different, the book content to be checked is also different. Therefore, when the management device displays the book display interface, the page where the book content to be inquired is located is not directly displayed, but is displayed according to the type of the page where the book content is located.

In one possible implementation, when the index identifier of the page where the book content is located is the index identifier of the cover or the index identifier of the catalog page, it indicates that the book content is located on the cover or the catalog page, i.e., the book content is not the text content of the electronic book. Therefore, the user can be determined to make a query according to the book content in order to obtain a complete electronic book and know the approximate content in the electronic book. Therefore, the management device can display the catalog page in the book display interface for the user to view.

The electronic book may include one target page or a plurality of catalog pages, and when the electronic book includes only one catalog page, the management apparatus displays the catalog page in the book presentation interface. When the electronic book includes a plurality of catalog pages, whether the book contents are located in the first catalog page or other catalog pages, the first catalog page may be displayed in the book presentation interface in order to facilitate the user to view the catalog from scratch.

After the catalog pages are displayed in the book display interface, when the management device detects a sliding operation of the user, other catalog pages can be displayed according to the sliding operation so that the user can view the complete catalog. Or when the management device detects the selection operation of any title in the directory page, judging whether the selected title is the last-level title or not, and if the selected title is the last-level title, displaying the first text page corresponding to the last-level title in the book display interface so that the user can read the text content corresponding to the last-level title from the beginning. And if the selected title is not the last-level title, displaying at least one next-level title of the selected title in the book display interface so that the user can know the hierarchical relationship among the titles and select the last-level title which is expected to read the text content.

For example, as shown in fig. 9, the book display interface may display a catalog page in the book display interface, each non-last-level title corresponds to one expansion option, by clicking the expansion option, a next-level title that is not a last-level title may be displayed on the book display interface until the book display interface displays the last-level title, and the user may manually click any last-level title to select the text content to be read. And after the last-level title is displayed, the expansion option of the non-last-level title is converted into a hiding option, and the user can hide the next-level title of the non-last-level title by clicking the hiding option.

In another possible implementation manner, when the index identifier of the page where the book content is located is the index identifier of the text page, which indicates that the book content is the text content of the electronic book, it may be determined that the user performs a query according to the book content, not only to obtain a complete electronic book, but also wants to know the content in the text and the text of the book content. Therefore, the management device determines the last-level title to which the text page belongs, the text content under the last-level title can be regarded as the front and back text content of the book content, and the management device displays the first text page corresponding to the last-level title in the book display interface in order to facilitate the user to read from the beginning.

In the catalog page of the electronic book, each last-level title corresponds to an index identification range, and the index identification range comprises at least one index identification for representing the index identification of at least one text page corresponding to the last-level title. Therefore, when the index identifier of the page where the book content is located is the index identifier of the text page, the last-stage title corresponding to the index identifier is determined, and the text page corresponding to the first index identifier in the index identifier range corresponding to the last-stage title is the first text page corresponding to the last-stage title.

When the management device displays the book content on the book display interface, the displayed book content may be the same as the book content acquired by the management device before viewed from the foreground interface, but the book content displayed on the book display interface is extracted from the electronic book by the management device after the management device acquires the complete electronic book. Therefore, based on the displayed book content, other book contents of the electronic book can also be displayed.

Then after step 604 above, the method may further comprise the following steps 605 or 606:

605. when the book content is displayed on the book display interface, when a sliding operation of a user is detected, other book content in the electronic book is displayed according to the sliding operation.

For example, when the slide operation is the upward slide operation, the book content in the range corresponding to the slide distance after the currently displayed book content is determined based on the slide distance of the slide operation, and the newly determined book content may be displayed. Alternatively, when the slide operation is a downward slide operation, the book content in the range corresponding to the slide distance before the currently displayed book content may be determined according to the slide distance of the slide operation, and the newly determined book content may be displayed.

Alternatively, when the slide operation is the upward slide operation, the book content in the page immediately preceding the current page is displayed, or when the slide operation is the downward slide operation, the book content in the page immediately following the current page is displayed.

In this way, the user can not only view the book content desired to be searched, but also view other book contents in the electronic book by sliding up and down.

606. The book display interface comprises an exit option, when confirmation operation of the exit option is detected, a main interface of the book management application is displayed, and the main interface comprises book identification of the electronic book. And when the selection operation of the book mark is detected, the book content displayed last time when the book display interface is exited can be continuously displayed in the book display interface.

In addition, when the book content is displayed in the book display interface, the user can learn based on the book content. That is, after the step 604, the method may further include the following steps 607 or 608:

607. the book display interface further includes a learning option, and when the management apparatus detects a confirmation operation for the learning option, an operation corresponding to the learning option is performed based on the content of the book displayed in the book display interface.

The learning option is used to trigger a learning operation on the book content. Different learning options may be provided depending on the learning operations that may be performed. For example, for an english lesson, the learning operations that can be performed include reading after, dictating words, etc., and accordingly, reading after options, dictating words options, etc. can be displayed in the book display interface.

After reading the book content, if the user wants to learn based on the book content, the user can trigger the corresponding learning option, and at this time, the management device can help the user to learn by interacting with the user.

608. The book display interface further comprises a learning option and selection options of a plurality of paragraphs in the book content, when a confirmation operation on any selection option is detected, the paragraph corresponding to the confirmed selection option is determined as the book content to be learned, and when the confirmation operation on the learning option is detected, the operation corresponding to the learning option is executed based on the book content to be learned.

The book content may include a plurality of paragraphs, so that in order to facilitate a user to learn based on certain paragraphs, when the book display interface displays the book content, a selection option may be displayed for each paragraph, and when the user wishes to learn any paragraph, a confirmation operation on the selection option may be triggered, and then a confirmation operation on the learning option may be triggered. When the management device detects the confirmation operation of any selection option, the management device determines the paragraph corresponding to the confirmed selection option as the book content to be learned, and when the confirmation operation of the learning option is detected, the management device can execute the operation corresponding to the learning option based on the book content to be learned, and other paragraphs do not need to be considered in the learning process.

For example, the book contents displayed in the book presentation interface have words and texts, and learning options and selection options for each paragraph are also displayed, as shown in fig. 10 and 11. When the confirmation operation for any one of the selection options has not been detected, the learning option "start learning" is in a non-selectable state. When a confirmation operation of the selection option of the first paragraph of the text is detected, the paragraph is determined as a paragraph to be learned by the user, and the learning option "start learning" is in a selectable state. When the confirmation operation of the learning option 'start learning' is detected, a follow-up reading interface is displayed, and the user can carry out follow-up reading learning based on the selected paragraph.

As shown in fig. 12, the read-after interface does not directly display a complete paragraph, but only displays one sentence at a time, and also displays a pronunciation button and a read-after option "click to start read-after", when the user clicks the pronunciation button, the management device can send out a voice corresponding to the sentence, and after the user listens to the voice, the user clicks the read-after option "click to start read-after", so that the read-after operation can be performed, and the voice corresponding to the sentence is repeated.

It should be noted that the management apparatus in the embodiment shown in fig. 6 may include an electronic device and a server.

In one scenario, a server stores a database, an electronic device displays a management interface of an electronic book management application, a user can input book content to be inquired on the electronic device and sends an inquiry request carrying the book content to the server, the server inquires an electronic book to which the book content belongs and an index identifier of a page where the electronic book content belongs in the database after receiving the inquiry request, the electronic book content corresponding to the index identifier is obtained and then returned to the electronic device, the electronic device is displayed to the user, and the user can learn based on the electronic book.

In another scenario, the server creates a database according to the collected electronic books, and issues the database to the plurality of electronic devices. When a user inputs book content to be inquired on the electronic device, the electronic device can inquire the electronic book to which the book content belongs and the index identification of the page where the electronic book content is located in the database, obtain the book content corresponding to the index identification, display the book content to the user, and the user can learn based on the electronic book.

With reference to the embodiment shown in fig. 6, an operation flow according to an embodiment of the present invention may be as shown in fig. 13, and through the operation flow, according to the book content acquired in the content input interface of the electronic book management application, the electronic book to which the book content belongs and the book content on the page where the book content is located in the electronic book may be displayed.

According to the method provided by the embodiment of the invention, the content of the book input through the content input interface is obtained by displaying the content input interface of the electronic book management application, the electronic book to which the content of the book belongs is inquired in the database, the book display interface of the electronic book management application is displayed, and the content of the electronic book is displayed on the book display interface. The embodiment of the invention provides the function of inquiring the electronic books according to the contents of the books, expands the application range, can inquire the complete electronic books according to the contents of partial books without knowing the description information of the electronic books by a user, is convenient and quick to operate and has lower information storage requirement on the user.

On the basis of the embodiments shown in fig. 3, 4 and 6, an exemplary operation flow is further provided in an embodiment of the present invention, and includes:

1. and the manager uploads the electronic books to a database of the server, and the book contents of the electronic books are stored in the database. The book content in the electronic book is divided according to pages and includes an index mark of each page.

2. When a user sees a section of interesting book content, the book content is shot through the electronic equipment, a photo containing the book content is obtained, and the photo is sent to the server.

3. And the server queries in the database according to the text content and the image characteristics in the photo to obtain the electronic book containing the book content and the index identification of the page where the book content is located.

4. And the server sends the electronic book and the index identification to the electronic equipment, and the electronic equipment displays the book content on the page corresponding to the index identification.

The user can also view the book contents, and can also display other book contents before or after the current book contents through a sliding operation, and perform a learning process such as reading, reading after or reciting according to the displayed book contents.

Fig. 14 is a schematic structural diagram of an ebook display device according to an embodiment of the present invention, and referring to fig. 14, the device includes:

a first display module 1401, configured to perform the steps of displaying a content input interface of the electronic book management application in the foregoing embodiment;

an obtaining module 1402, configured to perform the steps of obtaining book content input through a content input interface in the foregoing embodiments;

a query module 1403, configured to perform the step of querying, in the database, the electronic book to which the book content belongs in the foregoing embodiment;

a second display module 1404, configured to perform the steps of displaying the book display interface of the electronic book management application in the above embodiments.

Optionally, the query module 1403 is configured to perform the steps of querying the electronic book and the index identifier in the above embodiment;

optionally, the second display module 1404 includes:

the display unit is used for displaying the catalogue pages in the book display interface when the index marks are the index marks of the front cover or the index marks of the catalogue pages in the embodiment; or when the index mark is the index mark of the text page, determining the last-level title of the text page, and displaying the first text page corresponding to the last-level title in the book display interface.

Optionally, the apparatus further comprises:

a third display module, configured to perform, when a selection operation on any title in the directory page is detected in the above embodiment, if the selected title is a last-level title, a step of displaying, in the book display interface, a first text page corresponding to the last-level title;

and a fourth display module, configured to perform the step of displaying, in the book display interface, a next-level title of the selected title if the selected title is not the last-level title in the foregoing embodiment.

Optionally, the apparatus further comprises:

and the execution module is used for executing the steps of executing the operation corresponding to the learning option in the embodiment.

Optionally, the obtaining module 1402 comprises at least one of:

the shooting unit is used for shooting the book content of the original book to obtain a book image when the triggering operation of the shooting option is detected in the embodiment;

the selection unit is used for acquiring the book image selected by the user in the image library when the triggering operation of the image selection option is detected in the embodiment;

a text input unit, configured to perform the step of acquiring text content input by the user in the text input field in the above embodiment;

and the voice input unit is used for recording the voice content and converting the voice content into the text content when the triggering operation of the voice input option is detected in the embodiment.

Optionally, the apparatus further comprises:

the first collecting module is used for executing the step of collecting the text content and the index identification of each page in at least one electronic book in the embodiment;

a first establishing module, configured to perform the step of establishing a first corresponding relationship in a database according to the text content and the index identifier of each page in each electronic book in the foregoing embodiment;

the word segmentation module is used for performing the step of segmenting the text content of each page in each electronic book to obtain at least one word of each page in the embodiment;

and the second establishing module is used for executing the step of establishing the second corresponding relation in the database according to at least one vocabulary and the index identification of each page in each electronic book in the embodiment.

Optionally, the query module 1403 further includes:

the query unit is used for executing the step of querying the text content corresponding to at least one vocabulary according to the first corresponding relation and the second corresponding relation when the book content comprises at least one vocabulary in the embodiment;

a first determining unit, configured to perform a step of determining, from the queried text contents in the above embodiment, a text content that matches the book content, an electronic book to which the text content belongs, and an index identifier of a page in the electronic book where the text content is located;

a second determining unit, configured to perform the steps of taking the determined electronic book as the electronic book to which the book content belongs and taking the determined index identifier as the index identifier of the page in the electronic book where the book content is located in the electronic book in the above embodiment.

Optionally, the query unit is further configured to query, according to the second correspondence in the foregoing embodiment, an electronic book to which the vocabulary belongs and an index identifier of a page in which the vocabulary in the electronic book is located; and inquiring the text content corresponding to the electronic book and the index identification according to the first corresponding relation.

Optionally, the first determining unit is further configured to calculate a similarity between each text content and the book content when the plurality of text contents are queried in the above embodiment; and determining the text content with the maximum similarity with the book content from the plurality of text contents as the text content matched with the book content, and determining the electronic book to which the text content belongs and the index mark of the page where the text content is located in the electronic book.

Optionally, the apparatus further comprises:

the second collecting module is used for collecting the image and the index identification of each page in at least one electronic book in the embodiment, and performing feature extraction on the image of each page to obtain the image features;

a third establishing module, configured to perform the step of establishing a third corresponding relationship in the database according to the image feature and the index identifier of each page in each electronic book in the foregoing embodiment;

the clustering module is used for clustering the collected image characteristics of the plurality of pages in the embodiment to obtain a plurality of categories and the central image characteristics of each category;

a fourth establishing module, configured to execute the step of establishing a fourth corresponding relationship in the database according to the central image feature of each category and the image feature in each category in the foregoing embodiment.

Optionally, the query module 1403 further includes:

the characteristic extraction unit is used for performing the step of extracting the characteristics of the book image to obtain the target image characteristics of the book image when the book content comprises the book image in the embodiment;

the query unit is configured to perform the step of querying, according to the third corresponding relationship and the fourth corresponding relationship in the above embodiment, the image features matched with the target image features, the electronic books to which the pages corresponding to the image features belong, and the index identifiers of the pages corresponding to the image features in the electronic books;

and the determining unit is used for executing the steps that the determined electronic book is taken as the electronic book to which the book content belongs and the determined index mark is taken as the index mark of the page where the book content is located in the electronic book in the embodiment.

Optionally, the second querying unit is further configured to determine, according to the fourth corresponding relationship in the foregoing embodiment, a central image feature similar to the target image feature and an image feature corresponding to the central image feature; determining image features matched with the target image features from the image features corresponding to the central image features; and inquiring the electronic books and the index identifications corresponding to the image features according to the third corresponding relation.

Optionally, the second querying unit is further configured to calculate a similarity between each image feature and the target image feature when the plurality of image features are obtained in the above embodiment; and a step of determining, from the plurality of image features, an image feature having the greatest similarity to the target image feature as an image feature matching the target image feature.

It should be noted that: in the electronic book display device provided in the above embodiment, when displaying an electronic book, only the division of the above functional modules is taken as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the management device is divided into different functional modules to complete all or part of the above described functions. In addition, the electronic book display device provided by the above embodiment and the electronic book display method embodiment belong to the same concept, and specific implementation processes thereof are detailed in the method embodiment and are not described herein again.

Fig. 15 shows a block diagram of an electronic device 1500 according to an exemplary embodiment of the present invention. The electronic device 1500 may be a portable mobile electronic device, such as: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion Picture Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion Picture Experts compression standard Audio Layer 4), a notebook computer, a desktop computer, a head-mounted device, or any other intelligent electronic device. Electronic device 1500 may also be referred to by other names as user equipment, portable electronic device, laptop electronic device, desktop electronic device, and so on.

In general, electronic device 1500 includes: a processor 1501 and memory 1502.

Processor 1501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, or the like. The processor 1501 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). Processor 1501 may also include a main processor and a coprocessor, where the main processor is a processor for processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 1501 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, processor 1501 may also include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.

The memory 1502 may include one or more computer-readable storage media, which may be non-transitory. The memory 1502 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 1502 is used to store at least one instruction for being possessed by processor 1501 to implement the ebook display method provided by method embodiments herein.

In some embodiments, the electronic device 1500 may further include: a peripheral interface 1503 and at least one peripheral. The processor 1501, memory 1502, and peripheral interface 1503 may be connected by buses or signal lines. Various peripheral devices may be connected to peripheral interface 1503 via buses, signal lines, or circuit boards. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1504, a display 1505, a camera assembly 1506, an audio circuit 1507, a positioning assembly 1508, and a power supply 1509.

The peripheral interface 1503 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 1501 and the memory 1502. In some embodiments, the processor 1501, memory 1502, and peripheral interface 1503 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1501, the memory 1502, and the peripheral interface 1503 may be implemented on separate chips or circuit boards, which is not limited in this embodiment.

The Radio Frequency circuit 1504 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuitry 1504 communicates with communication networks and other communication devices via electromagnetic signals. The radio frequency circuit 1504 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1504 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuitry 1504 can communicate with other electronic devices via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 8G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the radio frequency circuit 1504 may also include NFC (Near Field Communication) related circuits, which are not limited in this application.

The display screen 1505 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 1505 is a touch display screen, the display screen 1505 also has the ability to capture touch signals on or over the surface of the display screen 1505. The touch signal may be input to the processor 1501 as a control signal for processing. In this case, the display screen 1505 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display 1505 may be one, providing the front panel of the electronic device 1500; in other embodiments, the display 1505 may be at least two, each disposed on a different surface of the electronic device 1500 or in a folded design; in still other embodiments, the display 1505 may be a flexible display disposed on a curved surface or a folded surface of the electronic device 1500. Even further, the display 1505 may be configured in a non-rectangular irregular pattern, i.e., a shaped screen. The Display 1505 can be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and other materials.

The camera assembly 1506 is used to capture images or video. Optionally, the camera assembly 1506 includes a front camera and a rear camera. Generally, a front camera is disposed on a front panel of an electronic apparatus, and a rear camera is disposed on a rear surface of the electronic apparatus. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 1506 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.

The audio circuitry 1507 may include a microphone and speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 1501 for processing or inputting the electric signals to the radio frequency circuit 1504 to realize voice communication. For stereo capture or noise reduction purposes, multiple microphones may be provided, each at a different location of the electronic device 1500. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 1501 or the radio frequency circuit 1504 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, the audio circuitry 1507 may also include a headphone jack.

The positioning component 1508 is configured to locate a current geographic Location of the electronic device 1500 to implement navigation or LBS (Location Based Service). The Positioning component 1508 may be a Positioning component based on the united states GPS (Global Positioning System), the chinese beidou System, the russian graves System, or the european union's galileo System.

The power supply 1509 is used to supply power to the various components in the electronic device 1500. The power supply 1509 may be alternating current, direct current, disposable or rechargeable. When the power supply 1509 includes a rechargeable battery, the rechargeable battery may support wired charging or wireless charging. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, the electronic device 1500 also includes one or more sensors 1510. The one or more sensors 1510 include, but are not limited to: acceleration sensor 1511, gyro sensor 1512, pressure sensor 1513, fingerprint sensor 1514, optical sensor 1515, and proximity sensor 1516.

The acceleration sensor 1511 may detect the magnitude of acceleration on three coordinate axes of a coordinate system established with the electronic apparatus 1500. For example, the acceleration sensor 1511 may be used to detect components of the gravitational acceleration in three coordinate axes. The processor 1501 may control the display screen 1505 to display the user interface in a landscape view or a portrait view based on the gravitational acceleration signal collected by the acceleration sensor 1511. The acceleration sensor 1511 may also be used for acquisition of motion data of a game or a user.

The gyroscope sensor 1512 may detect a body direction and a rotation angle of the electronic device 1500, and the gyroscope sensor 1512 and the acceleration sensor 1511 may cooperate to collect a 3D motion of the user on the electronic device 1500. The processor 1501 may implement the following functions according to the data collected by the gyro sensor 1512: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.

The pressure sensor 1513 may be disposed on a side bezel of the electronic device 1500 and/or underneath the display 1505. When the pressure sensor 1513 is disposed on the side frame of the electronic device 1500, the holding signal of the user to the electronic device 1500 may be detected, and the processor 1501 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 1513. When the pressure sensor 1513 is disposed at a lower layer of the display screen 1505, the processor 1501 controls the operability control on the UI interface in accordance with the pressure operation of the user on the display screen 1505. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.

The fingerprint sensor 1514 is configured to capture a fingerprint of the user, and the processor 1501 identifies the user based on the fingerprint captured by the fingerprint sensor 1514, or the fingerprint sensor 1514 identifies the user based on the captured fingerprint. Upon recognizing that the user's identity is a trusted identity, the user is authorized by processor 1501 to have relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying for and changing settings, etc. The fingerprint sensor 1514 may be disposed on the front, back, or side of the electronic device 1500. When a physical key or vendor Logo is provided on the electronic device 1500, the fingerprint sensor 1514 may be integrated with the physical key or vendor Logo.

The optical sensor 1515 is used to collect ambient light intensity. In one embodiment, processor 1501 may control the brightness of display screen 1505 based on the intensity of ambient light collected by optical sensor 1515. Specifically, when the ambient light intensity is high, the display brightness of the display screen 1505 is increased; when the ambient light intensity is low, the display brightness of the display screen 1505 is adjusted down. In another embodiment, the processor 1501 may also dynamically adjust the shooting parameters of the camera assembly 1506 based on the ambient light intensity collected by the optical sensor 1515.

A proximity sensor 1516, also referred to as a distance sensor, is typically provided on the front panel of the electronic device 1500. The proximity sensor 1516 is used to capture the distance between the user and the front of the electronic device 1500. In one embodiment, the processor 1501 controls the display 1505 to switch from the bright screen state to the dark screen state when the proximity sensor 1516 detects that the distance between the user and the front of the electronic device 1500 is gradually decreased; when the proximity sensor 1516 detects that the distance between the user and the front of the electronic device 1500 gradually becomes larger, the processor 1501 controls the display 1505 to switch from the breath-screen state to the bright-screen state.

Those skilled in the art will appreciate that the configuration shown in FIG. 15 is not intended to be limiting of electronic device 1500, and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components may be used.

Fig. 16 is a schematic structural diagram of a server according to an embodiment of the present invention, where the server 1600 may generate a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 1601 and one or more memories 1602, where the memory 1602 stores at least one instruction, and the at least one instruction is loaded and executed by the processors 1601 to implement the methods provided by the above method embodiments. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input/output interface, so as to perform input/output, and the server may also include other components for implementing the functions of the device, which are not described herein again.

The server 1600 may be configured to perform the steps performed by the management apparatus in the electronic book display method.

An embodiment of the present invention further provides an electronic book display device, which includes a processor and a memory, where the memory stores at least one instruction, at least one program, a code set, or an instruction set, and the instruction, the program, the code set, or the instruction set is loaded by the processor and has an operation performed in the electronic book display method for implementing the above embodiment.

An embodiment of the present invention further provides a computer-readable storage medium, in which at least one instruction, at least one program, a code set, or a set of instructions is stored, and the instruction, the program, the code set, or the set of instructions is loaded by a processor and has an operation performed in the electronic book display method to implement the above-described embodiment.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only a preferred embodiment of the present invention, and should not be taken as limiting the invention, and any modifications, equivalents, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. An ebook display method, the method comprising:

2. The method according to claim 1, wherein said querying, in the database, the electronic book to which the book content belongs comprises:

inquiring the electronic book to which the book content belongs and the index identification of the page in the electronic book where the book content is located in the database; the book display interface comprises book contents corresponding to the index marks in the electronic books.

3. The method of claim 2, wherein the electronic book comprises a cover, a catalog page and a body page, the catalog page comprising a plurality of levels of headings, and each last level of headings corresponds to at least one body page;

the book display interface displaying the electronic book management application includes:

when the index identification is the index identification of the cover or the index identification of the catalog page, displaying the catalog page in the book display interface; or,

and when the index identification is the index identification of the text page, determining the last-level title to which the text page belongs, and displaying the first text page corresponding to the last-level title in the book display interface.

4. The method of claim 3, wherein after displaying the catalog page in the book presentation interface, the method further comprises:

when the selection operation of any title in the directory page is detected, if the selected title is the last-level title, displaying a first text page corresponding to the last-level title in the book display interface;

and if the selected title is not the last-level title, displaying the next-level title of the selected title in the book display interface.

5. The method of claim 1, further comprising:

the book display interface further comprises a learning option, and when the confirming operation of the learning option is detected, the operation corresponding to the learning option is executed based on the book content; or,

the book display interface further comprises a learning option and selection options of a plurality of paragraphs in the book content, when a confirmation operation on any selection option is detected, the paragraph corresponding to the confirmed selection option is determined as the book content to be learned, and when the confirmation operation on the learning option is detected, the operation corresponding to the learning option is executed based on the book content to be learned.

6. The method of claim 1, wherein the obtaining of the book content input through the content input interface comprises at least one of:

the content input interface comprises a shooting option, and when the triggering operation of the shooting option is detected, the book content of an original book is shot to obtain a book image; taking the book image as the book content, and/or extracting text content from the book image as the book content;

the content input interface comprises an image selection option, and when the triggering operation of the image selection option is detected, the book image selected by the user in the image library is acquired; taking the book image as the book content, and/or extracting text content from the book image as the book content;

the content input interface comprises a text input field, and text content input in the text input field by a user is obtained and used as the book content;

the content input interface comprises a voice input option, and when the triggering operation of the voice input option is detected, voice content is recorded and converted into text content to serve as the book content.

7. The method according to claim 2 or 6, wherein before querying the electronic book to which the book content belongs and the index of the page of the electronic book where the book content is located in the database, the method further comprises:

collecting text content and index identification of each page in the at least one electronic book;

establishing a first corresponding relation in the database according to the text content and the index identification of each page in each electronic book, wherein the first corresponding relation is the corresponding relation among the electronic book, the index identification and the text content in the page corresponding to the index identification;

performing word segmentation on the text content of each page in each electronic book to obtain at least one word of each page;

and establishing a second corresponding relation in the database according to at least one vocabulary and the index identification of each page in each electronic book, wherein the second corresponding relation is the corresponding relation among the vocabulary, the electronic book to which the vocabulary belongs and the index identification of the page in which the vocabulary belongs in the electronic book.

8. The method according to claim 7, wherein the querying, in the database, the electronic book to which the book content belongs and the index identifier of the page of the electronic book on which the book content is located comprises:

when the book content comprises at least one vocabulary, inquiring text content corresponding to the at least one vocabulary according to the first corresponding relation and the second corresponding relation;

determining text content matched with the book content, an electronic book to which the text content belongs and an index mark of a page where the text content is located in the electronic book from the inquired text content;

and taking the determined electronic book as the electronic book to which the book content belongs, and taking the determined index mark as the index mark of the page in the electronic book where the book content is located.

9. The method according to claim 8, wherein said querying the text content corresponding to the at least one vocabulary according to the first corresponding relationship and the second corresponding relationship comprises:

for each vocabulary in the at least one vocabulary, inquiring the electronic book to which the vocabulary belongs and the index identification of the page in which the vocabulary is located in the electronic book according to the second corresponding relation;

and inquiring the text content corresponding to the electronic book and the index identification according to the first corresponding relation.

10. The method of claim 8, wherein determining, from the queried text contents, a text content matching the book content, an electronic book to which the text content belongs, and an index identifier of a page in the electronic book where the text content is located comprises:

when a plurality of text contents are inquired, calculating the similarity between each text content and the book content;

and determining the text content with the maximum similarity with the book content from the plurality of text contents as the text content matched with the book content, and determining the electronic book to which the text content belongs and the index identification of the page of the text content in the electronic book.

11. The method according to claim 2 or 6, wherein before querying the electronic book to which the book content belongs and the index of the page of the electronic book where the book content is located in the database, the method further comprises:

collecting the image and the index identification of each page in the at least one electronic book, and performing feature extraction on the image of each page to obtain image features;

establishing a third corresponding relation in the database according to the image characteristics and the index identification of each page in each electronic book, wherein the third corresponding relation is the corresponding relation among the image characteristics, the electronic book to which the page corresponding to the image characteristics belongs and the index identification of the page in the electronic book;

clustering the collected image features of the multiple pages to obtain multiple categories and central image features of each category, wherein each category comprises the image features of at least one page;

and establishing a fourth corresponding relation in the database according to the central image features of each category and the image features in each category, wherein the fourth corresponding relation is the corresponding relation between the central image features and the image features in the category to which the central image features belong.

12. The method according to claim 11, wherein the querying, in the database, the electronic book to which the book content belongs and the index identifier of the page of the electronic book on which the book content is located includes:

when the book content comprises a book image, performing feature extraction on the book image to obtain target image features of the book image;

inquiring image features matched with the target image features, an electronic book to which pages corresponding to the image features belong, and index identifications of the pages corresponding to the image features in the electronic book according to the third corresponding relationship and the fourth corresponding relationship;

13. The method according to claim 12, wherein the querying, according to the third corresponding relationship and the fourth corresponding relationship, for the image feature matched with the target image feature, the electronic book to which the page corresponding to the image feature belongs, and the index identifier of the page corresponding to the image feature in the electronic book includes:

according to the fourth corresponding relation, determining a central image feature similar to the target image feature and an image feature corresponding to the central image feature;

determining image features matched with the target image features from the image features corresponding to the central image features;

and inquiring the electronic books and the index identifications corresponding to the image features according to the third corresponding relation.

14. The method of claim 13, wherein determining the image feature matching the target image feature from the image features corresponding to the center image feature comprises:

when a plurality of image features are acquired, calculating the similarity between each image feature and the target image feature;

and determining the image feature with the maximum similarity with the target image feature from the plurality of image features as the image feature matched with the target image feature.

15. An electronic book display device, the device comprising:

and the second display module is used for displaying a book display interface of the electronic book management application, wherein the book display interface comprises book contents corresponding to the index identification.