CN111523343B - Reading interaction method, device, equipment, server and storage medium - Google Patents
Reading interaction method, device, equipment, server and storage medium Download PDFInfo
- Publication number
- CN111523343B CN111523343B CN201910040221.4A CN201910040221A CN111523343B CN 111523343 B CN111523343 B CN 111523343B CN 201910040221 A CN201910040221 A CN 201910040221A CN 111523343 B CN111523343 B CN 111523343B
- Authority
- CN
- China
- Prior art keywords
- information
- reading
- text content
- user
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/04—Electrically-operated educational appliances with audible presentation of the material to be studied
Abstract
The invention discloses a reading interaction method, a reading interaction device, reading interaction equipment, a server and a storage medium. The method comprises the following steps: acquiring image information of a current reading page, and identifying text content in the image information, wherein the image information is captured by a camera on the point reading equipment; determining key knowledge information in the text content; and determining the interactive questions corresponding to the current reading page based on a preset interactive question bank and the key knowledge information, and sending the interactive questions for playing. By utilizing the method, through the problem interaction with the reading user in the reading process, the interestingness of the user in the reading process is enhanced, the enthusiasm of the user for actively thinking in the reading process is also enhanced, and therefore the reading effect of improving the reading interest of the user and the divergent thinking capability of the user is achieved.
Description
Technical Field
The embodiment of the invention relates to the technical field of data interaction, in particular to a reading interaction method, a reading interaction device, reading interaction equipment, a server and a storage medium.
Background
When a user reads a book, the whole reading process of the user is boring and low in interactivity due to the single display mode of the content of the book, so that the user is prevented from reading the book.
In addition, the user often only reads the contents provided on the book, and is difficult to actively think and explore in reading, which is not beneficial to the divergent thinking of the user in reading, thereby affecting the reading effect of the user in reading the book.
Disclosure of Invention
The embodiment of the invention provides a reading interaction method, a reading interaction device, reading interaction equipment, a server and a storage medium, so that reading interaction is carried out when a user reads, and the reading interestingness of the user in reading is enhanced.
In a first aspect, an embodiment of the present invention provides a reading interaction method, including:
acquiring image information of a current reading page, and identifying text content in the image information;
determining key knowledge information in the text content;
and determining the interactive questions corresponding to the current reading page based on a preset interactive question bank and the key knowledge information, and sending the interactive questions for playing.
In a second aspect, an embodiment of the present invention further provides a reading interaction device, including:
the information acquisition module is used for acquiring the image information of the current reading page and identifying the text content in the image information;
the key information determining module is used for determining key knowledge information in the text content;
and the interactive question determining module is used for determining the interactive question corresponding to the current reading page based on a preset interactive question bank and the key knowledge information, and sending the interactive question and playing the interactive question.
In a third aspect, an embodiment of the present invention further provides a point reading device, including:
the main body, the controller and the wireless network module which are positioned in the main body, and the sound pickup device, the sound production device, the camera and the touch screen which are nested on the main body, wherein the main body is arranged on a carrier on which reading materials are arranged,
the controller is configured to control at least one of: the pickup device, the sound production device, the camera and the touch screen execute corresponding work and are also used for realizing the reading interaction method provided by the embodiment of the invention;
the sound pickup device is used for collecting audio information, and the audio information comprises reply information of a user;
the pronunciation device is used for playing audio information;
the camera is used for capturing image information, and the image information comprises reading pages in the reading material;
the touch screen is used for displaying information.
In a fourth aspect, an embodiment of the present invention further provides a server, including:
one or more processors;
storage means for storing one or more programs;
the one or more programs are executed by the one or more processors, so that the one or more processors implement the reading interaction method provided by the embodiment of the invention.
In a fifth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the reading interaction method provided in the embodiment of the present invention.
The embodiment of the invention provides a reading interaction method, a reading interaction device, reading interaction equipment, a server and a storage medium, wherein the method comprises the following steps: the method comprises the steps of obtaining image information of a current reading page, identifying text content in the image information, determining key knowledge information in the text content, determining interaction problems corresponding to the current reading page based on preset knowledge information and the key knowledge information, and sending the interaction problems to a point reading device for playing. By utilizing the method, through the problem interaction with the reading user in the reading process, the interestingness of the user in the reading process is enhanced, the enthusiasm of the user for actively thinking in the reading process is also enhanced, and therefore the reading effect of improving the reading interest of the user and the divergent thinking capability of the user is achieved.
Drawings
Fig. 1 is a schematic flowchart illustrating a reading interaction method according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a reading interaction method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a reading interaction device according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a point-to-read apparatus according to a fourth embodiment of the present invention;
fig. 5 is a schematic structural diagram of a server according to a fifth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Example one
Fig. 1 is a schematic flow chart of a reading interaction method according to an embodiment of the present invention, where the method is suitable for a situation where a user needs to perform reading interaction when reading, and the method may be executed by a reading interaction device, where the device may be implemented by software and/or hardware and is generally integrated on a reading device and/or a server of a reading device.
It should be noted that the reading interaction method provided in this embodiment is specifically applied to the point-to-read device and/or the server of the point-to-read device, and the reading interaction with the user in the reading process of the user can be specifically realized through the point-to-read device and/or the server of the point-to-read device.
As shown in fig. 1, a reading interaction method according to a first embodiment of the present invention includes the following operations:
s101, obtaining image information of a current reading page, and identifying text content in the image information.
In this embodiment, the current reading page may specifically be a reading page currently being read in the reading material selected by the user, where the reading material may specifically be a book, a drawing book, a newspaper, or the like readable by the user. The reading material may be considered to include at least one piece of content to be read currently, which can be read by a user. It will be appreciated that the reading material and the pointing device may be placed on the same support (e.g. a desktop) when the user is reading.
Meanwhile, the image information corresponds to the current reading page and can be captured by a camera in the point reading device, and the text content can be understood as the content contained in the current reading page determined after the image information is identified.
For example, when a user reads, a reading material including a current reading page may be placed on a desk on which the reading device is placed, and the user may adjust a placement position of the reading material, so that a camera on the reading device may capture the current reading page in the reading material, thereby obtaining image information of the current reading page read by the user.
It is understood that this step may acquire image information of a current reading page captured by a camera of the point-reading device, and then may identify the acquired image information through a given image identification algorithm, such as image identification based on feature matching, image identification based on classification, and the like, so as to obtain text content corresponding to the image information.
And S102, determining key knowledge information in the text content.
In this embodiment, the key knowledge information may be specifically understood as information that covers the core key content in the text content corresponding to the current reading page. The implementation of determining the key knowledge information in this step may be: searching standard text content matched with the text content from a preset knowledge information base, and then acquiring key knowledge information preset corresponding to the standard text content, wherein the knowledge information base can be formed in advance based on manual verification and arrangement.
It should be noted that, in the reading interaction method provided in this embodiment, when performing manual verification and layout, the reading materials with higher reading frequency of the main user to which the reading interaction method provided in this embodiment is applicable may be determined, and then the contents of each reading page in the reading materials are mainly subjected to manual verification and layout, so as to form the key knowledge information corresponding to each reading page in different reading materials.
In addition, the implementation of determining the key knowledge information in this step may also be: and directly performing word segmentation analysis on the text content of the current reading page to determine key words in the text content, and then combining the word senses of the key words with the set compiling grammar to form key knowledge point information corresponding to the current reading page.
For example, assuming that the text content in the current reading page is determined to be a story named monkey for the month based on the above steps, the embodiment may obtain key knowledge information of the story from a knowledge information base which is manually verified and arranged in advance or determined by word segmentation analysis as follows: a group of monkeys took the moon from the well, but did not, and the moon was still hanging on the sky.
S103, determining the interactive questions corresponding to the current reading page based on a preset interactive question bank and the key knowledge information, and sending the interactive questions for playing.
In this embodiment, the interactive question bank may be specifically understood as forming a related question data set in advance based on the information arrangement of the mined key knowledge points. For example, after obtaining the key knowledge point information of the current reading page, the step may search the interactive question bank for standard knowledge information matching the key knowledge information, and use the interactive question corresponding to the standard knowledge information as the interactive question of the key knowledge information. It can be known that there may be a plurality of interactive questions determined in this step, and in order to implement interactive question answering with a reading user, one interactive question may be sequentially selected in this step and sent to the reading device for playing.
After determining the key knowledge point information in the story, the interaction problem of the current reading page can be determined based on the key knowledge point information and the interaction problem library, and the interaction problems can include, for example, what story is told by the current content, where the monkey is to take the moon in the story, no monkey is to take the moon, the interaction problem can also be, why the monkey cannot take the moon, and the like. In the step, after the related interaction problems are obtained, one interaction problem can be selected and sent to the point reading equipment at a set time interval sequence, so that problem interaction is carried out with a reading user through the point reading equipment.
The reading interaction method provided by the embodiment of the invention comprises the following steps: the method comprises the steps of obtaining image information of a current reading page, identifying text content in the image information, determining key knowledge information in the text content, determining interaction problems corresponding to the current reading page based on preset knowledge information and the key knowledge information, and sending the interaction problems to a point reading device for playing. By utilizing the method, through the problem interaction with the reading user in the reading process, the interestingness of the user in the reading process is enhanced, the enthusiasm of the user for actively thinking in the reading process is also enhanced, and therefore the reading effect of improving the reading interest of the user and the divergent thinking capability of the user is achieved.
On the basis of the above embodiment, as an optional embodiment of this embodiment, after determining the key knowledge information in the text content, the following is further optimized and added: and generating corresponding picture drawing information based on the key knowledge information, and playing the picture drawing information.
In this embodiment, after determining the key knowledge information of the current reading page, in addition to determining the related interaction problem, the screen rendering information that can be played at the reading device side may be generated based on the key knowledge information, and the screen rendering information may be sent to the reading device side for dynamic display and playing to the reading user.
Specifically, a noun describing a person or an animal in the key knowledge information, for example, 'monkey' may be determined, a noun describing a scene, for example, 'moon', 'well', and 'big tree', may be determined, and a verb, for example, 'drag', may be determined, so that the nouns and verbs may be combined to describe an associated cartoon image, which is the above example, and an image of a monkey dragging moon from a well may be formed and dynamically presented to the reading user through the pointing device, so that the current reading content may be presented to the reading user more vividly.
The technical characteristics of the optional embodiment realize the imaging of the key knowledge information in the current reading page, thereby enhancing the picture sense of the reading user in the reading process and also improving the reading interest of the user.
Example two
Fig. 2 is a schematic flow chart of a reading interaction method according to a second embodiment of the present invention, which is optimized based on the first embodiment, and in this embodiment, the determining of the key knowledge information in the text content is further embodied as: performing word segmentation on the text content to obtain a word set corresponding to the text content; counting the occurrence frequency of each word to obtain a keyword of which the occurrence frequency is greater than a set threshold; and summarizing each keyword based on a set grammar compiling model to obtain key knowledge information corresponding to the text content.
Meanwhile, the embodiment further adds: after response information of a user for the current interactive question is received, comment information corresponding to the response information is determined and used for displaying, and the response information is collected by a microphone on the click-to-read equipment.
As shown in fig. 2, the reading interaction method provided in the second embodiment of the present invention specifically includes the following operations:
s201, acquiring image information of a current reading page, and identifying text content in the image information.
Illustratively, the step acquires image information of a current reading page captured by a camera of the point-reading device. It should be noted that, in this embodiment, the following S202 to S204 specifically provide an implementation method for determining key knowledge information.
S202, performing word segmentation processing on the text content to obtain a word set corresponding to the text content.
In this embodiment, to implement the determination of the key knowledge information, a given text word segmentation processing algorithm may be first adopted to perform word segmentation processing on the text content corresponding to the image information, so as to obtain a related word set.
S203, counting the occurrence frequency of each word, and obtaining the keywords of which the occurrence frequency is greater than a set threshold value.
In this embodiment, statistics on the occurrence frequency of the words in the word set may be performed, different words may be sorted from high to low based on the occurrence frequency of each word, and finally, a keyword whose occurrence frequency is higher than a set threshold may be selected.
And S204, summarizing each keyword based on a set grammar compiling model to obtain key knowledge information corresponding to the text content.
In this embodiment, the grammar compiling model may be specifically understood as a neural network model for outputting relevant key knowledge information based on key words, and may be trained and learned in advance based on a certain amount of sample words as a sample set, so as to form an applicable network model.
S205, determining the interactive questions corresponding to the current reading page based on a preset interactive question bank and the key knowledge information, and sending the interactive questions for playing.
Illustratively, in this step, the interactive question associated with the current reading page can be obtained by searching the standard knowledge information matched with the key knowledge information from the interactive question library, and then the obtained interactive question can be played on the touch screen of the point-to-read device in a set sequence, wherein after one interactive question is sent, the next interactive question can be played after a question response of the reading user is received, and the next interactive question can also be played after a set time interval is reached.
S206, after response information of the user for the current interactive question is received, comment information corresponding to the response information is determined and used for displaying.
In this embodiment, the interactive question currently selected and sent to the point-to-read device may be recorded as the current interactive question, and it can be understood that, for a reading user, after acquiring the current interactive question played by the point-to-read device, the reading user may give the reply information of the played current interactive question, where the reply information is collected by a microphone on the point-to-read device. In this step, reply information fed back by the user can be received, and the reply information can be analyzed to determine whether the reply information conforms to the standard answer of the current interactive question, and corresponding comment information can be formed according to the determination result.
Illustratively, when it is determined that the answer information does not conform to the standard answer, a dynamic picture informing the reading user of an answer error may be formed as the comment information and played by the reading device, the standard answer may also be played as the comment information in the form of the dynamic picture by the reading device, or some punishment items (such as punishment of the user to read the text content of the current reading page again, etc.) may also be presented to the reading user by the reading device.
For another example, when the answer information is determined to be the same as the standard answer, a dynamic picture informing the reading user of correct answer may be formed as the comment information and played by the reading device, or some reward items may be played by the reading device as the comment information (e.g., a certain number of coins or a rank value of the reward reading user) to be displayed to the reading user.
Further, the determining and displaying the comment information corresponding to the reply information includes:
comparing the reply information with standard reply information preset for the current interactive question; if the matching degree of the reply information and the standard reply information is larger than a set matching value, the set pragmatic sentence is used as comment information and is used for voice playing and animation display of the pragmatic sentence; otherwise, the set punishment information is used as comment information and is used for voice playing of the punishment information; or the set answer prompt information is used as comment information and is used for voice playing and animation display of the answer prompt.
It can be understood that the reply information of the user does not need to be completely consistent with the standard reply information, and the user may only have the same meaning, that is, the matching degree determined in this step is greater than or equal to the set matching value, and the reading user may be considered to respond correctly, at this time, a word-up sentence may be formed as feedback of the comment information, and it can be known that the comment information may be displayed in an animation form through a touch screen of the reading device, or played in a voice form through a pronunciation device of the reading device.
When the matching degree determined in the step is smaller than the set matching value, punishment information can be fed back to the reading user, and the punishment information can be played and displayed by the touch screen or played by the pronunciation device. In addition, when the matching degree of the reply information and the standard reply information is smaller than the set matching value, the answer prompt information of the interactive question can be determined, the answer prompt information is displayed on a touch screen of the click-to-read equipment or is played in a voice mode, and further, the answer matching operation is carried out again after the reading user gives the reply information based on the reply prompt, so that the comment information is fed back to the reading user.
Illustratively, the facial information can be displayed on the touch screen of the reading device in the form of an animation of a colored egg and corresponding voice is played through the sound production device of the reading device, the displayed and played facial content can have "congratulations of you, answers right", "true stick, answers right, rewards you with a gold coin", etc., the punishment information can also be displayed on the reading device in the form of an animation, and a cartoon crying face or a regret expression can be used as the animation content and matched with corresponding characters such as "true regret, bad you successfully draw", "huggy, answer wrong, want correct answer bar", etc., and similarly, the answer prompt can also be displayed to the reading user in the form of an animation.
It can be understood that, when the execution subject of the first embodiment or the second embodiment is the point reading device, the point reading device may directly implement the reading interaction with the reading user based on the above steps, and when the execution subject of the first embodiment or the second embodiment is the server of the point reading device, the server may perform the data interaction with the point reading device in real time, thereby implementing the reading interaction with the reading user. In addition, the execution main body of the method provided in the first embodiment or the second embodiment may also be a point-to-read device and a server of the point-to-read device, and the two devices cooperate to execute the steps of the method to implement reading interaction when a user reads the reading interaction.
The reading interaction method provided by the embodiment of the invention embodies the implementation process of key knowledge information in text content, and simultaneously increases the operation of reading users for acquiring response information of interaction problems. By utilizing the method, through interactive question answering with the reading user in the reading process, the interestingness of the user in the reading process is enhanced, the enthusiasm of active thinking in the reading process of the user is also enhanced, and therefore the reading effect of improving the reading interest of the user and the divergent thinking capability of the user is achieved.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a reading interaction apparatus according to a third embodiment of the present invention, where the apparatus is suitable for a case where a user needs to perform reading interaction during reading, and the apparatus may be implemented by software and/or hardware and is generally integrated on a reading device and/or a server of the reading device. Specifically, as shown in fig. 3, the apparatus includes: an information acquisition module 31, a key information determination module 32, and an interaction problem determination module 33.
The information acquisition module 31 is configured to acquire image information of a current reading page and identify text content in the image information, where the image information is captured by a camera on the point-to-read device;
a key information determination module 32, configured to determine key knowledge information in the text content;
and the interactive question determining module 33 is configured to determine an interactive question corresponding to the current reading page based on a preset interactive question library and the key knowledge information, and send the interactive question for playing.
In this embodiment, the apparatus first obtains image information of a current reading page through an information obtaining module 31, identifies text content in the image information, then determines key knowledge information in the text content through a key information determining module 32, and finally determines an interaction problem corresponding to the current reading page through an interaction problem determining module 33 based on a preset interaction problem library and the key knowledge information, and sends the interaction problem for playing.
The reading interaction device provided by the third embodiment of the invention has the advantages that the interestingness of the user in the reading process is enhanced through the problem interaction with the reading user in the reading process, the enthusiasm of the user for active thinking in the reading process is also enhanced, and the reading effect of improving the reading interest of the user and the divergent thinking ability of the user is achieved.
Further, the key information determining module 32 is specifically configured to:
performing word segmentation on the text content to obtain a word set corresponding to the text content;
counting the occurrence frequency of each word to obtain a keyword of which the occurrence frequency is greater than a set threshold;
and summarizing each keyword based on a set grammar compiling model to obtain key knowledge information corresponding to the text content.
Further, the apparatus further comprises:
and the comment information determining module is used for determining and displaying comment information corresponding to the reply information after receiving the reply information of the user for the current interactive question, wherein the reply information is collected by a microphone on the click-to-read equipment.
Further, the comment information determining module is specifically configured to:
after receiving reply information of a user aiming at the current interactive question, comparing the reply information with standard reply information preset for the current interactive question;
if the matching degree of the reply information and the standard reply information is larger than a set matching value, the set pragmatic sentence is used as comment information and is used for voice playing and animation display of the pragmatic sentence; if not, then,
the set punishment information is used as comment information and is used for voice playing of the punishment information; alternatively, the first and second electrodes may be,
and taking the set answer prompt information as comment information, and displaying the answer prompt in voice and animation.
Further, the apparatus further comprises:
and the drawing information generating module is used for generating corresponding picture drawing information based on the key knowledge information after determining the key knowledge information in the text content, and playing the picture drawing information.
Example four
Fig. 4 is a schematic structural diagram of a point-to-read device according to a fourth embodiment of the present invention, as shown in fig. 4, the point-to-read device includes: a main body 41, a controller (not shown) and a wireless network module (not shown) which are positioned in the main body 41, and a sound pickup device 42, a sound production device 43, a camera 44 and a touch screen 45 which are nested on the main body 41, wherein the main body 41 is arranged on a carrier 46 on which a reading material 47 is arranged, and the controller is used for controlling at least one of the following items: the sound pickup device 42, the sound generation device 43, the camera 44 and the touch screen 45 perform corresponding operations, and are further configured to implement the reading interaction method provided by the embodiment of the present invention, wherein the sound pickup device 42 is configured to collect audio information, and the audio information includes reply information of a user; a sound generation device 43 for playing audio information; a camera 44 for capturing image information including reading pages in the reading material; and a touch panel 45 for displaying information.
The touch and talk device can be, for example, an electronic device such as a computer, a tablet, or a mobile phone having a sound pickup device, a sound generation device, a camera, and a touch screen, wherein the sound pickup device can be a microphone, and the sound generation device can be a speaker. The reading material may be a conventional paper book, journal or picture book, etc. Illustratively, the carrier on which the reading material is located may be a desktop, the main body 41 of the point-and-read device is mounted on the desktop, and the controller may perform data interaction with a server at the back end through the wireless network module.
The click-to-read device serving as the method execution main body provided by the embodiment of the disclosure can enhance the interest of the user in the reading process and enhance the initiative of the user in active thinking in the reading process, thereby achieving the reading effect of improving the reading interest of the user and the divergent thinking ability of the user.
EXAMPLE five
Fig. 5 is a schematic structural diagram of a server according to a fifth embodiment of the present invention. It can be understood that the server provided in the fifth embodiment of the present invention can also be used as an execution subject of the reading interaction method provided in the fifth embodiment of the present invention. As shown in fig. 5, a server provided in the fifth embodiment of the present invention includes: one or more processors 51 and storage 52; the number of the processors 51 in the server may be one or more, and one processor 51 is taken as an example in fig. 5; storage 52 is used to store one or more programs; the one or more programs are executed by the one or more processors 51, so that the one or more processors 51 implement the reading interaction method according to any of the embodiments of the present invention.
The server may further include: an input device 53 and an output device 54.
The processor 51, the storage device 52, the input device 53 and the output device 54 in the server may be connected by a bus or other means, and the bus connection is exemplified in fig. 5.
The storage device 52 in the server is used as a computer-readable storage medium for storing one or more programs, which may be software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the reading interaction method provided in one or two embodiments of the present invention (for example, the modules in the reading interaction device shown in fig. 4 include the information obtaining module 31, the key information determining module 32, and the interaction problem determining module 33). The processor 51 executes various functional applications of the server and data processing by running software programs, instructions and modules stored in the storage device 52, namely, implements the reading interaction method in the above method embodiment.
The storage device 52 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the server, and the like. Further, the storage 52 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the storage 52 may further include memory located remotely from the processor 51, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 53 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the server. The output device 54 may include a display device such as a display screen.
And, when the one or more programs included in the above-mentioned server are executed by the one or more processors 51, the programs perform the following operations:
acquiring image information of a current reading page, and identifying text content in the image information, wherein the image information is captured by a camera on the point reading equipment; determining key knowledge information in the text content; and determining the interactive questions corresponding to the current reading page based on a preset interactive question bank and the key knowledge information, and sending the interactive questions for playing.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is used to execute a reading interaction method when executed by a processor, and the method includes:
acquiring image information of a current reading page, and identifying text content in the image information, wherein the image information is captured by a camera on the point reading equipment; determining key knowledge information in the text content; and determining the interactive questions corresponding to the current reading page based on a preset interactive question bank and the key knowledge information, and sending the interactive questions for playing.
Optionally, the program, when executed by the processor, may be further configured to perform a reading interaction method according to any embodiment of the present invention.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM), a flash Memory, an optical fiber, a portable CD-ROM, an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. A computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take a variety of forms, including, but not limited to: an electromagnetic signal, an optical signal, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, Radio Frequency (RF), etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (8)
1. A reading interaction method, comprising:
acquiring image information of a current reading page, and identifying text content in the image information;
determining key knowledge information in the text content;
determining an interaction problem corresponding to the current reading page based on a preset interaction problem library and the key knowledge information, and sending the interaction problem for playing;
the interactive questions are multiple, and one interactive question is sequentially selected for playing;
after determining the key knowledge information in the text content, the method further includes:
generating corresponding picture drawing information based on the key knowledge information and playing the picture drawing information;
wherein the determining key knowledge information in the text content comprises:
performing word segmentation on the text content to obtain a word set corresponding to the text content;
counting the occurrence frequency of each word to obtain a keyword of which the occurrence frequency is greater than a set threshold;
and summarizing each keyword based on a set grammar compiling model to obtain key knowledge information corresponding to the text content.
2. The method of claim 1, further comprising:
after response information of a user for the current interactive question is received, comment information corresponding to the response information is determined and used for displaying, and the response information is collected by a microphone on the click-to-read equipment.
3. The method according to claim 2, wherein the determining and displaying the comment information corresponding to the reply information comprises:
comparing the reply information with standard reply information preset for the current interactive question;
if the matching degree of the reply information and the standard reply information is larger than a set matching value, the set pragmatic sentence is used as comment information and is used for voice playing and animation display of the pragmatic sentence; if not, then,
the set punishment information is used as comment information and is used for voice playing of the punishment information; alternatively, the first and second electrodes may be,
and taking the set answer prompt information as comment information, and displaying the answer prompt in voice and animation.
4. A reading interaction device, comprising:
the information acquisition module is used for acquiring the image information of the current reading page and identifying the text content in the image information;
the key information determining module is used for determining key knowledge information in the text content;
the interactive question determining module is used for determining the interactive question corresponding to the current reading page based on a preset interactive question bank and the key knowledge information, and sending the interactive question for playing;
the interactive questions are multiple, and one interactive question is sequentially selected for playing;
a drawing information generating module for generating corresponding picture drawing information based on the key knowledge information after determining the key knowledge information in the text content, and playing the picture drawing information;
wherein the determining key knowledge information in the text content comprises:
performing word segmentation on the text content to obtain a word set corresponding to the text content;
counting the occurrence frequency of each word to obtain a keyword of which the occurrence frequency is greater than a set threshold;
and summarizing each keyword based on a set grammar compiling model to obtain key knowledge information corresponding to the text content.
5. The apparatus of claim 4, further comprising:
and the comment information determining module is used for determining and displaying comment information corresponding to the reply information after receiving the reply information of the user for the current interactive question, and the reply information is collected by a microphone on the click-to-read equipment.
6. A point-reading apparatus, comprising: the main body, the controller and the wireless network module which are positioned in the main body, and the sound pickup device, the sound production device, the camera and the touch screen which are nested on the main body, wherein the main body is arranged on a carrier on which reading materials are arranged,
the controller is configured to control at least one of: the pickup device, the sound production device, the camera and the touch screen perform corresponding work and are also used for realizing the reading interaction method according to any one of claims 1 to 3;
the sound pickup device is used for collecting audio information, and the audio information comprises reply information of a user;
the pronunciation device is used for playing audio information;
the camera is used for capturing image information, and the image information comprises reading pages in the reading material;
the touch screen is used for displaying information.
7. A server, comprising:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the reading interaction method of any of claims 1-3.
8. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the reading interaction method according to any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910040221.4A CN111523343B (en) | 2019-01-16 | 2019-01-16 | Reading interaction method, device, equipment, server and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910040221.4A CN111523343B (en) | 2019-01-16 | 2019-01-16 | Reading interaction method, device, equipment, server and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111523343A CN111523343A (en) | 2020-08-11 |
| CN111523343B true CN111523343B (en) | 2022-04-01 |
Family
ID=71900008
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910040221.4A Active CN111523343B (en) | 2019-01-16 | 2019-01-16 | Reading interaction method, device, equipment, server and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111523343B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113420131A (en) * | 2021-06-11 | 2021-09-21 | 洪恩完美(北京)教育科技发展有限公司 | Reading guide method and device for children picture book and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107798931A (en) * | 2017-12-05 | 2018-03-13 | 上海电机学院 | A kind of intelligent children education learning system and method |
| CN108055593A (en) * | 2017-12-20 | 2018-05-18 | 广州虎牙信息科技有限公司 | A kind of processing method of interactive message, device, storage medium and electronic equipment |
| CN108509136A (en) * | 2018-04-12 | 2018-09-07 | 山东音为爱智能科技有限公司 | A kind of children based on artificial intelligence paint this aid reading method |
| CN108710653A (en) * | 2018-05-09 | 2018-10-26 | 北京智能管家科技有限公司 | One kind, which is painted, originally reads aloud order method, apparatus and system |
| CN108806360A (en) * | 2018-05-31 | 2018-11-13 | 北京智能管家科技有限公司 | Reading partner method, apparatus, equipment and storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150269133A1 (en) * | 2014-03-19 | 2015-09-24 | International Business Machines Corporation | Electronic book reading incorporating added environmental feel factors |
| CN108279833A (en) * | 2018-01-08 | 2018-07-13 | 维沃移动通信有限公司 | A kind of reading interactive approach and mobile terminal |
-
2019
- 2019-01-16 CN CN201910040221.4A patent/CN111523343B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107798931A (en) * | 2017-12-05 | 2018-03-13 | 上海电机学院 | A kind of intelligent children education learning system and method |
| CN108055593A (en) * | 2017-12-20 | 2018-05-18 | 广州虎牙信息科技有限公司 | A kind of processing method of interactive message, device, storage medium and electronic equipment |
| CN108509136A (en) * | 2018-04-12 | 2018-09-07 | 山东音为爱智能科技有限公司 | A kind of children based on artificial intelligence paint this aid reading method |
| CN108710653A (en) * | 2018-05-09 | 2018-10-26 | 北京智能管家科技有限公司 | One kind, which is painted, originally reads aloud order method, apparatus and system |
| CN108806360A (en) * | 2018-05-31 | 2018-11-13 | 北京智能管家科技有限公司 | Reading partner method, apparatus, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111523343A (en) | 2020-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110517689B (en) | Voice data processing method, device and storage medium | |
| WO2022121601A1 (en) | Live streaming interaction method and apparatus, and device and medium | |
| CN108847214B (en) | Voice processing method, client, device, terminal, server and storage medium | |
| CN106971009B (en) | Voice database generation method and device, storage medium and electronic equipment | |
| CN107040452B (en) | Information processing method and device and computer readable storage medium | |
| CN111107442B (en) | Method and device for acquiring audio and video files, server and storage medium | |
| CN101998107A (en) | Information processing apparatus, conference system and information processing method | |
| CN114339285B (en) | Knowledge point processing method, video processing method, device and electronic equipment | |
| US10089898B2 (en) | Information processing device, control method therefor, and computer program | |
| CN110569364A (en) | online teaching method, device, server and storage medium | |
| CN111524507A (en) | Voice information feedback method, device, equipment, server and storage medium | |
| CN113140138A (en) | Interactive teaching method, device, storage medium and electronic equipment | |
| CN110808038A (en) | Mandarin assessment method, device, equipment and storage medium | |
| CN113315979A (en) | Data processing method and device, electronic equipment and storage medium | |
| US20220391058A1 (en) | Interaction information processing method and apparatus, electronic device and storage medium | |
| CN110825164A (en) | Interaction method and system based on wearable intelligent equipment special for children | |
| CN110767005A (en) | Data processing method and system based on intelligent equipment special for children | |
| CN111523343B (en) | Reading interaction method, device, equipment, server and storage medium | |
| CN111241802B (en) | Job generation method, device, storage medium and terminal | |
| CN113573128A (en) | Audio processing method, device, terminal and storage medium | |
| CN113763925B (en) | Speech recognition method, device, computer equipment and storage medium | |
| KR102088047B1 (en) | Apparatus for studying language | |
| KR20230025708A (en) | Automated Assistant with Audio Present Interaction | |
| KR100884826B1 (en) | Repeatable studying apparatus using page index, system and mehtod | |
| Abreu et al. | Voice Interaction on TV: Analysis of natural language interaction models |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |