TWI839603B - Method, device, storage medium and electronic equipment for assisting reading - Google Patents

Abstract

The present invention provides a method, device, storage medium and electronic device for assisting reading. The method for assisting reading includes: a reading mode, wherein the reading mode includes: displaying a text to be read and highlighting the current sentence sentence by sentence; recording the pronunciation of the user reading aloud; and comparing the demonstration pronunciation with the user reading aloud pronunciation to obtain a reading evaluation result of the user reading aloud pronunciation. The embodiment of the present invention compares the demonstration pronunciation with the user's reading pronunciation and evaluates the user's reading pronunciation, which helps to improve the user's participation and learning effect. The user's reading aloud helps to improve the user's listening and speaking ability. At the same time, by evaluating the user's reading pronunciation, it can help the user learn more targetedly and master the learning content.

Description

Method, device, storage medium and electronic equipment for assisting reading

The present invention belongs to the field of language learning technology, and specifically relates to a method, device, storage medium and electronic equipment for assisting reading.

With the widespread use of mobile terminals such as mobile phones, there are more and more applications applied to them, which has also led to many things being able to be realized on mobile terminals, such as reading books, etc. At present, there are many products on the market for online reading, reading news and learning knowledge. However, these products usually can only provide text content for users to read, or input text content information to users through voice playback. This method is obviously not enough for users who learn languages. For example, when users need to learn a foreign language, they may not be able to complete reading the foreign language text alone. If it is only played to users through voice, such learning is very passive, which reduces the user's initiative to learn, thereby causing users to give up learning.

In view of this, the embodiments of the present invention are committed to providing a method, apparatus, storage medium and electronic device for assisting reading, which displays the text to be read and highlights the current sentence sentence by sentence. The user reads the current sentence and records the user's reading pronunciation. By comparing the demonstration pronunciation with the user's reading pronunciation, the user's reading pronunciation is evaluated, which helps to improve the user's participation and learning effect. By the user reading aloud, it helps to improve the user's listening and speaking ability. At the same time, by evaluating the user's reading pronunciation, it can help the user to learn more targeted and master the learning content.

According to one aspect of an embodiment of the present invention, the present invention provides a method for assisting reading, including a reading mode, wherein the reading mode includes: displaying a text to be read and highlighting the current sentence sentence by sentence; recording the user's reading pronunciation; wherein the user's reading pronunciation is the voice of the user reading the current sentence; and comparing the demonstration pronunciation with the user's reading pronunciation to obtain a reading evaluation result of the user's reading pronunciation.

In some embodiments of the present invention, after obtaining the reading evaluation result of the user's reading and pronunciation, the reading mode further includes: when the reading evaluation result is that the user's reading and pronunciation is not passed, prompting the user.

In certain embodiments of the present invention, after obtaining the reading evaluation result of the user's reading pronunciation, the reading mode further includes: when the reading evaluation result is that the user's reading pronunciation has not passed, recording the user's reading pronunciation again to obtain the re-reading pronunciation; and comparing the demonstration pronunciation with the re-reading pronunciation to obtain the re-reading evaluation result of the re-reading pronunciation.

In certain embodiments of the present invention, the reading mode further includes: when the number of recordings exceeds a preset first threshold and the last reading evaluation result is that the corresponding reading pronunciation fails, a selection pop-up window is provided for the user to select; wherein the selection pop-up window includes options to skip the current sentence and record again.

In some embodiments of the present invention, a repeat mode is also included, wherein the repeat mode includes: displaying and playing the text to be read sentence by sentence; hiding the current sentence after the current sentence is played; recording the user's repeat pronunciation; wherein the user's repeat pronunciation is the voice of the user repeating the current sentence; and comparing the demonstration pronunciation with the user's repeat pronunciation to obtain a repeat evaluation result of the user's repeat pronunciation.

In certain embodiments of the present invention, after obtaining the rereading evaluation result of the user's rereading pronunciation, the rereading mode further includes: when the rereading evaluation result is that the user's rereading pronunciation has not passed, recording the user's rereading pronunciation again to obtain a re-repeated pronunciation; and comparing the demonstration pronunciation with the re-repeated pronunciation to obtain a re-repeating evaluation result of the re-repeated pronunciation.

In certain embodiments of the present invention, the repeat mode further includes: when the number of recordings exceeds a preset second threshold and the last repeat evaluation result is that the corresponding repeat pronunciation has not passed, a selection pop-up window is provided for the user to select; wherein the selection pop-up window includes options for skipping the current sentence and recording again.

In some embodiments of the present invention, a listening mode is also included, wherein the listening mode includes: displaying the text to be read, playing it sentence by sentence and highlighting the current sentence; recording the user's listening pronunciation; wherein the user's listening pronunciation is the user's voice when listening to the current sentence; and comparing the demonstration pronunciation with the user's listening pronunciation to obtain a listening evaluation result of the user's listening pronunciation.

In certain embodiments of the present invention, after obtaining the listening evaluation result of the user's listening pronunciation, the listening mode further includes: when the listening evaluation result is that the user's listening pronunciation has not passed, recording the user's listening pronunciation again to obtain the re-listening pronunciation; and comparing the demonstration pronunciation with the re-listening pronunciation to obtain the re-listening evaluation result of the re-listening pronunciation.

In some embodiments of the present invention, re-recording the user's listening pronunciation includes: playing the current sentence again; and re-recording the user's listening pronunciation.

In certain embodiments of the present invention, the listening mode further includes: when the number of recordings exceeds a preset third digital threshold and the last listening evaluation result is that the corresponding listening pronunciation fails, a selection pop-up window is provided for the user to select; wherein the selection pop-up window includes options to skip the current sentence and record again.

In some embodiments of the present invention, a silent reading mode is also included, wherein the silent reading mode includes: displaying the text to be read and highlighting the current sentence.

In some embodiments of the present invention, the silent reading mode further includes: playing the text to be read; and pausing the playing of the text to be read.

In some embodiments of the present invention, a listening mode is also included, wherein the listening mode includes: displaying the text to be read, playing the text to be read sentence by sentence and highlighting the current sentence.

In some embodiments of the present invention, the listening mode further includes: displaying a playback progress bar according to the content length of the text to be read.

In some embodiments of the present invention, a retelling mode is also included, wherein the retelling mode includes: playing the text to be read sentence by sentence; recording the user's retelling pronunciation after the current sentence is played; wherein the user's retelling pronunciation is the voice of the user retelling the current sentence; and comparing the demonstration pronunciation with the user's retelling pronunciation to obtain a retelling evaluation result of the user's retelling pronunciation.

In certain embodiments of the present invention, after obtaining the repetition evaluation result of the user's repeated pronunciation, the repetition mode also includes: when the re-repetition evaluation result is that the re-repetition pronunciation fails, recording the user's repetition pronunciation again to obtain the re-repetition pronunciation; and comparing the demonstration pronunciation with the re-repetition pronunciation to obtain the re-repetition evaluation result of the re-repetition pronunciation.

In some embodiments of the present invention, re-recording the user's repeated pronunciation includes: playing the current sentence again; and re-recording the user's repeated pronunciation.

In certain embodiments of the present invention, the retelling mode further includes: when the number of recordings exceeds the preset fourth threshold and the last retelling evaluation result is that the corresponding retelling pronunciation fails, a selection pop-up window is provided for the user to select; wherein the selection pop-up window includes options to skip the current sentence and record again.

In some embodiments of the present invention, it also includes: switching the current mode to other modes.

In some embodiments of the present invention, it also includes: obtaining a user level level based on user information; and formulating an evaluation standard based on the user level level.

In some embodiments of the present invention, user information includes user age or user nationality.

In some embodiments of the present invention, after the evaluation criteria are formulated, the method further includes: adjusting the evaluation criteria according to the comprehensive evaluation results of users within a preset time period.

According to another aspect of the present invention, an embodiment of the present invention provides a device for assisting reading, including a reading module, wherein the reading module includes: a first display unit, used to display the text to be read, and highlight the current sentence sentence by sentence; a first recording unit, used to record the user's reading pronunciation; wherein the user's reading pronunciation is the voice of the user reading the current sentence; and a first comparison unit, used to compare the demonstration pronunciation with the user's reading pronunciation to obtain a reading evaluation result of the user's reading pronunciation.

In some embodiments of the present invention, a repeat module is also included, wherein the repeat module includes: a second display unit, used to display and play the text to be read sentence by sentence; a hiding unit, used to hide the current sentence after the current sentence is played; a second recording unit, used to record the user's repeat pronunciation; wherein the user's repeat pronunciation is the voice of the user repeating the current sentence; and a second comparison unit, used to compare the demonstration pronunciation with the user's repeat pronunciation to obtain a repeat evaluation result of the user's repeat pronunciation.

In some embodiments of the present invention, an audio-reading module is also included, wherein the audio-reading module includes: a third display unit, used to display the text to be read, play it sentence by sentence and highlight the current sentence; a third recording unit, used to record the user's audio-reading pronunciation; wherein the user's audio-reading pronunciation is the voice of the user listening to the current sentence; and a third comparison unit, used to compare the demonstration pronunciation with the user's audio-reading pronunciation to obtain an audio-reading evaluation result of the user's audio-reading pronunciation.

In some embodiments of the present invention, a silent reading module is also included, wherein the silent reading module includes: a fourth display unit, which is used to display the text to be read and highlight the current sentence.

In some embodiments of the present invention, a listening module is also included, wherein the listening module includes: a fifth display unit, which is used to display the text to be read, play the text to be read sentence by sentence and highlight the current sentence.

In some embodiments of the present invention, a retelling module is also included, wherein the retelling module includes: a playback unit, which is used to play the text to be read sentence by sentence; a sixth recording unit, which is used to record the user's retelling pronunciation after the current sentence is played; wherein the user's retelling pronunciation is the voice of the user retelling the current sentence; and a sixth comparison unit, which is used to compare the demonstration pronunciation with the user's retelling pronunciation to obtain a retelling evaluation result of the user's retelling pronunciation.

According to another aspect of the present invention, an embodiment of the present invention provides a storage medium, wherein the storage medium stores a computer program, and the computer program is used to execute the assisted reading method provided by any of the above aspects.

According to another aspect of the present invention, an embodiment of the present invention provides an electronic device, the electronic device comprising: a processor; a memory for storing instructions executable by the processor; and the processor, for executing the assisted reading method provided by any of the above aspects.

The embodiments of the present invention provide a method, apparatus, storage medium and electronic device for assisting reading, which displays a text to be read and highlights the current sentence sentence by sentence. The user reads the current sentence and records the user's reading pronunciation. By comparing the demonstration pronunciation with the user's reading pronunciation, the user's reading pronunciation is evaluated, which helps to improve the user's participation and learning effect. By the user reading aloud, it helps to improve the user's listening and speaking ability. At the same time, by evaluating the user's reading pronunciation, it can help the user to learn more targeted and master the learning content.

The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making progressive labor are within the scope of protection of the present invention.

Furthermore, in the exemplary embodiments, since the same reference numerals denote the same components having the same structure or the same steps of the same method, if one embodiment is exemplarily described, only the structures or methods different from the described embodiment are described in other exemplary embodiments.

Throughout the specification and the scope of the patent application, when a component is described as being "connected" to another component, the component may be "directly connected" to the other component, or "electrically connected" to the other component through a third component. In addition, unless explicitly described to the contrary, the term "include" and its corresponding terms should be understood to include only the component, and should not be understood to exclude any other components.

Currently, the application software products that can be used for reading can usually only provide text content for users to read, or input text content information to users through voice playback. This method is obviously not enough for users who are learning languages. Because many users learn foreign languages by reading foreign languages, they may not be able to complete reading foreign language texts alone. If the text is only played to users through voice, it is difficult for users to fully accept it. This kind of learning will be very passive, resulting in reduced user enthusiasm for learning and thus giving up learning.

In order to solve the above problems, the embodiments of the present invention provide a method, apparatus, storage medium and electronic device for assisting reading, which displays the text to be read and highlights the current sentence sentence by sentence. The user reads the current sentence and records the user's reading pronunciation. By comparing the demonstration pronunciation with the user's reading pronunciation, the user's reading pronunciation is evaluated, which helps to improve the user's participation and learning effect. By the user reading aloud, it helps to improve the user's listening and speaking ability. At the same time, by evaluating the user's reading pronunciation, it can help the user to learn more targeted and master the learning content.

The following is a detailed description of the specific implementation of each embodiment of the present invention in conjunction with the attached figures: Figure 1 shows a flow chart of a method for assisting reading provided by an embodiment of the present invention. As shown in Figure 1, the method for assisting reading includes a reading aloud mode, wherein the reading aloud mode includes the following steps, that is, in the reading aloud mode, the following steps are performed.

Step 110: Display the text to be read and highlight the current sentence one by one.

When the user starts reading and the current reading mode is the reading mode, the display interface of the application software installed on the terminal device such as the mobile phone displays the full text of the text to be read and highlights the current sentence sentence by sentence, that is, the full text of the text to be read is displayed on the display interface, and the current sentence is highlighted sentence by sentence, so as to provide the user with the ability to focus on the current sentence when reading aloud, reduce the interference of other sentences on the learning of the current sentence, and improve the user's concentration.

Step 120: Record the user's reading pronunciation; wherein the user's reading pronunciation is the user's voice reading the current sentence.

The user's reading pronunciation is recorded and obtained by turning on the recording device, that is, after the reading starts, the text to be read is displayed on the display interface and the current sentence is highlighted sentence by sentence. At the same time, the recording device is turned on to record the user's voice reading the current sentence. The recording device may include a microphone and other devices built into the terminal device.

Step 130: Compare the demonstration pronunciation with the user's read pronunciation to obtain a reading evaluation result of the user's read pronunciation.

The recorded user's pronunciation is compared with the demonstration pronunciation to obtain a reading evaluation result of the user's pronunciation, wherein the demonstration pronunciation is the standard pronunciation of the current sentence. By comparing the similarity between the user's pronunciation and the demonstration pronunciation, a reading evaluation result of the user's pronunciation is given accordingly, wherein the reading evaluation result may include pass and fail, and the pass reading evaluation result may further include good, very good, excellent, etc.

It can be seen that an embodiment of the present invention provides a method for assisting reading, which displays a text to be read and highlights the current sentence sentence by sentence. The user reads the current sentence and records the user's reading pronunciation. By comparing the demonstration pronunciation with the user's reading pronunciation, the user's reading pronunciation is evaluated, which helps to improve the user's participation and learning effect. By the user reading aloud, it helps to improve the user's listening and speaking ability. At the same time, by evaluating the user's reading pronunciation, it can help the user to learn more targeted and master the learning content.

Fig. 2 is a flow chart of a method for assisting reading provided by another embodiment of the present invention. As shown in Fig. 2, after step 130, the method may further include the following steps.

Step 140: When the reading evaluation result is that the user's reading pronunciation fails, prompt the user.

When the reading evaluation result is failed, the user is prompted that the user has failed. In one embodiment, the prompt may be played with a prompt tone such as "Come on" or "Keep going" or other encouraging or comforting words, or the above-mentioned encouraging or comforting words may be displayed in text. The present invention does not limit the specific method and form of the prompt.

In one embodiment, as shown in FIG. 2 , after step 130 , the reading mode may further include the following steps.

Step 150: When the reading evaluation result is that the user's reading pronunciation fails, the user's reading pronunciation is recorded again to obtain a re-reading pronunciation.

When the user's reading and pronunciation is not passed, the user can be asked to read and record the user's reading and pronunciation again to obtain the re-reading and pronunciation. For sentences that the user has not mastered or has a low degree of mastery, the user's mastery can be improved through multiple exercises. In one embodiment, before re-recording the user's reading and pronunciation, the current sentence can also be played to enable the user to learn the current sentence.

Step 160: Compare the demonstration pronunciation with the re-read pronunciation to obtain a re-read evaluation result of the re-read pronunciation.

After recording the user's re-reading pronunciation, the demonstration pronunciation is compared with the re-reading pronunciation to obtain a re-reading evaluation result of the re-reading pronunciation.

In one embodiment, as shown in FIG. 2 , when the number of recordings does not exceed the preset first threshold value and the last reading evaluation result is that the corresponding reading pronunciation does not pass, step 150 is executed again; when the number of recordings exceeds the preset first threshold value and the last reading evaluation result is that the corresponding reading pronunciation does not pass, step 170 is executed.

Step 170: Provide a selection pop-up window for the user to select. The selection pop-up window includes options to skip the current sentence and record again. It should be understood that the options in the selection pop-up window can be set according to the needs of actual applications, and the present invention is not limited to this.

When the user's reading and pronunciation has not passed and the number of recordings has not exceeded the preset first threshold value (for example, 3 times), the user can try again to avoid the failure result caused by the interference of external noise on the reading and pronunciation; and when the user's reading and pronunciation has not passed and the number of recordings exceeds the first threshold value, a selection pop-up window can be provided for the user to choose to continue practicing or skip the current sentence.

Fig. 3 is a flow chart of a method for assisting reading provided by another embodiment of the present invention. As shown in Fig. 3, the method for assisting reading may further include a repeat mode, wherein the repeat mode includes the following steps, that is, in the repeat mode, the following steps are performed.

Step 210: Display and play the text to be read sentence by sentence.

When the user starts reading and the current reading mode is the repeat mode, the text to be read is displayed and played sentence by sentence on the display interface of the application software installed on the terminal device such as the mobile phone. That is, only the current sentence is displayed and played on the display interface of the application software, while other sentences in the text to be read are not displayed, so as to avoid interference of other sentences with the learning of the current sentence, so as to improve the user's concentration.

Step 220: Hide the current sentence after the current sentence is played.

When the current sentence is played, the current sentence is displayed on the display interface, and after the current sentence is played, the current sentence is hidden, that is, after the current sentence is played, no sentence of the text to be read is displayed on the display interface, so as to avoid the user only referring to the text content of the current sentence for learning, resulting in the current sentence not being well received and remembered by the user, thereby improving the user's memory of the current sentence.

Step 230: Record the user's repeated pronunciation; wherein the user's repeated pronunciation is the user's voice repeating the current sentence.

The user's repeated pronunciation is recorded and obtained by turning on a recording device, that is, after the current sentence is played, the current sentence is hidden on the display interface, and the recording device is turned on to record the user's voice repeating the current sentence. The recording device may include a microphone and other devices built into the terminal device.

Step 240: Compare the demonstration pronunciation with the user's repeated pronunciation to obtain a re-reading evaluation result of the user's repeated pronunciation.

The recorded user reread pronunciation is compared with the demonstration pronunciation to obtain a rereading evaluation result of the user's reread pronunciation, wherein the demonstration pronunciation is the standard pronunciation of the current sentence. By comparing the similarity between the user's reread pronunciation and the demonstration pronunciation, a rereading evaluation result of the user's reread pronunciation is given accordingly, wherein the rereading evaluation result may include pass and fail, and the rereading evaluation result of pass may further include good, very good, excellent, etc.

In one embodiment, when the rereading evaluation result is that the user's rereading pronunciation has not passed, the user can be prompted. When the rereading evaluation result is not passed, the user is prompted that it has not passed. In one embodiment, the prompting method can be to play a prompt tone such as "Come on" or "Keep up the good work" or other encouraging or comforting words, or to display the above-mentioned encouraging or comforting words through text. The present invention does not limit the specific method and form of the prompting, so as to avoid directly giving back the evaluation result score to the user and hitting the user's learning enthusiasm.

In one embodiment, as shown in FIG. 3 , after step 240 , the above-mentioned repeat mode may further include the following steps.

Step 250: When the rereading evaluation result is that the user's rereading pronunciation fails, the user's rereading pronunciation is recorded again to obtain a re-rereading pronunciation.

When the user's repeated pronunciation fails, the user can be asked to repeat and record the user's repeated pronunciation again to obtain the repeated pronunciation. For sentences that the user has not mastered or has a low degree of mastery, the user's mastery can be improved through multiple exercises. In one embodiment, before re-recording the user's repeated pronunciation, the current sentence can be displayed and played again to enable the user to learn the current sentence again.

Step 260: Compare the demonstration pronunciation with the re-read pronunciation to obtain a re-read evaluation result of the re-read pronunciation.

After recording the user's re-read pronunciation, the demonstration pronunciation is compared with the re-read pronunciation to obtain a re-read evaluation result of the re-read pronunciation.

In one embodiment, as shown in FIG. 3 , when the number of recordings does not exceed the preset second threshold value and the last re-reading evaluation result is that the corresponding re-reading pronunciation does not pass, step 250 is executed again; when the number of recordings exceeds the preset second threshold value and the last re-reading evaluation result is that the corresponding re-reading pronunciation does not pass, step 270 is executed.

Step 270: Provide a selection pop-up window for the user to select. The selection pop-up window includes options to skip the current sentence and record again. It should be understood that the options in the selection pop-up window can be set according to the needs of actual applications, and the present invention is not limited to this.

When the user's re-pronunciation has not been passed and the number of recordings has not exceeded the preset second threshold value (for example, 3 times), the user can try again to avoid the failure result caused by the interference of external noise on the re-pronunciation; and when the user's re-pronunciation has not been passed and the number of recordings has exceeded the second threshold value, a selection pop-up window can be provided for the user to choose to continue practicing or skip the current sentence.

Fig. 4 is a flow chart of a method for assisting reading provided by another embodiment of the present invention. As shown in Fig. 4, the method for assisting reading may further include a listening mode, wherein the listening mode includes the following steps, that is, in the listening mode, the following steps are performed.

Step 310: Display the text to be read, play it sentence by sentence and highlight the current sentence.

The auxiliary reading method provided by the present invention may also include a listening mode. When the user starts reading and the current reading mode is the listening mode, the full text of the text to be read is displayed on the display interface, and the current sentence is played sentence by sentence and highlighted, so that the user can focus on the current sentence when listening, reduce the interference of other sentences on the learning of the current sentence, and improve the user's concentration.

Step 320: Record the user's listening pronunciation; wherein the user's listening pronunciation is the user's listening pronunciation of the current sentence.

The user's audio pronunciation is recorded and obtained by turning on the recording device, that is, after the audio starts, the text to be read is displayed on the display interface and played sentence by sentence with the current sentence highlighted, and at the same time the recording device is turned on to record the user's audio of the current sentence, wherein the recording device may include a microphone and other devices built into the terminal device.

Step 330: Compare the demonstration pronunciation with the user's heard pronunciation to obtain an audio-visual evaluation result of the user's heard pronunciation.

The recorded user's listening pronunciation is compared with the demonstration pronunciation to obtain a listening evaluation result of the user's listening pronunciation, wherein the demonstration pronunciation is the standard pronunciation of the current sentence. By comparing the similarity between the user's listening pronunciation and the demonstration pronunciation, a listening evaluation result of the user's listening pronunciation is given accordingly, wherein the listening evaluation result may include pass and fail, and the passed listening evaluation result may further include good, very good, excellent, etc.

In one embodiment, when the result of the listening evaluation is that the user's listening pronunciation has not passed, the user can be prompted. When the result of the listening evaluation is not passed, the user is prompted that it has not passed. In one embodiment, the prompting method can be playing a prompt tone such as "Come on" or "Keep up the good work" or other encouraging or comforting words, or can be displaying the above-mentioned encouraging or comforting words through text. The present invention does not limit the specific method and form of the prompting.

In one embodiment, as shown in FIG. 4 , after step 330 , the reading mode may further include the following steps.

Step 340: When the listening evaluation result is that the user's listening pronunciation fails, the user's listening pronunciation is recorded again to obtain a second listening pronunciation.

When the user's listening and pronunciation is not passed, the user can be asked to listen again and record the user's listening and pronunciation again to obtain the second listening and pronunciation. For sentences that the user has not mastered or has a low degree of mastery, the user's mastery can be improved through multiple exercises. In one embodiment, before re-recording the user's listening and pronunciation, the current sentence can be played again and the user's listening and pronunciation can be re-recorded to achieve further learning of the current sentence by the user.

Step 350: Compare the demonstration pronunciation with the re-listening pronunciation to obtain a re-listening evaluation result of the re-listening pronunciation.

After recording the user's re-listening pronunciation, the demonstration pronunciation is compared with the re-listening pronunciation to obtain a re-listening evaluation result of the re-listening pronunciation.

In one embodiment, as shown in FIG. 4 , when the number of recordings does not exceed the preset third digital threshold and the last listening evaluation result is that the corresponding listening pronunciation does not pass, step 340 is executed again; when the number of recordings exceeds the preset third digital threshold and the last listening evaluation result is that the corresponding listening pronunciation does not pass, step 360 is executed.

Step 360: Provide a selection pop-up window for the user to choose. The selection pop-up window includes options to skip the current sentence and record again. It should be understood that the options in the selection pop-up window can be set according to the needs of actual applications, and the present invention is not limited to this.

When the user's listening and pronunciation has not passed and the number of recordings has not exceeded the preset third digital threshold (for example, 3 times), the user can try again to avoid the failure result caused by the interference of external noise on the reading pronunciation; and when the user's listening and pronunciation has not passed and the number of recordings exceeds the third digital threshold, a selection pop-up window can be provided, allowing the user to choose to continue practicing or skip the current sentence.

Fig. 5 is a flow chart of a method for assisting reading provided by another embodiment of the present invention. As shown in Fig. 5, the method for assisting reading may further include a silent reading mode, wherein the silent reading mode includes the following steps, that is, in the silent reading mode, the following steps are performed.

Step 410: Display the text to be read and highlight the current sentence.

The auxiliary reading method provided by the present invention may also include a silent reading mode. When the user starts reading and the current reading mode is the silent reading mode, the full text of the text to be read is displayed on the display interface, and the current sentence is highlighted, so that the user can focus on the current sentence during silent reading, reduce the interference of other sentences on the learning of the current sentence, and improve the user's concentration.

In one embodiment, as shown in FIG. 5 , the silent reading mode may further include the following steps.

Step 420: Play the text to be read.

Step 430: Pause the playback of the text to be read.

By setting the pause/play button, you can choose to start playing the text to be read or stop playing the text to be read in the silent reading mode. When starting to play, you can start playing from the current sentence or from the first sentence of the text to be read. The present invention can select the starting position when starting to play according to the actual application scenario, and the present invention is not limited to this.

Fig. 6 is a flow chart of a method for assisting reading provided by another embodiment of the present invention. As shown in Fig. 6, the method for assisting reading may further include a listening mode, wherein the listening mode includes the following steps, that is, in the listening mode, the following steps are performed.

Step 510: Display the text to be read, play the text to be read sentence by sentence and highlight the current sentence.

The auxiliary reading method provided by the present invention may also include a listening mode. When the user starts reading and the current reading mode is the listening mode, the full text of the text to be read is displayed on the display interface, and the current sentence is played sentence by sentence and highlighted, so that the user can focus on the current sentence when listening, reduce the interference of other sentences on the learning of the current sentence, and improve the user's concentration.

In one embodiment, as shown in FIG. 6 , the listening mode may further include the following steps.

Step 520: Display a playback progress bar according to the content length of the text to be read.

A playback progress bar is displayed based on the length of the text to be read, so that users can grasp the playback progress in real time.

Fig. 7 is a flow chart of a method for assisting reading provided by another embodiment of the present invention. As shown in Fig. 7, the method for assisting reading includes a retelling mode, wherein the retelling mode includes the following steps, that is, in the retelling mode, the following steps are performed.

Step 610: Play the text to be read sentence by sentence.

The auxiliary reading method provided by the present invention may also include a retelling mode. When the user starts reading and the current reading mode is the retelling mode, the content of the text to be read is not displayed on the display interface, and only the current sentence is played, so that the user can focus on the current sentence when listening, so as to improve the user's concentration and mastery.

Step 620: After the current sentence is played, the user's repeated pronunciation is recorded; wherein the user's repeated pronunciation is the voice of the user repeating the current sentence.

The user's repeated pronunciation is recorded and obtained by turning on the recording device, that is, after the current sentence is played, the recording device is turned on at the same time to record the user's voice repeating the current sentence, wherein the recording device may include a microphone and other devices built into the terminal device.

Step 630: Compare the demonstration pronunciation with the user's repeated pronunciation to obtain a repetition evaluation result of the user's repeated pronunciation.

The recorded user's repeated pronunciation is compared with the demonstration pronunciation to obtain a repetition evaluation result of the user's repeated pronunciation, wherein the demonstration pronunciation is the standard pronunciation of the current sentence. By comparing the similarity between the user's repeated pronunciation and the demonstration pronunciation, a repetition evaluation result of the user's repeated pronunciation is given accordingly, wherein the repetition evaluation result may include passed and failed, and the passed repetition evaluation result may further include good, very good, excellent, etc.

In one embodiment, when the repetition evaluation result is that the user's repetition pronunciation has not passed, the user can be prompted. When the repetition evaluation result is not passed, the user is prompted that it has not passed. In one embodiment, the prompting method can be to play a prompt tone such as "Come on" or "Keep up the good work" or other encouraging or comforting words, or to display the above-mentioned encouraging or comforting words through text. The present invention does not limit the specific method and form of the prompting, so as to avoid directly giving back the evaluation result score to the user and hitting the user's learning enthusiasm.

In one embodiment, as shown in FIG. 7 , after step 630, the above-mentioned repetition mode may further include the following steps.

Step 640: When the repetition evaluation result is that the user's repetition pronunciation fails, the user's repetition pronunciation is recorded again to obtain a repetition pronunciation.

When the user's repetition pronunciation fails, the user can be asked to repeat and record the user's repetition pronunciation again to obtain the repetition pronunciation. For sentences that the user has not mastered or has a low degree of mastery, the user's mastery can be improved through multiple exercises. In one embodiment, before re-recording the user's repetition pronunciation, the current sentence can be played again and the user's repetition pronunciation can be re-recorded to achieve further learning of the current sentence by the user.

Step 650: Compare the demonstration pronunciation with the repeated pronunciation to obtain a repetition evaluation result of the repeated pronunciation.

After recording the user's restatement pronunciation, the demonstration pronunciation is compared with the restatement pronunciation to obtain a restatement evaluation result of the restatement pronunciation.

In one embodiment, as shown in FIG. 7 , when the number of recordings does not exceed the preset fourth threshold and the last repetition evaluation result is that the corresponding repetition pronunciation does not pass, step 640 is executed again; when the number of recordings exceeds the preset fourth threshold and the last repetition evaluation result is that the corresponding repetition pronunciation does not pass, step 660 is executed.

Step 660: Provide a selection pop-up window for the user to select. The selection pop-up window includes options to skip the current sentence and record again. It should be understood that the options in the selection pop-up window can be set according to the needs of actual applications, and the present invention is not limited to this.

When the user's repetition pronunciation has not passed and the number of recordings has not exceeded the preset fourth threshold (for example, 3 times), the user can try again to avoid the failure result caused by the interference of external noise on the repetition pronunciation; and when the user's repetition pronunciation has not passed and the number of recordings exceeds the fourth threshold, a selection pop-up window can be provided for the user to choose to continue practicing or skip the current sentence.

In one embodiment, the present invention can switch the current mode to another mode according to the user's instructions. For example, if the current mode is the default reading mode, the user can manually select the listening mode to switch the current reading mode to the listening mode. By switching modes, the user's reading options can be improved, and the user can select a reading mode that suits him or her according to actual needs, thereby improving the reading effect in a more targeted manner. After switching the mode, the reading progress in the mode before switching may not be retained, that is, after switching the mode, the text to be read is re-read in the new reading mode.

In one embodiment, the default mode can be set to realize the current mode that the user defaults to when opening the reading.

The embodiment of the present invention can select any one or a combination of multiple of the above six modes according to the actual application scenario. Preferably, in one embodiment of the present invention, the above six modes are included at the same time. By setting the six modes, the user can first select the less difficult listening mode and silent reading mode to understand the content of the reading text when reading, and then select the listening mode and reading mode to learn reading ability, and finally select the rereading mode and retelling mode to repeat the reading text for memory. By using a progressive learning method, the user's reading level and ability can be gradually prompted. In particular, for users who learn foreign languages, their learning effect is better than that of a simple reading mode. Of course, it should be understood that the five modes in the embodiment of the present invention can be selected by the user according to his or her own needs, and it is not necessary to follow the above progressive order, and the embodiment of the present invention does not limit this.

Fig. 8 is a flow chart of a method for formulating evaluation criteria provided by an embodiment of the present invention. As shown in Fig. 8, the formulation of evaluation criteria for evaluating the repetition evaluation results, reading evaluation results, and listening evaluation results in the above embodiment may include the following steps.

Step 710: Obtain the user level based on the user information.

Different users have different levels of reading ability, for example, adults and children have different reading abilities. Therefore, when formulating evaluation criteria, the user's level of reading ability can be obtained based on user information. In one embodiment, the user information may include the user's age or the user's nationality. When the age and nationality of users are different, their reading abilities will be quite different. For example, it is much easier for Chinese people to read Chinese texts than for foreigners. Therefore, in general, the level of Chinese people in reading Chinese texts is significantly higher than that of foreigners.

Step 720: Establish evaluation criteria based on user level.

Different evaluation standards are formulated according to the obtained user level levels, that is, different evaluation standards are formulated according to the user's reading level level for a specific type of text to be read, so as to achieve fair evaluation.

In one embodiment, as shown in FIG8 , after step 720, the method for formulating the evaluation criteria may further include the following steps.

Step 730: Adjust the evaluation criteria based on the comprehensive evaluation results of the user within a preset time period.

Since the user information provided when registering cannot fully reflect the user's reading level, after a period of study, the user can be comprehensively evaluated and the evaluation criteria can be adjusted based on the results of the comprehensive evaluation. For example, if the user's reading level has greatly improved after studying for a period of time, the user's evaluation criteria can be appropriately raised at this time, and texts with higher reading difficulty can also be recommended to the user to encourage the user to make further progress.

In one embodiment, after the user finishes reading the current text to be read, the user is prompted to complete the reading, and other texts to be read recommended to the user are displayed. The implementation method of recommending the text to be read to the user includes: obtaining a recommended text set associated with the current reading text based on a set of search questions to be selected.

When the user is reading the current text, the user will have the need to read texts related to the text. At this time, the relevant recommended text set can be obtained based on the focus-related dimensions reflected by the candidate search question set. The recommended text set can enable users to think deeply and improve their cognition. In addition, it provides users with choices from multiple dimensions, breaks out of fixed thinking patterns, and opens up users to think in a variety of ways. In one embodiment, all historical search questions can be ranked down or up according to preset rules (for example, search times, click times, useful evaluations, etc.), and the candidate search question set that meets the first preset condition is selected. Among them, the first preset condition may include one or more combinations of the following conditions: the number of times input is greater than or equal to the first threshold and belongs to the first preset number of historical search questions with the most input times. The more times a search question is entered, the more attention it has received, the more typical it is, the more relevant it is to the current article, and the more it matches the question the user needs to search for. This can effectively shorten the time it takes for users to conceive of question editing methods and effectively answer users' search questions. By setting the first default condition, search questions of multiple dimensions that are logically relevant to the current reading text are filtered out.

FIG9 is a flow chart of a text recommendation method provided by an embodiment of the present invention. As shown in FIG9 , the recommendation method specifically includes the following steps.

Step 810: Obtain a text list of search results corresponding to each of the candidate search questions in the candidate search question set.

By searching with each of the candidate search questions in the candidate search question set as the search input condition, a list of search result texts corresponding to each candidate search question will be obtained.

Step 820: According to the number of the search questions to be selected in the search question set to be selected, filter out the first second preset number of search result texts from the search result text list corresponding to each search question to be selected and add them to the recommended text set.

Since the set of candidate search questions is obtained through screening, the number of candidate search questions that meet the first preset condition is different. According to the different number of candidate search questions in the set of candidate search questions, the first second preset number of search result texts are selected from the list of search result texts corresponding to each candidate search question to be added to the recommended article set.

For example, when the number of search questions to be selected in the set of search questions to be selected is 10, each of the 10 search questions to be selected is searched to obtain a list of search result texts corresponding to each search question to be selected, and the search result text ranked in the top 1 in each search result text list is selected to obtain 10 search result texts, and the 10 search result texts are added to the recommended text set as recommended texts. It should be understood that there is a corresponding relationship between the number of search questions to be selected and the second preset number, and the R&D personnel preset the number of search questions to be selected in the set of search questions to be selected and the second preset number in advance. In the embodiments of the present invention, there is a corresponding relationship between the number of search questions to be selected and the second preset number, and the specific values are not limited.

In one embodiment, when the number of the search questions to be selected in the search question set to be selected is 1, the second preset number is 3. When the number of the search questions to be selected in the filtered search question set to be selected is 3, each of the 3 search questions to be selected is searched to obtain a list of search result texts corresponding to each search question to be selected, and the search result texts ranked top 1 in each search result text list are filtered to obtain 3 search result texts, which are added to the recommended text set as recommended texts.

In one embodiment, when the number of the search questions to be selected in the search question set is 2 or 3, the second preset number is 2. When the number of the search questions to be selected in the filtered search question set is 2, each of the 2 search questions to be selected is searched to obtain a list of search result texts corresponding to each search question to be selected, and the search result texts ranked in the top 2 are filtered out in each search result text list to obtain 4 search result texts, which are added to the recommended text set as recommended texts.

In one embodiment, when the number of the search questions to be selected in the search question set is greater than or equal to 4, the second preset number is 1. When the number of the search questions to be selected in the search question set to be selected is N (N≥4), each of the N search questions to be selected is searched to obtain a list of search result texts corresponding to each search question to be selected, and the search result texts ranked top 1 in each search result text list are filtered to obtain N search result texts, and the N search result texts are added to the recommended text set as recommended texts.

In one embodiment, as shown in FIG. 9 , the above text recommendation method may further include the following steps.

Step 830: When the number of recommended texts in the recommended text set is less than a third preset number, a plurality of tag categories corresponding to the currently read text are obtained, wherein each tag category includes at least one tag.

Specifically, when the total number of search result texts selected according to the number of candidate questions is less than the third preset number, for example: when the number of candidate search questions in the candidate search question set is 2 or 3, 4 search result texts are obtained, then the number of recommended texts in the current recommended text set is 4, and the number of recommended texts in the recommended text set is 10 (the third preset number is 10). The number of recommended texts in the current recommended text set is considered to be unsaturated, and it is necessary to obtain recommended texts from other dimensions and continue to add them to the recommended text set. Multiple label categories corresponding to the current reading text are obtained, wherein each label category includes at least one label.

It should be understood that each text will have a default tag, and the embodiments of the present invention do not limit the specific means of obtaining each tag. These tags are divided into different tag categories according to different dimensions, and each tag category includes at least one tag. For example, the tag category may include a main viewpoint category, and the main viewpoint category includes: the same viewpoint, similar viewpoint, opposing viewpoint, and refuted viewpoint, etc.

Step 840: According to the number of tags in the tag category, filter out the first four preset number of search result texts in the search result text list corresponding to the tag and add them into the recommended text set.

Specifically, each label category contains a different number of labels, and the first four preset number of search result texts are filtered out from the search result text list corresponding to each label and added to the recommended text set.

For example, the label category is the main viewpoint category, which includes the following four labels: same viewpoint, similar viewpoint, opposing viewpoint, and refuted viewpoint. Search with each of these four labels to obtain the search result text list corresponding to the same viewpoint, the search result text list corresponding to similar viewpoints, the search result text list corresponding to opposing viewpoints, and the search result text list corresponding to refuted viewpoints. Filter the top search result texts from the corresponding search result text list, the search result text list corresponding to similar viewpoints, and the search result text list corresponding to opposing viewpoints, and obtain four search result texts, which are added to the recommended text set as recommended texts. It should be understood that there is a corresponding relationship between the number of tags in the tag category and the fourth preset number. The R&D personnel preset the number of tags in the tag category and the fourth preset number in advance. The embodiment of the present invention does not limit the number of tags in the tag category and the fourth preset number and the specific value.

In one embodiment, as shown in FIG. 9 , the above text recommendation method may further include the following steps.

Step 850: When the number of recommended texts in the recommended text set is less than the third preset number, the number of tags in the tag category with a higher priority is selected first, and the first fourth preset number of search result texts are filtered out from the search result text list corresponding to the tags in the tag category with a higher priority to add to the recommended text set.

Specifically, there is a priority between label categories. For example, the label categories include: main viewpoint label category, keyword label category, main character label category, and main character personality label category. There is a priority between these four categories. The main viewpoint label category has the highest priority, and the keyword label category, main character label category, and main character personality label category have the same priority but are all lower than the main viewpoint label category. When the number of recommended texts in the recommended text set is less than the third preset number, first, according to the number of main viewpoint labels in the main viewpoint label category, the first fourth preset number of search result texts are filtered out from the search result text list corresponding to the main viewpoint label and added to the recommended text set. After adding the recommended texts filtered out in the text list corresponding to the main label, if the number of recommended texts in the recommended text set has reached the third preset number, the filtering is stopped; if the number of recommended texts in the recommended text set is still less than the third preset number, the recommended texts are filtered out from the search result text list corresponding to the keyword label, the search result text list corresponding to the main character label category, and the search result text list corresponding to the main character personality label category according to the number of keyword labels in the keyword label category, the number of main tasks in the main character label category, and the number of main character personalities in the main character personality label category.

In one embodiment, multiple label categories include a main viewpoint category, and each main viewpoint category includes at least one main viewpoint label; step 840 may specifically include: according to the number of main viewpoint labels in the main viewpoint category, in the list of search result texts corresponding to the main viewpoint labels, filter out the first fourth preset number of search result texts and add them to the recommended text set.

Specifically, the label category is the main viewpoint category, which includes four labels: same viewpoint, similar viewpoint, opposing viewpoint and refuted viewpoint. Search with each of these four labels to obtain the search result text list corresponding to the same viewpoint, the search result text list corresponding to similar viewpoints, the search result text list corresponding to opposing viewpoints and the search result text list corresponding to refuted viewpoints. Filter the top search result texts from the corresponding search result text list, the search result text list corresponding to similar viewpoints and the search result text list corresponding to opposing viewpoints, and obtain three search result texts. The four search result texts are added to the recommended text set as recommended texts. It should be understood that there is a corresponding relationship between the number of tags in the tag category and the fourth preset number. The R&D personnel preset the number of tags in the tag category and the fourth preset number in advance. The embodiment of the present invention does not limit the number of tags in the tag category and the fourth preset number and the specific value.

In one embodiment, when the number of main idea labels in the main idea category is 1, the fourth preset number is 3, and a list of search result texts corresponding to the 1 main idea is obtained. In the list of search result texts corresponding to the main idea, the top 3 search result texts are selected to obtain 3 search result texts, and the 3 search result texts are added to the recommended text set as recommended texts.

In one embodiment, when the number of main idea labels in the main idea category is 2 or 3, the fourth default number is 2, and a list of search result texts corresponding to the 2 or 3 main idea are obtained, and the search result texts ranked in the top 2 are respectively filtered out from the list of search result texts corresponding to the 2 or 3 main idea, to obtain 4 or 6 search result texts, and the 4 or 6 search result texts are added as recommended texts to the recommended text set.

In one embodiment, when the number of main opinion labels in the main opinion category is M (M is greater than or equal to 4), the fourth preset number is 1, and a list of search result texts corresponding to the M main opinion texts is obtained. In the list of search result texts corresponding to the M main opinion texts, the search result texts ranked in the top 1 are filtered out to obtain M search result texts, and the M search result texts are added to the recommended text set as recommended texts.

In one embodiment, the tag category includes a keyword category, and each keyword category includes at least one keyword tag; step 840 specifically includes: according to the number of keyword tags in the keyword category, in the list of search result texts corresponding to the keyword tags, filter out the first fourth preset number of search result texts and add them to the recommended text set.

In one embodiment, when the number of keyword tags in the keyword category is 1, the fourth default number is 3; when the number of keyword tags in the keyword category is 2 or 3, the fourth default number is 2; when the number of keyword tags in the keyword category is greater than or equal to 4, the fourth default number is 1.

In one embodiment, multiple tag categories include a main character category, and each main character category includes at least one main character tag; step 840 specifically includes: according to the number of main character tags in the main character category, in the list of search result texts corresponding to the main character tags, filter out the first fourth preset number of search result texts and add them to the recommended text set.

In one embodiment, when the number of main character tags in the main character category is 1, the fourth default number is 3; when the number of main character tags in the main character category is 2 or 3, the fourth default number is 2; when the number of main character tags in the main character category is greater than or equal to 4, the fourth default number is 1.

In one embodiment, multiple label categories include a main character personality category, and each main character personality category includes at least one main character personality label; step 840 specifically includes: according to the number of main character personality labels in the main character personality category, filtering out the first fourth preset number of search result texts in the search result text list corresponding to the main character personality label and adding them to the recommended text set.

In one embodiment, when the number of main character personality labels in the main character personality category is 1, the fourth default number is 3; when the number of main character personality labels in the main character personality category is 2 or 3, the fourth default number is 2; when the number of main character personality labels in the main character personality category is greater than or equal to 4, the fourth default number is 1.

FIG10 is a schematic diagram of the structure of a reading aid device provided by an embodiment of the present invention. As shown in FIG10 , the reading aid device 7 comprises: a reading module 71, wherein the reading module 71 comprises: a first display unit 711, which is used to display the text to be read and highlight the current sentence sentence by sentence; a first recording unit 712, which is used to record the user's reading pronunciation; wherein the user's reading pronunciation is the user's pronunciation of the current sentence; and a first comparison unit 713, which is used to compare the demonstration pronunciation with the user's reading pronunciation to obtain a reading evaluation result of the user's reading pronunciation.

In one embodiment, the reading module 71 is further configured as follows: when the evaluation result is that the reading pronunciation fails, the user's reading pronunciation is recorded again to obtain the re-reading pronunciation; the demonstration pronunciation is compared with the re-reading pronunciation to obtain the re-reading evaluation result of the re-reading pronunciation; when the re-reading evaluation result is that the re-reading pronunciation fails, the user is prompted again; when the number of recordings does not exceed the preset first threshold value and the last reading evaluation result is that the corresponding reading pronunciation fails, record again; when the number of recordings exceeds the preset first threshold value and the last reading evaluation result is that the corresponding reading pronunciation fails, a selection pop-up window is provided for the user to choose, wherein the selection pop-up window includes options for skipping the current sentence and recording again.

The auxiliary reading device provided by the embodiment of the present invention has a first display unit 711 that displays the text to be read and highlights the current sentence sentence by sentence. The user reads the current sentence and the first recording unit 712 records the user's reading pronunciation. The first comparison unit 713 compares the demonstration pronunciation with the user's reading pronunciation and evaluates the user's reading pronunciation, which helps to improve the user's participation and learning effect. The user's reading aloud helps to improve the user's listening and speaking ability. At the same time, by evaluating the user's reading pronunciation, it can help the user to learn more targeted and master the learning content.

In one embodiment, as shown in FIG10 , the reading assisting device 7 may further include a rereading module 72, wherein the rereading module 72 includes: a second display unit 721, for displaying and playing the text to be read sentence by sentence; a hiding unit 722, for hiding the current sentence after the current sentence is played; a second recording unit 723, for recording the user's rereading pronunciation; wherein the user's rereading pronunciation is the pronunciation of the user rereading the current sentence; and a second comparison unit 724, for comparing the demonstration pronunciation with the user's rereading pronunciation to obtain a rereading evaluation result of the user's rereading pronunciation.

In one embodiment, the repeat module 72 is further configured as follows: when the evaluation result is that the repeat pronunciation has not passed, record the user's repeat pronunciation again to obtain the repeat pronunciation; compare the demonstration pronunciation with the repeat pronunciation to obtain the repeat evaluation result of the repeat pronunciation; when the repeat evaluation result is that the repeat pronunciation has not passed, prompt the user again; when the number of recordings does not exceed the preset second threshold value and the last repeat evaluation result is that the corresponding repeat pronunciation has not passed, record again; when the number of recordings exceeds the preset second threshold value and the last repeat evaluation result is that the corresponding repeat pronunciation has not passed, provide a selection pop-up window for the user to choose, wherein the selection pop-up window includes options to skip the current sentence and record again.

In one embodiment, as shown in FIG. 10 , the reading assisting device 7 may further include an audio-reading module 73, wherein the audio-reading module 73 includes: a third display unit 731, for displaying the text to be read, playing sentence by sentence and highlighting the current sentence; a third recording unit 732, for recording the user's audio-reading pronunciation; wherein the user's audio-reading pronunciation is the pronunciation of the user's audio-reading current sentence; and a third comparison unit 733, for comparing the demonstration pronunciation with the user's audio-reading pronunciation to obtain an audio-reading evaluation result of the user's audio-reading pronunciation.

In one embodiment, the listening module 73 is further configured as follows: when the evaluation result is that the listening pronunciation fails, the user's listening pronunciation is recorded again to obtain the second listening pronunciation; the demonstration pronunciation is compared with the second listening pronunciation to obtain the second listening evaluation result of the second listening pronunciation; when the second listening evaluation result is that the second listening pronunciation fails, the user is prompted again; when the number of recordings does not exceed the preset third digital threshold and the last listening evaluation result is that the corresponding listening pronunciation fails, record again; when the number of recordings exceeds the preset third digital threshold and the last listening evaluation result is that the corresponding listening pronunciation fails, a selection pop-up window is provided for the user to choose, wherein the selection pop-up window includes options for skipping the current sentence and recording again.

In one embodiment, as shown in FIG. 10 , the reading assistance device 7 may further include a silent reading module 74, wherein the silent reading module 74 includes: a fourth display unit 741 for displaying the text to be read and highlighting the current sentence.

In one embodiment, as shown in FIG. 10 , the silent reading module 74 may further include: a playing unit 742 for playing the text to be read; and a pausing unit 743 for pausing the playing of the text to be read.

In one embodiment, as shown in FIG. 10 , the reading assisting device 7 may further include a listening module 75 , wherein the listening module 75 includes: a fifth display unit 751 for displaying the text to be read, playing the text to be read sentence by sentence, and highlighting the current sentence.

In one embodiment, as shown in FIG. 10 , the listening module 75 may further include: a progress display unit 752 for displaying a playback progress bar according to the content length of the text to be read.

In one embodiment, as shown in FIG. 10 , the reading assisting device 7 may further include a retelling module 76, wherein the retelling module 76 includes: a playback unit 761, for playing the text to be read sentence by sentence; a sixth recording unit 762, for recording the user's retelling pronunciation after the current sentence is played, wherein the user's retelling pronunciation is the voice of the user retelling the current sentence; and a sixth comparison unit 763, for comparing the demonstration pronunciation with the user's retelling pronunciation to obtain a retelling evaluation result of the user's retelling pronunciation.

In one embodiment, the repetition module 76 is further configured to: when the evaluation result is that the repetition pronunciation fails, record the user's repetition pronunciation again to obtain a repetition pronunciation; compare the demonstration pronunciation with the repetition pronunciation to obtain a repetition evaluation result of the repetition pronunciation; when the repetition evaluation result is that the repetition pronunciation fails, record the user's repetition pronunciation again to obtain a repetition pronunciation; compare the demonstration pronunciation with the repetition pronunciation, To obtain the re-repetition evaluation result of the re-repetition pronunciation; when the number of recordings does not exceed the preset fourth number threshold and the last repetition evaluation result is that the corresponding repetition pronunciation does not pass, record again; when the number of recordings exceeds the preset fourth number threshold and the last repetition evaluation result is that the corresponding repetition pronunciation does not pass, provide a selection pop-up window for the user to choose; wherein the selection pop-up window includes options for skipping the current sentence and re-recording.

In one embodiment, as shown in FIG. 10 , the reading assisting device 7 may further include: a switching module 77 for switching the current module to another module.

In one embodiment, as shown in FIG. 10 , the reading assistance device 7 may further include an evaluation standard formulation module 78, wherein the evaluation standard formulation module 78 includes: a level determination unit 781, for obtaining a user level level based on user information; wherein the user information may include user age or user nationality, etc.; a standard formulation unit 782, for formulating evaluation standards based on the user level level; and a standard adjustment unit 783, for adjusting the evaluation standards based on the comprehensive evaluation results of the user within a preset time period.

In one embodiment, as shown in FIG. 10 , the reading assistance device 7 may further include a recommendation module 79, wherein the recommendation module 79 includes: a search result acquisition unit 791, for acquiring a list of search result texts corresponding to each to-be-selected search question in the to-be-selected search question set; and a recommended text acquisition unit 792, for filtering out the first second preset number of search result texts from the list of search result texts corresponding to each to-be-selected search question, according to the number of to-be-selected search questions in the to-be-selected search question set, and adding them to the recommended text set.

In one embodiment, the recommended text acquisition unit 792 may be further configured as follows: when the number of the search questions to be selected in the set of search questions to be selected is 1, the second preset number is 3. In one embodiment, the recommended text acquisition unit 792 may be further configured as follows: when the number of the search questions to be selected in the set of search questions to be selected is 2 or 3, the second preset number is 2. In one embodiment, the recommended text acquisition unit 792 may be further configured as follows: when the number of the search questions to be selected in the set of search questions to be selected is greater than or equal to 4, the second preset number is 1.

In one embodiment, the recommended text acquisition unit 792 can be further configured as follows: when the number of recommended texts in the recommended text set is less than a third preset number, multiple tag categories corresponding to the currently reading text are obtained, wherein each tag category includes at least one tag; the recommended text set construction unit 794 is used to filter out the first fourth preset number of search result texts in the search result text list corresponding to the tag according to the number of tags in the tag category, and add them to the recommended text set.

In one embodiment, the recommended text acquisition unit 792 can be further configured as follows: when the number of recommended texts in the recommended text set is less than the third preset number, the number of tags in the tag category with a higher priority is selected first, and the first fourth preset number of search result texts are selected from the search result text list corresponding to the tags in the tag category with a higher priority to add to the recommended text set.

In one embodiment, multiple label categories include a main viewpoint category, and each main viewpoint category includes at least one main viewpoint label; the recommended text acquisition unit 792 can be further configured to: according to the number of main viewpoint labels in the main viewpoint category, filter out the first fourth preset number of search result texts in the search result text list corresponding to the main viewpoint label and add them to the recommended text set.

In one embodiment, the recommended text acquisition unit 792 can be further configured as follows: when the number of main viewpoint labels in the main viewpoint category is 1, the fourth preset number is 3, and the search result text list corresponding to the 1 main viewpoint is obtained. In one embodiment, the recommended text acquisition unit 792 can be further configured as follows: when the number of main viewpoint labels in the main viewpoint category is 1, the fourth preset number is 3, and the search result text list corresponding to the 1 main viewpoint is obtained. In one embodiment, the recommended text acquisition unit 792 can be further configured as follows: when the number of main viewpoint labels in the main viewpoint category is 2 or 3, the fourth preset number is 2, and the search result text list corresponding to the 2 or 3 main viewpoints is obtained. In one embodiment, the recommended text acquisition unit 792 can be further configured as follows: when the number of main opinion labels in the main opinion category is M (M is greater than or equal to 4), the fourth preset number is 1, and a search result text list corresponding to the M main opinions is obtained.

In one embodiment, the tag category includes a keyword category, each keyword category includes at least one keyword tag; the recommended text acquisition unit 792 can be further configured to: according to the number of keyword tags in the keyword category, filter out the first fourth preset number of search result texts in the search result text list corresponding to the keyword tags and add them to the recommended text set. In one embodiment, the recommended text acquisition unit 792 can be further configured as: when the number of keyword tags in the keyword category is 1, the fourth default number is 3; when the number of keyword tags in the keyword category is 2 or 3, the fourth default number is 2; when the number of keyword tags in the keyword category is greater than or equal to 4, the fourth default number is 1.

In one embodiment, the plurality of tag categories include a main character category, and each main character category includes at least one main character tag; the recommended text acquisition unit 792 may be further configured as follows: based on the number of main character tags in the main character category, the first fourth preset number of search result texts are respectively selected from the search result text list corresponding to the main character tag and added to the recommended text set. In one embodiment, the recommended text acquisition unit 792 may be further configured as follows: when the number of main character tags in the main character category is 1, the fourth preset number is 3; when the number of main character tags in the main character category is 2 or 3, the fourth preset number is 2; when the number of main character tags in the main character category is greater than or equal to 4, the fourth preset number is 1.

In one embodiment, the plurality of label categories include a main character personality category, and each main character personality category includes at least one main character personality label; the recommended text acquisition unit 792 may be further configured as follows: based on the number of main character personality labels in the main character personality category, the first fourth preset number of search result texts are respectively selected from the search result text list corresponding to the main character personality label and added to the recommended text set. In one embodiment, the recommended text acquisition unit 792 may be further configured as follows: when the number of main character personality labels in the main character personality category is 1, the fourth preset number is 3; when the number of main character personality labels in the main character personality category is 2 or 3, the fourth preset number is 2; when the number of main character personality labels in the main character personality category is greater than or equal to 4, the fourth preset number is 1.

The electronic device according to the embodiment of the present invention is described below with reference to Fig. 11. The electronic device may be any one or both of the first device and the second device, or a stand-alone device independent of them, and the stand-alone device may communicate with the first device and the second device to receive the collected input signals from them.

FIG11 is a block diagram of an electronic device provided by an embodiment of the present invention. As shown in FIG11 , the electronic device 10 includes one or more processors 11 and a memory 12.

The processor 11 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and/or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.

The memory 12 may include one or more computer program products, which may include various forms of storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and/or cache memory, etc. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the storage medium, and the processor 11 may run the program instructions to implement the auxiliary reading method of each embodiment of the present invention described above and/or other desired functions. Various contents such as input signals, signal components, noise components, etc. can also be stored in the storage medium.

In one example, the electronic device 10 may further include an input device 13 and an output device 14, and these components are interconnected via a bus system and/or other forms of connection mechanisms (not shown).

For example, when the electronic device is the first device or the second device, the input device 13 may be a microphone or a microphone array for capturing input signals from a sound source. When the electronic device is a stand-alone device, the input device 13 may be a communication network connector for receiving collected input signals from the first device and the second device.

In addition, the input device 13 may also include, for example, a keyboard, a mouse, etc.

The output device 14 can output various information to the outside, including determined distance information, direction information, etc. The output device 14 can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.

Of course, for the sake of simplicity, only some of the components related to the present invention in the electronic device 10 are shown in FIG11 , and components such as a bus, an input/output interface, etc. are omitted. In addition, the electronic device 10 may also include any other appropriate components according to the specific application.

In addition to the above-mentioned methods and apparatus, an embodiment of the present invention may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the method of assisting reading according to various embodiments of the present invention described in the above-mentioned "Exemplary Method" section of this specification.

The computer program product may be written in any combination of one or more programming languages to write program code for performing the operations of the embodiments of the present invention, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" language or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user computing device, as a separate package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

In addition, an embodiment of the present invention may also be a storage medium on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the processor executes the steps of the method for assisting reading according to various embodiments of the present invention described in the above "Exemplary Method" section of this specification.

The storage medium may be any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or components, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fibers, a portable compact disk read-only memory (CD-ROM), an optical memory device, a magnetic memory device, or any suitable combination of the foregoing.

The above describes the basic principle of the present invention in combination with specific embodiments. However, it should be pointed out that the advantages, strengths, effects, etc. mentioned in the present invention are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required to be possessed by each embodiment of the present invention. In addition, the specific details disclosed above are only for the purpose of illustration and facilitation of understanding, not limitation, and the above details do not limit the present invention to being implemented by adopting the above specific details.

The block diagrams of the devices, apparatuses, equipment, and systems mentioned in the present invention are only illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems may be connected, arranged, or configured in any manner. Words such as "including," "comprising," "having," and the like are open-ended words, meaning "including but not limited to," and may be used interchangeably therewith. The words "or" and "and" used herein refer to the words "and/or," and may be used interchangeably therewith, unless the context clearly indicates otherwise. The word "such as" used herein refers to the phrase "such as but not limited to," and may be used interchangeably therewith.

It should also be noted that in the device, apparatus and method of the present invention, each component or each step can be decomposed and/or reassembled. Such decomposition and/or reassembly should be regarded as an equivalent solution of the present invention.

The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present invention. Therefore, the present invention is not intended to be limited to the aspects shown herein, but rather to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present invention to the form disclosed herein. Although a number of example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

110~170, 210~270, 310~360, 410~430, 510~520, 610~660, 710~730, 810~850: Steps 10: Electronic equipment 11: Processor 12: Memory 13: Input device 14: Output device 7: Reading device 71: Reading module 711: First display unit 712: First recording unit 713: First comparison unit 72: Repeat module 721: Second display unit 722: Hidden unit 723: Second recording unit 724: Second comparison unit 73: Listening module 731: Third display unit 732 :3rd recording unit 733:3rd comparison unit 74: silent reading module 741:4th display unit 742: playback unit 743: pause unit 75: listening module 751:5th display unit 752: progress display unit 76: retelling module 761: playback unit 762:6th recording unit 763:6th comparison unit 77: switching module 78: evaluation standard formulation module 781: grade determination unit 782: standard formulation unit 783: standard adjustment unit 79: recommendation module 791: search result acquisition unit 792: recommended text acquisition unit 794: recommended text set construction unit

FIG1 is a flowchart of a method for assisting reading provided by one embodiment of the present invention; FIG2 is a flowchart of a method for assisting reading provided by another embodiment of the present invention; FIG3 is a flowchart of a method for assisting reading provided by another embodiment of the present invention; FIG4 is a flowchart of a method for assisting reading provided by another embodiment of the present invention; FIG5 is a flowchart of a method for assisting reading provided by another embodiment of the present invention; FIG6 is a flowchart of a method for assisting reading provided by another embodiment of the present invention. A flowchart of a method for assisting reading provided; Figure 7 shows a flowchart of a method for assisting reading provided by another embodiment of the present invention; Figure 8 shows a flowchart of a method for formulating evaluation standards provided by an embodiment of the present invention; Figure 9 shows a flowchart of a text recommendation method provided by an embodiment of the present invention; Figure 10 shows a schematic diagram of the structure of a device for assisting reading provided by an embodiment of the present invention; Figure 11 shows a block diagram of an electronic device provided by an embodiment of the present invention.

110~130: Steps

Claims (25)

A method for assisting reading includes displaying the full text of a text to be read when a user starts reading and the current reading mode is a reading mode, and is characterized in that it also includes: highlighting the current sentence sentence by sentence; recording the user's reading pronunciation; wherein the user's reading pronunciation is the user's voice reading the current sentence; comparing the demonstration pronunciation with the user's reading pronunciation to obtain a reading evaluation result of the user's reading pronunciation, wherein the demonstration pronunciation is the standard pronunciation of the current sentence; when the reading evaluation result is that the user's reading pronunciation fails, recording the user's reading pronunciation again to obtain a second reading pronunciation; comparing the demonstration pronunciation with the second reading pronunciation to obtain a second reading pronunciation. The reading evaluation result of the pronunciation is displayed; and when the reading recording times exceeds the preset first threshold value and the last reading evaluation result is that the corresponding reading pronunciation fails, a first selection pop-up window is provided for the user to select; wherein the first selection pop-up window includes an option to skip the current sentence, wherein the reading evaluation result is determined based on the evaluation standard, and the formulation of the evaluation standard includes: obtaining the user level level according to the user information, wherein the user information includes age and nationality; formulating the evaluation standard according to the user level level, and the designation of the evaluation standard also includes: if the user's reading level improves within a preset time period, the evaluation standard is improved. The method for assisting reading as described in claim 1, wherein the first selection pop-up window also includes an option to record again. The method for assisting reading as described in claim 1, further comprising a rereading mode, wherein the rereading mode comprises: displaying and playing the text to be read sentence by sentence; hiding the current sentence after the current sentence is played; recording the user's rereading pronunciation; wherein the user's rereading pronunciation is the user's voice rereading the current sentence; and comparing the demonstration pronunciation with the user's rereading pronunciation to obtain a rereading evaluation result of the user's rereading pronunciation. The method for assisting reading as described in claim 3, wherein after obtaining the rereading evaluation result of the user's rereading pronunciation, the rereading mode further includes: when the rereading evaluation result is that the user's rereading pronunciation has not passed, recording the user's rereading pronunciation again to obtain a re-rereading pronunciation; and comparing the demonstration pronunciation with the re-rereading pronunciation to obtain a re-rereading evaluation result of the re-rereading pronunciation. The method for assisting reading as described in claim 4, wherein the rereading mode further includes: when the number of rereading recordings exceeds the preset second threshold value and the last rereading evaluation result is that the corresponding rereading pronunciation fails, a second selection pop-up window is provided for the user to select; wherein the second selection pop-up window includes options for skipping the current sentence and re-recording. The method for assisting reading as described in claim 1, further comprising a listening mode, wherein the listening mode comprises: displaying the text to be read, playing sentence by sentence and highlighting the current sentence; recording the user's listening pronunciation; wherein the user's listening pronunciation is the user's pronunciation of the current sentence; and comparing the demonstration pronunciation with the user's listening pronunciation to obtain a listening evaluation result of the user's listening pronunciation. The method for assisting reading as described in claim 6, wherein after obtaining the listening evaluation result of the user's listening pronunciation, the listening mode further includes: when the listening evaluation result is that the user's listening pronunciation fails, recording the user's listening pronunciation again to obtain a second listening pronunciation; and comparing the demonstration pronunciation with the second listening pronunciation to obtain a second listening evaluation result of the second listening pronunciation. The method for assisting reading as described in claim 7, wherein the re-recording of the user's listening pronunciation comprises: playing the current sentence again; and re-recording the user's listening pronunciation. The method for assisting reading as described in claim 7, wherein the listening mode further includes: when the number of times of listening recording exceeds the preset third digital threshold and the last listening evaluation result is that the corresponding listening pronunciation fails, a third selection pop-up window is provided for the user to select; wherein the third selection pop-up window includes the options of skipping the current sentence and recording again. The method for assisting reading as described in claim 1, further comprising a silent reading mode, wherein the silent reading mode comprises: displaying the text to be read and highlighting the current sentence. The method for assisting reading as described in claim 10, wherein the silent reading mode further comprises: playing the text to be read; and pausing the playing of the text to be read. The method for assisting reading as described in claim 1, further comprising a listening mode, wherein the listening mode comprises: displaying the text to be read, playing the text to be read sentence by sentence and highlighting the current sentence. The method for assisting reading as described in claim 12, wherein the listening mode further includes: displaying a playback progress bar according to the content length of the text to be read. The method for assisting reading as described in claim 1, further comprising a retelling mode, wherein the retelling mode comprises: playing the text to be read sentence by sentence; recording the user's retelling pronunciation after the current sentence is played; wherein the user's retelling pronunciation is the user's voice retelling the current sentence; and comparing the demonstration pronunciation with the user's retelling pronunciation to obtain a retelling evaluation result of the user's retelling pronunciation. The method for assisting reading as described in claim 14, wherein after obtaining the repetition evaluation result of the user's repetition pronunciation, the repetition mode further includes: when the repetition evaluation result is that the repetition pronunciation fails, re-recording the user's repetition pronunciation to obtain the repetition pronunciation; and comparing the demonstration pronunciation with the repetition pronunciation to obtain the repetition evaluation result of the repetition pronunciation. The method for assisting reading as described in claim 15, wherein the re-recording of the user's repeated pronunciation comprises: playing the current sentence again; and re-recording the user's repeated pronunciation. The method for assisting reading as described in claim 15, wherein the retelling mode further includes: when the number of retelling recordings exceeds the preset fourth number threshold and the last retelling evaluation result is that the corresponding retelling pronunciation fails, providing a fourth selection pop-up window for the user to choose; wherein the fourth selection pop-up window includes options for skipping the current sentence and re-recording. A device for assisting reading includes a first display unit, which is used to display the full text of a text to be read when a user starts reading and the current reading mode is a reading mode. The device is characterized in that it includes: the first display unit is also used to highlight the current sentence sentence by sentence; a first recording unit is used to record the user's reading pronunciation; wherein the user's reading pronunciation is the user's reading of the text. The first comparison unit is used to compare the demonstration pronunciation with the user's reading pronunciation to obtain a reading evaluation result of the user's reading pronunciation, wherein the demonstration pronunciation is the standard pronunciation of the current sentence, and the first comparison unit is also used to record the user's reading pronunciation again when the reading evaluation result is that the user's reading pronunciation fails to pass, and obtain a re-reading evaluation result. comparing the demonstration pronunciation with the re-read pronunciation to obtain a re-reading evaluation result of the re-read pronunciation; and when the number of reading recordings exceeds a preset first threshold value and the last reading evaluation result is that the corresponding reading pronunciation fails, providing a first selection pop-up window for the user to select, wherein the first selection pop-up window includes an option to skip the current sentence, Wherein, the reading evaluation result is determined based on the evaluation standard, and the first comparison unit is used to obtain the user level level according to the user information, wherein the user information includes age and nationality; the evaluation standard is formulated according to the user level level, and the first comparison unit is also used to improve the evaluation standard when the user's reading level improves within a preset time period. The device for assisting reading as described in claim 18, further comprising a rereading module, wherein the rereading module comprises: a second display unit for displaying and playing the text to be read sentence by sentence; a hiding unit for hiding the current sentence after the current sentence is played; a second recording unit for recording the user's rereading pronunciation; wherein the user's rereading pronunciation is the user's voice rereading the current sentence; and a second comparison unit for comparing the demonstration pronunciation with the user's rereading pronunciation to obtain a rereading evaluation result of the user's rereading pronunciation. The device for assisting reading as described in claim 18, further comprising an audio-reading module, wherein the audio-reading module comprises: a third display unit for displaying the text to be read, playing sentence by sentence and highlighting the current sentence; a third recording unit for recording the user's audio-reading pronunciation; wherein the user's audio-reading pronunciation is the user's audio of the current sentence; and a third comparison unit for comparing the demonstration pronunciation with the user's audio-reading pronunciation to obtain an audio-reading evaluation result of the user's audio-reading pronunciation. The device for assisting reading as described in claim 18, further comprising a silent reading module, wherein the silent reading module comprises: A fourth display unit, for displaying the text to be read and highlighting the current sentence. The device for assisting reading as described in claim 18, further comprising a listening module, wherein the listening module comprises: a fifth display unit for displaying the text to be read, playing the text to be read sentence by sentence and highlighting the current sentence. The device for assisting reading as described in any one of claims 18 to 22, further comprising a retelling module, wherein the retelling module comprises: a playback unit for playing the text to be read sentence by sentence; a sixth recording unit for recording the user's retelling pronunciation after the current sentence is played; wherein the user's retelling pronunciation is the user's voice retelling the current sentence; and a sixth comparison unit for comparing the demonstration pronunciation with the user's retelling pronunciation to obtain a retelling evaluation result of the user's retelling pronunciation. A storage medium storing a computer program for executing the method for assisting reading as described in any one of claims 1 to 17. An electronic device, comprising: a processor; a memory for storing instructions executable by the processor; the processor is used to execute the method for assisting reading as described in any one of claims 1 to 17.

Images