JP3182283U - Audio playback method for electronic books - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic book capable of tracing characters smoothly and at an appropriate speed.
An electronic book of the present invention includes a word data storage unit 11, a sound number storage unit 13, a voice storage unit 15, a text display unit 21, and a voice trace unit 23. The voice tracing unit 23 controls the tracing speed according to the number of sounds for each character stored in the sound number storage unit 13. For example, a control unit and a calculation unit of the electronic book function as the audio tracing unit 23. In this electronic book, the voice tracing unit 23 controls the speed of tracing the character according to the sound reproduction time of the voice storage unit 15 and the number of sounds for each character stored in the sound number storage unit 13. For this reason, it is possible to appropriately trace the character whose voice is being reproduced.
[Selection] Figure 1

Description

  The present invention relates to an electronic book and a sound reproduction method for adjusting a tracing speed according to the number of sounds for each character.

  Japanese Patent No. 4729171 discloses an electronic book device and an audio reproduction system. In this patent, for example, the color of a character is changed in synchronism with speech reading (paragraph [0100] to paragraph [0102]).

Japanese Patent No. 4729171

  In the method disclosed in Japanese Patent No. 4729171, the color of the character to be read out is changed, so that the color movement is intermittent and a smooth impression cannot be given. On the other hand, tracking of so-called karaoke lyrics has a constant speed, and correct characters cannot always be traced. In particular, Kanji has a plurality of sounds even for one character. For this reason, when text is traced at a constant speed, there is a problem that the previous part is traced before reading the kanji part.

  In view of this, an object of the present invention is to provide an electronic book capable of tracing characters smoothly and at an appropriate speed.

  The present invention basically relates to an electronic book with a sound reproduction function. This electronic book has a function of adjusting the trace speed according to the number of sounds for each character. For example, a Chinese character has multiple readings even for a single character. Therefore, if you trace Kanji and Hiragana at the same speed, you cannot trace the correct part. Since the present invention adjusts the tracing speed according to the number of sounds for each character, the corresponding character part can be traced smoothly and at an appropriate speed according to reading and voice.

  The electronic book of the present invention has a word data storage unit 11, a sound number storage unit 13, a voice storage unit 15, a text display unit 21, and a voice trace unit 23. In addition to the above-described elements, the electronic book of the present invention may appropriately include elements included in a normal electronic book. Examples of such elements are a monitor 19, an audio output unit (for example, a speaker) 25, and an audio input unit (for example, a microphone) 27.

  The word data storage unit 11 is an element for storing word data obtained by classifying the text of an electronic book into words or phrases. For example, a part of the storage unit of the electronic book functions as the word data storage unit 11.

  The sound number storage unit 13 is an element for storing the number of sounds for each character included in the word data. For example, a part of the storage unit of the electronic book functions as the sound number storage unit 13.

  The voice storage unit 15 is an element for storing voice obtained by reading out word data. For example, a part of the storage unit of the electronic book functions as the voice storage unit 15.

  The text display unit 21 is an element for controlling to display part or all of the text of the electronic book on the monitor 19 as text 17. For example, the control unit and the calculation unit of the electronic book function as the text display unit 21.

  The voice trace unit 23 is an element for displaying a portion of the text 17 displayed on the monitor 19 so as to trace a portion for reproducing the voice stored in the voice storage unit 15. The voice tracing unit 23 controls the tracing speed according to the number of sounds for each character stored in the sound number storage unit 13. For example, a control unit and a calculation unit of the electronic book function as the audio tracing unit 23.

  In this electronic book, the voice tracing unit 23 controls the speed of tracing the character according to the sound reproduction time of the voice storage unit 15 and the number of sounds for each character stored in the sound number storage unit 13. For this reason, it is possible to appropriately trace the character whose voice is being reproduced.

  The preferred electronic book of the present invention further includes a text analysis system 31. The text analysis system 31 includes a text input unit 33, a text analysis unit 35, and a sound number calculation unit 37. Since the text analysis system 31 is provided, this electronic book can automatically analyze words and phrases included in the text and measure and store the number of sounds of each character when a sentence is input. For this reason, this electronic book can format the input text so that it can be automatically reproduced. At this time, it is preferable that voice is also input to the electronic book at the same time and stored in a form corresponding to each word or phrase.

  The text input unit 33 is an element for inputting text included in the electronic book. For example, an input unit or input / output unit of an electronic book functions as the text input unit 33.

  The text analysis unit 35 is an element for analyzing the text input by the text input unit 33 into words or phrases, and is an element for outputting the analyzed words or phrases to the word data storage unit 11. The electronic book control unit 41, the calculation unit 43, and the storage unit 47 function as the text analysis unit 35.

  The sound number calculation unit 37 is an element for obtaining the number of sounds for each character included in the word or phrase analyzed by the text analysis unit. Then, the sound number calculation unit 37 outputs the obtained sound number for each character to the sound number storage unit 13. For example, the electronic book control unit 41, the calculation unit 43, and the storage unit 47 function as the sound number calculation unit 37.

  The preferred electronic book of the present invention is one in which the text display unit 21 controls the voice to be reproduced by the voice trace unit 23 or the phrase being reproduced is highlighted on the monitor 19. Since the phrase in which the sound is reproduced is highlighted, the user can understand which part of the sound is reproduced.

  A preferred electronic book of the present invention is one in which the voice tracing unit 23 has a text guidance creating unit 29. The text guidance creation unit 29 controls the voice display unit 30 so that the voice is reproduced or the guidance display 30 is displayed near the character being reproduced. Examples of characters are letters or words. An example of the guidance display 30 is a translucent icon that is positioned on the character on which the voice is being played or being played. Since the guidance display 30 is displayed near the character from which the sound is reproduced, the user can understand which character the sound is reproducing.

  ADVANTAGE OF THE INVENTION According to this invention, the electronic book which can trace a character smoothly and at an appropriate speed can be provided.

FIG. 1 is a block diagram for explaining elements of an electronic book according to the present invention. FIG. 2 is a block diagram for explaining a computer included in the electronic book of the present invention. FIG. 3 shows an example of text displayed on the monitor. FIG. 4 is a display example in which a portion where sound is reproduced is highlighted. FIG. 5 is a diagram illustrating a state in which the guidance display moves in the part “this world” in the text. FIG. 6 is a diagram illustrating how the guidance display moves in the “necessary” portion of the text. FIG. 7 is a block diagram of an electronic book having a text analysis system. FIG. 8 is a diagram illustrating an example of an electronic book realized using a mobile terminal. FIG. 9 is a diagram illustrating an example of an electronic book on which an image or a moving image related to the text is displayed.

  FIG. 1 is a block diagram for explaining elements of an electronic book according to the present invention. As shown in FIG. 1, this electronic book includes a word data storage unit 11, a sound number storage unit 13, a voice storage unit 15, a text display unit 21, and a voice trace unit 23. In addition to the above-described elements, the electronic book of the present invention may appropriately include elements included in a normal electronic book. Examples of such elements are a monitor 19, an audio output unit (for example, a speaker) 25, and an audio input unit (for example, a microphone) 27. The contents of electronic books are texts, novels, books and their readings. Another example of e-book content is lyrics and songs. Another example of e-book content is video narration with a video background and video dialogue.

  The electronic book according to the present invention displays characters on a display and reproduces sound related to the displayed characters. The electronic book in the present invention may be a portable terminal capable of browsing books and texts. The electronic book in the present invention may be implemented by installing a predetermined program in a computer.

  FIG. 2 is a block diagram for explaining a computer included in the electronic book of the present invention. As shown in FIG. 2, the computer includes a control unit 41, a calculation unit 43, an input / output unit 45, and a storage unit 47. Each element is connected so that information can be exchanged via the bus 49. The storage unit 47 stores a control program. When information is input from the input / output unit 45, the control unit 41 reads a control program stored in the storage unit 47. And the control part 41 reads the information memorize | stored in the memory | storage part 47 suitably based on the instruction | command of the read control program, and makes the calculating part 43 perform a calculation process. And the control part 41 memorize | stores in the memory | storage part 47 suitably the information calculated | required by the calculating part. On the other hand, the control unit 41 appropriately outputs information obtained by calculation by the calculation unit from the input / output unit 45. As described above, the electronic book of the present invention can be equipped with a necessary function for functioning as an electronic book by a computer.

  The word data storage unit 11 is an element for storing word data obtained by classifying the text of an electronic book into words or phrases. For example, a part of the electronic book storage unit 47 functions as the word data storage unit 11. The example of the text of an electronic book is all or part of the character group contained in a novel. Another example of e-book text is lyrics. The word data storage unit 11 may also store the number of characters included in each word or phrase.

  FIG. 3 shows an example of text displayed on the monitor. In the example shown in FIG. 3, the text including the character string “no one who needs me in this world” is displayed on the monitor. Then, word data for performing such display is stored in the word data storage unit 11. An example of the phrase may be a natural part (that is, a part that can be pronounced by separating words) by inserting “,” for example. The word data storage unit 11 may store text separately for each word, such as “this”, “world”, and “de”. The word data storage unit 11 may phrase a text such as “in this world” or “a person who needs me in this world”. Also, any combination of multiple characters may be used as a phrase. For example, the number of characters included in “in this world” is four characters.

  The sound number storage unit 13 is an element for storing the number of sounds for each character included in the word data. For example, a part of the electronic book storage unit 47 functions as the sound number storage unit 13. The sound number storage unit 13 stores the number of sounds for each character included in the word data as shown in Table 1 below, for example. For example, the character may be character by character. In addition, a word that is usually pronounced at once may be a single character. That is, for example, “necessary” may be treated as two characters such as “necessary” and “necessary”, or may be treated as one character including “necessary” and two characters.

  In the above example, two kanji characters ("bo" and "ku") are assigned to each kanji character "I". In the above example, “Necessary” is treated as one character. However, “necessary” may be divided into “necessary” and “necessary” and the number of sounds may be set to 2, for example. As described above, each character is preferably stored in association with an ID (identification number).

  The voice storage unit 15 is an element for storing voice obtained by reading out word data. For example, a part of the electronic book storage unit 47 functions as the voice storage unit 15. When the text is a sentence, for example, the read voice is stored in the voice storage unit 15. For example, the voice storage unit 15 may store a voice obtained by reading a text such as a novel, or may store a voice for each character. Further, a series of sounds may be segmented and stored for each character. When the text is lyrics, the singing voice corresponds to the voice. Therefore, the singing voice is stored in the voice storage unit 15. In any case, it is preferable that the above-mentioned ID is stored in association with the voice part related to the ID of the corresponding word.

  For example, for the voice “No one needs me in this world”, each character part (for example, “ko”, “no” ...) or at least the beginning of the sentence Is preferably stored in association with an ID corresponding to the character. Since the ID corresponding to this character exists, the display of the text can be traced in synchronization with the reproduction of the voice. Tracing the display of the text means that a display effect is brought about so that the user can visually recognize the reproduced text portion in accordance with the timing at which the sound is reproduced.

  The text display unit 21 is an element for controlling to display part or all of the text of the electronic book on the monitor 19 as text 17. For example, the control unit 41 and the calculation unit 43 of the electronic book function as the text display unit 21.

  Elements for displaying character data on a display including a monitor are already known. For example, character data is converted into a format that can be displayed on a monitor and temporarily stored in a frame buffer. The character data can be displayed on the monitor by reading the data converted into an appropriate format from the frame buffer. The text display unit 21 is preferably one in which the voice is reproduced by the voice trace unit 23 or the phrase being reproduced is highlighted. In the example of FIG. 3, after the control unit of the electronic book reads out information related to the phrase stored in the word data storage unit 11 and is reproduced next time or corresponding to the sound being reproduced, and appropriately converted. , Display the phrase on the monitor.

  FIG. 4 is a display example in which a portion where sound is reproduced is highlighted. In the example of FIG. 4, the character “That World” is emphasized over other characters. As a method for emphasizing the phrase from other characters, a known method may be adopted as appropriate. As an example, emphasized characters (for example, characters whose character color is different from other parts, characters that are thicker than others, characters that are larger in size) are stored in correspondence with the phrase IDs assigned to each phrase. The highlighted character may be read out and displayed on the monitor using the phrase ID relating to the phrase corresponding to the next reproduced or reproduced voice.

  The voice trace unit 23 is an element for displaying a portion of the text 17 displayed on the monitor 19 so as to trace a portion for reproducing the voice stored in the voice storage unit 15. The voice tracing unit 23 controls the tracing speed according to the number of sounds for each character stored in the sound number storage unit 13. For example, a control unit, a calculation unit, and a storage unit of an electronic book function as the audio tracing unit 23.

  For example, the control unit 41 of the electronic book controls the timing at which the audio stored in the audio storage unit 15 is reproduced. The ID attached to the voice stored in the voice storage unit 15 is read out, and further, the ID of each word data stored in the word data storage unit 11 is read out. Then, the portion having the ID of the word data corresponding to the ID for reproducing the sound is traced. As will be described later, the trace example is provided on the character corresponding to the guidance display 30. Another example of a trace is to highlight a phrase in which sound is played. For example, a phrase in which sound is reproduced may be traced by reducing the color of text other than the phrase in which sound is reproduced.

  A preferred electronic book of the present invention is one in which the voice tracing unit 23 has a text guidance creating unit 29. The text guidance creation unit 29 controls the voice display unit 30 so that the voice is reproduced or the guidance display 30 is displayed near the character being reproduced. An example of the guidance display 30 is a translucent icon that is positioned on the character on which the voice is being played or being played. An example of the icon shape is a circle (including an ellipse).

  As shown in FIG. 4, an example of the voice trace is that a translucent guidance display 30 corresponding to the voice to be reproduced is positioned on a character (for example, an emphasized character) on the monitor, and as the voice is reproduced, The guidance display 30 is moved.

  FIG. 5 is a diagram illustrating a state in which the guidance display moves in the part “this world” in the text. FIG. 5 shows how the guidance display 30 moves in accordance with the passage of time from the top to the bottom. As shown in FIG. 5, the icon (reading bubble) that functions as the guidance display 30 moves as the sound is reproduced. A preferred example of the electronic book of the present invention is one in which the guidance display 30 moves continuously as shown in FIG. Since the guidance display 30 moves continuously, a smooth impression can be given to the user of the electronic book.

  The voice trace unit 23 controls the trace unit to move in a space (area) assigned to each text. The moving speed at this time may be obtained based on the time during which the trace moves in the space allocated to each of the above texts.

  FIG. 6 is a diagram illustrating how the guidance display moves in the “necessary” portion of the text. The “necessary” part includes two characters. On the other hand, the “necessary” portion includes four numbers of “hitsuyo”. The voice tracing unit 23 reads the number of characters “2” “necessary” from the word data storage unit 11. On the other hand, the voice tracing unit 23 reads information of four sounds, which is the number of sounds included in “hitsuyo”, from the sound number storage unit 13. Then, the voice tracing unit 23 obtains 2/4 = 0.5, and obtains a calculation result that makes the speed of tracing the voice of the “necessary” part 0.5 times the normal speed. Then, the voice tracing unit 23 controls to perform voice tracing according to the obtained trace speed information of 0.5 times.

  Further, the electronic book may calculate the trace speed using the number of sounds stored in association with each ID in the word data storage unit 11. For example, the voice storage unit 15 stores the reproduction time TT [seconds] for each phrase. Then, the number of sounds of each character included in the phrase is summed. In this calculation, the text ID included in each phrase is read using the phrase ID, and the number of characters stored in the word data storage unit 11 in association with the ID is read to obtain the sum. This number of sounds is SS [sound]. Then, the electronic book performs a calculation to divide the reproduction time for each phrase (TT [seconds]) by the sum of the number of sounds included in a certain phrase (SS [sound]). Then, it can be said that TT / SS obtained is the number of seconds per sound. When tracing the text 17 displayed on the monitor 19, the voice tracing unit 23 reads information on the number of sounds of each character from the word data storage unit 11 and multiplies it by TT / SS, and is assigned to each text. The time for the trace to move in space can be determined.

  In this electronic book, the voice tracing unit 23 controls the speed of tracing the character according to the sound reproduction time of the voice storage unit 15 and the number of sounds for each character stored in the sound number storage unit 13. For this reason, it is possible to appropriately trace the character whose voice is being reproduced.

  FIG. 7 is a block diagram of an electronic book having a text analysis system. As shown in FIG. 7, this electronic book has all the elements described above and further has a text analysis system 31. The text analysis system 31 includes a text input unit 33, a text analysis unit 35, and a sound number calculation unit 37.

  The text input unit 33 is an element for inputting text included in the electronic book. For example, the input unit or input / output unit 45 of the electronic book functions as the text input unit 33. Information including text is input to the electronic book via the input / output unit 45. Then, the text input unit 33 appropriately stores the text in the storage unit 47 based on a command from the control unit 41.

  The text analysis unit 35 is an element for analyzing the text input by the text input unit 33 into words or phrases. The electronic book control unit 41, the calculation unit 43, and the storage unit 47 function as the text analysis unit 35. For example, the storage unit 47 has a database of words including words, particles, or phrases. The text analysis unit 35 sequentially reads text from the storage unit 47. Then, the text is analyzed into a word or phrase by comparing the read text portion with a word, particle or phrase included in the database. Note that devices for analyzing such text into words or phrases are well known. Therefore, the present invention can use a known text analysis device as the text analysis unit 35. The text analysis unit 35 appropriately adds an ID to the analyzed word or phrase, and outputs the word or phrase to the word data storage unit 11 as word data. Then, the word data storage unit 11 stores this word data.

  The sound number calculation unit 37 is an element for obtaining the number of sounds for each character included in the word or phrase analyzed by the text analysis unit 35. Then, the sound number calculation unit 37 outputs the obtained sound number for each character to the sound number storage unit 13. For example, the electronic book control unit 41, the calculation unit 43, and the storage unit 47 function as the sound number calculation unit 37. For example, the storage unit 47 stores a word or phrase, a character included in each word or phrase, and the number of sounds for each character. The sound number calculation unit 37 receives word data (including words or phrases) from the text analysis unit 35 or reads the words or phrases analyzed by the text analysis unit 35 from the storage unit. Then, the sound number calculation unit 37 compares each word or phrase with the word or phrase included in the storage unit 47 and reads the sound number for each character included in the storage unit 47. In this way, the sound number calculation unit 37 can obtain the sound number for each character included in the word or phrase. The character may be a letter, a word, or a phrase. Next, the sound number calculation unit 37 outputs the obtained sound number for each character to the sound number storage unit 13. Then, the sound number storage unit 13 stores the number of sounds for each character.

  When voice is input from the voice input unit 27, the voice is stored in the voice storage unit 15. A preferred example of this system has a voice recognition unit (not shown). Devices for recognizing speech and converting it into text are already known (for example, Japanese Patent No. 3686934, Japanese Patent No. 3709436). Accordingly, in a preferred example of the present invention, the input speech may be converted into text using a known device and method. Then, the input text is matched with the voice, and the same ID assigned to the text is attached to the voice and stored in the voice storage unit 15. By doing so, it is possible to connect the voice input from the voice input unit 27 and the text input from the text input unit 33. For this reason, the electronic book of the present invention can output voice in synchronism with the reproduction of text even for the input voice.

  FIG. 8 is a diagram illustrating an example of an electronic book realized using a mobile terminal. As shown in FIG. 8, the electronic book can be realized as a portable terminal. Examples of the mobile terminal are a mobile phone, a smartphone, a PDA, a laptop computer, and IPad (registered trademark). A portable terminal is not limited to these.

  FIG. 9 is a diagram illustrating an example of an electronic book on which an image or a moving image related to the text is displayed. The example shown in FIG. 9 further includes a video database that stores images or moving images. An image or a moving image is stored in the video database in association with the ID attached to the text, phrase or word. For this reason, when audio is reproduced, for example, the phrase related to the audio is emphasized by using the ID of the audio part to be reproduced, and included in the phrase or the phrase by using the ID of the audio part to be reproduced. An image or a moving image related to the word to be read is read from the video database and processed so that it can be displayed on the monitor. For this reason, the electronic book of this aspect can display not only text but also images or moving pictures related to voice in association with voice. In the example shown in FIG. 9, when audio is played for a phrase “a cat on the box”, a phrase “a cat on the box” is displayed from the surrounding text. It is highlighted with black letters, and the guidance display moves the phrase part "There is a cat on the box." Correspondingly, an image or moving image relating to the presence of a cat on the box is read from the video database, and an image or moving image relating to the presence of the cat on the box is displayed on the second monitor. The example in FIG. 9 is an example using a so-called two-screen game machine. In this example, the text, the highlighted phrase, and the guidance display are displayed on the first screen, and the image or the moving image is displayed on the second screen. On the other hand, in the case of an electronic book with a single monitor, when an input for switching the screen is made, the screen may be converted from a screen showing text, highlighted phrases, and guidance display to a screen showing an image or a moving image. .

  Since the present invention relates to electronic books, it can be used in the home appliance industry.

DESCRIPTION OF SYMBOLS 11 Word data memory | storage part 13 Sound number memory | storage part 15 Voice memory | storage part 17 Text 19 Monitor 21 Text display part 23 Voice tracing part 25 Voice output part 27 Voice input part 29 Text guidance preparation part 30 Guidance display 31 Text analysis system 33 Text input part 35 Text analysis unit 37 Sound number calculation unit 41 Control unit 43 Calculation unit 45 Input / output unit 47 Storage unit 49 Bus

Claims (4)

A word data storage unit (11) for storing word data obtained by classifying the text of the electronic book into words or phrases;
A sound number storage unit (13) for storing the number of sounds for each character included in the word data;
A voice storage unit (15) for storing voice of the word data read aloud;
A text display section (21) for displaying the text (17) on a monitor (19);
An audio tracing unit (23) for displaying a portion of the text (17) displayed on the monitor (19) to reproduce the portion of the audio stored in the audio storage unit (15), and
A text analysis system (31);
Have
An electronic book with the audio playback function,
The voice trace unit (23)
The tracing speed is controlled according to the number of sounds for each character stored in the sound number storage unit (13),
The text analysis system (31)
A text input unit (33) for inputting text included in the electronic book;
A text analysis unit (35) that analyzes the text input by the text input unit (33) into words or phrases, and outputs the analyzed words or phrases to the word data storage unit (11);
A sound number calculation unit (37) for obtaining the number of sounds for each character included in the word or phrase analyzed by the text analysis unit (35), wherein the obtained sound number for each character is stored in the sound number storage unit (13). Output to
Have
E-book. The electronic book according to claim 1,
The text display unit (21) controls the voice to be reproduced by the voice tracing unit (23) or the phrase being reproduced is highlighted on the monitor (19).
E-book. The electronic book according to claim 1,
The voice tracing unit (23) has a text guidance creating unit (29),
The text guidance creation unit (29) controls the voice tracing unit (23) to reproduce the voice or display the guidance display (30) in the vicinity of the character being reproduced.
E-book. The electronic book according to claim 3,
The guidance display (30) is a translucent icon located on the character where the voice is played or being played,
E-book.

Images