JP2014215415A - Voice output system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an inexpensive voice output system capable of easily reproducing a phrase written in a paper book in a selected language.SOLUTION: A voice output system (100) is configured to output voice data for a paper book (110) consisting of a phrase including second languages as the translation of one sentence or the like written in a first language and a track having a plurality of phrases. The voice output system includes: an input part (121); a voice output part (122a) for outputting the voice data; a transmission/reception part connected to the Internet for transmitting/receiving the voice data; and a storage part for storing the voice data. The input part includes: capturing means for capturing the voice data in the storage part: phrase selection means for selecting a phrase; and mode selection means for selecting a language to be output. The voice output part outputs a voice on the basis of the selected phrase and the selected mode.

Description

  The present invention relates to an audio output system that outputs a phrase described in a paper book in a selected language.

  In a paper book for language learning, voice data is recorded on a CD (Compact Disk), and the CD is attached to the paper book and sold. However, a CD has only a single layer, and there is a limit of 99 tracks that can be arranged in that layer. Therefore, when performing detailed settings for playback methods such as playback for each phrase described in a paper book or playback for each language, one track is used for each phrase, and all the phrases described in the paper book are stored one sheet. Because it is difficult to fit in a CD, audio data had to be put in a plurality of CDs.

  On the other hand, for example, Patent Document 1 discloses that a voice of a predetermined phrase is output by bringing a voice pen having voice data into contact with an icon of a sheet on which a plurality of icons having dot codes are described. . According to this method, a predetermined phrase and its language can be easily selected, and the number of phrases is not limited.

Noto 3179231

However, in Patent Document 1, a person who wants to purchase a paper book must also purchase a voice pen, which imposes a financial burden on the purchaser. In addition, the phrase cannot be played continuously, and there are functional limitations.
Accordingly, an object of the present invention is to provide an audio output system capable of easily reproducing a phrase described in a paper book in a selected language using a portable terminal or the like.

  The audio output system includes a phrase including a second language that is a translation of one word, one sentence, or one paragraph for one word, one sentence, or one paragraph described in a first language, and a track that includes a plurality of phrases. An audio output system that outputs audio data for a plurality of paper books. This audio output system includes an input unit that inputs predetermined information via a display, an audio output unit that outputs audio data, a transmission / reception unit that is connected to the Internet and transmits / receives audio data, and is received via the transmission / reception unit. A storage unit that stores audio data, and an input unit that identifies a paper book and takes in audio data corresponding to the paper book into the storage unit, and a track that selects a track and phrase of the paper book Phrase selection means and mode selection means for selecting a first mode for outputting only the first language, a second mode for outputting only the second language, or a third mode for outputting the first language and the second language. Based on the phrase selected by the phrase selecting means and the mode selected by the mode selecting means, the sound output unit outputs sound.

  In the voice output system, at the input unit, at least one of the order of outputting the voice of the selected language and the playback speed of the voice are input.

Furthermore, the audio output system includes an input unit, an audio output unit, a transmission / reception unit, and a storage unit in one portable terminal.
Further, in the audio output system, the track / phrase selecting means displays the table of contents of the paper book on the input unit of the audio output device, and selects audio data of a predetermined phrase from the table of contents.
In the audio output system, the track / phrase selection means selects the page number of the paper book, and further selects the phrase described on the selected page.

The voice output system includes a voice detection unit that receives voice and decodes a phrase of the voice.
Furthermore, the audio output system outputs a sound in which a plurality of phrases are selected by the track / phrase selecting means, and one phrase arbitrarily selected from the selected plurality of phrases is output in sound in the first language. After the output, the speech detection unit has a test mode in which a speech that is pronounced in the second language is input to the speech detection unit, and it is determined whether the translation of the phrase input by speech is correct.

  ADVANTAGE OF THE INVENTION According to this invention, the audio | voice output system which is cheap and can reproduce | regenerate easily the phrase described in the paper book in the selected language can be provided.

1 is a diagram showing a schematic configuration of an audio output system 100. FIG. (A) is the figure which showed the hierarchy of the audio | voice data 131. FIG. FIG. 2B is a configuration diagram of the mobile terminal 120. 3 is a flowchart illustrating an operation procedure of the audio output system 100. (A) is a top view of the portable terminal 120 in which the names of a plurality of paper books are displayed on the input unit 121. FIG. 5B is a plan view of the mobile terminal 120 in which a track number and phrase number selection screen is displayed on the input unit 121. 4 is a plan view of the mobile terminal 120 on which a playback language selection screen is displayed on an input unit 121. FIG. (A) is a top view of the portable terminal 120 with the playback speed adjustment screen displayed on the input unit 121. FIG. FIG. 6B is a plan view of the mobile terminal 120 in which a playback order adjustment screen is displayed on the input unit 121. (A) is a diagram showing a table of contents page of the paper book 210. FIG. FIG. 6B is a plan view of the mobile terminal 120 in which a table of contents setting screen is displayed on the input unit 121. 4 is a plan view of the mobile terminal 120 on which a voice detection function setting screen is displayed on an input unit 121. FIG. (A) is the flowchart in which the execution procedure of the test function was shown. (B) is a top view of the portable terminal 120 on which the test function setting screen is displayed.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. It should be noted that the scope of the present invention is not limited to these forms unless otherwise specified in the following description.

(First embodiment)
<Configuration of Audio Output System 100>
FIG. 1 is a diagram showing a schematic configuration of an audio output system 100. The voice output system 100 is a system that, for example, is for language learning and outputs a phrase of a paper book 110 in which a predetermined phrase is written in a plurality of languages in a plurality of languages. The phrase is, for example, one word, one sentence, or one paragraph. The phrase is included in a track composed of a plurality of phrases. As an example of the phrase and the track, for example, if the track is a series of conversation sentences, the phrase is a sentence in the conversation sentence. At this time, each phrase is expressed in a plurality of languages such as Japanese and English.

  In the audio output system 100, for example, audio is output from the mobile terminal 120. The mobile terminal 120 is a smartphone, for example. Hereinafter, the mobile terminal 120 will be described as a smartphone. The portable terminal 120 has, on one main surface, an input unit 121 formed by a flat panel display, an audio output unit 122a that outputs audio, and an audio detection unit 125 that receives audio and decodes the audio. 2 (b)), a transmission / reception unit 124 (see FIG. 2 (b)) connected to a network such as a cloud (cloud computing) 130 and receiving predetermined audio data 131, and the received audio data 131. And a storage unit 126 (see FIG. 2B) for storing. The voice data 131 includes a phrase of the paper book 110 and a voice that is a translation thereof. For example, when a phrase is expressed in Japanese in the paper book 110 and the phrase is also expressed in English as a translation thereof, the audio data 131 indicates the Japanese and English sounds of the phrase described in the paper book 110. Including. The voice detection unit 125 includes a voice input unit 123 that is a microphone into which voice is input from the outside. The sound may be output by the sound output unit 122a that is a speaker, or may be output by the sound output unit 122b that is a headphone. The input unit 121 that is a flat panel display is formed by a touch panel or the like that can input predetermined information by touching a screen, for example. In addition to a flat panel display, a flexible display having a curved surface may be used.

  FIG. 2A is a diagram illustrating a hierarchy of audio data 131 of a certain paper book 110. The audio data 131 of the paper book 110 has a hierarchical structure composed of a plurality of hierarchies. For example, as shown in FIG. 2A, the audio data 131 has a plurality of tracks. This track is arranged as the first hierarchy. Moreover, when the track is composed of different conversation sentences (one sentence), each track includes a plurality of phrases. This phrase becomes the second hierarchy. Furthermore, each phrase is expressed in a plurality of languages such as Japanese, Chinese and English. The plurality of languages are arranged as the third hierarchy. In FIG. 2A, the audio data 131 is composed of 10 tracks from track 1 to track 10, track 1 is composed of five phrases 1 to 5, and phrase 1 is expressed in Japanese and English. It shows that. In FIG. 2A, only the hierarchy of track 1 and phrase 1 is shown, but the other tracks and phrases also have the same hierarchical structure.

  FIG. 2B is a configuration diagram of the mobile terminal 120. In the input unit 121, various information is input to instruct the portable terminal 120, and various information is displayed. In the portable terminal 120, the transmission / reception unit 124 downloads the audio data 131 from the cloud 130 according to the command input to the input unit 121, and stores it in the storage unit 126. The audio data 131 stored in the storage unit 126 is output as audio from the audio output unit 122 a or the like according to a command from the input unit 121. In addition, the voice detection unit 125 analyzes the voice taken in via the voice input unit 123 according to a command from the input unit 121 and detects the voice. Furthermore, the voice detection unit 125 determines whether or not the captured voice phrase matches the phrase of the paper book 110.

<Operation Procedure of Audio Output System 100>
FIG. 3 is a flowchart showing an operation procedure of the audio output system 100. Hereinafter, the operation procedure of the audio output system 100 will be described with reference to the flowchart of FIG.

  In step S <b> 101 of FIG. 3, the operator activates application software installed on the mobile terminal 120. Application software for the audio output system 100 is installed in the portable terminal 120 in advance, and the operator activates the application software when starting to use the audio output system 100.

  In step S102, it is determined whether or not the audio data 131 of the paper book 110 has been downloaded. If the audio data 131 has not been downloaded, the process proceeds to step S103, and if the audio data 131 has been downloaded, the process proceeds to step S105.

  In step S <b> 103, the operator connects to the cloud 130 via the transmission / reception unit 124 (see FIG. 2B) of the mobile terminal 120 and specifies the paper book 110 for downloading the audio data 131 on the cloud 130. . For example, the paper book 110 is specified by searching for the book name or ISBN code of the paper book 110 on the cloud 130.

  In step S104, the audio data 131 of the paper book 110 identified in step S103 is downloaded from the cloud 130 to the storage unit 126. The downloaded audio data 131 is placed in a state where the audio data 131 can be reproduced. After step S104, the process proceeds to step S106.

  In step S <b> 105, the operator selects one paper book 110 to be used from the sound data of the paper book stored in the mobile terminal 120, and puts the sound data 131 of the paper book 110 into a state where it can be reproduced.

  FIG. 4A is a plan view of the mobile terminal 120 in which names of a plurality of paper books are displayed on the input unit 121. The input unit 121 shows the titles of a plurality of paper books whose audio data is stored in the storage unit 126. In step S105 of FIG. 3, the operator selects a title of a book to be reproduced (used) from those displayed on the flat panel display. As an example, FIG. 4A shows a state where the operator has selected the title of the book name “English book 1”.

  In step S106, the track number and phrase number used by the paper book 110 specified in step S103 or selected in step S105 are selected. FIG. 4B shows the track / phrase selection means of the audio output system 100.

  FIG. 4B is a plan view of the mobile terminal 120 in which a track number / phrase number selection screen is displayed on the input unit 121. Above the input unit 121, a track number display unit 141 indicating a track number is shown. A three-digit dial is displayed on the track number display unit 141, and when a digit such as an operator's finger is touched and moved up and down, the number on the dial rotates. The operator specifies the track number by rotating the three-digit dial. FIG. 4B shows a state where “058” is selected as the track number. In addition, the input unit 121 includes a phrase number display unit 142 indicating a phrase number below the track number. A three-digit dial is displayed on the phrase number display unit 142. When a digit such as an operator's finger is touched and moved up and down, the number on the dial is rotated. The operator specifies the track number by rotating the three-digit dial. FIG. 4B shows a state where “002” is selected as the phrase number.

  As shown in FIG. 4B, the track number and the phrase number are selected by the input unit 121, and the audio data 131 to be output as audio is specified. On the other hand, audio output may be performed for each track. In this case, the phrase number may not be selected. In consideration of such audio reproduction for each track, for example, when inputting a phrase number, click on the “phrase number” icon 143 to light it for a certain period of time, indicating that the phrase number is to be input, and then the phrase number May be input. In other words, when the “phrase number” icon 143 is lit, the entered phrase number is valid, and when it is not input for a certain period of time, all the phrases included in the track number are valid. become. Although not specifically shown, all phrases included in the track number may be validated using a dial “−” (horizontal bar) without a number.

  In step S107, the language in which the track or phrase selected in step S106 is output as audio is selected. In step S107, the language to be used is selected, and the order of reproducing the language is selected.

  FIG. 5 is a plan view of the mobile terminal 120 on which a playback language selection screen is displayed on the input unit 121. On the reproduction language selection screen, the language in which the audio data is reproduced and the order thereof are input. For example, the language playback order 144 is displayed on the left side of the screen, and the playback language 145 is displayed on the right side thereof. The number displayed in the language playback order 144 indicates the language playback order, and the language displayed in the playback language 145 on the right side is played back. For the playback language 145, for example, one language is selected from a drop-down list. In the example shown in FIG. 5, the track or phrase selected in step S106 is first played back in Japanese and then played back in English. For example, if the mode for outputting only Japanese is the first mode, the mode for outputting only English is the second mode, and the mode for outputting Japanese and English is the third mode, FIG. 5 shows the reproduction of the third mode. Will be done. That is, the screen shown in FIG. 5 corresponds to mode selection means for selecting a language to be used. On the other hand, in FIG. 5, reproduction in the first mode or the second mode may be performed by setting the designated language only in the first language reproduction order 144. Although not shown, another mode may be provided in which playback is first performed in Japanese, then played back in English, and then played back in Chinese. The audio data is reproduced when the operator presses the reproduction button 146 shown in FIG.

  As described above, in the voice output system 100, a consumer uses an expensive device such as a voice pen by causing the voice data to be output using the mobile terminal 120 that is believed to be owned by many people. There is no need to purchase. Therefore, the audio output system 100 of the present invention is easy to use for many people. Also, in the audio system 100, the number of tracks is not limited, unlike a CD (Compact Disk) or the like. Since there are no restrictions on the number of tracks, a plurality of hierarchies are formed in detail, so that detailed reproduction such as one sentence or one word can be easily performed. Furthermore, since the audio data 131 is formed in a plurality of layers, the phrase selection is complicated. However, the phrase for audio output can be set easily and quickly using the track / phrase selection means and the mode selection means. Can do.

  In the above description, the mobile terminal 120 is described as an example of a smartphone, but a mobile music player, a tablet terminal, or the like may be used as the mobile terminal 120. Further, three or more languages may be used. For example, in FIG. 5, when Chinese is selected in the third language playback order 144 instead of Japanese, audio data is played back in the order of Japanese, English, and Chinese for a predetermined phrase. .

(Second Embodiment)
The audio output system 100 has various functions in addition to the functions shown in the first embodiment. Examples of various functions other than the functions shown in the first embodiment will be described below. Moreover, in the following description, the same part as 1st Embodiment is represented using the same code | symbol, and the description is abbreviate | omitted.

<Playback speed adjustment function>
In the audio output system 100, for example, the language playback speed may be set. As a result, a good language increases the reproduction speed, and when audio data is reproduced in a language that is not good, the reproduction speed of the language is slowed down to make it easy to hear.

  FIG. 6A is a plan view of the mobile terminal 120 in which a playback speed adjustment screen is displayed on the input unit 121. In the playback speed display screen of FIG. 6 (a), the speeds of Japanese, English, and Chinese are individually adjusted. Japanese is 1.5 times the normal speed, and English is A state in which the normal speed is set to 0.8 times normal speed and Chinese is set to 0.5 times normal speed is shown. These speed adjustments are performed, for example, by moving the tab 147 left and right.

<Playback order setting function>
The audio output system 100 can also reproduce a plurality of designated phrases and tracks in succession. First, if the operator sets a plurality of tracks and a plurality of phrases to be reproduced, it is possible to save the trouble of resetting the phrases every time.

  FIG. 6B is a plan view of the mobile terminal 120 in which the playback order adjustment screen is displayed on the input unit 121. On the playback order setting screen, a plurality of tracks, a plurality of phrases, and a playback order thereof are set. A track / phrase playback order 148 is shown at the left end of the setting screen. The number indicated by the track / phrase playback order 148 is the playback order of the track or phrase. The track number and the phrase number indicate the track number and the phrase number of the paper book 110 as described in FIG. In the language column, the language in which audio is output is shown.

  When the setting shown in FIG. 6B is made and the playback button 146 is pressed, a series of playbacks set in FIG. 6B is performed. In the reproduction, first, the entire track 58 is reproduced in Japanese. Secondly, phrase 1 of track 58 is reproduced in English, and phrase 1 of track 58 is reproduced in Chinese third. Furthermore, the phrase 12 of the track 61 is reproduced in English fourth, and the phrase 14 of the track 61 is reproduced in English fifth. The setting as shown in FIG. 6B is performed by clicking the track / phrase playback order 148, for example, on the track number / phrase number selection screen of FIG. 4B and the playback language selection screen of FIG. Set by selecting the condition on each screen.

<Contents setting function>
The audio output system may display a table of contents of a paper book on the mobile terminal 120 and select a predetermined track and phrase from the table of contents. Such a function can be used, for example, when voice data is added later to a paper book issued without assuming voice data.

  FIG. 7A is a diagram showing a table of contents page of the paper book 210. In the paper book 210, a table of contents includes a large item 211 and a small item 212 included in the large item 211. The large item 211 corresponds to, for example, a track of the paper book 110, and the small item 212 corresponds to a phrase of the paper book 110. In the paper book 210, the track number and the phrase number are not set unlike the paper book 110 (see FIG. 1).

  FIG. 7B is a plan view of the mobile terminal 120 in which the table of contents setting screen is displayed on the input unit 121. The table of contents of the paper book 210 is displayed on the input unit 121 of the portable terminal 120, and a large item 211 and a small item 212 are displayed. Further, by moving the scroll bar 149 displayed at the right end of the input unit 121 up and down, the target large item 211 or small item 212 can be displayed. Furthermore, the target audio data can be reproduced by selecting the target large item 211 or the small item 212 and further selecting the language used as shown in FIG.

  In the above embodiment, a table of contents is displayed on the input unit 121 and a predetermined phrase is searched from the table of contents. However, a predetermined phrase may be searched for from the page number of a paper book. In this case, for example, a page number of a paper book is input to a predetermined position of the input unit 121 to display a paragraph (phrase information) of the page, and a predetermined phrase is searched from the display.

<Voice detection function>
The voice output system may have a voice detection function for decoding a phrase of the input voice by inputting the predetermined phrase by voice. For example, the voice output system can be used to check whether or not an English phrase is memorized.

  FIG. 8 is a plan view of the mobile terminal 120 with the voice detection function setting screen displayed on the input unit 121. In the leftmost column of the screen, the track / phrase playback order 148 is described. When the reproduction is performed in the order shown in FIG. 8, first, the Japanese phrase 1 of the track 58 is reproduced. Second, the English voice input of phrase 1 of track 58 is performed. The operator translates the English translation of phrase 1 in the same track 58 as the first Japanese into the voice input unit 123 and inputs it as voice. Then, the voice detection unit 125 (see FIG. 2B) decodes the pronounced English, and determines whether the pronounced English phrase is correct. After the determination, for example, a chime sound is sounded if correct, and a buzzer sound is sounded if incorrect, thereby informing whether English is correct. Third, the English phrase 1 of track 58 is played. Thus, the operator can confirm the English translation of the correct phrase 1 of the track 58.

  Such a function can be used to memorize English words, for example, by making a phrase one word. In addition, since a phrase can be freely selected with reference to a paper book, it can be used to intensively memorize poor English words.

<Intensive test function>
The voice input system 100 may have a centralized test function that tests whether a predetermined phrase can be translated into another language. The intensive test function will be described below with reference to FIGS. 9 (a) and 9 (b).

  FIG. 9A is a flowchart showing an execution procedure of the intensive test function. FIG. 9B is a plan view of the mobile terminal 120 on which the test function setting screen is displayed.

  In step S201 of FIG. 9A, the language to be tested is selected. A test language selection unit 150 on the test function setting screen in FIG. 9B selects a language for testing. For example, in FIG. 9B, “English” is selected as the language to be tested.

  In step S202, a plurality of phrases are selected. In the test function setting screen of FIG. 9B, a track number, a phrase number, and a language for reproducing audio data are input along the track / phrase playback order 148. FIG. 9B shows a state in which the Japanese phrase 1 of the track 58 is selected as the first track / phrase playback order 148. In this way, the track number, phrase number, and language for reproducing the audio data are also input in the second and subsequent tracks / phrase playback order 148. On the test function setting screen, the number of the track / phrase playback order 148 does not indicate the playback order but is merely an identification number.

  In step S203, an arbitrary number in the track / phrase playback order 148 is automatically selected, and the track number and phrase number set in the selected track / phrase playback order 148 are played back. Will be played in the language you want. For example, in FIG. 9B, when the third track / phrase playback order 148 is automatically selected, phrase 3 on the track 58 is played back in Japanese.

  In step S <b> 204, the operator inputs the speech for the phrase reproduced in step S <b> 203 from the voice input unit 123 in the language selected by the test language selection unit 150. In FIG. 9B, since English is selected as the test language, the operator inputs the voice in English.

  In step S <b> 205, it is determined whether or not the voice input from the voice input unit 123 is correct as a translation in the voice detection unit 125. The judgment is shown as a result by, for example, sounding a chime sound when correct and a buzzer sound when incorrect. In addition, a test of a plurality of questions may be performed by repeating steps S203 to S205 a plurality of times.

  The optimal embodiment of the present invention has been described above in detail, but as will be apparent to those skilled in the art, the present invention can be implemented with various modifications and variations within the technical scope thereof. In the above description, a paper book for language learners has been assumed. However, a paper book such as a wild bird book or an animal picture book may be used. For example, suppose that there are illustrations of photogis and warblers on page 10 of the Wild Bird Encyclopedia. A plurality of wild bird calls are stored in the cloud as audio data for each page (corresponding to a track). Then, the voice input system 100 downloads the voice data 113. The voice data 113 enables selection of twitter (corresponding to Japanese) and ground singing (corresponding to English) for each phototogis (corresponding to a phrase) and warbler (corresponding to a phrase). The present invention can be applied to a bird book as well as a paper book for language learning.

DESCRIPTION OF SYMBOLS 100 ... Audio | voice output system 110, 210 ... Paper book 120 ... Audio | voice output apparatus 121 ... Input part 122a, 122b ... Audio | voice output part 123 ... Audio | voice input part 124 ... Transmission / reception part 125 ... Audio | voice detection part 126 ... Memory | storage part 130 ... Cloud (cloud) Computing)
131 ... Audio data 141 ... Track number display section 142 ... Phrase number display section 143 ... "Phrase number" icon 144 ... Language playback order 145 ... Playback language 146 ... Playback button 147 ... Tab 148 ... Track / phrase playback order 149 ... Scroll Bar 150 ... Test language selection part 211 ... Major item 212 ... Small item

Claims (7)

A phrase including a second language that is a translation of the one word, one sentence, or one paragraph with respect to one word, one sentence, or one paragraph described in the first language, and a track that includes a plurality of the phrases, and describes a plurality of the tracks An audio output system for outputting audio data for a paper book,
An input unit for inputting predetermined information via a flat panel display;
An audio output unit for outputting the audio data;
A transmitting / receiving unit connected to the Internet for transmitting and receiving the audio data;
A storage unit for storing the audio data received via the transmission / reception unit,
The input unit identifies the paper book, and capture means for capturing the audio data corresponding to the paper book into the storage unit;
Track / phrase selection means for selecting the track and the phrase of the paper book;
Mode selection means for selecting a first mode for outputting only the first language, a second mode for outputting only the second language, or a third mode for outputting the first language and the second language;
An audio output system in which the audio output unit outputs audio based on the phrase selected by the phrase selecting unit and the mode selected by the mode selecting unit.   The audio output system according to claim 1, wherein at least one of an order of outputting audio of the selected language and an audio reproduction speed is further input to the input unit.   The audio output system according to claim 1, wherein the input unit, the audio output unit, the transmission / reception unit, and the storage unit are provided in one mobile terminal.   4. The track / phrase selection unit displays a table of contents of the paper book on the input unit of the sound output device, and selects the sound data of the predetermined phrase from the table of contents. 5. The audio output system according to one item.   4. The audio output system according to claim 1, wherein the track / phrase selection unit selects a page number of the paper book, and further selects the phrase according to the selected page. 5. .   The voice output system according to claim 1, further comprising a voice detection unit that receives voice and decodes the phrase of the voice. A plurality of the phrases are selected by the track / phrase selecting means,
Outputting one of the phrases arbitrarily selected from the selected phrases in the first language,
After the voice output of the first language, voice input of the phrase translated in the second language is input to the voice detection unit,
The voice output system according to claim 6, further comprising a test mode for judging whether the translation of the phrase inputted by voice is correct.