JP6641680B2 - Audio output device, audio output program, and audio output method - Google Patents

Description

  The present invention relates to an audio output device, an audio output program, and an audio output method.

  2. Description of the Related Art Conventionally, as an audio output device such as an electronic dictionary, a device capable of outputting a specified word or the like as a model sound of a native speaker when a user instructs reproduction of a sound such as a word is known.

  In addition, there has been proposed a device in which the voice of a user (learner) is recorded, and utterance practice can be performed while listening to and comparing with a model voice of a native speaker or comparing waveforms of each other (for example, see Patent Document 1). 1).

JP-A-2003-162291

However, in the above-described conventional voice output device, although the user voice and the model voice can be compared, the comparison ends only by executing one word or text selected by the user. As a result, the user cannot grasp the learning tendency of the user, and it is difficult to recognize, for example, pronunciations that he is not good at, and it is difficult to say that the learning efficiency is high.
Therefore, a main object of the present invention is to provide a voice output device, a voice output program, and a voice output method capable of improving the learning efficiency of vocal practice as compared with the related art.

In order to solve the above problems, the present invention is an audio output device,
Display means including a touch panel;
Audio output means;
A model voice storage unit preliminarily storing model voices of a plurality of words;
Recording means for recording user voice;
History of words for which at least one of output processing of the model voice by the voice output unit, output process of the user voice recorded by the recording unit, and recording process of the user voice by the recording unit has been performed. History storage means for storing
Vowels or consonants, on the vowel or each said consonant, the identifiable frequency contained in the words stored in said history storage unit, to be displayed on said display means,
Of the vowels or consonants displayed so as to be identifiable, a word including the vowel or the consonant selected by a user operation on the touch panel is extracted from the words stored in the history storage unit and displayed. Display control means;
It is characterized by having.

  ADVANTAGE OF THE INVENTION According to this invention, the learning efficiency of vocal practice can be improved compared with the former.

FIG. 2 is a plan view illustrating a schematic configuration of an electronic dictionary. FIG. 3 is a block diagram schematically showing a control circuit of the electronic dictionary. It is a flowchart which shows the flow of an audio | voice output process. FIG. 9 is a diagram for explaining an operation example of the electronic dictionary. FIG. 9 is a diagram for explaining an operation example of the electronic dictionary.

  Hereinafter, an example of an embodiment in which the audio output device according to the present invention is applied to an electronic dictionary will be described with reference to the drawings.

[Appearance configuration]
First, an external configuration of the electronic dictionary 1 according to the present embodiment will be described.
FIG. 1 is a plan view showing a schematic configuration of the electronic dictionary 1.
As shown in FIG. 1, the electronic dictionary 1 mainly includes a display 2, a key group 6, a speaker 7, a microphone 8, and the like.

The display 2 is a part for displaying various data such as characters and codes according to the operation of the key group 6 by the user.
The display 2 is configured by an LCD (Liquid Crystal Display), an ELD (Electronic Luminescence Display), or the like.
The display 2 is formed integrally with the touch panel 22 (see FIG. 2) and can receive operations such as handwriting input.

The key group 6 includes various keys for receiving an operation for operating the electronic dictionary 1 from a user.
The key group 6 has a character key 6a, a cursor key 6b, a translation / decision key 6c, and the like.

The character key 6a is a key used by a user to input a character or the like.
The cursor key 6b is a key used to move an inverted display position in the screen, that is, a cursor position, and can designate up, down, left, and right directions.
The translation / decision key 6c is a key used for executing a search or determining a headword.

The speaker 7 is a part that outputs sound according to the operation of the key group 6 by the user.
The microphone 8 is a part that takes in sound from outside.

[Internal configuration]
Next, the internal configuration of the electronic dictionary 1 will be described.
FIG. 2 is a block diagram schematically showing a control circuit of the electronic dictionary 1.
As shown in FIG. 1, the electronic dictionary 1 mainly includes a display unit 10, an input unit 20, a voice input / output unit 30, a CPU (Central Processing Unit) 40, a flash ROM (Read Only Memory) 50, and a RAM (Random Access Memory). 60, etc., and the respective units are connected to each other via a bus 80 so as to be able to communicate data with each other.

The display unit 10 has the display 2.
The display unit 10 displays various information on the display 2 based on a display signal input from the CPU 40.

The input unit 20 has a key group 6 and a touch panel 22.
The input unit 20 outputs a signal corresponding to the pressed key or the position of the touch panel 22 to the CPU 40.

The audio input / output unit 30 has a speaker 7 and a microphone 8.
The voice input / output unit 30 causes the speaker 7 to output a voice based on a voice output signal input from the CPU 40, and records a voice uttered by the user on the microphone 8 based on a recording signal input from the CPU 40. And let them do it.

The CPU 40 executes a process based on a predetermined program in accordance with the input instruction, performs an instruction to each functional unit, transfers data, and the like, and controls the electronic dictionary 1 comprehensively.
Specifically, the CPU 40 reads various programs stored in the flash ROM 50 in response to an operation signal or the like input from the input unit 20, and executes processing according to the programs. Then, the CPU 40 stores the processing result in the RAM 60 and causes the display unit 10 to appropriately output the processing result.

The flash ROM 50 is a memory that stores programs and data for implementing various functions of the electronic dictionary 1.
In the present embodiment, the flash ROM 50 stores a voice output program 52, a dictionary database group 54, a word voice data group 56, learning history data 58, and the like.

  The audio output program 52 is a program for causing the CPU 40 to execute an audio output process (see FIG. 3) described later.

The dictionary database group 54 has a plurality of dictionary databases 55.
In the present embodiment, the dictionary database group 54 includes a dictionary database 55a for “English-Japanese dictionary”, a dictionary database 55b for “Japanese dictionary”, and the like.
The dictionary database 55 stores a plurality of words (headwords) and explanation information including the meaning of the words in association with each other.

The word voice data group 56 stores model voices of various words in advance, and has model voice data 57 of each word of a headword in each dictionary database 55.
In the present embodiment, the word voice data group 56 has model voice data 57a of English words corresponding to the dictionary database 55a of “English-Japanese dictionary”.
The word sound data group 56 may include a plurality of model sound data 57 for the same word.

The learning history data 58 accumulates and stores a history of word utterance practice by the user. Specifically, the learning history data 58 accumulates a history of words for which at least one of the following model voice output processing, user voice recording processing, and recorded user voice output processing has been performed. Remember.
Further, the learning history data 58 counts the number of words that have undergone at least one of the processes (that is, words for which the user has practiced utterance) for each spelling (or phonetic symbol) included in this word. While storing.

  The RAM 60 is a memory that temporarily stores various programs executed by the CPU 40 and data related to the execution of these programs.

[motion]
Next, the operation of the electronic dictionary 1 when executing the audio output processing will be described.
FIG. 3 is a flowchart showing the flow of the audio output process.

  The sound output process is a process in which the CPU 40 reads and executes the sound output program 52 in the flash ROM 50. In the present embodiment, the voice output process is executed when the user selects the “listening comparison learning mode” by a predetermined operation.

When the voice output process is executed, first, as shown in FIG. 3, the CPU 40 reads the learning history data 58 from the flash ROM 50, and displays the learning history of the past practice of uttering words by the user (learner). The list is displayed on the display 2 (step S1).
More specifically, the learning history list displays, for each spelling (or phonetic symbol), the number of words including the spelling (or phonetic symbol) stored in the learning history data 58 so as to be identifiable. .
However, the learning history list may be such that the frequency at which the spelling (or phonetic symbol) is included in a word stored in the learning history data 58 is identifiably displayed for each spelling (or phonetic symbol). I just need.
Note that the learning history list is preferably displayed in a list or color-coded so that the frequency can be easily identified for each spelling (or phonetic symbol).

Next, the CPU 40 accepts a user's selection operation of any one of the spellings (or phonetic symbols) in the learning history list (step S2), and selects one word including the selected spelling (or phonetic symbols). It is displayed (step S3).
At this time, one word displayed as a learning target (hereinafter, referred to as “learning word”) may be randomly selected from a plurality of words including the selected spelling (or phonetic symbol), For example, the selection may be made in the order registered in the dictionary database 55 in advance. The user may be able to switch between the random selection and the selection in the order of registration.
Further, at this time, the CPU 40 reads the explanation information of the learning word from the dictionary database 55 and displays it on the display 2 together with the learning word.

  Next, the CPU 40 reads the model voice of the learning word from the word voice data group 56 of the flash ROM 50, and outputs (reproduces) it from the speaker 7 as a model of the user (step S4).

  Next, the CPU 40 takes in the voice of the learning word by the user from the microphone 8 and stores (records) it in the RAM 60 (step S5).

  Next, after outputting the model voice of the learning word output in step S4 again (step S6), the CPU 40 reads out the user voice recorded in step S5 from the RAM 60 and outputs it from the speaker 7 (step S7).

  Here, the CPU 40 performs the process of outputting the model voice in step S4, the process of recording the user voice in step S5, the process of re-outputting the model voice in step S6, and the process of outputting the user voice in step S7. However, when one word is continuously performed, the additional information indicating that the continuous processing is performed is stored in the learning history data 58 in association with the one word.

  After the audio output in step S7, the CPU 40 causes the display 2 to display a processing selection area that allows the user to select the subsequent processing. In the present embodiment, the processing selection area allows the user to select whether to listen to the voice again, repeat the utterance, shift to learning the next word, or end the learning.

  Next, the CPU 40 determines whether or not the “listen to sound again” process is selected by a user operation on the process selection area (step S8), and when it is determined that the process is selected (step S8; Yes), the process moves to step S6.

  If it is determined in step S8 that the “listen to voice again” process is not selected (step S8; No), the CPU 40 determines whether the “re-utterance” process is selected by a user operation on the process selection area. It is determined whether or not the process is selected (step S9), and when it is determined that the process is selected (step S9; Yes), the process proceeds to step S4 described above.

If it is determined in step S9 that the “re-utterance” process is not selected (step S9; No), the CPU 40 selects the “move to next word” process by a user operation on the process selection area. It is determined whether or not it is (step S10).
If it is determined that the process is selected (Step S10; Yes), the CPU 40 replaces the next word of the current learning word with a plurality of words including the spelling (or phonetic symbols) selected in Step S2. After selecting from among them in the same manner as in step S3 and displaying the selected information together with the explanation information (step S11), the process proceeds to step S4.

  If it is determined in step S10 that the “transition to next word” process is not selected (step S10; No), the CPU 40 selects the “end of learning” process by a user operation on the process selection area. It is determined whether or not the process is selected (step S12). If it is determined that the process is not selected (step S12; No), the process proceeds to another process.

  If it is determined in step S12 that the “learning end” process has been selected by the user (step S12; Yes), the CPU 40 ends the voice output process.

[Operation example]
Next, the operation of the electronic dictionary 1 will be described with a specific example.
FIGS. 4 and 5 are diagrams for explaining an operation example of the electronic dictionary 1 when executing the voice output process.

First, when the user selects the “listening comparison learning mode” by a predetermined operation, a learning history list L in which a list of past vocal practice history of words by the user is displayed on the display 2 as shown in FIG. It is displayed (step S1).
In the learning history list L of this operation example, the number of words practiced by the user in four stages is determined for each spelling included in the word (less than 30 words, 30 to 59 words, 60 to 99 words, 100 words). Above) are displayed in different colors.

  Next, when the user performs an operation of selecting the spelling “R” from the learning history list L (step S2), as shown in FIG. 4B, the word “R” is selected from a plurality of words including the spelling “R”. "learn" is selected as a learning word, and is displayed on the display 2 together with the explanation information (step S3).

  Next, after the model voice of the word “learn” is reproduced from the speaker 7 as a model (step S4), as shown in FIG. 4C, the voice of the word “learn” by the user is captured from the microphone 8 and recorded. Is performed (step S5).

Next, as shown in FIG. 4D, after the model voice of the word “learn” is reproduced from the speaker 7 (step S6), the recorded user voice is transmitted from the speaker 7 as shown in FIG. It is reproduced (step S7). Thereby, the user can hear and compare his own voice and the model voice.
When these voices have been reproduced, as shown in FIG. 5B, in the processing selection area 21 of the display 2, a “redo” button B1, an “listen again” button B2, a “to the next word” button B3, An "end" button B3 is displayed.

  Next, when the user performs an operation of selecting the "listen again" button B2 (step S8; Yes), the model voice of the word "learn" and the user voice are reproduced from the speaker 7 again (steps S6 and S7).

  When the user performs an operation of selecting the “Redo” button B1 (Step S8; No, S9; Yes), after the model voice of the word “learn” is reproduced (Step S4), the user voice is re-recorded. (Step S5). Then, after the model voice of the word "learn" is reproduced from the speaker 7 (step S6), the newly re-recorded user voice is reproduced from the speaker 7 (step S7).

  Further, when the user performs an operation of selecting the “to next word” button B3 (Step S8; No, S9; No, S10; Yes), the current learning word “learn” as shown in FIG. Is displayed on the display 2 together with the explanation information. Then, the reproduction of the model voice, the recording of the user voice, the reproduction of the model voice, and the reproduction of the recorded user voice are sequentially performed in the same manner as in the case of the previous word “learn” (steps S4 to S7).

  When the user performs an operation of selecting the “end” button B4 (step S8; No, S9; No, S10; No, S11; Yes), the “listening comparison learning mode” ends, that is, the audio output processing is ended. finish.

According to the above-described embodiment, as shown in steps S1 and S2 in FIG. 3, at least one of the exemplary voice output process, the user voice recording process, and the recorded user voice output process is performed. The history of the processed word is stored in the learning history data 58. Then, for each spelling or phonetic symbol, the frequency at which the spelling or phonetic symbol is included in a word stored in the learning history data 58 is displayed on the display 2 in an identifiable manner.
Thereby, the user can recognize his or her own learning tendency such as the bias of the vocal practice for each spelling or phonetic symbol, and thus the learning efficiency of the vocal practice can be improved as compared with the related art.
Furthermore, since this frequency is displayed in a list as the learning history list L, the user can easily recognize his / her learning tendency only by looking at the learning history list L.
Further, since the frequency is displayed in the learning history list L in different colors, the user can more easily recognize his / her own learning tendency by looking at the learning history list L at a glance.

Also, as shown in steps S4 to S11 in FIG. 3, for a plurality of words (for example, “learn” and “memorize”) each including the spelling or phonetic symbol selected by the user, the model voice and the user voice are different. Are output from the speaker 7 continuously for the plurality of words while being output alternately for each word.
Thereby, the user can repeatedly hear and compare a plurality of words including specific pronunciations, such as pronunciations of spellings "R" and "TH" that Japanese are not good at. Therefore, it is possible to improve the learning efficiency of the vocalization training as compared with the related art in which the user can only hear and compare one word selected by the user.

  The embodiment to which the present invention can be applied is not limited to the above-described embodiment, and can be appropriately changed without departing from the gist of the present invention.

For example, the example in which the audio output device according to the present invention is applied to the electronic dictionary 1 has been described. The present invention is applicable to all electronic devices such as a notebook computer, a mobile phone, a PDA (Personal Digital Assistant), and a game machine.
The audio output program according to the present invention may also be stored in a memory card, a CD, or the like that is detachable from these electronic devices including the electronic dictionary 1.

As described above, some embodiments of the present invention have been described. However, the scope of the present invention is not limited to the above-described embodiments, and the scope of the invention described in the claims and the equivalents thereof are described. Including.
In the following, the inventions described in the claims first attached to the application form of this application are appended. The item numbers of the claims described in the supplementary notes are as set forth in the claims originally attached to the application form of this application.
(Appendix)
[Claim 1]
Display means;
Audio output means;
A model voice storage unit preliminarily storing model voices of a plurality of words;
Recording means for recording user voice;
History of words for which at least one of output processing of the model voice by the voice output unit, output process of the user voice recorded by the recording unit, and recording process of the user voice by the recording unit has been performed. History storage means for storing
For each spelling or phonetic symbol, display control means for causing the display means to display the frequency at which the spelling or phonetic symbol is included in a word stored in the history storage means,
An audio output device comprising:
[Claim 2]
The audio output device according to claim 1,
The history storage unit includes an output process of the model voice by the voice output unit, a recording process of a user voice by the recording unit, a re-output process of the model voice by the voice output unit, and a process performed by the voice output unit. When the output processing of the user voice recorded in the recording means is continuously performed for one word, additional information indicating that the continuous processing has been performed is stored in association with the one word. An audio output device characterized by the above.
[Claim 3]
The audio output device according to claim 1 or 2,
The display control means,
An audio output device for displaying, for each of the spelling or the phonetic symbols, the number of words including the spelling or phonetic symbols stored in the history storage means as the frequency on the display means so as to be identifiable. .
[Claim 4]
The audio output device according to any one of claims 1 to 3,
The display control means, for each of the spelling or the phonetic symbols, causes the display means to display a list on the display means so that the frequency of the spelling or the phonetic symbols included in the words stored in the history storage means can be identified. An audio output device characterized by the above.
[Claim 5]
The audio output device according to claim 4,
The display control means, for each of the spelling or the phonetic symbols, is color-coded so that the frequency at which the spelling or the phonetic symbols are included in the words stored in the history storage means is color-coded, and the display means An audio output device characterized in that the audio output device is displayed.
[Claim 6]
The audio output device according to any one of claims 1 to 5,
Selecting means for the user to select one of the spelling or the phonetic symbols displayed on the display means,
For the word including the spelling or the phonetic symbol selected by the selecting means, the voice output means outputs the model voice of the word, the recording means records the user voice, and the voice output means Control means for controlling the audio output means and the recording means so as to continuously perform the re-output processing of the exemplary voice and the output processing of the recorded user voice,
An audio output device, further comprising:
[Claim 7]
A display unit, a voice output unit, a model voice storage unit storing model voices of a plurality of words in advance, and a computer including a recording unit for recording a user voice,
At least one of an output process of the model voice by the audio output unit, an output process of the recorded user voice by the audio output unit, and a recording process of the user voice by the recording unit has been performed. A history storage function for storing the history of words,
For each spelling or phonetic symbol, a display control function of causing the display unit to display the frequency at which the spelling or phonetic symbol is included in the word stored by the history storage function,
An audio output program characterized by realizing:
[Claim 8]
A display means, a sound output means, a model sound storage means in which model sounds of a plurality of words are stored in advance, and a sound output method using a computer including a recording means for recording a user voice,
At least one of an output process of the exemplary voice by the audio output unit, an output process of the recorded user voice by the audio output unit, and a recording process of the user voice by the recording unit has been performed. A history storage step of storing a history of words;
A display control step of displaying, on the display unit, for each spelling or phonetic symbol so that the frequency at which the spelling or phonetic symbol is included in the word stored by the history storing step can be identified;
A voice output method comprising:

DESCRIPTION OF SYMBOLS 1 Electronic dictionary 2 Display 7 Speaker 8 Microphone 50 Flash ROM
52 voice output program 57 model voice data 58 learning history data 60 RAM
L Learning history list

Claims (8)

Display means including a touch panel;
Audio output means;
A model voice storage unit preliminarily storing model voices of a plurality of words;
Recording means for recording user voice;
History of words for which at least one of output processing of the model voice by the voice output unit, output process of the user voice recorded by the recording unit, and recording process of the user voice by the recording unit has been performed. History storage means for storing
Vowels or consonants, on the vowel or each said consonant, the identifiable frequency contained in the words stored in said history storage unit, to be displayed on said display means,
Of the vowels or consonants displayed so as to be identifiable, a word including the vowel or the consonant selected by a user operation on the touch panel is extracted from the words stored in the history storage unit and displayed. Display control means;
An audio output device comprising: The audio output device according to claim 1,
The history storage unit includes an output process of the model voice by the voice output unit, a recording process of a user voice by the recording unit, a re-output process of the model voice by the voice output unit, and a process performed by the voice output unit. When the output processing of the user voice recorded in the recording means is continuously performed for one word, additional information indicating that the continuous processing has been performed is stored in association with the one word. An audio output device characterized by the above. The audio output device according to claim 1 or 2,
The display control means,
The vowel or the each consonant sound output apparatus characterized by displaying the number of words containing the vowel or the consonant is stored in the history storage means identifiably said display means as said frequency. The audio output device according to any one of claims 1 to 3,
Wherein the display control unit, the vowel or the respective consonant, to be identified the frequency with which the vowel or the consonant is included in the words stored in said history storage means, that is listed on the display means Characteristic audio output device. The audio output device according to claim 4,
Wherein the display control unit, the vowel or the respective consonant, the frequency of the vowel or the consonant is included in the words stored in said history storage means can be identified by color, on said display means in different colors An audio output device for displaying. The audio output device according to any one of claims 1 to 5,
Selecting means for a user to select one of the vowels or consonants displayed on the display means;
For a word including the vowel or the consonant selected by the selection means, output processing of the model voice of the word by the voice output means, recording processing of a user voice by the recording means, and the processing by the voice output means Control means for controlling the audio output means and the recording means so as to continuously perform the re-output processing of the exemplary voice and the output processing of the recorded user voice,
An audio output device, further comprising: A display unit including a touch panel, a voice output unit, a model voice storage unit storing model voices of a plurality of words in advance, and a computer including a recording unit for recording a user voice,
At least one of an output process of the model voice by the audio output unit, an output process of the recorded user voice by the audio output unit, and a recording process of the user voice by the recording unit has been performed. A history storage function for storing the history of words,
Vowels or consonants, on the vowel or each said consonant, the identifiable frequency contained in the words stored by the history storage function, is displayed on the display means,
Among the vowels or consonants displayed so as to be identifiable, a word including the vowel or the consonant selected by a user operation on the touch panel is extracted from a word stored by the history storage function and displayed. Display control function,
An audio output program characterized by realizing: A voice output method using a computer including a display unit including a touch panel, a voice output unit, a model voice storage unit storing model voices of a plurality of words in advance, and a recording unit recording a user voice,
At least one of an output process of the model voice by the audio output unit, an output process of the recorded user voice by the audio output unit, and a recording process of the user voice by the recording unit has been performed. A history storage step of storing a history of words;
Vowels or consonants, on the vowel or each said consonant, the identifiable frequency contained in the words stored by the history storage step, to be displayed on said display means,
A word including the vowel or the consonant selected by the user's operation on the touch panel among the vowels or the consonants displayed so as to be identifiable is extracted from the words stored in the history storage step and displayed. A display control step;
A voice output method comprising:

Images