JP2023046222A - Electronic apparatus, information processing method and program - Google Patents

Abstract

To provide: an electronic apparatus capable of effectively performing language learning; an information processing method; and a program.SOLUTION: According to an embodiment of the present invention, an electronic apparatus has a control part for executing processing in a text marker mode and in an evaluation mode, wherein the text marker mode causes to display a marker representing a reproduction position of a sample voice with respect to a text corresponding to the sample voice caused to be displayed on a display part in accordance with reproduction timing of the sample voice, without outputting, from a voice output part, the sample voice corresponding to the text selected as a processing object, and wherein the evaluation mode causes to display the text corresponding to the sample voice on the display part, and inputs, from a voice input part, an orally read voice obtained by orally reading the text, and evaluates the orally read voice on the basis of the sample voice, and causes to display an evaluation result on the display part.SELECTED DRAWING: Figure 1

Description

The present invention relates to an electronic device, an information processing method, and a program suitable for language learning.

Some learning functions implemented in electronic devices such as electronic dictionaries and personal computers are aimed at learning foreign languages. Language learning includes, for example, listening learning for listening to sentences read out in a foreign language, and speaking learning for correctly pronouncing the foreign language.

In listening learning, for example, while a sentence (text) is displayed, a native speaker who reads out the displayed sentence outputs voice. A learner can learn the utterance by a native speaker by repeating the voice by the native speaker.

In speaking learning, for example, a sentence (text) to be uttered by the learner is displayed, the learner reads the displayed sentence aloud, and the result of evaluation by the pronunciation judgment function is output for this voice. do. The learner confirms the evaluation result by the pronunciation judgment function and gives feedback on the reading speed, pronunciation, etc.

JP 2007-094055 A

In this way, some conventional electronic devices are provided with learning functions such as listening learning and speaking learning for language learning, but they have not been able to perform language learning suitable and effective for learners. .

SUMMARY OF THE INVENTION The present invention has been made in consideration of the above problems, and an object of the present invention is to provide an electronic device, an information processing method, and a program that enable effective language learning.

In order to solve the above problems, an electronic device according to an embodiment of the present invention does not output a sample voice corresponding to a text selected as a processing target from a voice output unit, but synchronizes the sample voice with the reproduction timing of the sample voice. a text marker mode for displaying a marker indicating a reproduction position of the sample voice for the text corresponding to the sample voice displayed on the display unit; and displaying the text corresponding to the sample voice on the display unit. an evaluation mode for inputting the reading voice obtained by reading the text aloud from the voice input unit, evaluating the reading voice based on the sample voice, and displaying the evaluation result on the display unit. have

ADVANTAGE OF THE INVENTION According to this invention, the electronic device, the information processing method, and program which can learn a language effectively can be provided.

1 is a functional block diagram showing the configuration of an electronic circuit of an electronic device according to an embodiment of the invention; FIG. 1 is a front view showing the external configuration of an electronic dictionary according to this embodiment; FIG. The figure which shows an example of the learning management data in this embodiment. 4 is a flowchart showing learning setting processing according to the embodiment; FIG. 4 is a diagram showing an example of setting contents of learning setting data according to the embodiment; 4 is a flowchart for explaining learning processing by a learning processing program for an electronic dictionary according to the present embodiment; 7 is a flowchart showing processing of learning step 1 (first mode) in the learning processing shown in FIG. 6; FIG. 7 is a flowchart showing processing of learning step 2 (second mode) in the learning processing shown in FIG. 6; FIG. FIG. 7 is a flowchart showing processing of learning step 3 (third mode) in the learning processing shown in FIG. 6; FIG. The figure which shows an example of learning screen DS1 for the 1st mode in this embodiment. The figure which shows an example of the marker which changes with reproduction|regeneration of a sample audio|voice in the learning screen in this embodiment. The figure which shows an example of learning screen DS2 for 2nd mode in this embodiment. The figure which shows an example of learning screen DS3 for 3rd modes in this embodiment. The figure which shows an example of the 1st marker and 2nd marker which change in learning screen DS3 in this embodiment. The figure which shows an example of evaluation result screen DS4 in this embodiment. 1 is a schematic diagram of a learning support system according to an embodiment of the present invention; FIG.

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a functional block diagram showing the configuration of an electronic circuit of an electronic device according to an embodiment of the invention.

In this embodiment, an example in which an electronic device is configured as an electronic dictionary 10, for example, will be described. In addition to the electronic dictionary 10, the electronic device can be realized by various electronic devices such as a personal computer, a smart phone, a tablet PC, and a game device. Further, in the present embodiment, the functions realized by the electronic dictionary 10 described later may be realized by a system in which electronic devices and servers connected via a network including the Internet work together. Instead of 10, only a server may be used to output the processing result in an electronic device connected via a network. Details will be described later.

In the electronic dictionary 10, plural types of dictionary contents are recorded as dictionary data. In the dictionary content, at least one word sense information is registered in association with each of a plurality of words used as entry words. The dictionary contents installed in the electronic dictionary 10 are generally created by publishers, etc., and include those published on paper media, etc., and are highly reliable. Therefore, by effectively using highly reliable dictionary contents for learning, a correct and effective learning effect can be expected.

Note that dictionary content is not limited to dictionaries related to languages such as English and Japanese, and includes content such as encyclopedias, learning reference books, workbooks, literary works, and commentaries.

The dictionary content can be used not only by the dictionary search function, but also as learning content for language learning.

The electronic dictionary 10 has a computer configuration in which programs recorded on various recording media or transmitted programs are read, and the operation is controlled by the read programs, and the electronic circuit includes a CPU ( central processing unit) 11 is provided.

The CPU 11 functions as a control section that controls the electronic dictionary 10 as a whole. The CPU 11 receives a control program pre-stored in the memory 12, a control program read from a recording medium 13 such as a ROM card into the memory 12 via a recording medium reading unit 14, or a network such as the Internet (not shown). It controls the operation of each part of the circuit in accordance with a control program downloaded from an external device (server or the like) and read into the memory 12 through.

The control program stored in the memory 12 receives an input signal corresponding to a user operation from the key input unit 16, an input signal corresponding to a user operation from the touch panel type display unit 17 as a display unit, or the recording medium reading unit 14. It is activated in response to a connection communication signal with an external recording medium 13 such as an EEPROM (registered trademark), RAM, or ROM connected via.

Connected to the CPU 11 are a memory 12, a recording medium reading unit 14, a communication unit 15, a key input unit 16, a touch panel display unit 17 (display), an audio input unit (microphone) 18, an audio output unit (speaker) 19, and the like. be. In one embodiment, the display unit does not have to function as a touch panel. For example, an LCD (Liquid Crystal Display) may be used as the display unit instead of the touch panel type display unit 17 .

Control programs stored in the memory 12 include a dictionary control program 12a, a learning processing program 12b, and the like. The dictionary control program 12 a is a program for controlling the overall operation of the electronic dictionary 10 . The dictionary control program 12a also has a dictionary search function of searching dictionary contents based on a character string input by the input unit (key input unit 16, touch panel display unit 17, voice input unit 18) and displaying information. Realize The dictionary control program 12a also includes a handwritten character recognition program for recognizing handwritten characters on the touch panel type display unit 17 .

The learning processing program 12b is a program that implements a learning function for learning a foreign language. The learning processing program 12b includes a learning setting processing program and a reading evaluation program. The learning setting processing program is for executing processing for setting learning setting data for controlling display and sound reproduction when the learning function is executed, according to an operation by the learner. The reading aloud evaluation program recognizes the learner's voice input from the voice input unit 18, detects the uttered content (sentence, sentence, word, etc.), and reads the text aloud by the learner and the native speaker. It is intended to perform an evaluation process based on a comparison of sample speech against text, such as by (a native speaker of a foreign language).

The electronic dictionary 10 according to the present embodiment reproduces a sample voice corresponding to the learning content (text) selected as the target of the learning process based on the learning processing program 12b (learning function), and outputs the sample voice from the voice output unit 19. A first mode ( sample voice mode), the text corresponding to the sample voice displayed on the touch panel display unit 17 in accordance with the playback speed (playback timing) of the sample voice without outputting the sample voice from the voice output unit 19, A second mode (text marker mode) for displaying a marker indicating the reproduction position of the sample voice, a text corresponding to the sample voice is displayed on the touch panel type display unit 17, and reading voice obtained by reading the text is input from the voice input unit 18. Then, the reading voice is evaluated based on the sample voice, and the processing in the third mode (evaluation mode) of displaying the evaluation result on the touch panel type display section 17 is executed.

The memory 12 stores dictionary data 12c, learning content data 12d, learning management data 12e, learning setting data 12f, reading evaluation data 12g, and the like.

The dictionary data 12c includes, for example, multiple dictionaries such as an English-Japanese dictionary, a Japanese-English dictionary, an English-English dictionary, an English-Chinese dictionary, and a Japanese dictionary, and a database that collects dictionary contents such as multiple types of encyclopedias. The dictionary data 12c is associated with word sense information describing the meaning (word sense) corresponding to each entry word for each dictionary. Note that the dictionary data 12c may be stored in an external device (server or the like) that can be accessed through a network, instead of being built in the main body of the electronic dictionary 10. FIG.

The learning content data 12d is learning data used for the learning function by the learning processing program 12b. The learning content data 12d includes texts including a plurality of sentences, sentences, words, etc., sample voices of each text read aloud by a native speaker, and evaluation criteria for evaluating reading voices by learners based on the sample voices. including data, etc. The learning content data 12d includes a plurality of learning contents (texts), which are arbitrarily selected by the learner and used for learning.

The learning management data 12e is data for managing learning progress of a plurality of learning contents included in the learning content data 12d. In the learning management data 12e, learning progress information indicating to which of the first to third modes each learning content has been executed by the learning processing program 12b (learning function) is registered.

The learning setting data 12f is data for controlling display and audio reproduction when the learning processing program 12b (learning function) is executed. The learning setting data 12f is set by processing by a learning setting processing program.

The read-aloud evaluation data 12g is data indicating the evaluation result of the read-aloud reading of the text of the learning content by the learner, which is evaluated based on the sample voice by executing the third mode of the learning processing program 12b.

The communication unit 15 controls communication with other electronic devices via a network such as the Internet or a LAN (Local Area Network), or communicates with other electronic devices at a short distance using Bluetooth (registered trademark) or Wi-Fi. - Execute communication control for short-range wireless communication such as Fi (registered trademark).

In the electronic dictionary 10 configured as described above, the CPU 11 controls the operation of each circuit part according to the instructions described in various programs such as the dictionary control program 12a and the learning processing program 12b, and the software and hardware work together. By operating as follows, the functions described in the following description of operation are realized.

FIG. 2 is a front view showing the external configuration of the electronic dictionary 10 according to this embodiment.

In the case of the electronic dictionary 10 shown in FIG. 2, a CPU 11, a memory 12, a recording medium reading section 14, a communication section 15, a voice input section 18, and a voice output section 19 are built in the lower side of the main body which is opened and closed, and a key input section. 16 is provided, and a touch panel type display unit 17 is provided on the upper side.

The key input unit 16 includes a character input key 16a, a dictionary selection key 16b for selecting various dictionaries and various functions, a [translation/decision] key 16c, a [return] key 16d, and cursor keys (up, down, left, and right keys). 16e, a delete key 16f, a power button, and other various function keys.

Various menus and buttons 17a are displayed on the touch panel display unit 17 according to the execution of various functions. On the touch panel type display unit 17, for example, a pen can be used to perform touch operations for selecting various menus and buttons 17a, and handwritten character input for inputting characters.

In handwritten character input, when a pattern representing a character is handwritten with a pen in the handwritten character input area displayed on the touch panel type display unit 17, character recognition processing is performed on the pattern. Characters corresponding to the pattern obtained by the character recognition process are displayed in the character input area of the touch panel display unit 17 in the same manner as characters input by operating the character input keys 16 a of the key input unit 16 . Therefore, a character string for dictionary search can be input by handwritten characters on the touch panel type display unit 17 .

Also, the electronic dictionary 10 can input characters by voice. The electronic dictionary 10 inputs the voice uttered by the learner from the voice input unit 18, performs voice recognition processing on the input voice, and inputs a character string corresponding to the uttered voice.

FIG. 3 is a diagram showing an example of the learning management data 12e in this embodiment.

The learning management data 12e includes learning progress information indicating which of the first to third modes has been executed by the learning processing program 12b (learning function) for each learning content (learning content 1, 2, . . . ), for example. is registered. In the learning progress information shown in FIG. 3, learning steps 1, 2, and 3 indicate the first mode, second mode, and third mode, respectively. In the learning management data 12e shown in FIG. 3, for the learning content 3, learning progress information indicating that the first mode and the second mode (learning steps 1 and 2) have been executed is registered. Data indicating non-learning is registered for contents that are not processed by the learning function (for example, "learning content 2").

Next, the operation of the electronic dictionary 10 according to this embodiment will be described.

First, the learning setting process in this embodiment will be described. FIG. 4 is a flowchart showing learning setting processing in this embodiment.

The CPU 11 displays a learning setting screen on the touch panel display unit 17 when execution of the learning setting process is instructed by, for example, a menu operation during execution of the learning function by the learning processing program 12b (step S1).

On the learning setting screen, setting items for controlling display and audio reproduction when the learning function is executed are displayed. For example, on the learning setting screen, when executing the third mode of the learning function, the first marker (guide marker) representing the playback position of the sample voice and the reading position of the reading voice for the text of the learning content A setting item is provided for setting whether or not to display (on/off) each of the second markers (user markers).

The CPU 11 accepts an instruction (learning setting) for a setting item by operating the cursor key 16e or by touching the touch panel type display unit 17 (step S2). When confirmation of the setting input on the learning setting screen is instructed by, for example, the operation of the [translate/determine] key 16c or a touch operation on the confirmation button provided on the learning setting screen (step S3, Yes), the CPU 11 The learning setting data 12f indicating the display (on) or non-display (off) of the first marker and the display (on) or non-display (off) of the second marker set on the setting screen are stored in the memory 12. It is stored (step S4). The CPU 11 refers to the learning setting data 12f when executing the third mode by the learning function, and executes display control of the first marker and the second marker according to the setting contents.

FIG. 5 is a diagram showing an example of setting contents of the learning setting data 12f in this embodiment. In the example shown in FIG. 5, "on" (with display) is set for each of the first marker (guide marker) and the second marker (user marker). Therefore, in the third mode, both the first marker and the second marker are displayed for the text of the learning content.

Thus, in the learning setting process, it is possible to display both the first marker and the second marker, display either the first marker or the second marker, or display neither the first marker nor the second marker. , can be set according to the learner's learning style.

Note that the learning setting screen is provided with setting items for display control of the first marker and the second marker, but other learning settings may be made.

For example, it may be possible to set the playback speed at which the sample sound of the learning content is played back when the learning function is executed. For example, several changeable stages (for example, five stages) of options are displayed on the learning setting screen so that any one can be arbitrarily selected. The CPU 11 stores data indicating the reproduction speed selected on the learning setting screen as the learning setting data 12f. The CPU 11 refers to the data indicating the reproduction speed when executing the first to third modes by the learning function, and controls the reproduction timing of the sample voice and the movement speed of the first marker.

In this way, in the learning setting process, it is possible to set the display of the marker and the reproduction speed of the sample voice when the learning function is executed. As a result, when the learning function is executed, display and audio reproduction suitable for the learner's learning are executed, so effective learning can be expected.

Next, learning processing by the learning function of the electronic dictionary 10 in this embodiment will be described.

FIG. 6 is a flowchart for explaining learning processing by the learning processing program 12b of the electronic dictionary 10 in this embodiment. FIG. 7 is a flow chart showing processing of learning step 1 (first mode (sample voice mode)) in the learning processing shown in FIG. FIG. 8 is a flow chart showing processing of learning step 2 (second mode (text marker mode)) in the learning processing shown in FIG. FIG. 9 is a flow chart showing processing of learning step 3 (third mode (evaluation mode)) in the learning processing shown in FIG.

First, when execution of the learning function is instructed by, for example, operating a menu, the CPU 11 displays a selection screen of learning content (text) to be learned on the touch panel type display section 17 . On the learning content selection screen, for example, a list of a plurality of learning contents that can be learned is displayed so that the learner can arbitrarily specify the content.

When any learning content is designated on the learning content selection screen (step A1), the CPU 11 acquires learning progress information of the designated learning content from the learning management data 12e (step A2).

When the learning progress information indicates that all the learning steps are unlearned (step A3, Yes), the CPU 11 shifts to learning step 1 (first mode) (step A4). In the electronic dictionary 10 of the present embodiment, listening learning for learning content is executed in learning step 1 (first mode).

When all the learning steps are not unlearned (step A3, No), the CPU 11 determines whether the learning step 1 is unlearned. If the learning step 1 has not been learned (step A6, Yes), the CPU 11 shifts to the learning step 1 (first mode) (step A4). Further, when the learning progress information indicates that learning step 1 has been completed (step A6, No), the CPU 11 determines whether learning step 2 has not been learned since learning step 1 has already been executed. If the learning step 2 has not been learned (step A9, Yes), the CPU 11 shifts to the learning step 2 (second mode) (step A7). In the electronic dictionary 10 of the present embodiment, in learning step 2 (second mode), speaking learning is performed for the same learning content for which listening learning was performed in learning step 1 .

Further, when the learning progress information indicates that learning step 2 has been completed (step A9, No), the CPU 11 has already executed learning step 2, so the CPU 11 shifts to learning step 3 (third mode) (step A10). . In the electronic dictionary 10 of the present embodiment, in learning step 3 (third mode), in order to confirm the results of learning in learning steps 1 and 2, the same learning content for which listening/speaking learning was performed in learning steps 1 and 2 Read aloud and output evaluation results by comparison with sample speech.

When the execution of learning step 1 (first mode) is completed, the CPU 11 basically shifts to next learning step 2 (second mode), and when the execution of learning step 2 (second mode) is completed, , basically, then go to learning step 3 (third mode).

That is, in the electronic dictionary 10 according to the present embodiment, learning steps 1 to 3 (first to third modes) with different learning modes are performed step by step, so that foreign language learning can be effectively performed. I have to.

After the learning step 1 ends, the CPU 11 displays, for example, a confirmation screen for shifting to the learning step 2 . When the learner inputs a transfer confirmation instruction on the transfer confirmation screen (step A5, Yes), the CPU 11 proceeds to learning step 2 (step A5). On the other hand, if the learner does not input an instruction to confirm the transition on the transition confirmation screen (step A5, No), the CPU 11 executes the learning step 1 again. That is, the learning step 1 can be repeatedly executed according to the learner's request.

Similarly, after the learning step 2 ends, the CPU 11 displays a confirmation screen for shifting to the learning step 3 . When the learner inputs a transfer confirmation instruction on the transfer confirmation screen (step A8, Yes), the CPU 11 proceeds to learning step 3 (step A10). On the other hand, in the transfer confirmation screen, if the learner does not input a transfer confirmation instruction (step A8, No), the CPU 11 executes the learning step 2 again. Alternatively, when the learner inputs an instruction to shift to learning step 1 on the shift confirmation screen, the CPU 11 may execute learning step 1 again.

Thus, in the electronic dictionary 10 of the present embodiment, learning steps 1 to 3 (first to third modes) with different learning modes are basically executed step by step. , the same learning step can be repeatedly executed, and learning in each learning step 1, 2 can be reliably performed.

Further, in the above description, the learning steps 1 to 3 (first to third modes) are executed step by step. Alternatively, arbitrary learning steps (modes) may be combined and executed. For example, the first mode (steps A3, A4, A6, A9) shown in FIG. , only the first mode and the second mode may be executed.

Next, specific examples of learning steps 1 to 3 (first to third modes) will be described.

First, learning step 1 (first mode) will be described with reference to the flowchart shown in FIG.

When learning step 1 is started, the CPU 11 causes the touch panel display unit 17 to display foreign language sentences on the learning screen for the first mode based on the text of the learning content selected as the learning object.

FIG. 10 is a diagram showing an example of the learning screen DS1 for the first mode in this embodiment. As shown in FIG. 10, a foreign language sentence (text) to be learned is displayed.

The CPU 11 starts outputting the sample voice GS from the voice output unit 19 based on the data of the sample voice read aloud by the native speaker included in the learning content corresponding to the displayed sentence (text), and at the same time, starts the sample voice. Display of a marker (guide marker) corresponding to the text in accordance with the reproduction speed (reproduction timing) is started (step B1).

Note that when the speed of the sample voice is set in the learning setting data 12f, the playback timing of the sample voice is controlled according to the playback speed set in the learning setting data 12f. In this case, the same playback speed is used in all learning steps 1 to 3 (first to third modes).

After that, the CPU 11 reproduces the sample voice GS and outputs it from the voice output unit 19 until the reproduction of the sample voice is completed (step B2, No), and at the same time clearly indicates the position in the text read out by the sample voice. As shown, the display is controlled so as to change the display position of the marker in accordance with the reproduction timing of the sample voice (step B1).

In the learning screen DS1 shown in FIG. 10, the text range read out by the sample voice is displayed as a marker GM by displaying it in a display form different from the display of other texts. In the example shown in FIG. 10, the background color of the range of text read out by the sample voice is displayed in a different color from the others to make the marker GM. This facilitates identification of the marker GM.

FIG. 11 shows an example of the marker GM that changes along with the reproduction of the sample voice on the learning screen DS1 in this embodiment. As shown in FIG. 11A, when the sample voice is reproduced up to "A certain man", the marker GM1 is displayed up to "A certain man".

Subsequently, when the sample voice is played up to "...several Daughters", the marker GM2 is displayed up to "...several Daughters", and the sample voice is played up to "...were always", as shown in FIG. 11(B). Then, as shown in FIG. 11C, the marker GM3 is displayed up to "...were always".

When the reproduction of the sample voice is completed (step B2, Yes), the CPU 11 updates the learning progress information of the learning content to be learned in the learning management data 12e so as to indicate the completion of learning step 1 (step B3).

In this way, in the learning step 1 (first mode) of the electronic dictionary 10 of the present embodiment, while listening to the sample voice of the native speaker for the text of the learning content, mark the reading position of the sample voice with respect to the text with the marker GM. can be confirmed by Therefore, learn how to listen to a sample voice by a native speaker, and learn the reading time (reading speed), sharpness, smoothness, etc. of the text of the learning content by a native speaker, which is necessary for reading aloud like a native speaker. can do.

Next, learning step 2 (second mode) will be described with reference to the flowchart shown in FIG.

When the learning step 2 is started, the CPU 11 causes the touch panel display section 17 to display foreign language sentences on the learning screen for the second mode based on the text of the learning content selected as the learning object.

FIG. 12 is a diagram showing an example of the learning screen DS2 for the second mode in this embodiment. As shown in FIG. 12, foreign language sentences (texts) to be learned are displayed in the same manner as the learning screen DS1.

The CPU 11 displays a marker GM (guide marker) for the text corresponding to the displayed sentence (text), based on the data of the sample voice read aloud by the native speaker included in the learning content, in accordance with the reproduction timing of the sample voice. is started (step C1). That is, in the learning step 2, without outputting the sample voice from the voice output unit 19, the reading position of the text read aloud by the native speaker is indicated by the marker GM.

After that, until the display of the marker GM corresponding to the playback timing of the sample voice reaches the end of the text (step C2, No), the CPU 11 clearly indicates the reading position in the text when the native speaker reads the text. First, the display is controlled so as to change the display position of the marker GM in accordance with the reproduction timing of the sample voice (step C1). The display of the marker GM is assumed to be executed in the same manner as in learning step 1 (first mode), and the description thereof is omitted.

The learner reads aloud the text indicated by the marker GM according to the marker GM whose display position moves in the text of the learning content, thereby practicing reading the text aloud at the same reading time (reading speed) as a native speaker. can. The learner uses not only the reading time (reading speed) but also the results of learning step 1 (first mode) to effectively learn to read aloud like a native speaker, such as sharpness and smoothness. be able to.

When the display of the marker GM corresponding to the reproduction timing of the sample voice reaches the end of the text (step C2, Yes), the CPU 11 updates the learning progress information of the learning content to be learned in the learning management data 12e in the learning step 2. Update to indicate completion (step C3).

In this manner, in the learning step 2 (second mode) of the electronic dictionary 10 of the present embodiment, it is possible to check the read-out position of the text of the learning content according to the reproduction timing of the sample voice by the native speaker using the marker GM. can. Therefore, it is possible to effectively learn (practice) how to read the text of the learning content aloud like a native speaker.

Next, learning step 3 (third mode) will be described with reference to the flowchart shown in FIG.

When the learning step 3 is started, the CPU 11 causes the touch panel display section 17 to display foreign language sentences on the learning screen for the third mode based on the text of the learning content selected as the learning object.

FIG. 13 is a diagram showing an example of the learning screen DS3 for the third mode in this embodiment. As shown in FIG. 13, similar to the learning screen DS1, foreign language sentences (text) to be learned are displayed.

First, the CPU 11 refers to the learning setting data 12f to determine whether or not to display a first marker (guide marker) representing the playback position of the sample voice and a second marker (user marker) representing the reading position of the reading voice. (on/off) is determined (step D1). In the following description, the case where the first marker (guide marker) is displayed and the case where it is not displayed will be described.

When the display of the first marker GM (guide marker) is set in the learning setting data 12f (step D2, Yes), the CPU 11 inputs the reading voice of the text by the learner. (step D3), and based on the data of the sample voice, display of the first marker GM for the text is started in accordance with the reproduction timing of the sample voice (step D4). Display of the first marker GM is executed in the same manner as in learning step 2 (second mode). Also, sample speech is not output as in learning step 2 (second mode).

In addition, the CPU 11 records the reading voice of the text input by the learner from the voice input unit 18 for evaluation to be described later, detects the uttered content, and determines the reading position of the text (step D5). . The CPU 11 starts displaying a second marker UM (user marker) for the text according to the reading position of the text determined for the reading voice (step D6).

Thereafter, the CPU 11 waits until the display of the first marker GM corresponding to the playback timing of the sample voice reaches the end of the text (the playback time of the sample voice has elapsed) (step D7, No), until the native speaker reads the text. The display is controlled so as to change the display position of the first marker GM in accordance with the reproduction timing of the sample voice so as to clearly indicate the reading position in the text (step D4).

In addition, the CPU 11 controls the display so as to clearly indicate the reading position in the text and to change the display position of the second marker UM according to the reading voice of the text by the learner input from the voice input unit 18. (steps D5 and D6).

In the learning screen DS3 shown in FIG. 13, the first marker GM displayed according to the playback timing of the sample voice and the second marker UM displayed according to the reading voice US by the learner are displayed relative to the text of the learning content. are displayed. The first marker GM and the second marker UM are displayed in different display forms so that the learner can easily identify them. For example, the first marker GM is displayed in the same display form as in the first/second modes so that the learner can recognize that it is the marker corresponding to the sample speech. The second marker UM is displayed by underlining the text so as not to overlap with the first marker GM.

FIG. 14 shows an example of the first marker GM and the second marker UM that change on the learning screen DS3 in this embodiment. In FIG. 14(A), when the first marker GM1 corresponding to the sample speech was displayed up to "A certain man", it was determined that the learner's reading speech was uttered up to the position of "A certain man". changes the display to indicate that the second marker UM1 has been read aloud up to "A certain man".

Subsequently, when the display of the first marker GM2 is changed to the position of "...several Daughters" according to the reproduction timing of the sample voice, as shown in FIG. , the display is changed so that the second marker UM2 has been read aloud up to "...who were". Furthermore, when the display of the first marker GM3 is changed to the position of "...were always" according to the playback timing of the sample speech, as shown in FIG. , the display is changed to indicate that the second marker UM3 has been read aloud up to "...always quarrelling".

In this way, the second marker UM indicating the position where the learner is reading the text aloud is displayed at the same time as the first marker GM that is displayed according to the playback timing of the sample voice for the text of the learning content. By comparing the display positions of the first marker GM and the second marker UM, it is possible to easily visually confirm whether the learner's reading of the text is fast, appropriate, or slow relative to the sample voice. Therefore, the learner can adjust reading aloud at a speed similar to the sample speech while reading the text aloud.

When the display of the marker UM corresponding to the input position of the reading voice US reaches the end of the text (the learner reads the text to the end) (step D7, Yes), the CPU 11 compares the reading voice of the learner with the sample voice. Evaluation by comparison is performed (step D12). The evaluation of the reading voice will be described later.

On the other hand, when it is set in the learning setting data 12f that the first marker GM (guide marker) is not displayed (step D2, No), the CPU 11 inputs voice reading of the text by the learner. Voice input from the unit 18 is started (step D8).

In addition, the CPU 11 stores the reading voice of the text input by the learner from the voice input unit 18 for evaluation to be described later, and detects the content of the utterance to determine the reading position of the text (step D9). . The CPU 11 starts displaying a second marker UM (user marker) for the text according to the reading position of the text determined for the reading voice (step D10).

After that, until the input of the learner's reading voice US ends (the learner reads the text aloud to the end) (step D11, No), the CPU 11 continues to read the text by the learner input from the voice input unit 18. Accordingly, the display is controlled so as to change the display position of the second marker UM so as to clearly indicate the reading position in the text (steps D9 and D10).

In this case, the first marker GM is not displayed on the learning screen DS3 shown in FIG. 13, and only the second marker UM is displayed in the same manner as described above. Detailed description is omitted.

In this way, by not displaying the first marker GM for the text of the learning content, it is possible to increase the difficulty of reading aloud in the same way as the sample speech, and obtain an evaluation result for the reading aloud. That is, it is possible to check the results of learning by obtaining evaluation results of reading aloud under difficult conditions.

When the input of the reading voice US is completed (step D11, Yes), the CPU 11 evaluates the reading voice of the learner by comparing it with the sample voice (step D12). The evaluation of the reading voice will be described later.

Note that if the learning setting data 12f is set not to display the second marker UM, the processing for displaying the second marker UM is omitted in the above description.

In the above description, the background color of the first marker GM is displayed in a color different from the others, and the second marker UM is displayed with an underline. may be used. For example, the character color may be changed, the character font may be changed, or the character may be erased. Alternatively, the upper half of the text (character or background color) may be in the first color representing the first marker GM, and the lower half of the text may be in the second color different from the first color representing the second marker UM. good.

In addition, the first marker GM and the second marker UM described above specify the range of the text, but a mark (or figure) indicating only the position of the word or character that is the target of the sample voice (reading voice), etc. may be displayed.

Also, in FIGS. 11 and 14, the display positions of the first marker GM and the second marker UM are shown to change on a word-by-word basis, but the display positions may be shown on a character-by-character basis.

Next, the evaluation of the read aloud voice by the learner will be described.

The learning content includes a sample voice obtained by reading a text aloud by a native speaker, and evaluation criteria data for evaluating the learner's reading voice based on the sample voice. Creation of evaluation criteria data is executed as follows. For example, a sample speech is converted into speech data, and physical quantities such as power and frequency are calculated for each frame divided by a fixed time. , the strength of consonants/vowels, changes in dynamics, and the like. Based on these determination results, the sample speech read aloud by the native speaker is digitized and used as evaluation reference data.

In learning step 3 (third mode), the CPU 11 executes the same processing as the sample voice described above for the reading voice recorded by the learner reading the text aloud, digitizes the reading voice, and evaluates it. Generate data.

The CPU 11 compares the evaluation reference data of the sample speech with the evaluation target data of the read-aloud speech, assigns scores for a plurality of parameters, and further integrates the scores for the plurality of parameters to calculate a comprehensive evaluation of the read-aloud speech. . The plurality of parameters include, for example, reading time, consonant determination (consonant strength), sharpness, smoothness, and the like.

Basically, the CPU 11 assigns a higher score as the evaluation reference data and the evaluation target data are closer. As for the read-aloud time, the closer the reading time of the sample voice and the read-aloud voice is, the higher the score may be.

Furthermore, the evaluation of the reading voice may be performed not only on a sentence-by-sentence basis of the entire text, but also on a sentence-by-sentence or word-by-word basis to obtain an evaluation value for each. In this case, the learner may designate a partial text range to be evaluated for the text, and the evaluation value for the text range may be output. Furthermore, evaluation may be performed by reading aloud only a part of the text instead of reading the entire text aloud. For example, when the first marker GM is displayed, reading aloud is started at the timing when the first marker GM reaches a sentence to be evaluated. The CPU 11 evaluates the read-aloud voice input by the learner in units of sentences. As a result, even if the text of the learning content is long, the evaluation result can be output even if the reading is interrupted in the middle, or the evaluation result can be output by selecting the sentence in the text that you want to study intensively. is possible, and learning can be made more efficient.

When the evaluation of the reading voice is completed, the CPU 11 updates the learning progress information of the learning content to be learned in the learning management data 12e so as to indicate the completion of the learning step 3 (step D13), and updates the evaluation result of the reading voice. This evaluation result screen is displayed on the touch panel type display unit 17 (step D14).

FIG. 15 is a diagram showing an example of the evaluation result screen DS4 in this embodiment.

On the evaluation result screen DS4 shown in FIG. 15, for example, together with the overall evaluation D41, the parameter scores D42 and the parameter scores D42 for each of a plurality of parameters (reading time, consonant judgment (consonant strength), sharpness, smoothness) are graphed. A parameter score graph D43 is displayed.

By confirming the comprehensive evaluation D41 and the parameter score D42 on the evaluation result screen DS4, it is possible to easily grasp the result of learning for one learning content executed through learning steps 1 to 3 (first mode to third mode). can be done.

The evaluation result screen DS4 is provided with, for example, a "sound reproduction" button D44, a "relearn" button D45, and an "end" button D46.

When the CPU 11 detects an operation to select the "sound reproduction" button D44 (step D15, Yes), the CPU 11 executes sound reproduction processing for sample speech or recorded reading speech (step D16). For example, the learner arbitrarily selects a sample voice or reading voice, and the CPU 11 outputs the sample voice or reading voice from the voice output unit 19 . At this time, the CPU 11 displays the learning screen DS3 shown in FIG. 13, which is the same as when the reading voice is input, so that the change in the first marker GM and the second marker UM can be referred to. As a result, the learner can check the situation when reading aloud (reading aloud quickly/slowly, etc.) while listening to the recorded reading voice. Also, by comparing changes in the first marker GM and the second marker UM, it is possible to visually confirm the evaluation of smoothness.

Further, when the CPU 11 detects an operation to select the "relearning" button D45 (step D17, Yes), the CPU 11 returns to the process of step D1 and executes the same process as described above.

When the CPU 11 detects an operation to select the "end" button D46 (step D18, Yes), the CPU 11 ends the processing of learning step 3 (third mode).

In this way, in the learning step 3 (third mode) of the electronic dictionary 10 in the present embodiment, the evaluation result of the learner's reading voice based on the sample voice for the text is obtained, so the reading speed and pronunciation of the text can be obtained. It becomes easy to objectively recognize the correctness of a sentence and feed it back to language learning.

In the electronic dictionary 10 of this embodiment, the learning process having the learning steps 1 to 3 (first mode to third mode) described above can be executed, so that language learning can be performed effectively.

Also, depending on the learner, for example, by sequentially executing learning steps 2 and 3 (second mode and third mode) or learning steps 1 and 2 (first mode and second mode), Combined and effective language learning becomes possible.

FIG. 16 is a schematic diagram of a learning support system according to an embodiment of the present invention. The learning support system 1 of this embodiment further includes a server 20 . FIG. 16 shows a functional block diagram showing the configuration of the electronic circuit of the server 20. As shown in FIG.

The server 20 has a configuration of a computer in which programs recorded on various recording media or transmitted programs are read and the operation is controlled by the read programs. processing unit) 21 is provided.

The CPU 21 functions as a control unit that controls the server 20 as a whole. The CPU 21 receives a control program pre-stored in the memory 22, a control program read into the memory 22 from a recording medium 23 such as a ROM card via a recording medium reading unit 24, or a network such as the Internet (not shown). It controls the operation of each part of the circuit according to a control program downloaded from an external device (server or the like) and read into the memory 22 through the .

Control programs stored in the memory 22 include a dictionary control program 22a, a learning processing program 22b, and the like. Note that the programs and data stored in the memory 22 shown in FIG. 16 are substantially the same as the programs and data with the same names shown in FIG. 1, and description thereof will be omitted.

In the above description, the electronic dictionary 10 executes the learning process based on the learning program 12b, but the server 20 may execute the learning process based on the learning program 22b. In this case, the CPU 21 (control unit) mounted on the server 20 executes the same processing as the learning processing based on the learning program 12b described above, and transmits the processing result to the electronic device (such as the electronic dictionary 10) through the network N. to display the screen (DS1 to DS4, etc.) and output audio as described above.

In general, the processing capacity of the server 20 is higher than that of an electronic device such as the electronic dictionary 10, so by having the server 20 execute the learning process, the load on the electronic dictionary 10 can be greatly reduced and the processing efficiency of the entire process can be improved. can be improved. In addition, the server 20 can store a large amount of learning content data, and can provide a large number of learners with a wide variety of learning content.

Furthermore, a system in which electronic devices (such as the electronic dictionary 10) and the server 20 work together may execute the same processing as described above. In this case, the CPU 11 (control unit) of the electronic device (such as the electronic dictionary 10) and the CPU 21 (control unit) of the server 20 cooperate with each other based on the learning program, thereby functioning as a control unit of the system. The electronic device and the server 20 execute a part of the learning process assigned to each, and cause the electronic device to output the processing result.

Note that the methods described in the embodiments, that is, each method such as the processing shown in the flowcharts, can be executed by a computer using memory cards (ROM cards, RAM cards, etc.), magnetic disks (flexible disks, hard disks, etc.). , an optical disk (CD-ROM, DVD, etc.), a semiconductor memory, or other recording medium for distribution. Then, the computer reads the program recorded in the external recording medium, and the operation is controlled by this program, thereby realizing processing similar to the functions described in the embodiments.

In addition, program data for realizing each method can be transmitted over a network (Internet) in the form of program code, and the program data can be captured from a computer connected to this network and processed in the same manner as in the above-described embodiment. function can also be realized.

It should be noted that the present invention is not limited to the embodiments, and can be variously modified in the implementation stage without departing from the gist of the invention. Furthermore, the embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some components are deleted from all the components shown in the embodiments, or some components are combined, the problems described in the column of problems to be solved by the invention can be solved, and the invention If the effect described in the effect column of 1 above can be obtained, a configuration in which this constituent element is deleted or combined can be extracted as an invention.

The invention described in the original claims of the present application is appended below.

[1]
For the text corresponding to the sample voice displayed on the display unit in accordance with the reproduction timing of the sample voice without outputting the sample voice corresponding to the text selected as the processing target from the voice output unit, a text marker mode for displaying a marker representing the playback position of the sample voice;
The text corresponding to the sample voice is displayed on the display unit, the reading voice obtained by reading the text is input from the voice input unit, the reading voice is evaluated based on the sample voice, and the evaluation result is displayed on the display. An electronic device having a control unit for executing processing by an evaluation mode displayed in the unit.

[2]
The control unit
The electronic device according to [1], wherein when the evaluation mode is executed, the text corresponding to the sample voice is displayed on the display unit without outputting the sample voice from the voice output unit.

[3]
The control unit
outputting the sample voice from the voice output unit and representing the playback position of the sample voice with respect to the text corresponding to the sample voice displayed on the display unit in accordance with the playback timing of the sample voice; The electronic device according to [1] or [2], which executes a sample voice mode for displaying a marker.

[4]
The control unit
storing progress information indicating execution statuses of the sample voice mode, the text marker mode, and the evaluation mode for each text;
The electronic device according to [3], wherein any one of the sample voice mode, the text marker mode, and the evaluation mode is executed based on the progress information of the text selected as the processing target.

[5]
The control unit
The electronic device according to [3] or [4], wherein the processing in the text marker mode is executed after executing the processing in the sample voice mode, and the processing in the evaluation mode is executed after executing the processing in the text marker mode. .

[6]
The control unit, when executing the evaluation mode, places at least one of a first marker representing a playback position of the sample voice and a second marker representing a reading position of the reading voice for the text. The electronic device according to any one of [1] to [5] for displaying.

[7]
[6] The electronic device according to [6], wherein the control unit displays the first marker and the second marker in different display modes.

[8]
The electronic device according to [6] or [7], wherein the control unit displays the first marker and the second marker in a display form different from that of the text.

[9]
The control unit
storing setting data indicating whether or not to display the first marker and the second marker in the evaluation mode;
The electronic device according to any one of [6] to [8], wherein the first marker and the second marker are displayed according to the setting data.

[10]
An information processing method in an electronic device having a control unit,
The control unit
For the text corresponding to the sample voice displayed on the display unit in accordance with the reproduction timing of the sample voice without outputting the sample voice corresponding to the text selected as the processing target from the voice output unit, a text marker mode for displaying a marker representing the playback position of the sample voice;
The text corresponding to the sample voice is displayed on the display unit, the reading voice obtained by reading the text is input from the voice input unit, the reading voice is evaluated based on the sample voice, and the evaluation result is displayed on the display. An information processing method for executing processing according to an evaluation mode displayed in a section.

[11]
the computer,
For the text corresponding to the sample voice displayed on the display unit in accordance with the reproduction timing of the sample voice without outputting the sample voice corresponding to the text selected as the processing target from the voice output unit, a text marker mode for displaying a marker representing the playback position of the sample voice;
The text corresponding to the sample voice is displayed on the display unit, the reading voice obtained by reading the text is input from the voice input unit, the reading voice is evaluated based on the sample voice, and the evaluation result is displayed on the display. A program that functions to perform processing according to evaluation mode, which is displayed in the section.

10... Electronic dictionary 11, 21... CPU 12, 22... Memory 12a... Dictionary control processing program 12b... Learning processing program 12c... Dictionary data 12d... Learning content data 12e... Learning management data 12f... Learning Setting data 12g... Read-aloud evaluation data 13... External recording medium 14... Recording medium reading unit 15... Communication unit 16... Key input unit 17... Touch panel type display unit 18... Voice input unit 19... Voice output Part 20... Server.

Claims (11)

For the text corresponding to the sample voice displayed on the display unit in accordance with the reproduction timing of the sample voice without outputting the sample voice corresponding to the text selected as the processing target from the voice output unit, a text marker mode for displaying a marker representing the playback position of the sample voice;
The text corresponding to the sample voice is displayed on the display unit, the reading voice obtained by reading the text is input from the voice input unit, the reading voice is evaluated based on the sample voice, and the evaluation result is displayed on the display. An electronic device having a control unit for executing processing by an evaluation mode displayed in the unit. The control unit
2. The electronic device according to claim 1, wherein when the evaluation mode is executed, the text corresponding to the sample voice is displayed on the display unit without outputting the sample voice from the voice output unit. The control unit
outputting the sample voice from the voice output unit and representing the playback position of the sample voice with respect to the text corresponding to the sample voice displayed on the display unit in accordance with the playback timing of the sample voice; 3. The electronic device according to claim 1, wherein the electronic device executes a sample voice mode in which markers are displayed. The control unit
storing progress information indicating execution statuses of the sample voice mode, the text marker mode, and the evaluation mode for each text;
4. The electronic device according to claim 3, wherein one of said sample voice mode, said text marker mode, and said evaluation mode is executed based on said progress information of a text selected as a processing target. The control unit
5. The electronic device according to claim 3, wherein the processing in the text marker mode is executed after executing the processing in the sample voice mode, and the processing in the evaluation mode is executed after executing the processing in the text marker mode. . The control unit, when executing the evaluation mode, places at least one of a first marker representing a playback position of the sample voice and a second marker representing a reading position of the reading voice for the text. 6. The electronic device according to any one of claims 1 to 5, for displaying. 7. The electronic device according to claim 6, wherein said control unit displays said first marker and said second marker in different display modes. 8. The electronic device according to claim 6, wherein said control unit displays said first marker and said second marker in a display form different from said text. The control unit
storing setting data indicating whether or not to display the first marker and the second marker in the evaluation mode;
9. The electronic device according to claim 6, wherein said first marker and said second marker are displayed according to said setting data. An information processing method in an electronic device having a control unit,
The control unit
For the text corresponding to the sample voice displayed on the display unit in accordance with the reproduction timing of the sample voice without outputting the sample voice corresponding to the text selected as the processing target from the voice output unit, a text marker mode for displaying a marker representing the playback position of the sample voice;
The text corresponding to the sample voice is displayed on the display unit, the reading voice obtained by reading the text is input from the voice input unit, the reading voice is evaluated based on the sample voice, and the evaluation result is displayed on the display. An information processing method for executing processing according to an evaluation mode displayed in a section. the computer,
For the text corresponding to the sample voice displayed on the display unit in accordance with the reproduction timing of the sample voice without outputting the sample voice corresponding to the text selected as the processing target from the voice output unit, a text marker mode for displaying a marker representing the playback position of the sample voice;
The text corresponding to the sample voice is displayed on the display unit, the reading voice obtained by reading the text is input from the voice input unit, the reading voice is evaluated based on the sample voice, and the evaluation result is displayed on the display. A program that functions to perform processing according to evaluation mode, which is displayed in the section.

Images