JP2019211496A - Language learning support system - Google Patents

Abstract

To provide a language learning support system that can sequentially determine a text input by a learner in word units in dictation.SOLUTION: Providing a system that outputs a sentence selected by predetermined selection means as voice output information, that sequentially determines whether or not a word input by a learner hearing the sentence is correct, and that visibly displays only a correct input word of words input by the learner in a position identified in a word order in an area which can display the words constituting the sentence being a target of the hearing in the word order, enables the text input by the learner to be sequentially determined in a word units in dictation.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a language learning support system, and more specifically, relates to a system that inputs speech output information of a language to be learned as text information and performs correct / incorrect determination.

  Of foreign language learning methods, dictation, that is, a method of writing foreign language speech output information into text information is said to be effective for hearing.

  By the way, in English, taking English as an example, the pronunciation of each word constituting a sentence and the pronunciation of a word arranged in the sentence may be heard differently even for the same word.

  This is because liaison (ringing) means that the words that make up the sentence and the words before and after the language are pronounced in a conventional manner, resulting in a pronunciation different from the pronunciation of a single word. . The dictation is said to be one of the most suitable methods for training to listen to each word in the sentence, unlike the pronunciation of individual words such as ringing. This is because an accurate reproduction of the hearing result is compulsory by interposing a work of writing up as compared with the case of simply listening.

  Conventionally, as a system capable of dictation, when an input operation of a sentence including a plurality of words is received from a user (learner) with respect to speech output information of a sentence having a predetermined designation, each word of the designated sentence is received. A learning support system that determines an error word and an error type among the words of the input sentence has been proposed (see, for example, Patent Document 1).

  According to this configuration, since the evaluation is performed for each word of the sentence with respect to the input data, it is possible to accurately determine the hearing ability of the learner for the pronunciation unique to the sentence that is different from the pronunciation of each individual word such as the ringing. I could expect the effect.

Japanese Patent Laying-Open No. 2015-60074

  However, according to the prior art, the error word and the error type are determined after waiting for the input of the entire sentence, and the specific gravity of the learner gradually shifts from the hearing itself to the input operation. There was a possibility of deviating from the original purpose of dictation. Furthermore, if the written sentence can be corrected before the above judgment is made, it is possible to perform a grammatical check on the displayed input sentence, and the judgment on the input sentence after such a check is an accurate hearing. There was a risk of not being able to judge its own ability.

  Also, the input method is to input from the first word of the sentence. For example, in the middle of a sentence, the input of a word that could not be heard is suspended and the input from the heard word is selectively and immediately input. Was impossible. As a result, conventionally, in the case of input, first, the entire sentence that has been heard has to be stored, and there has been an inconvenience that accurate hearing ability cannot be measured.

  An object of the present invention is to solve the above-described problems, and an object of the present invention is to provide a language learning support system that can sequentially determine a text input by a learner in units of words in dictation.

  In order to achieve the above object, the language learning support system according to the present invention is an area in which words inputted by the learner are sequentially judged for correctness and the words constituting the sentence to be interviewed can be displayed in the word order. The most important feature is that only correct input words are displayed so as to be visible at positions specified in the word order.

That is, the language learning support system according to the present invention inputs speech output information of a sentence configured in a language to be learned as characters in the language, and compares the sentence with the sentence to determine whether the input character is correct or incorrect. A language learning support system to perform,
Storage means comprising a plurality of the sentences, and storing each sentence in association with the voice output information and the character information;
A voice output unit that reads out the voice output information and the character information selected by the predetermined selection unit from the storage unit, and outputs the voice output information;
An input means for enabling input of characters corresponding to the output audio output information in units of words;
A determination means for collating the input word input by the input means with the constituent words constituting the sentence and determining correctness;
Control means for controlling to display only input words that match the constituent words by the correctness determination as display words;
Display means for displaying the matched display word;
With
The display means has a sentence display area that allows the entire sentence to be displayed when each constituent word is arranged at a position specified according to the word order of the sentence, and the control means is read from the storage means. In contrast to the character information, the display word is controlled to be displayed at the specified position in the region.

  According to this configuration, correct / incorrect determination is made on the input words, and only the input words determined to be correct are displayed at the positions specified in the word order sequence in the sentence each time the correct / incorrect determination is made. be able to.

  The display means has an input word display area for displaying an input word input by the input means in an area different from the sentence display area, and the control means is determined to be the coincidence by the determination means In addition, the display word may be displayed in the sentence display area and the input word may be deleted from the input word display area.

  According to this structure, what has been input can be confirmed in real time in units of words.

  The control means arranges the character information read from the storage means in the sentence display area before the correctness determination, and arranges the entire sentence by arranging the constituent words in the same color as the background color. Only the constituent words corresponding to the input words determined to match by the correctness determination may be changed to a color scheme that can be visually recognized as the display words.

  According to this configuration, the sentence itself is displayed in advance in the sentence display area and can be displayed only by changing the color scheme, so that the determination result can be displayed quickly.

  The control means is not determined to match, and when the position of the constituent word maintained in the hidden character is selected by the input means, the constituent word is changed to a visually recognizable color scheme and the displayed word You may be able to do that.

  According to this configuration, when the input word is incorrect, the correct constituent word can be quickly confirmed.

  The blank character portion and the delimiter character portion before and after the input word determined to match may be automatically complemented by the control means and displayed together with the display word by the display means.

  Since the characters (blank characters and delimiters) required for text display are not directly related to the hearing itself, according to this configuration, these blank characters and delimiters are automatically complemented in the input operation. You can also be able to concentrate on the hearing.

  When the sentence includes a plurality of the same constituent words, the control means sequentially inputs the constituent words that are consecutively located either before or after by the input means, thereby specifying the position of the same constituent words. For those that can be displayed, only the constituent words arranged at the position are displayed as display words, and for those in which only the same constituent words are input by the input means, all of the same constituent words are displayed as display words. You may control to display.

  According to this configuration, even if a plurality of the same constituent words in the sentence are included, it is possible to determine as much as possible which word the input word has heard and input.

  For the case where only the same constituent word is input, all of the same constituent words are displayed as display words. In such a case, the control means can display the display as distinguishable from other display words. For example, since at least a word that displays all of the above as a display word can be visually recognized, even if the learner includes the plurality of constituent words, the learner can easily find a word that can be substantially heard and cannot be heard. Can be visually recognized.

  The determination means determines whether or not at least the input word matches in units of constituent characters, and determines whether or not there is a character other than a blank character or a delimiter before the beginning and after the end of the matching portion. Also good.

  According to this configuration, it is possible to determine only words whose spelling is completely matched as display words, thereby enabling accurate determination.

  The language learning support system according to the present invention makes it possible to sequentially determine the text input by the learner in units of words in dictation, and has the effect of contributing to improvement of language hearing skills.

FIG. 1 is a block diagram of a language learning support system according to the present invention. FIG. 2 is a diagram showing a processing flow for determining whether an input word is correct or not in the language learning support system according to the present invention. FIG. 3 is a diagram schematically illustrating a display mode of the sentence side display unit. 4A and 4B are diagrams showing the transition of the display screen example of the language learning support system according to the present invention in a time series, in which FIG. 4A is a screen example before the input word is input, and FIG. An example of a screen showing a state where an input word is input on the display unit, (c) is an example of a screen showing a state where a display word is displayed on the sentence side display unit after the correctness of the input word is determined, and (d) is an input The example of a screen which showed the state which displayed the word determined to be an error on the sentence side display part is shown. FIG. 5 is a diagram showing an example of a display screen when a plurality of identical constituent words are included in a sentence.

  In FIG. 1, reference numeral 1 denotes a language learning support system according to the present invention. The language learning support system 1 includes a storage unit 12 (corresponding to a storage unit) that stores a teaching material in which voice output information of a plurality of sentences composed of languages to be learned and character information are associated with each other. When any one of the plurality of teaching materials stored in the storage unit 12 is selected by the input unit 14 (corresponding to a selection unit), the reading is read out from the storage unit 12. The read audio output information of the teaching material is output by the audio output unit 13 (corresponding to the audio output means). When the learner outputs from the voice output unit 13, the learner sequentially inputs the heard words in the language to be learned from the input unit 14 (corresponding to the input unit).

  The input word (input word) is the character information read from the storage unit 12 by the determination unit 15 (corresponding to the determination unit), that is, the word (configuration word) constituting the selected sentence. The presence or absence of a matching word is determined. If there is a matching word, the control unit 11 (corresponding to the control means) displays only the word on the display unit 16 (corresponding to the display means). The displayed word (display word) is displayed at a predetermined position in the display area of the display unit 16 by the control unit 11 as described later.

  The language learning support system 1 may be constructed as a dedicated system that exhibits various functions according to the present invention, but some functions are realized by computer software and installed in an existing personal computer, for example. There may be. In this case, a CPU (Central Processing Unit), a RAM (memory), a ROM (storage) and peripheral devices include an input device such as a mouse and a keyboard, and an output device such as a display and a speaker. Then, the CPU reads the teaching material data stored in the storage or the external storage device in accordance with an instruction input from the input device, and outputs an audio output signal to the speaker from the audio output information of the teaching material data. Control to do.

  When the CPU receives an input word input from the input device, the CPU reads a processing program stored in the storage into the memory, and the processing word constitutes character information of the read teaching material data by the processing program. The input word that matches is determined, and only the matching word is controlled to be output to an output device (for example, a display).

  As described above, FIG. 1 illustrates a block diagram based on the functional concept of the language learning support system 1 according to the present invention, and as long as the functions described in the claims are exhibited, FIG. It is not intended to limit the configuration to that shown in FIG.

  FIG. 1 shows an integrated configuration based on a stand-alone system not connected to a computer network such as the Internet. For example, the audio output unit 13, the input unit 14, and the display unit 16 are connected to a communication line such as the Internet. The network terminal may be connected to a server provided with the control unit 11, the storage unit 12, and the determination unit 15 via the communication line from the network terminal, and the connected network terminal There may be a plurality of units. In addition, the storage unit 12 may be constructed as a database system independent of other functions. As described above, when connecting via a communication line, the individual functions are distributed and connected, and the language learning support system is configured as a whole.

  Moreover, the processing program may be used via the communication line as a so-called web application in addition to being installed in the personal computer, without being installed in the network terminal.

  Hereinafter, the processing contents of the correct / incorrect determination of the input word of the language learning support system according to the present invention will be described with reference to FIG. In this embodiment, English will be described below as an example of the language to be learned.

  As described above, when acquiring the character string of the input word input from the input unit 14 (S1), the determination unit 15 determines whether the character string is valid as a word (S2). For example, when there is an input that is not recognized as valid as an input word, such as an input of only a symbol or an input of a character string other than English, the determination process is immediately terminated (N in S2). On the other hand, if it is determined that the input word is valid (Y in S2), the input word is checked (matched) for a match in the sentence (S3).

  If it is determined that there is no match, the determination process is immediately terminated (N in S4). On the other hand, when it is determined that there is a matching portion (Y in S4), the character before the head of the matching portion is inspected (collated) (S5). If there is a character before the beginning of the match, and it is not a so-called blank character (N in S6), the spelling is different, so it is determined as another word, and the process returns to S3 again to match the sentence in the sentence Perform the inspection. On the other hand, in the case of a blank character (Y in S6), the character after the end of the matching portion is inspected (verified) (S7). If there is a character after the end of the matching part and it is not a so-called blank character (N in S8), the spelling is different as described above, so that it is judged as another word, and the process returns to S3 and is in the sentence again. Check for matching points. On the other hand, in the case of a blank character (Y in S8), since it is a complete match, it is recognized as a word (constituent word) in the sentence (S9). Next, it is determined whether or not the recognized input word is an unknown matching part (S10). If it is determined that it is not unknown (known) (N in S10), the process returns to S3 and matches in the sentence. Perform inspection (verification). On the other hand, if it is determined as an unknown matching part (Y in S10), the coloration of the matching part in the sentence is changed to be visible (S11), and the process returns to S3 to check other matching parts in the sentence. (Verification) is performed. In the present embodiment, in S11, the color scheme of the matching part is changed, but the color scheme may be displayed by a visually recognizable method, and the change of the color scheme is an example and is not intended to be limited to this.

  As described in S6 and S8, by confirming the presence or absence of a blank character both before the beginning and after the end of the matching part, only words that completely match the spelling are recognized as matching words. For example, a difference due to a change in word form (for example, in the case of the past form, the difference only in the presence or absence of “d” at the end) often matches most of the words. Therefore, accurate determination can be made in units of words in the sentence. Note that, for the purpose of dictation, that is, for the purpose of improving listening skills, for example, uppercase and lowercase characters in input words, delimiters such as periods and commas, etc. are not subject to determination processing. On the other hand, an apostrophe or the like itself is a symbol and has no corresponding sound, or has an influence on the pronunciation of a word (for example, “It is” and “It's” may be an agreement) , Different pronunciations, etc.) are subject to determination. That is, in the example of “It is” and “It's”, both are recognized as different words.

  Hereinafter, an example of a user interface displayed on the display unit 16 will be described with reference to FIG. Note that FIG. 3 is shown as an example, and the present invention is not limited to this form.

  In FIG. 3, since it is premised on a system in which a plurality of user terminals access teaching materials, a user ID display unit 16a is set in the front view and the upper left of the screen. When a teaching material is selected by the input unit 14 such as a keyboard, the title of the teaching material is displayed on the title display unit 16b. The selection operation may be selected by scrolling down the title display unit 16b with the input unit 14 (not shown).

  When sound is output from the sound output unit 13 in response to the instruction to play the teaching material sound, the elapsed time is displayed on the progress bar 16c. On the right side of the screen in the front view, a control component display section 16d is provided such as a button for performing playback, fast forward and rewind, a repeat location designation icon, a playback speed adjustment bar, a radio button for selecting a writing function, and the like. Yes.

  On the other hand, on the left side of the middle part of the screen, there is provided a teaching material display section for displaying teaching material data. The teaching material display unit is composed of the waveform information display unit 16e of the output voice, the sentence side display unit 16f, and the native language translation display unit 16g. The teaching material display section can be enlarged and changed in size. A writing display section is provided below the teaching material display section. The writing display unit is composed of an input side display unit 16h and a submit button unit 16i.

  When the learning material is selected, the sentence included in the selected learning material is displayed as a hidden character on the sentence side display unit 16f. In the present embodiment, for convenience of explanation, “I ′m going to cut it out.” Is displayed on the sentence side display portion 16f by a broken line. However, in actuality, for example, the same color as the background color is used. It is invisible because of the color scheme.

  The sentence side display unit 16f has an area (sentence display area) in which the entire sentence can be displayed in accordance with the words constituting the sentence, that is, the word order of the constituent words. On the other hand, the input side display unit 16h is a region where an input word is displayed (input word display region) when the learner sequentially inputs the heard words to the voice output from the voice output unit 13 through the input unit 14. ).

  After the display of the input word, if the determination unit 15 determines that the word matches the constituent word, the matching constituent word has a color scheme that is visible at the position of the word order in the sentence of the word in the sentence display area. Change and display as display word.

  Hereinafter, transition of the display screen in time series corresponding to the determination process will be described with reference to FIG. For convenience of explanation, only the sentence side display unit 16f and the input side display unit 16h are shown in the display screen described in FIG.

  Before the input word is input, the sentence side display unit 16f is in a state in which the entire sentence serving as the teaching material is turned upside down (FIG. 4A). At this stage, the learner cannot visually recognize the sentence, but the sentence display area is fixed, and the position of each display word constituting the sentence is specified.

  When the voice output unit 13 outputs the sentence that has been turned upside down, and the learner hears it and inputs it through the input unit 14, the input word is displayed on the input side display unit 16h (FIG. 4B). In the present embodiment, the sentence prefix “I ′m” is input and displayed on the input side display unit 16h, that is, “I ′m” is displayed only in the input word display area. At this time, the input “I ′m” is not displayed in the sentence-side display area because the determination unit 15 is performing the determination process.

  When it is determined by the determination processing that the input “I ′m” matches the constituent word, the input is displayed on the sentence side display unit 16f which is a sentence side display area (FIG. 4C). The input word “I ′m” displayed on the side display unit 16h is deleted. It should be noted that “I ′m” displayed on the sentence-side display unit 16f is “I ′m” arranged in advance (in the case of this example, at the beginning of the word) in a hidden character in accordance with the word order of the sentence. Is displayed by changing the color scheme to a visually recognizable color scheme. Note that “I'm” is an apostrophe word, so if you enter it in a format that does not use abbreviations, such as “I am”, the meaning is the same, but you can hear it as “I am”. It is determined that it has not been displayed, and is not displayed on the sentence side display unit 16f.

  Thereafter, the determination process is executed in units of words each time the words sequentially heard by the learner are input through the input unit 14 in the same procedure as described above. In the present embodiment, since the learner cannot hear “cut it” in the sentence and cannot input it (or there is an input of a spelling error), it is determined as an error input, and the hidden character is displayed in the sentence side display area. In the position specified in Fig. 4 (b), the concealed character is maintained. That is, the portion that could not be heard (including the case where the spelling was input with an incorrect spelling) is displayed as if blank characters for the words that could not be heard were formed when viewed from the learner side. When the word part in the state in which the above-mentioned hidden characters are maintained is specified and specified by the input unit 14 (for example, after clicking the range by the pointing device, an operation such as clicking) is visible (see FIG. 4D). It is possible to display a constituent word that is in a hidden state as a display word. With such a configuration, the learner can immediately and clearly recognize which word in the sentence is a word that he / she could not hear.

  By the way, the same word may be included in the sentence. For example, the sentence side display area “He side it was possible to make it.” In FIG. 5 includes two “it” in the sentence. In this case, if “it” is input to 16h without any particular front and back, both “it” are displayed in 16f. For example, when the learner sequentially inputs the preceding and following words such as “He”, “said”, “it”, and “was” on the input side display unit 16h, the “it” input by the learner is which “it”. If it can be specified, it is determined that the former “it” is input, and the former “it” is displayed on the sentence side display unit 16f, but the latter “it” is not displayed.

  For convenience of explanation, in FIG. 5, “it” is displayed on both the input side display unit 16h and the sentence side display unit 16f. However, in actuality, it is determined that “it” is input, and the sentence is displayed. (It is displayed on the side display unit 16f and “it” in the input side display unit 16h is deleted).

  On the other hand, when the learner inputs only “it” into the input side display unit 16h, all “it” are displayed on the sentence side display unit 16f (see FIG. 5). In this case, for example, when other words are also displayed, a display distinguishable from the other words, for example, “it” may have a different color scheme from the other words.

DESCRIPTION OF SYMBOLS 1 Language learning support system 11 Control part 12 Memory | storage part 13 Voice output part 14 Input part 15 Determination part 16 Display part 16f Sentence side display part 16h Input side display part

Claims (8)

A language learning support system that inputs speech output information of a sentence configured in a language to be learned in characters in the language and compares the sentence with the sentence to determine whether the input character is correct or incorrect.
Storage means comprising a plurality of the sentences, and storing each sentence in association with the voice output information and the character information;
A voice output unit that reads out the voice output information and the character information selected by the predetermined selection unit from the storage unit, and outputs the voice output information;
An input means for enabling input of characters corresponding to the output voice output information in units of words;
A determination means for collating the input word input by the input means with the constituent words constituting the sentence and determining correctness;
Control means for controlling to display only input words that match the constituent words by the correctness determination as display words;
Display means for displaying the matched display word;
With
The display means has a sentence display area that allows the entire sentence to be displayed when each constituent word is arranged at a position specified according to the word order of the sentence, and the control means is read from the storage means. A language learning support system, wherein the display word is controlled to be displayed at the specified position in the region in contrast to the character information.   The display means has an input word display area for displaying an input word input by the input means in an area different from the sentence display area, and the control means is determined to be the coincidence by the determination means The language learning support system according to claim 1, wherein the display word is displayed in the sentence display area and the input word is deleted from the input word display area.   The control means arranges the character information read from the storage means in the sentence display area before the correctness determination, and arranges the entire sentence by arranging the constituent words in the same color as the background color. 3. The language learning support system according to claim 1, wherein only the constituent words corresponding to the input words determined to match by the correctness determination are changed to a color scheme that can be visually recognized as the display words. .   The control means is not determined to match, and when the position of the constituent word maintained in the hidden character is selected by the input means, the constituent word is changed to a visually recognizable color scheme and the displayed word The language learning support system according to claim 3, wherein:   2. The blank character portion and the delimiter character portion before and after the input word determined to match are automatically complemented by the control means and displayed together with the display word by the display means. 5. The language learning support system according to any one of items 1 to 4.   When the sentence includes a plurality of the same constituent words, the control means sequentially inputs the constituent words that are consecutively located either before or after by the input means, thereby specifying the position of the same constituent words. For those that can be displayed, only the constituent words arranged at the position are displayed as display words, and for those in which only the same constituent words are input by the input means, all of the same constituent words are displayed as display words. The language learning support system according to claim 1, wherein the language learning support system is controlled so as to be displayed.   7. The language learning support system according to claim 6, wherein when all of the same constituent words are displayed as display words, the control means displays the display words so as to be distinguishable from other display words.   The determination means determines whether or not at least the input words match in units of constituent characters, and determines the presence or absence of a character other than a blank character or a delimiter before the beginning and after the end of the matching portion. The language learning support system according to any one of claims 1 to 7.

Images