JP6900605B2 - Language listening learning system with dynamic pronunciation - Google Patents

Description

Hereinafter, the language learning system of the present invention will be described as an English learning system.
The present invention relates to a language listening learning system for learning pronunciation that is the basis of listening by utilizing audiovisual materials so that native conversations and English in movies can be heard.

When English is a job, reading, writing, and speaking can be done with effort, but listening to native English (hereinafter referred to as "listening") is useless no matter how much effort is put into listening. This is because the voice that cannot be pronounced cannot be recognized no matter how many times it is heard. There are many teaching materials on pronunciation on the market, but all of them are based on the illustration of the position of the tip of the tongue and the explanation of how to move it, and even now in the heyday of computer graphics, the basics are still useless. The tongue is not a voluntary muscle that can be moved freely when speaking or eating, and cannot be intentionally controlled.

Native listening, on the other hand, improves significantly when listening while watching the speaker's lip movements. However, unpronounceable voice remains inaudible. The countermeasure is to acquire the ability to speak at native speed in order to eliminate unpronounceable voice. For that purpose, it is necessary to practice forcibly moving the lips by following the movement of the speaker's lips. On the other hand, since it is not possible to stare at the mouth of another person and listen to it, an English movie (hereinafter referred to as "movie") is used as a substitute for the native speaker, and the voice of the movie (hereinafter referred to as "line") is used while watching the movement of the lip 2. ), Which can be repeated (hereinafter referred to as "dynamic pronunciation") at the same time while watching English subtitles (hereinafter referred to as "subtitles"), was achieved with audiovisual support to see the movement of lips 2, and as a result, native speakers. This is the development of speech practice materials for languages that provide listening ability.

"Random House Webster'Unabled Dictionary", RANDOM HOUSE "American Heritage Dictionary", HOUGHTON MIFFLIN Co., Ltd. "Digital Echo Kit DE-0248FP-2 Manual", Tanioka Electronics Co., Ltd. "Korg KP3 Instruction Manual", Korg Co., Ltd.

When trying to practice dynamic pronunciation in movies (including all movies including movies such as theater movies, DVD movies, TV movies, etc., hereinafter referred to as "movies"), problems are encountered. The image of the lips 2 is too far from the subtitle 3, is too small and unclear, appears on the screen too infrequently, or sways, and sufficient image recognition regarding the movement of the lips 2 cannot be obtained. In fact, there are very few scenes where a clear and stable image of the lips 2 can be seen at the same time as the subtitle 3.

In dynamic pronunciation, even if you try to repeat while listening to the lines, the lines are too fast to follow. The repetition cannot keep up with the speed of the dialogue, and it overlaps with the beginning of the next word that comes into the ear and interferes with listening. Therefore, a signal for commanding the start timing of the repeat is required so that the redundant repeat time can be shortened and the repeat can be performed in synchronization with the movement of the lips 2.

In spoken English, there is a rhythm that allows you to add a score to a sentence, and the momentum of pronunciation is concentrated on one point with a syllable or word, and it is pronounced as if it jumps between words. On the other hand, Japanese is a flat language in which vowels are always attached to consonants that should be given momentum due to the structure of syllables, and vowels open their mouths, so there is no momentum or rhythm. When reciting with dynamic pronunciation, in addition to the signal that commands the timing of the recitation, a signal that commands the strength and rhythm of the line to be repeated is also required.

The first aspect of the present invention made to solve the above problems is to display all the movie images including the moving image distributed on the audiovisual medium on the screen 1 and output the lines of the movie to the audio output device 8. , Whether to place the image of the lips 2 that moves in synchronization with the voice of the dialogue coming into the user's ear on the upper or lower side of the subtitle 3 so that they do not overlap each other while maintaining the aspect ratio of the actual lips. , or placed on the back of the subtitle 3, in ranges lip 2 and subtitle 3 in any arrangement entering the same field at the same time, to maximize the size of the lips 2, a maximum of lip 2 when placed on the back, The size of the lips 2 is set large enough for the lips 3 so that the image of the lips 2 that passes through the subtitle 3 is not obstructed by the characters of the subtitle 3, and the voice of the dialogue that synchronizes with the clear and unwavering movement of the lips 2 is produced. , The user is equipped with an auxiliary function that assists the user to repeat the lips 2 and the subtitle 3 at the same time, a vibrating body 4, and an adjustable voice delay device 6 that delays the voice of the dialogue as needed. It is a language listening learning system based on dynamic pronunciation. The images and lines used in the learning system are distributed in an audiovisual medium. This solves the above-mentioned problem (0005).

The second aspect of the present invention, which has been made to solve the above problems, is the dynamic pronunciation-based language listening learning system according to claim 1, wherein the auxiliary function is when reciting in synchronization with the movement of the lip 2. , The signal that commands the strength and rhythm of the words and phrases of the lines that come into the ear and the timing of the start of repetition is perceived by the user by the color change of the lip 2 that is proportional to the voice intensity of the lines, so that the user can perceive it. A language listening learning system based on dynamic pronunciation, characterized in that a signal of the timing can be obtained. This solves the problems described in (0006) and (0007) above.

A third aspect of the present invention, which has been made to solve the above problems, is the dynamic pronunciation-based language listening learning system according to claim 1, when the user repeats the words in synchronization with the movement of the lips 2. It is characterized in that a signal for commanding the strength, rhythm, and timing of the start of repetition of an incoming line word or phrase is obtained from the vibrating body 4 that vibrates in proportion to the voice intensity of the line through the tactile sense of the skin. The language listening learning system based on the dynamic pronunciation according to claim 1. This solves the problems described in (0006) and (0007) above.

A fourth aspect of the present invention made to solve the above problems is that in the language listening learning system based on dynamic pronunciation according to claim 1, the movement of speech on the lip 2 is performed so as not to overlook the initial movement of the lip 2. It is characterized by being equipped with an adjustable audio delay device 6 that can set a delay of zero to a maximum of 50 milliseconds for the output audio by adding a delay time as needed from the time it is seen until the audio reaches the ear. A language listening learning system with dynamic pronunciation. This solves the problems described in (0006) and (0007) above.

The present invention is specialized in spoken English, and understanding the meaning in listening is not a problem. Therefore, news with clear utterances and no listening problems is not a learning target for dynamic pronunciation, but news has much to learn from English expressions and vocabulary. Also, news is easy to hear, but the speed of utterance is the same as that of movies. Some TV news has subtitles, and if you use this as a teaching material and repeat it with dynamic pronunciation, your English expressions and vocabulary will grow. There is a fact that English can only be understood by reciting the voice heard, either voiced or unvoiced in the head, and the above-mentioned voiced recitation improves general English proficiency at a speed that cannot be experienced anywhere else. effective.

In the dynamic pronunciation of the present invention, the pronunciation at the time of repetition is performed while looking at the subtitles, so that the characters of the subtitles are collated for each word, and in the defective syllable in which the consonant is accompanied by an unnecessary vowel, the repetition is performed at the speed of the movie. Get stuck. In other words, it has a double proofreading filter for pronunciation, and pronunciation defects are perceived. On the other hand, if you do not have the function of this proofreading filter and speak in time with news etc., pronunciation defects in syllables and words will accumulate without being perceived, and the more enthusiastic you learn, the more defects will be overwritten, and when you notice it, you will listen. Although it often suffers irreparable damage, the above-mentioned calibration filter has the effect of stopping the loss in advance, which is enough to attribute lifelong efforts to blisters.

Since the practice in dynamic pronunciation of the present invention speaks safely with a learning system characterized by a filter function that perceives pronunciation defects, progress is rapid with concentrated learning even if it is a little tight. If this is used in general movies and news, it will be effective as a ship for those who need English at work or who want to improve in a short time.

The original object of the present invention is the acquisition of listening, not the improvement of pronunciation, but the pronunciation precedes according to the principle of "the voice that cannot be pronounced cannot be heard". However, if the lines can be repeated without delay, "the voice that can be heard can be pronounced" is also established, and the inaudible syllables disappear, and the repeated pronunciation can be improved by trial and error based on the heard voice.

It is a system diagram which shows the listening learning system use situation of the language by the dynamic pronunciation of this invention. It is a flowchart of dynamic pronunciation of this invention.

FIG. 1 is a representative diagram showing an embodiment of the “language listening learning system by dynamic pronunciation” of the present invention. The movie displayed on the screen 1 is distributed on an audiovisual medium and reproduced by the audiovisual medium playback device 5. , Sent to screen 1 and displayed. As long as the movie has lips 2, subtitles 3, and lines, the background of the movie may be the full display of the movie, the sub-display display, or no background image. In addition to the screen 1 of FIG. 1, the learning system includes an audiovisual medium reproduction device 5, an adjustable audio delay device 6, a delay time adjustment knob 7 of the adjustable audio delay device, a vibrating body 4, and an audio output device 8 (earphones, It is composed of a speaker, etc.), an audio data line 10 connecting them, and a video / audio data line 11. Further, a selection menu 9 is displayed on the screen 1 as needed, and is used for selecting the size of the lips 2 and for turning on / off the function of changing the color of the lips in proportion to the voice intensity.

The dynamic pronunciation of the present invention has two problems. The first is that the movement of the speaker's lips 2 can be clearly seen, and the second is that the subtitles can be seen while watching the movement of the lips 2 and the lines can be repeated at the same time. However, once the dynamic pronunciation is acquired, even ordinary movies on the market can practice dynamic pronunciation with subtitles.

The dynamic pronunciation described in the first aspect of the present invention has a feature that the pronunciation can be improved by trial and error. Trial and error is to compare the native voice you hear with your own pronunciation and correct the differences. However, Japanese verses, which we have been accustomed to for many years, have a strong characteristic that one consonant always accompanies one vowel. Therefore, regarding the English voice that comes into our ears, we add vowels to the consonants in our head. I have a habit of listening. This habit is solid, and it is useless to adopt artificial rules such as tongue control regarding pronunciation. And everywhere, redundant words that are pronounced with unwanted vowels interfere with the beginning of subsequent words and interfere with hearing. In the dynamic pronunciation of the present invention, the unnecessary vowels are removed and the redundancy is eliminated by giving a signal for forcibly commanding the quick opening and closing of the lips according to the movement of the lips 2.

There are many people who studied abroad in the United States for four or five years and have native pronunciation, and many who have worked in the United States for 20 years but cannot get out of Japanese pronunciation and listening. The difference is simply whether or not the above-mentioned trial and error can be performed. Avid English learners are often left behind in pronunciation and listening. People who can't do trial and error are so enthusiastic that they try to incorporate unreasonable rules into pronunciation, so they can't get out of Japanese syllables even after many years, and no matter how they combine phonemes with vowels, they don't become English syllables. Continues to make great efforts. On the other hand, young people who went to the United States without much study in advance learn English syllables naturally in a short time because they listen freely and speak while looking at the native mouth. In other words, by learning the dynamic pronunciation of the present invention, it is possible to have the ability to rapidly improve pronunciation and listening by trial and error even in old age.

In English sentences composed of words consisting of English syllables with characteristics far from Japanese syllables, pronunciation changes dynamically in some cases rather than statically. In fast utterances, pronunciation changes dynamically between syllables and words. For listening in that case, it is not useful to introduce the regularity of pronunciation as in the study books on the market, and it is necessary to understand the effect of inertia such as tongue and lips. For example, in the case of "Red Light", "d" and "L" do not introduce rules such as "continue to pronounce with the tip of the tongue attached to the back of the upper jaw", but instead use the power of the tongue and lips. If the tongue is pulled out and dynamically uttered according to the signal for commanding the repeat according to the first, second, and third claims, the above-mentioned sound is continuous without the tip of the tongue separating from the upper jaw due to the inertia of the tongue.

When reciting English, imitating the sounds you hear does not result in English voice. An English dictionary with audio is also useless if you don't have English syllables. The result is that the voice that comes into your ears is identified as a Japanese syllable that is soaked in your head, but the dynamic pronunciation of the present invention can overcome this. The fast movement of the lips 2 commanded by the signal, the suction of the tip of the tongue to the upper gums that occurs instantly when the muscles at the base of the nose are squeezed, and the curly tongue movement that occurs when the tongue pops and moves. Unnecessary vowels associated with consonants are eliminated. In very fast utterances, the quick opening and closing of the lips causes the "S" -like fricatives that come out from the gaps between the upper and lower lips, the nasal voice that frequently produces "N" -like sounds with the pronunciation of "N", and the tongue-in-cheek. When a loud sound is perceived with high frequency, the repeat can be followed regardless of the speed of the utterance.

When the user perceives the vibration of the vibrating body 4 described in the third aspect of the present invention with the tactile sensation of the skin and listens while watching the movement of the speaker's lips 2, most of the general movie in which the subtitle 3 is not displayed. Can be heard. That is, the vibrating body 4 also serves as a listening hearing aid. However, in order to enjoy this function, it is a prerequisite that the dynamic pronunciation of the present invention is acquired.

The most difficult part of listening is probably the song. It is true that some songs are so fast that they cannot be heard even by looking at the subtitles. However, there are other reasons why measures can be taken. Compared to the singing voice, the live environmental sound and accompaniment sound of the song are loud and difficult to hear, and it is difficult to visually follow the movement of the lips 2 due to the shaking of the body and face, and the image of the lips 2 is in the microphone. Often hidden and invisible. In fact, it is not uncommon for Japanese songs to be inaudible live. However, if the above problems are solved, songs containing many of the fastest utterances in English are attractive as teaching materials for dynamic pronunciation. The countermeasure is the development of learning materials that eliminate the above-mentioned problems. In other words, there is no audience, the intensity of the accompaniment sound is reduced to the minimum necessary, the interference and interference of the environmental sound coming into the ear is minimized, there is no microphone image that covers the image of the lips 2, and the face is stationary and fluctuates. The singing voice that comes into the ear in synchronization with the movement of the lips 2 without the lips can be repeated while watching the subtitle 3 regardless of the speed of speech. Now, once you can sing ultra-high-speed songs with dynamic pronunciation, you will gradually be able to hear even fast-spoken songs in a general performance environment.

1 screen (DVD player, TV, personal computer, etc., or their monitor screen)
2 Lips 3 Subtitles (English subtitles)
4 Vibrating body 5 Audiovisual medium playback equipment (DVD player, TV, personal computer, etc.)
6 Adjustable audio delay device (audio delay time can be set from zero to 50 ms)
7 Adjustable audio delay device delay time adjustment knob 8 Audio output device (earphones, speakers, etc.)
9 Choice menu (size of lips 2 and on / off choice of color change function of lips 2)
10 Audio data line 11 Video audio data line

Claims (4)

All movie images including videos distributed on audiovisual media are displayed on the screen (1), and the dialogue of the movie is output to the audio output device (8), and the audio of the dialogue that comes into the user's lips. The images of the lips (2) that move in synchronization with the above are placed on the upper or lower side of the subtitle (3) so as not to overlap each other while maintaining the aspect ratio of the actual lips , or the back of the subtitle (3). The size of the lips (2) is maximized and the lips (2) are maximized when the lips (2) and the subtitles (3) are placed in the same field at the same time. Now, make the size of the lips (2) large enough for the subtitle (3) so that the image of the lips (2) that passes through the subtitle (3) is not obstructed by the characters of the subtitle (3), and it is clear and fluctuating. Auxiliary function, vibrating body (4), and necessary to assist the user to repeat the voice of the dialogue synchronized with the movement of the lips (2) while watching the lips (2) and the subtitle (3) at the same time. A language listening learning system by dynamic pronunciation, which is provided with an adjustable voice delay device (6) that delays the voice of the dialogue according to the voice . In the dynamic pronunciation language listening learning system according to claim 1, the auxiliary function determines the strength of words and phrases that come into the ear when reciting in synchronization with the movement of the lip (2). The signal that commands the rhythm and the timing of the start of repetition is perceived by the user by the change in the color of the lip (2) in proportion to the voice intensity of the dialogue , so that the user can obtain the signal of the timing. A featured language listening learning system with dynamic pronunciation. :
In the dynamic pronunciation language listening learning system according to claim 1, when the user repeats in synchronization with the movement of the lip (2), the strength and rhythm of the words and phrases that come into the ear and the rhythm The dynamically pronounced language according to claim 1, wherein a signal that directs the timing of the start of repetition is obtained from the vibrating body (4) that vibrates in proportion to the voice intensity of the dialogue through the tactile sensation of the skin. Listening learning system. In the language listening learning system based on dynamic pronunciation according to claim 1, the time from when the movement of vocalization is seen on the lips (2) to when the voice reaches the ear so as not to overlook the initial movement of the lips (2). A language listening learning system with dynamic pronunciation, which is equipped with an adjustable voice delay device (6) that can set a delay of up to 50 milliseconds from zero to the output voice with a delay time if necessary. ..

Images