JP2020067644A - Listening learning system for language by dynamic pronunciation - Google Patents

Listening learning system for language by dynamic pronunciation Download PDF

Info

Publication number
JP2020067644A
JP2020067644A JP2018208461A JP2018208461A JP2020067644A JP 2020067644 A JP2020067644 A JP 2020067644A JP 2018208461 A JP2018208461 A JP 2018208461A JP 2018208461 A JP2018208461 A JP 2018208461A JP 2020067644 A JP2020067644 A JP 2020067644A
Authority
JP
Japan
Prior art keywords
pronunciation
listening
lips
learning system
lip
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2018208461A
Other languages
Japanese (ja)
Other versions
JP6900605B2 (en
Inventor
祥二 里村
Shoji Satomura
祥二 里村
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Satomura Shoji
Original Assignee
Satomura Shoji
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Satomura Shoji filed Critical Satomura Shoji
Priority to JP2018208461A priority Critical patent/JP6900605B2/en
Publication of JP2020067644A publication Critical patent/JP2020067644A/en
Application granted granted Critical
Publication of JP6900605B2 publication Critical patent/JP6900605B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Electrically Operated Instructional Devices (AREA)

Abstract

To solve the problem that: listening of native English is dramatically improved if looking at movement of lips 2 of a speaker; but, a person cannot listen while looking at the speaker's mouth; also, the person cannot hear voice that cannot be pronounced even if heard many times; and although countermeasures for both difficulties is use of a movie as substitution of the speaker and simultaneous repetition of dialogues while looking at the movement of the lips 2 and a caption 3, in the movies on a market, there is almost no scene in which the movement of the lips 2 without fluctuation can be clearly seen in the vicinity of the caption 3.SOLUTION: The problem is solved by distributing an audiovisual medium in which lips 2 without fluctuation and a video image of a caption 3 can be seen at the same time in the same field of view, by reproducing the audiovisual medium with a learning system, and by repeating a dialogue in accordance with the dialogue.SELECTED DRAWING: Figure 1

Description

以下、本発明について言語の学習システムを英語の学習システムとして説明する。
本発明は、ネイティブの会話や映画の英語が聞き取れるように、視聴覚教材の活用で聞き取りの基になる発音を習得する言語のリスニング学習システムに関する。
Hereinafter, the language learning system of the present invention will be described as an English learning system.
TECHNICAL FIELD The present invention relates to a language listening learning system for learning a pronunciation which is a basis of listening by utilizing audio-visual teaching materials so that a native conversation and a movie English can be heard.

英語が仕事の場合、読み、書き、話すことは努力で何とかなるものの、ネイティブ英語の聞き取り(以下、「リスニング」という)は、聴くことの努力をどれほど重ねても役立たない。発音できない音声は何度聞いても音声認識できないためである。発音に関する教材は市場に溢れているが、いずれも舌先の位置の図示や動かし方の説明が基になっていて、コンピュータグラフィックス全盛の今も基本は昔から変わらず役立たない。舌は、喋るときや食するときは自在に動かせる随意筋ではなく、意図的な制御などできるものではない。  When English is a job, reading, writing, and speaking can be done with effort, but listening to native English (henceforth "listening") is useless no matter how much effort you make with listening. This is because voice that cannot be pronounced cannot be recognized no matter how many times it is heard. Although the teaching materials about pronunciation are overflowing in the market, they are all based on the illustration of the position of the tip of the tongue and the explanation of how to move it, and the basics of computer graphics are still useless from the old days. The tongue is not a voluntary muscle that can be moved freely when speaking or eating, and it cannot be intentionally controlled.

一方、ネイティブのリスニングは、発話者の口唇の動きを見ながら聞くと著しく改善する。しかし、発音できない音声は聞き取れないままである。対策は、発音できない音声を消去するために、ネイティブの速さでの発話能力の習得である。そのためには、発話者の口唇の動きを追って、強制的に口唇を動かす練習が必要となる。一方、他人の口元を見つめて聞くわけにはいかないので、ネイティブの代用として英語の映画(以下、「映画」という)を用い、口唇2の動きを見ながら映画の音声(以下、「セリフ」という)を、英語字幕(以下、「字幕」という)を見ながら同時に復唱(以下、「動的発音」という)できる発音能力を、口唇2の動きを見る視聴覚の支援で達成し、結果としてネイティブのリスニング能力が得られる言語の発話練習教材の開発である。  Native listening, on the other hand, improves significantly when the listener listens to the movements of their lips. However, voices that cannot be pronounced remain inaudible. The measure is to master the speaking ability at a native speed in order to erase the unpronounced voice. For that purpose, it is necessary to practice moving the lips by following the movement of the lips of the speaker. On the other hand, since it is not possible to gaze at and listen to the mouths of others, an English movie (hereinafter referred to as "movie") is used as a native substitute, and the sound of the movie (hereinafter referred to as "serif") is observed while watching the movement of the lip 2. ), While simultaneously listening to English subtitles (hereinafter referred to as “subtitles”), the pronunciation ability to repeat (hereinafter referred to as “dynamic pronunciation”) is achieved with audio-visual support for observing the movement of the lip 2, and as a result This is the development of utterance practice materials in a language that gives listening ability.

「Random House Webster’Unabridged Dictionary」、RANDOM HOUSE"Random House Webster'Unmerged Dictionary", RANDOM HOUSE 「American Heritage Dictionary」、HOUGHTON MIFFLIN Co."American Heritage Dictionary," HOUGHTON MIFFLIN Co. 「デジタルエコーキットDE−0248FP−2説明書」、(有)谷岡電子"Digital echo kit DE-0248FP-2 instruction manual", Tanioka Electronics 「コルグKP3取扱説明書」、株式会社コルグ"Korg KP3 Instruction Manual", Korg Co., Ltd.

映画(劇場映画、DVD映画、テレビ映画、など動画を含めた全ての映画を含み、以下、「映画」という。)で、動的発音を実践しようとすると問題に遭遇する。口唇2の映像が、字幕3との距離が離れすぎていたり、小さすぎて不鮮明であったり、画面に出る頻度が少なすぎたり、揺れ動いて口唇2の動きに関する十分な映像認識が得られない。事実、口唇2の鮮明で揺らぎのない映像が字幕3と同時に見える場面は極めて少ない。  In movies (including all movies including moving images such as movie theaters, DVD movies, television movies, and so on, hereinafter referred to as "movies"), a problem is encountered when trying to practice dynamic pronunciation. The image of the lips 2 is too far from the subtitles 3, too small and unclear, the frequency of appearing on the screen is too low, and the images of the lips 2 sway, and sufficient image recognition regarding the movement of the lips 2 cannot be obtained. In fact, there are very few scenes where a clear and stable image of the lips 2 can be seen at the same time as the subtitles 3.

動的発音において、セリフを聞きながら同時に復唱しようとしてもセリフが速すぎて追随は難しい。セリフの速さに復唱が追いつかず、耳に入って来る次の単語の頭と重なって、リスニングの妨げる。そこで冗長な復唱時間を短縮し、口唇2の動きに同期した復唱ができるように、復唱開始のタイミングを指揮する信号が必要である。  In dynamic pronunciation, if you try to repeat while listening to the lines, the lines are too fast to follow. The recitation cannot catch up with the speed of the dialogue, and it overlaps with the head of the next word coming into the ear, hindering listening. Therefore, it is necessary to provide a signal that commands the timing of the start of replay so that the redundant replay time can be shortened and the replay can be performed in synchronization with the movement of the lip 2.

音声英語では、文章に楽譜を付けられるほどのリズムがあり、音節や単語のある一点に発音の勢いが集中し、単語間を飛び跳ねるように発音される特徴がある。これに対して日本語は音節の構造上、勢いをつけるべき子音には必ず母音が付随し、母音では口が開くため勢いとリズムが存在しないフラットな言語である。動的発音で復唱するとき、前記の復唱のタイミングを指揮する信号に加えて、復唱するセリフの強弱やリズムを指揮する信号も必要である。  In spoken English, sentences have a rhythm that can be scored, and the momentum of pronunciation is concentrated at one point where there are syllables or words, and is pronounced as if jumping between words. On the other hand, Japanese is a flat language in which vowels are always accompanied by vowels due to the structure of syllables, and vowels have no mouth and no rhythm because the mouth opens. When reciting with dynamic pronunciation, in addition to the signal for commanding the timing of the above-mentioned recitation, a signal for commanding the strength and rhythm of the reciting line and rhythm is also necessary.

前記課題を解決するためになされた本発明の第1は、画面1上でセリフに同期して動く口唇2の映像を字幕3の上側又は下側に、実物の口唇の縦横比を保ちながら互いに重なり合わないように配置するか、又は字幕3の背面に配置し、両者が同時に同一の視野に入る範囲で口唇2のサイズを最大化し、鮮明で揺らぎのない口唇2の動きに同期したセリフの復唱を可能にする補助機能、補助装置A、及び、補助装置Bを備えていることを特徴とする請求項1に記載の動的発音による言語のリスニング学習システムである。前記学習システムで使用する映像やセリフは視聴覚媒体で配信する。これにより前記(0005)の課題が解決する。  The first aspect of the present invention made in order to solve the above-mentioned problem is to display an image of the lip 2 moving on the screen 1 in synchronism with the dialogue on the upper side or the lower side of the subtitle 3 while maintaining the aspect ratio of the actual lip. Place it so that it does not overlap, or place it on the back of the subtitle 3, maximize the size of the lip 2 within the range where they both come into the same visual field at the same time, and use a serif that is synchronized with the movement of the lip 2 that is clear and stable. 2. The listening system for dynamic language pronunciation learning according to claim 1, further comprising: an auxiliary function that enables recitation, an auxiliary device A, and an auxiliary device B. The videos and lines used in the learning system are distributed by audiovisual media. This solves the problem (0005).

前記課題を解決するためになされた本発明の第2は、請求項1に記載の動的発音による言語のリスニング学習システムにおいて、前記補助機能は、口唇2の動きに同期して復唱する際に、耳に入ってくる単語や句の強弱やリズム及び復唱開始のタイミングを指揮する信号を、セリフの音声強度に比例した口唇2の色の変化で表示することを特徴とする請求項1に記載の動的発音による言語のリスニング学習システムである。出力する音声信号の強度に比例して変化する口唇2の映像は前記視聴覚媒体に組み込んでいる。これにより、前記(0006)及び(0007)に記載の課題が解決する。  A second aspect of the present invention, which has been made to solve the above-mentioned problems, is the language listening learning system using dynamic pronunciation according to claim 1, wherein the auxiliary function is used when reciting in synchronization with the movement of the lip 2. 2. The signal for controlling the strength and weakness of a word or phrase coming into the ear, the rhythm, and the timing of the start of recitation are displayed by a change in the color of the lip 2 in proportion to the voice intensity of the serif. It is a language listening learning system with dynamic pronunciation. The image of the lip 2 that changes in proportion to the intensity of the output audio signal is incorporated in the audiovisual medium. This solves the problems described in (0006) and (0007).

前記課題を解決するためになされた本発明の第3は、請求項1に記載の動的発音による言語のリスニング学習システムにおいて、前記補助装置Aは、口唇2の動きに同期して復唱する際に、耳に入ってくる単語や句の強弱やリズム及び復唱開始のタイミンを指揮する信号を、セリフの音声強度に比例して振動する振動体4から皮膚の触覚を通して与えることを特徴とする請求項1に記載の動的発音による言語のリスニング学習システムである。前記振動体4から出力される振動は、接触する皮膚が長時間の振動に耐えられるように柔らかなケースの中で、音声信号に同期して振動する。これにより、前記(0006)及び(0007)に記載の課題が解決する。  A third aspect of the present invention, which has been made to solve the above-mentioned problems, is the dynamic learning language listening learning system according to claim 1, wherein the auxiliary device A repeats in synchronization with the movement of the lip 2. In addition, a signal for commanding the strength and weakness of a word or phrase coming into the ear, the rhythm, and the timing for starting recitation is given through the tactile sensation of the skin from the vibrating body 4 that vibrates in proportion to the voice intensity of the serif. It is a language listening learning system with dynamic pronunciation according to Item 1. The vibration output from the vibrating body 4 vibrates in synchronization with the audio signal in a soft case so that the skin to be contacted can endure the vibration for a long time. This solves the problems described in (0006) and (0007).

前記課題を解決するためになされた本発明の第4は、請求項1に記載の動的発音による言語のリスニング学習システムにおいて、前記補助装置Bは、口唇2の初動を見逃さないように、口唇2で発声の動きが見えてから音声が耳に届くまでに可調整の遅延時間を入れて、出力音声にゼロから最大50ミリセカンドまでの遅延を与えられる可調整音声遅延装置6を備えていることを特徴とする動的発音による言語のリスニング学習システムである。前記遅延時間は、出力音声をデジタル化し、可調整のデジタル遅延回路で遅延させて、ボリュウムで連続設定が可能である。これにより前記(0006)に記載の復唱開始のタイミングを指揮する信号は遅れずに知覚される。  A fourth aspect of the present invention, which has been made to solve the above-mentioned problems, is a language listening learning system using dynamic pronunciation according to claim 1, wherein the auxiliary device B does not miss the initial movement of the lip 2. 2 is equipped with an adjustable voice delay device 6 which allows an adjustable delay time from when the movement of the utterance is seen to when the voice reaches the ear to give a delay of zero to a maximum of 50 milliseconds to the output voice. It is a language listening learning system with dynamic pronunciation. The delay time can be continuously set with a volume by digitizing the output sound, delaying it with an adjustable digital delay circuit. As a result, the signal that directs the timing of the start of recitation described in (0006) is perceived without delay.

本発明は、音声英語に特化したもので、リスニングにおける意味の理解は問題にしていない。従って、発話が鮮明でリスニング問題が存在しないニュースは動的発音の学習対象ではないが、ニュースは英語表現と語彙の豊かさから学ぶべきことは極めて多い。また、ニュースは聞き取りが容易でも発話のスピードは映画と同等である。テレビのニュースでは字幕が出るものもあり、これを教材にして動的発音で復唱すれば、英語表現と語彙が成長する。英語は、聞いた音声を有声でも、又、頭の中で無声でも復唱して初めて意味が理解できる事実があり、前記の有声復唱は、英語一般能力を他では体験し得ない速度で向上させる効果がある。  The present invention is specific to spoken English and does not concern understanding the meaning of listening. Therefore, news with clear speech and no listening problems is not a subject of learning dynamic pronunciation, but news has a lot to learn from the richness of English expressions and vocabulary. In addition, news is easy to hear, but the speed of speech is the same as that of movies. In some TV news, subtitles appear, and by using these as teaching materials and repeating them with dynamic pronunciation, English expressions and vocabulary grow. In English, there is a fact that the meaning can be understood only by repeating the heard voice whether it is voiced or unvoiced in the head, and the above voiced recitation improves general English ability at a speed that can not be experienced elsewhere. effective.

本発明の動的発音における復唱時の発音は字幕を見ながら行うために、単語毎に字幕の文字で照合される、又、子音に不要な母音が付随する欠陥音節では映画の速さにおける復唱は行き詰まる。つまり、発音に関する二重の校正フィルターが備わっていて、発音の不具合が知覚される。一方、この校正フィルターの機能を持たず、ニュースなどに合わせ喋りまくると、音節や単語における発音の不具合が知覚されずに蓄積し、熱心に学習すればするほど不具合の上書きが重なり、気が付くとリスニングに取り返しのつかないダメージを負っていることも多いが、前記の校正フィルターは生涯の努力を水泡に帰すほどのロスを事前に食い止める効果がある。  In the dynamic pronunciation of the present invention, the pronunciation at the time of replaying is performed while looking at the subtitles, so each word is collated with the characters of the subtitles, and in the defective syllable in which consonants are accompanied by unnecessary vowels, replaying is performed at the speed of the movie. Is stuck. In other words, there is a double calibration filter for pronunciation, and a pronunciation defect is perceived. On the other hand, if you do not have the function of this proofreading filter and talk to news etc., problems of pronunciation in syllables and words will accumulate without being perceived, and the more you study hard, the more problems will be overwritten, and when you notice, you will listen. Although it often suffers from irreparable damage, the above-mentioned calibration filter has the effect of preliminarily stifling the loss that may be attributed to the bubbles of life's efforts.

本発明の動的発音における練習は、発音の不具合を知覚するフィルター機能を特徴とする学習システムで安全に喋りまくるため、少々きつくても濃縮された学習で進歩が早い。これを、一般の映画やニュースで活用すれば、仕事で英語が必須の場合や短時間の向上を目出す人には渡りに船の効果がある。  In the practice of dynamic pronunciation of the present invention, a learning system featuring a filter function for perceiving a pronunciation defect is used to safely speak, so that even a little tight learning can make rapid progress. If this is used in general movies and news, if the English is essential for work or if a person who seeks improvement in a short period of time has the effect of a ship.

本発明の本来の目的は、リスニングの習得であり、発音の改善ではないが、「発音できない音声は聞き取れない」の原則に従って発音が先立っている。しかし、セリフを遅れずに復唱できると、「聞ける音声は発音できる」も成立する成長であり、聞き取れない音節が消えて、聞いた音声を基に試行錯誤で復唱発音を改善できるようになる。  Although the original purpose of the present invention is to acquire listening and not to improve pronunciation, pronunciation is preceded according to the principle that "unsoundable speech cannot be heard." However, if you can repeat the lines without delay, "you can pronounce the audible sounds" is also growing, and the inaudible syllables disappear, and you can improve the repeat pronunciation by trial and error based on the heard sounds.

本発明の動的発音による言語のリスニング学習システム使用状況を示すシステム図である。  FIG. 1 is a system diagram showing the usage situation of a language listening learning system using dynamic pronunciation of the present invention. 本発明の動的発音のフローチャートである  3 is a flowchart of dynamic pronunciation of the present invention.

図1は、本発明の「動的発音による言語のリスニング学習システム」の実施形態を示す代表図で、画面1上に表示する映画は視聴覚媒体で配信されて、視聴覚媒体再生装置5で再生され、画面1に送られて表示する。前記映画は、口唇2と字幕3とセリフさえあれば、それらの背景は映画のフル表示でも、サブディスプレイ表示でも、又は、背景映像がなくてもよい。前記学習システムは、図1の画面1の他に、視聴覚媒体再生装置5、可調整音声遅延装置6、可調整音声遅延装置の遅延時間調整ノブ7、振動体4、イヤホン8、及び、それらを結ぶ音声データ線10、及び、映像音声データ線11で構成される。また、画面1には、選択メニュー9を必要に応じて表示し、口唇2の大小サイズの選択と、音声強度に比例して口唇2の色が変化する機能のオンオフの選択に使用する。  FIG. 1 is a representative diagram showing an embodiment of a “language listening learning system with dynamic pronunciation” of the present invention. A movie displayed on a screen 1 is distributed by an audiovisual medium and reproduced by an audiovisual medium reproducing device 5. , Sent to screen 1 and displayed. As long as the movie has lips 2, subtitles 3 and lines, the background of the movie may be a full display of the movie, a sub-display of the movie, or no background image. In addition to the screen 1 of FIG. 1, the learning system includes an audiovisual medium reproducing device 5, an adjustable audio delay device 6, a delay time adjusting knob 7 of the adjustable audio delay device, a vibrating body 4, an earphone 8, and the like. The audio data line 10 and the video / audio data line 11 are connected. In addition, a selection menu 9 is displayed on the screen 1 as needed, and is used for selecting the size of the lip 2 and for selecting the function of changing the color of the lip 2 in proportion to the sound intensity.

本発明の動的発音には二つの課題がある。第一は、発話者の口唇2の動きが鮮明に見えること、第二は、口唇2の動きを見ながら字幕を見て同時にセリフを復唱できることであり、いずれも、請求項1の学習システムは満たしているが、一旦、前記動的発音が身につくと、市場の普通の映画でも、字幕があれば動的発音の実践が可能となる。  The dynamic pronunciation of the present invention has two problems. The first is that the movement of the lips 2 of the speaker can be clearly seen, and the second is that the speech can be repeated at the same time while watching the movements of the lips 2 while watching the subtitles. Although satisfying, once the dynamic pronunciation is acquired, it is possible to practice the dynamic pronunciation even with ordinary movies on the market if subtitles are provided.

本発明の第1に記載の動的発音は、発音を試行錯誤により改善できる特徴を備えている。試行錯誤とは、聞こえたネイティブ音声を自身の発音と比較して、違いを修正していくことである。しかし、長年慣れ親しんだ日本語音節は1個の子音に必ず1個の母音が付随する強い特徴があるため、耳に入ってくる英語の音声に関し、頭の中で、子音には母音を付け加えて聞く癖がある。この癖は堅固で、発音に関し、舌の制御など人工的な規則を取り入れても役立たない。そして、至るところで、不要な母音を伴って発音される冗長な単語は、後続単語の頭の部分と干渉して聞き取りを妨げる。本発明の動的発音は、口唇2の動きに合わせた唇の素早い開閉を半ば強制的に指揮する信号を与えることで、前記の不要な母音が除かれて前記冗長も解消する。  The dynamic pronunciation described in the first aspect of the present invention has a feature that the pronunciation can be improved by trial and error. Trial and error is the process of correcting the differences by comparing the heard native voice with its own pronunciation. However, Japanese syllables, which we have been accustomed to for many years, have a strong characteristic that one consonant is always accompanied by one vowel. I have a habit of listening. This habit is firm, and it is useless to incorporate artificial rules such as tongue control for pronunciation. Then, everywhere, redundant words pronounced with unnecessary vowels interfere with the head part of the succeeding word and interfere with listening. The dynamic pronunciation of the present invention eliminates the unnecessary vowels and eliminates the redundancy by giving a signal that forcibly commands the rapid opening and closing of the lips according to the movement of the lips 2 in the middle.

4,5年アメリカに留学した人で、ネイティブ的な発音になる人もいれば、20年アメリカで仕事をしても、日本語的発音やリスニングから抜け出せない人も多い。その差は、単純に前記の試行錯誤ができるか否かである。熱心な英語学習者は往々にして発音とリスニングで取り残されていることが多い。試行錯誤ができない人は、熱心なあまり、発音に無理な規則を取り込もうとするため、何年たっても日本語音節から抜け出せず、母音が絡んだ音素をどう組み合わせても英語の音節にはならない無用な努力を続けている。一方、事前に大した勉強もしないでアメリカに渡った若者などは、ネイティブの口元を見ながら自由奔放に聞いて喋るため、短時間で自然に英語音節を身につけている。つまり、本発明の動的発音を学習すれば、年老いても、発音とリスニングを試行錯誤で急速に改善できる能力を備えることが可能である。  Some people have studied abroad in the United States for four or five years and have native pronunciation, while many people who have worked in the United States for twenty years cannot get out of Japanese pronunciation or listening. The difference is whether or not the above trial and error can be performed. Avid English learners are often left behind in pronunciation and listening. People who cannot make trial and error are enthusiastic and try to incorporate unreasonable rules for pronunciation, so they can not get out of the Japanese syllable for many years, and no matter how they combine phonemes with vowels, they do not become English syllables. Is making continuous efforts. On the other hand, young people who traveled to the United States without much study in advance learned the English syllable naturally in a short time because they spoke freely while listening to the native mouth and talking freely. In other words, by learning the dynamic pronunciation of the present invention, it is possible to provide the ability to rapidly improve the pronunciation and listening by trial and error even when aged.

日本語音節とはかけ離れた特性の英語音節からなる単語で構成される英語文章では、発音は静的ではなく場合場合で動的に変化する。速い発話では音節間や単語間が連続して発音が動的に変化する。その場合のリスニングには、市場の学習書にあるような発音の規則性を導入しても役立たず、舌や口唇などの慣性の効果を理解する必要がある。一例を挙げれば、「Red Light」の場合、「d」と「L」は「舌先を上顎の裏につけたまま続けて発音する」などの規則を導入するのではなく、舌や口唇の力を抜いて、請求項1、請求項2、及び、請求項3に記載の復唱を指揮する信号に従って動的に発話すれば、舌の慣性で舌先が上顎から離れずに前記の音が連続する。  In English sentences composed of words consisting of English syllables having characteristics far from Japanese syllables, pronunciation is not static but changes dynamically in some cases. In fast utterance, pronunciation changes dynamically between syllables and words. In that case, it is not useful to introduce the regularity of pronunciation as described in market learning books, and it is necessary to understand the effect of inertia such as the tongue and lip. As an example, in the case of “Red Light”, “d” and “L” do not introduce rules such as “pronuncing continuously with the tip of the tongue attached to the back of the upper jaw”, but rather the power of the tongue and lip. If it is extracted and is dynamically uttered according to the signals that direct the recitations according to claims 1, 2, and 3, the sound is continuous without the tip of the tongue leaving the upper jaw due to the inertia of the tongue.

英語を復唱する場合、聞こえた音をまねても英語の音声にはならない。音声付き英語辞書も英語音節が身についていなければ役立たない。耳に入る音声が頭の中で、染みついた日本語音節に同定されてしまう結果であるが、本発明の動的発音はこれを打ち破ることができる。信号で指揮された口唇2の速い動きと、鼻の付け根の筋肉を絞ると瞬時に起きる舌先の上歯茎への吸い上げと、舌が弾けて動くときに発生する巻き舌的な舌の動きで、子音に付随する不要な母音は排除される。非常に速い発話では、唇の素早い開閉で、上下唇の隙間からでる「S」音的な摩擦音や、「N」の発音で「ん」的な音が頻発しての鼻声や、巻き舌的な音が高頻度で知覚されるとき、発話の速さに関わらず復唱が追随できている。  When reciting English, mimicking the sounds heard does not produce English speech. An English dictionary with voice is also useless if you are not familiar with English syllables. The result is that the sound that is heard in the ear is identified in the Japanese syllable that is soaked in the head, but the dynamic pronunciation of the present invention can overcome this. With the fast movement of the lip 2 that is commanded by the signal, the quick suction of the tongue tip to the upper gums when the muscle of the base of the nose is squeezed, and the curling tongue movement that occurs when the tongue pops and moves, Unnecessary vowels associated with consonants are eliminated. For very fast utterances, opening and closing of the lips quickly causes an "S" -like fricative sound coming out of the gap between the upper and lower lips, and a "N" -like "n" -like sound that frequently causes a nasal voice or a tongue-like tongue. When various sounds are perceived with high frequency, recitation can follow regardless of the speed of speech.

本発明の第3に記載の振動体4の振動を皮膚の触覚で知覚しながら、発話者の口唇2の動きを見ながら聞くと、字幕3が表示されない一般の映画でもほとんどの部分が聞き取れる。つまり振動体4はリスニング補聴装置の役目もする。但し、この機能を享受するには、本発明の動的発音が身についていることが前提である。  When perceiving the vibration of the vibrating body 4 described in the third aspect of the present invention by the tactile sense of the skin and listening while watching the movement of the lip 2 of the speaker, almost all the parts can be heard even in a general movie in which the subtitle 3 is not displayed. That is, the vibrating body 4 also functions as a listening hearing aid. However, in order to enjoy this function, it is premised that the dynamic pronunciation of the present invention is acquired.

リスニングで最も難しいのは歌であろう。一部の歌は字幕を見ても聞き取れないほど発話が速いことは事実である。しかし、他にも対策可能な理由がある。歌は、歌声に比べて、ライブの環境音や、伴奏音が大きく聞き取りが難しい上に、体や顔が揺れ動き口唇2の動きを視覚で追うのが難しく、又、口唇2の映像がマイクに隠れて見えないことも多い。実際、日本語の歌でもライブでは聞き取れないことも少なくない。しかし、前記の問題が解決すれば英語最速の発話が多く含まれる歌は動的発音の教材として魅力である。対策は、前記の課題を排除した学習教材の開発である。つまり、観客がなく、伴奏音の強さを必要最小に絞り、耳に入ってくる環境音の妨害と干渉を最小化し、口唇2の映像を覆い隠すマイク映像がなく、顔が静止して揺らぎのない口唇2の動きに同期して耳に入ってくる歌声は、発話の速さに関わらず、字幕3を見ながら復唱可能である。これで、一旦、動的発音により超高速の歌が歌えるようになれば、次第に一般の演奏環境においても、速い発話の歌でも聞き取れるようになってくる。  The most difficult part of listening is probably a song. It is a fact that some songs are so fast that they cannot be heard even by looking at the subtitles. However, there are other reasons that can be taken. Compared to the singing voice, a live environment sound and accompaniment sound are louder and harder to hear, and it is difficult to visually follow the movements of the lips 2 due to body and face shaking. Often hidden and invisible. In fact, it's not uncommon for Japanese songs to not be heard live. However, if the above problem is solved, a song that contains many of the fastest English utterances is attractive as a teaching material for dynamic pronunciation. The countermeasure is the development of learning materials that eliminate the above problems. In other words, there is no audience, the intensity of the accompaniment sound is reduced to the necessary minimum, the disturbance and interference of the environmental sound coming into the ear is minimized, and there is no microphone image that covers the image of the lip 2 and the face is stationary and fluctuates. The singing voice that comes into the ear in synchronization with the movement of the lips 2 that does not exist can be repeated while watching the subtitle 3 regardless of the utterance speed. With this, once the ultra-high-speed song can be sung by the dynamic pronunciation, it becomes gradually possible to listen to the fast-speaking song even in a general performance environment.

1 画面(DVDプレーヤー、テレビ、パソコンなど、又は、それらのモニター画面)
2 口唇
3 字幕(英語字幕)
4 振動体
5 視聴覚映像再生機器(DVDプレーヤー、テレビ、パソコンなど)
6 可調整音声遅延装置(音声遅延時間をゼロから50ミリセカンドで設定可能)
7 可調整音声遅延装置の遅延時間調整ノブ
8 イヤホン
9 選択肢メニュー(口唇2のサイズ、及び、口唇2の色変化機能のオンオフ選択肢)
10 音声データ線
11 映像音声データ線
1 screen (DVD player, TV, PC, etc., or their monitor screen)
2 lips 3 subtitles (English subtitles)
4 Vibrator 5 Audiovisual image playback equipment (DVD player, TV, personal computer, etc.)
6 Adjustable audio delay device (audio delay time can be set from 0 to 50 milliseconds)
7 Adjustable audio delay device delay time adjustment knob 8 Earphone 9 Options menu (size of lip 2 and on / off choice of color change function of lip 2)
10 audio data line 11 video and audio data line

Claims (4)

画面(1)上に、視聴覚媒体で配信する動画を含めた全ての映画のセリフと、セリフに同期して動く口唇(2)の映像を、字幕(3)の上側又は下側に、実物の口唇の縦横比を保ちながら互いに重なり合わないように配置するか又は字幕(3)の背面に配置し、口唇(2)と字幕(3)が同時に同一の視野に入る範囲で、口唇(2)のサイズを最大化し、鮮明で揺らぎのない口唇(2)の動きに同期したセリフの復唱を容易にする補助機能、補助装置A、及び、補助装置Bを備えていることを特徴とする動的発音による言語のリスニング学習システム  On the screen (1), the video of all the movies including the video distributed by audiovisual media and the video of the lip (2) that moves in synchronization with the video are displayed above or below the subtitles (3) in the real world. The lips (2) are placed so that they do not overlap each other while maintaining the aspect ratio of the lips, or are placed on the back of the subtitles (3) so that the lips (2) and the subtitles (3) are in the same visual field at the same time. Dynamics characterized by having an auxiliary function, an auxiliary device A, and an auxiliary device B, which maximizes the size of the subject and facilitates the recitation of serifs in synchronization with the movement of the lip (2) which is clear and stable. Pronunciation language learning learning system 請求項1に記載の動的発音による言語のリスニング学習システムにおいて、前記補助機能は、口唇(2)の動きに同期して復唱する際に、耳に入ってくる単語や句の強弱やリズム及び復唱開始のタイミングを指揮する信号を、セリフの音声強度に比例した口唇(2)の色の変化で表示することを特徴とする動的発音による言語のリスニング学習システム。  2. The dynamic listening language learning learning system according to claim 1, wherein the auxiliary function, when reciting in synchronization with the movement of the lip (2), reinforces the rhythm and the strength and rhythm of a word or phrase coming into the ear. A language listening learning system with dynamic pronunciation, characterized in that a signal for commanding the timing of the start of recitation is displayed by a change in the color of the lip (2) proportional to the voice intensity of the dialogue. 請求項1に記載の動的発音による言語のリスニング学習システムにおいて、前記補助装置Aは、口唇(2)の動きに同期して復唱する際に、耳に入ってくる単語や句の強弱やリズム及び復唱開始のタイミングを指揮する信号を、セリフの音声強度に比例して振動する振動体(4)から皮膚の触覚を通して得られることを特徴とする請求項1に記載の動的発音による言語のリスニング学習システム。  2. The dynamic listening language learning learning system according to claim 1, wherein when the auxiliary device A recites in synchronization with the movement of the lips (2), the strength and rhythm of words and phrases that come into the ears. And a signal that directs the timing of the start of recitation is obtained through a tactile sensation of the skin from a vibrating body (4) that vibrates in proportion to the voice intensity of the serifs. Listening learning system. 請求項1に記載の動的発音による言語のリスニング学習システムにおいて、前記補助装置Bは、口唇(2)の初動を見逃さないように、口唇(2)で発声の動きが見えてから音声が耳に届くまでに可調整の遅延時間を入れて、出力音声にゼロから最大50ミリセカンドの遅延を設定できる可調整音声遅延装置(6)を備えていることを特徴とする動的発音による言語のリスニング学習システム。  2. The language learning learning system with dynamic pronunciation according to claim 1, wherein the auxiliary device B hears a voice after the utterance movement is visible on the lip (2) so as not to miss the initial movement of the lip (2). Of a language with dynamic pronunciation, which is equipped with an adjustable voice delay device (6) capable of setting an adjustable delay time before reaching Listening learning system.
JP2018208461A 2018-10-19 2018-10-19 Language listening learning system with dynamic pronunciation Active JP6900605B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2018208461A JP6900605B2 (en) 2018-10-19 2018-10-19 Language listening learning system with dynamic pronunciation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2018208461A JP6900605B2 (en) 2018-10-19 2018-10-19 Language listening learning system with dynamic pronunciation

Publications (2)

Publication Number Publication Date
JP2020067644A true JP2020067644A (en) 2020-04-30
JP6900605B2 JP6900605B2 (en) 2021-07-07

Family

ID=70390308

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018208461A Active JP6900605B2 (en) 2018-10-19 2018-10-19 Language listening learning system with dynamic pronunciation

Country Status (1)

Country Link
JP (1) JP6900605B2 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1195653A (en) * 1997-09-19 1999-04-09 Mayumi Oba Learning method of english pronunciation
JP2001525078A (en) * 1997-04-25 2001-12-04 リードスピーク インコーポレイテッド A method of producing an audiovisual work having a sequence of visual word symbols ordered with spoken word pronunciations, a system implementing the method and the audiovisual work
JP2002244842A (en) * 2001-02-21 2002-08-30 Japan Science & Technology Corp Voice interpretation system and voice interpretation program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001525078A (en) * 1997-04-25 2001-12-04 リードスピーク インコーポレイテッド A method of producing an audiovisual work having a sequence of visual word symbols ordered with spoken word pronunciations, a system implementing the method and the audiovisual work
JPH1195653A (en) * 1997-09-19 1999-04-09 Mayumi Oba Learning method of english pronunciation
JP2002244842A (en) * 2001-02-21 2002-08-30 Japan Science & Technology Corp Voice interpretation system and voice interpretation program

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
黒木 速人他: "音声同時字幕システムにおける内容理解の向上を目的とした話者の顔情報の呈示方法", ヒューマンインタフェース学会誌 ヒューマンインタフェース学会論文誌, vol. 9, no. 2, JPN6021015123, 25 May 2007 (2007-05-25), pages 205 - 211, ISSN: 0004500656 *

Also Published As

Publication number Publication date
JP6900605B2 (en) 2021-07-07

Similar Documents

Publication Publication Date Title
JP3016864B2 (en) Audio-visual work with writing, method of meaningfully combining oral pronunciation and writing in audio-visual work, and apparatus for linear and conversational applications
Pickett et al. Time factors in perception of a double consonant
US20110053123A1 (en) Method for teaching language pronunciation and spelling
WO2015099464A1 (en) Pronunciation learning support system utilizing three-dimensional multimedia and pronunciation learning support method thereof
Spiteri Miggiani Exploring applied strategies for English-language dubbing
Nagamine Effects of hyper-pronunciation training method on Japanese university students’ pronunciation
US20040248068A1 (en) Audio-visual method of teaching a foreign language
de Vargas et al. Haptic speech communication using stimuli evocative of phoneme production
CA2418924A1 (en) Method and apparatus for rapid language acquisition
Swerts et al. Congruent and incongruent audiovisual cues to prominence
JP2006133521A (en) Language training machine
Krivokapic et al. A kinematic analysis of prosodic structure in speech and manual gestures.
JP3110215B2 (en) Pronunciation training device
JP6900605B2 (en) Language listening learning system with dynamic pronunciation
JP2005128177A (en) Pronunciation learning support method, learner's terminal, processing program, and recording medium with the program stored thereto
Arai et al. Seeing closing gesture of articulators affects speech perception of geminate consonants
Markham et al. Input modality effects in foreign accent
JPH0822238A (en) Language training system effectively utilizing quadruple time characteristic of english
JP2006163269A (en) Language learning apparatus
Yamane et al. Mirroring beat gestures: Effects on EFL learners
KR102115228B1 (en) Sound learning system and method of a hearing-impaired person
JP2000181333A (en) Pronunciation training support device, its method and program recording medium therefor
JP2001042758A (en) Voice of foreign language learning method and voice of foreign language learning materials to be used for the method
JP2005352047A (en) Learning device
Randall Staged replication of naturally‐occurring talk: A performer's perspective

Legal Events

Date Code Title Description
A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20200831

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20200915

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201112

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210511

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210517

R150 Certificate of patent or registration of utility model

Ref document number: 6900605

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250