KR20140087950A - Apparatus and method for learning rhythm pattern by using native speaker's pronunciation data and language data. - Google Patents
Apparatus and method for learning rhythm pattern by using native speaker's pronunciation data and language data. Download PDFInfo
- Publication number
- KR20140087950A KR20140087950A KR1020130000016A KR20130000016A KR20140087950A KR 20140087950 A KR20140087950 A KR 20140087950A KR 1020130000016 A KR1020130000016 A KR 1020130000016A KR 20130000016 A KR20130000016 A KR 20130000016A KR 20140087950 A KR20140087950 A KR 20140087950A
- Authority
- KR
- South Korea
- Prior art keywords
- data
- language
- pronunciation
- language data
- learner
- Prior art date
Links
- 230000033764 rhythmic process Effects 0.000 title claims abstract description 85
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000012545 processing Methods 0.000 claims abstract description 21
- 238000012360 testing method Methods 0.000 claims description 5
- 238000012937 correction Methods 0.000 claims description 3
- 210000001097 facial muscle Anatomy 0.000 claims description 3
- 210000003205 muscle Anatomy 0.000 claims description 3
- 238000010295 mobile communication Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 8
- 239000003550 marker Substances 0.000 description 3
- 239000003086 colorant Substances 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000010998 test method Methods 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000001454 recorded image Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
- G09B19/06—Foreign languages
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Tourism & Hospitality (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- General Health & Medical Sciences (AREA)
- General Business, Economics & Management (AREA)
- Economics (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Entrepreneurship & Innovation (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
Description
(Hereinafter referred to as " image data ") that reminds language data and words or phrases or phrases or sentences (hereinafter referred to as " language data " (Hereinafter referred to as " pronunciation data ") (hereinafter, referred to as " pronunciation data ") of speech data in pronunciation of language data, speech waveform in pronunciation of language data, The present invention relates to a pattern learning apparatus and method, and more particularly, to a pattern learning apparatus and method that sequentially provides language data, provides color change and rhythm icons to accented syllables of language data provided for rhythm pattern learning of language data, , Meaning interpreted in the language of the country in which the language data is learned is displayed, The voice and image are reproduced in the pronunciation of the native language of the displayed language data, and the voice and the image according to the pronunciation of the learner's linguistic data are inputted, The shape of the lip, the position of the teeth and the tongue, and the linguistic data of the learner's pronunciation, the face muscle change, the shape of the lip, the position of the tooth and the tongue, and the speech waveform comparison screen, And a rhythm pattern learning apparatus and method using pronunciation data of a native speaker.
As the society becomes global, various cultures are exchanged and people are interested in learning foreign languages in order to deepen their understanding and exchange their culture.
Many foreign language learning is done through books, and because of the development of electronic devices, MP3, PMP, electronic dictionary,
However, the conventional foreign language learning contents are grammatical learning, which is a disadvantage of not being able to speak a foreign language even though they have studied for a long time.
Furthermore, the accent is very important in foreign language speaking learning. However, it is possible to confirm the accent of the word in the conventional foreign language learning contents, but it is difficult to learn the accent of the sentence which is the basis of actual speaking, Hard.
SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to solve the above-mentioned problems, and an object of the present invention is to provide language data for sequentially providing language data and providing color change and rhythm icons to accented syllables of language data provided for rhythm pattern learning of language data, And a rhythm pattern learning apparatus and method using pronunciation data.
It is also an object of the present invention to provide a rhythm pattern learning apparatus and method using pronunciation data related to language data provided, language data providing a meaning interpreted in a language of a country in which the language data is learned, and pronunciation data of native speakers have.
It is also an object of the present invention to provide a rhythm pattern learning apparatus and method using language data together with image data capable of associating the provided language data and pronunciation data of native speakers.
It is another object of the present invention to provide a speech recognition apparatus and a speech recognition method in which a learner is able to correct a pronunciation of a native speaker by comparing the pronunciation data of a native speaker with pronunciation data of a learner, Learning apparatus and method.
It is another object of the present invention to provide a rhythm pattern learning apparatus and method using language data and pronunciation data of native speakers, which enable checking intensities of pronunciations and positions of accents through comparison of speech waveforms.
It is another object of the present invention to provide an apparatus and method for providing pronunciation data of a native speaker in a variety of types such as female, male, American, English, and phonetic pronunciation, Learning apparatus and method.
The apparatus for learning rhythm patterns using language data and pronunciation data of native speakers according to the present invention is characterized in that the rhythm pattern learning apparatus using language data and phonetic symbols related to language data, A storage unit for storing pronunciation data and sound waveform data;
An input unit for inputting rhythm pattern learning data using language data and rhythm pattern learning data using language data;
Rhythm pattern learning using the selected language data When the learning of the data starts, the language data is displayed. In order to learn the rhythm patterns of the displayed language data, the color change and rhythm icons are displayed in the accent syllable of the linguistic data, A display unit for displaying image data interpreted in a language of a country in which language data is to be learned, the image data being capable of associating the displayed language data;
An audio processing unit for receiving a learner's voice when the learner pronounces the displayed language data in the rhythm pattern learning using the linguistic data and the pronunciation data of native speakers;
A voice analysis module for analyzing the voice inputted through the audio processor and converting the voice into a waveform and comparing and analyzing the waveform of the native voice with the similarity of the native voice;
A camera unit for collecting the positional image of the tooth and the tongue of the lips and the change of the facial muscles when pronouncing the learner's language data;
An image processing unit for normalizing a face muscle change, a lip shape, a focus and a size of positional image data of a tooth and a tongue when pronouncing linguistic data input from the camera unit; And
A linguistic model of the learner, a positional image of a tooth and a tongue, and a linguistic data of a native speaker stored in the storage unit when the learner's pronunciation of the language data is normalized through the image processor, And a control unit for displaying the waveform processed through the speech waveform processing unit and the speech waveforms of the stored native speakers and comparing the similarities to display "good" in 50% or more similarity and "bad" in less than 50% . ≪ / RTI >
The control unit may further include a wired / wireless network unit for switching and displaying an accent syllable of language data matching the language data stored in the storage unit among the displayed language data of the Internet web browser in a different color have.
The control unit may further include a DMB module unit for displaying the highlighted syllable of the language data corresponding to the language data stored in the storage unit of the language data from the DMB English broadcast in a different color .
In addition, the layer of the display unit may be divided into Home, Dic, and Option tabs.
In addition, the Home tab displays language data, a color change and a rhythm icon are displayed in the accented syllable of the displayed language data, a pronunciation symbol related to the language data, and a meaning interpreted in the language of the country The shape of the lips when pronouncing the linguistic data of the native speaker, the position of the teeth and the tongue, the shape of the face or lips when pronouncing the learner's linguistic data, and the teeth And a position of a tongue, a voice waveform of a native speaker, and a voice waveform of a learner.
In addition, the Option tab includes selection of whether or not to display image data capable of reminding the language data, selection of the number of times and the number of times of video and audio reproduction in pronunciation of a learner, and color and rhythm display of an accent syllable The selection of whether or not to pronounce the pronunciation, the selection of the pronunciation symbol, the selection of the gender of the voice output, the selection of the pronunciation voice output by the country, and the selection of the pronunciation correction test mode.
Further, the control unit may be configured to present a problem in a language rhythm pattern test, and to display a pronunciation accuracy of a learner.
The rhythm pattern learning method using the language data and the pronunciation data of native speakers according to the present invention includes: inputting a selection command of rhythm pattern learning data using language data to be learned from a learner;
The linguistic data is displayed in accordance with the rhythm pattern learning data learning using the selected linguistic data, the color change and the rhythm icon are displayed in the accented syllable of the linguistic data for the rhythm pattern learning of the displayed linguistic data, A step of displaying image data interpreted in a language of a country in which the language data is to be learned and capable of associating the displayed language data;
Displaying an image when a native speaker is pronunciated according to the selected language data;
A step of inputting voice and image when pronouncing the learner's language data according to the displayed language data;
A step of displaying and reproducing an image when pronunciating a native speaker's speech data and an image when pronouncing a learner's speech data;
A step of displaying a comparison screen of a native speech waveform and a learner speech waveform; And
And displaying "bad" if the similarity degree between the native speech waveform and the learner speech waveform is "good" if the similarity is 50% or more and "bad" if the similarity is less than 50%.
According to the rhythm pattern learning method using the linguistic data of the present invention and the pronunciation data of the native speaker, the linguistic data is sequentially provided, the color change and the rhythm icon are provided to the accented syllable of the linguistic data provided for the rhythm pattern learning of the linguistic data, A pronunciation symbol associated with the provided language data, and a meaning interpreted in a language of a country in which the language data is to be learned are provided together, and image data capable of reminding the provided language data are provided together, and pronunciation data of the native speaker and pronunciation data It is possible to calibrate the learner so that the pronunciation of the learner is similar to that of the native speaker by comparing the pronunciation of the learner with the pronunciation of the learner, A woman, a man, an American expression, an English pronunciation, It is possible to provide a wide range of language speaking learning, and thus it is possible to perform a wide range of language speaking learning.
1 is a block diagram showing a configuration of a rhythm pattern learning apparatus using language data and pronunciation data of native speakers according to an embodiment of the present invention;
2 is a view showing an example of a rhythm pattern learning selection screen using language data to be learned and pronunciation data of a native speaker according to an embodiment of the present invention;
3 and 4 show examples of a level selection screen for rhythm pattern learning using selected language data and pronunciation data of native speakers according to an embodiment of the present invention.
5 is a view showing an example of a rhythm pattern learning screen using language data and pronunciation data of a native speaker according to an embodiment of the present invention;
6 is a diagram showing an example of displaying dictionary information of a word in a Dic tab according to an embodiment of the present invention;
FIG. 7 is a view showing an example of a rhythm pattern learning option list using language data and native pronunciation data of an option tab according to an embodiment of the present invention; FIG.
8 is a diagram illustrating an example of a language rhythm pattern test method for presenting a problem according to an embodiment of the present invention and displaying a pronunciation accuracy of a learner;
9 is a diagram illustrating an example of switching an accented syllable of language data coinciding with language data stored in the storage unit among different language data displayed in an Internet web browser or DMB English broadcast according to an embodiment of the present invention Fig.
10 is a flowchart of a rhythm pattern learning method using language data and pronunciation data of native speakers according to an embodiment of the present invention.
Hereinafter, an apparatus and method for learning a rhythm pattern using language data of the present invention and pronunciation data of a native speaker will be described with reference to the accompanying drawings.
1 is a block diagram showing a configuration of a rhythm pattern learning apparatus using language data and pronunciation data of native speakers according to an embodiment of the present invention.
Referring to FIG. 1, a rhythm
Although not shown, the screen of the
This has the effect that the learner can check the learning status through the screen of the Internet web browser or the DMB English broadcast, and check and review the pronunciation of the language data which has not been heard.
Although not shown, a marker for implementing an augmented reality is written in a foreign language learning book or a foreign language learning program output through a display such as a computer, a smart phone, a tablet pc, or a pmp, and the marker is displayed through the camera unit 112 A pronunciation symbol related to the language data, an interpretation in the language of the country that learns about the language data, an image or animation or image related to the language data, a native pronunciation image, and a voice waveform It is preferable that each piece of data related to the marker in the data is reproduced through the screen.
This has the effect that the learner is immediately provided with the data related to the learning at the time of learning and also helps the pronunciation learning.
The rhythm
The
As shown in FIG. 5, when the learner starts learning, the
The selected language data is displayed together with the image data capable of associating the language data, and at the same time, the moving image is reproduced when the native language data of the native language pronouncing the corresponding language data is pronounced.
A pop-up menu is displayed so that a learner's voice can be input though the learner's voice is not displayed, and the learner's voice is pronounced by looking at the camera provided in the rhythm
When the voice recording and the video image capturing are completed, the pronunciation video in which the mouth part is enlarged and the recorded pronunciation video of the learner are reproduced in the pronunciation of the native language data of the native language
Preferably, the
In addition, the pronunciation video reproduction of the learner allows the learner's facial muscle change, lips shape, and tooth and tongue position to be inputted and displayed in real time through the camera, not by the recording method, Shape, and location of the teeth and tongue directly on the screen, so that they can practice the pronunciation of the native speaker.
At this time, the
6 is a diagram showing an example of displaying dictionary information of a word in a Dic tab according to an embodiment of the present invention.
As shown in FIG. 6, if the
7 is a diagram illustrating an example of a rhythm pattern learning option list using language data in the Option tab and pronunciation data of a native speaker according to an embodiment of the present invention.
As shown in FIG. 7, the
8 is a diagram illustrating an example of a language rhythm pattern test method for presenting a problem according to an embodiment of the present invention and displaying the pronunciation accuracy of a learner.
FIG. 9 shows an example of switching the accented syllable of the language data coinciding with the language data stored in the storage unit among the language data displayed on the Internet web browser or the DMB English broadcast according to the embodiment of the present invention into different colors Fig.
10 is a flowchart of a rhythm pattern learning method using language data and pronunciation data of a native speaker according to an embodiment of the present invention.
Referring to FIG. 10, a learner selects rhythm pattern learning data using language data to be learned through an input unit 102 (S200).
When the rhythm pattern learning data selection using the language data to be learned through the
Thereafter, the learner's voice data is input through the
(Step S206). In this way, the learner's pronunciated image of the learner, whose focus and size are standardized, is reproduced through the image processing unit 116 (S206).
In the case of the learner's pronunciations, the distance between the learner and the camera when pronouncing the learner data, and the face size occupied by the learner are different for each learner.
Accordingly, the
At this time, the learner can apply the recording reproduction or the real time reproduction method to the image reproduction upon pronunciation.
The
The learner's voice waveform is displayed side by side so that it can be compared with the voice waveform of the native speaker stored in the
The waveform is a form of the wavelength generated when the vibration shape of the sound is divided by the time difference, and the voice waveform is an important factor to confirm the accent and rhythm when pronouncing.
In the above, the case where the learner learns English is described as an example, but it goes without saying that the present invention can also be applied to other languages such as Chinese, Japanese, German, French and so on.
100: rhythm pattern learning device using language data and pronunciation data of native speakers
102:
104: storage unit 106: audio processing unit
108: Voice analysis module 110: Voice waveform processor
112: camera section 114: display section
116: image processing unit 118: wired / wireless network unit
120: DMB module unit 122:
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020130000016A KR20140087950A (en) | 2013-01-01 | 2013-01-01 | Apparatus and method for learning rhythm pattern by using native speaker's pronunciation data and language data. |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020130000016A KR20140087950A (en) | 2013-01-01 | 2013-01-01 | Apparatus and method for learning rhythm pattern by using native speaker's pronunciation data and language data. |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20140087950A true KR20140087950A (en) | 2014-07-09 |
Family
ID=51736777
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020130000016A KR20140087950A (en) | 2013-01-01 | 2013-01-01 | Apparatus and method for learning rhythm pattern by using native speaker's pronunciation data and language data. |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20140087950A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105070118A (en) * | 2015-07-30 | 2015-11-18 | 广东小天才科技有限公司 | Pronunciation correcting method and device for language learning |
CN109326160A (en) * | 2018-11-07 | 2019-02-12 | 吕梁学院 | A kind of Oral English Practice pronunciation critique system |
-
2013
- 2013-01-01 KR KR1020130000016A patent/KR20140087950A/en not_active Application Discontinuation
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105070118A (en) * | 2015-07-30 | 2015-11-18 | 广东小天才科技有限公司 | Pronunciation correcting method and device for language learning |
CN109326160A (en) * | 2018-11-07 | 2019-02-12 | 吕梁学院 | A kind of Oral English Practice pronunciation critique system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR100900085B1 (en) | Language learning control method | |
CN111739556B (en) | Voice analysis system and method | |
KR100900081B1 (en) | Language learning control method | |
Ai | Automatic pronunciation error detection and feedback generation for call applications | |
KR20140078810A (en) | Apparatus and method for learning rhythm pattern by using native speaker's pronunciation data and language data. | |
KR20140087956A (en) | Apparatus and method for learning phonics by using native speaker's pronunciation data and word and sentence and image data | |
KR20160001332A (en) | English connected speech learning system and method thereof | |
KR20140107067A (en) | Apparatus and method for learning word by using native speakerpronunciation data and image data | |
KR20140079677A (en) | Apparatus and method for learning sound connection by using native speaker's pronunciation data and language data. | |
KR20140087951A (en) | Apparatus and method for learning english grammar by using native speaker's pronunciation data and image data. | |
KR20140087950A (en) | Apparatus and method for learning rhythm pattern by using native speaker's pronunciation data and language data. | |
KR20140079245A (en) | Apparatus and method for learning rhythm pattern by using native speaker's pronunciation data and language data. | |
KR20140075994A (en) | Apparatus and method for language education by using native speaker's pronunciation data and thought unit | |
Johnson | An integrated approach for teaching speech spectrogram analysis to engineering students | |
KR20140028527A (en) | Apparatus and method for learning word by using native speaker's pronunciation data and syllable of a word | |
KR20140074459A (en) | Apparatus and method for learning word by using native speaker's pronunciation data and syllable of a word and image data | |
KR20140082127A (en) | Apparatus and method for learning word by using native speaker's pronunciation data and origin of a word | |
KR20140073768A (en) | Apparatus and method for language education by using native speaker's pronunciation data and thoughtunit | |
KR20140087957A (en) | Apparatus and method for Language Pattern Education by using sentence data. | |
KR20140078082A (en) | Apparatus and method for Language Pattern Education by using sentence data. | |
KR20140087955A (en) | Apparatus and method for learning english preposition by using native speaker's pronunciation data and image data. | |
KR20140101548A (en) | Apparatus and method for learning word by using link example sentence. | |
KR20140087953A (en) | Apparatus and method for language education by using native speaker's pronunciation data and thoughtunit | |
KR20140087959A (en) | Apparatus and method for learning word by using native speaker's pronunciation data and syllable of a word and image data | |
KR20140078081A (en) | Apparatus and method for learning phonics by using native speaker's pronunciation data and word and sentence and image data |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WITN | Withdrawal due to no request for examination |