KR20140109551A - Apparatus and method for learning foreign language by using augmented reality - Google Patents

Apparatus and method for learning foreign language by using augmented reality Download PDF

Info

Publication number
KR20140109551A
KR20140109551A KR1020130022569A KR20130022569A KR20140109551A KR 20140109551 A KR20140109551 A KR 20140109551A KR 1020130022569 A KR1020130022569 A KR 1020130022569A KR 20130022569 A KR20130022569 A KR 20130022569A KR 20140109551 A KR20140109551 A KR 20140109551A
Authority
KR
South Korea
Prior art keywords
sentence
foreign language
data
augmented reality
unit
Prior art date
Application number
KR1020130022569A
Other languages
Korean (ko)
Inventor
주홍철
Original Assignee
주홍철
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주홍철 filed Critical 주홍철
Priority to KR1020130022569A priority Critical patent/KR20140109551A/en
Publication of KR20140109551A publication Critical patent/KR20140109551A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/06—Foreign languages
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Tourism & Hospitality (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Human Resources & Organizations (AREA)
  • General Business, Economics & Management (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

An apparatus and a method for learning a foreign language by using an augmented reality are provided. The apparatus for learning a foreign language by using an augmented reality comprises a storage unit, a camera unit, a key input unit, an audio processing unit, a control unit, a mixing unit, and an image processing unit. The storage unit stores a vocabulary or sentence, an accent, a phonetic alphabet, an interpreted meaning of a foreign language, an image, animation or video reminding the vocabulary or sentence, a native speaker pronunciation video and voice, and a native speaker pronunciation voice waveform data associated with the vocabulary or sentence. The camera unit collects an augmented reality maker. The key input unit searches, in text, the vocabulary, sentence or page to study. The audio processing unit searches, in voice, the vocabulary, sentence or page to study. The control unit collects data associated with the augmented reality maker collected through the camera unit, data searched by the key input unit or data searched through the audio processing unit among a foreign language vocabulary or sentence stored in the storage unit, the accent, the phonetic alphabet, the interpreted meaning of the foreign language, image data reminding the foreign language vocabulary or sentence, and a native speaker pronunciation video and voice waveform data associated with the foreign language or sentence and controls the data to send to the mix unit. The mixing unit generates a moving picture by mixing all data collected by the control unit. The image processing unit reproduces the moving picture mixed by mixing unit.

Description

[0001] Apparatus and method for learning foreign languages using augmented reality [

The present invention relates to an image or animation or image (hereinafter referred to as image data) and a word or sentence pronunciation of a native speaker that can remind a corresponding word or sentence by using augmented reality technique in foreign language learning using words or sentences When a voice, a word or a sentence is pronounced, a voice waveform, a word or a sentence are pronounced, a facial muscle change, a lip shape, and a tooth and a tongue position pattern (hereinafter referred to as pronunciation data) The present invention relates to a foreign language learning apparatus and a method for providing foreign language learning using a word or a sentence, a foreign language learning book, or a foreign language learning program displayed on a computer, a smart phone, a tablet pc, And a marker for realizing the augmented reality Place the camera lens attached to the learning device in the corresponding marker and check the foreign words or sentences associated with the markers and the accents, pronunciation symbols, meaning interpreted in the language of the learning country, the corresponding words or sentences The present invention relates to a foreign language learning apparatus and method using an augmented reality for effectively learning a foreign language by allowing the pronunciation data of a native speaker about image data, words or sentences that can be remapped to be mixed and reproduced as a moving picture.

In the age of globalization, interest in learning foreign languages is increasing.

Conventional foreign language learning systems provide vocabulary data of native speakers using MP3 or CD to list vocabulary or sentences using books or pmp, tablet pc, or smartphone, and listen to pronunciation of the words or sentences.

However, using the provided MP3 or CD, the learner can not immediately hear the native speaker's voice for the word or sentence currently being learned, and the pronunciation of the native speaker can not be accurately known.

In order to overcome the limitations of the foreign language learning system, the number of overseas language training is increased from the age of childhood. As a result, the financial burden and conflict due to family separation are emerging as social problems.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to solve the above-mentioned problems, and an object of the present invention is to provide a foreign language learning book or a foreign language learning program output from a computer, a smart phone, a tablet pc, The present invention also provides a foreign language learning apparatus and method using an augmented reality in which a marker for implementing the augmented reality is provided and the desired foreign language learning data is immediately provided to enhance the efficiency of foreign language learning.

It is also an object of the present invention to provide a foreign language learning apparatus using an augmented reality which provides an intuitive learning system by providing an accent, a pronunciation symbol, and a meaning interpreted in a language of a learning country, And a method.

It is also an object of the present invention to provide a foreign language learning apparatus and method using an augmented reality, which enables an associative learning method by providing together foreign language words or image data capable of associating sentences.

It is also an object of the present invention to provide a foreign language learning apparatus and method using an augmented reality which provides pronunciations of pronunciation of a native language to a foreign language word or sentence to be learned.

The foreign language learning device using the augmented reality according to the present invention can be applied to a foreign language learning apparatus using an augmented reality learning apparatus such as an accent relating to a foreign language word or sentence, a foreign language word or a sentence, a pronunciation symbol, A storage unit for storing a native speech sound image and voice, and a native speech sound waveform data;

A camera unit for collecting the augmented reality markers;

A key input unit for searching for a word or a sentence or a page to be learned through a character;

An audio processing unit for searching a word or a sentence or a page to be learned through voice;

An accent related to a foreign language word or a sentence, a pronunciation symbol, an interpretation in a language of a learning country, image data capable of reminding a foreign language word or a sentence, a native speech image, and a sound waveform data A controller for collecting the data related to the augmented reality marker collected through the camera unit, the data retrieved by the key input unit or the data retrieved through the audio processing unit, and sending the collected data to the mixer;

A mixer for mixing all the data collected by the controller to produce a moving image;

And an image processor for reproducing the mixed moving image from the mixer.

The wired / wireless network unit may further include a wired / wireless network unit for controlling the controller to link and download the associated data through the web server when the storage unit does not have data associated with the augmented reality marker collected through the camera unit. can do.

A foreign language learning method using an augmented reality according to the present invention includes the steps of marking a marker for realizing an augmented reality in a foreign language learning book or a foreign language learning program output through a display such as a computer, a smart phone, a tablet pc, and a pmp;

Positioning a camera lens mounted on a terminal capable of functioning as an augmented reality on the markers;

A foreign language word or sentence associated with the markers mentioned above, an accent related to a foreign language word or sentence, a pronunciation symbol, an interpreted meaning in the language of the learning country, image data capable of reminding a foreign language word or sentence, Reproducing all of the data as a moving image;

A step of retrieving a word or a sentence or a page to be further learned through a character or voice input;

An accent related to a foreign language word or a sentence, a pronunciation symbol, a meaning interpreted in a language of a learning country, image data capable of associating a foreign language word or a sentence, a native speech image, and a voice waveform data Are mixed and reproduced as a moving picture.

According to the foreign language learning method using the augmented reality of the present invention, an augmented reality is implemented in a foreign language learning book or a foreign language learning program outputted through a display such as a computer, a smart phone, a tablet pc, and a pmp in a foreign language learning using words or sentences The markers to be used are indicated, and the desired foreign language learning data is provided immediately so that the efficiency of the foreign language learning can be enhanced. The accents, pronunciation symbols and interpreted meaning of the language of the learning country It provides an intuitive learning system to be provided together with image data that can remind the foreign language words or sentences to be studied together so as to enable associative learning methods, Provide pronunciation data of native speakers Wide and provided to enable correct recognition that the to overcome the limitations of the conventional learning machine and width, the effect of the immediate foreign language learning.

1 is a block diagram showing a configuration of a foreign language learning apparatus using an augmented reality according to an embodiment of the present invention;
2 and 3 are views showing an example of foreign language learning using an augmented reality according to an embodiment of the present invention.
4 is a flowchart of a foreign language learning method using an augmented reality according to an embodiment of the present invention.

Hereinafter, an apparatus and method for learning a foreign language using an augmented reality according to the present invention will be described with reference to the accompanying drawings.

1 is a block diagram illustrating a configuration of a foreign language learning apparatus using an augmented reality according to an embodiment of the present invention.

Referring to FIG. 1, a foreign language learning apparatus 100 using an augmented reality includes an accent related to a word or a sentence, a word or a sentence, an pronunciation symbol, an interpreted meaning in the language of the learning country, an image A camera unit 102 for collecting the augmented reality markers, a word or a sentence or a page to be learned, etc. through a character An audio processing unit 114 for searching a word or a sentence or a page to be learned through voice, and a storage unit 114 for storing a foreign language word or sentence, a foreign language word or a sentence Accents, phonetic symbols, meaning interpreted in the language of the learning country, image data that can be reminiscent of foreign words or sentences, native pronunciation images, The augmented reality markers collected through the camera unit 102, the data searched by the key input unit 116 or the data searched through the audio processing unit 114 are collected and stored in the mixer 110 A mixer 110 for mixing the data collected by the controller 108 to produce a moving image and a video processor 110 for reproducing the mixed video from the mixer 110, And a control unit 108 for linking and reproducing the associated data through the web server when the storage unit 104 does not have data associated with the augmented reality markers collected through the camera unit 102 And a wired / wireless network unit 106 for controlling the wired /

The foreign language learning apparatus 100 using an augmented reality includes a computer terminal capable of functioning as an augmented reality, a tablet PC, a language term, and a smart phone.

The image processing unit 112 includes a speaker to enable audio output and media output.

2 and 3 are views showing an example of foreign language learning using an augmented reality according to an embodiment of the present invention.

A marker for realizing an augmented reality in a foreign language learning book or a foreign language learning program outputted through a display such as a computer, a smart phone, a tablet pc, and a pmp is displayed, and a marker capable of functioning as an augmented reality A camera lens attached to the marker may be used to indicate a word or sentence associated with the marker, an accent associated with the word or sentence, a pronunciation symbol, an interpreted meaning in the language of the learning country, image data capable of reminding a word or sentence, Both the pronunciation image and the sound waveform data are mixed and reproduced as moving images.

If there is a word or a sentence or a page that the learner wants to learn further, the user can continue learning by searching through a character or voice input.

(= Inside) + nov (= new) + at (= make) + ion (noun), for example, = suffix).

Accurate pronunciation correction learning for words and sentences and image associative memoryless learning can be performed through the video reproduced by the mixing.

4 is a flowchart of a foreign language learning method using an augmented reality according to an embodiment of the present invention.

Referring to FIG. 4, a marker for implementing an augmented reality is written and produced in a foreign language learning book or a foreign language learning program output through a display such as a computer, a smart phone, a tablet pc, and a pmp (S200).

The camera unit 102 is positioned on the markers and the markers are collected. (S202).

Thereafter, the word or sentence stored in the storage unit 104, the accent related to the word or sentence, the pronunciation symbol, the interpreted meaning in the language of the learning country, image data capable of reminding a word or a sentence, The control unit 108 sends the data associated with the marker to the mixer 110. The mixer 110 mixes all of the corresponding data as a moving image and reproduces the data through the image processor 112 (S204).

Then, a word or a sentence or a page to be further learned is searched through a character or voice input (S206).

An accent related to a foreign language word or a sentence, a pronunciation symbol, a meaning interpreted in a language of a learning country, image data capable of associating a foreign language word or a sentence, a native speech image, and a voice waveform data Are mixed and reproduced as a moving image (S208).

Image data related to a word or a sentence is an important factor in association learning.

Accent, pronunciation, native pronunciation, voice, and voice waveform data related to a word or a sentence are important factors for accurate pronunciation learning.

A voice waveform is a type of wavelength generated when dividing a vibration shape of a sound by a time difference, and a voice waveform is an important factor for confirming the accent and rhythm when a word or a sentence is pronounced.

It is the part that the learner must check in order to learn the pronunciation of the native speaker, because the meaning of the word or sentence is different depending on which part is pronounced strongly.

As a matter of course, it is needless to say that the present invention can be applied to other languages such as Chinese, Japanese, German, French, etc. in addition to English.

100: Foreign language learning apparatus using an augmented reality 102:
104: storage unit 106: wired / wireless network unit
108: control unit 110: mix unit
112: image processor 114: audio processor
116:

Claims (4)

In a foreign language learning apparatus using an augmented reality,
An image or animation or video that can be reminded of a word or sentence, a native speech sound image and voice, and a native speech sound waveform data A storage unit;
A camera unit for collecting the augmented reality markers;
A key input unit for searching for a word or a sentence or a page to be learned through a character;
An audio processing unit for searching a word or a sentence or a page to be learned through voice;
An accent related to a foreign language word or a sentence, a pronunciation symbol, an interpretation in a language of a learning country, image data capable of reminding a foreign language word or a sentence, a native speech image, and a sound waveform data A controller for collecting the data related to the augmented reality marker collected through the camera unit, the data retrieved by the key input unit or the data retrieved through the audio processing unit, and sending the collected data to the mixer;
A mixer for mixing all the data collected by the controller to produce a moving image;
And an image processor for reproducing the mixed moving image from the mixer.
The method according to claim 1,
And a wired / wireless network unit for controlling the controller to link the related data through the web server and to reproduce the linked data or the associated data when the storage unit does not have data associated with the augmented reality marker collected through the camera unit Foreign Language Learning Device Using Augmented Reality. To implement claim 1,
And a marker for realizing an augmented reality in a foreign language learning book or a foreign language learning program output through a display such as a computer, a smart phone, a tablet pc, a pmp, etc., Device. A method for learning a foreign language using an augmented reality, the method comprising: marking a marker for realizing an augmented reality in a foreign language learning book or a foreign language learning program outputted through a display such as a computer, a smart phone, a tablet pc, and a pmp;
Positioning a camera lens mounted on a terminal capable of functioning as an augmented reality on the markers;
An accent related to a word or a sentence, a word or a sentence associated with the above-mentioned marker, a pronunciation symbol, an interpreted meaning in the language of the learning country, an image or an animation or an image capable of reminding a word or a sentence, Reproducing all of the data as a moving image;
A step of retrieving a word or a sentence or a page to be further learned through a character or voice input;
An accent related to a foreign language word or a sentence, a pronunciation symbol, a meaning interpreted in a language of a learning country, image data capable of associating a foreign language word or a sentence, a native speech image, and a voice waveform data And a step of mixing and reproducing the mixed images as a moving image.
KR1020130022569A 2013-03-03 2013-03-03 Apparatus and method for learning foreign language by using augmented reality KR20140109551A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020130022569A KR20140109551A (en) 2013-03-03 2013-03-03 Apparatus and method for learning foreign language by using augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020130022569A KR20140109551A (en) 2013-03-03 2013-03-03 Apparatus and method for learning foreign language by using augmented reality

Publications (1)

Publication Number Publication Date
KR20140109551A true KR20140109551A (en) 2014-09-16

Family

ID=51756031

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020130022569A KR20140109551A (en) 2013-03-03 2013-03-03 Apparatus and method for learning foreign language by using augmented reality

Country Status (1)

Country Link
KR (1) KR20140109551A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107784096A (en) * 2017-10-19 2018-03-09 王守刚 A kind of reading auxiliary system and method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107784096A (en) * 2017-10-19 2018-03-09 王守刚 A kind of reading auxiliary system and method
CN107784096B (en) * 2017-10-19 2021-11-26 王守刚 Reading auxiliary system and method

Similar Documents

Publication Publication Date Title
US9478143B1 (en) Providing assistance to read electronic books
US20130196292A1 (en) Method and system for multimedia-based language-learning, and computer program therefor
WO2012086356A1 (en) File format, server, view device for digital comic, digital comic generation device
US20060194181A1 (en) Method and apparatus for electronic books with enhanced educational features
JP5634853B2 (en) Electronic comic viewer device, electronic comic browsing system, viewer program, and electronic comic display method
KR20160111275A (en) Foreign language learning system and foreign language learning method
US20140349259A1 (en) Device, method, and graphical user interface for a group reading environment
WO2014151884A2 (en) Device, method, and graphical user interface for a group reading environment
US10896624B2 (en) System and methods for transforming language into interactive elements
US10276150B2 (en) Correction system, method of correction, and computer program product
JP2014085998A (en) Electronic note creation support device and program for electronic note creation support device
KR20140087956A (en) Apparatus and method for learning phonics by using native speaker's pronunciation data and word and sentence and image data
KR20140078810A (en) Apparatus and method for learning rhythm pattern by using native speaker's pronunciation data and language data.
KR20140109551A (en) Apparatus and method for learning foreign language by using augmented reality
CN111681467B (en) Vocabulary learning method, electronic equipment and storage medium
KR20140107067A (en) Apparatus and method for learning word by using native speakerpronunciation data and image data
US20160267811A1 (en) Systems and methods for teaching foreign languages
KR20140087951A (en) Apparatus and method for learning english grammar by using native speaker's pronunciation data and image data.
KR20170009487A (en) Chunk-based language learning method and electronic device to do this
KR20170097419A (en) Korean language learning system and Korean language learning method using the same
KR20140087949A (en) Apparatus and method for learning word by using augmented reality
KR20140087950A (en) Apparatus and method for learning rhythm pattern by using native speaker's pronunciation data and language data.
KR20140101548A (en) Apparatus and method for learning word by using link example sentence.
KR102618311B1 (en) An apparatus and method for providing conversational english lecturing contents
KR102453876B1 (en) Apparatus, program and method for training foreign language speaking

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination