KR20140087893A - Apparatus and method for learning word by using augmented reality - Google Patents

Apparatus and method for learning word by using augmented reality Download PDF

Info

Publication number
KR20140087893A
KR20140087893A KR1020120158678A KR20120158678A KR20140087893A KR 20140087893 A KR20140087893 A KR 20140087893A KR 1020120158678 A KR1020120158678 A KR 1020120158678A KR 20120158678 A KR20120158678 A KR 20120158678A KR 20140087893 A KR20140087893 A KR 20140087893A
Authority
KR
South Korea
Prior art keywords
augmented reality
word
sentence
learning
image
Prior art date
Application number
KR1020120158678A
Other languages
Korean (ko)
Inventor
주홍찬
Original Assignee
주홍찬
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주홍찬 filed Critical 주홍찬
Priority to KR1020120158678A priority Critical patent/KR20140087893A/en
Publication of KR20140087893A publication Critical patent/KR20140087893A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/06—Foreign languages
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Tourism & Hospitality (AREA)
  • Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Multimedia (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The present invention relates to an apparatus and a method for learning a foreign language using an augmented reality, and more particularly, to an apparatus and method for learning a foreign language using an augmented reality, which includes accents related to words or sentences, words or sentences, pronunciation symbols, A storage unit for storing a native speech sound image and voice, and a native speech sound waveform data; A camera unit for collecting the augmented reality markers; Among the image data, the native pronunciation image, and the sound waveform data stored in the storage unit, the accent related to the word or sentence, the word or the sentence, the pronunciation symbol, the meaning interpreted in the language of the learning country, the word or the sentence, A controller for extracting each of the data associated with the augmented reality marker collected through the unit and sending the extracted data to the mixer; A word or sentence associated with the augmented reality marker collected through the camera unit processed by the control unit, an accent related to the word or sentence, a pronunciation symbol, an interpreted meaning in the language of the learning country, image data A mix unit for mixing a native pronunciation sound image and voice waveform data to produce a moving image; And an image processor for reproducing moving images associated with the augmented reality markers collected through the camera unit processed by the mixer.

Figure pat00001

Description

[0001] Apparatus and method for learning augmented reality [

The present invention relates to an image or animation or image (hereinafter referred to as "image data ") capable of reminding a corresponding word or sentence by using augmented reality technology in a foreign language learning using words or sentences, (A) The word "a" or "a" is a word or a sentence. The word "a" or "a" And more particularly, to a foreign language learning apparatus and method for providing a foreign language learning book or a computer, a smart phone, a tablet pc, a pmp, etc. through a display in a foreign language learning using a word or a sentence And a marker for realizing an augmented reality in a foreign language learning program. A camera lens attached to a foreign language learning device using a thread is placed on the corresponding marker, and a foreign language word or a sentence associated with the marker, an accent for the word or sentence, a pronunciation symbol, a meaning interpreted in the language of the learning country, And more particularly, to an apparatus and method for learning a foreign language using an augmented reality, in which pronunciation data of a native speaker about image data, a word or a sentence that can remind a sentence, are mixed and reproduced as a moving picture to perform effective foreign language learning.

In the age of globalization, interest in learning foreign languages is increasing.

Conventional foreign language learning systems provide vocabulary data of native speakers using MP3 or CD to list vocabulary or sentences using books or pmp, tablet pc, or smartphone, and listen to pronunciation of the words or sentences.

However, using the provided MP3 or CD, the learner can not immediately hear the native speaker's voice for the word or sentence currently being learned, and the pronunciation of the native speaker can not be accurately known.

In order to overcome the limitations of the foreign language learning system, the number of overseas language training is increased from the age of childhood. As a result, the financial burden and conflict due to family separation are emerging as social problems.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to solve the above-mentioned problems, and an object of the present invention is to provide a foreign language learning book or a foreign language learning program output from a computer, a smart phone, a tablet pc, The present invention also provides a foreign language learning apparatus and method using an augmented reality in which a marker for implementing the augmented reality is provided and the desired foreign language learning data is immediately provided to enhance the efficiency of foreign language learning.

It is also an object of the present invention to provide a foreign language learning apparatus using an augmented reality which provides an intuitive learning system by providing an accent, a pronunciation symbol, and a meaning interpreted in a language of a learning country, And a method.

It is also an object of the present invention to provide a foreign language learning apparatus and method using an augmented reality, which enables an associative learning method by providing together foreign language words or image data capable of associating sentences.

It is also an object of the present invention to provide a foreign language learning apparatus and method using an augmented reality which provides pronunciations of pronunciation of a native language to a foreign language word or sentence to be learned.

The foreign language learning device using the augmented reality according to the present invention can be applied to a foreign language learning apparatus using an augmented reality learning apparatus such as an accent relating to a foreign language word or sentence, a foreign language word or a sentence, a pronunciation symbol, A storage unit for storing a native speech sound image and voice, and a native speech sound waveform data;

A camera unit for collecting the augmented reality markers;

An accent related to a foreign language word or a sentence, a pronunciation symbol, an interpretation in a language of a learning country, image data capable of reminding a foreign language word or a sentence, a native speech image, and a sound waveform data A controller for extracting respective data associated with the augmented reality markers collected through the camera unit and sending the extracted data to the mixer;

A foreign language word or sentence associated with the augmented reality marker collected through the camera unit processed by the control unit, an accent related to a foreign language word or sentence, a pronunciation symbol, a meaning interpreted in the language of the learning country, a foreign language word or a sentence A mixer for mixing the image data, the native pronunciation images, and the sound waveform data to form a moving image;

And an image processor for reproducing a moving image associated with the augmented reality marker collected through the camera unit processed by the mixer.

The wired / wireless network unit may further include a wired / wireless network unit for allowing the control unit to control downloading of the associated data through the web server when the storage unit does not have data associated with the augmented reality markers collected through the camera unit.

A foreign language learning method using an augmented reality according to the present invention includes the steps of marking a marker for realizing an augmented reality in a foreign language learning book or a foreign language learning program output through a display such as a computer, a smart phone, a tablet pc, and a pmp;

Positioning a camera lens mounted on a terminal capable of functioning as an augmented reality on the markers;

A foreign language word or sentence associated with the markers mentioned above, an accent related to a foreign language word or sentence, a pronunciation symbol, a meaning interpreted in the language of the learning country, image data capable of reminding a foreign language word or sentence, And the data is mixed and reproduced as moving images.

According to the foreign language learning method using the augmented reality of the present invention, an augmented reality is implemented in a foreign language learning book or a foreign language learning program outputted through a display such as a computer, a smart phone, a tablet pc, and a pmp in a foreign language learning using words or sentences The markers to be used are indicated, and the desired foreign language learning data is provided immediately so that the efficiency of the foreign language learning can be enhanced. The accents, pronunciation symbols and interpreted meaning of the language of the learning country It provides an intuitive learning system to be provided together with image data that can remind the foreign language words or sentences to be studied together so as to enable associative learning methods, Provide pronunciation data of native speakers Wide and provided to enable correct recognition that the to overcome the limitations of the conventional learning machine and width, the effect of the immediate foreign language learning.

1 is a block diagram showing a configuration of a foreign language learning apparatus using an augmented reality according to an embodiment of the present invention;
2 is a diagram illustrating an example of foreign language learning using an augmented reality according to an embodiment of the present invention;
3 is a flowchart of a foreign language learning method using an augmented reality according to an embodiment of the present invention.

Hereinafter, an apparatus and method for learning a foreign language using an augmented reality according to the present invention will be described with reference to the accompanying drawings.

1 is a block diagram illustrating a configuration of a foreign language learning apparatus using an augmented reality according to an embodiment of the present invention.

Referring to FIG. 1, a foreign language learning apparatus 100 using an augmented reality includes an accent related to a word or a sentence, a word or a sentence, an pronunciation symbol, an interpreted meaning in the language of the learning country, an image A storage unit 104 in which native speech sound data and native speech sound waveform data are stored; a camera unit 102 for collecting augmented reality markers; The augmented reality marker (s) collected through the camera unit 102 among the accent related to the sentence, the pronunciation symbol, the interpreted meaning of the language of the learning country, the image data capable of reminding a word or a sentence, The control unit 108 extracts each of the data associated with the data collected by the control unit 108 and sends it to the mixer 110, A mix of all of the word or sentence associated with the reality marker, the accent associated with the word or sentence, the pronunciation symbol, the meaning interpreted in the language of the learning country, the image data capable of reminding the word or sentence, An image processing unit for reproducing a moving image associated with the augmented reality marker collected through the camera unit 102 processed by the mixer 110, And a wired / wireless network unit 106 for allowing the control unit 108 to control downloading of the associated data through the web server when there is no data associated with the collected augmented reality markers in the storage unit 104.

The foreign language learning apparatus 100 using the augmented reality includes a computer terminal capable of functioning as an augmented reality, a tablet PC, a language term, and a smart phone.

The image processing unit 112 includes a speaker to enable audio output and media output.

2 is a diagram illustrating an example of foreign language learning using an augmented reality according to an embodiment of the present invention.

A marker for realizing an augmented reality in a foreign language learning book or a foreign language learning program outputted through a display such as a computer, a smart phone, a tablet pc, and a pmp is displayed, and a marker capable of functioning as an augmented reality A camera lens attached to the marker may be used to indicate a word or sentence associated with the marker, an accent associated with the word or sentence, a pronunciation symbol, an interpreted meaning in the language of the learning country, image data capable of reminding a word or sentence, Both the pronunciation image and the sound waveform data are mixed and reproduced as moving images.

In the case of a word, for example, in English, "innovation" means that the syllable is divided into "syllable" or "in nov ation"

Can be written in etymological units like "in (= inside) + nov (= new) + at (= make) + ion (= suffix)".

Accurate pronunciation correction learning for words and sentences and image associative memoryless learning can be performed through the video reproduced by the mixing.

3 is a flowchart of a foreign language learning method using an augmented reality according to an embodiment of the present invention.

Referring to FIG. 3, a marker for implementing an augmented reality is written and produced in a foreign language learning book or a foreign language learning program output through a display such as a computer, a smart phone, a tablet pc, and a pmp (S200).

The camera unit 102 is positioned on the markers and the markers are collected. (S202).

Thereafter, the word or sentence stored in the storage unit 104, the accent related to the word or sentence, the pronunciation symbol, the interpreted meaning in the language of the learning country, image data capable of reminding a word or a sentence, The control unit 108 sends the data associated with the marker to the mixer 110. The mixer 110 mixes all of the corresponding data as a moving image and reproduces the data through the image processor 112 (S204).

Image data related to a word or a sentence is an important factor in association learning.

Accent, pronunciation, native pronunciation, voice, and voice waveform data related to a word or a sentence are important factors for accurate pronunciation learning.

A voice waveform is a type of wavelength generated when dividing a vibration shape of a sound by a time difference, and a voice waveform is an important factor for confirming the accent and rhythm when a word or a sentence is pronounced.

It is the part that the learner must check in order to learn the pronunciation of the native speaker, because the meaning of the word or sentence is different depending on which part is pronounced strongly.

As a matter of course, it is needless to say that the present invention can be applied to other languages such as Chinese, Japanese, German, French, etc. in addition to English.

100: Foreign language learning apparatus using an augmented reality 102:
104: storage unit 106: wired / wireless network unit
108: control unit 110: mix unit
112:

Claims (4)

In a foreign language learning apparatus using augmented reality, a word or a sentence, an accent related to a word or a sentence, a pronunciation symbol, an interpreted meaning in the language of the learning country, an image or an animation or an image capable of reminding a word or a sentence, A storage unit for storing video and audio data and native speech sound waveform data; A camera unit for collecting the augmented reality markers; Among the image data, the native pronunciation image, and the sound waveform data stored in the storage unit, the accent related to the word or sentence, the word or the sentence, the pronunciation symbol, the meaning interpreted in the language of the learning country, the word or the sentence, A controller for extracting each of the data associated with the augmented reality marker collected through the unit and sending the extracted data to the mixer; A word or sentence associated with the augmented reality marker collected through the camera unit processed by the control unit, an accent related to the word or sentence, a pronunciation symbol, an interpreted meaning in the language of the learning country, image data A mix unit for mixing a native pronunciation sound image and voice waveform data to produce a moving image; And an image processor for reproducing a moving image associated with the augmented reality marker collected through the camera unit processed by the mixer.
The mobile terminal of claim 1, further comprising a wired / wireless network unit for allowing the control unit to control the download command of the associated data through the web server when there is no data associated with the augmented reality marker collected through the camera unit, A Foreign Language Learning Device Using Augmented Reality. In order to implement the first aspect, the method further includes writing and marking a marker for implementing an augmented reality in a foreign language learning book or a foreign language learning program output through a display such as a computer, a smart phone, a tablet pc, or a pmp A foreign language learning device using an augmented reality. A method for learning a foreign language using an augmented reality, the method comprising: marking a marker for realizing an augmented reality in a foreign language learning book or a foreign language learning program outputted through a display such as a computer, a smart phone, a tablet pc, and a pmp; Positioning a camera lens mounted on a terminal capable of functioning as an augmented reality on the markers; An accent related to a word or a sentence, a word or a sentence associated with the above-mentioned marker, a pronunciation symbol, an interpreted meaning in the language of the learning country, an image or an animation or an image capable of reminding a word or a sentence, And the data is mixed and reproduced as a moving picture.
KR1020120158678A 2012-12-31 2012-12-31 Apparatus and method for learning word by using augmented reality KR20140087893A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020120158678A KR20140087893A (en) 2012-12-31 2012-12-31 Apparatus and method for learning word by using augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020120158678A KR20140087893A (en) 2012-12-31 2012-12-31 Apparatus and method for learning word by using augmented reality

Publications (1)

Publication Number Publication Date
KR20140087893A true KR20140087893A (en) 2014-07-09

Family

ID=51736726

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020120158678A KR20140087893A (en) 2012-12-31 2012-12-31 Apparatus and method for learning word by using augmented reality

Country Status (1)

Country Link
KR (1) KR20140087893A (en)

Similar Documents

Publication Publication Date Title
CN107369462B (en) Electronic book voice playing method and device and terminal equipment
US9478143B1 (en) Providing assistance to read electronic books
WO2012086356A1 (en) File format, server, view device for digital comic, digital comic generation device
US20130196292A1 (en) Method and system for multimedia-based language-learning, and computer program therefor
JP2012133662A (en) Electronic comic viewer device, electronic comic browsing system, viewer program and recording medium recording viewer program
KR20160081244A (en) Automatic interpretation system and method
US9087512B2 (en) Speech synthesis method and apparatus for electronic system
KR20140087956A (en) Apparatus and method for learning phonics by using native speaker's pronunciation data and word and sentence and image data
KR20140078810A (en) Apparatus and method for learning rhythm pattern by using native speaker's pronunciation data and language data.
US9697851B2 (en) Note-taking assistance system, information delivery device, terminal, note-taking assistance method, and computer-readable recording medium
KR20140107067A (en) Apparatus and method for learning word by using native speakerpronunciation data and image data
KR20140075994A (en) Apparatus and method for language education by using native speaker's pronunciation data and thought unit
KR20140087893A (en) Apparatus and method for learning word by using augmented reality
KR20140109551A (en) Apparatus and method for learning foreign language by using augmented reality
KR20140087951A (en) Apparatus and method for learning english grammar by using native speaker's pronunciation data and image data.
Frazier et al. Lecture ready 3: strategies for academic listening note-taking and discussion
KR102098377B1 (en) Method for providing foreign language education service learning grammar using puzzle game
KR20140087949A (en) Apparatus and method for learning word by using augmented reality
KR20140087950A (en) Apparatus and method for learning rhythm pattern by using native speaker's pronunciation data and language data.
KR20140079245A (en) Apparatus and method for learning rhythm pattern by using native speaker's pronunciation data and language data.
KR20140101548A (en) Apparatus and method for learning word by using link example sentence.
KR20140073768A (en) Apparatus and method for language education by using native speaker's pronunciation data and thoughtunit
KR101579905B1 (en) A system for creating English word decoding multimedia file aiming at enhancing literacy
KR102453876B1 (en) Apparatus, program and method for training foreign language speaking
KR20220134248A (en) Method and device for providing korean language self-directed learning contents

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination