KR101629894B1 - System and method of learning language service for mat - Google Patents

System and method of learning language service for mat Download PDF

Info

Publication number
KR101629894B1
KR101629894B1 KR1020150153455A KR20150153455A KR101629894B1 KR 101629894 B1 KR101629894 B1 KR 101629894B1 KR 1020150153455 A KR1020150153455 A KR 1020150153455A KR 20150153455 A KR20150153455 A KR 20150153455A KR 101629894 B1 KR101629894 B1 KR 101629894B1
Authority
KR
South Korea
Prior art keywords
augmented reality
user
contents
marker
server
Prior art date
Application number
KR1020150153455A
Other languages
Korean (ko)
Inventor
함덕표
Original Assignee
함덕표
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 함덕표 filed Critical 함덕표
Priority to KR1020150153455A priority Critical patent/KR101629894B1/en
Application granted granted Critical
Publication of KR101629894B1 publication Critical patent/KR101629894B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G06Q50/205—Education administration or guidance
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/06—Foreign languages
    • H04N5/225—

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • Strategic Management (AREA)
  • Educational Technology (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Marketing (AREA)
  • Human Resources & Organizations (AREA)
  • Primary Health Care (AREA)
  • General Health & Medical Sciences (AREA)
  • General Business, Economics & Management (AREA)
  • Economics (AREA)
  • Health & Medical Sciences (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The present invention relates to a mathematical language learning system and method for a mat, wherein a character image and corresponding English words are printed on at least one surface thereof, and a mat of a foamed resin material printed with an augmented reality marker corresponding to the character image and an English word ; A personal terminal for recognizing the augmented reality markers, driving the augmented reality contents corresponding to the augmented reality contents, outputting English pronunciation, recognizing the pronunciation of the user, and providing and executing content data according to a user's interaction; An augmented reality server for searching and providing the augmented reality contents associated with the augmented reality markers requested through the communication network from the personal terminal, and providing the augmented reality contents to the personal terminal in accordance with the user's interaction; And an administrator terminal connected to the augmented reality server through a communication network and authoring content data according to the interaction between the augmented reality marker and the user, and for managing and monitoring the user.

Description

 [0001] The present invention relates to a language learning system and method for a mat,

More particularly, the present invention relates to a system and method for learning mat language, and more particularly, an English word and a picture capable of driving an augmented reality on a floor mat are printed, The present invention relates to a language learning system and method using a mat that enables a user to perform an interaction through a user interface displayed on a screen of a smartphone while being driven on a smartphone screen.

Recently, it has become a routine task to prevent floor noise and to live a floor mats for children and children indoors for safety.

The floor mats are printed with characters that the child or the child likes, or the learning materials are printed for education purposes such as a face plate and a numeric plate.

The floor mats are made of synthetic resin or foamed resin in various sizes and can be assembled to be assembled so as to combine various patterns or images.

Recently, the importance of early foreign language education has been emphasized, and studies have shown that early childhood foreign language education is very effective for brain development. According to this trend, various learning media for early education are emerging.

However, these early learning learning media are merely a follow-up of conventional learning media such as video videos, picture books, word cards, and the like. It is difficult for children to learn actively, and it can also cause boredom or rejection.

It is expected to be more effective and useful for young children if a combination of smartphone and augmented reality markers is used as a learning medium that can induce interest and enhance learning effect for infants .

SUMMARY OF THE INVENTION The present invention has been made to solve the conventional problems as described above, and it is an object of the present invention to provide a floor mat in which English words and pictures capable of driving an augmented reality are printed, The present invention is intended to provide a system and method for a mat language learning system in which dimensional content is driven on a smartphone screen and a user can perform an interaction through a user interface displayed on a smartphone screen.

The mat language learning system according to the present invention includes a mat of a foamed resin material on which a character image and corresponding English words are printed on at least one side thereof and an augmented reality marker corresponding to the character image and an English word is printed; A personal terminal for recognizing the augmented reality marker, driving the augmented reality contents corresponding to the augmented reality contents, outputting English pronunciation, recognizing the pronunciation of the user and providing and executing content data according to user interaction; An augmented reality server for searching and providing the augmented reality contents associated with the augmented reality markers requested through the communication network from the personal terminal, and providing the augmented reality contents to the personal terminal in accordance with the user's interaction; And an administrator terminal connected to the augmented reality server through a communication network and authoring content data according to the interaction between the augmented reality marker and the user, and for managing and monitoring the user.

In addition, in the language learning system for mat according to the present invention, the personal terminal includes a video input unit for capturing an augmented reality marker corresponding to the character image and the English word; And recognizing the augmented reality markers photographed from the image input unit and operating the augmented reality contents in cooperation with the augmented reality server, recognizing the user interaction and the pronunciation of the user, and transmitting the augmented reality content to the augmented reality server, And an augmented reality application unit installed to execute the augmented reality application unit.

Further, in the language learning system for mat according to the present invention, the augmented reality application unit may include a marker recognition module for recognizing the augmented reality markers photographed by the image input unit; An augmented reality driving module for driving the augmented reality contents corresponding to the augmented reality markers; A user interface module capable of inputting user selection or control commands for the augmented reality contents and receiving and executing an interaction based on user input; A speech recognition module for receiving and recognizing the pronunciation of the user in the English language driven by the augmented reality contents; And receiving a content corresponding to the augmented reality marker from the augmented reality server storing the augmented reality content, receiving recognition of a user interaction or a user's pronunciation corresponding to the augmented reality content, And a server interworking module for providing data.

In addition, in the language learning system for mat according to the present invention, the augmented reality server includes an augmented reality data database storing augmented reality markers corresponding to the character image, English words, and augmented reality contents corresponding thereto; An augmented reality contents searching module for searching augmented reality contents corresponding to the augmented reality markers to provide augmented reality contents; And a content verification module for comparing and verifying the augmented reality markers stored in the augmented reality database and the augmented reality markers recognized by the marker recognition module according to the augmented reality markers corresponding to the augmented reality markers.

In addition, in the language learning system for mat according to the present invention, the augmented reality server includes a content matching module for recognizing user's interaction or user's pronunciation and matching the content data.

In addition, in the language learning system for mat according to the present invention, the augmented reality server receives user information for use with the augmented reality contents for the mat printed with the augmented reality markers corresponding to the character image and the English word from the individual terminal And a user database for storing and managing the user's pronunciation of the English user.

The administrator terminal includes a content authoring terminal connected to the augmented reality server through a communication network and inputting augmented reality contents for an augmented reality marker to be further expanded; And a monitoring terminal for authoring and monitoring the user by authoring additional content data according to the user's interaction.

Meanwhile, a mat language learning method of a mat according to the present invention includes a step of registering purchase information and authenticating a user of a mat user terminal printed with an augmented reality marker on an augmented reality server; Augmented reality marker recognition module recognizing a marker displayed on a learning mat through an image input unit; The augmented reality driving module searches for and provides the augmented reality contents corresponding to the markers stored in the augmented reality server; Displaying a user interface on a screen while the augmented reality contents are running on a personal terminal; The augmented reality contents are driven in a personal terminal and a user inputs an interaction into a user interface; And displaying the additional content corresponding to the user interaction on the personal terminal in association with each other.

Meanwhile, the language learning method for mat according to the present invention includes: a step of recognizing a marker displayed on a learning mat through an image input unit by an augmented reality marker recognition module; Searching the augmented reality contents corresponding to the markers stored in the augmented reality server by the augmented reality driving module; The content verification module compares the augmented reality marker stored in the augmented reality server database with the augmented reality marker recognized by the recognition module to see if they match; The personal terminal displays the augmented reality contents on the personal terminal while outputting English pronunciation of the corresponding marker; Recognizing pronunciation of a user who repeatedly pronounces English sound output from the speech recognition module; And the personal terminal displays the predetermined character on the evaluation of the word pronunciation recognized through the augmented reality driving module and outputs the character.

In addition, in the method for learning mat language according to the present invention, the personal terminal may include determining whether a user inputs an interaction to a user interface while the augmented reality contents are driven; And the augmented reality server includes a step of matching and displaying additional contents corresponding to the user interaction with the augmented reality contents, and displaying the augmented reality contents on a personal terminal.

According to the present invention, it is possible to combine smart phones and augmented reality markers with a mat that can be commonly accessed in the vicinity, thereby inducing interest to children and doubling the learning effect.

In addition, according to the present invention, the pronunciation of the user is recognized, and additional contents corresponding to the pronunciation are matched and provided, thereby leading to a user-customized language learning.

In addition, the present invention provides a user interface to select and operate a user-preferred content, and can induce interest and curiosity, thereby enhancing learning motivation and sense of accomplishment.

1 is a schematic configuration diagram of a language learning system for a mat according to the present invention.
2 is a detailed block diagram of a personal terminal of the language learning system for mat according to the present invention.
3 is a detailed block diagram of an augmented reality server of the language learning system for mat according to the present invention.
4 is a schematic flowchart of a language learning method for a mat according to an embodiment of the present invention.
5 is a flowchart of a language learning method for a mat according to another embodiment of the present invention.
FIG. 6 is a diagram illustrating a configuration of a language learning system for a mat according to an embodiment of the present invention.

Hereinafter, a system and method for learning a mat language according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic configuration diagram of a language learning system for a mat according to the present invention.

1, a language learning system for mat according to an exemplary embodiment of the present invention includes a mat 100, a personal terminal 200, an augmented reality server 300, and an augmented reality server 300 on which a character image and an augmented reality marker corresponding to an English word are printed, A communication network 400, and an administrator terminal 500.

The mat (100) is made of foamed resin or urethane material as a mat to be laid mainly on the floor.

In the mat 100, a character image 110 and a corresponding English word are printed on at least one side thereof, and an augmented reality marker corresponding to the character image and the English word is printed.

The augmented reality marker exists in the image obtained by the personal terminal 200 and can be informed. The personal terminal 200 extracts the shape of the object by analyzing the feature points of the object, And the type of the object can be recognized by comparing the stored reference shape.

The personal terminal 200 recognizes the augmented reality markers, drives the augmented reality contents corresponding to the augmented reality contents, outputs English pronunciation, recognizes the pronunciation of the user, and provides and executes content data according to the user's interaction .

The personal terminal 100 is a mobile device capable of capturing image data of the character image, English words, and augmented reality markers corresponding thereto, and directly executing AR contents including 3D video, A terminal, a smart phone, a tablet PC, and a PDA.

The augmented reality server 300 searches for and provides the augmented reality contents associated with the augmented reality markers requested through the communication network from the personal terminal 200, matches the content data according to the user's interaction, to provide.

The administrator terminal 500 is connected to the augmented reality server 300 via a communication network, authoring content data according to the augmented reality marker and the user's interaction, and for managing and monitoring the user.

2 is a detailed block diagram of a personal terminal of the language learning system for mat according to the present invention.

2, the personal terminal 200 includes an image input unit 210 for acquiring an image of a character image, an augmented reality application unit for driving the augmented reality contents in cooperation with the augmented reality server 300 220).

The image input unit 210 photographs the character image printed on the mat 100 and the augmented reality marker corresponding to the English word.

The image input unit 210 acquires an image of a specific region of the mat 100. As an example, the image input unit 210 may acquire an image of a specific region using a CCD camera.

The augmented reality application unit 220 recognizes the augmented reality markers photographed from the image input unit 210 and operates the augmented reality contents in cooperation with the augmented reality server 300 to recognize the user's interaction and the pronunciation of the user To the augmented reality server 300 and executes the content data according to the user's interaction.

When the augmented reality application unit 220 purchases a mat and registers a user in the augmented reality server 300 as described later, the augmented reality application unit 220 can be downloaded as a software form such as an app or an operating program through a communication network and installed in a personal terminal.

The augmented reality application unit 220 includes a marker recognition module 221, an augmented reality driving module 222, a user interface module 223, a voice recognition module 224, and a server interworking module 225.

The marker recognition module 221 recognizes the augmented reality markers photographed by the image input unit 210. [

The augmented reality markers can be inserted into various characters printed on a mat and English characters. The marker recognition module 221 can recognize and interpret the augmented reality markers using connection of feature points or various pattern recognition techniques have.

The augmented reality driving module 222 drives the augmented reality contents corresponding to the augmented reality markers.

The augmented reality contents provide a three-dimensional moving image for a two-dimensional character image and simultaneously output a voice for an English word related to the character image.

The user interface module 223 can input a user's selection or control command for the augmented reality contents and receives and executes an interaction according to the user's input.

The user interaction indicates a user's input selection or control command or data input to the personal terminal as a response of the user while the augmented reality contents is being driven and processes the menu for the operation of the augmented reality contents, When the application is operated, an operation button and a search selection button may be displayed to touch the button on the touch screen.

The user interface module 223 may be configured to operate in a touch screen form on the screen where the augmented reality contents are played when the application is driven.

The predetermined 3D character selected by the user through the menu selection button displayed on the touch screen can be configured to pronounce and describe the word corresponding to the augmented reality marker in advance.

That is, a plurality of content operation menus may be specified in advance in one augmented reality marker, and the user can select them.

Also, the user interface module 223 may be configured to display an augmented reality image describing different meanings of the word each time the operation button is touched by a user.

The speech recognition module 224 receives a pronunciation of the user and recognizes the pronunciation of the user when the user follows the same pronunciation with respect to the English language driven by the augmented reality contents.

In the case of a smartphone, the voice recognition module 224 may be configured to receive a voice input to a microphone and recognize an accent and a rhythm related to a word or a sentence, and convert data into voice waveform data.

Speech waveform data is a type of wavelength generated when the waveform of a sound is divided by time difference, and a voice waveform is an important factor for confirming the accent and rhythm when a word or a sentence is pronounced.

In addition, the server interworking module 225 may request and receive content corresponding to the augmented reality marker to the augmented reality server 300, which stores the augmented reality contents, And provides the matched contents data from the augmented reality server 300 according to a result of recognizing the pronunciation of the augmented reality server 300. [

3 is a detailed block diagram of an augmented reality server of the language learning system for mat according to the present invention.

3, an augmented reality database 310, an augmented reality content search module 320, a content verification module 330, a content matching module 340, and a user database 350 are stored in the augmented reality server 300 .

The augmented reality database 310 stores a character image printed on the mat, an augmented reality marker corresponding to an English word, and augmented reality contents corresponding to the augmented reality marker.

The augmented reality database 310 is configured to store the augmented reality markers displayed on the mat in advance, and stores the three-dimensional contents corresponding to the augmented reality markers together.

The augmented reality database 310 may be configured to continuously update the augmented reality markers newly constructed as the character image and the English word displayed on the mat are expanded.

 In addition, the augmented reality content searching module 320 searches the augmented reality contents corresponding to the augmented reality markers extracted from the image data of the character image and the English word, and transmits the augmented reality contents to the individual terminal 200 through the communication network .

The content verification module 330 compares the augmented reality markers stored in the augmented reality database 410 with the augmented reality markers recognized by the marker recognition module 221 according to the feature points corresponding to the augmented reality markers, .

The content matching module 340 of the augmented reality server 300 recognizes the user's interaction or user's pronunciation and matches the content data.

When the accent of the user's pronunciation recognized by the voice recognition module 224 of the personal terminal 200 and the rhythm or voice waveform data are compared with the voice data provided and evaluated, the content matching module 340 ) Allows the evaluation data according to the recognition result to be combined with the augmented reality contents.

For example, when a user speaks a correct pronunciation, the character is applauded with the voice of 'well done' as a form of adding an additional action, image or voice to a three-dimensional character driven according to the degree to which the user follows pronunciation. The image that is hit or danced is further combined.

In addition, the content matching module 340 displays an alphabetic character plate through a user interface, and if the user correctly inputs the spelling, similarly, additional contents tailored to the user are combined and executed in addition to the running stereoscopic AR content do.

According to the user interaction, a menu for the operation of the augmented reality contents is processed or a predetermined 3D character selected by the user through the menu selection button displayed on the touch screen is configured to pronounce and describe a word corresponding to the augmented reality marker in advance And may be configured so that the augmented reality image describing the meaning of the word is further matched and driven whenever the operation button is touched by the user.

Meanwhile, in the augmented reality server 300, the user information to be used for the augmented reality contents for the mat printed with the augmented reality markers corresponding to the character image and the English word is received from the personal terminal and is registered by the user, Or a user database 350 for storing and managing user pronunciations in English.

When the user who has purchased the mat capable of running the augmented reality contents registers the user through the web or the communication network, the user registration can provide the user-customized content extension according to the learning process, and the learning evaluation and the systematic language learning medium or system So that the learning result of the learner and the evaluation result can be stored, so that the learning management of the user can be systematically planned.

3, the administrator terminal 500 includes a content authoring terminal 510 that is connected to the augmented reality server 300 through a communication network and inputs augmented reality contents for an augmented reality marker to be further expanded, And a monitoring terminal 520 for processing user management and monitoring to provide additional content data according to the user's interaction.

As the character image and the English words are expanded in the content authoring terminal 510, the newly added augmented reality markers are linked to an external content provider or a production system to expand the added augmented reality contents as they are continuously updated. And provide an interface to do so.

4 is a schematic flowchart of a language learning method for a mat according to an embodiment of the present invention

First, the mat user terminal 200 on which the augmented reality markers are printed registers the purchase information with the augmented reality server and registers the user information (S10).

When the user is registered in the augmented reality server 300, the application for driving the augmented reality can be downloaded through the communication network as software such as an app or an operating program, and installed in the personal terminal.

Next, in the personal terminal, the augmented reality marker recognition module 221 recognizes the marker displayed on the learning mat through the image input unit 210 (S20).

The augmented reality driving module 222 retrieves and provides the augmented reality contents corresponding to the markers stored in the augmented reality server 300 through the server interworking module 225 (S30).

At this time, the augmented reality driving module 222 causes the augmented reality contents corresponding to the marker to be driven by the individual terminal and causes the user interface to be displayed on the screen (S40).

Here, when the augmented reality contents are driven in the personal terminal, the user inputs the interaction into the user interface (S50).

When the application is driven by the user interface, the augmented reality contents can be configured to be operated in a touch screen form on the screen where the augmented reality contents are played, and various content operation menus can be previously designated in one augmented reality marker, And can display the augmented reality image explaining different meanings of the word every time the operation button is touched by the user.

Accordingly, the augmented reality server 300 matches the additional content for the user interaction and is driven and outputted by the individual terminal (S60).

5 is a flowchart of a language learning method for a mat according to another embodiment of the present invention.

 First, in the individual terminal, the augmented reality marker recognition module 221 recognizes the marker displayed on the learning mat through the image input unit 210 (S100).

Next, the augmented reality driving module 222 retrieves and provides the augmented reality contents corresponding to the markers stored in the augmented reality server 300 through the server interworking module 225 (S110).

The content verification module 330 compares the augmented reality markers stored in the augmented reality server database 310 with the augmented reality markers recognized by the marker recognition module 221 in step S120.

Next, the personal terminal 200 displays the English pronunciation of the corresponding marker while displaying the augmented reality contents corresponding to the character image on the personal terminal (S130).

The speech recognition module 224 receives and recognizes the repeated pronunciation of the English pronunciation that is output during the augmented reality content operation (S140).

Here, the speech recognition module 224 compares the accent with the recognized user's speech and the rhythm or speech waveform data with the provided speech data to evaluate the degree of coincidence.

After the recognition process, the personal terminal 200 displays a predetermined character on the pronunciation of the recognized word through the speech recognition module 224 and outputs it (S150).

In addition, when the user inputs an interaction to the user interface while the augmented reality contents are being driven, the personal terminal receives the interaction (S160).

The augmented reality server 300 receives and confirms the user interaction input, matches the augmented reality contents with the augmented reality contents to provide the augmented reality contents to the personal terminal 200, and drives the personalized terminal to output the augmented reality contents in operation S170.

FIG. 6 is an overall block diagram of a configuration of a language learning system for a mat according to an embodiment of the present invention.

6, purchase authentication for user registration is processed in the augmented reality server system by purchasing a play character in which a character for learning and an English word are printed, and a user inputs augmented reality An application for driving can be downloaded and installed in a personal terminal such as a smart phone.

When a character image printed on a play mat is photographed by a smartphone, the user recognizes the augmented reality markers included in the character image according to the driving of the application, tracks the augmented reality contents previously matched to the markers, and renders the retrieved augmented reality contents, And displays the 3D video as the augmented reality contents on the phone screen.

On the other hand, when an English pronunciation 'X-ray' printed on the character is outputted as a voice and the user recognizes it, the data is registered as a result of evaluation of the pronunciation of the user and is combined with the augmented reality contents .

In order to expand the augmented reality contents as the additional augmented reality markers are continuously updated, an authoring tool terminal and a manager terminal for user monitoring are linked to an external content provider or a production system, System.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the invention as defined by the appended claims. .

100: Matte 110: Character image
200: personal terminal 210: video input unit
220: application part 221: marker recognition module
222: augmented reality driving module 223: user interface module
224: voice recognition module 225: server interlock module
300: augmented reality server 310: augmented reality database
320: augmented reality content retrieval module 330: content verification module
340: content matching module 350: user database
400: communication network 500: administrator terminal
510: Content authoring terminal 520: Monitoring terminal

Claims (10)

A mat of a foamed resin material on which a character image and an English word corresponding thereto are printed on at least one side and an augmented reality marker corresponding to the character image and an English word is printed;
The augmented reality application unit is installed to recognize the augmented reality marker, to drive the augmented reality content corresponding to the augmented reality content, to output English pronunciation, to recognize the pronunciation of the user, to provide and execute content data according to the user's interaction, A personal terminal for displaying an evaluation of pronunciation of a word as a predetermined character and outputting the evaluation;
The augmented reality contents associated with the augmented reality markers requested through the communication network from the personal terminal are searched and provided, the contents data are matched according to the interaction of the user and are provided to the personal terminal, An augmented reality server that includes a content matching module that matches the augmented reality server; And
A manager terminal for accessing the augmented reality server through a communication network and authoring content data according to the augmented reality marker and user interaction and for managing and monitoring the user,
Wherein the manager terminal comprises: a content authoring terminal connected to the augmented reality server through a communication network and inputting augmented reality contents for an augmented reality marker to be further expanded; And
And a monitoring terminal for authoring additional content data according to a user's interaction to process user management and monitoring. The method according to claim 1,
In the personal terminal,
An image input unit for photographing an augmented reality marker corresponding to the character image and an English word; And
Recognizes the augmented reality marker photographed from the image input unit, operates the augmented reality contents in cooperation with the augmented reality server, recognizes the user's interaction and pronunciation of the user, and transmits the augmented reality content to the augmented reality server, And an augmented reality application unit configured to execute the augmented reality application unit. 3. The method of claim 2,
The augmented reality application unit,
A marker recognition module for recognizing the augmented reality markers photographed by the image input unit;
An augmented reality driving module for driving the augmented reality contents corresponding to the augmented reality markers;
A user interface module capable of inputting user selection or control commands for the augmented reality contents and receiving and executing an interaction based on user input;
A speech recognition module for receiving and recognizing the pronunciation of the user in the English language driven by the augmented reality contents; And
The augmented reality server receives a content corresponding to the augmented reality marker from the augmented reality server and stores the received augmented reality content in the augmented reality server in response to a result of recognizing user's interaction or user's pronunciation corresponding to the augmented reality content, And a server interworking module for providing matched contents data. The method according to claim 1,
The augmented reality server includes:
An augmented reality data database in which the augmented reality markers corresponding to the character image and the English words and the augmented reality contents corresponding thereto are stored;
An augmented reality contents searching module for searching augmented reality contents corresponding to the augmented reality markers to provide augmented reality contents; And
And a content verification module for comparing and verifying the augmented reality markers stored in the augmented reality database and the augmented reality markers recognized by the auger recognition module of the augmented reality application unit according to the feature points corresponding to the augmented reality markers Language learning system for mat. delete 5. The method of claim 4,
The augmented reality server includes:
User information to be used for the augmented reality contents for the mat printed with the augmented reality markers corresponding to the character image and the English word is inputted from the personal terminal and registered with the user and the user's pronunciation of the registered user or the English word is stored And a user database that manages the mat. delete delete Augmented reality marker recognition module recognizing a marker displayed on a learning mat through an image input unit;
Searching the augmented reality contents corresponding to the markers stored in the augmented reality server by the augmented reality driving module;
Comparing the augmented reality marker stored in the augmented reality server database with the augmented reality marker recognized by the marker recognition module;
The personal terminal displays the augmented reality contents on the personal terminal while outputting English pronunciation of the corresponding marker;
Recognizing pronunciation of a user who repeatedly pronounces English sound output from the speech recognition module; And
The personal terminal includes a step of displaying and outputting an evaluation of recognized pronunciation of a word through augmented reality driving module with a predetermined character,
The personal terminal receives the interaction when the user inputs an interaction to the user interface while the augmented reality contents are driven.
The augmented reality server receives and confirms the user interaction input and provides additional contents corresponding to the user interaction to the augmented reality contents and provides the augmented reality contents to the individual terminal; And
The administrator terminal further includes inputting the augmented reality contents for the augmented reality marker to be further extended through the communication network to the augmented reality server and authoring and monitoring the user by authoring additional content data according to the interaction of the user A method of learning a language for a mat. delete
KR1020150153455A 2015-11-02 2015-11-02 System and method of learning language service for mat KR101629894B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150153455A KR101629894B1 (en) 2015-11-02 2015-11-02 System and method of learning language service for mat

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150153455A KR101629894B1 (en) 2015-11-02 2015-11-02 System and method of learning language service for mat

Publications (1)

Publication Number Publication Date
KR101629894B1 true KR101629894B1 (en) 2016-06-13

Family

ID=56191467

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150153455A KR101629894B1 (en) 2015-11-02 2015-11-02 System and method of learning language service for mat

Country Status (1)

Country Link
KR (1) KR101629894B1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200062500A (en) * 2018-11-27 2020-06-04 주식회사 엔비져블 Education support system and method using mat and Augmented Reality
KR102175340B1 (en) 2019-07-31 2020-11-06 안동대학교 산학협력단 Educational AR application for infants stored in a computer-readable storage medium and method for providing the same
CN112037593A (en) * 2019-06-03 2020-12-04 广东小天才科技有限公司 Learning interaction implementation method and system based on augmented reality

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040069646A (en) * 2003-01-30 2004-08-06 주식회사 비구 Member Management System For Using Infancy Educational Learning Appliance
KR20120014854A (en) * 2010-08-10 2012-02-20 주식회사 에듀윈 Language learnning device
KR101522834B1 (en) * 2015-03-13 2015-05-27 한현정 Floor mats with augmented reality marker and augmented reality systems that include it

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040069646A (en) * 2003-01-30 2004-08-06 주식회사 비구 Member Management System For Using Infancy Educational Learning Appliance
KR20120014854A (en) * 2010-08-10 2012-02-20 주식회사 에듀윈 Language learnning device
KR101522834B1 (en) * 2015-03-13 2015-05-27 한현정 Floor mats with augmented reality marker and augmented reality systems that include it

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
[골든베이비] 살아움직이는 증강현실 3D 입체 스프링매트 디노3D매트로 우리아이 공룡을 만났어요~! (네이버 블로그, 2015.10.22) *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200062500A (en) * 2018-11-27 2020-06-04 주식회사 엔비져블 Education support system and method using mat and Augmented Reality
KR102178894B1 (en) 2018-11-27 2020-11-13 주식회사 엔비져블 Education support system and method using mat and Augmented Reality
CN112037593A (en) * 2019-06-03 2020-12-04 广东小天才科技有限公司 Learning interaction implementation method and system based on augmented reality
KR102175340B1 (en) 2019-07-31 2020-11-06 안동대학교 산학협력단 Educational AR application for infants stored in a computer-readable storage medium and method for providing the same

Similar Documents

Publication Publication Date Title
US10580319B2 (en) Interactive multimedia story creation application
US9754503B2 (en) Systems and methods for automated scoring of a user's performance
US11871109B2 (en) Interactive application adapted for use by multiple users via a distributed computer-based system
CN109144244A (en) A kind of method, apparatus, system and the augmented reality equipment of augmented reality auxiliary
KR101629894B1 (en) System and method of learning language service for mat
US20190108772A1 (en) Method and apparatus for multilingual interactive self-learning
KR20190125597A (en) the lecture system using the iris scanning type head mounted display
CN105117400A (en) Information searching method and system
CN117651960A (en) Interactive avatar training system
KR20180088005A (en) authoring tool for generating VR video and apparatus for generating VR video
CN116601661A (en) Generating an evaluation mask for multi-factor authentication
US20170018203A1 (en) Systems and methods for teaching pronunciation and/or reading
KR20090002136A (en) Persionanlized realtime evaluating and learning system and operation method thereof
CN111078992B (en) Dictation content generation method and electronic equipment
JP6623575B2 (en) Learning support device and program
KR102119724B1 (en) Terminal device for supporting quick search for video and operating method thereof
US9968844B2 (en) Server and user device for providing a computer implemented game reward
CN111580653A (en) Intelligent interaction method and intelligent interactive desk
KR101901724B1 (en) Writing education system using puzzle and the method thereof
US11605054B2 (en) System and method for recognizing environment and/or location using object identification techniques
KR102069922B1 (en) System and Application For Learning Navigation
KR20220053021A (en) video game overlay
CN111033540A (en) Method and system for streaming data over a network
JP2017068592A (en) Robot, robot control device, robot control method and program
KR102528293B1 (en) Integration System for supporting foreign language Teaching and Learning using Artificial Intelligence Technology and method thereof

Legal Events

Date Code Title Description
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20190425

Year of fee payment: 4