KR20190011095A - Method and apparatus for learning language, thereof system - Google Patents

Abstract

The present invention relates to a language learning method, a device thereof and a system thereof. More specifically, the present invention includes: a user terminal which generates and displays a 3D image by operating a service with any one between a first mode and a second mode based on service data according to operation environments, executes conversation with a virtual object in the 3D image based on previously learned data by recognizing input information inputted from a user, generates and transmits result information of the executed conversation, and executes learning content by using learning content information received in response to the result information; a service server which transmits the service data to the user terminal, analyzes the result information received from the user terminal, generates learning content information depending on the analysis result, and transmits the learning content information to the user terminal; and a learning server which provides learning content to the user terminal. In the present invention, the operation environment is set by the user. The present invention is provided for language learning based on a desired place regardless of the actual place of a user through a user terminal.

Description

METHOD AND APPARATUS FOR LEARNING LANGUAGE, THEREOF SYSTEM,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a language learning method and apparatus and a system thereof, and more particularly, to a language learning method and apparatus and a system thereof for learning a language based on any one of a virtual reality and an augmented reality through a user terminal .

Today, the world is rapidly changing. Due to the breakthrough of transportation and communication, the national ethnic boundary is disappearing, but the language is different and communication is difficult.

In order to solve this problem, a translation technology has been developed and various translation services have been provided. However, it is a reality that it is inconvenient to use in a situation where a conversation should be exchanged in real time.

It is not easy to learn languages other than the native language, and there are limitations in the way of learning, so it is often the case that you want to learn the language of the country through listening to conversation lectures or language training. When we learn the native language, we are able to memorize the words naturally through the surrounding environment, and to use the memorized words appropriately according to each situation. Learning the language of a country through conversation classes or language training also aims to improve its language skills as it learns languages in a variety of situations in countries where the language is used. In other words, learning through interaction rather than one-sided learning is a great help to improve language skills.

Recent development of Virtual Rality (VR) and Augmented Reality (AR) technology has made it possible for users to experience objects that are not in reality, and it is becoming increasingly important that mobile terminals based on operating systems such as smartphones As the spread has expanded, it has become possible to experience these virtual and augmented reality through mobile terminals.

Accordingly, there is a need to provide a service capable of learning a language based on a desired place regardless of a place where the user is actually located, in accordance with the growth rate of the virtual reality and the AR technique.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide a language learning method and apparatus capable of learning a language based on a desired place regardless of a place where a user is actually located through a user terminal, .

In addition, the present invention provides a language learning method and apparatus and a system for enabling a user to perform real-time communication with a virtual object in various situations, so that a learning effect on a language can be rapidly improved.

The present invention also provides a language learning method and apparatus capable of enjoying various benefits provided by a corresponding service shop by informing a user of various benefits provided by the service shop, And to provide such a system.

It is another object of the present invention to provide a language learning method and apparatus and a system for providing learning contents according to a learning situation of a user, thereby enabling fast learning of a part requiring learning such as pronunciation correction or grammar.

The objects of the present invention are not limited to those mentioned above, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

According to an embodiment of the present invention, there is provided a language learning system for generating and displaying 3D (3 Dimension) images by driving a service in either a first mode or a second mode according to a driving environment, Recognizes input information to be input, executes a dialog with a virtual object in the 3D image based on previously learned data, generates and transmits result information on the executed dialog, and transmits the result information received in response to the result information A user terminal for executing learning contents using learning content information; A service server for transmitting service data for the driving environment to the user terminal, analyzing result information received from the user terminal, generating learning content information according to the analysis result, and transmitting the learning content information to the user terminal; And a learning server for providing learning contents to the user terminal, wherein the driving environment is set by the user.

According to another aspect of the present invention, there is provided a language learning method comprising: receiving configuration information on a driving environment from a user terminal; Transmitting, by the service server, service data corresponding to the received configuration information to the user terminal; The service server recognizes the input information input from the user and performs a dialog with a virtual object in a 3D (3-Dimension) image based on the previously learned data to receive the generated result information from the user terminal ; And analyzing the received result information, and generating learning content information according to the analysis result and transmitting the generated learning content information to the user terminal, wherein the user terminal comprises: Mode and a second mode to generate and display 3D images, and the user terminal requests the learning server to provide the learning contents using the received learning content information, And the driving environment is set by the user.

According to another aspect of the present invention, there is provided a language learning apparatus for transmitting setting information on a driving environment, result information on service activation, and a request for providing learning contents, A receiving unit for receiving data, learning content information, and learning content; An audio unit for reproducing an audio signal to be output through a speaker and inputting an audio signal input from the microphone; A recognition unit for recognizing input information for at least one of a voice, a touch, a movement, and a line of sight input from a user; A driving unit for driving a service in one of a first mode and a second mode according to the driving environment; A generating unit for generating a 3D (3D) image based on the input information and the service data; A display unit for displaying the generated 3D image; A storage unit for storing the service data and the pre-learned data; And generating and displaying a 3D image by driving a service in either the first mode or the second mode according to the driving environment, recognizing the input information, and generating a virtual object And a controller for generating and transmitting result information on the executed conversation and controlling execution of the learning contents using the learning content information received in response to the result information, The environment is set by the user.

According to the present invention, a user can learn a language based on a desired place regardless of a place where the user is actually located.

In addition, according to the present invention, it is possible for a user to real-time communicate with a virtual object in various situations, so that a learning effect on a language can be rapidly improved.

In addition, according to the present invention, by informing the user of various benefits provided by the service shop, the user can enjoy various benefits provided by the service shop, and the service shop can obtain the publicity effect.

Further, according to the present invention, learning contents are provided according to the learning situation of the user, so that it is possible to quickly learn a part requiring learning such as pronunciation correction or grammar

The effects of the present invention are not limited to those mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the following description.

1 is a block diagram illustrating a network configuration of a language learning system according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a language learning method according to an embodiment of the present invention;
3 is a block diagram illustrating a configuration of a user terminal according to an embodiment of the present invention;
4 is a flowchart illustrating a language learning method in a user terminal according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. Hereinafter, the terms are defined in consideration of donation in the present invention, which may vary depending on the intention of the user, the intention or the custom of the operator.

However, the present invention is not limited to the embodiments described below, but may be embodied in various forms. These embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art to which the present invention pertains. Only. Therefore, the definition should be based on the contents throughout this specification.

Throughout the specification, when an element is referred to as being "comprising" or "comprising" an element, it is understood that the element may include other elements, not the exclusion of any other element . In addition, terms such as "... unit", "... device", "... device", "... part" or "... module" Means a unit for processing, which may be implemented by hardware, software, or a combination of hardware and software.

In the exemplary embodiment of the present invention, each component, function block or means may be composed of one or more sub-components, and the electrical, electronic, and mechanical functions performed by the components may be electronic circuits, An integrated circuit, an ASIC (Application Specific Integrated Circuit), or the like, or may be implemented separately or two or more may be integrated into one.

Also, each block of the accompanying block diagrams and combinations of the steps of the flowcharts may be performed by computer program instructions. These computer program instructions may be embedded in a processor of a general purpose computer, a special purpose computer, a portable notebook computer, a network computer, a mobile device such as a smart phone, an on-line game service provision server or other programmable data processing equipment, Those instructions, which are performed through the processor of the data processing equipment as possible, will create means for performing the functions described in each block or flowchart of the block diagrams described below. These computer program instructions may also be stored in a memory or in a computer readable memory available to a computer device capable of directing a computer device or other programmable data processing device to implement the functionality in a particular manner, It is also possible to produce products containing instruction means for performing the functions described in the respective steps of the flowcharts. It will be appreciated that computer program instructions may be loaded onto a computer device or other programmable data processing equipment so that a process for performing a series of operating steps on a computer device or other programmable data processing equipment may be created to determine each block and flowchart of the block diagram It is also possible to provide steps for executing the functions described in each step of Fig.

Also, each block or each step may represent a module, segment, or portion of code that includes one or more executable instructions for executing the specified logical function (s). It should also be noted that in some alternative embodiments, the functions mentioned in the blocks or steps may occur out of order. For example, two blocks or steps shown in succession may in fact be performed substantially concurrently, or the blocks or steps may sometimes be performed in reverse order according to the corresponding function.

In the embodiment of the present invention, the client or various devices include all calculation means capable of collecting, reading, processing, processing, storing, and displaying data such as a desktop computer, a notebook computer, a smart phone, a PDA, . In particular, the client or various devices in the embodiment of the present invention can execute software written in a readable code, and can display and transmit the software to a user. In addition, the software may be stored on its own if necessary, or may be read with data from outside.

The client or various devices in the embodiment of the present invention include functions such as input, output, and storage as well as the above-described data processing functions. For this purpose, a CPU, a main board, a graphics card, A CPU, a main board, a graphic chip, a memory chip, a sound engine, a speaker, a touch pad, a speaker, a speaker, a keyboard, a mouse, a monitor, a USB, a communication modem, An external connection terminal such as a USB, a communication antenna, a communication modem capable of implementing communication such as 3G, LTE, LTE-A, WiFi, Bluetooth, and the like. It is to be understood that these various elements may be used singly or in combination of two or more, or a combination of the various elements may implement one or more functions, and may be embodied in one or more blocks in the drawings or in the description And parts thereof may mean that the various elements included in the client or the various devices as described above may be expressed singly or two or more together, or a combination of various elements may represent one or more functions.

The present invention allows a user to selectively visit a service shop which is located at a distance in augmented reality or virtual reality and a service shop lined up in the virtual reality through a user terminal and conduct conversation with a virtual object while ordering, , And provides learning contents based on the result of the conversation so that learning can proceed. Also, even if you do not visit a particular service store, you may be able to converse by asking questions from virtual objects encountered during a virtual street. Meanwhile, the service stores are shops providing actual services, and each time they visit each store in augmented reality or virtual reality, information on benefits such as coupons and discounts offered by each store is provided together do.

Hereinafter, an apparatus and method for learning a language according to an embodiment of the present invention and a system thereof will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating a network configuration of a language learning system according to an embodiment of the present invention.

Referring to FIG. 1, the language learning system 100 includes a user terminal 101, a service server 103, a service shop server 105, and a learning server 107.

First, the user terminal 101 generates and displays 3D (3 Dimension) images by driving the service in either the first mode or the second mode based on the service data according to the driving environment set by the user. Here, the driving environment includes positional information as a background of the 3D image, that is, information about a virtual area where the user wants to learn a language, and the first mode and the second mode may be the augmented reality mode and the virtual reality mode, respectively have.

Also, the user terminal 101 recognizes input information such as voice, touch, motion, and gaze input from a user and executes a dialog with a virtual object in the 3D image based on previously learned data. Thereafter, the user terminal 101 generates result information on the executed conversation, transmits the result information to the service server 103, and provides the learning contents from the learning server 107 using the learning content information received in response thereto Receive.

The user terminal 101 may receive benefit information of the corresponding service shop from the service shop server 105 corresponding to at least one service shop in the 3D image.

Meanwhile, the user terminal 101 may provide a service in cooperation with a separate device such as an HMD (Head Mounted Display).

The service server 103 transmits the service data corresponding to the driving environment of the user terminal 101 among the stored service data to the user terminal 101 and analyzes the result information about the conversation received from the user terminal 101. Thereafter, the service server 103 generates learning content information according to the analysis result, and transmits the learning content information to the user terminal 101, thereby allowing the user terminal 101 to receive the learning content required by the user terminal 101.

The service shop server 105 transmits its benefit information to the service server 103. Although only one service shop server is shown in FIG. 1, it may be configured for each of a plurality of service shops subscribed to the service.

The learning server 107 receives the learning content provision request of the user terminal 101 and transmits the requested learning content to the user terminal 101 in response thereto.

2 is a flowchart illustrating a language learning method according to an embodiment of the present invention.

When the application is executed in the user terminal 101 (S201), a notification message indicating that the application is executed is transmitted to the service server 103 (S203). At this time, the step S203 may be omitted.

Then, the user terminal 101 sets a driving environment for driving the 3D image (S205), and transmits the setting information to the service server 103 (S207). At this time, the setting information includes location information selected by the user, that is, information on an area serving as a background of language learning, and mode information on whether the augmented reality mode or the virtual reality mode is selected.

The service server 103 confirms the setting information received from the user terminal 101 (S209), and transmits the service data corresponding to the confirmed setting information among the stored service data (S211). At this time, the service data includes data necessary for driving the service, and further includes distance information previously stored according to the location information included in the setting information and information about at least one service shop.

The user terminal 101 downloads and stores the service data from the service server 103 (S213), and drives the service based on the stored service data (S215). At this time, the service may be driven by a separate device worn by the user in a state of being interlocked with the user terminal 101.

Thereafter, the user terminal 101 recognizes user input information such as voice, touch, motion, and gaze from the user (S217), executes a dialog with the virtual object in the 3D image based on the previously learned data, (S219). The user terminal 101 transmits the generated result information to the service server 103.

The service server 103 confirms the result information received from the user terminal 101 (S223), and transmits the learning content information to the user terminal 101 based on the result information (S225). Although not shown in the drawings, the service server 103 analyzes result information, selects at least one learning content among various learning contents according to the analysis result, and transmits information about the selected learning contents.

The user terminal 101 confirms the learning contents based on the learning contents information received from the service server 103 (S227), and requests the learning server 107 to provide the learning contents using the learning contents information (S229). At this time, the user terminal 101 may request the learning server 107 to provide the learning contents through the link included in the learning content information.

The learning server 107 confirms a provision request for learning contents received from the user terminal 101 (S231), and provides the requested learning contents to the user terminal 101 (S233).

The user terminal 101 proceeds the learning through the learning contents provided from the learning server 107 (S235).

On the other hand, when the user terminal 101 visits a specific shop in the augmented reality or virtual reality in the state where the service is operated, the user terminal 101 can confirm the benefit information for the specific shop. This benefit information is provided from the service shop server 105 to the service server 103 as shown in step S202. This information may be used when there is a change in information about at least one of the discount, the event and the coupon provided by the service shop server 105 The service shop server 105 can transmit to the service server 103 every time. Although not shown in FIG. 2, when there is a request to provide a benefit from the user terminal 101, the service server 103 may notify the service shop server 105 to provide benefits.

In this case, the user terminal 101 selects a benefit to be provided from the confirmed benefit information (S237), and transmits the benefit selection information to the service server 103 (S239).

The service server 103 confirms the benefit selection information received from the user terminal 101 (S241), and provides the user terminal 101 with the benefit corresponding to the confirmed benefit selection information.

The user terminal 101 downloads and stores the benefits received from the service server 103 (S245). These saved benefits can be for discounts, promotions, coupons, and for stored coupons or discounts when you use the store offline or online.

Steps S237 through S255 for providing benefits may be performed before steps S219 through S235 for providing a learning service, and may be omitted if the user does not select them.

3 is a block diagram illustrating a configuration of a user terminal according to an embodiment of the present invention.

3, the user terminal 101 includes a transmitting / receiving unit 1011, a camera unit 1013, an audio unit 1015, a recognition unit 1017, a driving unit 1019, a generating unit 1021, 1023, a storage unit 1025, and a control unit 1027.

The transmitting and receiving unit 1011 transmits setting information on the driving environment, result information on the service driving, and a request for providing learning contents, and receives service data, learning content information, and learning contents corresponding to the setting information. In addition, all the signals, data, and information transmitted and received from the user terminal 101 are also transmitted and received by the transmitting and receiving unit 1011.

The camera unit 1013 can photograph the surrounding environment and inputs actual image information through photographing. At this time, the actual image information may be input to the generating unit 1019 in real time.

The audio unit 1015 includes a microphone (not shown) and a speaker (not shown). The audio unit 1015 reproduces an audio signal output from the inside of the user terminal 101 through a speaker, The audio signal is input through a microphone.

The recognition unit 1017 recognizes input information for at least one of voice, touch, movement, and gaze input from the user. At this time, the voice can be recognized based on the input through the microphone of the audio unit 1015, and the touch can be recognized based on the touch of the user on the display unit 1017. [ In addition, although not shown in the drawing, various sensors for detecting movement or biometric information of the user may be provided. The recognition unit 1017 recognizes the motion or biometric information of the user sensed through the sensors It is possible.

The driving unit 1019 executes the application and drives the service in either the first mode or the second mode, that is, the augmented reality mode or the virtual reality mode according to the driving environment. At this time, the driving unit 1019 can be executed or driven by recognizing the information input from the audio unit 1015 and the display unit 1023 by the recognition unit 1017. [

The generation unit 1021 generates a 3D image based on the input information recognized by the recognition unit 1017 and the service data received by the transmission / reception unit 1011.

The display unit 1023 displays the 3D image generated by the generation unit 1021.

The storage unit 1025 stores the service data and the pre-learned data. In addition, the storage unit 1025 may store all data, information, and the like received by the user terminal 101, as well as data, information, and the like generated by the user terminal 101.

 The control unit 1027 generates and displays a 3D image by driving a service in either the first mode or the second mode according to the driving environment, recognizes the input information, and generates a virtual image in the 3D image based on the pre- Executes the dialog with the object, generates and transmits the result information about the executed dialog, and controls the learning contents to be executed using the learning content information received in response to the result information.

4 is a flowchart illustrating a language learning method in a user terminal according to an embodiment of the present invention.

The application is executed in the driving unit 1019 and the recognition unit 1017 recognizes the user input information input from the audio unit 1015 and the display unit 1023 to set the position and the driving mode (S403) .

Thereafter, the transmission / reception unit 1011 transmits the setting information to the service server 103 (S405), receives the service data received from the service server 103 in response thereto, downloads the service data, and stores the downloaded service data in the storage unit 1025 (S407).

The driving unit 1019 drives the service in either the first mode or the second mode based on the stored service data (S409).

When the driving unit 1019 is driven in the first mode, that is, in the augmented reality mode, the generation unit 1021 generates a 3D virtual object corresponding to an actual image photographed from the camera unit 1013 and 3D image information included in the service data Thereby generating a 3D image (S411). If the driving unit 1019 is driven in the second mode, that is, in the virtual reality mode, the generating unit 1021 generates a 3D image based on the 3D image information included in the service data (S413).

Thereafter, the recognition unit 1017 checks whether the user input information input from the audio unit 1015 or the display unit 1023 is sensed (S415). For example, when a user's voice is input through the audio unit 1015, conversation proceeds based on previously learned data stored in the storage unit 1025. If there is no more input voice, . That is, steps S411 through S415 may be repeatedly performed.

If the user input information is detected, the 3D image is generated and output according to the detected user input information. If the user input information is not detected, the result information of steps S411 and S413 is generated To the service server 103 (S417). This is because steps S411 through S415 transmit the result information for the repetitive conversation. To this end, the dialog information advanced in steps S411 to S415 may be stored in the storage unit 1025. [

The transmission / reception unit 1011 receives the learning content information from the service server 103 in response to the result information, and the display unit 1023 displays the received learning content information to confirm the user.

Based on this, the user selects whether to connect the learning contents. The recognition unit 1017 recognizes whether the learning contents are connected by the user's selection (S421).

If the recognition unit 107 recognizes that the learning unit does not connect to the learning contents, the process proceeds to step S415. If the recognition unit 1017 recognizes that the learning unit connects to the learning contents, the transmission / To the service server 103 (S423).

Thereafter, the transmitting / receiving unit 1011 receives the learning content from the service server 103 in response thereto, and proceeds the learning through the driving unit 1019 (S425).

Although the present invention has been described with reference to preferred embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It is not intended to limit the scope. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

100: Language learning system 101: User terminal
103: service server 105: service shop server
107: Learning server 1011: Transmitting /
1013: camera unit 1015: audio unit
1017: recognition unit 1019:
1021: Generation unit 1023: Display unit
1025: Storage unit 1027: Control unit

Claims (24)

In a language learning system,
(3D) image by driving a service in either a first mode or a second mode based on service data according to a driving environment, recognizes input information input from a user, A user who executes the learning contents using the learning contents information received in response to the result information, and a user who executes the learning contents using the learning contents information received in response to the result information, Terminal;
A service server for transmitting the service data to the user terminal, analyzing result information received from the user terminal, generating learning content information according to the analysis result, and transmitting the information to the user terminal; And
And a learning server for providing learning contents to the user terminal,
Wherein the driving environment is set by the user.
The method according to claim 1,
Wherein the driving environment includes position information as a background of the 3D image to be generated and displayed,
Wherein the first mode and the second mode are an augmented reality mode and a virtual reality mode, respectively.
The method according to claim 1,
In the 3D image,
And a 3D image of at least one service shop and a distance previously stored according to the location information.
The method of claim 3,
The language learning system includes:
Further comprising at least one service shop server transmitting the benefit information for the at least one service shop periodically or by request to the service server.
5. The method of claim 4,
The service data includes:
Further comprising benefit information for the at least one service store.
5. The method of claim 4,
The benefit information includes:
Discount information, event information, and coupon information.
The method according to claim 1,
The user terminal comprises:
And is connected to the learning server via link information included in the learning content information.
The method according to claim 1,
When executing a dialog between the user and a virtual object in the 3D image,
Wherein the user terminal counts an input time limit for the input information.
The method according to claim 1,
The input information includes:
And information about at least one of a voice, a touch, a movement, and a gaze input from the user.
3. The method of claim 2,
The user terminal comprises:
In the first mode, a 3D image is generated and displayed by combining 3D image information included in the service data with an actual image input through a camera,
And generates and displays a 3D image based on the 3D image information included in the service data when the second mode is selected.
In a language learning method,
The service server receiving configuration information on a driving environment from a user terminal;
Transmitting, by the service server, service data corresponding to the received configuration information to the user terminal;
The service server recognizes the input information input from the user and performs a dialog with a virtual object in a 3D (3-Dimension) image based on the previously learned data to receive the generated result information from the user terminal ; And
Analyzing the received result information, generating learning content information according to the analysis result, and transmitting the generated learning content information to the user terminal,
Wherein the user terminal is configured to generate and display a 3D image by driving a service in either a first mode or a second mode based on the received service data,
Wherein the user terminal requests the learning server to provide learning contents using the received learning content information and receives the requested learning contents,
Wherein the driving environment is set by the user.
12. The method of claim 11,
Wherein the driving environment includes position information as a background of the 3D image to be generated and displayed,
Wherein the first mode and the second mode are an augmented reality mode and a virtual reality mode, respectively.
12. The method of claim 11,
In the 3D image,
And a 3D image of at least one service shop and a distance previously stored according to the location information.
14. The method of claim 13,
The language learning method includes:
The service server
Further comprising receiving benefit information for the at least one service store from at least one service shop server.
15. The method of claim 14,
The service data includes:
And the benefit information for the at least one service shop.
15. The method of claim 14,
The benefit information includes:
Discount information, event information, and coupon information.
12. The method of claim 11,
The learning content information includes:
And link information for the learning contents.
12. The method of claim 11,
When executing a dialog between the user and a virtual object in the 3D image,
Wherein the input limit time for the input information is counted.
12. The method of claim 11,
The input information includes:
And information about at least one of a voice, a touch, a movement, and a gaze input from the user.
13. The method of claim 12,
Wherein the first mode is a mode for generating and displaying a 3D image by synthesizing 3D image information included in the service data to an actual image input through a camera provided in the user terminal,
Wherein the second mode is a 3D image generation and display mode based on the 3D image information included in the service data.
In a language learning apparatus,
A transmitting and receiving unit for transmitting setting information for a driving environment, result information for driving a service, and a providing request for learning contents, and receiving service data, learning content information, and learning contents corresponding to the setting information;
A camera unit for inputting image information through a camera;
An audio unit for reproducing an output audio signal through a speaker and inputting an audio signal from the microphone;
A recognition unit for recognizing input information for at least one of a voice, a touch, a movement, and a line of sight input from a user;
A driving unit for driving a service in one of a first mode and a second mode according to the driving environment;
A generating unit for generating a 3D (3D) image based on the input information and the service data;
A display unit for displaying the generated 3D image;
A storage unit for storing the service data and the pre-learned data; And
And generating and displaying a 3D image by driving a service in either the first mode or the second mode according to the driving environment, recognizing the input information, and recognizing the input information, And a control unit for generating and transmitting result information on the executed conversation and controlling execution of the learning content using the learning content information received in response to the result information,
Wherein the driving environment is set by the user.
22. The method of claim 21,
The language learning apparatus comprising:
When executing a dialog between the user and a virtual object in the 3D image,
Further comprising a timer for counting an input time limit for the input information.
22. The method of claim 21,
Wherein the driving environment includes position information as a background of the 3D image to be generated and displayed,
Wherein the first mode and the second mode are an augmented reality mode and a virtual reality mode, respectively.
24. The method of claim 23,
Wherein the generation unit comprises:
And generating 3D image by synthesizing 3D image information included in the service data with an actual image input through the camera unit in the first mode,
And generates a 3D image based on the 3D image information included in the service data when the second mode is selected.

Images