WO2020055027A1

WO2020055027A1 - Language learning apparatus

Info

Publication number: WO2020055027A1
Application number: PCT/KR2019/011359
Authority: WO
Inventors: 전영숙
Original assignee: 전영숙
Priority date: 2018-09-14
Filing date: 2019-09-04
Publication date: 2020-03-19
Also published as: KR102088047B1

Abstract

A language learning apparatus according to an embodiment of the present invention comprises: a character module for, with regard to learning contents including one or more characters and lines of the characters, generating one or more fictitious characters to be in charge of one or more lines among the lines, and grouping lines, which have been distributed to the same character in the learning contents, into a line group; and a role play module for executing the learning contents, muting the sound at a section of lines that the character is in charge of in the learning contents, and displaying unit subtitles corresponding to the lines, on a screen.

Description

Language learning device

An embodiment of the present invention relates to a language learning device.

In general, in learning a language, constant iterative learning is important. In order to maintain consistent repetitive learning, it is necessary for the learner to be interested in learning the language. Accordingly, a role-playing language learning method is proposed in which a learner takes on the role of a character in a content such as a movie or a drama, and follows the dialogue. However, in general, a learning device designed to use a role-playing language learning method has already defined roles and roles assigned by the roles. Because the language proficiency is different for each learner, the amount of dialogue or composition words that are assigned to random roles is different. Since the learner does not continue learning if it is too easy or difficult than his / her own learning ability, a learning method is required to implement a role play suitable for each learner's learning ability.

An object of the present invention is to provide a language learning device that implements a role play suitable for each learner's learning ability.

The language learning apparatus according to an embodiment of the present invention generates one or more virtual characters for one or more dialogues among the dialogues with respect to learning content including one or more characters and dialogues of the characters, and In the learning content, a character module for grouping dialogues distributed to the same character into a dialogue group and executing the learning contents, muting in the dialogue section of the character in charge of the character in the learning contents, and subunit corresponding to the dialogue It includes a role play module displayed on the screen.

The role play module receives the voice corresponding to the learner's dialogue in the muted dialogue section, compares the waveform of the learner's voice with the waveform of the original speech of the dialogue section, and compares it to the muted dialogue section. The learner's metabolic accuracy can be calculated.

The role play module determines that if the learner's metabolic accuracy is greater than or equal to a preset value, it is determined that the metabolic implementation of the muted metabolic part has passed, and the learner is based on the number of times that the metabolic part has been passed as compared to the number of attempts. It can calculate the metabolic digestion rate.

The role play module sets the character difficulty of the corresponding character based on the dialogues included in the dialogue group corresponding to the character, and the learner's level among the one or more characters based on the learner's dialogue digestibility and the character difficulty You can recommend a character that fits.

The role play module sets the subtitle difficulty for the unit subtitle based on the length of the unit subtitles of the dialogues included in the dialogue group and the difficulty of the words included in the unit subtitles, and sets the character difficulty based on the subtitle difficulty. Can be set.

The role-playing module may re-execute the learning content from the beginning of the dialogue section when the dialogue accuracy is less than or equal to a preset value.

The language learning apparatus may further include a practice module that receives the learner's voice, converts the learner's voice to text using STT (speech to text) technology, and displays the converted text on the screen. have.

A language learning method according to an embodiment of the present invention is a method performed in a computing device having one or more processors, and a memory storing one or more programs executed by the one or more processors, wherein one or more characters and Generating one or more virtual characters for managing one or more of the dialogues for the learning contents including the dialogue of the character, and grouping the dialogues distributed to the same character in the learning contents into a dialogue group And executing the learning content and muting in a part of the dialogue part in charge of the character in the learning content, and displaying a unit subtitle corresponding to the dialogue on the screen.

When explaining the effect of the language learning apparatus according to the present invention are as follows.

By using a variety of content that learners can easily obtain in their lives, learners can create role plays themselves to implement role plays that fit their level.

Specifically, according to the disclosed embodiment, a learner generates a character performing dialogue in a language desired to learn on a learning content by himself, so that the character is responsible for one or more of a plurality of dialogues included in the learning content. By setting, it is possible to implement a role play suitable for the learner's own learning ability.

1 is a view showing a language learning system using a language learning apparatus according to an embodiment of the present invention

2 is a view showing that a language learning apparatus according to an embodiment of the present invention operates

3 is a block diagram illustrating a language learning apparatus according to an embodiment of the present invention

4 is a diagram for explaining that the character module of the language learning apparatus manages the dialogue of characters according to an embodiment of the present invention

5 is a view for explaining that the role play module of the language learning apparatus according to an embodiment of the present invention calculates the accuracy of the learner's voice

6 is a flowchart illustrating a language learning method according to an embodiment of the present invention

7 is a block diagram illustrating and illustrating a computing environment including a computing device suitable for use in example embodiments.

The following detailed description is provided to aid in a comprehensive understanding of the methods, apparatus and systems described herein. However, this is only an example and the present invention is not limited thereto.

In the following description, when it is determined that the detailed description of the known technology related to the present invention may obscure the subject matter of the present invention, the detailed description will be omitted. In addition, terms to be described later are terms defined in consideration of functions in the present invention, which may vary according to a user's or operator's intention or practice. Therefore, the definition should be made based on the contents throughout this specification. The terminology used in the detailed description is only for describing embodiments of the present invention and should not be limiting. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this description, expressions such as “comprising” or “equipment” are intended to indicate certain characteristics, numbers, steps, actions, elements, parts or combinations thereof, and one or more other than described. It should not be interpreted to exclude the presence or possibility of other characteristics, numbers, steps, actions, elements, or parts or combinations thereof.

In the following description, the suffixes "module" and "part" for the components used in the description are given or mixed only in consideration of the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves. .

In the following description, the terms “transmission”, “communication”, “transmission”, “reception” and the like of the signal or information are not only those in which a signal or information is transmitted directly from one component to another. This includes passing through other components. In particular, "transmitting" or "transmitting" a signal or information to a component indicates the final destination of the signal or information, not a direct destination. The same is true for the "reception" of a signal or information. Also, in this specification, when two or more pieces of data or information are “related” means that acquiring one piece of data (or information) can acquire at least part of the other piece of data (or information) based on it.

Further, terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms may be used for the purpose of distinguishing one component from other components. For example, the first component may be referred to as a second component without departing from the scope of the present invention, and similarly, the second component may also be referred to as a first component.

Hereinafter, specific embodiments of the present invention will be described in detail with reference to the drawings. Regardless of reference numerals, identical or similar elements are assigned the same reference numerals, and redundant description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed in the specification is not limited by the accompanying drawings, and all modifications included in the spirit and technical scope of the present invention , It should be understood to include equivalents or substitutes.

1 is a diagram illustrating a language learning system using a language learning apparatus according to an embodiment of the present invention.

Referring to FIG. 1, the language learning system 100 may include a language learning device 101 and a content providing server 102.

The language learning device 101 may be connected to one or more content providing servers 102 to enable communication through a communication network.

In some embodiments, the communication network includes the Internet, one or more local area networks, wire area networks, cellular networks, mobile networks, other types of networks, or combinations of these networks. can do.

The language learning device 101 may be an electronic device such as a smartphone, a personal computer (PC), or a tablet PC (tablet PC). The language learning apparatus 101 may receive content selected by a learner among a plurality of content provided by the content providing server 102. The language learning apparatus 101 may use the received content to generate a role play provided to learners for language learning.

The language learning apparatus 101 may generate a role play by setting the learner's role and the dialogue's dialogue for the learner's language learning for each of the roles included in the content and the role. The language learning apparatus 101 may provide a role play to the learner, so that the learner can learn the language suitable for his / her own level. A detailed description of the operation of the language learning apparatus 101 will be described later with reference to FIG. 2.

In addition, the language learning device 101 is a function of repeating a section capable of repeatedly learning a certain section of dialogue, a function of dictation to listen to the dialogue and input a text phrase, and to adjust the playback speed in playing learning content Speed control, and the like. However, the function of repeating the section, the function of the dictation, the function of speed adjustment, etc. are also possible in a general role-playing apparatus, and a detailed description thereof is omitted because it may obscure the subject matter of the present invention.

The content providing server 102 may be a portal server that includes and provides content such as YouTube, Naver, and the like. Further, the content providing server 102 may be a server formed to implement the present invention.

The content providing server 102 may provide the content held by the content providing server 102 to the language learning device 101 according to a learner's selection using the language learning device 101. Here, the content may be video content including one or more characters and dialogues of characters (a foreign language that a learner wants to learn).

2 is a diagram illustrating that a language learning apparatus according to an embodiment of the present invention operates, and FIG. 3 is a block diagram illustrating a language learning apparatus according to an embodiment of the present invention.

2 and 3, the language learning apparatus 101 may include an image registration module 110, a character module 120, a role play module 130, and a practice module 140.

In this specification, a module may mean a functional and structural combination of hardware for performing the technical idea of the present invention and software for driving the hardware. For example, the "module" may mean a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and does not necessarily mean a physically connected code or a type of hardware. .

The image registration module 110 may receive an image and a subtitle of the corresponding content, and store the image and the subtitles together as one of the learning contents selected by the learner among the one or more contents provided by the content providing server 102. . The learning content may be stored in the storage memory of the language learning device 101, but is not limited thereto, and the language learning device 101 includes a communication module, a cloud service outside the language learning device 101, and the like. It may be stored through.

In addition, the image registration module 110 may store images and subtitles of contents together as learning contents for contents that the learner directly inputs into the language learning apparatus 101.

* When the content selected or input by the learner includes only an image without subtitles, the image registration module 110 may store only the corresponding image. Subsequently, when the subtitle corresponding to the corresponding image is received, the image registration module 110 may store the corresponding image and the subtitle as learning content. When a subtitle corresponding to an image is received, the learner may find and receive it through a server that provides subtitles, or there may be a case where the learner directly receives the subtitle.

The character module 120 may generate an arbitrary virtual character for distributing the learner's dialogue to the learning content. That is, the character may be virtually generated by the learner to take part in some dialogue among all the dialogues of the characters in the content.

One or more casts may appear in the learning content. Depending on the learner's intention, the character may be set to be in charge of all the lines of one role appearing in the corresponding learning content. In addition, the character may be set to be in charge of all of the lines of the multiple roles appearing in the learning content. In addition, the character may be set so that a plurality of characters divide and take charge of the dialogue of one role appearing in the corresponding learning content. Without being limited to this, the character may be set to collect and handle some of the lines from each of the multiple roles. That is, the character module 120 may match one or more characters with respect to dialogues of characters (cast characters) included in the learning content.

The character module 120 is a set of dialogues (hereinafter, dialogue group (B)) assigned by a character generated by collecting dialogues (X) selected by a learner among a plurality of short dialogues (X) included in subtitles of learning content ). Details of the character module 120 generating a character and assigning a dialogue to the generated character will be described later with reference to FIG. 4.

The role play module 130 may include an audio output device and an image output device. The audio output device may be, for example, a speaker or an earphone terminal, and the image output device may be, for example, a display provided on the front surface of the language learning device 101. The role play module 130 may aurally and visually output an image of the learning content. The role-playing module 130, when it is the turn of the dialogue assigned to an arbitrary character, outputs the subtitle (hereinafter, a unit subtitle) of the dialogue with the image through the image output device, and simultaneously stops outputting the sound of the image You can.

At this time, the learner can speak the foreign language to learn the corresponding dialogue by looking at the subtitles on the muted image in the case of the order of dialogue of characters to learn.

The role play module 130 may stop the output of the subtitles and restart the sound output of the video when a predetermined time elapses so that the dialogue is exposed. That is, the role play module 130 may stop the output of the subtitles and output the sound of the video again when the dialogue in which the character is assigned in the corresponding learning content passes. Subsequently, in the dialogue to which the character is assigned, as described above, the subtitle of the corresponding dialogue may be output and the sound of the video may not be output.

The role play module 130 may include a voice input device. The voice input device may be, for example, a microphone. The role play module 130 may determine how accurately the learner's voice input through the voice input device embodies the dialogue and accuracy. A detailed description thereof will be described later with reference to FIG. 5.

The role-playing module 130 may determine whether the passage of the dialogue is passed based on a preset accuracy in reproducing an arbitrary dialogue. Specifically, when the accuracy of the learner's voice is less than a preset value, the role-playing module 130 may replay the image from the start time of the corresponding dialogue and receive the learner's voice again. The role play module 130 may repeat the process of replaying the image from the start time of the corresponding dialogue and receiving the learner's voice again until the accuracy of the learner's voice exceeds a predetermined value. In addition, when the number of times of repeating the process of replaying the image and re-entering the voice becomes equal to or greater than a preset number, the role play module 130 may continuously play the remaining image regardless of the accuracy of the learner's voice.

For example, the role play module 130 may be set such that the learner performs the dialogue group B of the character b (b). The role play module 130 removes the sound of the video and the phrase of the second dialogue X2 (hereinafter referred to as the second unit subtitle) during the time during which the second dialogue X2 among the dialogue groups of the character b (b) should be performed. D2)) can be superimposed and output. At the same time, the role play module 130 may receive a voice of a learner implementing the second dialogue X2 through a microphone.

When the learner implements the second dialogue X2 with an accuracy of 80% or more, the role-playing module 130 may continue to reproduce the next image. When the learner implements the second dialogue (X2) with an accuracy of less than 80%, the role-playing module 130 mutes and plays the image again from the start time of the second dialogue (X2), and the second unit subtitle (D2) Can be overlaid with the video.

In addition, the role-playing module 130 may calculate the metabolic digestibility based on the number of times the learner attempts to metabolize and passes the metabolism. In addition, the role play module 130 may set the difficulty (hereinafter, the character difficulty) to characters generated by the learner according to a preset criterion.

Specifically, the role play module 130 may set the difficulty (hereinafter, subtitle difficulty) for each of the plurality of subtitles (X) included in the dialogue group B (B) of the character b (b). The role play module 130 may set the subtitle difficulty based on the length of the unit subtitle D and the difficulty ratio of words for each subtitle X. In order to set the subtitle difficulty level, a dictionary in which words are classified for each difficulty level may be stored in the role play module 130. The role play module 130 may set the character difficulty of the corresponding character b (b) by averaging the difficulty of the subtitles of a plurality of subtitles (X) belonging to the dialogue group B (B).

The role play module 130 may recommend one or more characters of the characters generated by the character module 120 to the learner based on the metabolic digestibility of the learner.

For example, the role play module 130 may set the character difficulty level of the character a (a) to first level, and the character difficulty level 1 character a (a) may recommend or request a metabolic digestibility of 50% or more. In addition, the role play module 130 may set the character difficulty level of the character b (b) to level 2, and the character difficulty level 2 character b (b) may recommend or request a metabolic digestibility of 60% or more.

The role play module 130 may be set to request a metabolic digestibility of a predetermined value or more according to the character difficulty. The role-playing module 130, when a learner with a 55% metabolic digestion rate attempts to metabolize the character b (b), the current learner's metabolic digestion rate (55%) with the metabolic digestibility (60%) required by the character b (b). You can generate a notification that you are out of reach.

In addition, the role play module 130 may preferentially notify the user of a character whose learner's metabolic digestion rate is greater than or equal to that required by the character. The role play module 130 may generate a notification that preferentially recommends the character b (b) to a learner who is trying to perform the role play when the learner's metabolic digestion rate is 62%.

The practice module 140 analyzes the waveform of the learner's voice using speech to text (STT) technology, and converts the pronunciation of the learner into text. STT technology is a known technology, so a detailed description thereof will be omitted. The exercise module 140 may output characters on the image output by the learner on the image output device so that the learner can confirm that they have pronounced.

4 is a view for explaining that the character module of the language learning apparatus according to an embodiment of the present invention manages the dialogue of the character.

Referring to FIG. 4, the character module 120 generates random characters (a and b) to be responsible for dialogues in the learning content, and among a plurality of short dialogues (X) included in the subtitles of the learning content, the learner The character created by collecting selected dialogue lines (X) can be set as a set of assigned dialogue lines (hereinafter, a dialogue group (B)).

The learning content may include dialogues such as the first dialogue (X1) to the nth dialogue. Each dialogue may include a dialogue start time (S), a dialogue end time (F), and a unit caption (D). The metabolism start time S may be a time when the metabolism starts to be exposed on the image output device. The metabolic end time F may be a time for stopping the exposure of the metabolism on the image output device. The unit caption D may be a phrase of the caption displayed on the image output device.

The character generation module 120 may generate characters such as characters a (a) and characters b (b). (An example of generating multiple characters has been given, but only one character may be created.) The character creation module 120 can designate characters (a and b, etc.) for each of a plurality of lines (X1 to X7, etc.). have. For example, the character generation module 120 may designate the character a (a) for the first dialogue X1 and the character b (b) for the second dialogue X2 to the seventh dialogue X7. . The character generation module 120 may collect the second dialogue X2 to the seventh dialogue X7 and designate them as a dialogue group B (B) which is a set of dialogues X in charge of the character b (b).

5 is a view for explaining that the role play module of the language learning apparatus according to an embodiment of the present invention calculates the accuracy of the learner's voice.

Referring to FIG. 5, the role play module 130 may determine how accurately the learner's voice input through the voice input device embodies the dialogue and accuracy. The role-playing module 130 compares the waveform of the input learner's voice with the waveform of the original voice of the muted image to determine how accurately the learner implemented the dialogue in the corresponding foreign language.

The role play module 130 may compare the waveform of the input learner's voice with the sound waveform of a section corresponding to the second dialogue X2 in the image. The role play module 130 may determine how accurately the learner accurately implements the second dialogue X2 by comparing the waveform of the learner's voice with the sound waveform of the original image.

In the general role-playing language learning apparatus, the roles and the dialogues assigned by the roles are already determined. However, because the language proficiency is different for each learner, the learners may feel that it is too easy or difficult for the role-play that has already been created and provided, and thus may not continue learning.

However, the language learning apparatus 101 of the present invention can directly create a role play by the learner, thereby implementing a role play suitable for their level, and accordingly, the learner can continue learning the language.

6 is a flowchart illustrating a language learning method according to an embodiment of the present invention.

Referring to FIG. 6, the method may include generating a virtual character (S101), generating a large group for each character (S201), executing learning content (S301), and muting (S401). have.

First, the language learning apparatus 101 may generate one or more virtual characters for taking charge of one or more of the dialogues with respect to the learning content including one or more characters and the dialogues of the characters (S101). Next, the language learning apparatus 101 may group the dialogues distributed to the same character into a dialogue group (S201). Next, the language learning apparatus 101 may execute learning content (S301). Next, the language learning apparatus 101 may mute the dialogue section in which the character is in charge (S401).

7 is a block diagram illustrating and illustrating a computing environment 10 including a computing device suitable for use in example embodiments.

In the illustrated embodiment, each component may have different functions and capabilities in addition to those described below, and may include additional components in addition to those described below.

The illustrated computing environment 10 includes a computing device 12. In one embodiment, the computing device 12 may be a language learning device (eg, a language learning device 101).

The computing device 12 includes at least one processor 14, a computer readable storage medium 16 and a communication bus 18. The processor 14 can cause the computing device 12 to operate in accordance with the exemplary embodiment mentioned above. For example, processor 14 may execute one or more programs stored on computer readable storage medium 16. The one or more programs may include one or more computer-executable instructions, and the computer-executable instructions, when executed by the processor 14, configure the computing device 12 to perform operations according to an exemplary embodiment. Can be.

Computer readable storage medium 16 is configured to store computer executable instructions or program code, program data and / or other suitable types of information. The program 20 stored on the computer readable storage medium 16 includes a set of instructions executable by the processor 14. In one embodiment, the computer-readable storage medium 16 is a memory (volatile memory such as random access memory, non-volatile memory, or a suitable combination thereof), one or more magnetic disk storage devices, optical disk storage devices, flash Memory devices, other types of storage media that can be accessed by the computing device 12 and store desired information, or any suitable combination thereof.

The communication bus 18 interconnects various other components of the computing device 12, including a processor 14 and a computer readable storage medium 16.

Computing device 12 may also include one or more I / O interfaces 22 and one or more network communication interfaces 26 that provide an interface for one or more I / O devices 24. The input / output interface 22 and the network communication interface 26 are connected to the communication bus 18. The input / output device 24 may be connected to other components of the computing device 12 through the input / output interface 22. Exemplary input / output devices 24 include pointing devices (such as a mouse or trackpad), keyboards, touch input devices (such as touch pads or touch screens), voice or sound input devices, various types of sensor devices, and / or imaging devices. Input devices, and / or output devices such as display devices, printers, speakers, and / or network cards. The exemplary input / output device 24 is a component constituting the computing device 12 and may be included in the computing device 12 or connected to the computing device 12 as a separate device distinct from the computing device 12. It might be.

The above detailed description should not be construed as limiting in all respects, but should be considered illustrative. In addition, it will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit and essential features of the present invention. Therefore, the scope of rights of the present invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

Claims

For one or more characters and learning content including the dialogue of the character, one or more virtual characters for playing one or more dialogues among the dialogues are generated, and the dialogues distributed to the same character in the learning contents are dialogue groups Character modules grouped into; And

And a role-playing module that executes the learning content and mutes the part of the dialogue in charge of the character in the learning content.
The method according to claim 1,

The role play module,

A language learning device that displays a unit subtitle corresponding to the dialogue on a screen and receives a voice corresponding to the dialogue of the learner in the muted dialogue section.
The method according to claim 2,

The role play module,

A language learning apparatus for comparing the waveform of the learner's voice with the waveform of the original speech of the dialogue part, and calculating the learner's dialogue accuracy with respect to the muted dialogue section.
The method according to claim 3,

The role play module,

If the learner's metabolic accuracy is greater than or equal to a predetermined value, it is determined that the metabolic implementation of the muted metabolic portion has passed, and the metabolic digestibility of the learner is based on the number of times the attempted metabolic portion has passed the metabolic implementation. A language learning device that calculates.
The method according to claim 4,

The role play module,

Set a character difficulty level of the corresponding character based on the dialogue lines included in the dialogue group corresponding to the character, and select a character that matches the learner's level among the one or more characters based on the learner's metabolic rate and the character difficulty level. Recommended, language learning device.
The method according to claim 5,

The role play module,

A language for setting a subtitle difficulty level for the unit subtitle based on the length of the unit subtitles of the dialogue lines included in the dialogue group and the difficulty level of words included in the unit subtitles, and setting the character difficulty level based on the subtitle difficulty level. Learning device.
The method according to claim 3,

The role play module,

When the metabolic accuracy is less than or equal to a preset value, the language learning apparatus to execute the learning content again from the beginning of the metabolic partial section.
The method according to claim 1,

The language learning device,

A language learning apparatus further comprising an exercise module that receives the learner's voice, converts the learner's voice to text using a speech to text (STT) technique, and displays the converted text on the screen.
One or more processors, and

A method performed in a computing device having a memory for storing one or more programs executed by the one or more processors,

Generating one or more virtual characters for in charge of one or more of the dialogues with respect to one or more characters and learning content including the dialogues of the characters;

Grouping dialogues distributed to the same character in the learning content into dialogue groups;

Executing the learning content; And

And muting in a part of the dialogue part in charge of the character in the learning content.