KR102235789B1 - Apparatus and method for foreign language tutoring using lecturing contents - Google Patents

Abstract

A foreign language teaching method using lecture content according to an embodiment of the present disclosure comprises the steps of: outputting, through a display device, lecture content including a plurality of subtitles and audio and video data related to the subtitles received from a database, in response to an input of an instructor; playing the audio corresponding to a playback section of a video for each sentence or word, in response to the input of the instructor received through a playback setting interface; displaying a first interface for learning words related to the lecture content through the display device, in response to the input of the instructor; displaying a second interface for reading comprehension learning related to the lecture content through the display device, in response to the input of the instructor; and displaying a third interface for learning conversation related to the lecture content through the display device, in response to the input of the instructor.

Description

A foreign language teaching method using lecture contents and a device therefor {APPARATUS AND METHOD FOR FOREIGN LANGUAGE TUTORING USING LECTURING CONTENTS}

The present disclosure relates to a foreign language teaching method using lecture contents and an apparatus therefor, and more particularly, to a foreign language teaching method capable of providing active conversation, reading comprehension, and vocabulary learning using lecture contents, and an apparatus therefor. .

In general, foreign language learning methods can be divided into offline education through academy or visit, or online education that can be learned using information and communication technology (ICT) such as e-learning. Offline education for learning a foreign language is not a method of self-learning by learners, but a one-sided infusion-type learning method by an educator.It is not effective for foreign language learning that requires education to learn naturally in the mouth and body through repetitive learning. not.

In recent years, with the development of information and communication technology, various types of online foreign language learning programs that can solve the problems of offline foreign language learning education have been developed. In the case of conventional online foreign language learning programs, there is a problem that learning efficiency is degraded by individually learning foreign language reading, listening, speaking, and reading comprehension, and there is a limitation in inducing interest and voluntary participation of learners who watch online foreign language learning contents. have.

Embodiments disclosed in the present specification provide a foreign language teaching method using lecture contents and an apparatus therefor that can provide active conversation, reading comprehension, and word learning using lecture contents.

A foreign language teaching method using lecture content according to an embodiment of the present disclosure outputs a plurality of subtitles received from a database and lecture contents including audio and video data related to the subtitles through a display device in response to an input from a lecturer. In response to the instructor's input received through the playback setting interface, playing the audio corresponding to the playback section of the video for each sentence or word, in response to the instructor's input, the instruction for learning words related to the lecture content 1 Displaying an interface through a display device, in response to an input from the instructor, displaying a second interface for reading comprehension learning associated with the lecture content through the display device, and a conversation associated with the lecture content in response to an input from the instructor And displaying a third interface for learning through the display device.

According to an embodiment, the displaying of the third interface for learning conversation through the display device includes: outputting an audio or video related to a playback section of an image, in response to an input from an instructor received through the third interface. , Displaying a subtitle including the structure of a sentence based on a word or phrase, in response to an input from the instructor received through the third interface, a title directly translated according to the word order of the foreign language subtitle and the foreign language subtitle related to the video playback section And displaying a translated subtitle and displaying a grammar associated with a sentence included in the subtitle corresponding to the reproduction section of the video.

According to an embodiment, the subtitle includes at least one of a foreign language subtitle associated with a reproduction section of an image, a direct translation subtitle translated according to a word order of the foreign language subtitle, and a subtitle paraphrasing the foreign language subtitle according to a Korean word order.

According to an embodiment, the displaying of the third interface for conversational learning through the display device includes, in response to an input from an instructor received through the toggle interface, related to a playback section of the video while the audio or video is being played. The method further includes selectively displaying at least one of a paragraph, a sentence, and a word included in the subtitle on the display device.

According to an embodiment, the displaying of the third interface for learning conversation through the display device includes outputting an audio or video associated with a playback section, and outputting a foreign language associated with the playback section of the video while the audio or video is being output. And outputting, through the display device, the subtitles in which the subtitles and foreign language subtitles are paraphrased according to Korean word order.

According to an embodiment, the displaying of the second interface for reading comprehension learning through the display device includes: outputting an audio or video related to a reproduction section of an image, in response to an input from an instructor received through the second interface. , Displaying a subtitle including a structure of a sentence based on a word or phrase, in response to an input from the instructor received through the second interface, a title directly translated according to the word order of the foreign language subtitle and the foreign language subtitle associated with the video playback section And displaying a translated subtitle and displaying a grammar associated with a sentence included in the subtitle corresponding to the reproduction section of the video.

According to an embodiment, the displaying of the second interface for reading comprehension learning through the display device includes, in response to an input from an instructor received through the toggle interface, a sentence or word included in a subtitle corresponding to a reproduction section of the video. The method further includes outputting at least one of the plurality of problems associated with the display device.

According to an embodiment, the displaying of the first interface for word learning through the display device includes: outputting an audio associated with a word included in a subtitle, in response to an input from an instructor received through the first interface, Outputting at least one of an image, an example sentence, and a meaning associated with the word to a display device, and selectively displaying at least one of an image, example sentence, and meaning associated with the word on the display device in response to an input from the instructor received through the toggle interface. It includes the step of.

A computer program stored in a computer-readable recording medium is provided in order to execute a foreign language teaching method using the above-described lecture content according to an embodiment of the present disclosure on a computer.

According to an embodiment of the present disclosure, an apparatus for providing a foreign language teaching service using lecture contents includes at least one memory and at least one processor for storing lecture contents including audio and video data related to a plurality of subtitles and subtitles. And, the at least one processor outputs the lecture content through the display device, and in response to an input from the instructor received through the playback setting interface, outputs audio corresponding to the playback section of the video included in the lecture content for each sentence or word. Reproducing, in response to the input of the instructor, display a first interface for learning words associated with the lecture content through the display device, and in response to the input of the instructor, display a second interface for learning reading comprehension associated with the lecture content And a third interface for conversational learning related to the lecture content is displayed through the display device in response to an input from the instructor.

According to various embodiments of the present disclosure, by learning words related to a playback section of an image in the order of concept, repetition, word order, speed reading, and actual practice, students can learn through repetitive learning rather than a one-sided injection learning method by an educator. It can provide an active vocabulary learning method that can induce the body to learn and learn naturally.

According to various embodiments of the present disclosure, by learning conversation about a reproduction section of an image in the order of concept, repetition, word order, speed reading, and actual practice, it is not a one-sided injection learning method by an educator, but through repetitive learning. It can provide an active conversational learning method that can induce you to learn by naturally acquiring your body.

According to various embodiments of the present disclosure, reading comprehension learning for a reproduction section of an image is learned in the order of concept, repetition, word order, summary, and actual practice, so that it is not a one-sided injection learning method by an educator, but through repetitive learning. It can provide an active reading comprehension learning method that can induce the body to learn naturally.

The effects of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

Embodiments of the present disclosure will be described with reference to the accompanying drawings described below, in which like reference numerals denote like elements, but are not limited thereto.
1 is a schematic block diagram of an apparatus for creating and editing content for a foreign language lecture through a user interface according to an embodiment of the present disclosure.
2 is an exemplary diagram illustrating a screen of a user interface for receiving a content setting according to an embodiment of the present disclosure.
3 is an exemplary view showing a screen of a user interface for controlling a lecture according to an embodiment of the present disclosure.
4 is an exemplary diagram illustrating a screen of a user interface for setting a problem related to a caption included in an image according to an embodiment of the present disclosure.
5 is an exemplary diagram illustrating a process of synchronizing subtitles and audio for each sentence according to an embodiment of the present disclosure.
6 is an exemplary diagram illustrating a process of synchronizing a caption and audio for each word according to an embodiment of the present disclosure.
7 is a flowchart of a method of creating and editing content for a foreign language lecture according to an embodiment of the present disclosure.
8 is a schematic diagram illustrating an environment for providing a foreign language teaching service using lecture content according to an embodiment of the present disclosure.
9 is a schematic block diagram of an apparatus for providing a foreign language teaching service using lecture content according to an embodiment of the present disclosure.
10 is a diagram illustrating an example of content for a foreign language lecture generated through a content creation and editing apparatus for a foreign language lecture according to an embodiment of the present disclosure.
11A is a diagram illustrating an example of displayed word content in response to a user input from a user according to an embodiment of the present disclosure.
11B is a diagram illustrating an example of a user interface screen for providing a reading summary function according to an embodiment of the present disclosure.
12 is a diagram illustrating an example of a user interface screen for repetitive conversational learning according to an embodiment of the present disclosure.
13 is a diagram illustrating an example of a caption of a displayed image in response to a user input from a user according to an embodiment of the present disclosure.
14 is a diagram illustrating an example of a user interface screen for learning conversational speed reading according to an embodiment of the present disclosure.
15 is a diagram illustrating an example of a user interface screen for learning conversation practice according to an embodiment of the present disclosure.
16 is a diagram illustrating an example of a user interface screen for actual reading comprehension learning according to an embodiment of the present disclosure.
17 is a diagram illustrating an example of a user interface screen for word learning according to an embodiment of the present disclosure.
18 is a flowchart of a foreign language teaching method using lecture content according to an embodiment of the present disclosure.

Hereinafter, with reference to the accompanying drawings, specific details for the implementation of the present disclosure will be described in detail. However, in the following description, when there is a possibility that the subject matter of the present disclosure may be unnecessarily obscure, detailed descriptions of widely known functions or configurations will be omitted.

In the accompanying drawings, the same or corresponding elements are denoted with the same reference numerals. In addition, in the description of the following embodiments, overlapping descriptions of the same or corresponding components may be omitted. However, even if description of a component is omitted, it is not intended that such component is not included in any embodiment.

Advantages and features of the disclosed embodiments, and a method of achieving them will become apparent with reference to the embodiments described below together with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms, and only the present embodiments make the present disclosure complete, and the present disclosure provides the scope of the invention to those of ordinary skill in the art. It is provided only to inform you completely.

The terms used in the present specification will be briefly described, and the disclosed embodiments will be described in detail. Terms used in the present specification have selected general terms that are currently widely used as possible while considering functions in the present disclosure, but this may vary according to the intention or precedent of a technician engaged in a related field, the emergence of new technologies, and the like. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present disclosure should be defined based on the meaning of the term and the contents of the present disclosure, not the name of a simple term.

In the present specification, expressions in the singular include plural expressions unless the context clearly specifies that they are in the singular. In addition, plural expressions include expressions in the singular, unless the context clearly specifies that they are plural. When a part of the specification is said to include a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

In addition, the terms "module" or "unit" used in the specification mean software or hardware components, and "module" or "unit" performs certain roles. However,'module' or'unit' is not meant to be limited to software or hardware. The'module' or'unit' may be configured to be in an addressable storage medium, or may be configured to reproduce one or more processors. Thus, as an example,'module' or'unit' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, and properties. , Procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, or variables. Components and functions provided within the'module' or'unit' may be combined into a smaller number of components and'module' or'unit', or additional components and'module' or'unit'. Can be further separated.

According to an embodiment of the present disclosure, a'module' or'unit' may be implemented with a processor and a memory. 'Processor' should be interpreted broadly to include general purpose processors, central processing units (CPUs), microprocessors, digital signal processors (DSPs), controllers, microcontrollers, state machines, etc. In some circumstances, a'processor' may refer to an application specific semiconductor (ASIC), programmable logic device (PLD), field programmable gate array (FPGA), and the like. 'Processor' refers to a combination of processing devices such as, for example, a combination of a DSP and a microprocessor, a combination of a plurality of microprocessors, a combination of one or more microprocessors in combination with a DSP core, or any other such combination of configurations. You may. In addition, the'memory' should be broadly interpreted to include any electronic component capable of storing electronic information. 'Memory' refers to random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erase-programmable read-only memory (EPROM), It may refer to various types of processor-readable media such as electrically erasable PROM (EEPROM), flash memory, magnetic or optical data storage, registers, and the like. The memory is said to be in electronic communication with the processor if the processor can read information from and/or write information to the memory. The memory integrated in the processor is in electronic communication with the processor.

In the present specification, the description of'A and/or B'means'A', or'B', or'A and B'.

1 is a schematic block diagram of an apparatus 100 for creating and editing content for a foreign language lecture through a user interface 120 according to an embodiment of the present disclosure. The foreign language lecture content creation and editing apparatus 100 includes a communication unit 110 to enable communication with other devices, and may be any device capable of storing at least one of one or more images. For example, the device 100 for creating and editing foreign language lecture content includes a smart phone, a mobile phone, a computer, a notebook, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet PC, It may include a wearable device, an internet of things (IoT) device, a virtual reality (VR) device, an augmented reality (AR) device, and the like.

The foreign language lecture content creation and editing apparatus 100 may provide a foreign language lecture content creation and editing service to a user through a dedicated application installed in the foreign language lecture content creation and editing apparatus 100 or a web browser. Here, the user may be a teacher, such as a teacher or an instructor, who wants to create content for a foreign language lecture.

The foreign language lecture content creation and editing apparatus 100 may include a communication unit 110, a user interface 120, a storage unit 130, a display unit 140, and a control unit 150, as shown in FIG. 1. have. Here, the control unit 150 may include a content setting unit 152, a lecture control unit 154, and a subtitle sync control unit 156. According to an embodiment, the control unit 150 may include at least one processor and a memory.

The communication unit 110 may be configured to enable the foreign language lecture content creation and editing apparatus 100 to transmit and receive arbitrary information or data with an external device (eg, a web server) through a network. The control unit 150 may be configured to receive and process arbitrary information through the communication unit 110. The storage unit 130 may be configured to store information/data received from an external device and to store information generated by the control unit 150.

According to an embodiment, the communication unit 110 communicates with at least one of a plurality of external devices to provide a plurality of subtitles, an image including audio and video data related to the subtitles (for example, foreign language audio data such as movies, dramas, news, etc.). An image in which is included) may be received, and the received image may be provided to the controller 150. Depending on the installation environment, for example, the communication unit 110 is a wired network such as Ethernet, a wired home network (Power Line Communication), a telephone line communication device, and RS-serial communication, or a wireless LAN (WLAN), Bluetooth and Zigbee ( ZigBee) can be variously selected and configured as a wireless network.

According to another embodiment, the storage unit 130 of the apparatus 100 for generating and editing foreign language lecture content may store a plurality of subtitles received from the communication unit 110 and an image including audio and video data related to the subtitles, The control unit 150 may read or search at least one image from among a plurality of images stored from the storage unit 130. For example, the foreign language lecture content creation and editing apparatus 100 may read an image including foreign language audio data such as movies, dramas, and news stored from the storage unit 130 and output them to the display unit 140. In addition, the foreign language lecture content creation and editing apparatus 100 includes a connection terminal to store various images including foreign language expressions, such as a memory card (eg, a compact flash card, an SD memory card, a USB memory, etc.). Storage devices can be inserted. The storage device that can be inserted into the foreign language lecture content creation and editing apparatus 100 is not limited thereto, and may include any storage device capable of storing an image.

When a plurality of subtitles and an image including audio and video data related to the subtitles are output through the display unit 140, the control unit 150 may edit the output image in response to a user input input through the user interface 120. I can. According to an embodiment, the control unit 150 includes a content setting unit 152 configured to set a program for generating or editing lecture content to be generated in response to a user input, and a plurality of subtitles and subtitles in response to a user input. A lecture control unit 154 configured to edit an image including audio and video data, and a subtitle sync control unit 156 configured to synchronize a caption included in the image and audio in response to a user input. Here, the user interface 120 freely edits images including audio data related to foreign language expressions in a foreign language lecture content creation and editing device 100 such as a smartphone and a tablet PC, and various functions suitable for the user's convenience. Can provide.

The content setting unit 152 may set a layout of lecture contents or a program for generating or editing lecture contents. For example, the content setting unit 152 may set a window or button design in response to a user input input through a user interface.

The lecture control unit 154 may edit the video using the user interface 120 for generating lecture content related to subtitles. According to an embodiment, the lecture controller 154 may edit an image by receiving a reproduction number or reproduction speed for each sentence or word included in a subtitle corresponding to a reproduction section of an image from a user through the reproduction setting interface. In this way, by setting the number of times or playback speed for each sentence or word included in the subtitle based on the user input input through the user interface 120, a foreign language that can induce learners to naturally learn and learn through repetitive learning. By providing lecture contents, it is possible to increase the learning efficiency of learners learning foreign languages.

The subtitle sync control unit 156 may synchronize audio and subtitles using the user interface 120 for editing subtitles. According to an embodiment, the caption sync control unit 156 outputs a caption corresponding to a reproduction section of an image, and uses a sync control interface to synchronize the caption for each sentence or word included in the caption of the image output from the user. Can be adjusted. Here, the subtitle of the output image may include at least one of a foreign language subtitle associated with a reproduction section of the video, a direct translation subtitle translated according to a word order of the foreign language subtitle, and a subtitle paraphrasing the foreign language subtitle according to a Korean word order. In this way, by synchronizing the subtitle and audio through the user interface 120 that can control the synchronization of the subtitle for each sentence or word included in the subtitle of the video, a user who wants to create and/or edit foreign language lecture content (i.e. , Instructor) can easily synchronize the video's audio and subtitles to prevent a synchronization error between the audio and subtitles.

According to an embodiment, the lecture controller 154 outputs a grammar related to a sentence included in a subtitle corresponding to a reproduction section of an image, a sentence included in the subtitle, or a problem related to a word to the display unit 140 and provides it to the user. , You can edit grammar and problems related to subtitles. Specifically, the lecture control unit 154 may edit a provided grammar and/or problem in response to a user input received from a user through the user interface 120. Here, the grammar and/or problem related to the subtitle may be read from the storage unit 130 or may be received from an external device. Additionally or alternatively, the user may directly generate grammar and/or problems associated with the subtitles through the user interface 120 provided.

In addition, the lecture control unit 154 may output content related to a word included in a subtitle corresponding to a reproduction section of an image to the display unit 140 to provide it to the user, and edit the provided content. Here, the content related to the word may include a meaning of the word, an audio related to the pronunciation of the word, an example sentence related to the word, an image, and the like. Content associated with a word may also be read from the storage unit 130 or may be received from an external device. Additionally or alternatively, a user may directly create content associated with a word through the provided user interface 120.

In this way, the user (i.e., the instructor) creates or edits the grammar, problems, words and related contents related to the subtitles of the video to create contents for foreign language lectures, thereby inspiring interest in foreign language learning and enhancing the learning efficiency. Foreign language lecture contents that can be provided can be provided to learners.

2 is an exemplary diagram illustrating a screen 200 of a user interface for receiving a content setting according to an embodiment of the present disclosure. Users create contents for foreign language lectures using a user interface (e.g., touch display, keyboard, mouse, touch pen or stylus, microphone, motion recognition sensor, etc.) provided from the content creation and editing device for foreign language lectures. And/or an edit request can be entered. In one embodiment, the user interface may include a tab 210 for setting content, a tab 220 for controlling an item related to a lecture, and a tab 230 for setting a sync between subtitles and audio.

According to an embodiment, when the user selects the content setting tab 210, the apparatus for creating and editing content for a foreign language lecture may output user interfaces 212, 214, and 240 for receiving content setting input. The user interfaces 212, 214, and 240 for receiving content setting may include a button 212 for setting an environment of a program and a button 214 for setting a window and a button. For example, when a user selects a button 214 for setting a window and a button through a touch input or the like, a user interface 240 for setting a window design and a button design may be output as shown. . The user selects an image file to be set as the content main image through the output user interface 240 and sets the main image of the content, or selects items for changing the logo of the content on the left or right side of the window to design a window. Can be set. In addition, the user can set the design of the button to be included in the content to be generated.

According to another embodiment, when the user selects the button 212 for setting the environment of the program through a touch input or the like, a user interface (not shown) for setting the environment of the program may be output. The user interface (not shown) for setting a program environment may include, for example, an interface for selecting a basic language of a program and an interface for selecting a program skin. After the user sets or changes these items, if the user selects the save button 250 through a touch input or the like, the content creation and editing apparatus for a foreign language lecture may store the settings.

3 is an exemplary view showing a screen 300 of a user interface for controlling a lecture according to an embodiment of the present disclosure. According to an embodiment, the user may select the lecture control tab 310 through a touch input or the like to control items related to the lecture. In this case, the apparatus for creating and editing contents for lecture may output user interfaces 320, 322, 324, 326, 328, and 330 for lecture control. The user interface (320, 322, 324, 326, 328, 330) for lecture control includes a button 322 for setting playback of an image, a button 324 for setting subtitles included in the video, and subtitles included in the video. A button 326 for setting a related grammar, a button 328 for setting a word related to a subtitle, and a button 330 for setting a problem related to a subtitle included in the image. For example, when the user selects the button 328 for word setting through a touch input or the like, as shown, content 350 for a word related to a subtitle included in a playback section of an image is provided, An interface 340 for setting the provided word content may be output. Here, the content may include the meaning of the word, example sentences related to the word, images, audio, and the like.

For example, if the subtitle included in the playback section of the video selected by the user is'They are excellent journalists.', the content creation and editing apparatus for lecture is, as shown, content for "journalists" 350 ) May be generated and output through the display unit together with the interface 340 for word content to be provided to the user. The user may change detailed settings of the content for words, such as the color and size of characters included in the content, through the interface 340.

In the above, it has been described that the content generation and editing apparatus for lecture generates and provides the content related to the word to the user, but the present invention is not limited thereto. According to an embodiment, a user may directly generate content related to a word provided by using an interface for setting word content. The word content generated as described above may be displayed in various forms, such as displayed through a display unit with an image or through a pop-up window according to a user's setting.

According to another embodiment, when the user selects the button 322 for setting the reproduction of an image through a touch input or the like, a user interface (not shown) for controlling the reproduction of the image may be output. A user interface (not shown) for controlling the reproduction of an image is included in, for example, an interface for inputting the number of reproductions for each sentence or word included in the subtitle corresponding to the reproduction section of the video and the subtitle corresponding to the reproduction section of the video. It may include an interface for inputting a playback speed for each sentence or word. Here, the reproduction section of the video may be divided by sentences or words included in the subtitle, for example, but is not limited thereto, and the user may directly set the playback section through a user interface (not shown).

According to another embodiment, when a user selects the button 324 for setting a subtitle included in an image through a touch input, the detailed setting of the subtitle corresponding to the reproduction section of the image, such as color, size, font, etc., is changed. A possible user interface (not shown) may be output.

According to another embodiment, when the user selects the button 326 for setting grammar related to subtitles through a touch input or the like, a user interface for setting grammar along with the grammar related to the subtitle included in the playback section of the video Hour) can be output. For example, if the subtitle included in the playback section of the video selected by the user is'He has been to japan', the content creation and editing device for the lecture, as shown, has past participle associated with'have been'. The grammar for the grammar may be output through the display unit together with a user interface (not shown) for setting the grammar.

4 is an exemplary diagram illustrating a screen of a user interface 400 for setting a problem related to a caption included in an image according to an embodiment of the present disclosure. According to an embodiment, the user may select a button 410 for setting a problem through a touch input or the like in order to set a problem related to a caption included in an image. In this case, the content creation and editing apparatus for the lecture, as shown, is a problem related to the subtitle included in the reproduction section of the video (for example, a problem related to words, sentences or grammar included in the subtitle, a problem related to reading comprehension, etc.) Etc.) and a user interface 420 for setting a problem may be output together. For example, the device for creating and editing contents for a lecture includes an interface 430 for selecting a problem generated by the device for creating and editing contents for a lecture in response to a user input, and an interface 432 for setting the title of the problem. ), an interface 434 for setting a time when the problem is to be output, an interface 436 for setting the content of the problem, and an interface 438 for setting a correct answer to the problem may be output. Here, the problem related to the caption included in the video may be a problem generated by the content generation and editing apparatus for a lecture based on the caption included in the video, or a problem generated through a user interface for setting a problem.

The time when the problem or the correct answer is to be output may be directly set by the user through the interface, but is not limited thereto. For example, a content creation and editing apparatus for a lecture sets a problem related to a subtitle to be output while a video and a subtitle are displayed, or stops the output of the related video, and when a preset time elapses, the correct answer to the problem is given. You can also set it to print.

5 is an exemplary diagram illustrating a process of synchronizing subtitles and audio for each sentence according to an embodiment of the present disclosure. The user may synchronize the subtitle and the audio for each sentence through the first operation 510 and the second operation 520 using an application or a web browser operating on a content creation and editing device for a foreign language lecture. The first operation 510 indicates that the user selects one sentence for synchronizing with audio from among sentences included in the subtitle corresponding to the reproduction section of the image.

According to an embodiment, the user may select the caption sync setting button 530 through a touch input or the like for synchronization between a caption included in an image and an audio. In this case, the apparatus for generating and editing contents for a lecture may output a user interface 540 for setting the sync of subtitles included in the reproduction section of the video together with the video, as illustrated. For example, as shown in the user interface 540 for setting subtitle sync, a sentence sync tab 542 for setting subtitle sync for each sentence and a word sync tab for setting subtitle sync for each word. (544) may be included.

When the user selects the sentence sync tab 542 to set the subtitle sync for each sentence, an interface 550 for executing synchronization between the subtitle and audio included in the reproduction section of the image for each sentence may be output. As shown in the interface 550 for subtitle synchronization for each sentence, the subtitle is divided for each sentence, and the corresponding sentence may be displayed together with a playback time point at which the sentence is displayed in the image. The user may select one of the sentences 560 displayed on the screen through a touch input, or the like, and move to a screen or a pop-up window capable of synchronizing the sync between the sentence and audio. Here, the playback section may be a section having a set time interval from the playback time point of the image selected by the user, and the set time interval may be set based on a sentence included in the image.

The second operation 520 indicates that in response to the user selecting one of the sentences 560 displayed on the screen, a pop-up window for synchronization between the corresponding sentence and the audio is displayed on the display of the content creation and editing device for lecture. . The pop-up window 570 for synchronization between the sentence and the audio is an interface for setting the sentence selected by the user, the time point at which the sentence is displayed, the image of the video when the sentence is displayed, and the playback speed of the audio corresponding to the sentence And an interface for setting a playback time of audio corresponding to the sentence. The user may set the playback speed and/or playback timing of the audio corresponding to the sentence through a touch input or the like. For example, the user may transmit a request for setting the playback time of the audio corresponding to the sentence by selecting the one second forward movement button 572 through a touch input, etc. to the content creation and editing device for a foreign language lecture. . The content creation and editing apparatus for a foreign language lecture may receive a corresponding request and move the playback time of the audio corresponding to the sentence by 1 second.

When the user selects the apply button 574 through a touch input or the like after setting the playback time and/or playback speed of the audio corresponding to the sentence, the content creation and editing device for a foreign language lecture will audio Can be applied to. Alternatively, the user may cancel the setting applied to the playback time and/or playback speed of the audio by selecting the cancel button 576 through a touch input or the like.

6 is an exemplary diagram illustrating a process of synchronizing a caption and audio for each word according to an embodiment of the present disclosure. The user may synchronize the subtitle and the audio for each word through the first operation 610 and the second operation 620 using an application or a web browser running on a content creation and editing device for a foreign language lecture. The first operation 610 indicates that the user selects one word for synchronizing with audio from among words included in a subtitle corresponding to a reproduction section of an image.

According to an embodiment, the user may select the word sync tab 630 to set the sync of subtitles for each word. In this case, an interface 640 for synchronizing the audio and the caption included in the reproduction section of the image for each word may be output. In the interface 640 for subtitle syncing for each word, as shown, the subtitles may be divided and displayed for each word. The user may select one of the words 642 displayed on the screen through a touch input or the like, and move to a screen capable of synchronizing synchronization between the corresponding word and audio, or a pop-up window may be displayed. Here, the playback section may be a section having a set time interval from the playback time point of the image selected by the user, and the set time interval may be set based on words included in the image.

In the second operation 820, in response to the user selecting one of the words 642 displayed on the screen, a pop-up window 650 for synchronizing the word and the audio is displayed on the display of the content creation and editing device for the lecture. To be. The pop-up window 650 for synchronization between the word and the audio is an interface for setting the word selected by the user, the time point when the word is displayed, the image of the video when the word is displayed, and the playback speed of the audio corresponding to the word , An interface for setting a start time of audio corresponding to the corresponding word and an interface for setting an end time of audio corresponding to the corresponding word, and the like may be included. The user may set at least one of a playback speed of an audio corresponding to a corresponding word, a playback start point, and a playback end point through a touch input or the like. For example, the user selects the 0.5 second forward movement button 652 of the interface for setting the audio playback start point through touch input, etc., and makes a request to set the playback start point of the audio corresponding to the word in a foreign language. It can be transmitted to a content creation and editing device for lectures. The content creation and editing apparatus for a foreign language lecture may receive a corresponding request and move an audio playback start time corresponding to a corresponding word by 0.5 seconds.

When the user selects the apply button 654 through a touch input or the like after setting at least one of the audio playback speed, playback start point, and playback end point corresponding to the word, content creation and editing for foreign language lectures The device can apply those settings to the audio. Alternatively, the user may select the cancel button 656 through a touch input or the like to cancel a setting applied to at least one of a playback speed, a playback start point, and a playback end point.

7 is a flowchart of a content creation and editing method 700 for a foreign language lecture according to an embodiment of the present disclosure. The method 700 may be performed by a content creation and editing device for a foreign language lecture. As illustrated, the method 700 may be initiated with a step in which a processor receives a plurality of subtitles and an image including audio and video data associated with the subtitles (S710).

Then, in step S720, the video may be edited using the first interface for generating lecture content related to the subtitle. According to an embodiment, the processor receives the number of playback times or playback speed for each sentence or word included in the subtitle corresponding to the playback section of the video using the playback setting interface from the user (that is, the instructor) and included in the subtitle. You can set the number of times the sentence or word is played, or the playback speed.

Finally, an operation (S730) of synchronizing audio and subtitles using a second interface for editing subtitles may be performed. According to an embodiment, the processor may output a caption corresponding to a reproduction section of an image, and adjust the sync of the caption for each sentence or word included in the caption of the output image using a sync control interface. Here, the subtitle of the output image may include at least one of a foreign language subtitle associated with a reproduction section of the video, a direct translation subtitle translated according to a word order of the foreign language subtitle, and a subtitle paraphrasing the foreign language subtitle according to a Korean word order.

The above-described content creation and editing method 700 for a foreign language lecture may be performed individually or together. According to an embodiment, the processor selectively displays the corresponding subtitle while the video is being played by receiving at least one of paragraphs, sentences, and words included in the subtitle associated with the video playback section from the user using the toggle interface. can do.

According to an embodiment, the processor may edit content related to the playback section of the video in response to a user input. Specifically, the processor may edit a grammar associated with a sentence included in a caption corresponding to a reproduction section of an image. Additionally or alternatively, the processor may edit at least one of an image, an example sentence, and a meaning associated with a word included in a subtitle corresponding to a reproduction section of the video. Additionally or alternatively, it is possible to edit a problem associated with a sentence or word included in a subtitle corresponding to a reproduction section of an image. Here, it is preferable that the content is set to be output through a content creation and editing device for a foreign language lecture while the associated subtitle is displayed.

8 is a schematic diagram illustrating an environment for providing a foreign language teaching service using lecture content according to an embodiment of the present disclosure. The apparatus 810 for providing a foreign language teaching service using lecture contents may communicate with the apparatus 830 for generating and editing contents for a foreign language lecture through the network 820. The network 820 may be configured to enable communication between the apparatus 810 for providing a foreign language teaching service using lecture contents and the apparatus 830 for generating and editing contents for a foreign language lecture. Depending on the installation environment, the network 820 may include, for example, a wired network such as Ethernet, a wired home network (Power Line Communication), a telephone line communication device and RS-serial communication, a mobile communication network, a WLAN (Wireless LAN), It can be composed of wireless networks such as Wi-Fi, Bluetooth and ZigBee, or a combination thereof.

According to an embodiment, the apparatus 810 for providing a foreign language teaching service using lecture contents receives at least one of a plurality of lecture contents generated by the contents generation and editing apparatus 830 for a foreign language lecture through the network 820 can do. The apparatus 810 for providing a foreign language teaching service using lecture contents may be configured to support lecture contents, and may include a display device capable of displaying such lecture contents. The apparatus 810 for providing a foreign language teaching service using lecture contents according to a command signal received according to an input of a user (i.e., a lecturer such as a lecturer, a teacher, etc.) (for example, a command signal related to an operation such as selection of lecture contents). It can be operated.

The apparatus 810 for providing a foreign language teaching service using lecture contents may provide a foreign language teaching service using lecture contents to a user through the network 820. According to an embodiment, the apparatus 810 for providing a foreign language teaching service using lecture contents may store, provide, and execute a computer executable program (for example, a downloadable application) and data related to a foreign language teaching service using lecture contents. One or more server devices and/or databases, or one or more distributed computing devices and/or distributed databases based on cloud computing services.

As described above, when a user lectures the lecture contents through the foreign language teaching service providing apparatus 810 using the lecture contents, it is possible to induce interest of a learner learning a foreign language and increase the learning efficiency.

In FIG. 8, a device 810 for providing a foreign language teaching service using lecture content and a device for creating and editing contents for a foreign language lecture 830 are separately shown, but the present invention is not limited thereto, and the device 810 for providing a foreign language teaching service is shown. It is configured to include a content creation and editing device 830 for a foreign language lecture, and may function as a content creation and editing device 830 for a foreign language lecture.

9 is a schematic block diagram of an apparatus 900 for providing a foreign language teaching service using lecture content according to an embodiment of the present disclosure. As illustrated in FIG. 9, the apparatus 900 for providing a foreign language teaching service using lecture contents may include a communication unit 910, a control unit 920, a display device 930, and a database 940. Here, the control unit 920 may include at least one processor and a memory.

The apparatus 900 for providing a foreign language teaching service using lecture contents may communicate with an external device, such as an external server or a contents creation and editing apparatus for foreign language lectures, through the communication unit 910. The communication unit 910 is configured to communicate with an external device, such as a user terminal or an external server, through a network, and provides a lecture content generated through an external device (for example, a content creation and editing device for a foreign language lecture) or an external device. You can receive the stored lecture content. Here, the lecture content may include a plurality of subtitles, audio and video data related to the subtitles, and may be content related to a foreign language. For example, the communication unit 910 may be a wired network such as Ethernet, a wired home network (Power Line Communication), a telephone line communication device, and RS-serial communication, or a wireless LAN (WLAN), depending on the installation environment. Wireless networks such as Bluetooth and ZigBee can be variously selected and configured.

The communication unit 910 may provide the received lecture content to the control unit 920. In an embodiment, the control unit 920 may store the received lecture content in the database 940. Database 940 may include any storage device configured to store lecture content.

The controller 920 may output the received lecture content to the display device 930 and provide it to a user (ie, a teacher). Here, the apparatus 900 for providing a foreign language teaching service using lecture contents may process or provide lecture contents and may include an output device (eg, a display device, a speaker, etc.).

According to another embodiment, the database 930 of the apparatus 900 for providing a foreign language teaching service using lecture contents may store a plurality of lecture contents received from the communication unit 910, and the control unit 920 At least one of a plurality of stored lecture contents can be read or searched. In addition, the device 900 for providing a foreign language teaching service using lecture contents includes a connection terminal and various storage devices capable of storing lecture contents, such as a memory card (for example, a compact flash card, an SD memory card, a USB memory, etc.). Can be inserted. A storage device that can be inserted into the apparatus 900 for providing a foreign language teaching service using lecture content is not limited thereto, and may include any storage device capable of storing an image. A user may give a lecture to learners by using the lecture content output through the display device 930.

10 is a diagram illustrating an example of content for a foreign language lecture generated through a content creation and editing apparatus for a foreign language lecture according to an embodiment of the present disclosure. A user (that is, a teacher) can give a lecture to learners using an application running on a foreign language teaching service providing device using the lecture content or a foreign language lecture content generated through a web browser. According to an embodiment, a user may select a desired foreign language lecture content and display it on the screen of the display device. For example, when a user selects a foreign language lecture content, as shown, along with an audio and image 1012 associated with the selected foreign language lecture content on the screen of the display device, the selected foreign language lecture content indicates a playback section of the video. An interface 1030 for selecting and an interface 1040 for setting playback of an image related to lecture content in a foreign language may be output.

According to an embodiment, the user may select the playback section movement interface 1030 displayed on the upper right through a touch pen, a touch display, or a mouse to move to the section to be lectured. For example, when the user selects the playback section movement interface 1030, an interface 1040 for setting the playback of the section along with the image 1012 associated with the playback section may be displayed at the top of the screen of the display device. have.

In the above, when the user creates and/or edits the lecture content, the number of times of playback is preset for each sentence or word included in the subtitle corresponding to the playback section of the video using a user interface (not shown) for controlling the playback of the video. Or, although it has been described above that the playback speed is set in advance, it is not limited thereto. According to an embodiment, the user may repeatedly play a desired section to be repeated using the displayed playback setting interface 1040 or directly control the playback speed of the corresponding section.

According to an embodiment, when a user selects a foreign language lecture content, as illustrated, an interface for controlling learning content related to the foreign language lecture content may be output. The learning content control interface includes a D (Dictation) button for dictation learning on the upper left of the screen of the display device, an S (structure) button for displaying the structure of a sentence, a V (vocabulary) button for displaying content related to words, E (English) button to display direct translation subtitles according to the word order of foreign language subtitles, K (Korean) button to display subtitles translating foreign language subtitles according to Korean word order, O (Outline) to display summary information ) Button and a G (Grammar) button for displaying grammar. The user may select at least one of the learning content control interfaces displayed on the screen and use the learning content displayed on the screen for a foreign language lecture. For example, the user selects the S button, the V button, and the E button through a touch input, etc., and translates the text according to the sentence structure 1022, word content 1024, and the word order of the foreign language subtitles included in the video playback section. A direct translation subtitle 1026 can be output. Here, the sentence structure 1022 of the subtitle is preferably output together with the foreign language subtitle related to the reproduction section of the video, as shown, and the words and/or idioms included in the foreign language subtitle are underlined and/or highlighted and displayed. Can be.

Additionally or alternatively, when a user selects a foreign language lecture content, as shown, a Topic button 1050 for changing the foreign language lecture content, a conversation for moving to a screen for conversation learning related to the video playback section A button 1060, a reading button 1070 for moving to a screen for reading comprehension learning related to a playback section of an image, and a grammar button 1080 for moving to a screen for learning grammar related to subtitles included in the video playback section And a word button 1090 for moving to a screen for learning words related to a subtitle included in the reproduction section of the image.

After the user selects a section to lecture, the user has a conversation button 1060 for moving to the screen for learning conversation related to the playback section of the video, and for moving to the screen for reading comprehension in order to enhance the learning effect of learners. By selecting at least one of the reading comprehension button 1070, the grammar button 1080 for moving to the screen for learning grammar, and the word button 1090 for moving to the screen for learning words, learning related to the playback section of the corresponding video ( For example, you can move to a screen for lectures on grammar, reading comprehension, conversation, and vocabulary. For example, when the user selects the conversation button 1060 through a touch input or the like, an interface for conversation concept learning, conversation repetition learning, conversation speed reading learning, and conversation practice learning may be output. The user can select one of conversational concept learning, conversational repetition learning, conversational fast reading, and conversational practice learning, and move to the screen for the corresponding learning to teach the concept of conversation to learners.

11A is a diagram illustrating an example of word content 1110 displayed in response to a user input from a user according to an embodiment of the present disclosure. According to an embodiment, a user selects a word to be described during a foreign language lecture among foreign language subtitles output on the screen of the display device through a touch pen, a touch display, a mouse, etc., in order to inspire learners' interest and enhance the learning effect. I can. In this case, a screen for content related to the selected word may be moved or a pop-up window for content related to the selected word may be displayed. For example, if the user selects "Journalists" among the subtitles displayed on the user terminal, the spelling and meaning of "Journalists" and the time when the word is displayed are displayed at the top of the screen of the user terminal. Word content 1110 including an image (an image associated with a reporter), an example sentence ("She earn her living as a freelance journalist."), and a meaning (reporter) may be displayed through a pop-up window. Alternatively or additionally, when the user selects one of the output foreign language subtitles through a touch pen, a touch display, a mouse, or the like, audio corresponding to the corresponding word may be repeatedly reproduced.

11B is a diagram illustrating an example of a user interface screen for providing a reading summary function according to an embodiment of the present disclosure.

According to an embodiment, the user may output a description of the reading summary through various types of user interfaces 1141 to 1148 displayed through the user terminal. For example, the user terminal displays a housewife (introduction) through an oval-shaped user interface 1141, and a housewife (body) through a triangular user interface (1142, 1143) among the contents of an English paragraph to be read. , The housewife (conclusion) may be displayed through the diamond-shaped user interface 1144. In addition, the user terminal may output detailed descriptions of each of the housewife (introduction), the housewife (body), and the housewife (conclusion) among the contents of the English paragraph to be read through a separate user interface (1145, 1146, 1147, 1148). .

12 is a diagram illustrating an example of a user interface screen 1200 for repetitive conversational learning according to an embodiment of the present disclosure. After the user lectures the conversation concept learning to the learner by using the conversation concept learning contents, the user may select a conversation repetition learning area through a touch input or the like to move to the screen 1200 for conversation repetition learning. According to an embodiment, the conversational repetition learning may be dictation learning for a subtitle included in a reproduction section of an image. The user may selectively display at least one or more of paragraphs, sentences, and words included in subtitles as needed during a lecture using a toggle interface in order to increase the learning efficiency of conversational repetition learning. For example, the user can hide the word included in the caption from the screen as shown by selecting the "D button" displayed on the upper left through a touch pen, a touch display, a mouse, or the like.

13 is a diagram illustrating an example of a caption of a displayed image in response to a user input from a user according to an embodiment of the present disclosure. According to an embodiment, a user may select a word order button through a touch pen, a touch display, a mouse, or the like to give a lecture on a foreign language subtitle related to a reproduction section of an image. In this case, at least one of the foreign language subtitle 1330 corresponding to the video playback section, the direct translation subtitle 1310 translated according to the word order of the foreign language subtitle, and the subtitle 1320 paraphrasing the foreign language subtitle according to the Korean word order will be output. I can. For example, as shown, foreign language subtitles ("Journalists in South Korea have to then read the people what was reported by the media on one side") and foreign language subtitles corresponding to the playback section of the video are paraphrased according to Korean word order. Along with one subtitle ("Reporters in Korea should read to people what is reported by one side of the media"), the foreign language subtitle and the direct translation subtitle 310 are matched and displayed on the screen based on the structure of the sentence. I can.

In FIG. 13, the foreign language subtitle 1330 and the direct translation subtitle 1310 are matched based on the structure of the sentence together with the foreign language subtitle 1330 and the subtitle 1320 in which the foreign language subtitles are paraphrased according to the Korean word order. It has been described above that it is displayed on the screen, but is not limited thereto. Directly translated subtitles according to the word order of foreign language subtitles, or only the subtitles translated according to the Korean word order, are displayed on the screen, or directly translated subtitles in the foreign language subtitles corresponding to the video playback section, or directly translated according to the word order of foreign language subtitles. And various combinations of subtitles in which foreign language subtitles are paraphrased according to Korean word order may be displayed on the screen.

14 is a diagram illustrating an example of a user interface screen 1400 for learning conversational speed reading according to an embodiment of the present disclosure. After the user lectures the conversational repetition learning to the learner using the conversational repetition learning content, the user may select a conversational fast reading learning area through a touch input or the like, and move to the screen 1400 for conversational fast reading learning. According to an embodiment, the screen 1400 for learning conversational speed reading may include a foreign language subtitle related to a reproduction section of an image and a subtitle in which the foreign language subtitle is paraphrased according to a Korean word order. The user can control the reproduction speed and/or the number of reproductions through the interface 1410 for the outputted foreign language subtitles and paraphrased Korean subtitles and the reproduction setting to give a lecture to learners to learn conversational speed reading. In this case, the user may hide the paraphrased caption displayed on the screen from the screen by selecting the K button as needed.

15 is a diagram illustrating an example of a user interface screen 1500 for actual conversation learning according to an embodiment of the present disclosure. The user may lecture the learner to learn conversational fast reading using the content of conversational fast reading, and then move to the screen 1500 for conversational practice learning by selecting a conversational practice learning area through a touch input or the like. According to an embodiment, the screen 1500 for learning actual conversation may include an image related to a reproduction section of an image. The user may control the reproduction speed and/or the number of reproductions through the interface 1510 for the output image and the reproduction setting to give a lecture to learners in conversation practice.

As described above, by learning conversation about the playback section of the video in the order of concept, repetition, word order, speed reading, and practice, it is not a one-sided injection learning method by an educator, but through repetitive learning. It can provide an active conversational learning method that can induce you to learn and learn naturally.

16 is a diagram illustrating an example of a user interface screen 1600 for actual reading comprehension learning according to an embodiment of the present disclosure. Using foreign language lecture contents, users can lecture to learners the concept of reading, repetitive reading, and word order learning in the same process as conversational concept learning, conversational repetition learning, and conversational word order learning. The user may lecture the learner to learn the reading comprehension word order using the contents of the reading comprehension word order learning, and then select a reading comprehension practice learning area through a touch input or the like, and move to the screen 1600 for actual reading comprehension learning. According to an embodiment, the screen 1600 for practicing reading comprehension may include at least one of a plurality of problems related to sentences or words included in a caption corresponding to a reproduction section of an image. For example, when a reading practice learning area is selected through a touch input or the like, a topic finding problem may be displayed on the screen. In this case, a timer for which a time for solving the problem is set may be displayed along with the problem, and the correct answer to the problem may be displayed on the screen after a preset time has elapsed. Reading comprehension learning In addition, by learning reading comprehension for the playback section of the video in the order of concept, repetition, word order, summary, and practice, it is learned naturally in the mouth and body through repetitive learning rather than a unilateral injection learning method by an educator. It can provide an active reading comprehension learning method that can induce you to do.

17 is a diagram illustrating examples of user interface screens 1750, 1760, 1770, and 1780 for word learning according to an embodiment of the present disclosure. The user may select a word concept learning region from among the word learning interface 1712 displayed by selecting a word button through a touch input or the like in order to lecture the learner to learn words related to the reproduction section of the image. According to an embodiment, when a word concept learning region is selected by a user, at least one of an image 1714, an illustrative sentence 1718, and a meaning 1716 associated with the word may be output on the screen 1750. For example, the English spelling of "Journalists", meaning (for example, journalist, reporter), image (1714) meaning reporter, and example sentence (She earns her living as a freelance Jounalists.) are displayed on the screen (1750). Can be displayed. In addition, when an example sentence 1718 associated with a word is output, a paraphrase caption 1722 may also be output. The user may control the playback speed and/or the number of times of playback through the interface 1724 for setting the audio playback associated with the output image, example sentences, meanings and words to teach learners to learn word concepts.

Then, the user may select a word repetition learning area through a touch input or the like and move to the screen 1760 for word repetition learning. According to an embodiment, word repetition learning may be dictation learning for example sentences related to words. For example, in order to increase the learning efficiency of the conversational repetition learning, the user may hide at least one of words included in the example sentence from the screen as shown by selecting the "D button". After giving a lecture on word repetition learning to a learner by using the word repetition learning content, the user may select a word speed reading learning area through a touch input or the like to move to the screen 1770 for word speed reading learning.

According to an embodiment, the screen 1770 for fast reading of words includes English spelling of words (Journalists), meanings (journalists, reporters), example sentences related to words (She earns her living as a freelance journalist.), words and words. An associated image 1714 may be included. The user may lecture the learner to learn the word fast reading using the contents of the word fast reading, and then move to the screen 1780 for actual word learning by selecting a word practice learning area through a touch input or the like.

According to an embodiment, the screen 1780 for practical learning of words may include an image 1514 associated with a word and an English spelling (Journalist) of the word. For example, as shown, an image 1714 and English spelling (Journalist) associated with a word may be displayed together with a timer in which a time for fast reading learning is set. The user may lecture learners to practice words through an image 1714 associated with the output word and English spelling (Journalist) of the word.

As described above, by learning words related to the playback section of the image in the order of concept, repetition, word order, speed reading, and practice, it is not a one-sided injection learning method by an educator, but through repetitive learning. It can provide an active word learning method that can induce you to learn and learn naturally.

18 is a flowchart of a foreign language teaching method 1800 using lecture content according to an embodiment of the present disclosure. The method 1800 may be performed by an apparatus for providing a foreign language teaching service using lecture contents. As shown, the method 1800 begins with a processor outputting, through a display device, lecture content including a plurality of subtitles, audio and video data associated with the subtitles, received from a database in response to an input from an instructor. Can be (S1810).

Then, in step S1820, in response to the instructor's input received through the playback setting interface, the audio corresponding to the playback section of the video may be played for each sentence or word.

Thereafter, in response to an input from the instructor, an operation S1830 of displaying a first interface for learning words related to the lecture content through the display device may be performed. According to an embodiment, the processor outputs audio associated with a word included in a subtitle in response to a user input, and in response to a user input received through the first interface, at least one of an image, an example sentence, and a meaning associated with the word Can be output to the display device. Additionally or alternatively, in response to the instructor's input received through the toggle interface, the processor may selectively display at least one of an image, an example sentence, and a meaning associated with the word on the display device.

Next, in step S1840, in response to the instructor's input, a second interface for reading comprehension learning related to the lecture content may be displayed through the display device. According to an embodiment, the processor may output audio or an image related to a reproduction section of an image. Then, in response to the instructor's input received through the second interface, the processor directly translates the subtitles including the structure of the sentence based on the words or phrases, the foreign language subtitles related to the playback section of the video, and the word order of the foreign language subtitles. At least one of the translated subtitles may be displayed. Additionally or alternatively, the processor may display a grammar associated with a sentence included in a subtitle corresponding to a reproduction section of an image. Additionally or alternatively, the processor may output at least one of a plurality of problems related to sentences or words included in the subtitle corresponding to the reproduction section of the video to the display device in response to the instructor's input received through the toggle interface. have.

Finally, in response to the instructor's input, a third interface for conversational learning related to the lecture content may be displayed through the display device (S1850). According to an embodiment, the processor outputs audio or video related to the playback section of the video, and displays the foreign language subtitles related to the playback section of the video through the third interface and the directly translated subtitles according to the word order of the foreign language subtitles. I can. In addition, in response to the instructor's input received through the third interface, the processor displays a subtitle including a structure of a sentence based on a word or phrase, and writes a grammar associated with the sentence included in the subtitle corresponding to the reproduction section of the video. Can be displayed. Here, the subtitle may further include at least one of a foreign language subtitle associated with a reproduction section of the image, a direct translation subtitle translated according to a word order of the foreign language subtitle, and a subtitle paraphrasing the foreign language subtitle according to a Korean word order.

Additionally or alternatively, in response to the instructor's input received through the toggle interface, the processor displays at least one of paragraphs, sentences, and words included in the subtitles associated with the playback section of the video while the audio or video is being played. It can be selectively marked by the device.

Additionally or alternatively, the step of outputting the audio or video associated with the playback section, and while the audio or video is being output, the foreign language subtitles and the foreign language subtitles associated with the video playback section are paraphrased according to the Korean word order through the display device. Can be printed.

In FIG. 18, the step of displaying the first interface for learning words through the display device (S1830) is performed prior to the step of displaying the second interface for reading comprehension learning through the display device (S1840). The step of displaying the first interface through the display device (S1830) and the step of displaying the second interface for reading comprehension learning through the display device (S1840) are the steps of displaying a third interface for conversational learning through the display device (S1850). ), but is not limited thereto. For example, displaying a first interface for word learning through a display device (S1830), displaying a second interface for reading comprehension learning through a display device (S1840), and a third interface for conversational learning Displaying through the display device (S1850) may be performed in parallel, and each of the steps may be sequentially performed in an arbitrary order.

The above-described method for creating and editing contents for a foreign language lecture and a method for teaching foreign languages using lecture contents may be implemented as computer-readable codes on a computer-readable recording medium. The computer-readable recording medium includes all types of recording devices that store data that can be read by a computer system. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tapes, floppy disks, and optical data storage devices. Further, the computer-readable recording medium is distributed over a computer system connected through a network, so that computer-readable codes can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the above-described embodiments can be easily inferred by programmers in the technical field to which the present invention pertains.

The method, operation, or techniques of this disclosure may be implemented by various means. For example, these techniques may be implemented in hardware, firmware, software, or a combination thereof. Those of skill in the art will appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented in electronic hardware, computer software, or combinations of both. To clearly illustrate this interchange of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the particular application and design requirements imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementations should not be interpreted as causing a departure from the scope of the present disclosure.

In a hardware implementation, the processing units used to perform the techniques include one or more ASICs, DSPs, digital signal processing devices (DSPDs), programmable logic devices (PLDs). ), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units designed to perform the functions described in this disclosure. , Computer, or a combination thereof.

Accordingly, various exemplary logic blocks, modules, and circuits described in connection with the present disclosure may include general purpose processors, DSPs, ASICs, FPGAs or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, or It may be implemented or performed in any combination of those designed to perform the functions described in. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of computing devices, eg, a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in connection with the DSP core, or any other configuration.

In firmware and/or software implementation, the techniques include random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), PROM ( on a computer-readable medium such as programmable read-only memory), erasable programmable read-only memory (EPROM), electrically erasable PROM (EEPROM), flash memory, compact disc (CD), magnetic or optical data storage device, etc. It can also be implemented as stored instructions. The instructions may be executable by one or more processors, and may cause the processor(s) to perform certain aspects of the functionality described in this disclosure.

When implemented in software, the techniques may be stored on a computer-readable medium as one or more instructions or code or transmitted through a computer-readable medium. Computer-readable media includes both computer storage media and communication media, including any medium that facilitates transfer of a computer program from one place to another. Storage media may be any available media that can be accessed by a computer. By way of non-limiting example, such computer readable medium may contain RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or desired program code in the form of instructions or data structures. It may include any other media that may be used for transfer or storage to and accessible by a computer. Also, any connection is properly termed a computer-readable medium.

For example, if the software is transmitted from a website, server, or other remote source using wireless technologies such as coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or infrared, wireless, and microwave, coaxial cable , Fiber optic cable, twisted pair, digital subscriber line, or wireless technologies such as infrared, wireless, and microwave are included within the definition of the medium. Disks and discs as used herein include CDs, laser disks, optical disks, digital versatile discs (DVDs), floppy disks, and Blu-ray disks, where disks are usually magnetic It reproduces data optically, while discs reproduce data optically using a laser. Combinations of the above should also be included within the scope of computer-readable media.

The software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM, or any other known type of storage medium. An exemplary storage medium may be coupled to a processor such that the processor can read information from or write information to the storage medium. Alternatively, the storage medium may be integrated into the processor. The processor and storage medium may also reside within the ASIC. The ASIC may exist in the user terminal. Alternatively, the processor and storage medium may exist as separate components in the user terminal.

Although the above-described embodiments have been described as utilizing aspects of the presently disclosed subject matter in one or more standalone computer systems, the present disclosure is not limited thereto, and may be implemented in connection with any computing environment such as a network or a distributed computing environment. . Furthermore, aspects of the subject matter in this disclosure may be implemented in multiple processing chips or devices, and storage may be similarly affected across multiple devices. Such devices may include PCs, network servers, and portable devices.

In the present specification, the present disclosure has been described with reference to some embodiments, but various modifications and changes may be made without departing from the scope of the present disclosure that can be understood by those of ordinary skill in the art to which the present disclosure belongs. In addition, such modifications and changes should be considered to fall within the scope of the claims appended to this specification.

100: user terminal
110: communication department
120: user interface
130: storage unit
140: display
150: control unit
152: content setting unit
154: lecture control unit
156: subtitle sync control unit

Claims (13)

In the method of teaching foreign languages using lecture contents,
In response to the instructor's input, audio and video data received from the database, foreign language subtitles related to the playback section of the video, direct translation subtitles translated according to the word order of the foreign language subtitles, and subtitles paraphrasing the foreign language subtitles in Korean word order Outputting the included lecture contents through a display device;
In response to an input from an instructor received through a playback setting interface, playing audio corresponding to a playback section of the video for each sentence or word;
In response to an input from an instructor, displaying a first interface for learning words associated with the lecture content through the display device;
Displaying a second interface for reading comprehension learning related to the lecture content through the display device in response to the instructor's input;
In response to the instructor's input received through the second interface, the foreign language subtitle and the direct translation subtitle including a structure of a sentence based on a word or phrase.- The direct translation subtitle includes the foreign language subtitle and the foreign language subtitle based on the structure of the sentence. Matched and displayed-displaying;
In response to an input from an instructor received through the second interface, displaying a grammar associated with a sentence included in the foreign language subtitle corresponding to a reproduction section of the video;
In response to the instructor's input, displaying a third interface for conversational learning related to the lecture content through the display device;
In response to the instructor's input received through the third interface, the foreign language subtitle and the direct translation subtitle-the direct translation subtitle is matched and displayed with the foreign language subtitle based on the structure of the sentence-and the paraphrased subtitle Displaying; And
In response to an input from the instructor received through the first toggle interface, while the audio or video is being played, the display device displays at least one of a paragraph, a sentence, and a word included in the foreign language subtitle associated with the playback section of the video. Steps to optionally mark in
Including, the method.
delete delete delete delete delete The method of claim 1,
Displaying the second interface for reading comprehension learning through the display device,
In response to the instructor's input received through the second toggle interface, while the audio or video is being played, at least one of a paragraph, a sentence, and a word included in the subtitle associated with the playback section of the video is selectively selected by the display device. The method further comprising the step of marking as.
The method of claim 1,
Displaying the second interface for reading comprehension learning through the display device,
In response to an input from the instructor received through the second toggle interface, outputting at least one of a plurality of problems related to sentences or words included in the subtitle corresponding to the reproduction section of the video to the display device , Way.
The method of claim 1,
Displaying the first interface for learning the word through the display device,
Outputting audio associated with a word included in the subtitle; And
In response to an input from an instructor received through the first interface, outputting at least one of an image, an example sentence, and a meaning associated with a word to the display device.
The method of claim 9,
Displaying the first interface for learning the word through the display device,
In response to an input from an instructor received through a third toggle interface, while the audio is being played, at least one of an image, an example sentence, and a meaning associated with a word associated with the audio playback section is selectively displayed on the display device. The method further comprising the step of.
The method of claim 9,
Displaying the first interface for learning the word through the display device,
In response to an input from an instructor received through a third toggle interface, outputting at least one of a plurality of problems associated with a word included in a subtitle corresponding to the reproduction section of the audio to the display device .
A computer program stored in a computer-readable recording medium for executing a foreign language teaching method using the lecture contents according to any one of claims 1 and 7 to 11.
In the device for providing a foreign language teaching service using lecture contents,
At least one for storing the lecture content including audio and video data, foreign language subtitles associated with the reproduction section of the video, direct translation subtitles translated according to the word order of the foreign language subtitles, and subtitles paraphrasing the foreign language subtitles according to Korean word order Memory of; And
Including at least one processor,
The at least one processor,
Outputting the lecture contents through a display device,
In response to an input from the instructor received through the playback setting interface, audio corresponding to the playback section of the video included in the lecture content is played for each sentence or word,
In response to an input from the instructor, a first interface for learning words associated with the lecture content is displayed through the display device,
In response to the instructor's input, a second interface for reading comprehension learning associated with the lecture content is displayed through the display device,
In response to the instructor's input received through the second interface, the foreign language subtitle and the direct translation subtitle including a structure of a sentence based on a word or phrase.- The direct translation subtitle includes the foreign language subtitle and the foreign language subtitle based on the structure of the sentence. Matched and displayed-is displayed,
In response to an input from the instructor received through the second interface, a grammar associated with a sentence included in the foreign language subtitle corresponding to the reproduction section of the video is displayed, and
In response to the instructor's input, a third interface for conversational learning related to the lecture content is displayed through the display device,
In response to an input from the instructor received through the third interface, the foreign language subtitle, the direct translation subtitle, and the paraphrased subtitle related to the reproduction section of the video are displayed, and
In response to an input from the instructor received through the first toggle interface, while the audio or video is being played, the display device displays at least one of a paragraph, a sentence, and a word included in the foreign language subtitle associated with the playback section of the video. A device for providing a foreign language teaching service using lecture content that is selectively displayed in

Images