KR20230021297A - An apparatus and method for providing conversational english lecturing contents - Google Patents

Abstract

According to one embodiment of the present invention, an English conversation lecture content providing method comprises the following steps of: extracting audio for English conversation learning and an English subtitle of the audio from a database; outputting first segment audio of the audio in response to a user input; outputting a first English subtitle synchronized with the first segment audio in the first segment audio and the English subtitle; outputting second segment audio after the first segment audio; and outputting the second English subtitle synchronized with the second segment audio in the second segment audio and the English subtitle.

Description

Method and apparatus for providing English conversation lecture contents {AN APPARATUS AND METHOD FOR PROVIDING CONVERSATIONAL ENGLISH LECTURING CONTENTS}

The present disclosure relates to a method and apparatus for providing content for English conversation lectures, and more particularly, constructs a sentence by outputting an image of a specific section associated with one sentence without subtitles and then outputting a video of the specific section together with subtitles. After providing lecture contents in sentence units to grasp pronunciation, etc., the entire video including the previously output section video and the entire subtitle are re-output to provide lecture contents in paragraph units to grasp the overall flow of the conversation. , It relates to a method for providing English conversation lecture contents and an apparatus therefor.

The basics of foreign language learning begin with understanding the sentence structure of the language. However, in the case of conversation, one step further, listening ability, conversation lecture ability, and conversation ability to understand the flow between each sentence to exchange questions and answers, as well as the ability to understand pronunciation and stress and speak at the same time are required. .

Meanwhile, media contents such as American dramas, movies, and news have been utilized in various conventional English conversation lecture contents. Using these media contents, the instructor was able to conduct conversation lectures in only two ways: turning on or off the subtitles. However, there is a problem in that it is impossible to target specific learning abilities, such as improvement in listening ability, conversational lecture ability, conversation ability, and understanding of pronunciation and stress, by simply watching a video with or without subtitles.

In order to solve the above problem, the embodiments disclosed in this specification output a video of a specific section associated with one sentence without a subtitle, and then output the video of the specific section together with a subtitle, thereby improving the structure and pronunciation of the sentence. After providing the lecture contents in sentence units to grasp the above, the entire video and the entire subtitle including the previously output section video are re-output to provide the lecture contents in paragraph units to grasp the overall flow of the conversation. A method for providing conversation lecture contents and a device therefor are provided.

According to an embodiment of the present disclosure, a method for providing English conversation lecture contents includes extracting audio and English subtitles of the audio for learning English conversation from a database, and outputting a first segment audio of the audio in response to a user input. Outputting a first segment audio synchronized with the first segment audio from among the first segment audio and English subtitles, outputting a second segment audio after the first segment audio, and a second segment audio of the second segment audio and English subtitles. and outputting a second English subtitle synchronized with the 2-segment audio.

According to an embodiment, extracting audio and English subtitles of the audio for learning English conversation from the database may include extracting English subtitles for the original language video or audio for learning English conversation from the database.

According to an embodiment, the method for providing English conversation lecture content further includes receiving a user input for a blank button in a toggle interface including a function for amplifying English subtitles, and among the first segment audio and English subtitles The outputting of the first English subtitle synchronized with the first segment audio includes outputting the first segment audio and the first English subtitle in which at least a portion of the first segment audio is displayed as a blank space.

According to an embodiment, the method for providing English conversation lecture content further includes receiving a user input for an important button in a toggle interface including a function for amplifying English subtitles, and among the first segment audio and English subtitles The outputting of the first English subtitle synchronized with the first segment audio includes outputting the first segment audio and at least a portion of the first English subtitle displayed as a highlight based on a user input for an important button.

According to one embodiment, the highlight may be associated with the accent of the English pronunciation of the first English subtitle.

According to an embodiment, the method of providing English conversation lecture content further includes re-outputting audio and English subtitles when the output second English subtitle is the last sentence of a paragraph.

According to an embodiment, a method for providing English conversation lecture contents includes receiving a user input for a summary button of a toggle interface including a function for amplifying English subtitles, and in response to the user input for the summary button, English subtitles. A step of outputting a summary of the summary and an image associated with the summary is further included.

According to an embodiment, the image includes a plurality of images, and the step of outputting a summary of the English subtitle and an image associated with the summary in response to a user input to a summary button includes displaying a summary of the English subtitle and an image associated with the summary. and outputting using a Flip-a-Clip effect.

According to an embodiment, the method of providing English conversation lecture content further includes receiving a user input for a pronunciation button of a toggle interface including a function for amplifying English subtitles, and among the first section audio and English subtitles Outputting the first English subtitle synchronized with the first segment audio may include generating a waveform visually representing the first segment audio and intonation of the first English subtitle based on a user input to a pronunciation button. 1 including the step of superimposing and outputting English subtitles.

According to another embodiment of the present disclosure, a computer program stored in a computer readable recording medium is provided to execute a method for providing English conversation lecture content on a computer.

According to another embodiment of the present disclosure, an apparatus for providing English conversation lecture contents includes at least one database including audio for learning English conversation and English subtitles of the audio, and at least one control unit, wherein the at least one control unit , Extracts audio and English subtitles of the audio for learning English conversation from at least one database, outputs the first section audio of the audio in response to a user input, and Execute commands for outputting a synchronized first English subtitle, outputting a second segment audio after the first segment audio, and outputting a second English subtitle synchronized with the second segment audio among the second segment audio and English subtitles. is configured to

According to an embodiment of the present disclosure, the user may induce the learner to focus more on listening to the pronunciation of a vocabulary associated with a part marked with a blank rather than a part not marked with a blank.

According to an embodiment of the present disclosure, in a conversation lecture through listening, the learner may induce the learner to listen more intensively to the main vocabulary parts covered by blanks.

According to an embodiment of the present disclosure, in a conversation lecture through reading subtitles, a learner may naturally induce a learner to pronounce a highlighted part strongly, so that the user naturally learns the stress inherent in English.

According to an embodiment of the present disclosure, the user first performs a conversation lecture on each sentence, and then confirms the entire paragraph including each sentence representing one subject to the learner again, thereby starting a conversation on a specific subject. You can improve your speaking ability.

1 illustrates an example of a user using an English conversation lecture content providing device according to an embodiment of the present disclosure.
2 is a schematic diagram illustrating a configuration in which an information processing system is communicatively connected to a plurality of user terminals in order to provide a service related to English conversation lecture contents according to an embodiment of the present disclosure.
3 is a schematic block diagram of an English conversation lecture content providing apparatus according to an embodiment of the present disclosure.
4 shows an example of managing a menu of English lecture content according to an embodiment of the present disclosure.
5 illustrates an example of selecting a language of a user interface according to an embodiment of the present disclosure.
6 illustrates an example of outputting video and subtitles according to an embodiment of the present disclosure.
7 illustrates an example of displaying and outputting a part of English subtitles with blank spaces according to an embodiment of the present disclosure.
8 illustrates an example of displaying and outputting a part of an English subtitle as a highlight according to an embodiment of the present disclosure.
9 illustrates an example of a case where an output caption is the last sentence of a specific paragraph according to an embodiment.
10 illustrates an example of outputting a summary sentence of an English subtitle and an image associated with the summary sentence according to an embodiment of the present disclosure.
11 shows an example of outputting a problem according to an embodiment of the present disclosure.
12 shows an example of a method for providing English conversation lecture content according to an embodiment of the present disclosure.

Hereinafter, specific details for the implementation of the present disclosure will be described in detail with reference to the accompanying drawings. However, in the following description, if there is a risk of unnecessarily obscuring the gist of the present disclosure, detailed descriptions of well-known functions or configurations will be omitted.

In the accompanying drawings, identical or corresponding elements are given the same reference numerals. In addition, in the description of the following embodiments, overlapping descriptions of the same or corresponding components may be omitted. However, omission of a description of a component does not intend that such a component is not included in an embodiment.

Advantages and features of the disclosed embodiments, and methods of achieving them, will become apparent with reference to the following embodiments in conjunction with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below and may be implemented in various different forms, but only the present embodiments make the present disclosure complete, and the present disclosure does not extend the scope of the invention to those skilled in the art. It is provided only for complete information.

Terms used in this specification will be briefly described, and the disclosed embodiments will be described in detail. The terms used in this specification have been selected from general terms that are currently widely used as much as possible while considering the functions in the present disclosure, but they may vary according to the intention of a person skilled in the related field, a precedent, or the emergence of new technologies. In addition, in a specific case, there is also a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the invention. Therefore, the terms used in the present disclosure should be defined based on the meaning of the terms and the general content of the present disclosure, not simply the names of the terms.

Expressions in the singular number in this specification include plural expressions unless the context clearly dictates that they are singular. Also, plural expressions include singular expressions unless the context clearly specifies that they are plural. When it is said that a certain part includes a certain component in the entire specification, this means that it may further include other components without excluding other components unless otherwise stated.

Also, the term 'module' or 'unit' used in the specification means a software or hardware component, and the 'module' or 'unit' performs certain roles. However, 'module' or 'unit' is not meant to be limited to software or hardware. A 'module' or 'unit' may be configured to reside in an addressable storage medium and may be configured to reproduce one or more processors. Thus, as an example, a 'module' or 'unit' includes components such as software components, object-oriented software components, class components, and task components, processes, functions, and attributes. , procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, or variables. Functions provided within components and 'modules' or 'units' may be combined into a smaller number of components and 'modules' or 'units', or further components and 'modules' or 'units'. can be further separated.

According to one embodiment of the present disclosure, a 'module' or 'unit' may be implemented with a processor and a memory. 'Processor' should be interpreted broadly to include general-purpose processors, central processing units (CPUs), microprocessors, digital signal processors (DSPs), controllers, microcontrollers, state machines, and the like. In some circumstances, 'processor' may refer to an application specific integrated circuit (ASIC), programmable logic device (PLD), field programmable gate array (FPGA), or the like. 'Processor' refers to a combination of processing devices, such as, for example, a combination of a DSP and a microprocessor, a combination of a plurality of microprocessors, a combination of one or more microprocessors in conjunction with a DSP core, or a combination of any other such configurations. You may. Also, 'memory' should be interpreted broadly to include any electronic component capable of storing electronic information. 'Memory' includes random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable-programmable read-only memory (EPROM), It may also refer to various types of processor-readable media, such as electrically erasable PROM (EEPROM), flash memory, magnetic or optical data storage, registers, and the like. A memory is said to be in electronic communication with the processor if the processor can read information from and/or write information to the memory. Memory integrated with the processor is in electronic communication with the processor.

1 illustrates an example in which a user 100 uses an English conversation lecture content providing device 110 according to an embodiment of the present disclosure. As illustrated, the user 100 may create/provide English conversation lecture contents through the English conversation lecture contents providing device (or user terminal) 120 . In addition, the user 100 may conduct an English conversation lecture using the English conversation lecture content providing device 110 .

According to an embodiment, the user 100 may output audio for learning English conversation and English subtitles of the audio through the user interface 120 . Here, the audio for learning English conversation may include audio of foreign dramas, news, movies, etc. composed of English. The user 100 outputs the audio of a specific section without subtitles through the user interface 120, and then outputs the audio of the corresponding section with subtitles to provide a conversation lecture through listening and speaking and reading.

According to an embodiment, the user 100 may output at least a part of the English subtitle through the user interface 120 as a blank space. When the user 100 wants to learn the pronunciation of a specific vocabulary in English subtitles composed of one sentence, the user 100 may output English subtitles in which the corresponding vocabulary part is marked with a blank space. With this configuration, the user 100 can induce the learner to focus more on listening to the pronunciation of the vocabulary associated with the part marked with a blank rather than the part not marked with a blank.

According to an embodiment, the user 100 may display and output at least a portion of the English subtitle as a highlight through the user interface 120 . For example, when the user 100 wants to visually emphasize the stress of a specific part in the English subtitle consisting of one sentence, the English subtitle with the corresponding part highlighted can be output. With this configuration, the user can induce the learner to more intensively listen to the main vocabulary parts covered by blanks in conversation lectures through listening.

2 is a schematic diagram illustrating a configuration in which an information processing system 230 is communicatively connected to a plurality of user terminals 210_1, 210_2, and 210_3 in order to provide a service related to English conversation lecture contents according to an embodiment of the present disclosure. . Here, the user terminals 210_1, 210_2, and 210_3 may correspond to an English conversation lecture content providing device. The information processing system 230 may include system(s) capable of providing services related to English conversation lecture contents through the network 220 . In one embodiment, the information processing system 230 includes one or more server devices and/or databases capable of storing, providing, and executing computer-executable programs (eg, downloadable applications) and data related to English conversation lecture contents; or one or more distributed computing devices and/or distributed databases based on cloud computing services. For example, the information processing system 230 may include separate systems (eg, servers) for providing services related to English conversation lecture contents. The service related to English conversation lecture contents provided by the information processing system 230 is provided to the user (eg, through an application for English conversation lecture contents or a web browser application installed in each of the plurality of user terminals 210_1, 210_2, and 210_3). For example, a user, etc.) may be provided.

The plurality of user terminals 210_1 , 210_2 , and 210_3 (or English conversation lecture content providing devices) may communicate with the information processing system 230 through the network 220 . The network 220 may be configured to enable communication between the plurality of user terminals 210_1, 210_2, and 210_3 and the information processing system 230. Depending on the installation environment, the network 220 may be, for example, a wired network such as Ethernet, a wired home network (Power Line Communication), a telephone line communication device and RS-serial communication, a mobile communication network, a wireless LAN (WLAN), It may consist of a wireless network such as Wi-Fi, Bluetooth, and ZigBee, or a combination thereof. The communication method is not limited, and the user terminals (210_1, 210_2, 210_3) as well as a communication method utilizing a communication network (eg, mobile communication network, wired Internet, wireless Internet, broadcasting network, satellite network, etc.) that the network 220 may include ), short-range wireless communication between them may also be included.

In FIG. 2, a mobile phone terminal 210_1, a tablet terminal 210_2, and a PC terminal 210_3 are illustrated as examples of user terminals, but are not limited thereto, and the user terminals 210_1, 210_2, and 210_3 may perform wired and/or wireless communication. This is possible and may be any computing device equipped with an image sensor. For example, the user terminal includes a smartphone, a mobile phone, a navigation device, a computer, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet PC, a game console, and a wearable device ( wearable device), internet of things (IoT) device, virtual reality (VR) device, augmented reality (AR) device, and the like. In addition, although three user terminals 210_1, 210_2, and 210_3 are shown in FIG. 2 to communicate with the information processing system 230 through the network 220, it is not limited thereto, and a different number of user terminals may be connected to the network ( 220) to communicate with the information processing system 230. The plurality of user terminals 210_1, 210_2, and 210_3 may be user terminals of users using the English conversation lecture content service.

3 is a schematic block diagram of an English conversation lecture content providing apparatus 300 according to an embodiment of the present disclosure. The English conversation lecture content providing device 300 may refer to any computing device capable of executing an application for English conversation lecture content, a web browser application, etc. and capable of wired/wireless communication. For example, the mobile phone of FIG. 2 It may include a terminal 210_1, a tablet terminal 210_2, a PC terminal 210_3, and the like. As shown, the English conversation lecture content providing device 300 may include a communication unit 310, a controller 320, a display device 330, and a database 340. In one embodiment, the English conversation lecture content providing device 300 may correspond to the user terminal 210 shown in FIG. 2 . Here, the controller 320 may include at least one processor and memory. Also, the display device 330 may include an audio output device in addition to the display.

The communication unit 310 has a configuration or function for communicating with the English conversation lecture content providing device 300 and the information processing system (eg, 230 in FIG. 2) through a network (eg, 220 in FIG. 2). and a configuration or function for the English conversation lecture content providing device 300 and/or the information processing system to communicate with other user terminals or other systems (for example, a separate cloud system). As an example, a request or data generated by the control unit 320 of the apparatus for providing English conversation lecture contents 300 according to a program code stored in a recording device such as the database 340 (for example, for controlling English conversation lecture contents) request, image data, video data, etc.) may be transferred to the information processing system through a network under the control of the communication unit 310 .

The English conversation lecture content providing device 300 may communicate with an external device such as an external server (eg, 230 in FIG. 2 ) related to an English conversation lecture content providing service through the communication unit 310 . The communication unit 310 is configured to communicate with an external device such as a user terminal or an external server through a network and may receive English conversation lecture contents stored in the external device. Depending on the installation environment, the communication unit 310 may, for example, wired networks such as Ethernet, wired home networks (Power Line Communication), telephone line communication devices and RS-serial communication, or WLAN (Wireless LAN), Bluetooth and ZigBee ( A wireless network such as ZigBee) can be selected and configured in various ways.

The controller 320 may be configured to process commands of a computer program by performing basic arithmetic, logic, and input/output operations. Commands may be provided to the controller 320 by the database 340 or the communication unit 310 . For example, the controller 320 may be configured to execute commands received according to program codes stored in a recording device such as the database 340 .

According to an embodiment, the controller 320 may be configured to operate an application for English conversation lecture content or a web browser application. At this time, a program code associated with the corresponding application may be loaded into the database 340 of the English conversation lecture content providing device 300 . While the application is running, the control unit 320 of the English conversation lecture content providing device 300 receives information and/or data provided from an input/output device (not shown) connected to the English conversation lecture content providing device 300 by wire/wireless connection. It may be received through the display device 330, and the received information and/or data (eg, the instructor's handwriting input, etc.) may be processed and stored in the database 340. Also, such information and/or data may be provided to the information processing system through the communication unit 310 .

While an application for English conversation lecture content or a web browser application is operating, the controller 320 may use a touch screen connected to the English conversation lecture content providing device 300, a keyboard, a camera including an audio sensor and/or an image sensor, a microphone, etc. A user input may be received through an input device, and a control signal may be generated based on the user input to control the operation of the display device 330 . For example, based on user input, a user interface related to English conversation lecture content may be output on the display device 330, or an already output user interface may be changed/edited and re-outputted. For another example, based on the user input received through the above-described touch screen, keyboard, etc., an image, text, etc. may be output to the display device 330 .

Database 340 may include any non-transitory computer readable storage medium. According to one embodiment, the database 340 is a non-perishable mass storage device (permanent mass storage device) such as random access memory (RAM), read only memory (ROM), disk drive, solid state drive (SSD), flash memory, etc. mass storage device). As another example, a non-perishable mass storage device such as ROM, SSD, flash memory, disk drive, etc. may be included in the English conversation lecture content providing device 300 as a separate permanent storage device distinct from memory. In addition, the database 340 may store an operating system and at least one program code (eg, a code for an English conversation lecture content application that is installed and driven in the English conversation lecture content providing device 300).

These software components may be loaded from a computer readable recording medium separate from the database 340 . A recording medium readable by such a separate computer may include a recording medium directly connectable to the English conversation lecture content providing device 300, for example, a floppy drive, a disk, a tape, a DVD/CD-ROM drive, It may include a computer-readable recording medium such as a memory card. As another example, the software components may be loaded into the database 340 through the communication unit 310 rather than a computer-readable recording medium. For example, the at least one program is a computer program installed by developers or files provided by a file distribution system for distributing an application installation file through a network (eg, 220 in FIG. 2 ) (eg, , Application for English conversation lecture contents) may be loaded into the database 340.

The English conversation lecture content providing device 300 may include more components than those shown in FIG. 3 . However, there is no need to clearly show most of the prior art components. According to an embodiment, the apparatus 300 for providing content for English conversation lectures may further include other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, and a database. For example, when the English conversation lecture content providing device 300 is a smartphone, it may include components that are generally included in a smartphone, for example, an acceleration sensor, a gyro sensor, a camera module, and various physical components. Various components such as an in button, a button using a touch panel, an input/output port, and a vibrator for vibration may be implemented such that the English conversation lecture content providing device 300 is further included.

4 shows an example of managing a menu of English lecture content according to an embodiment of the present disclosure. As shown, the first operation step 410 represents an example in which the processor adds 'conversation' to the menu of English lecture content. According to one embodiment, when 'conversation' is input to the menu input interface 412, the display device may add 'conversation' to the menu of English lecture content in response to a user input to the menu addition button 414. there is.

The second operation step 420 represents an example of setting a sub-menu of English lecture content associated with the added menu. According to an embodiment, the display device may change one submenu among a plurality of submenus of English conversation lecture contents based on a user input to the submenu change interface 422 . For example, the display device sets a first submenu (or 'first menu') among a plurality of submenus of English conversation lecture contents to 'diagram+sentence' based on a user input to the submenu change interface 422. can be changed to 'video + text'. Accordingly, the display device may extract an image for an English conversation lecture and an English sentence (or subtitle) of the corresponding image from a database (eg, 340 in FIG. 3 ). For another example, the display device converts a first submenu (or 'first menu') among a plurality of submenus of English conversation lecture content to 'audio+sentence' based on a user input to the submenu change interface 422. '. Accordingly, the display device may extract audio for the English conversation lecture and subtitles of the corresponding audio from the database. That is, based on a user input to the sub-menu change interface 422, the type of content included in the English conversation lecture content may be changed. Additionally, the display device may change the number of submenus of the English lecture content associated with the added menu. For example, the display device may change the number of submenus of the English conversation lecture content from 5 to 4 in response to a user input to the interface for setting the number of submenus 426 .

5 illustrates an example of selecting a language of a user interface according to an embodiment of the present disclosure. According to an embodiment, the display device selects a language of a user interface (eg, skin, icon, button, etc.) or a language of subtitles based on a user input to the language selection interfaces 510 and 520. can be set For example, when 'Korean' is selected in the software language selection interface 510, the language of skins, icons, and buttons may be displayed in Korean. For another example, when 'Korean' is selected in the auxiliary language selection interface 520, auxiliary learning content (eg, annotation, structure, summary, vocabulary, grammar, literal translation, paraphrase, etc.) can be displayed in Korean. Hereinafter, examples in which 'Korean' is selected as both the software language and the auxiliary language are shown in FIGS. 6 to 12, but are not limited thereto. For example, 'Korean', 'Vietnamese', 'Thai', 'English', 'Chinese', and 'Japanese' may be selected in the language selection interfaces 510 and 520 .

6 illustrates an example of outputting audio and subtitles according to an embodiment of the present disclosure. According to one embodiment, the display device provides audio for learning English conversation and corresponding audio from a database (eg, 340 in FIG. 3 ) based on settings for the menu and submenu of the English lecture content described above with reference to FIG. 4 . It is possible to extract/output English conversation lecture contents including English subtitles. For example, when the 'conversation' menu is added and the 'first menu' (or 'concept') of the 'conversation' menu is set to 'audio+sentence', the display device is displayed in the English conversation lecture selection interface 616. In response to a user input for selecting 'concept', English conversation lecture contents including audio for learning English conversation and English subtitles of the corresponding audio may be output.

According to an embodiment, the display device may output a first section audio among audio in response to a user input in a first operation step 610 . Here, the user input may refer to a user input received from an input device (eg, mouse, keyboard, stylus pen, etc.) connected to the display device. Then, the display device may output a first English subtitle 622 synchronized with the first section audio among the first section audio and the English subtitle in a second operation step 620 . That is, in the first operation step 610, after outputting the first segment audio without subtitles, in the second operation step 620, the first segment audio is converted into first English subtitles 622, which are English subtitles of the first segment audio, and can be printed together. In this case, the first segment audio and the first English subtitle 622 may be composed of audio and subtitles for one sentence ('I had a big argument with Daived yesterday.').

According to one embodiment, the display device may output an image 612 associated with audio. For example, if the audio is the audio of an American drama, a representative image of the corresponding American drama may be output as the image 612 . In this case, the image 612 may be tagged with a tag 614 . Additionally, the display device may output media content (eg, audio, image, video, etc.) associated with the image 612 in response to a user input to the tag 614 . For example, the display device may output media content including information such as a trailer of an American drama, character information, and a summary in response to a user input to the tag 614 .

According to an embodiment, the display device may output the second segment audio after the first segment audio in step 630 of the third operation. Then, the display device re-outputs the second section video 632 of the video in a fourth operation step 640, and outputs the second English subtitle 642 synchronized with the second section video 632 of the English subtitles. can do. That is, similar to the case of the first segment audio, after outputting the second segment audio without subtitles in the third operation step 630, the English subtitle of the second segment audio second segment audio is performed in the fourth operation step 640. may be output together with the second English subtitle 642. In this case, the second segment audio and the second English subtitle 642 may include audio and subtitles for one sentence ('What did you argue about?').

7 illustrates an example of displaying and outputting parts of English subtitles 714 and 724 as blank spaces 718 and 726 according to an embodiment of the present disclosure. According to an embodiment, the display device may output a toggle interface 712_1 including a function for amplifying English subtitles 714 and 724 . As shown, the toggle interface 712_1 may include a 'blank' button 712_2. In this case, at least one button included in the toggle interface 712_1 may be configured to turn on/off each function for amplifying the English subtitles 714 and 724. Meanwhile, the first operation step 610 and the second operation step 620 of FIG. 6 may include the second operation step 720 and the fourth operation step 740 of FIG. 7 , respectively.

According to an embodiment, the display device may receive a user input for a 'blank' button 712_2 of the toggle interface 712_1. Then, the display device may (re)output the audio of the first segment in the first operation step 710, display at least a part of the first English subtitle 714 as a first blank 718, and output the output. For example, as shown, the 'a big argument' part, which is at least a part of the first English subtitle 714 'I had a big argument with Daived yesterday.', may be displayed as a first blank 718 and output. Similarly, the display device (re)outputs the second segment audio after the first segment audio in the second operation step 720, and displays at least a part of the second English subtitle 724 as a second blank 726. can be printed out. For example, as illustrated, the 'argue' part, which is at least a part of the second English subtitle 724 'What did you argue about?', may be displayed as a second blank 726 and output. With this configuration, the user can induce the learner to infer an appropriate word for the blank through listening.

8 illustrates an example of displaying and outputting a part of English subtitles 814 and 822 as highlights 818_1 to 818_4, 824_1 and 824_2 according to an embodiment of the present disclosure. As shown, the toggle interface 812_1 may include an 'important' button 812_2. Meanwhile, the first operation step 810 and the second operation step 820 of FIG. 7 may include the second operation step 620 and the fourth operation step 640 of FIG. 6 , respectively.

According to an embodiment, the display device may receive a user input for the 'important' button 812_2 included in the toggle interface 812_1. Then, in the first operation step 810, the display device (re)outputs the first section audio based on the user input to the 'important' button 812_2 and displays at least a part of the first English subtitle 814. It can be displayed and output as highlights (818_1 to 818_4). For example, as illustrated, 'big', 'ar', 'Dai', and 'ye', which are at least a part of the first English subtitle 814 'I had a big argument with Daived yesterday.', are respectively first highlighted. (818_1) to the fourth highlight (818_4) can be displayed and output. In this case, the highlights 818_1 to 818_4 may be related to the stress of English pronunciation of the first English subtitle 814 . Similarly, the display device (re)outputs the second segment audio after the first segment audio in the second operation step 820, and displays at least a part of the second English subtitle 822 as highlights 824_1 and 824_2. can be printed out. For example, as illustrated, at least parts of 'arg' and 'bout' of the second English subtitle 822 'What did you argue about?' are converted to a fifth highlight 824_1 and a sixth highlight 824_2, respectively. can be displayed and printed. In this case, the highlights 824_1 and 824_2 may be related to the stress of the English pronunciation of the second English subtitle 822 . With this configuration, the learner is induced to pronounce the highlighted part strongly in the process of conversation learning through reading subtitles, so that the learner can naturally learn the stress inherent in English.

Alternatively, the display device (re)outputs the first segment audio based on the user input to the 'important' button 812_2 in the first operation step 810, and the subject, verb, object, and bore are different from each other. A first English subtitle 815 displayed in color may be output. For example, in the first English subtitle 814 'I had a big argument with Daived yesterday.', the subject 'I' is displayed in red, the verb 'had' is displayed in yellow, and the object 'a big argument' is displayed in blue. It can be. With this configuration, the user can make the learner recognize the sentence form (eg, English form 1 to 5) using visual effects.

Additionally, the display device may receive a user input for a 'pronunciation' button (not shown) included in the toggle interface 812_1. In this case, in the first operation step 810, the display device provides a first waveform 818_5 visually representing the intonation (or accent of pronunciation) of the first English subtitle 814 to the first English subtitle 814. You can output overlapping. In addition, the display device superimposes a second waveform 824_3 visually representing the intonation (or accent of pronunciation) of the second English subtitle 822 on the second English subtitle 824 in the second operation step 820. can be printed out. With this configuration, the user can learn English's unique accent to the learner using visual effects.

9 illustrates an example of a case in which the output caption 912 is the last sentence of a specific paragraph according to an embodiment. According to an embodiment, the plurality of subtitles 922_1 to 922_3 of the image 924 for English conversation extracted from a database (eg, 340 in FIG. 3 ) may constitute at least one paragraph. Here, a 'paragraph' may refer to a lump (or part of a text) including a plurality of sentences representing one subject.

According to an embodiment, the display device may (re)output a third segment audio after the second segment audio and a third caption 912 that is an English subtitle of the third segment audio in the first operation step 910. . Here, the third subtitle 912 is a paragraph including a first English subtitle (eg, 622 in FIG. 6 ), a second English subtitle (eg, 642 in FIG. 6 ), and a third subtitle 912 . It could be the last sentence. In this case, the display device may re-output audio including the first segment audio, the second segment audio, and the third segment audio and audio subtitles 922_1 to 922_3 in the second operation step 920 . With this configuration, the user first conducts a conversation lecture on each sentence, and then confirms the entire paragraph including each sentence representing one topic to the learner again, so that the user has the conversation ability to exchange conversations about a specific topic. can improve

According to an embodiment, the display device controls playback of audio for the first segment audio, the second segment audio, and the third segment audio at positions corresponding to the subtitles 922_1 to 922_3, respectively. Playback interfaces 926_1 to 926_3 may be output. In this case, the display device may output audio of a section associated with one of the audio interfaces in response to a user input to one of the plurality of section reproduction interfaces 926_1 to 926_3. For example, in response to a user input to the first section playback interface 926_1, the display device displays audio (or video) and audio (or video) of the first section video associated with the first section playback interface 926_1. ) subtitles can be output. For another example, the display device may respond to a user input to the third section playback interface 926_3, and audio (or video) and audio (or, video) subtitles can be output. Additionally or alternatively, the display device applies a TTS (Text to Speech) function to subtitles associated with one interface in response to a user input to one of the plurality of section reproduction interfaces 926_1 to 926_3 to create/create/ Converted audio can be output.

10 illustrates an example of outputting a summary sentence 1018_1 of an English subtitle 1016 and an image 1018_2 associated with the summary sentence 1018_1 according to an embodiment of the present disclosure. According to an embodiment, the display device may receive a user input for a 'summary' button 1014 of the toggle interface 1012 including a function for amplifying the English subtitles 1016. Then, the display device may output a summary sentence 1018_1 of the English subtitle 1016 and an image 1018_2 associated with the summary sentence 1018_1 in response to a user input to the 'summary' button 1014. For example, if the English subtitle 1016 is 'conversation about a financial dispute with a friend', the display device responds to a user input to the 'Summary' button 1014 to display English subtitles 1016. At the bottom of the summary sentence 1018_1, 'a situation in which a friend quarreled over money' can be output, and an image 1018_2 reminiscent of the summary sentence 1018_1 can be output. 10 shows that one image 1018_2 reminiscent of the summary sentence 1018_1 is output, but is not limited thereto. For example, the display device may output a plurality of images reminiscent of the summary sentence 1018_1. In this case, the display device may output a plurality of images using an animation effect (eg, flip-a-clip).

11 shows an example of outputting a problem 1120 according to an embodiment of the present disclosure. According to one embodiment, the display device outputs a problem for learning English conversation from a database (eg, 340 in FIG. 3 ) based on the settings for the menu and submenu of the English lecture content described above with reference to FIG. 4 . can For example, when a 'conversation' menu is added and the 'fourth menu' (or 'practice A') of the 'conversation' menu is set to 'practice problem control', the display device displays an English conversation lecture selection interface 1110 In response to a user input selecting 'Practice A' in , a problem 1120 for learning English conversation may be output. Here, the problem 1120 may refer to a problem 1120 related to video and English subtitles included in the English conversation lecture content of the 'Concept' menu described above with reference to FIGS. 6 to 10 .

According to an embodiment, the display device may receive a user input for selecting 'TYPE A' from the type setting interface 1130 . In this case, the display device may output audio generated/converted using a text to speech (TTS) function to the problem 1120 together with the problem 1120. After a predetermined time elapses from the end of audio reproduction, the display device may output a correct answer interface 1150 indicating the correct answer to the question 1120 . Additionally, the display device may output a clock effect sound for indicating the passage of time while a predetermined time elapses from when audio playback is finished.

According to an embodiment, the display device may output question information 1160 of the question 1120. For example, the display device may output the type of question 1120, the frequency of questioning, the reason for questioning, importance, and the like. Additionally, the display device may output an explanation of problem 1120. For example, the display device may output a pop-up window displaying a commentary on the problem 1120 in response to a user input to the commentary button 1170 . In this case, the description of the problem 1120 may include at least one of an image, diagram, photograph, video, or map related to the problem 1120 .

According to an embodiment, the display device may receive a user input for selecting 'TYPE B' from the type setting interface 1130 . In this case, the display device may output the problem 1120 without the aforementioned audio. After a predetermined time elapses from when the question 1120 is output, the display device may output a correct answer interface 1150 indicating the correct answer to the question 1120 .

In FIG. 11, it is shown that the 'actual' problem is output as the problem 1120, but is not limited thereto. The display device may output a linking question in response to a user input for selecting 'association' in the question type selection interface 1140 . Here, the 'practical' problem may refer to a problem composed of the same text as the English subtitle included in the content of the English conversation lecture of the 'concept' menu described above with reference to FIGS. 6 to 10 . In addition, the 'association' problem may refer to a problem composed of passages related to the corresponding English subtitle.

Additionally, although not shown in FIG. 11 , the display device may output a problem 1120 and an image related to the problem 1120 . Here, the image associated with the problem 1120 may refer to an image (eg, US news, movie, drama, etc.) including information necessary for solving the problem 1120. Alternatively, the display device may output problem 1120 and images associated with problem 1120 .

12 shows an example of a method 1200 for providing English conversation lecture contents according to an embodiment of the present disclosure. The method 1200 may be performed by at least one control unit of an English conversation lecture content providing device (or user terminal). As shown, the method 1200 may start with extracting audio and English subtitles of the audio for learning English conversation from a database (S1210).

According to an embodiment, the display device may output audio of the first segment of audio in response to a user input (S1220). Then, among the first segment audio and English subtitles, the first English subtitle synchronized with the first segment audio may be output (S1230). In this case, the display device may receive a user input for a blank button among toggle interfaces including a function for amplifying English subtitles. Accordingly, the display device may output the first segment audio and the first English subtitle in which at least a part is displayed as a blank space based on a user input to the blank button. Also, the display device may receive a user input for an important button of a toggle interface including a function for amplifying English subtitles. Accordingly, the display device may output the first segment audio and the first English subtitle, at least partially of which is displayed as a highlight, based on the user input for the important button. Here, the highlight may be related to the stress of English pronunciation of the first English subtitle.

According to an embodiment, the display device may receive a user input for a summary button of a toggle interface including a function for amplifying English subtitles. Then, the display device may output a summary of the English subtitle and an image associated with the summary in response to a user input on the summary button. In this case, the image includes a plurality of images, and the display device may output the summary sentence of the English subtitle and an image associated with the summary sentence using a flip-a-clip effect.

According to an embodiment, the display device may receive a user input for a pronunciation button of a toggle interface including a function for amplifying English subtitles. In this case, the display device may superimpose and output waveforms representing the intonation of the first segment audio and the first English subtitle on the first English subtitle based on the user input to the pronunciation button.

According to an embodiment, the display device may output the second segment audio after the first segment audio (S1240). Then, the display device may output the second English subtitle synchronized with the second section audio among the second section audio and the English subtitle (S1250). Here, the display device may re-output audio and English subtitles when the output second English subtitle is the last sentence of a paragraph.

The methods, acts or techniques of this disclosure may be implemented by various means. For example, these techniques may be implemented in hardware, firmware, software, or combinations thereof. Those skilled in the art will appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchange of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the particular application and the design requirements imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementations should not be interpreted as causing a departure from the scope of the present disclosure.

In a hardware implementation, the processing units used to perform the techniques may include one or more ASICs, DSPs, digital signal processing devices (DSPDs), programmable logic devices (PLDs) ), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, and other electronic units designed to perform the functions described in this disclosure. , a computer, or a combination thereof.

Accordingly, the various illustrative logical blocks, modules, and circuits described in connection with this disclosure may be incorporated into a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or may be implemented or performed in any combination of those designed to perform the functions described in A general purpose display device may be a microprocessor, but in the alternative, a display device may be any conventional processor, controller, microcontroller, or state machine. A display device may also be implemented as a combination of computing devices, eg, a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other configuration.

In firmware and/or software implementation, the techniques include random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), PROM ( on a computer readable medium, such as programmable read-only memory (EPROM), erasable programmable read-only memory (EPROM), electrically erasable PROM (EEPROM), flash memory, compact disc (CD), magnetic or optical data storage device, or the like. It can also be implemented as stored instructions. Instructions may be executable by one or more processors and may cause the processor(s) to perform certain aspects of the functionality described in this disclosure.

If implemented in software, the techniques may be stored on or transmitted over as one or more instructions or code on a computer readable medium. Computer readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a computer. By way of non-limiting example, such computer readable media may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or desired program code in the form of instructions or data structures. It can be used for transport or storage to and can include any other medium that can be accessed by a computer. Also, any connection is properly termed a computer-readable medium.

For example, if the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, the coaxial cable , fiber optic cable, twisted pair, digital subscriber line, or wireless technologies such as infrared, radio, and microwave are included within the definition of medium. Disk and disc as used herein include CD, laser disc, optical disc, digital versatile disc (DVD), floppy disk, and blu-ray disc, where disks are usually magnetic data is reproduced optically, whereas discs reproduce data optically using a laser. Combinations of the above should also be included within the scope of computer readable media.

A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium can be coupled to the processor such that the processor can read information from or write information to the storage medium. Alternatively, the storage medium may be integral to the processor. The processor and storage medium may reside within an ASIC. An ASIC may exist within a user terminal. Alternatively, the processor and storage medium may exist as separate components in a user terminal.

Although the embodiments described above have been described as utilizing aspects of the presently-disclosed subject matter in one or more stand-alone computer systems, the disclosure is not limited thereto and may be implemented in conjunction with any computing environment, such as a network or distributed computing environment. . Further, aspects of the subject matter in this disclosure may be implemented in a plurality of processing chips or devices, and storage may be similarly affected across multiple devices. These devices may include PCs, network servers, and portable devices.

Although the present disclosure has been described in relation to some embodiments in this specification, various modifications and changes may be made without departing from the scope of the present disclosure that can be understood by those skilled in the art. Moreover, such modifications and variations are intended to fall within the scope of the claims appended hereto.

100: user
110: English conversation lecture content providing device
120: user interface

Claims (10)

In the method of providing English conversation lecture contents,
Extracting audio for learning English conversation and English subtitles of the audio from the database;
outputting first section audio of the audio in response to a user input;
outputting a first English subtitle synchronized with the first segment audio among the first segment audio and the English subtitle;
outputting a second segment audio after the first segment audio; and
Outputting a second English subtitle synchronized with the second segment audio among the second segment audio and the English subtitle
Including, method.
According to claim 1,
Receiving a user input for a blank button in a toggle interface including a function for amplifying the English subtitles
Including more,
The step of outputting a first English subtitle synchronized with the first segment audio among the first segment audio and the English subtitle,
Based on a user input to the blank button, outputting the first segment audio and the first English subtitle in which at least a part is displayed as a blank space;
Including, method.
According to claim 1,
Receiving a user input for an important button in a toggle interface including a function for amplifying the English subtitle
Including more,
The step of outputting a first English subtitle synchronized with the first segment audio among the first segment audio and the English subtitle,
Outputting the first segment audio and the first English subtitle, at least a part of which is displayed as a highlight, based on a user input for the important button.
Including, method.
According to claim 3,
wherein the highlight is associated with an accent of the English pronunciation of the first English subtitle.
According to claim 1,
re-outputting the audio and the English subtitle when the output second English subtitle is the last sentence of a paragraph
Further comprising a method.
According to claim 1,
receiving a user input for a summary button of a toggle interface including a function for amplifying the English subtitle; and
In response to a user input to the summary button, outputting a summary of the English subtitle and an image associated with the summary
Further comprising a method.
According to claim 6,
The image includes a plurality of images,
The step of outputting a summary of the English subtitle and an image associated with the summary in response to a user input to the summary button,
Outputting a summary of the English subtitle and an image related to the summary using a Flip-a-Clip effect
According to claim 1,
Receiving a user input for a pronunciation button of a toggle interface including a function for amplifying the English subtitles
Including more,
The step of outputting a first English subtitle synchronized with the first segment audio among the first segment audio and the English subtitle,
Based on a user input to the pronunciation button, outputting a waveform visually representing the intonation of the audio of the first segment and the first English subtitle by superimposing it on the first English subtitle.
Including, method.
A computer program stored in a computer readable recording medium to execute the method according to any one of claims 1 to 8 on a computer.
In the English conversation lecture content providing device,
at least one database including audio for learning English conversation and English subtitles of the audio; and
including at least one control unit;
The at least one control unit,
Extracting the audio and the English subtitle of the audio for learning English conversation from the at least one database;

In response to a user input, outputting a first segment audio of the audio;
Outputting a first English subtitle synchronized with the first section audio among the first section audio and the English subtitle;
Outputting a second segment audio after the first segment audio;
An English conversation lecture content providing device configured to execute commands for outputting a second English subtitle synchronized with the second section audio among the second section audio and the English subtitle.

Images