KR102105886B1 - Apparatus for Providing Lecture Service and Driving Method Thereof - Google Patents

Abstract

The present invention relates to an apparatus for providing a lecture service and a method for driving the apparatus, and an apparatus for providing a lecture service according to an embodiment of the present invention stores and matches the contents of questions and responses made between lecturers and participants in a lecture hall to specified lecture materials And a control unit that controls the storage unit to edit and re-store the stored query and response contents based on the edit information related to the query and response contents designated by the lecturer using the user device. Can be edited on the basis of the edit information specified before or during the lecture in the lecturer's user device.

Description

Apparatus for Providing Lecture Service and Driving Method Thereof}

The present invention relates to an apparatus for providing a lecture service and a method for driving the apparatus, and more specifically, a lecture service providing apparatus capable of freely editing conversation contents such as questions, responses, and discussions exchanged with participants during the lecture, and more specifically, It relates to a method of driving the device.

Recently, research on portable terminals such as smartphones and notebooks and development of related programs have been actively conducted, and these portable terminals are used as a means to show materials to attendees of lectures or seminars. As an example, after the lecture is over, people who attend related lectures or seminars are provided with printouts such as a predetermined PowerPoint (PPT) or data such as PDF (PDF) using the Internet.

However, conventionally, in a limited time and space, in many cases, it is necessary to search in addition to the prepared lecture data during the lecturer's lecture, but in the absence of multimedia equipment, it is difficult to search, or there is a hassle of conducting a search for each lecturer or individual.

Also, even if multimedia equipment is provided, attendees often miss part of the lecture due to actions such as taking notes on the material other than the data, and if there are the same lectures from other institutions, questions are asked at each lecture There is also a need for a wider and deeper lecture by gathering the discussion and bringing it to the lecturer.

Furthermore, recently, there is a need for further study in order to maximize the effectiveness of lectures by attending lectures more interestingly.

KR Publication No. 10-2009-0014088 (2009.02.06) KR registered patent No. 10-1215942 (2012.12.20) KR registered patent No. 10-1205388 (2012.11.21)

An object of the present invention is to provide a lecture service providing apparatus and a method of driving the apparatus for freely editing dialogue contents such as questions, responses, and discussions exchanged with participants during a lecture.

The lecture service providing apparatus according to an embodiment of the present invention includes a storage unit for matching and storing the contents of questions and responses made between lecturers and attendees in a given lecture material, and the query specified by the lecturer using a user device and And a control unit controlling the storage unit to edit and resave the stored query and response content based on the edit information related to the response content, wherein the control unit designates the edit to be specified before or during a lecture in the lecturer's user device. Edit based on information.

The control unit may be edited based on the edit information provided after the lecture by the lecturer's user device, and input from at least one of the lecturer's mobile phone, laptop computer, tablet PC, and microphone used as the user device. The editing information can be used.

The control unit may use information related to at least one of the lecturer's joke and personal opinion as the editing information.

The lecture service providing apparatus may further include a communication interface unit that provides the query and response contents in real time to the user device of the attendee or the user device of the lecture hall under the control of the controller.

The control unit may control the communication interface unit to provide the lecture material including the query and response contents re-stored in the storage unit to the user device of the attendee after the lecture is finished.

In addition, the method of driving a lecture service providing apparatus according to an embodiment of the present invention is a method of driving a lecture service providing apparatus including a storage unit and a control unit, and the designated lecture and inquiry content between lecturers and attendees of a lecture hall are designated. Matching and storing in the storage unit, and allowing the control unit to edit and resave the stored query and response contents based on the edit information related to the query and response contents designated by the lecturer using a user device And controlling the storage unit, wherein the controlling step edits the user information of the lecturer based on the edit information specified before or during the lecture.

The controlling step can be edited based on the edit information provided after the lecture by the lecturer's user device, and is used in at least one of the lecturer's mobile phone, laptop computer, tablet PC, and microphone used as the user device. The inputted editing information can be used.

In the controlling step, information related to at least one of a joke and a personal opinion of the lecturer may be used as the editing information.

The driving method of the lecture service providing device may further include providing the query and response contents in real time to the user device of the attendee or the user device of the lecture hall.

The controlling may include providing the lecture material including the query and response contents re-stored in the storage unit to the user device of the attendee after the lecture is finished.

According to an embodiment of the present invention, even if the lecturer is in or after the lecture, it is possible to induce the interest of the participants because the lecture material can be freely edited by using questions or responses in real time exchanged with the participants during the lecture, and furthermore, the content of the discussion can be freely edited. As a result, attendees can focus their attention, maximizing the effectiveness of the lecture.

1 is a view showing a lecture service system according to an embodiment of the present invention,
Figure 2 is a block diagram showing the structure of the lecture service providing apparatus of Figure 1,
Figure 3 is a block diagram showing another structure of the lecture service providing apparatus of Figure 1,
Figure 4 is a block diagram showing the structure of the lecture data generation unit of Figure 3,
5 is a view for explaining an editing process according to an embodiment of the present invention, and
6 is a flowchart illustrating a process of driving a lecture service providing apparatus according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

1 is a view showing a lecture service system according to an embodiment of the present invention.

As shown in FIG. 1, the lecture service system 90 according to an embodiment of the present invention includes the user devices 100 and 110, the communication network 120, the content providing device 130 and the lecture service providing device 140. Includes some or all.

Here, "including some or all" means that some of the components such as the attendee user device 110 or the content providing device 130 that constitute the user devices 100 and 110 are omitted, and the lecture service system 90 is used. It is configured or means that some components, such as a lecture service providing device 140, may be included in a network device constituting the communication network 120, and the like, and are described as including all in order to help the understanding of the present invention. do.

The user devices 100 and 110 are lecturer user devices (hereinafter referred to as first user devices) 100 used by lecturers for lectures and attendee user devices (hereinafter referred to as second user devices) 110 used by attendees of the lecture hall. It includes, it may further include a third user device, such as a screen device provided in the lecture hall. The user devices 100 and 110 include a microphone (hereinafter, a microphone), a smart phone, a laptop computer, a tablet PC, and the like, and may include at least one device. Here, a smart phone, a laptop computer, a tablet PC, a screen device, etc., may include a microphone or operate in conjunction. In addition, the first user device 100 according to an embodiment of the present invention may further include a voice recognition module for recognizing the acquired voice in addition to the voice acquisition unit for simply acquiring the voice. In general, devices such as smart phones have a high probability of including a voice recognition module, so it may be possible to use a microphone in conjunction with it.

In this way, the first user device 100 may be configured in various forms. For example, a microphone is configured separately from a smartphone and a laptop computer to communicate with the communication network 120, or a microphone is connected to a smartphone to communicate with the communication network 120 through the connected smartphone. can do. In addition, since various forms are possible, the embodiment of the present invention is not particularly limited to any one method.

In a room where time and space are limited, for example, in a lecture hall, the lecturer can conduct a lecture or seminar to participants gathered there through a microphone. Of course, this space may not have multimedia equipment, but it will generally be equipped with multimedia equipment such as a screen device. The lecturer (or faculty member) uses the first user device 100 to search for various lecture materials or lecture contents in addition to the prepared lecture materials or textbooks when it is determined that help is needed for attendance (or lecture) during the lecture It can be provided directly to attendees or can be displayed on a third user device. Since the lecturer has a microphone, he can search for lecture materials or contents based on speech recognition by uttering a voice command for search, and provide it to the participants or the screen. Here, the lecture material or contents may include lecture materials or textbooks necessary for the lecture, and other additional materials or contents.

For example, suppose the lecturer requested a search related to artificial intelligence (AI) during the lecture. The lecturer will first utter the voice command for the search "Artificial Intelligence Search". Then, the corresponding search command is transmitted to the communication network 120 in the form of a voice signal. When voice recognition is performed through a microphone or a smart phone to which the microphone is connected, it may be transmitted in the form of a voice recognition word. Here, the audio signal means an analog waveform. On the other hand, the speech recognition word may mean data processed by analyzing the waveform and analyzing the value of the recognized recognition word in the form of a binary code. In this way, the voice command (or search command) may be provided in various forms, so the embodiment of the present invention will not be limited to any one form.

In addition, the first user device 100 transmits the lecture contents searched according to the voice command to the attendees based on the attendee information to the attendees provided with the instruction during the search request or previously received before the lecture is made. can do. More precisely, if a list of lecture contents searched through, for example, a voice command is provided to the first user device 100, only the selected lecture contents can be provided to the participants. Of course, it is possible to provide not only the second user device 110 possessed by attendees, but also the third user device provided in the lecture hall. For convenience of explanation, the following description is provided to the second user device 110 of attendees. Explain that. The speaker can be provided to the attendees based on the attendee information in which the material is pre-stored or provided at the time of presentation by uttering the command " Provide to the attendees of the corresponding material (for example, data checked on the list) ". Of course, depending on the design intent of the system, it may be possible to make sure that all the lectures that are searched are provided immediately to the attendees when a search request is made.

For example, the lecturer may ask participants to join a specific lecture room of the lecture service provided by the lecture service providing device 140 before the lecture starts. During the process, attendees can be asked to record attendee information. As described above, the speech-based lecture contents can be provided to the lecturers based on the lecturer information secured before the lecture. Of course, even if the information of these participants does not join the lecture room, the lecturer or his assistant can request and store the information before the lecture.

Of course, the first user device 100 displays a pop-up window UI screen at the time of providing the searched lecture contents to attendees, and records the mobile phone number or email address on the UI screen to provide the lecture contents to attendees. Since it can be, in the embodiment of the present invention will not be particularly limited to either. The mobile phone number is useful to allow attendees to check what the lecturer has searched for directly in their own mobile phone when the lecture is held in a limited space rather than in a multimedia classroom. In addition, the email address can be useful for receiving multimedia data such as lecture notes that are automatically generated through lectures. Here, the lecture notes include real-time issues in the lecture.

Furthermore, the first user device 100 can freely edit the questions and responses, and discussion content that the lecturer exchanged with participants in real time during the lecture by using the lecture material. Of course, the first user device 100 can edit the temporarily stored data by itself and provide it to the lecture service providing device 140, but in the embodiment of the present invention, the speaker directly edits the voice on the UI screen displayed on the mobile phone or the like. It is desirable to do. For example, suppose that on the screen of the lecturer's first user device 100, his mobile phone or laptop computer, questions and responses or discussions exchanged during the lecture in relation to the lecture material are displayed in real time on one side of the lecture material. Then, when a joke or a personal opinion is displayed, the lecturer can utter a voice command so that the content is deleted. Of course, it is possible to select and delete such an editing operation on the UI screen, but it may be possible by presetting the content or category so that specific content is not displayed before or during the lecture.

In addition, when a request is made to display conversation contents such as questions, responses, and discussions made during a lecture in relation to the lecture material on the first user device 100, the lecturer selects a date or a lecture hall and performs a previous lecture. It may also be possible to show attendees who are currently speaking, such as questions, responses and discussions exchanged with attendees at Esau. Or, by showing the contents of existing attendees, it is possible to add content exchanged with the attendees in the current lecture hall. In this way, how to store the contents of questions, responses, and discussions with attendees using specific lecture materials in connection with lecture materials and display them on the screen will be done according to the format by using a preset format. It will be possible, and may vary depending on the intention of the system designer, so the embodiment of the present invention will not be limited to any one form.

The second user device 110 is a terminal device such as a smart phone possessed by attendees of the lecture, and may further include a laptop computer, a tablet PC, and the like. According to the interface of the attendees, the second user device 110 may perform a process for entering lecturer information by accessing (or logging in to the lecture service) the lecturer established by the lecturer. Of course, as mentioned above, the lecturer or his assistant may collect and enter the information of the participants before the lecture. Accordingly, the second user device 110 may receive the lecture contents provided by the first user device 100 and multimedia data such as a lecture note after the lecture is completed. In addition, the content of the conversation (eg, questions, responses, and discussions) between the lecturer and the participants during the lecture can be provided in conjunction with the lecture material. Of course, the content of the conversation may be provided based on the edit information edited by the lecturer using the first user device 100.

The second user device 110 can be viewed as selectively receiving lecture content or multimedia data depending on how the lecture service providing device 140 is designed to provide lecture content or multimedia data. In other words, as mentioned above, if the lecturer is designed to be provided to the second user device 110 immediately when a search request is made, the searched lecture contents will be provided immediately. However, if it is designed to be provided to the lecturer according to the search request, and then the lecture contents selected by the lecturer are designed to be provided, the lecture contents will be designed in such a manner. Since these methods are variously changed depending on how the program is designed, it is not particularly limited.

Of course, during the lecture, there may be a query from an attendee of the second user device 110. In this case, the design can be made in various forms. For example, recording of the voice of the participant through the speaker's microphone will be recorded and stored in the lecture service providing device 140 in the form of a voice file. Although it is possible to receive voice through the installed microphone, the lecture service providing device 140 records or analyzes the query of the voice file and the response of the lecturer and transmits it to the lecture hall in real time or in the future. It may be provided to other lecturers using the lecture service according to the embodiment. In this way, queries related to the second user device 110 may be processed in a voice-based manner in addition to being made in the form of a bulletin board in the opened lecture.

More specifically, the second user device 110 and / or the third user device are search contents requested by the lecturer using the first user device 100, such as supplementary data, and supplementary data by lecture data or search. When a conversation such as a query or response is made, it can be transmitted in real time and displayed on the screen. In fact, such an operation may be possible because it is designed to be programmed and operated in the lecture service providing device 140 so as to operate. Of course, if there is edit information edited during or after the lecture by the lecturer using the first user device 100, the conversation is edited based on the edit information and provided to the second user device 110 or the third user device. It could be. Of course, it is irrelevant to provide editing information before the lecture.

The communication network 120 includes both wired and wireless communication networks. For example, a wired / wireless Internet network may be used or interlocked as the communication network 120. Here, the wired network includes an internet network such as a cable network or a public telephone network (PSTN), and the wireless communication networks include CDMA, WCDMA, GSM, Evolved Packet Core (EPC), Long Term Evolution (LTE), Wibro network, etc. It includes meaning. Of course, the communication network 120 according to an embodiment of the present invention is not limited thereto, and may be used as a cloud computing network under a cloud computing environment as a connection network of a next-generation mobile communication system to be implemented in the future. For example, when the communication network 120 is a wired communication network, it is possible to connect to a switching center of a telephone station in the communication network 120. However, in the case of a wireless communication network, data can be processed by accessing a SGSN or a Gateway GPRS SupportNode (GGSN) operated by a communication company, or BTS (Base Station Transmission), NodeB, e-NodeB can be connected to various repeaters to process data.

The communication network 120 includes an access point (AP). Access points include small base stations, such as femto or pico base stations, which are often installed in buildings. Here, the femto or pico base station is classified according to the maximum number of accesses to the first user device 100, the second user device 110, and the third user device according to the classification of the small base station. Of course, the access point includes a short-range communication module for performing short-range communication such as ZigBee and Wi-Fi with the first user device 100 or the second user device 110. The access point can use TCP / IP or RTSP (Real-Time Streaming Protocol) for wireless communication. Here, short-range communication may be performed in various standards such as radio frequency (RF) and ultra-wideband communication (UWB), such as Bluetooth, Zigbee, infrared (IrDA), ultra high frequency (UHF), and very high frequency (VHF), in addition to Wi-Fi. You can. Accordingly, the access point can extract the location of the data packet, designate the best communication path for the extracted location, and deliver the data packet to the next device, for example, the lecture service providing device 140 along the designated communication path. An access point may share multiple lines in a typical network environment, and may include, for example, routers, repeaters, and repeaters.

The content providing device 130 includes a server operated by a third-party company or other institution, such as universities or broadcasting stations, which generates and provides lecture data by itself. The content providing device 130 may check and provide the questions and discussions in a specific lecture according to the linkage with the lecture service providing device 140. Here, the interlocking operation of the two devices may be performed by business alliances of operators operating each device. In other words, when the new content is updated, the content providing device 130 may check whether it is content previously provided to the lecture service providing device 140 and provide only new content.

The lecture service providing device 140 includes a DB 140a for storing vast (big) data. In addition, the lecture service providing device 140 provides speech-based searched lecture content to the first user device 100 at the request of the first user device 100, and provides the lecturer with the lecture or searched lecture content. Only the lecture contents selected by the user may be provided to the second user device 110 or the third user device. At this time, the searched lecture contents may be provided based on received or pre-stored attendee information. Of course, the searched lecture contents can be provided directly to the second user device 110, so the embodiment of the present invention will not be limited to any one method. Since this has been described above, further description will be omitted.

In addition, the lecture service providing device 140 generates multimedia data such as lecture notes by matching voice (signal), searched lecture contents, etc. acquired during a lecturer's lecture with electronic textbooks (hereinafter, electronic teaching materials) in real time. You can. For example, when a lecturer stores electronic teaching materials or lecture data such as PPT or PDF in a specific lecture room, the lecture service providing device 140 acquires, matches, and stores the voice received in real time based on the data and stores it. In addition, if there are questions or answers in the course of the lecture, or if there are searched lecture contents, it can be matched and stored according to the system designer's preset method. Here, the "pre-set method" is a programmatic aspect, but may include, for example, a process of generating a screen by attaching a question-and-answer tag in the form of a balloon. That is, the preset method is a format generated by a program that automatically generates multimedia data. Therefore, such a format may be formed in various forms, so the embodiment of the present invention will not be particularly limited to any one form.

Furthermore, the lecture service providing device 140 extracts keywords such as time, lecture name or lecture length when storing multimedia data such as lecture notes generated by the above process, and tags the extracted keywords in the multimedia data. It may be stored at 140a. It can be said that the multimedia data generated in this way are searched based on keywords.

On the other hand, the lecture service providing device 140 may perform an artificial intelligence function to search for more accurate lecture contents based on vast data. Of course, this function can be applied variously to extract more accurate keywords to generate multimedia data. As is well known, artificial intelligence can maximize the effect of lecture by repeated learning based on probability and statistical algorithms.

So far, with reference to FIG. 1, an example of constructing a separate lecture service providing device 140 for providing a lecture service by connecting to a communication network 120 of a communication company has been described. However, in another embodiment of the present invention, a program for performing the above function may be provided to a server of an online portal company, and a service may be made based on this. At this time, upon request for a search by voice recognition, a UI window is opened to enter and transmit the attendee information, so a service that allows the corresponding lecture material searched based on the provided attendant information to be provided to the attendees is also possible, and thus, the present invention is implemented. The example will not be particularly limited to either method.

Furthermore, the lecture service providing device 140 edits the lecture contents based on the editing information provided from the lecturer or the like during or after the lecture at the lecture hall. For example, when using lecture data or auxiliary data by searching for a lecture, the corresponding data will be displayed on the second user device 110 and / or the third user device. Therefore, if there is a conversation between the lecturer and the attendees of the lecture while viewing the relevant data, the lecture service providing device 140 will perform the operation such that the content of the conversation is recorded on one side of the data, for example, and displayed on the screen. If, in the course of the objection, the lecturer requests to edit a specific content, the conversation may be edited and displayed based on the edited information. Such an operation may be based on, for example, a voice requested by the lecturer or editing information made on a UI screen, but if the dialogue contents included in the category of the information are input based on the information set before the lecture, the dialogue contents are filtered. Is to be displayed on the screen. The information may include information related to jokes or personal opinions as mentioned above.

FIG. 2 is a block diagram showing the structure of the lecture service providing apparatus of FIG. 1.

As shown in Figure 2, the lecture service providing apparatus 140 according to an embodiment of the present invention includes a part or all of the lecture data processing unit 200 and the storage unit 210, where "some or all of the "It has the same meaning as before.

The lecture data processing unit 200 searches the lecture assistant data according to the lecturer's request according to an embodiment of the present invention, and connects the dialogue between the lecturer and the participants using the lecture data and assistant materials with the lecture data and / or auxiliary data And display it on the screen, and perform an operation in which the lecturer can freely edit it. The search has been sufficiently explained above, so further explanation will be omitted.

However, if you look more closely with regard to editing, the subject of editing refers to the content of conversations between the lecturer and the participants in the lecture, that is, questions, responses, and discussions. Therefore, when the relevant conversation contents are received in real time in the lecture, the lecture data processing unit 200 matches the received dialogue contents with the lecture data or auxiliary data to be displayed in real time on the screen. In this case, the lecture data processing unit 200 may use various information stored in the storage unit 210.

For example, the storage unit 210 may store information on what lecture data and auxiliary data are being used in a lecture hall where a lecture is currently being performed. Accordingly, the lecture data processing unit 200 may match the data currently displayed on the screen with the conversation content based on the information to be displayed on the screen in real time. In addition, the storage unit 210 may store setting information for setting the lecturer to prevent the conversation content of a specific category from being reflected before the lecturer. As mentioned earlier, the setup information can include jokes or private views. Therefore, if the relevant conversation contents of the lecturer are input during the lecture, the dialogue contents are filtered based on the setting information and displayed on the screen.

In addition, the storage 210 may store attendee information of attendees. This information may be temporarily stored by requesting to DB 140a of FIG. 1. Accordingly, the lecture data processing unit 200 allows the conversation content matching the data based on the attendee information of the attendees to be provided to the second user device 110 of the attendees. Of course, it may be provided as a third user device.

In addition, the lecture data processing unit 200 can provide multimedia data such as lecture notes including various real-time issues in the lecture hall based on the attendee information stored in the storage unit 210 even after the lecture is over. . Here, if the lecture material means data in PPT or PDF format created by the lecturer for use in the lecture hall, the lecture note is a lecture material that contains various issues made in the lecture hall, which is a real environment using the relevant data. For example, the reactions of the attendees at the previous lecture could provide good motivation for the attendees at the next lecture.

Based on the above, the lecture data processing unit 200 will include a search engine for retrieving the lecture contents based on speech recognition, and the search engine decodes the recognized voice commands, and for efficient retrieval. Artificial intelligence functions can be additionally performed. In other words, the recognition of the voice command is to analyze the voice signal and the analyzed result to match the machine language that can be recognized by the machine to recognize what the command is. This operation is a major procedure for speech recognition.

In addition, the lecture data processing unit 200 may further include a lecture data generation module for generating multimedia data in a specified format in addition to a search engine. Through this, multimedia data such as lecture notes of a designated type are generated. Multimedia materials are usually provided in the form of a video by matching voices in real time with electronic textbooks. At this time, the attendee's query and the response of the lecturer as an additional information, and the lecture contents retrieved during the lecture are presented to the participants at the appropriate time when the video progresses. Means provided. In the embodiment of the present invention, all of these series of processes are automatically performed to automatically generate multimedia data such as lecture notes, and may be provided to participants at the end of the lecture.

3 is a block diagram showing another structure of the lecture service providing apparatus of FIG. 1, and FIG. 4 is a block diagram showing the structure of the lecture data generation unit of FIG.

3 and 4 together with FIG. 1, the lecture service providing device 140 'according to another embodiment of the present invention includes a communication interface unit 300, a control unit 310, a lecture data generation unit 320, and It includes a part or all of the storage unit 330, and "including a part or all" is the same as the above meaning.

Compared to the lecture service providing device 140 of FIG. 2, the lecture service providing device 140 ′ of FIG. 3 is different from each other in that the control function and the lecture service function are dualized and processed. In other words, the control unit 310 performs a function for controlling the communication interface unit 300 and the lecture data generation unit 320 in the lecture service providing device 140 ', and the lecture data generation unit 320 is a lecture service A function for providing a can be performed independently. Of course, the control unit 310 may store a program that performs the same function as the lecture data generation unit 320 in the internal memory and execute it, which will be described later.

In FIG. 3, when the control unit 310 needs to perform a speech recognition-based search or automatic generation of multimedia data as described above, it is controlled to be performed by the lecture data generation unit 320. Then, again, the control unit 310 receives the result processed by the lecture data generation unit 320 and transmits the result to the communication interface unit 300. Of course, the control unit 310 may perform an operation such as compressing data in this process, but this may obscure the technical idea of the present invention, so a description thereof will be omitted.

The lecture data generation unit 320 stores and executes a program for providing a lecture service according to an embodiment of the present invention. The program is composed of a combination of SW modules, and each module can be composed of a combination of source codes. Based on this, if the main functions according to the embodiment of the present invention are roughly divided into modules, it may be illustrated as in FIG. 4. As shown in FIG. 4, the rest of the parts except for the search engine unit 410 may be regarded as related to the lecture data generation module as mentioned above. 4 illustrates that the search engine unit 410 also performs the overall control function of the program. Also, the search engine unit 410 may interlock with the DB 140a of FIG. 1.

In brief, if the voice command provided during the lecturer's lecture is received from the control unit 310 of FIG. 3, the search engine unit 410 of the lecture data generation unit 320 is connected to the corresponding voice command in the interworking DB 140a. The related lecture contents are searched and provided to the control unit 310 through the search data transmission unit 400. In addition, when the speaker's voice is acquired through the search data transmission unit 400, the speech is stored in the voice file storage unit 440, and the stored voice may be temporarily stored together with time information. Here, the time information may be used when matching with the electronic teaching material.

Then, the search engine unit 410 or the CPU in the search engine unit 410 provides the voice files and electronic teaching materials stored in the electronic teaching material storage unit 460 to the voice and teaching material matching unit 430 for matching. In the matching process, additional information (eg, attendee's query and lecturer's response, search command and search contents, etc.) are matched together to generate multimedia data such as lecture notes and be stored in the lecture note storage unit 450. You can. Then, if it is determined that the lecturer's lecture is over, the search engine unit 410 provides the lecture notes stored in the lecture note storage unit 450 to the participants based on the attendee information. That is, it can be sent to the smartphone owned by the attendee or sent by e-mail. Of course, before that, if, for example, the voice and text matching unit 430 is set to provide the conversation contents matched with the lecture material to the lecturer or screen, the corresponding data and dialogue contents stored in the lecture note storage unit 450 are the lecture hall. Can be sent to

In addition, the electronic classroom management unit 420 may perform an operation for granting access authority, such as performing a login or authentication to access the lecture room, for example, when a lecture is opened or a lecture room is created. .

According to an embodiment of the present invention, the lecture data generation unit 320 of FIG. 3 having the structure of FIG. 4 may operate in real time. In other words, during the lecture, if the lecturer requests to be displayed on the second user device 110 or the third user device of FIG. 1 in accordance with the lecture data or the auxiliary data, the lecture data generation unit 320 Will match the contents of the conversation in real time according to the request to be provided as a lecture hall. However, the content of the conversation is provided based on the edit information of the lecturer, whether the lecturer requests it during the lecture or before the lecture. Here, the editing information requested by the lecturer may be performed on a voice, UI screen, or before a lecture by presetting the lecturer, and furthermore, it may be performed by deep learning operation of artificial intelligence. It will not be particularly limited to one form. For example, it may be possible to detect that there was a joke of the lecturer based on the laughter of a participant or a specific state (for example, boo) among the contents of the lecture.

Meanwhile, the control unit 310 of FIG. 3 may include a CPU and a memory such as a ROM or RAM. Accordingly, the lecture service providing device 140 ′ of FIG. 3 may increase the processing speed for providing the lecture service by storing the program stored in the lecture data generation unit 320 in the internal memory and executing it during initial driving. . The CPU may include, for example, a microprocessor, that is, a microcomputer, including an operation circuit (ALU) and a control circuit, and may further include an instruction interpreter or a group of registers. This is a matter obvious to those skilled in the art, so a description thereof will be omitted for convenience. If the memory includes RAM, it can be seen that the lecture data generation unit 320 includes ROM. Here, the ROM includes EEPROM, and accordingly, the lecture data generation unit 320 may easily record and delete programs.

In addition to the communication interface unit 300, the control unit 310, the lecture data generation unit 320 and the storage unit 330 of FIG. 3, the lecture service providing device 140 and FIG. Since the contents of the lecture data processing unit 200 and the storage unit 210 of 2 are not significantly different, the contents will be replaced.

5 is a view for explaining an editing process according to an embodiment of the present invention.

Referring to FIG. 5 together with FIG. 1 for convenience of description, the screen of the second user device 110 or the third user device of the lecture hall is displayed at the request of the lecturer using the first user device 100 which is the user device of the lecturer. The screen as in 5 may be displayed.

Of course, when the lecturer first calls the lecture material or the auxiliary material through a search or the like, the lecture material or the auxiliary material displayed in the first area 510 of FIG. 5 may be displayed on the entire screen. Subsequently, if a conversation such as inquiry, response, and discussion is continued between the lecturer and the attendees using the corresponding lecture material and auxiliary materials during the lecture, the lecture service providing device 140 recognizes this and displays the entire screen in the first area 500. It is automatically divided into the second area 510, for example, the first area 500 displays lecture materials or auxiliary materials, and the second area 510 displays conversation contents such as questions, responses, and discussions from the lecture hall. Can give. Of course, such a screen division or a method of displaying conversation content may be varied.

In the foregoing, it has been exemplified that the dialogue contents are edited and displayed on the screen based on the edited information set before the lecture or the voice or UI window, but in FIG. 5, the process of editing the dialogue contents in the UI window among them for convenience of explanation Is showing. Of course, even in editing in the UI window, the command may use voice.

The lecturer decides whether or not to edit a specific conversation by calling a check box 511 to edit or delete a specific conversation by clicking a specific button on a voice or a mobile phone or a laptop computer. When the check box 511 is selected as described above, a UI window 513 may be displayed on one side of the screen asking whether to modify or delete the corresponding conversation. In the corresponding UI window 513, the lecturer can complete editing of the conversation contents by selecting edit or delete. For example, if you choose to edit, the lecturer can modify the phrase to the desired form. In this case, for example, a keyboard key for editing may be displayed on the screen.

After completing the editing of conversation contents such as questions, responses, and discussions, click the OK button, for example, and the conversation contents are displayed on the screen in the edited state.

This process may be a good way to increase the effectiveness of the lecture during the lecture in order to enhance the interest of the lecture, but as previously mentioned, if editing information has been set before the lecture, unnecessary misunderstanding is prevented from being displayed on the screen. The advantage of not buying it will also be obvious. Therefore, the embodiment of the present invention will not be particularly limited to any one method.

6 is a flowchart illustrating a process of driving a lecture service providing apparatus according to an embodiment of the present invention.

Referring to FIG. 6 together with FIG. 1 for convenience of description, the lecture service providing apparatus 140 according to an embodiment of the present invention stores and matches the contents of the questions and responses between the lecturer and attendees to the designated lecture material (S600) ).

Of course, the conversation contents such as the stored lecture data and matching questions and responses may be transmitted in real time to the second user device 110 possessed by the attendees of the lecture hall or the third user device installed in the lecture hall. will be.

Subsequently, when the lecturer edits the query and response contents using the first user device 100, the lecture service providing device 140 edits and re-stores the stored query and response contents based on the edit information related to the edit. It will be stored (S610).

The edited conversation content may be transmitted in real time to the lecture hall during the lecture if requested by the lecturer and displayed on the screen of the second user device 110 or the third user device.

In addition, the lecturer providing editing information at the lecture hall can be freely edited according to a request from the first user device 100 such as a microphone, a mobile phone or a laptop computer used by the lecturer. Of course, this process may be performed by a third user device (for example, a microphone linked to a screen) provided in the lecture hall.

On the other hand, that all components constituting the embodiments of the present invention are described as being combined or operated as one, the present invention is not necessarily limited to these embodiments. That is, if it is within the scope of the present invention, all of the components may be selectively combined and operated. In addition, although all of the components may be implemented by one independent hardware, a part or all of the components are selectively combined to perform a part or all of functions combined in one or a plurality of hardware. It may be implemented as a computer program having a. The codes and code segments constituting the computer program may be easily deduced by those skilled in the art of the present invention. Such a computer program is stored in a computer-readable non-transitory computer readable media, and read and executed by a computer, thereby implementing an embodiment of the present invention.

Here, the non-transitory readable recording medium means a medium that stores data semi-permanently and that can be read by a device, rather than a medium that stores data for a short time, such as registers, caches, and memory. . Specifically, the above-described programs may be stored and provided on a non-transitory readable recording medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

Although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and it is usually in the technical field to which the present invention pertains without departing from the gist of the present invention as claimed in the claims. It is of course possible to perform various modifications by a person having knowledge of, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

100: lecturer user device (or first user device)
110: participant user device (or second user device)
120: communication network 130: content providing device
140, 140 ': Lecture service providing device 200: Lecture data processing unit
210, 330: storage unit 300: communication interface unit
310: control unit 320: lecture data generation unit
400: search data transmission unit 410: search engine unit
420: electronic classroom management unit 430: voice and textbook matching unit
440: audio file storage 450: lecture note storage
460: electronic textbook storage

Claims (6)

A storage unit that matches and stores the content of questions and responses made between lecturers and attendees in the lecture hall to designated lecture materials; And
Includes a controller for controlling the storage unit to edit and re-save the stored query and response contents based on the edit information related to the query and response contents specified by the lecturer using a user device.
The control unit,
On the voice or UI screen, the lecturer edits on the basis of the edit information specified before or during a lecture on the lecturer's user device by a preset or artificial intelligence deep learning operation, and the lecturer's joke and Use information related to at least one of your private views,
The control unit,
When the lecturer first calls the lecture material or auxiliary data through a search, the lecture material or the auxiliary data displayed in the first area is displayed on the entire screen, and the lecturer uses the lecture material and the auxiliary material during the lecture. When the conversation between question and answer continues between and participants, it is recognized that the conversation is present, and the entire screen is automatically divided into a first area and a second area to display the lecture material or the auxiliary material in the first area, and In the second area, the conversation contents of questions and responses from the lecture hall are displayed in real time,
The control unit,
A lecture service providing device that generates the lecture data including issues seen by participants in the previous lecture hall and the next lecture hall in the lecture notes used by the lecture hall. According to claim 1,
The control unit may be edited based on the edit information provided after the lecture by the lecturer's user device, and input from at least one of the lecturer's mobile phone, laptop computer, tablet PC, and microphone used as the user device. Lecture service providing device using the edited information. delete According to claim 1,
And a communication interface unit that provides the query and response contents in real time to the user device of the attendee or the user device of the lecture hall under the control of the control unit. According to claim 4,
The control unit controls the communication interface to control the communication interface unit to provide the lecture data including the query and response contents re-stored in the storage unit to the user device of the attendee after the lecture ends. As a driving method of the lecture service providing apparatus including a storage unit and a control unit,
Matching questions and responses between lecturers and attendees of the lecture hall to designated lecture materials and storing them in the storage unit; And
Including the step of controlling the storage unit so that the control unit edits and re-stores the stored query and response contents based on the edit information related to the query and response contents designated by the lecturer using a user device.
The controlling step,
On the voice or UI screen, the lecturer edits on the basis of the edit information specified before or during a lecture on the lecturer's user device by a preset or artificial intelligence deep learning operation, and the lecturer's joke and Using information related to at least one of the private views;
When the lecturer first calls the lecture material or auxiliary data through a search, the lecture material or the auxiliary data displayed in the first area is displayed on the entire screen, and the lecturer uses the lecture material and the auxiliary material during the lecture. When the conversation between question and answer continues between and participants, it is recognized that the conversation is present, and the entire screen is automatically divided into a first area and a second area to display the lecture material or the auxiliary material in the first area, and Displaying, in real time, conversation content of questions and responses coming up from the lecture hall in the second area; And
Generating the lecture data including issues seen by attendees of the previous lecture hall and the next lecture hall in the lecture notes used by the lecture hall;
Driving method of the lecture service providing device further comprises.

Images