KR102492444B1 - Method, device and system for providing content using problem solving video - Google Patents

Abstract

According to one embodiment, provided is a method of providing instructional content for an online lecture based on image processing performed by a device, wherein the method comprises the steps of: acquiring a lecture video for a first instructor's online lecture when a class for the first instructor's online lecture ends; extracting a video image of a first time point, which is the last time point of the lesson, from the lecture video as a first image; dividing an area occupied by the instructional material in the first image into a first area and dividing a portion of the first image containing the first area to extract a 1-1 image; as a result of playing and analyzing the lecture video in reverse chronological order from the first time point, if it is confirmed that there is no letter in the first area at a second time point, setting a first section from the second time point to the first time point; and based on the 1-1 image, generating first content for providing the instructional material for the lecture of the first section. The present invention has the effect of providing the generated first content to learners as the instructional content for the online lecture.

Description

Method, apparatus and system for providing writing contents of online lecture based on image processing {METHOD, DEVICE AND SYSTEM FOR PROVIDING CONTENT USING PROBLEM SOLVING VIDEO}

The following embodiments relate to a technology for providing writing contents of an online lecture based on image processing.

With the rapid development of the Internet and digital media, video lectures using online are rapidly increasing. Online video lectures can demonstrate high efficiency at a relatively low cost, and in particular, a new learning culture is created due to the advantage that users can freely listen to lectures at the time and place they want using personal terminal devices such as smartphones and tablets. is situated as

Online lecture is an online lecture in which the lecturer explains the contents of the lecture while writing on the blackboard. Learning can be performed using lecture videos for online lectures that are to be provided.

On the other hand, there is an increasing demand for learners to check only the contents of the writings in addition to the lecture videos. That is, in the case of reviewing the class content only with the writing content after learning through the lecture video, there is an advantage in that the class content can be quickly reviewed.

However, in the past, since the content of the writing can be checked only by playing a video lecture, the learner has to write down the content of the writing separately in order to separately check the content of the writing later.

Therefore, there is an increasing demand for providing the writing contents desired by learners as separate contents, and research on technologies related to this is required.

Korean Patent Registration No. 10-1743624 Korean Patent Registration No. 10-1367195 Korean Patent Registration No. 10-2308443 Korean Patent Registration No. 10-0706901

According to an embodiment, when the class for the online lecture of the first instructor ends, a lecture video for the online lecture of the first instructor is obtained, and a video image of the first view, which is the last view of the class, is displayed in the first lecture video. Extract as an image, classify the area occupied by the writing in the first image as the first area, extract the 1-1 image by dividing the part with the first area in the first image, and convert the lecture video to the first viewpoint As a result of reproduction and analysis in reverse chronological order from , if it is confirmed that there is no letter in the first area at the second time point, the first section is set from the second time point to the first time point, and based on the 1-1 image , By generating the first content for providing writing on the lecture of the first section, the purpose is to provide the created first content to the learner as the writing content of the online lecture.

The object of the present invention is not limited to the object mentioned above, and other objects not mentioned will be clearly understood from the description below.

According to an embodiment, in the method for providing writing contents of an online lecture based on image processing, which is performed by an apparatus, when the class for the online lecture of a first instructor ends, the online lecture of the first instructor Obtaining a video of a lecture about; Extracting a video image of a first point of view, which is the last point of the class, as a first image from the lecture video; dividing an area occupied by writing in the first image into a first area, and extracting a 1-1 image by dividing a portion of the first image where the first area is located; As a result of reproducing and analyzing the lecture video in reverse chronological order from the first time point, if it is confirmed that there is no letter in the first area at the second time point, the first section from the second time point to the first time point setting up; and generating first content for providing writing on the lecture of the first section based on the 1-1 image.

In the video processing-based online lecture content providing method, after the step of extracting the 1-1 image, if it is confirmed that the 1-1 image has the first instructor, the 1-1 image Dividing an area occupied by a first instructor into a second area; As a result of replaying and analyzing the lecture video in reverse chronological order from the first point of view, if it is confirmed that the first instructor is not present in the second area at the time of 1-1, the lecture video of the 1-1 point of view extracting the video image as a second image; extracting a 2-1 image by dividing a portion of the second image in which the second area is located; and replacing a portion of the 1-1 image with the second area with the 2-1 image.

The method of providing writing content for an online lecture based on image processing may include, after generating the first content, checking whether or not the second point of view is a start point of the class in the video of the lecture; extracting a video image of a third viewpoint immediately before the second viewpoint as a third image when it is determined that the second viewpoint is not the class start time; dividing an area occupied by writing in the third image into a third area, and extracting a 3-1 image by dividing a portion of the third image where the third area is located; As a result of reproducing and analyzing the lecture video in reverse chronological order from the third time point, if it is confirmed that there is no letter in the third area at the fourth time point, the second section from the fourth time point to the third time point setting up; and generating second content for providing writing on the lecture of the second section based on the 3-1 image.

According to an embodiment, when the class for the online lecture of the first instructor ends, a lecture video for the online lecture of the first instructor is obtained, and a video image of the first view, which is the last view of the class, is displayed in the first lecture video. Extract as an image, classify the area occupied by the writing in the first image as the first area, extract the 1-1 image by dividing the part with the first area in the first image, and convert the lecture video to the first viewpoint As a result of reproduction and analysis in reverse chronological order from , if it is confirmed that there is no letter in the first area at the second time point, the first section is set from the second time point to the first time point, and based on the 1-1 image , By generating the first content for providing the writing for the lecture in the first section, there is an effect of providing the created first content to the learner as writing content for the online lecture.

On the other hand, the effects according to the embodiments are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

1 is a diagram schematically showing the configuration of a system according to an embodiment.
2 is a flowchart illustrating a process of generating writing content through image processing of a lecture video according to an embodiment.
3 is a flowchart illustrating a process of generating writing contents for a lecture of a first section based on a video image of a first viewpoint according to an embodiment.
4 is a diagram for explaining a first section set through a first viewpoint and a second viewpoint according to an embodiment.
5 is a flowchart illustrating a process of deleting a first instructor from a video image of a first viewpoint according to an embodiment.
6 is a diagram for explaining a 1-1 viewpoint according to an embodiment.
7 is a diagram for explaining a 1-1 image in which an area where a first instructor is located is replaced with another image according to an embodiment.
8 is a flowchart illustrating a process of generating writing content for a lecture of a second section based on a video image of a third viewpoint according to an embodiment.
9 is a diagram for explaining lecture videos classified into a plurality of sections according to an embodiment.
10 is a flowchart for explaining a process of moving a lecture video to a play point through writing content.
11 is an exemplary diagram of a configuration of a device according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, since various changes can be made to the embodiments, the scope of the patent application is not limited or limited by these embodiments. It should be understood that all changes, equivalents or substitutes to the embodiments are included within the scope of rights.

Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only, and may be modified and implemented in various forms. Therefore, the embodiments are not limited to the specific disclosed form, and the scope of the present specification includes changes, equivalents, or substitutes included in the technical spirit.

Although terms such as first or second may be used to describe various components, such terms should only be construed for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element.

It should be understood that when an element is referred to as being “connected” to another element, it may be directly connected or connected to the other element, but other elements may exist in the middle.

Terms used in the examples are used only for descriptive purposes and should not be construed as limiting. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the embodiment belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the present application, they should not be interpreted in an ideal or excessively formal meaning. don't

In addition, in the description with reference to the accompanying drawings, the same reference numerals are given to the same components regardless of reference numerals, and overlapping descriptions thereof will be omitted. In describing the embodiment, if it is determined that a detailed description of a related known technology may unnecessarily obscure the gist of the embodiment, the detailed description will be omitted.

The embodiments may be implemented in various types of products such as personal computers, laptop computers, tablet computers, smart phones, televisions, smart home appliances, intelligent vehicles, kiosks, and wearable devices.

1 is a diagram schematically showing the configuration of a system according to an embodiment.

Referring to FIG. 1 , a system according to an embodiment may include a plurality of learner terminals 100, a plurality of instructor terminals 200, and a device 300 capable of communicating with each other through a communication network.

First, a communication network may be configured regardless of its communication mode, such as wired or wireless, and may be implemented in various forms so that communication between servers and communication between servers and terminals is performed.

Each of the plurality of learner terminals 100 and each of the plurality of instructor terminals 200 may be implemented as a computing device having a communication function, for example, a mobile phone, desktop PC, laptop PC, tablet PC, smart phone, etc. It may be implemented, but is not limited thereto, and may be implemented in various types of communication devices that can be connected to external servers.

The plurality of learner terminals 100 are terminals used by learners who want to receive lecture videos for online lectures, including a first learner terminal 110 used by a first learner and a second learner terminal used by a second learner ( 120), etc., and the plurality of instructor terminals 200 are terminals used by instructors who want to provide lecture videos for online lectures, and the first instructor terminal 210 used by the first instructor, the second A second instructor terminal 220 used by the instructor may be included.

Each of the plurality of learner terminals 100 and each of the plurality of instructor terminals 200 use the device 300 to access a website operated by a person or organization that provides services, or to provide services using the device 300. An application or program developed and distributed by a provider or organization may be installed.

Each of the plurality of learner terminals 100 and the plurality of instructor terminals 200 may access the device 300 through a website, application, program, or the like provided by the device 300 .

Hereinafter, for convenience of description, the operation of the first learner terminal 110 and the first instructor terminal 210 will be mainly described, but the operation of the first learner terminal 110 in other learner terminals such as the second learner terminal 120 , and the operation of the first instructor terminal 210 can be performed instead in another instructor terminal such as the second instructor terminal 220 .

The device 300 may provide a platform so that classes for online lectures may be conducted between learners and instructors.

The device 300 may be a server owned by a person or organization that provides services using the device 300, may be a cloud server, or may be a peer-to-peer (p2p) set of distributed nodes. may be The apparatus 300 may be configured to perform all or some of the arithmetic function, storage/reference function, input/output function, and control function of a normal computer. The device 300 may be configured to communicate with a plurality of learner terminals 100 and a plurality of instructor terminals 200 by wire or wirelessly, and controls the operation of each of the plurality of learner terminals 100 and the plurality of instructor terminals 200. And, it is possible to control which information is to be displayed on the respective screens of the plurality of learner terminals 100 and the plurality of instructor terminals 200 .

The apparatus 300 is implemented as a server that provides an online lecture service, controls an online lecture class to proceed between learners and instructors, and when the online lecture class is finished, uploads a lecture video for the online lecture to a database. can be stored and managed. In this case, the device 300 may classify the lecture videos based on instructor, learning unit, learning level, etc., and may classify and store the classified lecture videos in a database.

Meanwhile, for convenience of explanation, FIG. 1 shows only the first learner terminal 110 and the second learner terminal 120 among the plurality of learner terminals 100, and the first instructor terminal among the plurality of instructor terminals 200 ( 210) and the second instructor terminal 220 are shown, but the number of terminals may vary according to embodiments. As long as the processing capacity of the device 300 allows, the number of terminals is not particularly limited.

According to an embodiment, the apparatus 300 may store the generated lecture video in a database whenever a lecture video for the online lecture is generated whenever a plurality of instructors conduct a class through online lecture.

The apparatus 300 may extract lecture contents as text through voice recognition from lecture videos stored in a database, and perform a sync operation between the extracted text and lecture videos to add the lecture contents to the lecture videos as subtitles. .

2 is a flowchart illustrating a process of generating writing content through image processing of a lecture video according to an embodiment.

As shown in (a) of FIG. 2 , the device 300 may extract an image of a specific viewpoint from a lecture video. At this time, the apparatus 300 may analyze the extracted image and determine that the writing and lecturer are together on the extracted image.

According to an embodiment, when a class for an online lecture is conducted, a video of the lecture is created by filming the class for the online lecture, and most of the camera angles for filming the class for the online lecture are fixed.

Therefore, since the lecture video is a video taken mainly of the blackboard, and only the lecturer is moving in front of the blackboard to take notes, as shown in (b) of FIG. 2, the device 300 extracts images of different viewpoints from the lecture video. can do. At this time, the device 300 may analyze the extracted image and determine that there is only writing on the extracted image.

After that, as shown in (c) of FIG. 2 , the apparatus 300 may generate writing content based on the image extracted from the lecture video. In this case, the device 300 may generate the writing content shown in (c) of FIG. 2 with the image shown in (b) of FIG. 2 . In addition, the device 300 combines a partial area of the image shown in FIG. 2(a) with a partial area of the image shown in FIG. 2(b) to create the writing content shown in FIG. 2(c). can create

When generating writing content based on an image extracted from a lecture video, the device 300 may convert the image extracted from the lecture video into a black-and-white image and set the converted black-and-white image as the writing content.

According to an embodiment, the device 300 can generate writing content by dividing the lecture video by section, integrating the writing content divided by section into one and providing it as writing content for the lecture video, and by section Through the selection of the divided writing content, it is possible to process a lecture video to be played from the time when the class related to the selected writing content is progressed. A detailed description related to this will be described later with reference to FIG. 10 .

3 is a flowchart illustrating a process of generating writing contents for a lecture in a first section based on a video image of a first viewpoint according to an embodiment, and FIG. 4 is a flowchart of a first viewpoint and a second viewpoint according to an embodiment. It is a diagram for explaining the first section set through two viewpoints.

Referring to FIG. 3 , first, in step S301, the device 300 may obtain a lecture video for an online lecture of a first instructor.

Specifically, the first instructor terminal 210 may store a lecture video of the first instructor's online lecture in the database of the device 300 when the class for the online lecture of the first instructor ends, and the device 300 may obtain a lecture video for the online lecture of the first instructor from the database.

In step S302, the device 300 may check the first point of view, which is the last point of the class, in the lecture video. At this time, the device 300 may check the first point of view set by the first instructor when the first point of time, which is the last point of time of the class, is set at the request of the first instructor, and the first point of view is not set separately. If not, the last reproduction time of the lecture video may be identified as the first time point.

In step S303, the device 300 may extract a video image of a first viewpoint from the lecture video as a first image. That is, the device 300 may capture an image of a first viewpoint in a lecture video and extract the captured image as a first image.

In step S304, the apparatus 300 may classify an area occupied by writing in the first image as a first area.

Specifically, the device 300 analyzes the first image, recognizes all characters on the first image, identifies the position of the leftmost character on the first image as a first point, and The position of the letter located at the top of the first image is checked as the second point, the position of the letter located at the far right on the first image is checked as the third point, and the position of the letter located at the bottom of the first image is checked. The location can be confirmed as the fourth point.

Thereafter, the device 300 generates a first straight line that extends in the vertical direction based on the first point, generates a second straight line that extends in the left and right direction based on the second point, and creates a vertical and horizontal line based on the third point. A third straight line extending in a direction may be generated, and a fourth straight line extending in a left-right direction based on the fourth point may be generated.

Thereafter, the device 300 may set an area connecting the first straight line, the second straight line, the third straight line, and the fourth straight line as the first area, and then distinguish the first area from the first image.

In step S305, the device 300 may divide a portion of the first image where the first region is located, and extract the divided image as the 1-1 image.

When the 1-1 image is extracted, the device 300 may determine whether the first instructor is present in the 1-1 image.

For example, when the 1-1 image is the image shown in (a) of FIG. 2, the device 300 may recognize that the first instructor is present in the 1-1 image, and If is the image shown in (b) of FIG. 2, it may be recognized that the first instructor is not present in the 1-1 image.

The device 300 may perform step S306 when it is recognized that there is no first instructor in the 1-1 image, and when it is recognized that there is a first instructor in the 1-1 image, 1 A process of deleting an instructor may be performed. A detailed description of the process of deleting the first instructor will be described later with reference to FIG. 5 .

In step S306, the device 300 may reproduce and analyze the lecture video in reverse chronological order from the first viewpoint. At this time, since the lecture video is reproduced and analyzed in reverse order in time, the letters in the first area gradually disappear. That is, when the lecture video is reproduced in reverse, the letters written in the first area disappear one by one.

In step S307, the apparatus 300 reproduces and analyzes the lecture video in reverse chronological order from the first viewpoint, and as a result, it can be confirmed that there is no letter in the first area at the second viewpoint.

That is, as shown in FIG. 4, the lecture video is played first from the second viewpoint 402, and then the first viewpoint 401 is played later than the second viewpoint 402. is reproduced in reverse chronological order from the first point of view 401 to monitor the disappearance of letters in the first area one by one, and the time point when it is confirmed that no letters in the first area are set as the second point of view 402. can

In step S308, the device 300 may set the first interval from the second time point to the first time point.

That is, as shown in FIG. 4 , the device 300 may set the first interval from the second time point 402 to the first time point 401 .

In step S309, the device 300 may generate first content for providing writing on the lecture of the first section based on the 1-1 image. Here, the first content is writing content generated using the 1-1 image, and may mean writing content for a lecture conducted during the first section.

When generating the first content, the device 300 may set the 1-1 image as the first content without image correction, and convert the 1-1 image to black and white as shown in (c) of FIG. 2 . It may be converted into an image, and the converted black-and-white image may be set as the first content.

5 is a flowchart for explaining a process of deleting a first instructor from a video image of a first viewpoint according to an embodiment, and FIG. 6 is a diagram for explaining a 1-1 viewpoint according to an embodiment. 7 is a diagram for explaining the 1-1 image in which the area where the first instructor is located is replaced with another image according to an embodiment.

Referring to FIG. 5 , first, in step S501, the apparatus 300 may extract a 1-1 image by dividing a portion of the first image where the first region is located.

In step S502, the device 300 may check whether it is recognized that there is a first instructor in the 1-1 image. That is, the device 300 may determine whether a first instructor exists in the image 1-1 by checking whether an object in the form of a person other than letters is recognized on the image 1-1.

If it is determined in step S502 that there is a first instructor in the 1-1 image, in step S503, the device 300 may divide the area occupied by the first instructor in the 1-1 image as a second area. In this case, the device 300 may divide the second region from the 1-1 image in the same manner as the method of dividing the first region from the first image.

For example, when the 1-1 image is the image shown in (a) of FIG. 2 , the apparatus 300 may classify an area where a first instructor is located on the right side as a second area.

In step S504, the apparatus 300 may reproduce and analyze the lecture video in reverse chronological order from the first viewpoint. At this time, since the lecture video is reproduced and analyzed in reverse order in time, the first instructor moves in reverse with respect to the moving line during class. That is, when a lecture video is played in reverse, the first instructor moves in the opposite direction to the class.

In step S505, the apparatus 300 reproduces and analyzes the video lecture in reverse chronological order from the first viewpoint, and as a result, it can be confirmed that the first instructor is not present in the second area at the 1-1 viewpoint.

That is, as shown in FIG. 6, the lecture video is played first from the second viewpoint 402, then the 1-1 viewpoint 601 and the first viewpoint 401 are played in that order. It is possible to monitor the movement of the first instructor in the second area in reverse by playing the lecture video in reverse order in time from the first viewpoint 401, and it is confirmed that the first instructor in the second area is out of the second area. The viewpoint may be set to the 1-1 viewpoint 601 .

In step S506, the device 300 may extract a video image of a viewpoint 1-1 from the lecture video as a second image. That is, the device 300 may capture an image of a 1-1 point of view in the lecture video and extract the captured image as a second image.

In step S507, the device 300 may extract the 2-1 image by dividing the second area in the second image.

In step S508, the device 300 may replace the portion of the 1-1 image with the second area with the 2-1 image.

That is, as shown in (a) of FIG. 7 , the device 300 can confirm that there is a first instructor in the 1-1 image 700, and the first instructor in the 1-1 image 700. The area occupied by may be divided into a second area. In this case, the device 300 may set the second area such that the second area is divided into a quadrangular shape.

Thereafter, the device 300 deletes the portion of the second area from the 1-1 image and inserts the 2-1 image at the deleted position, so that the 1-1 image and the 2-1 image are combined. A 1-1 image may be generated. That is, the part with the second area in image 1-1 is replaced with image 2-1, the first instructor in image 1-1 is deleted, and the writing is added in the deleted position, In 1 image, the first instructor may no longer be recognized.

8 is a flowchart illustrating a process of generating writing contents for a lecture in a second section based on a video image of a third viewpoint according to an embodiment, and FIG. 9 is classified into a plurality of sections according to an embodiment. It is a drawing for explaining a lecture video.

Referring to FIG. 8 , first, in step S801 , the apparatus 300 may generate first content for providing writing on the lecture of the first section based on the 1-1 image.

In step S802, the device 300 may check a second point of view, which is the start point of the first section, and determine whether the second point of view is the start point of the class in the lecture video. In this case, when the start time of the class is set by the request of the first instructor, the device 300 may check the start time of the class set by the first instructor, and if the start time of the class is not set separately , the start playback time of the lecture video can be checked as the start time of the class.

If it is confirmed in step S802 that the second point in time is the start point of the class, the device 300 determines that the lecture video is composed of only the first section, and generates writing content for the lecture video using the first content. there is.

If it is confirmed in step S802 that the second point of view is not the start point of the class, in step S803, the device 300 may check a third point of view that is immediately before the second point in the lecture video.

In step S804, the device 300 may extract a video image of a third viewpoint from the lecture video as a third image. That is, the device 300 may capture an image of a third viewpoint from a lecture video and extract the captured image as a third image.

In step S805, the device 300 may classify the area occupied by the writing in the third image as a third area.

In step S806, the apparatus 300 may divide the third region from the third image and extract the divided image as the 3-1 image.

In step S807, the device 300 may reproduce and analyze the lecture video in reverse chronological order from the third viewpoint. At this time, since the lecture video is reproduced and analyzed in reverse order in time, the letters in the third area gradually disappear. That is, when the video of the lecture is reproduced in reverse, the letters written in the third area disappear one by one.

In step S808, the apparatus 300 reproduces and analyzes the lecture video in reverse chronological order from the third viewpoint, and as a result, it can be confirmed that there is no letter in the third region at the fourth viewpoint.

In step S809, the device 300 may set the second interval from the fourth time point to the third time point.

That is, as shown in FIG. 9 , the device 300 additionally, in a state where the second time point 402 to the first time point 401 is set as the first section, the fourth time point 802 to the third time point 401 . Up to the point in time 801 can be set as the second interval.

In step S810, the device 300 may generate second content for providing writing on the lecture of the second section based on the 3-1 image. Here, the second content is writing content generated using the 3-1 image, and may mean writing content for a lecture conducted during the second section.

10 is a flowchart for explaining a process of moving a lecture video to a play point through writing content.

Referring to FIG. 10 , first, in step S1001 , the device 300 may generate second content for providing writing on the lecture of the second section based on the 3-1 image.

In step S1002, the device 300 may check a fourth point of view, which is the start point of the second section, and determine whether the fourth point of view is the start point of the class in the lecture video.

If it is determined in step S1002 that the fourth viewpoint is not the start time of the class, the process returns to step S803, the device 300 checks the fifth viewpoint immediately before the fourth viewpoint in the lecture video, and then the image of the fifth viewpoint. Based on the image, a process of generating writing content for the lecture in the third section may be performed.

If it is confirmed in step S1002 that the fourth point in time is the start point of the class, in step S1003, the device 300 determines that the lecture video is composed of a first section and a second section, and sequentially displays the second content and the first content. You can create writing contents for lecture videos. At this time, the device 300 may generate writing content for the lecture video in the order of the second content and the first content, since the playback order of the video is in the order of the second section and the first section. Also, the device 300 may combine the second content and the first content to generate writing content as a single PDF file.

In step S1004, the device 300 may receive a request for providing writing contents from the first learner terminal 110.

Specifically, when the first learner terminal 110 accesses a web page for reproducing a lecture video for an online lecture of the first instructor, the device 300 displays writing content for the lecture video in a part of the web page. A button used when requesting to be provided may be displayed, and when the corresponding button is selected by the first learner, a request for providing writing content may be received from the first learner terminal 110 .

In step S1005, the device 300 may provide writing content to the first learner terminal 110. At this time, after checking the first learner account logged in to the first learner terminal 110, the device 300 determines whether the first learner is a learner who has registered for the online lecture of the first instructor through the first learner account. If the first learner is identified as a learner who has registered for classes, writing content for the online lecture of the first instructor can be provided to the first learner terminal 110 .

In step S1006, the device 300 may receive a lecture reproduction request for first content among writing content from the first learner terminal 110.

Specifically, when writing content is displayed on the screen of the first learner terminal 110, the device 300 controls buttons used when requesting playback of a lecture related to the content to be further displayed for each content included in the writing content. When a button corresponding to the first content is selected by the first learner, a lecture playback request for the first content may be received from the first learner terminal 110 .

In step S1007, the device 300 may receive a lecture playback request for second content among writing content from the first learner terminal 110.

Specifically, when writing content is displayed on the screen of the first learner terminal 110, the device 300 controls buttons used when requesting playback of a lecture related to the content to be further displayed for each content included in the writing content. If a button corresponding to the second content is selected by the first learner, a lecture replay request for the second content may be received from the first learner terminal 110 .

In step S1008, when a request for reproducing the lecture for the first content is received, the device 300 may control the first learner terminal 110 to reproduce the lecture content from a second point in time.

That is, since the first content is the writing content for the lecture in the first section, when the device 300 receives a request for reproducing the lecture for the first section, the lecture content is reproduced from the second point in time, which is the start point of the first section. can be controlled as much as possible.

In step S1009, when a request for reproducing the lecture for the second content is received, the device 300 may control the first learner terminal 110 to reproduce the lecture content from a fourth point in time.

That is, since the second content is the writing content for the lecture in the second section, when the device 300 receives a request for reproducing the lecture for the second section, the lecture content is reproduced from the fourth point in time, which is the start point of the second section. can be controlled as much as possible.

According to an embodiment, the device 300 may receive a request for access to a website providing an online lecture service from the first learner terminal 110 .

Thereafter, the device 300 processes the access to the website according to the request for access to the website, provides the home page of the website to the first learner terminal 110, and the home page is the first learner terminal 110. ), it is possible to control the operation of the first learner terminal 110 so that it is displayed on the screen.

Thereafter, the device 300 may obtain first learner information by checking the first learner account. At this time, the device 300 identifies the first learner account logged in to the first learner terminal 110, searches for learner information stored in the database through the first learner account, and obtains the first learner information from the database. can Here, the first learner information is learner information about the first learner, and may further include profile information of the first learner, lecture playback details, and the like.

Thereafter, the device 300 may receive a playback request for the first lecture from the first learner terminal 110 . Here, the first lecture is an online lecture conducted by the first instructor, and may refer to an online lecture in which the class is conducted on the subject of explanation of the first learning unit.

Specifically, when a representative image of the first lecture, which is one of a plurality of lectures, is clicked on the home page displayed on the screen of the first learner terminal 110, the device 300 displays the first lecture from the first learner terminal 110. A play request for can be received.

Thereafter, the device 300 may check the first lecture and obtain first lecture information. In this case, the device 300 may check the first lecture through a playback request for the first lecture, retrieve lecture information stored in the database, and obtain first lecture information from the database. Here, the first lecture information is lecture information about the first lecture, and may include attribute information of the first lecture, learner usage details, and the like.

Thereafter, the device 300 may obtain a learner reproduction history of the first lecture through information on the first lecture. Here, the first lecture information may include reproduction history of a learner who reproduced the first lecture, and the learner reproduction history of the first lecture may include details of which learner reproduced the first lecture for how long.

For example, when the first lecture is played on the screen of the first learner terminal 110, the playback time of the first lecture is measured from the time the playback of the first lecture starts to the time the playback of the first lecture ends. Thus, the first learner and the playback time of the first lecture may be added to the learner playback history of the first lecture.

Thereafter, the device 300 may check the concentration time for each learner based on the learner reproduction history of the first lecture.

For example, if learner 1, learner 2, and learner 3 are registered as learners who reproduced and watched the first lecture in the learner reproduction history of the first lecture, the device 300 determines the concentration time of the first learner , the concentration time of the second learner and the concentration time of the third learner can be checked, respectively. Here, the concentration time may be set for each learner according to whether they are watching the screen while the first lecture is being reproduced.

Thereafter, the device 300 may calculate the average concentration time of the first lecture through the average value of the concentration time identified for each learner.

For example, the time learner 1 concentrated on watching lecture 1 was 30 minutes, the time learner 2 concentrated on lecture 1 for 45 minutes, and the time learner 3 concentrated on lecture 1 for 45 minutes. If the time is 60 minutes, the device 300 may calculate the average concentration time of the first lecture as 45 minutes.

Thereafter, the device 300 may set the reference time according to the length of the average concentration time of the first lecture.

For example, the device 300 may set the reference time to 5 minutes when the average concentration time of the first lecture is 30 minutes, and set the reference time to 10 minutes when the average concentration time of the first lecture is 60 minutes. there is. A criterion for setting the reference time may be set differently according to embodiments.

Thereafter, the device 300 may calculate the minimum time of the learner's permissible range as a value obtained by subtracting the reference time from the average concentration time of the first lecture.

For example, when the average concentration time of the first lecture is 30 minutes and the reference time is 5 minutes, the device 300 may calculate the minimum time of the allowable learner range as 25 minutes.

Thereafter, the device 300 may calculate the maximum time of the learner's permissible range as a value obtained by adding the reference time to the average concentration time of the first lecture.

For example, when the average concentration time of the first lecture is 30 minutes and the reference time is 5 minutes, the device 300 may calculate the maximum time of the learner's permissible range as 35 minutes.

Thereafter, the device 300 may set the allowable learner range based on the minimum time of the allowable learner range and the maximum time of the allowable learner range.

For example, when the average concentration time of the first lecture is 30 minutes, the device 300 may set the allowable learner range to a range of 25 minutes to 35 minutes.

The device 300 identifies the first learner account to obtain first learner information, identifies the first lecture to obtain first lecture information, and then, based on the first learner information and the first lecture information, determines the first learner information. The first learner's concentration time for the lecture may be predicted. Here, the concentration time of the first learner may mean a time during which the first learner concentrates on watching the first lecture.

Thereafter, the device 300 may check whether the first learner's concentration time is within the learner's permissible range. Here, as described above, the allowable learner range may be set differently according to the average concentration time.

If it is confirmed that the perusal time of the first learner is within the allowable range for the learner, the device 300 provides the first lecture to the first learner terminal 110, and displays the first lecture on the screen of the first learner terminal 110. It is possible to control the operation of the first learner terminal 110 so that is reproduced and displayed.

That is, when a playback request for the first lecture is received from the first learner terminal 110, the device 300 predicts the first learner's concentration time for the first lecture, and the first learner's concentration time is If it is confirmed that the first lecture is within the allowable range for the learner, it is determined that the first lecture is suitable for the first learner, and the first lecture may be provided to the first learner terminal 110 .

If it is determined that the first learner's concentration time is not within the learner's permissible range but outside the learner's permissible range, the device 300 may check whether the first learner's concentration time is shorter than the minimum time of the learner's permissible range.

If it is confirmed that the concentration time of the first learner is shorter than the minimum time allowed for the learner, the device 300 provides recommendation information for the second lecture to the first learner terminal 110, and the first learner terminal 110 It is possible to control the operation of the first learner terminal 110 so that recommended information for the second lecture is displayed on the screen of . Here, the second lecture is a lecture in which the learning units are the same as the first lecture and are taught in a shorter time than the first lecture.

For example, the first lecture is a 60-minute online lecture taught by the first instructor and the subject of the explanation of the first learning unit, the second lecture is taught by the second instructor, In the case of a 50-minute online lecture in which the class is based on the description of the first learning unit, the device 300 determines that the first learner's concentration time is shorter than the minimum time allowed for the learner, the device 300 stores the information stored in the database. It is possible to check the second lecture produced in a shorter time than the first lecture by inquiring lecture information, and provide recommendation information for the second lecture to the first learner terminal 110 .

That is, when a playback request for the first lecture is received from the first learner terminal 110, the device 300 predicts the first learner's concentration time for the first lecture, and the first learner's concentration time is If it is confirmed that it is out of the learner's permissible range, it is determined that the first lecture is not suitable for the first learner, and if it is confirmed that the first learner's concentration time is shorter than the minimum time of the learner's permissible range, it is determined that the lecture is shorter than the first lecture. It is determined that the second lecture produced by is suitable for the first learner, and recommendation information on the second lecture may be provided to the first learner terminal 110 . In this case, the device 300 may provide the first learner terminal 110 with recommendation information for the first lecture and the second lecture.

On the other hand, if the first learner's concentration time is confirmed to be longer than the minimum time in the learner's allowable range, the first learner's concentration time is determined to be outside the learner's allowable range, and the first learner's concentration time is the maximum time in the learner's allowable range. If it is confirmed that the concentration time of the first learner is longer than the maximum time of the learner's permissible range, the device 300 provides recommendation information for the third lecture to the first learner terminal 110, , the operation of the first learner terminal 110 can be controlled so that recommendation information for the third lecture is displayed on the screen of the first learner terminal 110 . Here, the third lecture is a lecture in which the learning unit is the same as the first lecture and the class is conducted for a longer time than the first lecture.

For example, the first lecture is a 60-minute online lecture taught by the first instructor and the subject of the explanation of the first learning unit, the third lecture is taught by the third instructor, In the case of a 70-minute online lecture in which the class is based on the description of the first learning unit, the device 300 determines that the first learner's concentration time is longer than the maximum time allowed by the learner, the device 300 stores the information stored in the database It is possible to check the third lecture produced over a longer period of time than the first lecture by inquiring lecture information, and provide recommendation information for the third lecture to the first learner terminal 110 .

That is, when a playback request for the first lecture is received from the first learner terminal 110, the device 300 predicts the first learner's concentration time for the first lecture, and the first learner's concentration time is If it is confirmed that it is out of the learner's permissible range, it is determined that the first lecture is not suitable for the first learner, and if it is confirmed that the first learner's concentration time is longer than the maximum time of the learner's permissible range, it is longer than the first lecture. It is determined that the third lecture produced by is suitable for the first learner, and recommendation information on the third lecture may be provided to the first learner terminal 110 . In this case, the device 300 may provide the first learner terminal 110 with recommendation information for the first lecture and the third lecture.

11 is an exemplary diagram of a configuration of a device according to an embodiment.

Apparatus 300 according to an embodiment includes a processor 310 and a memory 320 . The processor 310 may include at least one device described above with reference to FIGS. 1 to 10 or may perform at least one method described above with reference to FIGS. 1 to 10 . A person or organization using the device 300 may provide services related to some or all of the methods described above with reference to FIGS. 1 to 10 .

The memory 320 may store information related to the methods described above or a program in which the methods described below are implemented. Memory 320 may be volatile memory or non-volatile memory.

The processor 310 may execute a program and control the device 300 . Program codes executed by the processor 310 may be stored in the memory 320 . The device 300 may be connected to an external device (eg, a personal computer or network) through an input/output device (not shown) and exchange data through wired/wireless communication.

The embodiments described above may be implemented as hardware components, software components, and/or a combination of hardware components and software components. For example, the devices, methods and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate (FPGA). array), programmable logic units (PLUs), microprocessors, or any other device capable of executing and responding to instructions. A processing device may run an operating system (OS) and one or more software applications running on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to execution of software. For convenience of understanding, there are cases in which one processing device is used, but those skilled in the art will understand that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it can include. For example, a processing device may include a plurality of processors or a processor and a controller. Other processing configurations are also possible, such as parallel processors.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program commands recorded on the medium may be specially designed and configured for the embodiment or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Software may include a computer program, code, instructions, or a combination of one or more of the foregoing, which configures a processing device to operate as desired or processes independently or collectively. The device can be commanded. Software and/or data may be any tangible machine, component, physical device, virtual equipment, computer storage medium or device, intended to be interpreted by or provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed on networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer readable media.

As described above, although the embodiments have been described with limited drawings, those skilled in the art can apply various technical modifications and variations based on the above. For example, the described techniques may be performed in an order different from the method described, and/or components of the described system, structure, device, circuit, etc. may be combined or combined in a different form than the method described, or other components may be used. Or even if it is replaced or substituted by equivalents, appropriate results can be achieved.

Therefore, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

Claims (3)

A method for providing writing contents of an online lecture based on image processing performed by an apparatus,
Obtaining a lecture video of the online lecture of the first instructor when the class for the online lecture of the first instructor is terminated;
Extracting a video image of a first point of view, which is the last point of the class, as a first image from the lecture video;
dividing an area occupied by writing in the first image into a first area, and extracting a 1-1 image by dividing a portion of the first image where the first area is located;
dividing an area occupied by the first instructor in the 1-1 image into a second area when it is confirmed that the first instructor is present in the 1-1 image;
As a result of replaying and analyzing the lecture video in reverse chronological order from the first point of view, if it is confirmed that the first instructor is not present in the second area at the time of 1-1, the lecture video of the 1-1 point of view extracting the video image as a second image;
extracting a 2-1 image by dividing a portion of the second image in which the second area is located;
replacing a portion of the 1-1 image with the second area with the 2-1 image;
As a result of reproducing and analyzing the lecture video in reverse chronological order from the first time point, if it is confirmed that there is no letter in the first area at the second time point, the first section from the second time point to the first time point setting up; and
Based on the 1-1 image, generating first content for providing a writing for the lecture of the first section,
A method for providing writing content for online lectures based on image processing. delete According to claim 1,
After generating the first content,
Checking whether the second point in time is the start point of the class in the lecture video;
extracting a video image of a third viewpoint immediately before the second viewpoint as a third image when it is determined that the second viewpoint is not the class start time;
dividing an area occupied by writing in the third image into a third area, and extracting a 3-1 image by dividing a portion of the third image where the third area is located;
As a result of reproducing and analyzing the lecture video in reverse chronological order from the third time point, if it is confirmed that there is no letter in the third area at the fourth time point, the second section from the fourth time point to the third time point setting up; and
Based on the 3-1 image, generating second content for providing a writing on the lecture of the second section,
A method for providing writing content for online lectures based on image processing.

Images