KR101702013B1 - Smart education service system with video having function of sharing content of a variety of formats and Smart education method with video using thereof - Google Patents

Abstract

The present invention relates to a smart image training system having a content sharing function in various formats between an education support server 10, one or more lecturer terminals 20 and one or more learner terminals 30, And a lecture image processing unit (21a) for receiving a lecture image and voice through the lecturer terminal interface unit, encoding the lecture image and voice, and transmitting the lecture image to the education support server (10) through a communication unit in real time, Receives the message, processes it, displays it, transmits it to the education support server 10 through the communication unit, processes the text message of the student sent through the communication unit to be displayed, displays the stored lecture note or lecture note on the screen The lecture data displayed on the screen and the handwriting of the user on the lecture note A teacher terminal control unit (21) for inputting a mark and displaying it on the screen of the learner terminal together with lecture data or a lecture note, and transmitting the lecture note to the education support server (10) through the communication unit; The lecture data or the lecture note is displayed on the lecture terminal and the lecture note or the lecture note is inputted to the instructor terminal control unit 21 The instructor terminal control unit 21 displays the data to be shared on the instructor terminal according to the user's selection, captures a screen image, and displays the captured image as a video source And transmits the encoded data to the education support server 10 through the communication unit 23.

Description

[0001] The present invention relates to a smart image education system having various contents sharing functions, and a method of providing a video education service using the same.

The present invention relates to a video education system and a method for providing a video education service. More particularly, the present invention relates to a video education system, and more particularly, The present invention relates to a smart image training system having a content sharing function in various formats and a method of providing image training services using the same.

With the recent development of network communication, remote lecture service over the Internet has been provided to solve regional limitations of education.

In addition, such Internet lectures are being developed as a video education system that provides real-time lectures gradually from the way of presenting previously recorded lecture videos on the Internet, and it is also possible to provide lectures between lecturers and learners and lecturers, Interactive services that communicate with each other in an interactive manner are being attempted.

However, such real-time interactive interactive lecture services are mostly PC-based and can not escape the level of video chatting, which shares text messages and images. The decisive disadvantage is that lectures and contents of the lectures and lectures are provided in real time It can not be shared smoothly among students.

Especially, with the spread of mobile devices, mobile devices having various operating systems and limited applications as learner terminals become popular. That is, even though the lecturer shares various lecture materials, the learner terminal such as a mobile device having such a limit often does not have an application or playback ability to share it, and accordingly, real-time interactive The development of the video education system has been sluggish.

Korean Patent Laid-Open Publication No. 10-2013-0012652 (On-line remote river control system and on-line remote river control method)

Accordingly, it is an object of the present invention to solve the disadvantage of the existing real-time interactive interactive lecture service and to provide contents sharing in a variety of formats that can share live lecture data and book content with instructors and lecturers in real- And a method of providing a video education service using the same.

According to an aspect of the present invention, there is provided a smart image training system having a content sharing function in various formats between an education support server, at least one instructor terminal, and at least one learner terminal, The lecturer terminal includes a lecture image processing unit 21a that receives lecture video and audio through a lecturer terminal interface unit, encodes the lecture video and audio through a lecturer terminal interface unit, and transmits the lecture image to the education support server 10 through a communication unit in real time. A text message of the lecturer is received, processed and displayed, and transmitted to the education support server 10 via the communication unit, a text message of the lecturer transmitted through the communication unit is displayed, and stored lecture data or lecture notes On the screen, the lecture data displayed on the screen and the lecture notes An instructor terminal control unit (21) for receiving a handwriting and a mark of a user, processing the handwriting and mark to be displayed on the screen of the learner terminal together with lecture data or a lecture note, and transmitting it to the education support server (10) through the communication unit; Setting and changing a voice and image, a shared screen area constituting the video and audio of the lecture, inputting a text message, displaying the lecture note or lecture note, and inputting the handwriting and mark of the lecture note or lecture note And instructor terminal control unit 21 for transmitting the instructor terminal control unit 21 to the instructor terminal control unit 21. The instructor terminal control unit 21 displays the data to be shared on the instructor terminal according to the user's selection and captures the screen Encodes the captured image into a moving image as a video source, and transmits the encoded moving image to the education support server 10 via the communication unit 23. The instructor terminal control unit 21 executes data to be shared The application is activated and displayed on the screen of the instructor terminal, and the setting of the user's shared screen area on the instructor terminal screen And a shared screen processing unit 21b for capturing a screen at a predetermined cycle with respect to the set shared screen area, encoding the moving image using the captured image as a video source, and transmitting the encoded video to the education support server 10 through the communication unit 23 , And the instructor terminal interface unit 22 includes a shared screen setting unit 22c that receives setting and change of the user's shared screen area on the instructor terminal screen under the control of the shared screen processing unit 21b, And adjusts the frame rate and size of the moving picture to be encoded when the shared screen area of the user is changed through the shared picture setting unit 22c.

Preferably, the shared-screen processing unit 21b adjusts the frame rate and size of the moving picture to be encoded according to the state of the network.

Here, the instructor terminal control unit 21 generates a packet including the video source of the encoded moving picture, the XML information including the frame rate, the screen size, and the encoding method, and transmits the packet to the education support It is preferable to transmit it to the server 10.

delete

Preferably, the image processing unit 21a receives the moving image generated by the learner terminal through the communication unit according to the user's selection, decodes the moving image, and displays the decoded image on the screen of the lecturer terminal. And has a content sharing function.

Further, preferably, the instructor terminal interface unit 22 includes a student-student authority setting unit 22f for receiving an input for granting a right to perform a lecture to a specific student according to a user's selection, And an authority processing unit 21f for receiving an authorization input for a specific attending person through the authorization setting unit 22f, generating an authorization message for the specific attending person, and transmitting the generated authorization message to the communication unit 23 via the communication unit 23.

In another aspect, the present invention provides a method for providing an image training service using a smart image training system having various contents sharing functions between the education support server 10, one or more lecturer terminals 20 and one or more learner terminals 30 A shared data display step (410) for displaying an object to be shared on the screen by activating an application for executing data to be shared by the instructor terminal; A screen sharing input receiving step (420) for receiving a screen sharing starting input from the user through the user interface of the instructor terminal and displaying a window for screen sharing; A shared area setting input receiving step (430) of receiving setting and changing of a user's shared screen area related to the size and location of a window for the displayed screen sharing; A moving picture encoding / packetizing step of capturing a screen area included in the set screen sharing window as a shared screen area at regular intervals, generating a moving picture by encoding the captured image as a video source of the moving picture, and packetizing the moving picture (460); And a moving picture packet transmitting step (470) for transmitting the moving picture packet through a network to reproduce the moving picture packet in real time, wherein the frame rate and size of the moving picture to be encoded are adjusted when the user's shared screen area is changed .

Preferably, the instructor terminal checks the network status to which the instructor terminal is connected, and adjusts the frame rate and size of the video to be encoded according to the status of the network.

Preferably, the network status of the instructor terminal and the video processing capability of the instructor terminal are checked to adjust the capture period and the size of the image to be captured according to the state of the network and the video processing capability of the instructor terminal.

As described above, according to the present invention, the present invention solves the drawbacks of the existing real-time interactive interactive lecture service and shares the lecture data on the basis of the screen sharing method and the moving picture, thereby realizing lecture data in real time It has the effect that it can be shared smoothly among learners.

1 is a schematic diagram of a configuration of a smart image training system according to the present invention;
2 is a detailed configuration diagram of a main function part of the instructor terminal 20 according to an embodiment of the smart image education system of the present invention.
3 is a detailed configuration diagram of a main function part of the learner terminal 30 according to an embodiment of the smart image education system of the present invention.
FIG. 4 is a flowchart illustrating a process of sharing lecture data through screen sharing of a method of providing a video training service according to the present invention.
FIG. 5 is a flowchart of a lecture data sharing process in a learner terminal of a method of providing a visual education service according to the present invention.
FIG. 6 is a main screen capture of the process of sharing lecture data through screen sharing of the method of providing video training service of the present invention.
7 is a view of a main screen catcher in a learner terminal in a lecture data sharing process through screen sharing of a method of providing a visual education service of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification. And a detailed description thereof will be omitted to omit descriptions of portions that can be readily understood by those skilled in the art.

Throughout the specification and claims, where a section includes a constituent, it does not exclude other elements unless specifically stated otherwise, but may include other elements.

Hereinafter, the present invention will be described in detail with reference to the drawings.

FIG. 1 is a configuration diagram of a smart image training system according to the present invention. The smart image training system of the present invention comprises an education support server 10, at least one instructor terminal 20, and at least one learner terminal 30.

The education support server 10 remotely manages the smart image education service, thereby controlling the lecture opening process of the lecturer for the education service, managing the lecture provided, confirming the lecture contents of the learner, A web-based platform that manages and services all aspects of lectures such as notification, payment, lecture introduction, and lecture materials is provided to instructor terminals and learner terminals that are established according to the plan. Especially, And performs a function of a media server that relays live video.

2, the lecturer terminal 20 includes a lecturer terminal control unit 21, a lecturer terminal control unit 21, a lecturer terminal control unit 21, The instructor terminal interface unit 22 and the communication unit 23. This can be realized by functional combination of an application driven by a general purpose device such as a PC and a peripheral device of the device.

The instructor terminal control unit 21 includes a lecture image processing unit 21a that receives a lecture image and voice through a lecturer terminal interface unit and encodes the lecture image and voice into a moving picture and transmits the encoded lecture image to the education support server 10 through a communication unit, Receives a text message of the instructor through the interface, processes and displays the text message, transmits the text message to the education support server 10 through the communication unit, processes the text message of the attendance person transmitted through the communication unit to be displayed, A lecture note displayed on the screen and a handwriting and a mark of a user on the lecture note are inputted and processed so as to be displayed together with lecture notes or lecture notes on the screen of the learner terminal, To the server (10).

The lecture image processing unit 21a can receive and decode a moving picture generated at the learner terminal through the communication unit according to a user's selection and display it on the screen of the lecturer terminal.

 In addition to the lecture image processing section 21a, the shared screen processing section 21b includes a characteristic shared screen processing section 21b. The shared screen processing section 21b displays the material to be shared on the instructor terminal according to the user's selection, captures a screen, And transmits the encoded video to the education support server 10 through the communication unit 23. [

To this end, the shared screen processing unit 21b activates an application that executes data to be shared according to a user's selection, displays it on the screen of the instructor terminal, and inputs the setting of the user's shared screen area on the instructor terminal screen Captures a screen at a predetermined cycle with respect to the set shared screen area, and encodes the video using the captured image as a video source. In this case, the shared screen processing unit 21b adjusts the frame rate and size of the moving picture to be encoded according to the state of the network.

The shared screen processing unit 21b controls the shared screen setting unit 22c of the instructor terminal interface unit 22 to receive the setting of the shared screen area of the user on the instructor terminal screen, And adjusts the frame rate and the size of the moving picture to be encoded when the user's shared screen area is changed through the moving picture coding unit 22c.

 Generates a packet including the video source of the encoded moving picture, XML information including a frame rate, a picture size, and an encoding method, and transmits the packet to the education support server 10 through the communication unit 23.

 In addition, the instructor terminal control unit 21 receives the text message of the instructor, processes and displays the text message, transmits the text message to the education support server 10 through the communication unit, and processes the text message of the attendance person sent through the communication unit to be displayed The message processing module 21b displays the stored lecture material on the screen, receives the handwriting and the mark of the lecture on the lecture data displayed on the screen, processes the data so as to be displayed together with the lecture data on the screen of the learner terminal, A lecture data processing unit 21d for transmitting the lecture note to the education support server 10, a lecture note displayed on the screen, a handwriting and mark of the user on the lecture note displayed on the screen, And transmits the same to the education support server (10) through the communication unit And a processing unit (21e).

Further, the instructor terminal control unit 21 controls the instructor terminal control unit 22 so that the instructor terminal control unit 21 instructs the instructor terminal interface unit 22 to instruct the instructor terminal interface unit 22 to send a lecture to the specific lecturer through the lecturer authority setting unit 22f, And an authority processing unit 21f for generating an authorization message for the specific attendant and transmitting the generated authorization message to the communication unit 23 via the communication unit 23.

The instructor terminal interface unit 22 receives input of a voice and image, a shared screen area, and a text message constituting the video and audio of the lecture, a text message, displays the lecture data or lecture notes, A voice input unit 22a and an image input unit 22b for inputting voice and images constituting a lecture video and voice, and an input unit 22b for setting and changing a shared screen area, A handwriting / mark input unit 22e for displaying a lecture note or a lecture note and inputting a handwriting and a mark on the lecture note or lecture note, a screen setting unit 22c, a message input unit 22d for receiving a text message, And a lecturer-rights setting unit 22f for receiving an input for granting a right to proceed with lectures to a specific lecturer.

FIG. 3 is a detailed configuration diagram of a main functional part of a learner terminal 30 according to an embodiment of the smart image education system of the present invention. Basically, like the lecturer terminal 20 described above, the learner terminal control unit 31, A learner terminal interface unit 32 and a communication unit 33 as main components.

Each of the detailed configurations and functions of the learner terminal control unit 31 and the instructor terminal interface unit 32 is different from that of the instructor terminal control unit 21 and the instructor terminal interface unit 22 except that it does not include the configuration of the authority processing unit and the learner authority setting unit. In general, the transmission of the message and the transmission of the image of the user are always activated, but the transmission to the instructor terminal is limited. Only when receiving the authorization message for the right to proceed with the lecture, Is activated.

FIG. 4 is a flow chart of a lecture data sharing process by screen sharing of a method of providing a video education service of the present invention. FIG. 5 is a flowchart of a lecture data sharing process of sharing a lecture data to be.

Referring to FIG. 4, a smart image training system having a content sharing function of various formats according to the present invention and a method of providing an image training service using the smart image training system according to the present invention includes activating an application that executes data to be shared by an instructor terminal, A screen sharing input receiving step 420 for receiving a screen sharing starting input from the user through the user interface of the instructor terminal and displaying a window for screen sharing, A sharing area setting input receiving step 430 of receiving setting and changing of a user's shared screen area with respect to the size and position of a window for sharing, checking the network processing state of the instructor terminal and the video processing capability of the instructor terminal (440), thereby adjusting the frame rate and size of the moving picture to be encoded, (450) a step of capturing a screen area included in a window for the set screen sharing as a shared screen area at regular intervals, and encoding the captured image as a video source of the moving picture Packetizes the moving picture through a moving picture encoding / packetizing step 460 for creating a moving picture and packetizing the moving picture.

Exemplary XML information used for packetization is as follows [Table 1].

<? xml version = "1.0" encoding = "UTF-8"?>
<LiveNote>
<Streams>
<Stream>
<Email></Email>
<Channel></Channel>
<Audio Use = "Y">
<Bitrate></Bitrate>
<Encoding></Encoding>
<SamplePerSec></SamplePerSec>
<BitPerSample></BitPerSample>
<Channels></Channels>
<Compression></Compression>
<Extra></Extra>
</ Audio>
<Video Use = "Y">
<Bitrate></Bitrate>
<Width></Width>
<Height></Height>
<BitCount></BitCount>
<Compression></Compression>
<Fps></Fps>
<Extra></Extra>
</ Video>
</ Stream>
</ Streams>
</ LiveNote>

Then, the moving picture packet generated in the moving picture packet transmission step 470 is transmitted through the network to be reproduced in real time.

5, the above video packet is relayed by the education support server 10 and transmitted to the learner terminal 30 in real time. When the learner terminal 30 receives (510) a video packet, The packet is analyzed and an encoded video source is extracted therein (520). The extracted video source is decoded (530) in accordance with the encoding method included in the XML information, so that the learning data is shared through screen sharing (540) on the screen of the learner terminal.

FIG. 6 is a main screen capture of a lecture data sharing process by screen sharing of a method of providing a video education service of the present invention, and FIG. 7 is a diagram illustrating a main screen capture of a lecture data sharing process The main screen is a catcher.

FIG. 6A shows a lecturer terminal screen, FIG. 6B shows a lecturer terminal screen at the start of screen sharing, FIG. 6C shows a lecturer terminal screen at the time of sharing area adjustment, Fig. 7B is a learner's terminal screen during sharing. Fig.

The present invention has been described above with the aim of method steps illustrating the performance of certain functions and their relationships. The boundaries and order of these functional components and method steps have been arbitrarily defined herein for convenience of description. Alternative boundaries and sequences may be defined as long as the specific functions and relationships are properly performed. Any such alternative boundaries and sequences are therefore within the scope and spirit of the claimed invention. In addition, the boundaries of these functional components have been arbitrarily defined for ease of illustration. Alternative boundaries can be defined as long as certain important functions are properly performed. Likewise, the flow diagram blocks may also be arbitrarily defined herein to represent any significant functionality. For extended use, the flowchart block boundaries and order may have been defined and still perform some important function. Therefore, alternative definitions of both functional components and flowchart blocks and sequences are within the scope and spirit of the claimed invention.

The invention may also be described, at least in part, in the language of one or more embodiments. Embodiments of the invention are used herein to describe the invention, aspects thereof, features thereof, concepts thereof, and / or examples thereof. The physical embodiment of an apparatus, article of manufacture, machine, and / or process for implementing the invention may include one or more aspects, features, concepts, examples, etc., described with reference to one or more embodiments described herein . Moreover, in the entire drawings, embodiments may incorporate the same or similarly named functions, steps, modules, etc. that may use the same or different reference numerals, and so forth, Steps, modules, etc., may be the same or similar functions, steps, modules, etc., or the like.

As described above, the present invention has been described with reference to particular embodiments, such as specific elements, and specific embodiments and drawings. However, it should be understood that the present invention is not limited to the above- And various modifications and changes may be made thereto by those skilled in the art to which the present invention pertains.

Accordingly, the spirit of the present invention should not be construed as being limited to the embodiments described, and all of the equivalents or equivalents of the claims, as well as the following claims, belong to the scope of the present invention .

10: education support server 20: instructor terminal
30: learner terminal

Claims (10)

A smart image education system having a content sharing function in various formats between an education support server (10), one or more lecturer terminals (20) and one or more learner terminals (30)
The lecturer terminal includes a lecture image processing unit 21a that receives lecture video and audio through a lecturer terminal interface unit, encodes the lecture video and audio through a lecturer terminal interface unit, and transmits the lecture image to the education support server 10 through a communication unit in real time. A text message of the lecturer is received, processed and displayed, and transmitted to the education support server 10 via the communication unit, a text message of the lecturer transmitted through the communication unit is displayed, and stored lecture data or lecture notes And displays a lecture note or a lecture note on the screen of the learner terminal, receives the lecture note and the mark on the lecture note displayed on the screen, displays the lecture note and the lecture note on the screen of the learner terminal, 10); &lt; RTI ID = 0.0 &gt; a &lt; / RTI &gt;
Setting and changing a voice and image, a shared screen area constituting the video and audio of the lecture, inputting a text message, displaying the lecture note or lecture note, and inputting the handwriting and mark of the lecture note or lecture note To the instructor terminal control unit (21), and the teacher terminal interface unit (22)
The instructor terminal control unit 21 displays the data to be shared on the instructor terminal, captures the screen, and encodes the captured image into a moving image having a video source according to the user's selection, (10)
The instructor terminal control unit 21 activates an application that executes data to be shared according to a user's selection, displays the same on the screen of the instructor terminal, and inputs the settings of the user's shared screen area on the instructor terminal screen And a shared screen processing unit (21b) for capturing a screen at a predetermined cycle with respect to a set shared screen area, encoding a moving image having the captured image as a video source, and transmitting the encoded moving picture to the education support server (10) through the communication unit (23)
The instructor terminal interface unit 22 includes a shared screen setting unit 22c for receiving setting and changing of a user's shared screen area on the instructor terminal screen under the control of the shared screen processing unit 21b, And adjusts the frame rate and size of the moving picture to be encoded when the user's shared screen area is changed through the screen setting unit (22c). The method according to claim 1,
Wherein the shared screen processing unit (21b) adjusts the frame rate and size of the moving picture to be encoded according to the state of the network. 3. The method of claim 2,
The instructor terminal control unit 21 generates a packet including the video source of the encoded moving picture, the XML information including the frame rate, the screen size, and the encoding method, and transmits the packet to the education support server 10. The smart image education system according to claim 1, delete The method according to claim 1,
The lecture image processing unit 21a receives and decodes a moving picture generated by the learner terminal through the communication unit according to a user's selection and displays the decoded image on the screen of the lecturer terminal. Video education system. The method according to claim 1,
The lecturer terminal interface unit 22 includes a lecturer authority setting unit 22f for receiving an input for granting a right to proceed a lecture to a specific lecturer according to a user's selection, And an authorization processing unit (21f) for receiving an authorization input for a specific attending person through the communication unit (23) and generating an authorization message for the specific attending person through the communication unit (23) A smart image training system. A method for providing a video training service using a smart image training system having a content sharing function in various formats between an education support server (10), one or more lecturer terminals (20) and one or more learner terminals (30)
A shared data display step (410) of displaying an object to be shared on the screen by activating an application for executing data to be shared in the instructor terminal;
A screen sharing input receiving step (420) for receiving a screen sharing starting input from the user through the user interface of the instructor terminal and displaying a window for screen sharing;
A shared area setting input receiving step (430) of receiving setting and changing of a user's shared screen area related to the size and location of a window for the displayed screen sharing;
A moving picture encoding / packetizing step of capturing a screen area included in the set screen sharing window as a shared screen area at regular intervals, generating a moving picture by encoding the captured image as a video source of the moving picture, and packetizing the moving picture (460); And
And a moving picture packet transmission step (470) for transmitting the moving picture packet through a network to reproduce in real time,
And adjusting the frame rate and size of the moving picture to be encoded when the user's shared screen area is changed. 8. The method of claim 7,
And controlling a frame rate and a size of a moving picture to be encoded according to a state of the network by checking a network state to which the instructor terminal is connected. 8. The method of claim 7,
And controlling a capturing period and a size of an image to be captured according to the state of the network and the video processing capability of the instructor terminal by checking the network state of the instructor terminal and the video processing capability of the instructor terminal, A Method for Providing Video Education Service Using. A medium on which a computer-readable program for performing the method of any one of claims 7 to 9 is recorded.

Images