KR101711203B1 - System for providing multimedia contents, and Control Method Thereafter - Google Patents

Abstract

The present invention relates to a system for providing multimedia content and a method for controlling the system. More specifically, the present invention relates to a system for providing multimedia content, such as a source code, an image, an execution result, and the like, and also relates to a method for controlling the system. A system for providing multimedia content according to an embodiment of the present invention comprises: a main server which transfers information, required for WebRTC between first and second user terminals, to the first and second user terminals by using a WebSocket and allocates accounts of a Linux server for a class to the respective first and second user terminals; a relay server which transfers data, received from a Linux server by using the WebSocket, to the first user terminal and/or second user terminal in real time and transfers instructions or codes, input via the first or second user terminal, to the Linux server; and the Linux server which executes the instructions input via the first or second user terminal and received from the relay server.

Description

Technical Field [0001] The present invention relates to a multimedia contents providing system and a control method therefor,

The present invention relates to a multimedia contents providing system and a control method thereof, and more particularly, to a system and a control method for providing multimedia contents such as a source code, an image, and an execution result.

In line with the government's mandate for SW education in 2018, there is an increasing demand for programming education, and now there is an increase in providers and users of programming education through private institutes / tutoring. In addition, many people are offering programming videos online or developing / providing various learning contents.

However, current online lecture providing sites are one-to-many, so they do not provide an environment to receive individual lessons, and there is no big market due to the spatial / time constraints of academy / tutoring.

In the past, as the IT technology has developed, the concept of the picture tutoring has been introduced, and there has been an increasing demand for lecturers and students to teach on-line in mathematics and English, . In the existing programming system, the instructor and the student have to meet each other in offline, and the time and space restrictions are enormous. Therefore, there is a need for a web-based platform system that provides multimedia content that can be used for programming video education online.

Korean Patent Laid-Open No. 10-2015-0104661, an open market online education content relay method Korean Patent Laid-Open No. 10-2014-0011592, apparatus and method for supporting lecture program operation

SUMMARY OF THE INVENTION It is an object of the present invention to provide a multimedia contents providing system and a control method thereof.

However, the object of the present invention is not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

The system for providing multimedia contents according to an embodiment of the present invention transmits information necessary for WebRTC to each of the first user terminal and the second user terminal through WebSocket and instructs the first user terminal and the second user terminal Main server to allocate Linux server account for; A relay server for transmitting data received from the Linux server using the WebSocket to the first user terminal and / or the second user terminal in real time, and for transmitting commands or codes input from the first user terminal or the second user terminal to the Linux server; And a Linux server for executing a command input from the first user terminal and the second user terminal received from the relay server.

Preferably, the main server stores at least one of a lecture time, a lecture language, and a desired key (electronic money), which is information set by the first user when entering the lecture room page, And a DB control unit for determining whether the event is ended or ending due to an abnormal event, initializing the information set in the classroom in case of a normal end, and storing the current class time in case of an end due to an abnormal event.

Preferably, the main server shares information for a WebRTC connection between the first user terminal and the second user terminal, and transmits event information including a lecture end or coin payment every 30 minutes to the first user terminal or the second user terminal, A WebSocket communication unit for delivering the information to the terminal; And an http communication unit performing the html rendering of the lecture room and the previously stored code loading when the first user terminal or the second user terminal is connected to the lecture room and performing an http response to the request out of the lecture room .

Preferably, the relay server includes a Paramiko SSH communication unit for communicating with a Linux server, a WebSocket communication unit for communicating a lecture room event with the first and second user terminals, whether or not each account of the Linux server is allocated Further comprising: a memory for storing a list storing an empty account and updating a Linux server account list to the first and second users, wherein the WebSocket communication unit allocates an account of a Linux server from the first and second user terminals Receives a command request including a request, compile or execution, and returns the result from the Linux server to the user terminals.

Preferably, the Linux server includes an SSH communication unit for exchanging data between a Linux server and a relay server; And a memory for storing and compiling a code among the data transmitted through the SSH communication unit, wherein the memory allocation is limited for each of the first user terminal and the second user terminal, and the lecture terminal and the learner terminal are disconnected from the lecture room page The stored code is deleted.

Preferably, when a screen sharing button is clicked on the screen of the first user terminal, a screen sharing window is created on the screen of the second user terminal, and data shared by the first user terminal with the second user terminal is displayed as a second And is displayed on the user screen.

A method of controlling a multimedia content providing system according to another embodiment of the present invention is a method of controlling a multimedia content providing system in which a main server transmits information required for a WebRTC to a first user terminal and a second user terminal via a WebSocket, A step of assigning an account of a Linux server for each class to each user terminal; The relay server transfers data received from the Linux server using the WebSocket to the first user terminal and / or the second user terminal in real time, and transmits the command or codes inputted from the first user terminal or the second user terminal to the Linux server A relaying step; And executing a command input from the first user terminal and the second user terminal received from the relay server by the relay server; And a control unit.

Preferably, the method further includes a shell output result display step of delivering a result output to the shell of the Linux server account allocated to the first user terminal and the second user terminal to the first user terminal and the second user terminal, .

A control method of a multimedia contents providing system according to another embodiment of the present invention includes loading instruction information including lecture time or coin information from a database and transmitting the instruction information to a user terminal Interconnection step; A Linux account assignment step of assigning a Linux account to each of the first user terminal and the second user terminal; A compiling and executing step of transmitting a command and code for compiling and execution from the first user terminal or the second user terminal to the Linux server via the relay server and compiling and executing the code in the Linux server;

And a source file synchronization step of synchronizing source files edited by the first user and the second user in the classroom page using the WebRTC.

Preferably, the method further comprises the step of opening a lecture room where the first user terminal and the second user terminal are connected to the main server, and the first user terminal establishes a lecture room page only for the second user terminal .

Preferably, the method further includes transmitting a shell output result to the first user terminal and the second user terminal and displaying a result output to the shell of the Linux server account assigned to the first user terminal and the second user terminal, .

Preferably, the step of synchronizing the source files comprises the steps of synchronizing among the user terminals in real time when a source file is added, removed, or renamed; And synchronizing the contents of the source file with the user terminals in real time when editing the contents of the source file.

Preferably, the method further comprises a settlement step of delivering a part of the coin set by the first user and the second user each time the goods (coin) of the second user becomes a predetermined time for the first user .

Preferably, the method further comprises a connection restoring step of restoring the connection when the class connection is terminated due to abnormal termination by any one of refresh, backward, and browser termination.

A computer-readable recording medium according to another embodiment of the present invention records a program for executing a control method of a multimedia content providing system.

As described above, according to the multimedia contents providing system and the control method of the present invention, a programming education provider and a programming education attendee can provide multimedia contents such as source code, image, and execution result on-line without disturbing time / I can do programming lessons. In addition, using WebRTC technology, the role of server can be minimized and video chatting and code sharing can be done only by connecting between clients.

In addition, an environment similar to a conventional commercial programming development tool can be used on the web by using the integrated development environment (IDE) provided in the present invention, and the Linux shell provided in the present invention can be used for a Linux environment Practice is available, and real-time programming breaks the existing limitations that only exist offline, and provides a sufficient image programming environment to access the web online.

1 is a block diagram of a system for providing multimedia contents according to the present invention.
2 is a block diagram of a main server according to the present invention.
FIG. 3 shows a configuration of a relay server according to the present invention.
FIG. 4 shows a configuration of a Linux server according to the present invention.
FIG. 5 shows the overall screen configuration of a web-based classroom provided by the multimedia contents providing system 10000 according to the present invention.
FIG. 6 illustrates a configuration of screen sharing according to the present invention.
FIG. 7 illustrates a method of controlling a multimedia contents providing system according to another embodiment of the present invention.
FIG. 8 illustrates a control method of a system for providing multimedia contents according to another embodiment of the present invention.
FIG. 9 is a general flowchart of a class connection process between a first user (lecturer) and a second user (lecturer) according to the present invention.
10 is a flowchart illustrating a process of inputting a Linux command of a first user (lecturer) and a second user (lecturer) according to the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The present invention is capable of various modifications and various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the term "comprising" or "comprising" or the like is intended to specify the presence of stated features, integers, But do not preclude the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof.

1 is a block diagram of a system for providing multimedia contents according to the present invention. 1, the web-based platform system may include a main server 1, a lecturer terminal 2, a learner terminal 3, a relay server 4, and a plurality of Linux servers 5. The main server 1, the lecturer terminal 2, the learner terminal 3, the relay server 4 and the plurality of Linux servers 5 are connected via a network (not shown) to transmit and receive data or information. The network may be a wired or wireless network. Wireless networks include CDMA, LTE, WiFi, zigbee, and Bluetooth. For secure information transmission, a communication transmission protocol such as TCP / IP and UDP / IP is required. In addition, message delivery services such as SMS and MMS are needed for carrying information to be transmitted in the form of a message. An IP network can be used as a wired network. The lecture terminal 2 and the learner terminal 3 may be any one of a general personal computer (PC), a notebook PC, a tablet PC, and a smart phone. The lecturer terminal 2 or the learner terminal 3 transmits a command request such as an account assignment request, compile or execution to the Linux server to the relay server and receives the result from the Linux server through the relay server. Also, the standard output (stdout) of the Linux Shell connected to the user is output to the user terminal (2, 3) such as the lecturer terminal or the learner terminal.

The multimedia contents providing system according to an embodiment of the present invention transmits information necessary for the WebRTC to each of the lecture terminal and the learner terminal through the WebSocket and transmits the lecture terminal and the learner terminal to the peer terminal a peer to peer connection; A relay server for assigning a Linux server account for each class, delivering data received from a Linux server using WebSocket to the lecture terminal and the learner terminal in real time, and transmitting the lecture terminal and the commands inputted from the learner terminal to the Linux server; And a Linux server that executes commands input to the lecture terminal and the learner terminal.

2 is a block diagram of a main server according to the present invention. As shown in FIG. 2, the main server 1 includes a DB control unit 11, a WebSocket communication unit 12, and an HTTP communication unit 13.

As shown in FIG. 2, the DB control unit 11 transmits information (a lecture time, a language to be lectured, a desired key (electronic money)) set when the lecturer enters the lecture room using the lecturer's terminal . Further, the DB control unit 11 judges whether the lecturer or the learner goes out of the room or whether it is a normal end or an end due to an abnormal event. In case of a normal end, the information set in the classroom is initialized. In case of termination due to an abnormal event, the current class time and payment history are stored.

The WebSocket communication unit 12 shares information for the WebRTC connection between the lecture terminal 2 and the learner terminal 3. [ And also transmits event information such as the end of the lecture and coin dispensing every 30 minutes to the user terminals 2 and 3 in the main server 1.

The hypertext transfer protocol (http) communication unit 13 performs rendering of html (HyperText Markup Language), loading of previously stored codes, etc. when each user terminal 2, 3 connects to the classroom. It also performs http response (response) to requests outside the classroom.

FIG. 3 shows a configuration of a relay server according to the present invention.

As shown in FIG. 3, the relay server 4 includes a communication unit 40 and a memory unit 43. The communication unit 40 includes a Paramiko SSH (secure shell) communication unit 42 for communication with the Linux server 5 and a WebSocket communication unit 41 for communicating with a classroom event with the user. The WebSocket communication unit 41 receives a command request including a request from a lecturer or a lecturer or a user terminal 2 or 3 of the lecturer, that is, an account assignment request, compilation or execution of a Linux server, And returns the result to the user. The memory unit 43 stores a list storing the accounts of each account of the Linux server 5, and performs an empty account assignment and a Linux server account list update to the user.

FIG. 4 shows a configuration of a Linux server according to the present invention.

As shown in FIG. 4, the Linux server 5 includes an SSH communication unit 51 and a memory unit 52. The SSH communication unit 51 serves to exchange data between the Linux server and the relay server. The memory unit 52 stores and compiles commands and codes received through the SSH communication unit 51 when each user presses the "compile and execute" button 400 on the screen. The memory quota is limited for each user, and when the user leaves the classroom, the stored code is deleted. The SSH communication unit 51 receives a command corresponding to a desired operation of the user transmitted from the relay server, and transmits the command to the memory unit 52. The memory unit 52 receives and executes the instruction, returns the execution result to the SSH communication unit, and stops the execution if it is larger than the memory allocated to each user.

FIG. 5 shows the overall screen configuration of a web-based classroom provided by the multimedia contents providing system 10000 according to the present invention.

As shown in FIG. 5, the identification number 100 in the classroom screen is a code editing window for code editing, and 200 is a window for outputting the standard output (stdout) of the Linux Shell connected to the user to the output window of the Linux Shell to the user terminal. 300 is a command input window and is a window for inputting a command to be transmitted to the standard input (stdin) of the Linux Shell at the user terminal. 400 is a compile and execute button that passes compilation commands and execution commands to the Linux server. 500 is a stop button that sends a process interruption interrupt (Ctrl ^ c) to a process running on the Linux server. 600 is the end button of the class, and the lecturer sends the class end signal to the main server. Reference numeral 700 denotes a temporary storage button, which is used by the user to store the source files in the database (DB) of the main server. Reference numeral 800 denotes a data screen sharing button, which is a button for a first user (lecturer) to go to a page for selecting data to be shared to a second user (student). 900 is a counterpart window on which the other party receives and displays the image shot by the web camera. 1000 is a window of the user's own screen showing the image taken by the web camera. Reference numeral 1100 denotes a source file directory window, which is a window showing the source file directories of the first and second users. 1200 means tab, and you can add a new tab for working on a new source file.

FIG. 6 illustrates a configuration of screen sharing according to the present invention. In FIG. 5, 800 is a data screen sharing button, which is a button for a first user (lecturer) to go to a page for selecting data to be shared with a second user (student). When the data screen sharing button of the lecturer terminal or the learner terminal is clicked, a screen sharing window of Fig. 6 is created on the screen of the second user terminal. A separate data sharing window may be created on the learner terminal screen or a data sharing window may be created when the learner terminal clicks the screen sharing button even if only the data screen sharing button on the lecturer terminal is clicked.

As shown in FIG. 6, the identification number S100 is a screen window shared by the lecturer, and is a window for displaying data shared by the first user (lecturer) as images. S200 is a full-screen button, and is a button for making the screen of S100 a full screen. S300 is a pause button for temporarily stopping the screen of S100. As shown in FIG. 6, if a student shares a lecture with a student and displays a video image on the screen and a full screen (S200) button is pressed, the sharing screen is displayed on the entire display screen of the learner's terminal. Press the pause button (S300).

1 and 5, in the multimedia contents providing system 10000 according to the present invention, a peer to peer connection (P2P) connection between a first user terminal (lecturer terminal 2) and a second user terminal (Communication connection) between the first user and the second user. Accordingly, the load on the service providing server generated during the process of transmitting the video data (900, 1000 in FIG. 5) from the service providing server to the user terminal during the existing video chatting is solved.

Further, the present invention implements a code editing window (100 of FIG. 5) capable of simultaneously editing programming codes from a first user terminal (lecturer terminal) and a second user terminal (student attending terminal). The code editing window 100 is implemented by html and Jquery (a JavaScript compatible HTML library with browser compatibility and designed to simplify the client side script language) for each user terminal, and when each user inputs a code The color and indentation of the characters differs according to the grammar of each code. It also provides the ability to add a new tab 1200 to each user terminal 2, 3 for ease of programming by each user. Using the tab 1200, each user can edit multiple source files at one time.

The present invention also provides a method for providing an image to a second user (student) by an application unit (a word file, a pdf file, or the like) by a first user (lecturer) Lt; / RTI > This image, which is shared in real time, is also realized through P2P Connection between first and second user terminals without load of service providing server.

In addition, the present invention provides a function of actually compiling a code created to help the learning of a second user (student) and showing the result of execution to the terminal 3 of the second user. Also, the Linux Shell is provided to the terminals of the first and second users, and the first and second users input the actual Linux commands (300) using the corresponding Shell and view the results in the respective user terminals (200). In addition, the first and second users use a separate relay server 4 in order to use a command such as stop (Ctrl ^ c) in using the Linux Shell.

FIG. 7 illustrates a method of controlling a multimedia contents providing system according to another embodiment of the present invention.

As shown in FIG. 7, the control method of the system for providing multimedia contents according to the present invention may include a setting step S1, a relay step S2, an execution step S3, and a displaying step S4.

A method of controlling a multimedia content providing system according to another embodiment of the present invention is a method of controlling a multimedia content providing system in which a main server transmits information required for a WebRTC to a first user terminal and a second user terminal via a WebSocket, A step of assigning an account of a Linux server for each class to each user terminal; The relay server transfers data received from the Linux server using the WebSocket to the first user terminal and / or the second user terminal in real time, and transmits the command or codes inputted from the first user terminal or the second user terminal to the Linux server A relaying step; And executing a command input from the first user terminal and the second user terminal received from the relay server by the relay server; And a shell output result display step of delivering the result output to the shell of the Linux server account allocated to the first user terminal and the second user terminal to the first user terminal and the second user terminal and displaying the shell output result .

FIG. 8 illustrates a control method of a system for providing multimedia contents according to another embodiment of the present invention. 8, the control method of the multimedia contents providing system according to the present invention includes a classroom opening step S10, a user terminal connecting step S20, a Linux account assigning step S30, a compiling and executing step S40, A shell output result delivery step S50, a source file synchronization step S60, a settlement step S70, and a connection recovery step S80.

A control method of a multimedia contents providing system according to another embodiment of the present invention is a method of controlling a multimedia contents providing system in which a first user terminal and a second user terminal connect to a main server and a first user terminal connects only to a second user terminal Opening a classroom to open a classroom page; A step of bringing in information (including lecture time and coin information) necessary for the lecture from the database, and establishing a WebRTC between the first user and the second user terminal; A Linux account assignment step of assigning a Linux account to each of the first user terminal and the second user terminal; A compiling and executing step of transmitting a signal and a command (command) for compiling and executing from the first user terminal or the second user terminal to the Linux server via the relay server and compiling and executing the code in the Linux server; A shell output result delivery step of delivering a result output to the shell of the Linux server account allocated to the first user terminal and the second user terminal to the first user terminal and the second user terminal for display; And a source file synchronization step of synchronizing the source files edited by the first user and the second user in the classroom page without the load of the server using the WebRTC.

FIG. 9 is a general flowchart of a class connection process between a first user (lecturer) and a second user (lecturer) according to the present invention. FIG. 9 shows a step of establishing a classroom (S10) and a connection step (S20) between user terminals of FIG.

10 is a flowchart illustrating a process of inputting a Linux command of a first user (lecturer) and a second user (lecturer) according to the present invention. FIG. 10 shows the compilation and execution step (S40) and the shell output result delivery step (S50) of FIG.

8 to 10, a control method of the multimedia contents providing system of the present invention will be described below.

9, the first user (lecturer) and the second user (lecturer) can use the terminals 2 and 3 of his / her own to access the main server 1 and the main server 1 through the enrollment application mechanism Once the connection is made, the first user performs the step of opening a classroom page (see FIG. 5) for the second user only. The user other than the designated user can not enter the corresponding classroom page (refer to FIG. 5) by using the student ID, the classroom number or the password. The first step includes setting up a lecture room / coin setting in Fig. 9, a lecture time, storing coin information, and accessing a lecture room.

After the lecture room page (see Fig. 5) is opened as shown in Fig. 9, the information (lecture time, coin information, etc.) necessary for the lecture is retrieved from the database and set up and WebRTC is established between the user terminals Perform the steps. The second step includes steps 4, 5, WebRTC and step 6 in FIG.

In a third step S30, a step of allocating a Linux account to each of the first user terminal and the second user terminal is performed.

5, when a button (or an icon) for compiling and execution is clicked on the terminals 2 and 3 of the user on the screen, as shown in FIG. 5, commands for compiling and execution ) To the relay server 4, and the relay server 4 transmits the signal and the code to the Linux server, and compiles and executes the code in the Linux server.

In the fifth step S50, as shown in FIG. 10, the result output to the shell of the Linux server account allocated to each user is transmitted to the terminals 2 and 3 of the user and displayed on the screen.

In a sixth step S60, as shown in FIG. 5, a step of synchronizing source files edited by the first user and the second user in the classroom (see FIG. 5) without load of the server is performed using the WebRTC. The first function of the synchronization function is to synchronize users in real time when adding, removing and renaming source files. The second function is a function of synchronizing users in real time when editing the contents of a source file.

In the seventh step S70, a part of the set coins is delivered each time the goods (coin) of the second user becomes a predetermined time for the first user in the class of the first user and the second user . The first user and the second user can avoid a situation where the first user can not receive the full amount due to the abnormal termination during the class. In addition, when the second user desires to stop the class due to dissatisfaction of the class, the amount of money can be paid to the first user in proportion to the time of the class. In order to prevent the above problem in the conventional image tutoring platform, the intermediary receives the goods in advance to the second user, and then determines the contents of the instruction and delivers the contents to the first user. Minimize the role of intermediaries by simplifying this procedure.

In the eighth step S80, when the class connection is terminated abnormally (refresh, backward, browser termination, etc.), the connection can be restored.

Hereinafter, a method of controlling the multimedia contents providing system of the present invention will be described in detail with reference to FIGS. 8 to 10. FIG.

In the first step S10, a first user (a lecturer) and a second user (a student attending a lecture) communicate with a main server 11 through a course entry mechanism using their terminals 2 and 3 through a wired or wireless connection (Connection) is made, the first user opens a classroom page (see FIG. 5) for the second user only.

In the first step, the second user can request a lecture attendance request to a desired lecturer through a homepage showing information of a first user (lecturer) through his / her terminal. The first user (lecturer) who has been requested to enroll may accept or reject the second user's enrollment through his / her terminal. When the first user (lecturer) accepts the lecture, the main server 1 stores the connection information of the lecturer (hereafter, the first user) and the second user in the database DB. When the first user establishes a classroom for the second user, the main server 1 uses a universally unique identifier (UUID) for the first user who has requested the opening of the classroom, . And stores the URL (Uniform Resource Locator) of the classroom room page generated using this identifier in the database (DB).

Also, when the first user opens the classroom, a button or icon for accessing the classroom of the first user is activated on the connected lecturer information page of the second user. When the second user presses the corresponding button or icon, the main server 1 causes the second user to move to the lecture room established by the first user through the lecture room URL information of the first user stored in the DB. When a first user opens a classroom to prevent access to other users except for the first and second users in the classroom, the ID of the second user, the opened classroom number or the password is stored in the DB. The ID of the user who sends the access request to the classroom (see FIG. 5) is compared with the ID of the second user (student) stored in the DB, and the access is rejected in other cases and the address is redirected to the main page .

The second step S20 is a step of establishing the information necessary for the class and establishing the WebRTC among the users after the class room is opened.

In the second step, the first user can open a lecture room (see Fig. 5) for the lecture process only for the second user who has applied for the lecture. When a first user presses a button for opening a classroom, a WebSocket for first and second users is created in the main server 1, and the first user attempts to connect to the main server 1 through the WebSocket. After establishing a WebSocket connection between the terminal 2 of the first user and the main server 1, the first user transmits the class time to be performed in the classroom through the terminal 2, the desired coin to the second user, , And the language to be taught (C, Python, Java, etc.). For example, you may set up a separate payment procedure for the cost of the lecture, without setting the good.

When the first user completes the setting through the terminal 2, the setting value is transmitted to the main server 1 via ajax (Asynchronous JavaScript and XML, Ajax) Reference information) in the DB, and activates a button allowing the second user to enter the lecture room of the first user (see Fig. 5). When the second user enters the classroom (see FIG. 5) by pressing the enter button in the classroom (see FIG. 5), the second user attempts to connect to the main server 1 via WebSocket using his or her terminal 3 do. When a WebSocket connection between the main server 1 and the second user terminal 3 is established, the main server 1 transmits information necessary for WebRTC between the first user and the second user terminal via WebSocket Public IP, etc.). The second user attempts WebRTC to the first user terminal using the information received through the WebSocket using the terminal 3 of the second user. If the WebRTC between the first user and the second user terminal is successful, the main server displays the classroom information (the class time, the amount of the requested coin, the class language) stored in the DB to the second user terminal. When the second user reads the corresponding information and sends a signal to the main server that the user agrees with the terminal, the first and second user terminals are assigned accounts of the Linux server for the respective classes, respectively.

The third step S30 is a step of assigning Linux accounts to the first user terminal and the second user terminal, respectively.

In the third step, the Linux server 5 is a Linux server that executes a command that an actual user inputs to the terminal. The relay server 4 is a server which connects the user to an unused account of the Linux server and returns the output result to the Linux Shell to the user terminal 2, 3. The Linux server 5 exchanges data with the relay server 4 via SSH. The relay server 4 transmits data received from the Linux server 5 to the user terminals 2 and 3 in real time using the WebSocket and transmits the commands input from the user terminal to the Linux server 5.

After the first user (lecturer) and the second user (lecturer) establish a connection in the lecture room, if the terminal of the second user transmits a signal to start the lecture to the relay server 4, The process of connecting to the Linux server is performed using SSH. The details are as follows. Create several dozens of Linux accounts in advance on the Linux server (5). The relay server 4 grants the first user (lecturer) and the second user (lecturer) accessing the lecture room an account that is not currently being used. During the account granting process, the use of the account is managed through a list of accounts declared as global variables when the connection between the relay server and each user is established or disconnected. For example, when one first user and a second user pair access the classroom, two accounts indicated to be currently available in the account list are selected and given to the first user and the second user, respectively. Allocated accounts are marked for use by other users. If the first or second user leaves the classroom page, the assigned accounts are marked as available for other users. When you leave the classroom page, the files that each user creates for that account will be deleted.

In addition, all operations related to the connection between the Linux server 5 and the user terminals 2 and 3 are performed using the WebSocket managed by the relay server 4 and the Paramiko (API for assisting the SSH connection in the python server). More specifically, when the first user and the second user terminal enter the classroom and start lecturing, a WebSocket connection is established between the relay server 4 and the first and second users. The relay server 4 attempts to connect to the account of the corresponding Linux server through SSH using the account allocated above and the pem key of the relay server 4 (private key for SSH connection) using Paramiko. When the connection is established, it is indicated that the connection to the user's terminal (2, 3) is established.

In the fourth step S40, when the compile and execute button 400 is clicked on the screen of the user's terminal 2 and 3 to give an event, the relay server transmits the code to the Linux server 5, .

In step 4, when each user terminal 2, 3 is connected to the Linux server 5, a message is sent to the Linux server 5 using the WebSocket message and Paramiko of the relay server 4, And transmits the command to the relay server 4. The relay server 4 sends the received command to the Linux server 5 via the Paramiko Socket. The relay server 4 receives the result output from the Linux Shell through the Paramiko Socket and returns or displays the result through the WebSocket to the Linux shell window 200 on the screen of the user's terminal (2, 3).

When the compile and execute button 400 is pressed on the screen of the user terminal 2 or 3, the contents of the source file and the name of the source file are sent to the relay server. The relay server 4 sends a command to the Linux server 5 to store the contents of the source file sent and the name of the source file. In order to reduce the load on the relay server, a plurality of source files are sent from the user terminal (2, 3) at a predetermined time interval per source file. Further, even when the relay server 4 sends the file to the Linux server 5, the relay server 4 divides the code into a predetermined size, and then sends the code at predetermined time intervals. When the source files are all stored in the Linux server 5, the relay server 4 sends the compile command and the execution command according to the language for programming training to the Linux server 5. For example, in the case of C language, send "gcc -o result * .c" command and then send "./result" command to execute the program.

The fifth step S50 is a step of delivering the result output to the shell of the Linux server account allocated to each user to the part of the Linux shell 200 of the terminal 2, 3 of the user and displaying the result.

In the fifth step, the contents of the Paramiko socket buffer (buffer) in which the recvv (command to receive data) of the Paramiko Socket is executed in the relay server 4 (the data sent from the Linux server is stored) is read. The recv (Linux system call function, command to receive data) function can determine the size of the data that can be read at one time in the buffer. Also, when this function is executed, if there is no data in the buffer, you can set the time to wait for data to be received. For example, suppose the recv function has 1200 bytes of data that can be read at a time, and the wait time is 1 second. When recv is executed, if there is data in the buffer, it reads up to 1200 bytes. If there is no data in the buffer, wait for 1 second for data to be received, and if no data is received, an exception will be generated. If the data arrives within one second even if it is a constraint, the data is read and returned.

In addition, problems arise when invoking recv through the while loop on the relay server output from Linux Shell. In the case where the user-created program does not end and the data is continuously output, as shown in FIG. 5, even if the user sends a stop command by pressing the program stop command (500) on the screen, the Paramiko socket repeatedly repeats the recv Therefore, the command is not delivered to the Linux server. To solve this problem, when receiving data from the relay server 4, it receives only once, regardless of the amount of data sent from the Linux server 5. That is, the amount of data is called only once more than the amount of data that can be read at maximum when the recv function is executed. Once the relay server 4 receives the data, it transfers it to the user's terminal (2, 3) via WebSocket. If the data is not null, the user terminal (2, 3) sends a request to the relay server (4) to receive further data. The relay server 4 receives additional data from the Linux server 5. The process of receiving data is repeated until the data received by the relay server becomes null.

Also, if you go to the above process, you can immediately send the existing program execution stop command. Suppose that the user terminal (2, 3) sends an interrupt (Ctrl ^ C) request to the relay server (4) via WebSocket. Once the recv execution currently under way in the relay server 4 is completed, the relay server 4 can transmit the new command to the relay server 4 via the WebSocket again, And receives a stop request sent by pressing the stop button. Thereafter, the relay server 4 transfers the command to the Linux server 5 and terminates the program being executed.

The sixth step S60 is a real-time source file synchronization step using the WebRTC.

In a sixth step, a programming environment shared in real time is provided to the first user and the second user using the WebRTC data channel. As shown in FIG. 5, a virtual file system (source file directory, 1100) capable of adding and deleting a source file to the first and second user terminals 2 and 3 is implemented. In this file system 1100, each time the first or second user adds a new file or deletes an existing source file, the changed directory information is transmitted to the other user (2, 3) through the WebRTC data channel. Thereafter, the other users (2, 3) synchronize their file system (1100) with the other user using the information.

In addition, a code editing window 100 is placed on the screen of each user terminal, and the first and second users synchronize in real time every time code is added / edited. At this time, when the first and second users edit the same source file at the same time, there is a problem that the codes are overwritten with each other. To prevent this, place a variable that stores whether the code can be edited. Check whether the other person is editing the same source file as me through the variable. If the other party is modifying, the user can not modify the code of the code editing window 100 for a certain period of time. This method uses WebRTC, which is a P2P method between two clients, in contrast to the conventional method in which a server is required for intermediating information between clients. Therefore, it is possible to eliminate the load of the server in transmitting the code data that occurs whenever the user edits the code.

The seventh step S70 is a step in which a part of the coins set by the first user and the second user each time the goods (coin) of the second user becomes a predetermined time for the first user is delivered.

In the seventh step, the platform system of the present invention is a system that supports a free market in which a lecturer sets the value of his / her class and conducts lessons, rather than a system in which a company manages a lecturer. Therefore, there is a reliability problem. Therefore, it is appropriate to pay the goods according to the actual class time. And sends a request (ajax) to the main server every several minutes, for example, every five minutes, from the terminal 3 of the participant. The main server 1 compares the class time so far with a unit of several tens of minutes, for example, every 30 minutes, and confirms whether the student has paid the money for 30 minutes. If the money is not paid, the learner's goods are automatically delivered to the lecturer automatically. When the delivery of the goods is completed, the main server 1 informs each user terminal of the settlement using WebSocket. The class time is paid only for the correct time because the lecturer and the learner flow only when they are actually connected.

When the lecturer presses the class end button 600 on the screen of the first user terminal 2 and transmits a class end signal to the main server 1, the main server 1 notifies the lecturer To the second user terminal 3, which is a student, to pay for the remainder after deducting the money paid by the student. When the second user terminal responds to the payment request, money to be paid is delivered to the first user terminal, and the contents of the room (class time, price for the class, etc.) set in the room are initialized.

The eighth step S80 is a step of restoring the connection when the class connection is terminated due to abnormal termination (refresh, backward, browser termination, etc.).

In the eighth step, after the WebRTC is performed in the classroom, if a user terminal leaves the page, the connection is not established even if the same URL is accessed again. The process of becoming a WebRTC itself is established by setting a state in which the first user terminal waits for an offer, and then a connection is established by the second user terminal connecting to the page of the same URL and sending an offer. This process is not performed on the Web, such as a button click event, but is performed when js (javascript) is loaded for the first time. Therefore, if the initiator does not open a new page, the connection does not proceed.

In addition, when a user terminal performs an abnormal termination through backward, page refresh, or browser termination, the main server 1 detects a close event through WebSocket and informs the connected user Quot; < / RTI > The user who receives the command signal exits the classroom. Eventually, both users will be out of the classroom, and the connection will resume through the new classroom. At this time, contents (progressed class time, price of class, value of coin paid by the second user to the first user, contents of the stored file of the stored contents, etc.) progressed in the classroom are transmitted to the main server 1 It is stored in DB. When the connection is broken, the class time does not flow. When the connection is made again on the lecture room page, the lecture contents which were performed until the connection is disconnected are shown to the first and second users, and the lecture is started again. In other words, the contents of the lesson are not erased but are continued.

Meanwhile, the control method of the system for providing multimedia contents according to the embodiment of the present invention may be implemented in the form of a program command which can be executed through a variety of means for processing information electronically and recorded in a storage medium. The storage medium may include program instructions, data files, data structures, and the like, alone or in combination.

Program instructions to be recorded on the storage medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of software. Examples of storage media include magnetic media such as hard disks, floppy disks and magnetic tape, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, magneto-optical media and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as devices for processing information electronically using an interpreter or the like, for example, a high-level language code that can be executed by a computer.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention as defined in the appended claims. It will be understood that the invention may be varied and varied without departing from the scope of the invention.

Claims (15)

A system for providing multimedia contents,
A system for providing multimedia contents,
A main server for delivering information necessary for the WebRTC to the first user terminal and the second user terminal via WebSocket and allocating an account of a Linux server for teaching to the first user terminal and the second user terminal, respectively;
A relay server for transmitting data received from the Linux server using the WebSocket to the first user terminal and / or the second user terminal in real time, and for transmitting commands or codes input from the first user terminal or the second user terminal to the Linux server; And
And a Linux server for executing a command input from the first user terminal and the second user terminal received from the relay server,
The Linux server includes an SSH communication unit for exchanging data between a Linux server and a relay server, and a memory for storing and compiling code among data received through the SSH communication unit,
Wherein when the first user terminal and the second user terminal exit from the classroom page, the stored code is deleted. The system of claim 1, .
The method according to claim 1,
The main server stores at least one of a lecture time, a language to be lectured, and a desired key (electronic money), which is information to be set when the first user terminal enters the lecture room page, And a DB controller for determining whether the event is an end due to an abnormal event, initializing information set in the classroom if the event is a normal end, and storing the current class time in case of an end due to an abnormal event .
3. The method of claim 2,
The main server shares information for WebRTC connection between the first user terminal and the second user terminal, and transmits event information including the end of the lecture or coin payment every 30 minutes to the first user terminal or the second user terminal WebSocket communication unit; And an http communication unit performing the html rendering of the lecture room and the previously stored code loading when the first user terminal or the second user terminal is connected to the lecture room and performing an http response to the request out of the lecture room A multimedia content providing system.
The method according to claim 1,
The relay server includes a Paramiko SSH communication unit for communication with a Linux server,
A WebSocket communication unit for communicating a classroom event with the first and second user terminals,
Further comprising a memory for storing a list storing whether each account of the Linux server is allocated and allocating an empty account to the first and second user terminals and updating the Linux server account list,
Wherein the WebSocket communication unit receives a command request including an account assignment request, compile or execution of a Linux server from the first and second user terminals, and returns the result from the Linux server to the user terminals. Delivery system.
delete The method according to claim 1,
When a screen sharing button is clicked on the screen of the first user terminal, a screen sharing window is created on the screen of the second user terminal, and data shared by the first user terminal with the second user terminal is displayed on the second user screen The multimedia content providing system comprising:
A method of controlling a multimedia content providing system,
A main server transmits information necessary for WebRTC to each of the first user terminal and the second user terminal via WebSocket, and assigns an account of a Linux server for classroom to the first user terminal and the second user terminal respectively ;
The relay server transfers data received from the Linux server using the WebSocket to the first user terminal and / or the second user terminal in real time, and transmits the command or codes inputted from the first user terminal or the second user terminal to the Linux server A relaying step; And
An execution step of executing a command input from a first user terminal and a second user terminal received from a relay server by a Linux server; Lt; / RTI >
The Linux server transmits and receives data to and from the relay server, stores and compiles a code among the data transmitted from the relay server, restricts a memory allocation amount for each of the first user terminal and the second user terminal, And when the second user terminal leaves the classroom page, deletes the stored code.
8. The method of claim 7,
And outputting a shell output result of the Linux server account assigned to the first user terminal and the second user terminal to the first user terminal and the second user terminal and displaying the shell output result. The method comprising:
A method of controlling a multimedia content providing system,
Connecting the user terminals connecting the first user terminal and the second user terminal to each other to bring up the class information including the lecture time or coin information from the database and establish the WebRTC connection between the first user terminal and the second user terminal;
A Linux account assignment step of assigning a Linux account to each of the first user terminal and the second user terminal;
A compiling and executing step of transmitting a command and code for compiling and execution from the first user terminal or the second user terminal to the Linux server via the relay server and compiling and executing the code in the Linux server; And
And synchronizing the source files edited by the first user and the second user in the classroom page using the WebRTC.
10. The method of claim 9,
Further comprising a step of opening a lecture room where a first user terminal and a second user terminal are connected to a main server and a first user terminal establishes a lecture room page only for a second user terminal, / RTI >
10. The method of claim 9,
And a shell output result transfer step of transferring and displaying a result output to the shell of the Linux server account allocated to the first user terminal and the second user terminal to the first user terminal and the second user terminal, The method comprising:
10. The method of claim 9,
Wherein the step of synchronizing the source files includes the steps of synchronizing the source files in real time between user terminals when adding, removing, or renaming the source files; And synchronizing the content of the source file with the user terminal in real time when editing the contents of the source file.
10. The method of claim 9,
Further comprising a settlement step of delivering a part of coins set by the first user and the second user each time a second user's coin reaches a first user for a predetermined time, A method of controlling a providing system.
10. The method of claim 9,
Further comprising a connection restoring step of restoring the connection when an abnormal termination occurs due to any one of refreshing, backing up, and browser termination and ending the class connection.
A computer-readable recording medium storing a program for executing the method of any one of claims 7 to 14.

Images