KR20160069663A - System And Method For Producing Education Cotent, And Service Server, Manager Apparatus And Client Apparatus using therefor - Google Patents

Abstract

Disclosed are a system and a method for producing educational content, and a service server, an author terminal and a client terminal used for the system and the method. The system for producing the educational content according to the present invention may include: the service server which stores at least one piece of template information, receives and stores a medium file subordinate to one selected among the pieces of the template information and generates and provides a datum file including the template information and the medium file; and the author terminal which selects one among the pieces of the template information provided by the service server, receives the selected template information to generate the medium file subordinate to the template information and transmits the selected template information and the medium file to the service server. According to the present invention, it is possible to produce and share the educational content by using a web interface.

Description

[0001] The present invention relates to an educational contents production system, a production method, and a service server, author terminal, and client terminal used therein,

The present invention relates to an educational contents production system, a production method, and a service server, an author terminal, and a client terminal used for educational contents, which can be produced and shared on the web.

Recently, with the development of IT technology, e-learning service that implements on-line education along with off-line education has been highlighted. Here, offline education means education conducted through textbooks at schools and institutes, and online education means education conducted using network access technologies such as the Internet and intranets and various multimedia contents.

Currently, educational contents for e-learning are applied not only to audio and video but also various effects using multimedia contents such as text, graphics and images. In addition, an e-learning service is provided in which the user can directly participate in educational contents on the client terminal side.

Conventionally, there has been a problem in that it is difficult to directly produce an e-learning content composed of various objects by using a combination of text, image, image, and sound on a two-dimensional basis and to combine a 3D effect with the e-learning content.

The present invention is directed to solving the above-mentioned problems and other problems. Yet another object of the present invention is to provide an image processing apparatus and a method for selecting at least one of a 2D or 3D background screen and a realistic background screen, selecting at least one of 2D and 3D objects and real world objects, Selects one of the generated at least one template information and one of the at least one media file, and generates a data file by applying the selected media file according to the selected template information, and uploads the data file to the web interface to display And to provide a service server of the educational contents production system and a method of producing the educational contents.

Another object is to create a virtual real space background map by extracting characteristic points of the photographed image and to generate a virtual space map, and to map the photographed image into a background image and an object in the virtual space map, And an object of the present invention is to provide a creator terminal and an educational content production method that enable a user to select a authoring mode through a web interface and upload the created real world background screen and objects to the web interface to produce educational contents.

Another object of the present invention is to provide a method and apparatus for storing at least one template information, receiving and storing a media file dependent on selected template information of the at least one template information, generating and providing a data file including the template information and the media information To select one of the at least one template information, receive the selected template information to generate a media file that is dependent on the template, and upload the selected template information and the media file to the web interface for sharing And an object of the present invention is to provide an educational contents production system and a production method.

According to one aspect of the present invention, at least one of a 2D or 3D background screen and a real-world background screen is selected to select at least one of 2D and 3D objects and real-world objects, A 2D or 3D background image, a 2D or 3D object, a received real image background image or a real image object, at least one received media file, and at least one received media file, A memory for storing at least one template information, one of at least one template information generated by the template generation unit and one of the at least one media file, and applying the selected media file according to the selected template information A training data generator for generating a data file, A communication unit for receiving a live action object and the at least one media file, and a control signal associated with the template creation and data file generation, and a communication unit for receiving the generated data file, the at least one template information, And a display unit for displaying at least one of the 2D or 3D objects on a web screen.

According to another aspect of the present invention, there is provided a web service system including a display unit for accessing a service server and displaying a web interface provided by the service server, a camera for photographing an authoring space and an object, A real image background image / object generation unit for generating a 3D real image background image and an object for realizing a mapping of the photographed image into a background image and an object in the virtual space map, And an input unit for selecting and uploading the live-action background image and the created live-action background image to the web interface.

According to another aspect of the present invention, there is provided an information processing apparatus for storing at least one template information, receiving and storing a media file that is dependent on selected template information of the at least one template information, A service server for generating and providing a data file, and at least one template information provided by the service server, receiving the selected template information to generate a media file dependent on the template, And a author terminal for transmitting the media file to the service server.

According to another aspect of the present invention, there is provided a service server constituting an educational contents production system, wherein at least one of a 2D or 3D background screen and a real world background screen is selected, and at least one of 2D or 3D objects, Selecting at least one of the generated at least one template information and at least one media file, selecting one of the generated at least one template information and the selected template information, And displaying at least one of the generated data file, the at least one template information, the 2D or 3D background screen, and the 2D or 3D object on a web screen by applying the selected media file The method comprising the steps of:

According to another aspect of the present invention, there is provided a authoring terminal constituting an educational content production system, the author terminal comprising: displaying a web interface provided by the service server by accessing a service server; A step of photographing the authoring space and the object, a step of extracting the feature points of the photographed image to generate a virtual space map, a 3D photographing method of separating the photographed image into a background image and an object, Creating background images and objects, and uploading the created 3D real world scenes and objects to the web interface.

According to another aspect of the present invention, there is provided a method for managing a template, the method comprising: selecting one of at least one template information in a service server; receiving a selected template information from an author terminal to generate a media file dependent on the template; And transmitting the media file to the service server, and receiving and storing the media file dependent on the selected template information in the service server, and generating and providing a data file including the template information and the media information The method comprising the steps of:

Effects of the mobile terminal and the control method according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, anyone can easily produce educational contents using a web interface.

In addition, according to at least one embodiment of the present invention, there is an advantage that an avatar suitable for the content or frequency of the media file can be selected, or the expression or gesture of the avatar can be changed dynamically.

Further scope of applicability of the present invention will become apparent from the following detailed description. It should be understood, however, that the detailed description and specific examples, such as the preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will be apparent to those skilled in the art.

1 is a configuration diagram of a service server of an educational contents production system according to an embodiment of the present invention.
2 is a configuration diagram of an author terminal of an educational content production system according to an embodiment of the present invention.
FIG. 3 is a configuration diagram of an educational content production system according to an embodiment of the present invention.
4A to 4C are diagrams for explaining a content production method in a service server of the educational contents production system related to the present invention.
5 is a diagram for explaining a content production method in a author terminal of an educational content production system according to the present invention.
6 to 8 are flowcharts for explaining a method for producing an educational content of a service server in an educational content production system related to the present invention.
FIG. 9 is a flowchart illustrating a method for producing educational contents of a author terminal of an educational content production system according to the present invention.
FIG. 10 is a diagram for explaining a method for producing educational contents in the educational contents production system according to the present invention.
11 is a view for explaining an embodiment in which the expression of the avatar is changed according to the content of a media file related to the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Hereinafter, specific embodiments will be described with reference to the drawings.

1 is a configuration diagram of a service server of an educational contents production system according to an embodiment of the present invention.

The service server 100 of the educational content production system may include a template generation unit 110, a memory 120, a training data generation unit 130, a communication unit 140, and a display unit 150. The service server 100 of the educational content production system may further include an editor 160. [

The template generating unit 110 may generate template information by selecting one of the stored 2D or 3D background screen or object, or the background screen of one of the newly uploaded 2D or 3D background screen or object. The template is a basic unit of educational contents, and the educational environment is represented by graphical elements. A 2D or 3D background or object represents an authored graphical interface (e.g., virtual space, avatar, etc.), or a captured real image.

The template generating unit 110 may store the execution order information in association with at least one template information, and may generate the training data file by executing each template according to the execution order information stored corresponding to each template.

The training data generation unit 130 may generate a data file by combining the media file with the template information. That is, the education information can be added to the template information, which is a basic unit representing the educational environment, to generate the completed educational contents.

Specifically, the training data generation unit 130 selects specific template information among at least one template information generated by the template generation unit 110 and a specific media file among at least one media file, You can apply a file to create a data file.

The training data generation unit 130 may display at least one list of media files on the screen and generate an education data file by applying the access path of the media file selected by the user to the selected template information.

When the selected media file is a voice file, the training data generation unit 130 may classify the female or male by analyzing the frequency of the voice file, and may select the avatar object or the real image object to correspond to the male or female. In addition, the training data generator 130 may generate a data file to generate a facial expression or a gesture of the selected avatar object or a real image object in a set form when the contents set in the voice file are included.

The training data generation unit 130 receives the TTS (Text To Speech) type media file to be applied to the selected template through the communication unit 140, applies the TTS type media file as a voice file of the selected object, Can be generated.

The communication unit 140 may receive at least one media file and a control signal associated with the creation of the template and the creation of the data file from the author terminal.

The template generating unit 110 and the training data generating unit 130 may generate a template and generate a data file according to the control signal received through the communication unit 140. [

The memory 120 may store a 2D or 3D background image, a 2D or 3D object, a received live background image or a real image object, at least one received media file, and at least one generated template information.

The display unit 150 may display at least one of the generated data file, at least one template information, the stored 2D or 3D background screen, and the 2D or 3D object on the web screen.

The display unit 150 may display at least one completed template information and data file on the web screen. Also, template information can be generated by selecting a 2D or 3D background screen or an object through entry of the authoring mode displayed on the display unit 150. [

The editing unit 160 can edit some data in the generated data file, for example, delete the data, change the data file, and store the encrypted data file in the memory.

2 is a configuration diagram of an author terminal of an educational content production system according to an embodiment of the present invention.

The creator terminal 200 of the educational contents production system may include a display unit 210, a camera 220, an input unit 230, and a real image background / object generation unit 240.

The display unit 210 may access a service server and display a web interface provided by the service server. The display unit may be formed of a display such as a touch panel, a touch screen, an LCD, a PDD, and the like. In general, the display unit may include a touch panel or a touch screen capable of performing input and output functions together.

The camera 220 can capture the authoring space and the object, and can detect the movement change of the object. Only one camera may be installed in one area of the author terminal, and a plurality of cameras may be installed.

The input unit 230 may select a authoring mode through a web interface, and receive an input for uploading the created real background image and the object to the web interface. In general, a touch pattern or a touch screen can simultaneously perform a display portion and an input portion function.

The input unit 230 may further upload the voice file to the web interface.

The live-action background / object generation unit 240 can extract a feature point of the photographed image and generate a virtual space map. In addition, the real image background / object generation unit 240 may generate a 3D real image background image and an object, which map the image captured in the virtual space map to the background image and the object, respectively.

FIG. 3 is a configuration diagram of an educational content production system according to an embodiment of the present invention.

The educational contents production system 1000 may include a service server 100, an author terminal 200 and client terminals 300A and 300B.

As described above, the service server 100 stores at least one template information, receives and stores a media file that is dependent on the selected template information among at least one template information, and stores the data file including the template information and the media information Can be generated and provided.

The author terminal 200 selects one of at least one template information provided by the service server 100, receives the selected template information to generate a media file dependent on the template, and transmits the selected template information and the media file to the service server 100. [ (100).

The client terminals 300A and 300B can receive the data file from the service server 100 through the wired / wireless communication network and execute the template according to at least one template information included in the data file. In addition, the client terminals 300A and 300B constitute and display a screen showing the function of the executed template, and can reproduce and output the media file based on the information of the media file included in the data file.

The educational content production system can generate template information from the author terminal, upload it to the web interface of the service server, generate the data file using the uploaded template information, upload it to the web interface, and create and share educational contents. Also, the client terminal can download and reproduce the educational contents uploaded to the service server. The client terminal may include a mobile terminal, a notebook, an IPTV, and the author terminal may provide all functions of the client terminal.

4A to 4C are diagrams for explaining a content production method in a service server of the educational contents production system related to the present invention.

Referring to FIG. 4A, when accessing the service server of the education contents production system using the author terminal, the user can enter the authoring mode.

In the authoring mode, the service server may display the web interface on the display unit 150. The web interface can display a menu screen capable of creating a data file by uploading any one of a background screen, an object, and a media file.

Specifically, in the authoring mode, the service server displays menu items such as 'Select Avatar', 'Select Background', and 'Select Lecture', and can select a corresponding menu item according to a user's input.

Referring to FIG. 4B, when 'Select Avatar' is selected from the menu items of the web interface, the stored avatar graphics can be sequentially displayed.

The user can display another avatar shape by pressing the arrow key to switch the avatar graphic to the previous or later avatar. When the desired avatar shape is displayed, the user can select the object by pressing the Select key.

Referring to FIG. 4C, when the avatar selection is completed, the user can select the 'Select Background' or 'Select Lecture' menu item by pressing the Back key to switch to the previous screen.

When 'Select Background' displayed on the web interface is selected and a background screen is selected, a specific template can be created and stored using the previously selected object and the background screen.

If you select 'Select Lecture' displayed on the web interface after completing the template selection or creation, you can go to the menu where you can select the media file and apply the selected media file to the selected template information.

In this way, the author terminal user can create the educational contents through the web interface of the service server.

5 is a diagram for explaining a content production method in a author terminal of an educational content production system according to the present invention.

The creator terminal 200 of the educational contents production system can generate template information through the web interface when it forms a link with the service server and enters the authoring mode.

The author terminal 200 can generate the template information by selecting the background screen or objects ob1 and ob2 photographed through the camera installed in the terminal as the real background image and the real image object.

6 to 8 are flowcharts for explaining a method for producing an educational content of a service server in an educational content production system related to the present invention.

Referring to FIG. 6, the method for producing educational contents of a service server generates at least one template information (S610), creates a data file (S620), and displays the data file on a web screen (S630).

Specifically, the service server selects at least one of a 2D or 3D background screen and a real-world background screen, selects at least one of 2D or 3D objects and real-world objects, combines the selected background screen and the object, Information can be generated.

Referring to FIG. 7, the service server selects a background screen first (S611), selects an object (S612), and combines the selected background image and the object to generate template information (S613)

Next, the service server may select one of the generated at least one template information and at least one media file, and generate the data file by applying the selected media file according to the selected template information.

Referring to FIG. 8, the service server selects specific template information among a plurality of template information (S621), selects a specific media file among a plurality of media files (S622), applies the selected specific media file to specific template information A data file can be generated (S623).

Specifically, a data file can be generated by selecting a specific template to which avatars are combined on the background image of the 3D winter forest image, and selecting the audio file of the art lecture as a specific media file and combining them. At this time, the data file means the completed educational contents.

FIG. 9 is a flowchart illustrating a method for producing educational contents of a author terminal of an educational content production system according to the present invention.

9, when the author terminal accesses the service server, it receives the web interface from the service server and displays it (S910), selects the authoring mode through the web interface (S920), and captures the authoring space and the object S930).

The author terminal has at least one camera and a touch screen, and can display an image photographed through the camera on a touch screen using a graphical interface.

Next, a minutiae point of an image photographed by the author terminal is extracted to generate a virtual space map (S940), and a 3D real image background screen and an object to be imaged are separately mapped into a background image and an object in a virtual space map (S950), and uploads the generated 3D live background image and the object to the web interface (S960).

Specifically, the author terminal can reconstruct a photographed image by extracting a specific point from the image displayed on the touch screen and generating a virtual space map. Further, the author terminal can generate the background image or the object by editing the reconstructed image, and combine them to generate the template information.

FIG. 10 is a diagram for explaining a method for producing educational contents in the educational contents production system according to the present invention.

10, a service server and an author terminal form a communication link (S1010), and an author terminal can receive an input for selecting specific template information among a plurality of template information displayed on a display unit of a service server (S1020).

The author terminal receiving the specific template information generates a media file such as a voice file (S1030), and transmits the media file to the service server depending on the template information (S1040).

The service server stores the media file dependent on the template (S1050), and may generate the data file by combining the template information and the media file (S1060).

11 is a view for explaining an embodiment in which the expression of the avatar is changed according to the content of a media file related to the present invention.

Referring to FIG. 11, the service server may analyze the media file to generate a data file such that the expression of the object changes in the word of the specific content or the gesture is changed. In addition, the data file can be generated to change the gender of the object according to the frequency characteristics of the media file.

For example, the service server may change the look of the object so that the avatar takes a winking gesture if the media file contains a specific word.

When the educational content is completed and uploaded to the service server, the client terminal establishes a communication link with the service server (S1070), requests the uploaded data file and receives the uploaded data file in real time (S1080, S1090).

Therefore, both the author and the user can easily create or download the educational contents through the web interface.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Also, the computer may include a control unit 180 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: service server 110:
120: memory 130: training data generation unit
140: communication unit 150:
160: Editor
200 author terminal 210:
220: camera 230:
240: Actual background screen / object creation unit

Claims (17)

A template for generating at least one template information by selecting at least one of a 2D or 3D background screen and a real world background screen and selecting at least one of 2D and 3D objects and real world objects and combining the selected background screen and an object, Generating unit;
A memory for storing the 2D or 3D background screen, the 2D or 3D object, the received real backdrop or real image object, the received at least one media file, and the generated at least one template information;
A training data generator for generating a data file by selecting one of the at least one template information and at least one media file generated by the template generator and applying the selected media file according to the selected template information;
A communication unit for receiving a live-action background image or a live-action object from the author terminal, the at least one media file, and a control signal related to the template generation and data file generation; And
A display unit for displaying at least one of the generated data file, the at least one template information, the stored 2D or 3D background screen, and the 2D or 3D object on a web screen;
The service server of the educational contents production system.
The method according to claim 1,
And editing the generated data file by editing or encrypting the edited data file.
The method according to claim 1,
The training data generation unit may include:
Displays the at least one media file list on the screen, and applies the access path of the media file selected by the user to the selected template information to generate an education data file.
The method according to claim 1,
Wherein the template generating unit comprises:
Wherein the training data file is generated by storing the execution order information in association with the at least one template information and executing each template according to the execution order information stored corresponding to each template, .
The method according to claim 1,
The training data generation unit may include:
The method comprising the steps of: if the selected media file is a voice file, analyzing a frequency of the voice file to distinguish a female or male, selecting an avatar object or a real image object to correspond to the male or female, And generates the data file to generate a facial expression or a gesture of the selected avatar object or a real image object in a set form.
The method according to claim 1,
The training data generation unit may include:
Receiving a TTS (Text To Speech) type media file to be applied to the selected template through the communication unit, and applying the TTS type media file as a voice file of the selected object to generate the data file Service server of education contents production system.
A display unit connected to the service server and displaying a web interface provided by the service server;
A camera for photographing a work space and an object;
A 3D real image background screen for extracting the feature points of the photographed image to generate a virtual space map, and mapping the photographed image into a background image and an object in the virtual space map, and a real image background / An object generation unit; And
An input unit for selecting a authoring mode through the web interface and uploading the created real world background screen and objects to the web interface;
The author terminal of the educational contents production system.
8. The method of claim 7,
Wherein the input unit further uploads an audio file to the web interface.
A service server that stores at least one template information, receives and stores a media file that is dependent on the selected template information of the at least one template information, and generates and provides a data file including the template information and the media information; And
Selecting one of at least one template information provided by the service server, receiving the selected template information to generate a media file dependent on the template, and transmitting the selected template information and the media file to the service server Author terminal;
The content creation system comprising:
10. The method of claim 9,
Receiving a data file from the service server via a wired / wireless communication network, executing a template according to at least one template information included in the data file, displaying and displaying a screen showing a function of the executed template, And a client terminal for reproducing the media file based on the information of the media file included in the media file and outputting the media file.
10. The method of claim 9,
The service server,
A template for generating at least one template information by selecting at least one of a 2D or 3D background screen and a real world background screen and selecting at least one of 2D and 3D objects and real world objects and combining the selected background screen and an object, Generating unit;
A memory for storing the 2D or 3D background screen, the 2D or 3D object, the received real backdrop or real image object, the received at least one media file, and the generated at least one template information;
A training data generator for generating a data file by selecting one of the at least one template information and at least one media file generated by the template generator and applying the selected media file according to the selected template information;
A communication unit for receiving a live-action background image or a live-action object from the author terminal, the at least one media file, and a control signal related to the template generation and data file generation;
A display unit for displaying at least one of the generated data file, the at least one template information, the stored 2D or 3D background screen, and the 2D or 3D object on a web screen; And
An editor for editing or encrypting the generated data file;
Wherein the learning content generating system comprises:
12. The method of claim 11,
The training data generation unit may include:
The method comprising the steps of: if the selected media file is a voice file, analyzing a frequency of the voice file to distinguish a female or male, selecting an avatar object or a real image object to correspond to the male or female, And generates the data file to generate a facial expression or a gesture of the selected avatar object or a real image object in a predetermined format.
6. The method of claim 5,
The training data generation unit may include:
Receiving a TTS (Text To Speech) type media file to be applied to the selected template through the communication unit, and applying the TTS type media file as a voice file of the selected object to generate the data file Educational contents production system.
10. The method of claim 9,
The author terminal,
A display unit connected to the service server and displaying a web interface provided by the service server;
A camera for photographing a work space and an object;
A real image background screen for generating a virtual space map by extracting the feature points of the photographed image, a real image background screen for mapping the photographed image into a background image and an object in the virtual space map, Generating unit; And
An input unit for selecting a authoring mode through the web interface and uploading the created real world background screen and objects to the web interface;
Wherein the content creation system comprises:
A service server constituting an educational contents production system,
Selecting at least one of a 2D or 3D background screen and a realistic background screen and selecting at least one of 2D and 3D objects and real world objects and combining at least one template information with the selected background screen ;
Selecting one of the generated at least one template information and at least one media file and applying the selected media file according to the selected template information to generate a data file; And
Displaying at least one of the generated data file, the at least one template information, the 2D or 3D background screen, and the 2D or 3D object on a web screen;
The method comprising the steps of:
A author terminal of an educational contents production system,
Accessing a service server and displaying a web interface provided by the service server;
Selecting a authoring mode through the web interface, and photographing a authoring space and an object;
Extracting feature points of the photographed image to generate a virtual space map;
Creating a 3D real world background screen and an object for mapping the photographed image into a background image and an object in the virtual space map; And
Uploading the generated 3D real world background screen and object to the web interface;
Wherein the authoring terminal comprises:
Selecting one of the at least one template information from the service server;
Receiving the selected template information from an author terminal to generate a media file dependent on the template, and transmitting the selected template information and the media file to the service server; And
Receiving and storing a media file dependent on the selected template information in the service server, generating and providing a data file including the template information and the media information;
The method comprising the steps of:

Images