KR101926637B1 - Method for controlling mission participation type mobile terminal being compatible between heterogeneous devices, method for controlling in mission participation type moble commuication server being compatible between heterogeneous devices, and smart experience learning method for synchronizing mission data between heterogeneous mobile terminals - Google Patents

Abstract

The method includes receiving mission data generated at an external terminal through a server; Generating response data for the mission data; Converting the response data to first multimedia transport protocol metadata for compatibility between heterogeneous devices; And transmitting the first multimedia transport protocol metadata to the server, wherein the first multimedia transport protocol metadata includes header data, subheader data, and body data, Wherein the step of converting the response data into the first multimedia transport protocol metadata comprises the steps of: receiving the response data from the mobile terminal, Comprising the steps of: storing object coordinate data, object position data, object rotation data, and object transition data, which are information indicating relative values of coordinates, in the subheader data; About The.

Description

TECHNICAL FIELD [0001] The present invention relates to a control method of a mission-participating mobile communication terminal compatible with a heterogeneous device, a control method in a mission-participating mobile communication server compatible with a heterogeneous device, and a smart experience learning method of synchronizing mission data between heterogeneous mobile communication terminals TYPE MOBILE TERMINAL BEING COMPATIBLE BETWEEN HETEROGENEOUS DEVICES, METHOD FOR CONTROLLING IN MISSION PARTICIPATION TYPE MOBILE COMMUNICATION SERVER BEING COMPATIBLE BETWEEN HETEROGENEOUS DEVICES, AND SMART EXPERIENCE LEARNING METHOD FOR SYNCHRONIZING MISSION DATA BETWEEN HETEROGENEOUS MOBILE TERMINALS}

The present invention relates to a control method of a mission-participating mobile communication terminal compatible with a heterogeneous device, a control method in a mission-participating mobile communication server compatible with a heterogeneous device, and a smart experience learning method of synchronizing mission data between heterogeneous mobile communication terminals will be.

2. Description of the Related Art Recently, a mobile communication terminal such as a smart phone is configured to have various kinds of sensors and components, and is configured to perform many operations accordingly.

In addition, many entrepreneurs are developing programs for smartphones, making them more versatile for games, sports, movies, and learning.

As the necessity of extra-curricular learning activities in accordance with the full implementation of the 5-day weekly school system of schools is emerging, the need for creative and diverse forms of experiential learning outside the school (for example, service) There is a need to develop a method and system for systematically recording and managing the activities of experiential learning in the flow of experience and volunteer activities reflected in the evaluation of academic achievement and college admissions.

Accordingly, Korean Patent Publication 10-2015-0000262 "Experience Activity Management System and Method"

However, mobile terminals that support experiential learning are driven by a variety of coordinated operation programs, and there is a problem when a screen is shared because the screen reference coordinate system is different therebetween, so that real-time mission synchronization is not performed.

In order to solve the above-described problems, the present invention provides a control method of a mission-participating mobile communication terminal compatible with a heterogeneous device capable of real-time sharing of different kinds of results, a control method in a mission- And a smart experience learning method for synchronizing mission data between different mobile communication terminals.

According to another aspect of the present invention, there is provided a method of controlling a mission-participating mobile communication terminal compatible with a heterogeneous device, the method comprising: receiving mission data generated by an external terminal through a server; Generating response data for the mission data; Converting the response data to first multimedia transport protocol metadata for compatibility between heterogeneous devices; And transmitting the first multimedia transport protocol metadata to the server,
Wherein the first multimedia transport protocol metadata includes header data, subheader data, and body data, and the step of converting the response data to first multimedia transport protocol metadata for compatibility between the heterogeneous devices comprises: Object coordinate data, object position data, object rotation data, object data, which is information indicating a relative value of coordinates on the current screen of the object which is a multimedia object, such that data is interpreted and output with coordinates, And including transition data in the subheader data.

delete

Here, the header data may include terminal ID data, sequence data, object type data, and time data.

delete

delete

delete

delete

delete

delete

delete

According to an embodiment of the present invention having the above-described configuration, objects compatible with images such as images, texts, moving images, and the like between a terminal that sets a coordinate based on a DPI and a terminal that sets coordinates based on a pixel are made compatible, By synchronizing the mission data in real time between the mobile communication terminals, a mission-participating game or participatory learning is performed.

1 is a conceptual diagram showing the overall configuration of a communication system for synchronizing mission data related to the present invention;
2 is a flowchart illustrating a smart experience learning method for synchronizing mission data among heterogeneous mobile communication terminals according to an embodiment of the present invention.
3 is a flowchart illustrating a control method of a mission-participating mobile communication terminal compatible with a heterogeneous device according to another embodiment of the present invention.
FIG. 4 is a flowchart illustrating a control method in a mission-participating mobile communication server compatible with a heterogeneous device according to another embodiment of the present invention. FIG.
5 to 9 are diagrams showing data structures of response data used in an embodiment of the present invention.
10 to 16 illustrate operations in a terminal used in an embodiment of the present invention.
17 is a block diagram illustrating an electronic configuration of a communication system for synchronizing mission data related to an embodiment of the present invention;

Hereinafter, a method of controlling a mission-participating mobile communication terminal compatible with a heterogeneous device according to the present invention, a control method in a mission-participating mobile communication server compatible with a heterogeneous device, and a smart experience learning method of synchronizing mission data between heterogeneous mobile communication terminals Will be described in more detail with reference to the drawings.

1 is a conceptual diagram showing the overall configuration of a communication system for synchronizing mission data related to the present invention. 1, a communication system for processing mission data (for experiential learning progress) related to an embodiment of the present invention includes a mission terminal 10, a first terminal 100 executing a mission, 2 terminal 200, and a communication server 300 that processes mission data and performs data compatibility work.

The mission terminal 10, the first terminal 100, and the second terminal 200 may each be operated with a different operating program. In other words, operating programs such as iOS and Android iOS / PAD, Android pad, Window Mobile and the like are operated. Hereinafter, a heterogeneous device or heterogeneous mobile communication terminal means that the operating program is different or the screen coordinate system (pixel coordinate system or dpi coordinate system) is different do.

The mission terminal 10 is a terminal held by a teacher in operating an experiential learning operation program. Has the same configuration as a general smart phone and transmits mission data to the server 300 and broadcasts mission data to the first terminal 100 and the second terminal 200. [ The server 300 receives data including response data for the mission data from the first terminal 100 and the second terminal 200 in real time and transmits the mission data to the first terminal 100 The second terminal 200 and the second terminal 200 in real time.

The first terminal 100 and the second terminal 200 are heterogeneous terminals as described above and are terminals held by the student in the experiential learning program. (E.g., image storage, text data input, moving image storage, handwriting input, etc.) by receiving the mission data received from the mission terminal 10 or the communication server 300 and transmitting the response data to the multimedia transmission protocol And transmits the converted data to the communication server 300. The operation and configuration thereof will be described in more detail with reference to FIGS. 3 and 4 and FIGS. 10 to 16. FIG.

The server 300 generates team multimedia transmission protocol metadata by layering and merging the multimedia transmission protocol metadata including the response data transmitted from the first terminal 100 and the second terminal 200, , The first terminal 100, the second terminal 200, and the mission terminal 10 are synchronized with each other to perform the experiential learning.

Hereinafter, a smart experience learning method for synchronizing mission data between heterogeneous mobile communication terminals will be described with reference to FIG.

2 is a flowchart illustrating a smart experience learning method for synchronizing mission data among heterogeneous mobile communication terminals according to an embodiment of the present invention. As shown in FIG. 2, the server 300 first transmits mission data to the first terminal 100 and the second terminal 200, respectively (S31 and S32). The mission data includes contents for experiential learning. The server 300 receives the data generated by the mission terminal 10 and transmits the data to the first terminal 100 and the second terminal 200. Mission data indicating a mission to be performed is displayed on the display unit of the first terminal 100 and the second terminal 200, and the students generate and generate response data, respectively (S11, S21). Such response data may include text data, image data, moving image and voice data, or segment data (handwritten data). Each terminal control unit converts response data into first multimedia transmission protocol metadata and second multimedia transmission protocol metadata. Since the screen coordinate system is different between the first terminal 100 and the second terminal 200, the screen coordinate system is used for converting into response data represented by a common coordinate system. An example of these will be described with reference to FIGS. 5 to 9. FIG. These multimedia transmission protocol metadata are transmitted to the communication server 300 (S12, S22). The communication server 300 generates team canvas data by layering and merging the first and second multimedia transport protocol metadata transmitted from the first terminal 100 and the second terminal 200 in step S33, To generate metadata of the team multimedia transmission protocol (S34). The generated multimedia transmission protocol metadata is transmitted to the first and second terminals 200 so that not only the response data of the first terminal 100 and the second terminal 200 but also the response data of the team members are displayed (Synchronized) (S35, S36, S13, S23). The metadata of the team multimedia transmission protocol is also transmitted to the mission terminal 10 so that the first terminal, the second terminal 200 and the mission terminal 10 are all synchronized. In this manner, when a user input signal is generated in any one of the terminals (that is, a change input signal of the object), the object is changed in real time to the other terminal.

Hereinafter, a method of controlling a mission-participating mobile communication terminal compatible with a heterogeneous device, which is an operation in the first terminal 100 and the second terminal 200, will be described in more detail with reference to FIG.

3 is a flowchart illustrating a method of controlling a mission-participating mobile communication terminal compatible with a heterogeneous device according to another embodiment of the present invention. It should be understood that the operations described in FIG. 3 may be performed in the first terminal 100 and the second terminal 200. [

As shown in FIG. 3, the team mission experience app is stored and executed (S41). Here, the team mission experience app may be an app for conducting experiential learning as described above. In this state, the mission data is received from the external terminal (mission terminal 10) or the server 300 and displayed on the display unit (S42). In this state, the students generate response data through the first terminal 100 (S43). The response data may be, for example, an image obtained through a camera module, text input through a user input unit, voice data, or handwriting input data (these may be objects). Then, subheader data of these objects is generated. Relative coordinate information, rotation information, and object scale data information as the subheader data (S44, S45, S46). These subheader data are parameters indicating the screen coordinate system of the object as described above. The subheader data is generated, and the multimedia transport protocol metadata is generated using the generated subheader data and transmitted (S47, S48). Examples of these multimedia transport protocol metadata will be described in more detail with reference to FIGS.

Hereinafter, the operation of the mission-participating mobile communication server 300 compatible with the heterogeneous devices using the multimedia transmission protocol metadata acquired from the first terminal 100 and the second terminal 200 will be described with reference to FIG. 4 do.

FIG. 4 is a flowchart illustrating a control method in a mission-participating mobile communication server 300 compatible with a heterogeneous device according to another embodiment of the present invention. As shown in FIG. 4, the multimedia transmission protocol metadata is received from the first terminal 100 and the second terminal 200, respectively (S51). The multimedia transport protocol metadata is composed of header data, subheader data, and a body, wherein the subheader data is information related to the screen coordinate system. The team canvas data is generated using the subheader data (S52). Team canvas data is generated through layering and merging of the multimedia transport protocol metadata. Then, the first terminal 100, the second terminal 200, and the mobile communication server 300 are synchronized in a push manner for the caching module. That is, it is determined whether caching data exists in the generated team canvas data. If there is the caching data, the multimedia object is collected by communicating with the caching module. If there is no caching data, the caching data is generated in the server 300, (S53, S54, and S55). Then, the multimedia data object (i.e., response data) acquired using the caching data is layered and merged with the team canvas data to generate the team multimedia transmission protocol metadata, and the team multimedia transmission protocol metadata is transmitted and synchronized.

Hereinafter, the data structure of the multimedia transport protocol metadata including the above-described common screen coordinate system to make compatible between heterogeneous devices will be described with reference to Figs. 5 to 9. Fig.

5 to 9 illustrate data structures of multimedia transport protocol metadata used in an embodiment of the present invention. 5 illustrates header data of the multimedia transport protocol metadata. The multimedia transport protocol metadata includes header data, subheader data, and body data. The header data is basically composed of data indicating the ID and characteristics of the multimedia transport protocol metadata. The subheader data includes screen coordinate information and object characteristic information, and the body data includes object data.

As shown in FIG. 5, the header data includes canvas ID information, user ID information (terminal ID information), sequence information, object type information, and time stamp information. Here, the canvas ID information is the ID information of the team canvas data generated by the communication server 300, and when receiving the canvas ID information from the communication server 300, generates the team canvas ID immediately upon generating the multimedia transport protocol metadata. The user ID is information for distinguishing between the first terminal 100 and the second terminal 200. The sequence information is information indicating a pure number drawn on the canvas. The object type information is information indicating whether the object is a line, And the like.

6 to 9 show the structure of subheader data. In the case of FIG. 6, the object is a text. Here, ponit_x and point_y (11) are information indicating relative values of coordinates, and can be referred to as object coordinate data. The remaining information is, for example, font_name or the like, which is information 12 indicating the ID or characteristic of the object.

7 shows a case where the object is an image. Here, the information indicating the relative values of ponit_x and point_y (21) can be referred to as object coordinate data. In other words, ponit_x and point_y (21) are coordinates indicating positions relative to the entire length of one side and the other side of the display, and the subheader data includes new coordinate system information. The width and height (22) correspond to information indicating the size and position of the object. The trans_a to cy (24) and the like correspond to the object rotation data, the object scale data, and the object transient data, which indicate the rotation, scale, and variation of the image. Also, an object ID and image path information 23 are included.

8 shows a case where the object is audio / video data. Here, ponit_x and point_y (31) are information indicating relative values of coordinates and can be referred to as object coordinate data. The width and height (32) correspond to information indicating the size and position of the object. The trans_a to cy (34) and the like correspond to the object rotation data, the object scale data, and the object transition data, which indicate the rotation, scale and variation of the image.

This also includes a thumbnail image path and video paths 33-1 and 33-2.

9 shows a case where an object is a line (for example, handwriting input, etc. Here, ponit_x and point_y (31) are information indicating relative values of coordinates, and pen_color indicates the characteristic of an object representing a color.

Hereinafter, an operation in a mission-participating mobile communication terminal compatible with a heterogeneous device to which the above-described operation and control method is applied will be described with reference to FIG. 10 to FIG.

10 to 16 are diagrams illustrating operations in a terminal used in an embodiment of the present invention. 10 is a mission execution screen 40 of the first terminal 100 receiving mission data from the mission terminal 10. That is, the first terminal 100 receiving the mission data displays it on the display unit. Then, when the user inputs a specific command, the screen is switched to the screen of FIG. 11 is a mission execution screen. The mission transfer screen includes four mission blocks 51 to 54. In this example, the number of mission blocks is four, but the present invention is not limited to this, and two or more mission blocks may be included. Each mission block represents a mission that each team must fulfill. For example, the first block 51 is the first terminal 100, the second block 52 is the second terminal 200, the third block 53 is the third terminal, the fourth block 54 is A mission to be understood by the fourth terminal is displayed.

In this state, the user executes the mission to be performed by himself / herself. For example, an Android phone can be used to photograph and upload an image, or upload a moving image. The missions executed in the plurality of terminals are displayed in real time as shown in FIG. 12 and FIG. 13, and the team cooperative missions can be performed as shown in FIG. 14 through real time synchronization. The screen as shown in FIG. 14 is synchronized with the first terminal and the second terminal (i.e., the student terminal or the executing terminal) as well as the mission terminal, so that it can be confirmed.

15 and 16 illustrate a general case not according to the present invention and a screen state according to the present invention. FIG. 15 shows a case where the information of the first terminal 100 using the dpi unit is synchronized with the second terminal using the pixel unit, and FIG. 16 shows a case where the information is synchronized using the multimedia transmission protocol metadata according to the present invention . In FIG. 15, the interpretation of the response data is different from each other, and the size, the rotation information, and the information distortion of the circle coordinate value are cut off or deformed on the display, and the response data is displayed properly in FIG.

Hereinafter, an electronic configuration of a communication system for synchronizing mission data according to an embodiment of the present invention that operates as described above will be described with reference to FIG.

17 is a block diagram showing an electronic configuration of a communication system for synchronizing mission data according to an embodiment of the present invention. As shown in the figure, a communication system for synchronizing mission data, which is one embodiment of the present invention, comprises a terminal 100 and a communication server 300.

Here, the terminal 100 may be the first terminal 100 or the second terminal 200 described above. The terminal 100 may include a communication unit 110, a user input unit 120, a display unit 130, a memory 140, and a controller 150.

The communication unit 110 is configured to perform data communication with the communication server 300. In the present invention, the communication unit 110 transmits and receives mission data, multimedia transmission protocol metadata, and team multimedia transmission protocol metadata.

The user input unit 120 is for generating response data in the present invention and may include, for example, a key button, a keypad, or a touch screen (in this case, serving as a display unit). The learner can generate response data corresponding to the mission data displayed on the display unit through the user input unit 120. [

The display unit 130 is configured to display the mission data, and is a component for displaying information generated in the user input unit. When the display unit 130 is configured as a touch screen, the function of the user input unit is also provided.

The memory 140 is a component for storing an operation program for operation of the terminal according to the present invention and temporarily or permanently storing various data. The present invention is intended for object compatibility between heterogeneous terminals, that is, terminals whose operating programs are different. Therefore, an operating program such as iOS or Android is stored in the memory of the present invention, and the operation is performed regardless of the type.

The relative coordinate analysis module 153, the rotation information analysis module 155, and the multimedia data processing unit 157. The control unit 150 controls the overall operation of the terminal, and more specifically, .

As described above, the control unit 150 converts the response data for the mission data into the multimedia transport protocol metadata so as to be compatible with other models. Relative coordinate data, rotation information, and the like are generated to precisely coordinate the screen of the object, and the multimedia transmission protocol metadata is generated using these as subheader data, and the multimedia transmission protocol metadata is transmitted through the communication unit 110. In addition, the display unit 130 is synchronized with other terminals (i.e., the second terminal 200 and the communication server 300) by the team multimedia transmission protocol metadata transmitted from the communication server 300, ) Is displayed on the screen in real time.

The communication server 300 may include a server communication unit 310, a database 320, a caching module 330, and a server control unit 340.

The server communication unit 310 is for communicating with the mission terminal 10 and the terminal 100 and receives mission data from the mission terminal 10 and transmits the multimedia transmission protocol metadata And the team multi-media transmission protocol metadata.

The database 320 is a kind of memory for storing various data. In the present invention, not only the member information such as the ID information of the terminal, the team ID information (canvas integration ID), the ID information of the mission terminal 10, but also the database information of the mission data is stored.

The caching module 330 functions to generate a multimedia object in the multimedia transmission protocol metadata using caching data in a push method in order to reduce the overload of the system in the synchronization process between the mobile communication terminals. The metadata of the multimedia transmission protocol is transmitted to the mobile terminal so that the synchronization of the multimedia objects is performed.

The server control unit 340 may include a multimedia object analyzer 341, a synchronization unit 343, a data caching unit 345, and a canvas matching unit 347. That is, the server control unit 340 generates team canvas data by concatenating the multimedia transport protocol metadata transmitted from a plurality of terminals, combines the multimedia object with the team canvas data to generate team multimedia transmission protocol metadata And transmits it to the terminal through the server communication unit 310 to perform synchronization.

At this time, the subheader data of the multimedia transport protocol metadata includes data related to the screen coordinate system, that is, object coordinate data, object position data, object rotation data, object scale data, and object transition data, The coordinate system of the screen becomes the same, and the compatibility of the objects becomes possible.

According to an embodiment of the present invention having the above-described configuration, objects compatible with images such as images, texts, moving images, and the like between a terminal for setting coordinates based on DPI and a terminal for setting coordinates based on a Pixel are made compatible, It is possible to participate in a mission-participating game or participation learning among heterogeneous terminals.

As described above, the control method of the mission-participating mobile communication terminal compatible with the heterogeneous devices, the control method in the mission-participating mobile communication server compatible with the heterogeneous devices, and the smart experience learning method of synchronizing the mission data between the heterogeneous mobile communication terminals, The embodiments and the methods of the embodiments may be applied to the embodiments of the present invention, but the embodiments may be constructed by selectively combining all or some of the embodiments so that various modifications may be made.

10: mission terminal
100: First terminal
200: second terminal
300: communication server

Claims (11)

Receiving mission data generated by an external terminal through a server;
Generating response data for the mission data;
Converting the response data to first multimedia transport protocol metadata for compatibility between heterogeneous devices; And
And transmitting the first multimedia transport protocol metadata to the server,
The first multimedia transmission protocol metadata includes header data, subheader data, and body data,
Wherein the converting the response data to first multimedia transport protocol metadata for compatibility between the heterogeneous devices comprises:
Object coordinate data, object position data, and object rotation data, which are information indicating a relative value of coordinates on the current screen of the object, which is a multimedia object, such that the response data is interpreted and output so as to have coordinates, And including the object transition data in the subheader data.
delete The method according to claim 1,
The header data includes:
A terminal ID data, sequence data, object type data, and time data. delete delete delete delete delete delete delete delete

Images