KR100821835B1 - Method for realtime sorting of streaming data in Multimedia Messaging Server system - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

The present invention relates to a method for arranging real-time image information in a multimedia server system and a computer-readable recording medium recording a program for realizing the method.

2. The technical problem to be solved by the invention

The present invention, when receiving and storing video data from a video client program (hereinafter referred to as a client program) in a multimedia message server (MMS), real-time to arrange the received data in a time sequence without straining the server or network To provide a method of arranging image information and a computer-readable recording medium having recorded thereon a program for realizing the method.

3. Summary of Solution to Invention

According to an aspect of the present invention, there is provided a method of arranging image information in a multimedia server system in real time, the method comprising: setting an initial value of the number of temporary data to be recorded; Comparing the timestamps of the recently received predetermined number of multimedia data with the timestamps of the received multimedia data in response to receiving the multimedia data from the client side; Temporarily recording the received multimedia data in a corresponding alignment position of a temporary memory according to the multimedia data timestamp comparison result; Adjusting the number of temporary recording target multimedia data according to a current system load value or a current network state value; And storing the multimedia data on the temporary memory from the temporary memory to the storage device based on the adjusted number of temporary recording target multimedia data in a corresponding sorting position order.

4. Important uses of the invention

The present invention is used in a multimedia server system.

Real time video information, relay server, multimedia message server, client program, UDP, TCP, TimeStamp

Description

Method for sorting real-time video information in multimedia server system {Method for realtime sorting of streaming data in Multimedia Messaging Server system}             

1 is an exemplary configuration diagram of a multimedia server system to which the present invention is applied.

2 is a diagram illustrating an embodiment of a process of temporarily storing alignment data according to the present invention.

3A to 3C are flowcharts of one embodiment of a method for arranging real-time image information in a multimedia server system according to the present invention.

* Explanation of symbols for the main parts of the drawings

11: multimedia message server (MMS) 12: client program

13: Relay Server

The present invention relates to a computer-readable recording medium that records a real-time video information alignment method in a multimedia server system and a program for realizing the above method. When receiving and storing video data from a program), the real-time video information sorting method of sorting the arriving data in chronological order without burdening the server or network, and the computer recording the program for realizing the method can be read. To a recording medium.

The multimedia message of the present invention can be confirmed through the web using a web searcher as well as implemented through a mobile terminal, and through the support of voice, video, image, and complex formats through integration with the Unified Message System (UMS) Various multimedia services can be provided.

Currently, message transmission through mobile communication terminal is limited to simple text or text, but in the future, it includes voice and video based on high-speed IP network before commercial service of next generation mobile communication (eg IMT-2000). Multimedia data transmission is on the rise. Accordingly, a video communication system using a stream method supporting an encoding / decoding method based on MPEG-4 has been developed.

In other words, the present invention is based on a high-speed Internet Protocol (IP) network, and can receive, store, manage, and process multimedia data incorporating voice, text, still images, and video, thereby confirming a video message to an absent party. In the real-time image information sorting method in the multimedia server system, when the video data is received from the video client program (hereinafter referred to as client program) and stored, the received data is sorted in order of time without burdening the server or network. To save it.

Based on the high-speed network, real-time transmission of integrated multimedia data of voice, text, still image and video, and in case of the absence of the other party, the video message is stored so that the other party can easily check it later. When using an existing method ("method for processing multimedia messages" Application No .: 10-2000-0077092 has already been filed, the method of storing image data in this regard is simply the time stamp) (TimeStamp) is a big problem because of the heavy system load to handle large amounts of data in this way.

The present invention has been proposed to solve the above problems, and when the multimedia message server (MMS) receives and stores the image data from the video client program (hereinafter referred to as a client program), the server or network It is an object of the present invention to provide a method of arranging real-time image information that is arranged in a time sequence without causing stress, and a computer-readable recording medium that records a program for realizing the method.

That is, the present invention, when storing the image data transmitted from the client using the Transmission Control Protocol (TCP) and the User Datagram Protocol (UDP), the order of the nature of the UDP data may be reversed, in which case the reversed data Real-time video information sorting to arrange the video information in real time by adjusting the range of data sorted in the system according to the network situation and the current load of the system while storing them in the storage device of the multimedia message server (MMS). It is an object of the present invention to provide a computer-readable recording medium storing a method and a program for realizing the method.

According to an aspect of the present invention, there is provided a method of arranging image information in a multimedia server system in real time, the method comprising: setting an initial value relating to the number of temporary data subject multimedia data; Comparing the timestamps of the recently received predetermined number of multimedia data with the timestamps of the received multimedia data in response to receiving the multimedia data from the client side; Temporarily recording the received multimedia data in a corresponding alignment position of a temporary memory according to the multimedia data timestamp comparison result; Adjusting the number of temporary recording target multimedia data according to a current system load value or a current network state value; And a storing step of storing the multimedia data on the temporary memory from the temporary memory to the storage device in a corresponding alignment position order based on the adjusted number of temporary recording target multimedia data.

On the other hand, the present invention, in the multimedia server system having a processor, a function for setting an initial value regarding the number of multimedia data to be temporarily recorded; A function of comparing a time stamp of a predetermined number of multimedia data with a time stamp of the received multimedia data in response to receiving multimedia data from a client side; A function of temporarily recording the received multimedia data in a corresponding alignment position of a temporary memory according to a result of comparing the multimedia data time stamp; A function of adjusting the number of temporary data to be recorded temporarily according to a current system load value or a current network state value; And a computer-readable recording medium having recorded thereon a program for realizing a function of storing the multimedia data on the temporary memory from the temporary memory to the storage device in the order of the arrangement position based on the adjusted number of temporary recording target multimedia data. to provide.

The present invention is a system in which a multimedia message server (MMS), a client program, and a relay server are connected to a data network, and an algorithm according to the present invention arrives now when receiving and storing image data from a client program in an MMS. It can minimize the system load due to sorting by adjusting the data range to be sorted to the system according to the current load of the network according to the network situation while saving the video data actually in the order sent from the client. It actually consists of transmission control protocol (TCP) or user datagram protocol (UDP).

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is an exemplary configuration diagram of a multimedia server system to which the present invention is applied, where "11" represents a multimedia message server (MMS), "12" represents a client program, and "13" represents a relay server.

As shown in FIG. 1, in the multimedia server system, the MMS 11, the client program 12, and the relay server 13 are connected to the Internet.

The MMS 11 communicates with the client program 12 and the relay server 13 and receives image data from the client program 12 in real time when necessary, and stores the image data in the storage device.

The client program 12 is installed in the computer and sends the image data captured by the camera mounted on the computer to the server for storage or transfers the image data received from the server to the PC, the PC outputs it on the screen. Among these services, in particular, when the client program 12 transmits the image data to the MMS 11 and the MMS 11 receives this information and stores it in the storage device, the arrival order of the image data is different from the order actually sent by the client. There is a possibility.

This happens due to the characteristics of the protocol called UDP. In this case, if the sorting is possible after storing before storing in the storage device, the image data is less likely to be reversed when the image data stored in the client program 12 is sent again later. As a result, the screen quality of the image data is improved.

Referring to the operation of the multimedia server system of the present invention having the structure as described above in detail as follows.

That is, the structure of the data arriving at the MMS 11 is as shown in FIG. Since this video data is sent by UDP, one video data is automatically read when read from the server at once. Then, four bytes corresponding to a timestamp in this data contain time information when the client program transmits the image data to the MMS 11. However, the problem is that due to the characteristics of UDP, when the arrival order is compared with the timestamp value, the order is sometimes reversed. The MMS 11 needs to rearrange and store the reversed image data before receiving the image data and storing it in the storage device. At this time, depending on the reordering method, the performance of the system and the traffic of the network are greatly affected.

According to the present invention, as a part of the realignment method, the realignment load is adjusted in real time according to the current system performance of the server and the network situation so that the performance of the system and the traffic of the network are not excessive.

2 is a diagram illustrating an embodiment of a process of temporarily storing alignment data according to the present invention.

As illustrated in FIG. 2, a detailed process of a method of adjusting and rearranging a rearrangement load in real time according to a current system performance of a server and a network situation will be described with reference to FIG. 2. 2 is a form in which image data for sorting is temporarily stored in a memory of the MMS 11 before being stored in a storage device. 3A to 3C show in a flow chart how the reordering algorithm inside the MMS 11 is aligned in practice depending on the performance of the current system and the situation of the network.

FIG. 2 schematically shows how image data actually arrived is managed in the memory before being stored in the storage device.                     

D (1) to D (n) are image data that have already arrived and are aligned and stored in the temporary memory, and "Dnew" is newly arrived image data.

When "Dnew" arrives, D (1) is compared with a timestamp, and if D (1) 's timestamp is the most recent, "Dnew" is compared with D (2)' s timestamp. In this way, if "Dnew" is a more recent timestamp, and the comparison target is D (m), store D (n) in the storage device, and "Dnew" is stored in D (m) and D ( Store in temporary memory between m-1). Then, the oldest video message of n + 1 video data from "Dnew" and D (1) to D (n) is stored in the storage device, and the remaining n video data remain in the temporary memory.

3A to 3C are flowcharts illustrating an embodiment of a method of arranging real-time image information in a multimedia server system according to the present invention. The process of the actual alignment takes place in detail. No data has arrived.

As shown in FIGS. 3A to 3C, first, the number n of image data to be temporarily stored is determined before actually receiving and processing the data in step 301 for initialization. This value is set to an integer value proportional to the performance of the system. M is actually the number of image data stored in the temporary memory. M is set to 0 because none of the messages are initially stored.

After the initial setting, it waits for new image data Dnew to arrive. When the first image data arrives, there is no object to compare, so it is immediately stored in the temporary memory and m becomes 1. When the next image data arrives, m of the image data is increased by 1, and the image data having a large timestamp is compared with the timestamp T (1) of the first image data D (1) and the timestamp T (2) of the newly arrived image data Dnew. Timestamp is attached after the temporary memory of small image data. The image data having the most recent timestamp is then D (1), followed by D (2) (302 to 307).

When the third and subsequent video messages arrive, the timestamp T (1) of D (1) having the most recent timestamp among the already arrived video data is compared with the timestamp Tnew of the newly arrived video data Dnew (308 to 309). .

As a result of the comparison, if Tnew is greater than T, the comparison stops and Dnew is placed in temporary memory between D (i) and D (i-1) (where 3new is D (i) in the representation, and D ( From i) to D (m-1), the index increases by one from D (i + 1) to D (m)).

As a result of the comparison, if Tnew is not greater than T, next comparison is performed with Timestamp of the latest image data until comparison with Tnew (310). If m-1 is smaller than the timestamp of the image data having the oldest timestamp stored in the temporary memory, the process proceeds to step 312 in which Dnew is placed in the temporary memory between D (i) and D (i-1). (Where Dnew becomes D (i) in the notation, and the index increases by one notation from D (i) to D (m-1) from D (i + 1) to D (m)).

The reason for the comparison is to check whether the newly arrived image data Dnew is the most recently sent data from the client. In other words, the most recently sent data is the case when the first comparison process immediately goes to the next process 312, otherwise, it indicates that there is at least one newly arrived image data. After the comparison is completed, the process proceeds to the next process 312, and then the newly arrived image data Dnew is stored in the temporary memory between the i-th image data D (i) and the i-th image data D (i-1). It can be seen that D (i) is image data sent before Dnew and D (i-1) is image data sent after Dnew. Then, the load B of the server and the traffic amount C of the network are found from the server, and the number n of video data to be temporarily stored appropriately is calculated from this value (313). In calculating n, inversely proportional to B is good for load balancing because n decreases when the server is under heavy load, which reduces the load due to alignment, and proportional to C increases n when the network traffic increases. The more data that is stored, the greater the accuracy of sorting, which is useful for improving the accuracy of sorting.

Subsequently, after calculating n, if there are more than n pieces of image data in the temporary memory, the oldest image data, that is, D (m) through D (m-k) are stored in a file in order and erased from the temporary memory. Then, n pieces of video data remaining in the temporary memory remain from D (1) to D (n). Therefore, the number m of image data stored in the temporary memory is n. Then wait for a new video message to arrive and perform the same process (314 to 320).

Here, when sorting, the reason for comparing the sorted object to not all the video messages that have arrived, but to n recently arrived is that the client sent them in order, so the arrival order of the video data is less likely to be reversed. Because it will not.

The method of the present invention as described above may be implemented as a program and stored in a computer-readable recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.).

The present invention described above is not limited to the above-described embodiments and the accompanying drawings, and various substitutions, modifications, and changes are possible in the art without departing from the technical spirit of the present invention. It will be clear to those of ordinary knowledge.

As described above, the present invention can adjust the amount of the object to be aligned according to the load of the system, so that it can be properly adjusted according to the situation of the system load due to the alignment, so that the system performance can be maximized without limiting the system. It has an effect.

In addition, the present invention, when it is determined that the order of the video data arriving according to the state of the network is likely to be reversed, there is an effect that the accuracy of the alignment can be appropriately adjusted by giving a large number of objects to be aligned.

Claims (4)

In a method for arranging image information in a multimedia server system in real time, Setting an initial value relating to the number of temporary data to be recorded; Comparing the timestamps of the recently received predetermined number of multimedia data with the timestamps of the received multimedia data in response to receiving the multimedia data from the client side; Temporarily recording the received multimedia data in a corresponding alignment position of a temporary memory according to the multimedia data timestamp comparison result; Adjusting the number of temporary recording target multimedia data according to a current system load value or a current network state value; And A storage step of storing the multimedia data on the temporary memory from the temporary memory to the storage device in a corresponding alignment position order based on the adjusted number of temporary recording target multimedia data; Real-time image information sorting method in a multimedia server system comprising a. The method of claim 1, The adjusting step, The number of temporary recording target multimedia data is adjusted to be smaller than the set initial value as the current system load value is greater than a predetermined value, and the temporary recording target multimedia data as the current network state value is larger than a predetermined value. And adjusting the number greater than the set initial value. The method according to claim 1 or 2, The storing step, The multimedia server may store the multimedia data from the temporary memory to the storage device in the order of the oldest sorting position as the number of multimedia data temporarily recorded on the temporary memory is larger than the adjusted number of temporary recording target multimedia data. How to arrange real-time image information in the system. In a multimedia server system having a processor, A function of setting an initial value relating to the number of temporary data to be recorded; A function of comparing a time stamp of a predetermined number of multimedia data with a time stamp of the received multimedia data in response to receiving multimedia data from a client side; A function of temporarily recording the received multimedia data in a corresponding alignment position of a temporary memory according to a result of comparing the multimedia data time stamp; A function of adjusting the number of temporary data to be recorded temporarily according to a current system load value or a current network state value; And A function of storing the multimedia data on the temporary memory from the temporary memory to the storage device based on the adjusted number of temporary recording target multimedia data in a corresponding alignment position order; A computer-readable recording medium having recorded thereon a program for realizing this.

Images