KR100739306B1 - Processing method of multi-media message - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

The present invention relates to a method for processing a multimedia message and a computer readable recording medium having recorded thereon a program for realizing the method.

2. Technical problem to be solved by the invention

The present invention is based on the high-speed IP network, processing the multimedia message to receive, store, manage, and process the multimedia data integrated with voice, text, still picture and video to check the video message to the absent party It is an object of the present invention to provide a computer-readable recording medium recording a method and a program for realizing the method.

3. Summary of Solution to Invention

The present invention provides a method of processing a multimedia message, comprising: a first method of performing multimedia data communication between a transmitting side and a receiving side under call control of a relay server when a call connection between a transmitting side and a receiving side is possible in real time; step; A second step of storing a multimedia message from the transmitting side under call control of the multimedia message server when the call connection between the transmitting side and the receiving side is impossible in real time; And a third step of providing the stored multimedia message to a called party on a call connection in real time under the control of the relay server.

4. Important uses of the invention

The present invention is used for multimedia communication.

Multimedia message, relay server, stream transmission, missed

Description

Processing method of multi-media message             

1 is a system configuration to which a multimedia message processing method according to the present invention is applied.

2 is a diagram illustrating an embodiment of a first client terminal according to the present invention;

3 is a diagram illustrating an embodiment of a relay server according to the present invention;

4 is a flowchart illustrating an embodiment of an authentication procedure of a first client terminal according to the present invention;

5 is a flowchart illustrating an embodiment of a real-time communication process using multimedia data according to the present invention.

6 is a flowchart illustrating an embodiment of a process of storing a multimedia message according to the present invention.

7 is a flowchart illustrating an example of a process of confirming a multimedia message according to the present invention;

The present invention relates to a method for processing a multimedia message and a computer-readable recording medium recording a program for realizing the method. More particularly, the present invention relates to an integrated voice, text, still image, and moving picture based on a high-speed network. In addition to transmitting multimedia data in real time, a computer readable recording medium storing a multimedia message processing method and a program for realizing the method for storing the video message so that the other party can easily check it later when the other party is absent. It is about.

The multimedia message of the present invention can be confirmed through a web using a web searcher as well as a mobile terminal, and supports voice, video, image, and complex formats through integration with a unified message system (UMS). It can provide various multimedia services.

Currently, message transmission through mobile communication terminal is limited to simple text or text, but in the future, multimedia including video including voice based on high-speed IP network is ahead of commercial service of next generation mobile communication (eg IMT-2000). Data transfer is on the rise. Accordingly, a stream type video communication system supporting an encoding / decoding method based on MPEG-4 has been developed.

When the video communication system is developed as described above, the video conferencing system through the video of the video is generally operated in a multi-party communication method and 1: 1 communication method. At this time, in a multi-party communication method, even if one user does not participate, there is no big problem in real-time video communication according to multimedia data including text and video. There was a problem that the connection could not be made.

The present invention has been proposed to solve the above problems of the prior art, and is based on a high-speed IP network to receive, store, manage, and process multimedia data incorporating voice, text, still images, and video. Accordingly, an object of the present invention is to provide a method of processing a multimedia message, which enables a counterpart to check a video message, and a computer-readable recording medium storing a program for realizing the method.

The present invention for achieving the above object is, in the multimedia message processing method, when the call connection between the sender and the receiver is possible in real time, the multimedia data of the sender and the receiver under the call control of the relay server A first step of performing communication in real time; A second step of storing a multimedia message from the transmitting side under call control of the multimedia message server when the call connection between the transmitting side and the receiving side is impossible in real time; And a third step of providing the stored multimedia message to a called party to which the call is connected in real time under the control of the relay server.

On the other hand, the present invention, in order to process the multimedia message, when the call connection between the transmitting side and the receiving side in the multimedia message processing system having a processor is possible in real time, under the call control of the relay server, the transmitting side and the receiving side A first function of performing multimedia data communication in real time; A second function of storing a multimedia message from the transmitting side under call control of the multimedia message server when the call connection between the transmitting side and the receiving side is impossible in real time; And a computer-readable recording medium having recorded thereon a program for realizing a third function of providing the stored multimedia message to a call-connected receiving side in real time under the control of the relay server.

Here, the above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a system configuration to which a method for processing a multimedia message according to the present invention is applied.

As shown in FIG. 1, the first client terminal 11 transmits video stream data to the second client terminal 12 under the control of the relay server 13 to be described later to the transmitting terminal. The release server 13 performs call control such as connection, transmission and termination of the video stream data from the first client terminal 11 to the second client terminal 12 which will be described later, and the second client terminal 12 If a call connection fails due to the absence of a call), a call control command is transmitted to a multimedia messaging server (hereinafter referred to as "MM server") 14 to be described later.

The MM server 14 receives a call control command from the relay server 13, receives a multimedia message that the first client terminal 12 wants to leave, and receives a multimedia messaging database (hereinafter referred to as “MM DB”). (15).

The second client terminal 12 refers to a receiving terminal, is connected by a relay server 13 receives the video stream data transmitted in real time from the first client terminal 11, by request The received multimedia message is received from the MM DB 15 and confirmed. Here, the multimedia message received by the request is generated by the first client terminal 11 and finally stored in the MM DB 15, and the second client terminal 12 confirms the multimedia message stored in its inbox. When requesting the relay server 13 requests the call to the MM server 14, the MM server 14 retrieves the message from the MM DB (15).

The subscriber DB 16 is connected to the MM server 14 and notifies the MM server 14 and the relay server 13 of user information according to the authentication.

2 is a configuration diagram of an embodiment of a first client terminal according to the present invention.

Referring to FIG. 2, the network interface unit 21 provides a network interface between client terminals, a network interface between a client terminal and a relay server, and an interface with a client terminal and a multimedia message server, for which TCP / IP, UDP, and RTP are provided. It supports protocols such as / RTCP. The video encoder / decoder section 25 encodes the data obtained from the video camera for transmission of MPEG-4 stream video data, and decodes the received stream data for interpretation. The speech encoder / decoder section 27 encodes speech data obtained from the user side for transmission of MPEG-4 stream speech data, and decodes the received stream speech data to be interpreted.

The video input / output unit 26 and the audio input / output unit 28 output the image and audio information, which are received multimedia data, to the outside under the control of the main controller 23, and output the image and image input from the user. The multimedia stream data is provided to the video encoder / decoder section 25 and the audio encoder / decoder section 27, respectively. The multiplexer / demultiplexer 22 receives the encoded stream data from the video encoder / decoder 25 and the audio encoder / decoder 27 and multiplexes the second client terminal on the receiving side through the network interface 21. 12 or MM server 14, and demultiplexes the stream data input through the network interface 21 to the video encoder / decoder section 25 and the audio encoder / decoder section 27.

The call control unit 29 performs user authentication and call reception under the control of the main control unit 23 to be described later. The main controller 23 controls each module as a whole, and controls the non-real time transmission of the multimedia message along with the real time transmission and reception of the video stream data.

3 is a diagram illustrating an embodiment of a relay server according to the present invention.

As shown in FIG. 3, the main control unit 35 controls the transport management unit 31, the network interface 31, the multimedia processing unit 33, and the multimedia storage unit 34, which will be described later, to the first client terminal 11. Call control such as connection, transmission and termination of the video stream data from the second client terminal 12 is performed.

The operation management unit 31 operates and manages the resources used in the MM server 14 and sets and changes the system environment. The network interface 32 provides an interface between the first client terminal 11 side and the MM server 14 side. The multimedia storage unit 34 stores multimedia data, and the multimedia processing unit 33 searches, processes, and relays the stored multimedia information.

4 is a flowchart illustrating an embodiment of an authentication procedure of a first client terminal according to the present invention.

As shown in FIG. 4, the authentication process is a process required when the client terminal is driven and when the user logs in to the web, except that the client terminal is changed to a web browser.

First, when the first client terminal 11, which is the transmitting terminal, accesses the relay server 13 and requests authentication by the information input by the user (41), the relay server 13 receives the MM server 14 Ask the user for authentication (42). The MM server 14 then queries the subscriber DB 16 with user information (43), whereby the user information retrieved from the subscriber DB 16 is provided to the MM server 14 (44).

At this time, the MM server 14 transmits the retrieved user information to the relay server 13 (45), and the relay server 13 notifies the first client terminal 11 whether to authenticate based on the received user information. This completes the authentication process (46).

5 is a flowchart illustrating an embodiment of a real-time communication process using multimedia data according to the present invention.

As shown in Fig. 5, real time communication means communication that is possible when the receiver (second client terminal 12) responds to a call request from the sender (first client terminal 11).

That is, when the first client terminal 11 requests a connection to the relay server 13 by the sender's input information (51), the relay server 13 sends to the subscriber DB 16 via the MM server 14 Request recipient information (52). Accordingly, the receiver information retrieved from the subscriber DB 16 is provided to the relay server 13 through the MM server 14 (53). Accordingly, the relay server 13 checks the receiver information and transmits a call signal to the second client terminal 12 side of the receiver side (54). At this time, if the second client terminal receiving the call signal is in the waiting state in the network in real time, the second client terminal 12 receives the call signal and notifies the first client terminal 11 of the call response signal to the final. In step 55, the call connection is completed to perform multimedia stream data communication.

Meanwhile, the second client terminal 12 performs a call connection and transmits a connection state with the first client terminal 11 to the relay server 13 (56). Then, the relay server 13 records the current connection state and the disconnection state (57, 58). That is, the relay server 13 receives the call connection state notified from the second client terminal 12, monitors the connection state from the first client terminal 11 and the second client terminal 12, and monitors connection statistics. Update (57, 58).

6 is a flowchart illustrating an embodiment of a process of storing a multimedia message according to the present invention.

As shown in FIG. 6, the multimedia message storing process is a process of storing a message in the MM server 14 by a connection replacement service, where the sender is connected to the MM when the call is not connected due to the absence of a receiver. This is the case when leaving a message on the server 14.

First, when the first client terminal 11 requests a call connection to the relay server 13 using the information input by the sender (61), the relay server 13 passes through the MM server 14 to the subscriber DB. (16) is queried based on the sender's input information (62). Then, the subscriber information stored in the subscriber DB 16 is retrieved by the control of the MM server 14, and the retrieved subscriber information is provided to the relay server 13 (63). Then, the relay server 13 transfers the call control authority to the MM server 14 when there is no response to the call connection to the second client terminal 12 (when video communication is impossible in real time).

That is, when the second client terminal 12 does not respond to the call connection (when video communication is impossible in real time), the MM server 14 receives the call control authority from the relay server 13. Accordingly, the MM server 14 attempts to connect to the MM DB 15 through the transferred call control authority (65). Then, the MM DB 15 is connected to the MM server 14 and the pre-stored announcement is provided to the first client terminal 11 under the call control of the MM server 14. Here, the announcement is preferably a voice message for notifying that the receiving party can store the video message with the information indicating that the absence.

Then, the first client terminal 11 checks the announcement provided from the MM DB 15, recognizes that the real-time call with the second client terminal 12 on the other side is impossible, and the multimedia to the MM DB 15 Perform message leaving (67). At this time, the MM DB 15 stores the message that the first client terminal 11 wants to store, that is, the multimedia stream data at the corresponding address, and relays the call connection state with the first client terminal 11. Notify (68). Then, the relay server 13 receives the call connection status notified from the MM DB 15, monitors the connection status from the first client terminal 11 and the MM DB 15, and updates the connection statistics (69). , 70). Thereafter, the relay server 13 performs a process of notifying the second client terminal 12 that the multimedia message is stored by using a known technique.

7 is a flowchart illustrating a process of checking a multimedia message of a second client terminal according to the present invention.

As shown in FIG. 7, the message checking process is a process of checking multimedia stream data stored in the MM DB 15 in the absence of the user, and a description of a known authentication process will be omitted in the flowchart of FIG. 7. .

First, after completing the authentication procedure, the second client terminal 12 requests the relay server 13 to connect to the MM server 14 and generates connection data (71). Accordingly, the relay server 13 connects the call request to the MM server 14 (72). Accordingly, the MM server 14 retrieves the request message from the MM DB 15 (73). Here, as an example of the multimedia message, it is preferable to use multimedia stream data based on MPEG-4 in order to effectively perform real-time transmission and non-real-time message storage.

Accordingly, the MM DB 15 prepares the transmission of the multimedia message retrieved through the process, and the MM server 14 confirms that there is a missed multimedia message (74). Thereafter, the MM server 14 notifies the relay server 13 of the result of the processing based on the confirmed information (75). Accordingly, the relay server 13 permits call connection to the receiving side, i.e., the second client terminal 12 (76). Accordingly, the second client terminal 12 accesses the MM DB 15 and checks the multimedia stream data previously stored by the first client terminal 11 (77).

The relay server 13 monitors the connection status of the second client terminal 12 and the MM DB 15 and updates the access statistics (78,79).
Meanwhile, the receiver of the second client terminal 12 may perform the multimedia message checking process after recognizing that the missed multimedia message is stored.

The method of the present invention as described above may be implemented as a program and stored in a computer-readable recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.).

The present invention described above is not limited to the stated embodiments and the accompanying drawings, and it is common in the art that various substitutions, modifications, and changes can be made without departing from the technical spirit of the present invention. It will be evident to those who have knowledge of.

As described above, the present invention can perform a multimedia message service in real time even when the other party is absent along with a high-speed IP-based video real-time call, thereby increasing the convenience of the user according to the multimedia message. This has the effect of performing a message transfer.

Claims (5)

In the multimedia message processing method, A first step of performing real-time multimedia data communication between a transmitting side and a receiving side under call control of a relay server when a call connection between a transmitting side and a receiving side is possible in real time; A second step of storing a multimedia message from the transmitting side under call control of the multimedia message server when the call connection between the transmitting side and the receiving side is impossible in real time; And A third step of providing the stored multimedia message to a called party to which the call is connected in real time under the control of the relay server; Method of processing a multimedia message comprising a. The method of claim 1, The multimedia message, MPEG-4 based multimedia stream data processing method characterized in that the data. The method of claim 1, The multimedia message server, And a database for storing subscriber information and multimedia messages. The method of claim 1, The multimedia message server, If the receiving side is not connected to the call in real time, and receives the call control authority from the relay server to control the storage of the multimedia message received from the transmitting side. In order to process a multimedia message, a multimedia message processing system having a processor, A first function of performing multimedia data communication between the transmitting side and the receiving side in real time under the call control of the relay server when the call connection between the transmitting side and the receiving side is possible in real time; A second function of storing a multimedia message from the transmitting side under call control of the multimedia message server when the call connection between the transmitting side and the receiving side is impossible in real time; And A third function of providing the stored multimedia message to a called party to which a call is connected in real time under the control of the relay server A computer-readable recording medium having recorded thereon a program for realizing this.

Images