KR20090106114A - System and method for providing multimedia streaming service - Google Patents

Abstract

PURPOSE: A multimedia streaming service providing system and a method thereof are provided to offer a high-quality multimedia streaming service by making a server control a TS(Timp Stamp) value of an RTP packet. CONSTITUTION: A multimedia streaming service providing system comprises a streaming server(300) and an RES(Real-time Encoding Server)(400). The streaming server requests/receives an RTP packet from the RES in case a streaming service requested from a mobile communication terminal(100) is a live streaming service, and then changes a TS value. The streaming server transmits the RTP packet having the changed TS value to the mobile communication terminal.

Description

System and method for providing multimedia streaming service

The present invention relates to a system and method for providing a multimedia streaming service, and more particularly, to streaming various multimedia contents to a mobile communication terminal of a user, when providing a live streaming service, a TS (Time Stamp) value of a RTP packet is provided by a streaming server. The present invention relates to a system and method for providing a multimedia streaming service that provides a high quality multimedia streaming service without the influence of a mobile communication terminal.

Today's mobile phones are accelerating high functionality and complexity in addition to the basic features of voice calls.

Recently, a multimedia streaming service of a mobile communication terminal that receives a multimedia streaming service through a mobile phone is in progress.

A multimedia streaming service is a service that encodes multimedia contents such as audio and video provided by a content provider into a format suitable for transmission through a network with an encoder, and transmits them to a user in real time through a streaming server. Say.

Streaming is a technology that can reproduce audio and moving images in real time rather than download, and transmits to a user by reducing the transmission time of a vast amount of multimedia data by data compression and encoding technology.

The multimedia streaming service is a transport protocol for real time streaming, and is a real time streaming protocol (RTSP: Real-time Streaming Protocol, hereinafter referred to as 'RTSP'), and a real time transport protocol (RTP: Real-time Transport Protocol, hereinafter referred to as 'RTP'). And Real-time Transport Control Protocol (RTCP).

That is, a session is created by setting an RTP channel and an RTCP channel between the transmitting side and the receiving side using the RTSP, and the RTP packet and the RTCP packet are transmitted through the configured RTP channel and the RTCP channel.

On the other hand, when providing a real-time video, such as a live streaming service in the prior art, the streaming server receives the RTP packet encoded in real time from the Real-time Encoding Server (RES) and transmits it to the mobile communication terminal, from the streaming server By controlling the TS (Time Stamp) of the received RTP packet directly from the terminal, it was possible to perform live streaming normally.

In this case, the TS is a time that is displayed at a specific position of the RTP packet to prove that data existed at a certain time, and is a time displacement parameter that indicates a starting point of time with respect to a time commonly referred to by the transceiver. .

However, when a terminal that does not have a function of controlling the TS receives a live streaming service from a streaming server, the TS value of the RTP packet received from the RES in the streaming server continues to increase so that the mobile communication terminal may attempt to access the server. At this time, the TS of the RTP packet has a value of 0 or more.

In this case, there is a problem in that the screen played in the media player of the mobile communication terminal is interrupted or an error appears.

The present invention is to solve all the disadvantages and problems of the prior art as described above, the technical problem to be achieved by the present invention, when providing a live streaming service by controlling the TS (Timp Stamp) value of the RTP packet in the server of the terminal It is to provide high quality multimedia streaming service without any effect.

Another technical problem to be achieved by the present invention is to provide a high quality multimedia streaming service by transmitting a RTP packet by controlling a TS in a server when providing a live streaming service to a terminal having no TS control function.

The objects of the present invention are not limited to the above-mentioned objects, and other objects which are not mentioned will be clearly understood by those skilled in the art from the following description.

In the multimedia streaming service providing system according to the present invention for achieving the above object, when the streaming service requested from the mobile communication terminal is a live streaming service, by requesting and receiving an RTP packet to the RES to convert the TS value, the TS A streaming server for transmitting the converted RTP packet to the mobile communication terminal and a Real-time Encoding Server (RES) for transmitting the RTP packet encoding the multimedia content in real time when the RTP packet is requested from the streaming server. Provided is a multimedia streaming service providing system comprising a.

When the streaming service requested from the mobile communication terminal is a file streaming service, the streaming server receives the data packet from the multimedia database and transmits the data packet to the mobile communication terminal.

According to another aspect of the invention, in the streaming server providing the streaming service according to the streaming service request of the mobile communication terminal, a multimedia database storing the content for providing a file streaming service, streaming requested from the mobile communication terminal Streaming service type determination unit for distinguishing whether the service is a live streaming service or a file streaming service, an RTP packet converter for converting a TS value of the RTP packet received from the RES, and a regenerated RTP provided from the RTP packet converter Provided is a streaming server for providing a multimedia streaming service including a streaming service providing unit for transmitting either a packet or a data packet from the multimedia database to the mobile communication terminal.

The RTP packet converter converts the TS value of the first RTP packet received from the RES into 0.

The RTP packet converter converts the TS of the RTP packet transmitted after the first RTP packet into a difference value between the TS value of the first received RTP packet and the later TS value of the RTP packet.

According to another aspect of the present invention, in the method for providing a multimedia streaming service, (a) when the streaming server requests a RTP packet to the RES when the streaming service requested from the mobile communication terminal is a live streaming service, (b) Transmitting, by the RES, a RTP packet encoding the multimedia content in real time according to a request of a streaming server, to the streaming server, (c) the streaming server converting a TS value of the RTP packet received from the RES; (d) the streaming server provides a multimedia streaming service providing method comprising the step of transmitting the RTP packet converted the TS value to the mobile communication terminal.

When the streaming service requested from the mobile communication terminal is a file streaming service in step (a), transmitting, by the streaming server, a response to the multimedia basic information request signal from the mobile communication terminal to the mobile communication terminal; Transmitting, by the streaming server, a response to the setup request signal from the mobile communication terminal to the mobile communication terminal; transmitting, by the streaming server, a corresponding data packet according to a reproduction request for receiving real data of multimedia; Further provided is a method for providing a multimedia streaming service.

Receiving a data packet transmission end request signal from the mobile communication terminal after transmitting a corresponding data packet according to a reproduction request for receiving real data of the multimedia and a response signal for the data packet transmission end request signal. Provided is a method for providing a multimedia streaming service further comprising transmitting a message.

After transmitting the response signal to the data packet transmission end request signal, the TCP connection between the mobile communication terminal and the streaming server is terminated.

In step (c), the TS value of the first RTP packet received from the RES is converted to 0. The TS of the RTP packet transmitted after the first RTP packet is received and the RTP of the RTP packet received thereafter. Converting the TS value of the packet into a difference value.

According to another aspect of the invention, the streaming server provides a multimedia streaming service providing the streaming service over the network in response to a streaming service request of the mobile terminal, (a) the streaming service requested from the mobile terminal Determining whether the service is a live streaming service or a file streaming service, (b) if the live streaming service request is a result of the determination of step (a), requesting and receiving an RTP packet from the RES, and (c) receiving the received RTP packet A method of providing a multimedia streaming service is provided, the method comprising: converting a TS value of the mobile communication terminal; and (d) transmitting the RTP packet converted from the TS value to the mobile communication terminal.

If the streaming service requested from the mobile communication terminal is a file streaming service as a result of the determination in step (a), transmitting a response to the multimedia basic information request signal from the mobile communication terminal to the mobile communication terminal; Transmitting a response to a setup request signal from a communication terminal to the mobile communication terminal; transmitting a corresponding data packet to the mobile communication terminal according to a reproduction request of the mobile communication terminal for receiving real data of the multimedia; Further provided is a method for providing a multimedia streaming service.

Receiving a data packet transmission end request signal from the mobile communication terminal after transmitting the corresponding data packet to the mobile communication terminal according to a reproduction request of the mobile communication terminal to receive the real data of the multimedia; The method may further include transmitting a response signal to the packet transmission end request signal.

After transmitting the response signal to the data packet transmission end request signal, the TCP connection between the mobile communication terminal and the streaming server is terminated.

In step (c), the TS value of the first RTP packet received from the RES is converted to 0. The TS of the RTP packet transmitted after the first RTP packet is received and the RTP of the RTP packet received thereafter. Converting the TS value of the packet into a difference value.

The present invention can provide a high quality multimedia streaming service without affecting the terminal by controlling the TS (Timp Stamp) value of the RTP packet at the time of providing a live streaming service.

In addition, when providing a live streaming service to a terminal that does not have a TS control function, it is possible to provide a high-quality multimedia streaming service by transmitting a RTP packet by controlling the TS in the server.

Details of the above object and technical configuration of the present invention and the resulting effects thereof will be more clearly understood from the following detailed description based on the accompanying drawings.

First, Figure 1 is a block diagram of a multimedia streaming service providing system according to an embodiment of the present invention.

As shown in FIG. 1, the multimedia streaming service providing system according to the present invention includes a streaming server 300 which provides a streaming service to a mobile communication terminal 100 through a wired / wireless network with various multimedia contents, such as a real time video. It includes a real-time encoding server (RES) 400 for real-time encoding (encoding) multimedia to the streaming server 300.

In this case, the streaming server 300 may provide any one of a live streaming service and a file streaming service.

Here, the live streaming service receives an RTP packet encoded in real time from the RES 400 and transmits the received RTP packet to the mobile communication terminal 100, and the file streaming service provides data of multimedia content previously stored in the streaming server 300. The packet may be transmitted to the mobile communication terminal 100.

In addition, the streaming server 300 includes a RTP packet conversion unit for converting the TS value of the RTP packet received from the RES 400, the concrete configuration of the streaming server 300 will be described in more detail with reference to FIG. As follows.

2 is a block diagram of the streaming server of FIG. 1.

As shown in FIG. 2, the streaming server 300 includes a controller (not shown) for controlling all operations such as data management and transmission, and a multimedia database 320 having contents for providing the file streaming service. And a streaming service type determination unit 330 for identifying whether the streaming service requested from the mobile communication terminal 100 is a live streaming service or a file streaming service, and the TS of the RTP packet transmitted from the RES 400. The RTP packet converter 340 for converting a (Time Stamp) value, the regenerated RTP packet provided from the RTP packet converter 340, or a data packet from the multimedia database 320; It is configured to include a streaming service provider 350 for transmitting to the mobile communication terminal (100).

At this time, the TS (Time Stamp) is a time to mark at a specific position of the RTP packet to prove that the data existed at a certain time, the time indicating the starting point of time with respect to the time commonly referred to by the transceiver device Displacement parameter.

In this case, the streaming service provider 350 of the streaming server 300 receives a corresponding data packet from the multimedia database 320 when the streaming service requested from the mobile communication terminal 100 is a file streaming service. The data packet may be transmitted to the mobile communication terminal 100 through.

In addition, the streaming service provider 350 of the streaming server 300, if the streaming service requested from the mobile communication terminal 100 is a live streaming service, the RTP re-generated from the RTP packet converter 340 The RTP packet may be transmitted to the mobile communication terminal 100 through a network by receiving a packet.

On the other hand, the RTP packet converter 340 preferably converts the TS value of the first RTP packet received from the RES (400) to zero.

In addition, the RTP packet converter 340 preferably converts the TS of the RTP packet transmitted after the first RTP packet into a difference value between the TS value of the first received RTP packet and the later TS value of the RTP packet. Do.

In detail, the RTP packet converter 340 may calculate and convert the TS value as shown in Equation 1 below.

TSn = TS (n)-TS (base)

Here, TS (base) refers to the TS value of the first RTP packet received from the RES 400, and TS (n) refers to the TS value of the nth RTP packet received from the RES 400.

The reason for changing the TS of the RTP packet to start from zero is that, even when a live streaming service is provided to a terminal that does not have a function of controlling the TS, the server controls the TS so that the streaming service is normally operated. To make it happen.

Embodiments illustrating a service method in the multimedia streaming service system of the above-described mobile communication terminal will be described sequentially with reference to the flowcharts of FIGS. 3 to 5.

First, a method of providing a multimedia streaming service to a mobile communication terminal according to an embodiment of the present invention will be described with reference to the flowcharts of FIGS. 3 and 4.

3 is a flowchart illustrating a method of providing a multimedia streaming service to a mobile communication terminal according to an embodiment of the present invention, and FIG. 4 is a diagram illustrating a data flow in the multimedia streaming service according to an embodiment of the present invention.

As shown in FIG. 3, first, the subscriber requests a streaming service from the streaming server 300 through the mobile communication terminal 100 (S110).

The streaming service request may be made, for example, by turning on a media player mounted in the mobile communication terminal 100 or driving a multimedia streaming client.

Next, the streaming server 300 determines whether the streaming service requested from the mobile communication terminal 100 is a live streaming service (S120).

Then, in step S120, if the live streaming service request, the streaming server 300 receives the RTP packet from the RES (400) (S130).

Next, the streaming server 300 converts the TS value so that the TS of the RTP packet received from the RES 400 starts from zero (S140).

Subsequently, the streaming server 300 transmits the RTP packet whose TS value is changed to the mobile communication terminal 100 (S150).

In addition, in step S120, if the file streaming request is not a live streaming service, the streaming server 300 transmits a data packet according to the file streaming service to the mobile communication terminal 100.

In detail, the streaming server 300 may receive the corresponding data packet from the multimedia database 320 and transmit the data packet to the mobile communication terminal 100 through a network.

The reason for changing the TS of the RTP packet to start from zero is that the server controls the TS so that the streaming service is normally controlled even when a live streaming service is provided to a terminal not equipped with a function of controlling the TS. To make it happen.

For example, when the mobile communication terminal 100 having no function of controlling the TS receives a live streaming service from the streaming server 300, the streaming server 300 receives an RTP packet encoded in real time from the RES 400. The mobile station 100 receives the received message and transmits it to the mobile communication terminal 100. The TS value of the RTP packet received from the RES 400 continues to increase, so that the mobile communication terminal 100 attempts to access the streaming server 300. At this time, the TS of the RTP packet has a value of 0 or more.

In such a case, since the screen played by the media player of the mobile communication terminal 100 may be interrupted or an error may appear, in the present invention, the TS value is controlled by the streaming server 300.

On the other hand, as shown in Figure 4, looking at the data packet transmission method between the streaming server 300 and the media player of the mobile communication terminal 100, first, the media player of the mobile communication terminal 100 is the streaming server 300 The basic information of the multimedia to be provided is requested (DISCRIBE Request) (S11).

Next, after the response of the streaming server 300 (DESCRIBE Response) (S12), the media player transmits a setup request to the streaming server 300 to receive multimedia such as video, audio, and text (SETUP Request). (S13).

Next, after the response of the streaming server 300 (SETUP Response) (S14), the media player transmits a playback request for receiving the real data of the multimedia to the streaming server 300 (PLAY Request) (S15). ).

Subsequently, after the play request response of the streaming server 300 (PLAY Response) (S16), the media player of the mobile communication terminal 100 may perform a request such as pause, play, fast forward, and rewind. (S17).

On the other hand, when the streaming service is to be terminated during the streaming service as described above, the media player of the mobile communication terminal 100 requests the end of the data packet transmission (TEARDOWN Request) (S18).

Next, after the response of the streaming server 300 (TEARDOWN Response) (S19), the TCP connection between the media player of the mobile communication terminal 100 and the streaming server 300 is terminated (TCP Close) (S20).

Next, the above-described TS conversion process in the multimedia streaming service method of the mobile communication terminal according to an embodiment of the present invention will be described in more detail with reference to the flowchart of FIG. 5.

5 is a flowchart illustrating a TS conversion process in a multimedia streaming service providing method according to an embodiment of the present invention.

As shown in FIG. 5, first, the streaming server 300 receives an RTP packet from the RES 400 (S130).

Next, the streaming server 300 converts the TS of the first RTP packet received from the RES 400 to zero (S141).

Subsequently, the TS of the RTP packet transmitted after the first RTP packet is converted into a difference between the TS value of the first received RTP packet and the TS value of the subsequent RTP packet (S142).

In this case, the TS value may be calculated as in Equation 1 above.

Here, TS (base) refers to the TS value of the first RTP packet received from the RES 400, and TS (n) refers to the TS value of the nth RTP packet received from the RES 400.

Next, the streaming server 300 transmits the changed RTP packet to the mobile communication terminal 100 (S150).

The process of transmitting the RTP packet to the mobile communication terminal 100 may be performed according to the data flow of FIG. 4 described above.

FIG. 6 illustrates an example of TS conversion of an RTP packet. The streaming server 300 regenerates an RTP packet by converting a TS value of 0 into a TS value of '26643266' of an RTP packet received from the RES 400. The figure shows the example.

Accordingly, according to an embodiment of the present invention, when providing a live streaming service, the server may control the TS value of the RTP packet to provide a high quality multimedia streaming service without influence of the terminal.

In addition, when providing a live streaming service to a terminal that does not have a TS control function, it is possible to provide a high quality multimedia streaming service by transmitting a RTP packet by controlling the TS in the server.

As those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features, the embodiments described above should be understood as illustrative and not restrictive in all aspects. Should be. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

The present invention described above may be applied to a multimedia streaming service that provides various multimedia contents by streaming them to a mobile communication terminal of a user.

1 is a block diagram of a multimedia streaming service providing system according to an embodiment of the present invention.

2 is a block diagram of the streaming server of FIG. 1.

3 is a flowchart illustrating a method of providing a multimedia streaming service according to an embodiment of the present invention.

4 is a diagram illustrating a data flow in a multimedia streaming service according to an embodiment of the present invention.

5 is a flowchart illustrating a TS conversion process in a multimedia streaming service providing method according to an embodiment of the present invention.

6 is an exemplary diagram of TS conversion of an RTP packet.

<Description of Symbols for Main Parts of Drawings>

100: mobile communication terminal 300: streaming server

320: multimedia database 330: streaming service type determination unit

340: RTP packet converter 350: streaming service provider

400: RES

Claims (15)

In the multimedia streaming service providing system, If the streaming service requested from the mobile communication terminal is a live streaming service, a streaming server for requesting and receiving an RTP packet to the RES to convert the TS value, and transmits the RTP packet converted from the TS value to the mobile communication terminal; And And a Real-time Encoding Server (RES) for transmitting an RTP packet encoding the multimedia content in real time when the RTP packet is requested from the streaming server. In claim 1, The streaming server, When the streaming service requested from the mobile communication terminal is a file streaming service, the multimedia streaming service providing system receives a corresponding data packet from the multimedia database and transmits it to the mobile communication terminal. In the streaming server providing the streaming service according to the streaming service request of the mobile communication terminal, A multimedia database storing multimedia contents for providing a file streaming service; A streaming service type determination unit for discriminating whether a streaming service requested from the mobile communication terminal is a live streaming service or a file streaming service; An RTP packet conversion unit for converting the TS value of the RTP packet received from the RES and delivering the converted RTP packet to the streaming service provider; and And a streaming service provider which transmits any one of an RTP packet transmitted from the RTP packet converter and a data packet from the multimedia database to the mobile communication terminal. In claim 3, The RTP packet converter, Streaming server for providing a multimedia streaming service, characterized in that for converting the TS value of the first RTP packet received from the RES to 0. In claim 3, The RTP packet converter, And converting the TS of the RTP packet transmitted after the first RTP packet into a difference value between the TS value of the first received RTP packet and the TS value of the RTP packet received thereafter. In the multimedia streaming service providing method, (a) the streaming server requesting an RTP packet to the RES if the streaming service requested from the mobile communication terminal is a live streaming service; (b) transmitting, by the RES, an RTP packet encoding the multimedia content in real time according to a request of the streaming server, to the streaming server; (c) the streaming server converting a TS value of the RTP packet received from the RES; And (d) the streaming server transmitting the RTP packet converted from the TS value to the mobile communication terminal. In claim 6, If the streaming service requested from the mobile communication terminal is a file streaming service in step (a), the streaming server transmitting a response to the multimedia basic information request signal from the mobile communication terminal to the mobile communication terminal; The streaming server transmitting a response to the setup request signal from the mobile communication terminal to the mobile communication terminal; And And transmitting, by the streaming server, a corresponding data packet according to a reproduction request for receiving real data of the multimedia. In claim 7, After transmitting the corresponding data packet according to the reproduction request for receiving the real data of the multimedia, Receiving a data packet transmission end request signal from the mobile communication terminal; And And transmitting a response signal to the data packet transmission end request signal. In claim 8, After transmitting a response signal to the data packet transmission end request signal, Method of providing a multimedia streaming service characterized in that the TCP connection is terminated between the mobile communication terminal and the streaming server. In claim 6, Step (c) is, Converting the TS value of the first RTP packet received from the RES to 0; And And converting a TS of the RTP packet transmitted after the first RTP packet into a difference value between a TS value of the first received RTP packet and a TS value of the subsequent RTP packet. A streaming server provides a multimedia streaming service providing a corresponding streaming service through a network in response to a streaming service request of a mobile communication terminal. (a) determining whether the streaming service requested from the mobile communication terminal is a live streaming service or a file streaming service; (b) requesting and receiving an RTP packet from the RES when receiving the live streaming service request as a result of the determination of step (a); (c) converting a TS value of the received RTP packet; and (d) transmitting the RTP packet converted from the TS value to the mobile communication terminal. In claim 11, Transmitting a response to the multimedia basic information request signal from the mobile communication terminal to the mobile communication terminal when the streaming service requested from the mobile communication terminal is a file streaming service as a result of the determination in step (a); Transmitting a response to the setup request signal from the mobile communication terminal to the mobile communication terminal; And And transmitting a corresponding data packet to a mobile communication terminal according to a reproduction request of the mobile communication terminal for receiving real data of the multimedia. In claim 12, After the step of transmitting the corresponding data packet to the mobile communication terminal according to the reproduction request of the mobile communication terminal for receiving the real data of the multimedia, Receiving a data packet transmission end request signal from the mobile communication terminal; And And transmitting a response signal to the data packet transmission end request signal. In claim 13, After transmitting a response signal to the data packet transmission end request signal, Method of providing a multimedia streaming service characterized in that the TCP connection is terminated between the mobile communication terminal and the streaming server. In claim 11, Step (c) is, Converting the TS value of the first RTP packet received from the RES to 0; And And converting a TS of the RTP packet transmitted after the first RTP packet into a difference value between a TS value of the first received RTP packet and a TS value of the subsequent RTP packet.

Images