WO2006108366A1

WO2006108366A1 - Method for synchronising medium flows in a packet-switched mobile radio network, terminal and arrangement for said method

Info

Publication number: WO2006108366A1
Application number: PCT/DE2005/000696
Authority: WO
Inventors: Andreas Kanbach
Original assignee: Nokia Siemens Networks Gmbh & Co. Kg
Priority date: 2005-04-13
Filing date: 2005-04-13
Publication date: 2006-10-19
Also published as: EP1875704A1; DE112005003608A5

Abstract

The invention relates to a method for synchronising medium flows in a packet-switched mobile radio network (1). According to the invention, at least two different types of medium flows are transferred to a terminal (2) in a framework of a streaming-service by a media server (6). In order to simplify the synchronisation of the different types of medium flows, the media server (6) transfers the different types of medium flows to the terminal (2) via one individual connection (1) which is used as a transport protocol as a common media flow and the terminal (2) captures the common media flow and displays said different types of medium flows which are contained therein. Said device also relates to a terminal and to an arrangement.

Description

description

Method for the synchronization of medium streams in a packet-switched mobile radio network, terminal and arrangement for such

Mobile networks of the third generation z. B. according to the UMTS standard (Universal Mobile Telecommunication Standard) are designed not only for the transmission of voice and data, but also allow a mobile subscriber to use multimedia services.

The invention relates to a method for the synchronization of medium streams in a packet-switched mobile radio network, in which at least two media streams of different types are transmitted to a terminal in the context of the provision of a streaming service from a media server. In this case, a flow of medium is understood to mean, for example, a flow of audio or video data, that is to say a flow of data of its own kind.

From the 3GPP TS 26.233 Vβ .0.0 (2004-09) Internet publication of the 3rd Generation Partnership Project (3GPP, http://www.3gpp.org) a method for providing a service called Packet Switched Streaming Service (PSS) is known. This service provides a so-called streaming functionality for a packet-switched mobile network according to 3GPP standardization. Streaming is the ability of an application or a service to continuously play media streams, such as in the form of an audio and a video track, while these streams of media simultaneously from a media server in the form of a content server to a terminal in the form of a streaming client be transmitted. A GGSN (Gateway GPRS Support Node) the access of the streaming client using the packet-switched mobile network to a packet data network to which the Content Server is connected via UDP (User Datagram Protocol) or TCP (Transmission Control Protocol) ports. To retrieve a medium stream, the streaming client uses the RTSP protocol (Real Time Streaming Protocol). If the streaming client calls a medium stream, it is sent by the content server via the packet data network to the GGSN, which transmits it to the streaming client via a serving server GPRS support node serving the streaming client within the packet-switched mobile radio network.

From the Internet publication 3GPP TS 26.245 V6.1.0 (2004-12) the so-called Timed Text Format is still known. In the context of streaming services, the Timed Text Format allows the terminal to interoperate with other media streams such as video or audio by interpreting the textual information received by that format, and to display these streams of different types together.

Furthermore, the invention relates to a terminal for receiving at least two medium streams of different types, which are transmitted in a method for the synchronization of medium streams in a packet-switched mobile network in the context of providing a streaming service from a media server to the terminal.

Such a terminal is also known from the two previously published Internet publications in the context of 3GPP standardization.

The invention further relates to an arrangement for the synchronization of medium streams in a packet-switched mode bilfunknetz with a media server and at least one terminal, wherein in the context of the provision of a streaming service at least two media streams of different types are transmitted from the media server to the terminal.

Such an arrangement is also known from the aforementioned Internet publications 3GPP TS 26.233 V6.0.0 (2004-09) and 3GPP TS 26.245 V6.1.0 (2004-12).

The object of the invention is to further develop a method, a terminal and an arrangement of the specified type such that the transmission of the medium flows of different types is simplified and improved.

This object is achieved with respect to the method of the type described above according to the invention that the media server transmits the medium streams of different types over a single, using a transport protocol connection as a common media stream to the terminal, and the terminal receives a common media stream and the in this contained medium flows of different types for display brings. Thus, according to the invention, the common media stream consists of a flow of data of at least two different types, e.g. B. audio and video data.

The transmission of the medium streams of different types via a single, a transport protocol using compound as a common media stream to the terminal is advantageous, as this already takes place at the transport level synchronization of the medium streams. This has the consequence that for the terminal the task is omitted to bring the medium streams of different types in a temporal proximity or to synchronize them exactly. Instead, the temporal synchronization of the medium flows of different types is final. already given by the device that the terminal only receives a common media stream, which already contains the medium streams of different types in a synchronized form. Instead of having to carry out a complex interpretation of the received media streams of different types as in the known method, only the task from the received common media stream to separate the media streams of different types for the terminal and to bring them separately for display. Synchronization of the media streams of different types by the terminal as in the known method is eliminated. Due to the fact that the medium streams of different types already have a temporal proximity to one another at the transport level and are thus synchronized in time, synchronization errors caused by disturbances or delays in the data transmission are furthermore avoided. It should be noted at this point that the phrase "display" in the context of the present application not only includes a visual representation of data, but also the possible playback of audio data.

The method according to the invention can preferably be designed such that the transport protocol is the real-time transport protocol RTP. The use of RTP is advantageous as it is a protocol designed specifically for transporting payload data in real-time applications. Furthermore, the introduction of the method according to the invention is also facilitated because the method known from the Internet publication 3GPP TS 26.233 V6.0.0 (2004-09) already uses RTP to provide the Packet Switched Streaming Service.

The method according to the invention can preferably also be designed such that the media server supports the medium streams. different type using the RTP payload format for 3GPP Timed Text as a common media stream to the terminal transmits and the terminal brings the medium streams contained in the common media stream of different nature, taking into account the RTP payload format for 3GPP Timed Text for display. This embodiment is advantageous because it is discussed in the internet publication "Internet Draft draft-ietf-avt-rtp-3gpp-timed-text" currently being discussed within the framework of the IETF (Internet Engineering Task Force, http://www.ietf.org) -13.txt "RTP Payload Format for 3GPP Timed Text is already specified as a format that allows a text track to be embedded in an RTP-based media stream Generally speaking, a payload format is a specification that defines how concrete Different payload formats are defined for different payload data formats according to different applications.To define the different applications, so-called RTP profiles are defined, which include the allowed payload formats, ie the data types in RTP Packages may occur.

Preferably, the method according to the invention can also be embodied such that an audio track and a text track are used as medium streams of different types. This embodiment is advantageous in that, in addition to the transmission of audio data, it additionally permits the transmission of text information in a synchronized form. However, the text track may additionally or alternatively be associated with other types of media streams, such as a video track.

The method according to the invention can preferably proceed in such a way that the media server uses the text track to create a visual representation. Position for the hearing impaired transmits to the terminal. This allows for example in a video transmission the display of explanatory text z. For example, in the form of subtitles, which makes it easier for the hearing impaired to understand the displayed video or even makes it possible for the first time.

The inventive method is preferably so pronounced that the media server by means of the text track from the streaming service transmits a simultaneous translation to the terminal. This can advantageously be used for example in the transmission of foreign-language videoconferencing or video films.

In the method according to the invention, the media server can advantageously transmit a message tinker to the terminal by means of the text track. Thus, even with simultaneous display of z. B. video or voice data in addition messages are preferably displayed on the edge of the display of a terminal.

The method according to the invention can preferably also run such that the media server transmits advertising to the terminal by means of the text track. This embodiment is advantageous because it allows companies a new form of advertising. The provider of the streaming service opens up an additional source of income, which may allow him to offer associated with advertising streaming services for a cheaper price for transmission.

The method according to the invention can preferably also be designed so that the media server transmits information dependent on the current location of the terminal to the terminal by means of the text track. This information may be These are event announcements or advertising dependent on the location of the terminal.

Preferably, the inventive method is such that the media server by means of the text track images or Java

Applets to the terminal transmits, the terminal interpreted the images or Java applets based on their format, and the terminal displays the images or Java applets for display. This embodiment is preferred because the text track may also be used to display images or Java applets, such as in combination with an audio track. H. small programs created in the Java programming language can be used. For this purpose, the terminal must recognize the format of the image or the Java applet and, taking into account this format, display the image or Java applet.

The method according to the invention is preferably designed such that a push-to-talk over cellular (PoC) service is used to generate the audio track, and the content of the text track is displayed on at least one of the terminals involved in a PoC session. The PoC service, version 2.0 of which is currently specified by the Open Mobile Alliance (OMA, http://www.openmobilealliance.org), is a one-to-many mobile multicast communication in that only one user of a terminal device (so-called PoC client) participating in the PoC session can speak at any one time. The PoC service is based on a walkie talkie in its course. The unidirectional multicast communication is very advantageous especially for the cost-intensive air interface between the terminal and the base station system of the packet-switched mobile radio network. The use of the PoC service for generating the audio track is advantageous because it also creates the possibility for the PoC service in addition to the known Audio track to provide a text track, by means of which additional information can be transmitted. This results in completely new applications for the PoC service. Thus, text messages can be transmitted from the media server to the terminals involved in the PoC session without having to set up a new user connection. Furthermore, there is also the possibility that the terminals exchange text-based messages with each other by means of the media server.

The inventive method can preferably also run so that the PoC service is extended to a karaoke service, the media server in the form of a PoC server to a voice terminal using the audio track containing the selected melody data and by means of Text track containing the accompanying text transmits further data and the PoC server to participating in the PoC session receiving terminals transfer the vocals of the user of the voice terminal device containing additional data and the melody-containing additional data additively transmits the audio track. Due to the synchronization of the data streams of different types according to the method according to the invention, the known audio track and the newly added text track can also be synchronized for the PoC service. This is the prerequisite for the PoC service to be extended to a karaoke service.

With regard to the terminal, the object is achieved in a terminal of the type specified in the present invention, that the terminal first means for receiving a common, containing the medium streams of different types Mediastroms via a transport protocol connection, second means for determining the medium streams of different kinds from the common Media stream and third means of displaying the media has diumströme different types. This makes it possible for the terminal to receive the common media stream, to separate therefrom the individual medium streams of different types and to display the medium streams of different types. This is advantageous, as thus eliminates a complex synchronization of the medium streams of different types by the terminal.

Preferably, the terminal according to the invention is designed such that the first means for receiving the common

Mediastroms are formed via an RTP transport protocol connection. As already described in connection with the method according to the invention, the use of RTP as a transport protocol for the transmission of the common media stream is advantageous.

The second means of the terminal according to the invention are preferably designed such that the determination of the medium streams of different types from the common media stream using the RTP payload format for 3GPP Timed Text. As previously explained, the use of the RTP payload format for 3GPP Timed Text is preferred since it already provides a detailed description of how text information can be synchronized with other media streams using RTP as the payload transport protocol at the transport layer. It is necessary here for the terminal to also use the RTP payload format for 3GPP Timed Text for the purpose of displaying the medium streams of different types from the received common media stream.

The terminal according to the invention preferably has interpretation means by which received images or Java applets are interpreted prior to their display. Advantageous- In this way, the text track can also be used for the transmission of data that does not only consist of pure text, but must be interpreted before being displayed by the terminal.

With respect to the arrangement, the object is achieved in an arrangement of the type specified according to the invention that the media server has first means for creating a common Mediastroms from the medium streams of different types and second means for transmitting the common Mediastroms to the terminal. This is advantageous because the media server is thus enabled to generate and transmit the common media stream to the terminal.

The arrangement according to the invention can also be designed so that the means for transmitting the common media stream to the terminal have an RTP interface. This embodiment is advantageous because RTP is widely used as a protocol for transporting payload data in streaming services; Both the Packet Switched Streaming Service specified as part of 3GPP standardization and the PoC service specified as part of OMA standardization use RTP as a flexible and extensible transport protocol for the user data. It should be noted that in the context of the present application, no distinction is made between the actual transport protocol RTP and the associated control protocol RTCP (RTP Control Protocol).

Preferably, the arrangement according to the invention is embodied such that the first means are designed such that the common media stream is created using the RTP payload format for 3GPP Timed Text. The advantages of using this known format have already been explained above. In the context of the arrangement according to the invention, the means for creating the common media stream from the medium streams of different types are preferably designed such that they create the common data stream from an audio track and a text track. In addition, there is advantageously the possibility that the media server also merges other medium streams of different types into a common media stream. These may generally be two or more than two medium streams of different types.

Preferably, in the arrangement according to the invention, the media server can be a PoC server. By using a PoC server as a media server and the associated extension of the PoC service to a text track, the prerequisite for a variety of new applications for the PoC service is created.

The arrangement according to the invention is preferably designed such that the PoC server has transmission means, by means of which the selected melody-containing data is transmitted in the context of a karaoke service by means of the audio track and further data containing the accompanying text via the text track are transmitted to the voice-authorized terminal , and the song containing the user of the voice-authorized terminal additional data and the melody-containing data are transmitted by means of the audio track additively to the participating in the PoC session receiving terminals. The use of the arrangement according to the invention for providing a karaoke service on the basis of PoC is advantageous because it provides a new application for PoC. This enables the network operator of the mobile network to tap into new target groups and increase its revenue. To further explain the invention, the figure shows a sketch of an embodiment of the arrangement according to the invention.

Shown is a packet-switched mobile radio network 1 with which terminals 2, 3 and 4 are connected in more detail below. The packet-switched mobile radio network 1 may be, for example, one according to the GPRS (General Packet Radio Service) standard, in which case the connection of the terminals 2, 3 and 4 takes place via an SGSN (Serving GPRS Support Node), which is connected to a GGSN (Gateway GPRS Support Node) providing access to a packet data network 5; the network nodes of the packet-switched mobile radio network 1, d. H. SGSN and GGSN, are not shown figuratively for reasons of clarity. In the packet data network 5, it may be z. This may be, for example, a so-called IMS (IP Multimedia Subsystem) packet data network. To the packet data network 5, a media server 6 is connected in the form of a PoC server. The transmission of data between the media server 6 and the terminals 2, 3 and 4 takes place via the packet data network 5 and the packet-switched mobile radio network 1 by means of the RTP connections 7, 9 and 10, respectively.

The terminal 2, which in the context of the PoC service the

Voice Recognition can now activate a karaoke service. The media server 6 then transmits the data comprising the selected tune by means of the audio track according to the inventive method and further data including the accompanying text via the text track to the voice-authorized terminal 2 via the RTP connection 7 in synchronized form. The singing of a user 11 of the terminal 2 entitled to voice is recorded by the microphone, not shown, of the terminal 2 and transmitted in the form of additional data via the RTP connection 8 from the voice-authorized terminal 2 to the media server 6. The media server 6 transmits the vocal information of the user 11 of the voice-enabled terminal 2 including additional data and the melody-containing additional data additively by means of the audio track via the RTP connections 9 and 10 to the other two at the PoC karaoke session In this case, the further data containing the tune can either be transmitted together with the additional data containing the vocalist of the user 11 of the voice-enabled terminal 2 to the media server 6, or else also be summarized by the media server 6 with the vocals of the user 11 of the voice-enabled terminal 2 containing additional data.

By taking over the language entitlement within the

PoC service, there is the possibility that the voice terminal and thus the interpreter of the karaoke session can change, whereby a full karaoke functionality for the participating in the PoC session terminals 2, 3 and 4 is possible.

Claims

claims

1. A method for the synchronization of media streams in a packet-switched mobile network (1), wherein in the context of the provision of a streaming service from a media server

(6) at least two medium streams of different types to a

Terminal (2) are transmitted, that is, that

- The media server (6) transmits the medium streams of different types via a single, a transport protocol using connection (7) as a common media stream to the terminal (2), and

- The terminal (2) receives a common Mediastrom and brings the contained in this medium streams of different types for display.

2. The method according to claim 1, characterized in that the transport protocol used is the real-time transport protocol RTP.

3. Method according to claim 2, characterized in that

- The media server (6) transmits the media streams of different types using the RTP payload format for 3GPP Timed Text as a common media stream to the terminal (2) and

- the terminal (2) displays the medium streams of different types contained in the shared media stream, taking into account the RTP payload format for 3GPP Timed Text.

4. The method according to any one of the preceding claims, characterized in that As audio streams of different types an audio and a text track are used.

5. The method as claimed in claim 4, wherein the media server transmits a visual representation for the hearing impaired to the terminal by means of the text track.

6. The method as claimed in claim 4, wherein the media server transmits a simultaneous translation to the terminal by means of the text track from the streaming service.

7. The method according to claim 4, wherein a media ticker transmits a message ticker to the terminal device via the text track.

8. The method according to claim 4, characterized in that the media server (6) transmits advertising by means of the text track to the terminal (2).

9. Method according to one of claims 4 or 8, characterized in that the media server (6) transmits information dependent on the current location of the terminal (2) to the terminal (2) by means of the text track.

10. The method of claim 4, wherein a

- The media server (6) using the text track images or Java

Applets to the terminal (2) transmits, the terminal (2) interprets the images or Java applets based on their format, and

- The terminal (2) brings the images or Java applets to display.

11. The method according to any one of claims 4 to 10, d a d e r c h e c e n e c e s in that e

a push-to-talk over cellular (PoC) service is used to generate the audio track, and the content of the text track is displayed on at least one of the terminals (2, 3, 4) involved in a PoC session.

12. The method of claim 11, wherein a PoC service is extended to a karaoke service, wherein

- The media server (6) in the form of a PoC server to a voice terminal (2) by means of the audio track the selected melody-containing data and the text track containing the accompanying text transmits further data and

- The PoC server participating in the PoC session receiving authorized terminals (3, 4) the vocals of the user (11) of the voice terminal (2) containing additional data and the melody-containing additional data transmits additively using the audio track.

13. Terminal for receiving at least two medium streams of different types, which in a method for synchronizing medium streams in a packet-switched mobile network (1) in the context of providing a streaming service from a media server (6) to the terminal (2 ), characterized in that the terminal (2)

first means for receiving a common media stream containing the media streams of different types via a transport protocol connection, second means for determining the media streams of different types from the common media stream and

- Third means for displaying the medium streams of different types.

14. The terminal according to claim 13, wherein the first means for receiving the common media stream are configured via an RTP transport protocol connection.

15. The terminal as claimed in claim 14, wherein the second means are designed such that the determination of the medium flows of different types from the common media stream takes place using the RTP payload format for 3GPP Timed Text.

16. The terminal of claim 13, wherein the terminal has interpretation means by which received images or Java applets are interpreted prior to being displayed.

17. Arrangement for the synchronization of medium streams in a packet-switched mobile radio network (1) with a media server

(6) and at least one terminal (2), wherein as part of the provision of a streaming service, at least two media streams of different types are transmitted from the media server (6) to the terminal (2), characterized in that the media server (6)

- First means for creating a common media stream from the media streams of different types and - second means for transmitting the common media stream to the terminal (2).

18. Arrangement according to claim 17, characterized in that the means for transmitting the common media stream to the terminal have an RTP interface.

19. Arrangement according to claim 18, wherein the first means are designed such that the common media stream is created using the RTP payload format for 3GPP Timed Text.

20. Arrangement according to claim 17, wherein the means for creating the common media stream from the medium streams of different types are designed such that they create the common data stream from an audio track and a text track.

21. Arrangement according to claim 20, wherein the media server (6) is a PoC server.

22. Arrangement according to claim 21, characterized in that the PoC server has transmission means by which - In the context of a karaoke service by means of the audio track containing the selected melody data and the text track containing the accompanying text further data to the voice terminal (2) are transmitted, and

- The vocal of the user (11) of the voice terminal (2) containing additional data and the melody-containing data by means of the audio track additively transmitted to the participating in the PoC session receiving terminals (3, 4) are transmitted.