DE102006036562A1 - Two data streams receiving method, involves temporally outputting utilization portion of one data stream under utilization of identification characteristic of data stream matched on output of segment in another data stream - Google Patents

Abstract

The method involves receiving a data stream (E) and another data stream (P) with a utilization portion (W, Y) and an identification characteristic (Q, U). The data stream (E) is delayed, and the identification characteristic in the data stream (P) is detected. A segment in the data stream (E) is detected in dependence of the identification characteristic. The utilization portion of the data stream (P) is output temporally under utilization of the identification characteristic matched on an output of the segment in the data stream (E). Independent claims are also included for the following: (1) a method for transmitting two data streams (2) a transmitting arrangement comprising an analysis device (3) a receiving arrangement for synchronization of two utilization signals (4) a system of a transmitting arrangement and a receiving arrangement (5) a method for synchronization of multiple data streams (6) a system for implementing a method for synchronization of multiple data streams (7) a user terminal for a system for implementing a method for synchronization of data streams.

Description

The The invention relates to a method for receiving a first data stream and a second data stream. The invention also relates to a Method for transmitting and a method for transmitting a first and second data stream from a sender to a receiver. The invention further relates to a transmitting arrangement, a receiving arrangement and a system of a transmitting and a receiving arrangement.

The This invention relates generally to a method and system for transmission related data streams and a method for synchronizing data streams related to one another, and during execution of the method or in the construction of usable system components. Concerning the synchronization of related data streams is especially considering that it is in a communications environment, possibly over different transmission paths or transmitted in different ways Data streams, which are to be synchronized. This is not mandatory. It can also about other data streams acting in any technical environment or possibly even for the sake of synchronization with each other Information or data are generated.

in the Below, the invention is based on in a communication environment occurring data streams explains since this is indeed a particularly important application of the invention proposals.

modern Communication links, for example for the transmission of voice and audio signals, use often Protocols in networks, which the respective transmitting or receiving station via different Connect network nodes together. Such a connection is also referred to as a circuit switched or "circuit switched" connection. A data or signal transmission over the network nodes, depending on the protocol and network used different data transmission types can be provided. In a circuit-switched connection is used for all signals and signal components in general, the transmission path previously determined and kept free. This leads to that with such Communication link a substantially constant delay time between transmitter and receiver occurs. The duration of the delay Among other things, the switching times of the different Components of the various nodes determines, over which the communication connection will be produced.

The transmission formats are often like that designed such that useful signals without time information contained therein over the Medium are transported. A typical example is one ordinary, e.g. analog, telephone connection between a transmitter and a Receiver, at the language or Audio signals are received by a microphone on the transmitter side and transmitted via the Communication link are sent to the recipient. As soon as on the receiver side available they are over a speaker without additional delay output. For digital communication links, the Audio signals frequently in sections of certain length divided, coded and then sent to the receiver. Also digital coded audio signals usually contain no additional time information. in the In general, it can be assumed that audio signals in an end-to-end communication link using circuit switched technology additional Have time information.

Besides is there a possibility, User data of various types or media, such as language and transfer image between sender and receiver in a synchronized manner. A such synchronized transmission a combination of two or more media signals or data streams also as English "Session". One typical example of this is the so-called videoconference, in addition to a pure audio signal or audio data stream also transmitted image or video signals become. For synchronization between audio and video signals it different ways. In a circuit-switched approach, audio and video signals are used into a circuit switched data stream, typically referred to as "multiplexing", so that and the same transmission path for both Currents or Signals is used and thus the synchronization by appropriate Arrangement in the data stream is practically given by all signals be played immediately after their decoding In another, e.g. packet-switched approach different media or each package of each medium basically transmitted over different transmission paths become. In this case for correct play as well as synchronization are with the transmission additional Information in the form of timestamps, e.g. in every media package, intended.

However, there may be a need to add additional second payload to an existing communication link, wherein the existing communication connection is continued. This is the case, for example, if in addition to video or audio signal transmission video signals are to be transmitted. The question of a joint output arises, inter alia, when the first mentioned connection the "circuit swit ched "technique is used.

A easy way consists of the second media signal, in this case the Video signal, over an additional Communication link to transfer. In such a case, it is quite possible that the second communication link other areas of the communication network used. If receiver side both media signals or payload data is output, is the built Session is not synchronized and it generally comes to one Time offset between the different media signals or data streams.

A possibility to prevent mismatched output it would be that to end the first communication connection and a completely new "session" including the additional Rebuild second media signal. A synchronization can then by the simultaneous transmission the two media signals or data streams over the same connection respectively. Alternatively, for the connection also another media signal, for example a Videoconferencing, be provided. However, this solution will the already existing communication connection terminates, a process which is usually not desired by a user. In addition, must even with a change one of the two data streams the existing connection will be terminated. A flexible addition an additional one Media signal or data stream with, for example, different bit rate or content to an already existing communication connection is not possible in this embodiment.

task The invention according to a first main aspect is a method provide, which in a transmission of first and second data streams a concerted temporal output of the two or possibly also more data streams guaranteed. Another object of the invention according to the first aspect is to provide a transmitting or receiving arrangement which is a synchronous data transfer multiple data streams in a simple way allows.

These Tasks are with the independent ones claims 1, 19, 23, 37, 48, 59 solved. embodiments and further aspects of the invention are the subject of the dependent claims. Solution approaches and solutions for this Task also emerge from the claims 63 to 105.

To the principle of the invention is provided in the second data stream additional identification features provided derived from the first data stream and so on a coordinated output of the first and second data stream allow. This allows an already existing communication connection with a transmission continue the first data stream.

Under The term data stream means any kind of signal that for transmission of information is suitable. The data stream can therefore be a useful signal include, but also represent the useful signal itself. Likewise it may be an analog or a digital signal or such include.

To the proposed principle becomes the first communication link for a transmission the first data stream, a second communication link for the transmission of the second data stream. In the second data stream are Identification features that contain an assignment of sections of the second data stream to corresponding sections of the first Enable data stream. Likewise be included in the second data stream identification features an assignment of sections of one in the second data stream contained useful signal to corresponding sections of the first Data stream or corresponding sections of a useful signal in the first data stream. On the receiver side, such a succession matched output of the first data stream and the second data stream respectively.

Conveniently, are the identifiers in the second data stream of the derived first data stream or payload data in the first data stream. It is even possible that the identification features essential parts of the first data stream or the payload of the first data stream.

For example, the first data stream may contain audio signals or audio data in at least two of temporally successive subsections. The term audio signal or audio data is understood to mean any form of audible signals, ie speech, sounds, or even music. An identification feature is extracted from each of the subsections, which enables identification of the respective subsection of the first data stream. This identification feature is assigned to a subsection of a second data stream, so that later coordinated or even synchronous output of the respective subsections is possible. A synchronous output is understood to mean a balanced playing, in order to have the best possible synchronicity under other conditions. It is expedient if the features used for the identification of the subsections are particularly robust against artifacts or disturbances during the data transmission of the first data stream. Stö Changes or signal variations can arise, for example, due to the coding and compression of signals due to irrelevance reduction and quantization or due to distortions or noise during transmission or any other effects. In this way, a synchronous output of the first and second data stream can take place on the receiver side even after one or more of these disturbances during the data transmission.

In According to one aspect of the invention, the method comprises the steps of Receiving and delaying the first data stream, the multiple, usually a variety of successive sections. Likewise will receive a second data stream. This will now at least one first identification feature determines which of at least a first subsection of the successive subsections derived from the first data stream. In addition, the process includes the step of analyzing the first delayed data stream or the individual sections in the first data stream. It will be a first Part of the first data stream as a function of at least one first identification feature is determined and then this first subsection is output together with the second data stream.

to delay of the first data stream, it is sufficient if this is cached. Also can for processing of the first data stream measures be provided, which is an output of the sections of the first Delay data stream, allowing enough time for the further process steps remain. A time offset between corresponding sections of the first and second data streams can be corrected.

alternative can also delay the second data stream and if necessary cached for this purpose become. In that regard could then the second data stream as above concerning the first one Stream considered and the first data stream as above concerning the second data stream are considered. It could too both data streams are delayed and be cached.

For one another coordinated output of the first and second data stream, it is therefore appropriate, in addition to the extraction of the first identification feature in the second Data stream a corresponding identification feature in the first data stream to investigate. These are the subsections of the first data stream analyzed and derived from each subsection of an identification feature. This should be of the same type as the first identifier so, after making a comparison, make a decision about it can be whether the first identification feature contained in the second data stream matches the derived identification features of the first data stream or at least sufficiently similar is.

at of the present invention such an extra second data stream to an already existing communication connection with a data transfer Add, without interrupting the already existing communication connection must become. It is only necessary to have at least one of the data streams, in particular to cache the first stream before output to the first Steps of identifying identification features and then synchronizing to enable.

As has already become clear, it is mainly thought that the first data stream and the second data stream each have a plurality or multitude of consecutive subsections, possibly data frames, , wherein several or all subsections of the second Data stream on a respective associated subsection of the first data stream, contained in the second data stream Identification is assigned and for several of these identifiers the assigned subsection of the first data stream is determined and over the respective identification feature mutually associated sections the first and the second data stream output timed become. In this context, it may be appropriate if for the assignment a subsection of the first data stream to a subsection of the second data stream several, to different sections the identification of the first data stream become.

In An embodiment of the invention is for the generation of the first Data stream provided a first useful signal, the several consecutive Includes subsections. The first useful signal can be any kind of signal be containing audio data. From the individual sections of the useful signal identification features are derived, which the Identify each subsection with a high probability. By doing so leaves based on the identification feature with high probability determine an assignment to the respective subsection. The derived ones Identification features can for one Generation of a second data stream can be used by Subsections in the second data stream are assigned to one another Coordinated edition with the corresponding sections of the first data stream are provided.

Conveniently, the derived identification features are particularly robust against Artifacts in signal processing, compression or interference during the Data transfer. For example, you can the identifiers from LTP (Long Term Prediction) coefficients a subsection are formed. Alternatively, it can be the identifier by analyzing frequency information a content of the respective subsection of the first data stream or the first useful signal. It is also possible diverse Sequence information, such as HASH sequences or checksums to determine from subsections. The latter is appropriate if the first useful signal coded according to a coding method information contains. But it is also possible that the identification features encoded portions of the first data stream or the first useful signal included.

In In another embodiment of the invention, the method comprises additionally the steps of providing a first and second wanted signal, each one of a plurality of temporally successive Have sections. Corresponding sections in each case are assigned to each other for a later one coordinated edition. From sections of the first useful signal identification features are determined and the corresponding Associated with subsections of the second useful signal. Then be first and second useful signals processed further and as the first and second Transfer data stream. After a reception, the two data streams are buffered. The become in the second data stream existing identification features extracted. At the same time, the subsections become the first data stream obtained the first useful signal and identification features determined. These are with the existing in the second data stream Identification features compared. In a match, the corresponding Subsections issued, leaving a coordinated output guaranteed is.

there is it additional possible, Discard unused sections after a certain period of time or spend. This can be useful, especially if while the data transmission of the first or second data stream parts have been lost or due to errors during the data transmission can not be reconstructed.

• – Analoge Audiosignale bzw. Audiodaten;
• – GSM kodierte Audiosignale;
• – G.711 kodierte Audiosignale;
• – PCM kodierte Audiosignale;
• – AMR oder AMR-WB kodierte Audiosignale;
• – nach einem der G.72x Verfahren des ITU-T Standards kodierte Audiosignale, z.B. G.723.1, G.727, G.729.

The first data stream may contain at least one of the following useful signals or be formed as such:

• - analog audio signals or audio data;
• - GSM encoded audio signals;
• G.711 encoded audio signals;
• - PCM encoded audio signals;
• AMR or AMR-WB encoded audio signals;
• - According to the G.72x method of the ITU-T standard coded audio signals, eg G.723.1, G.727, G.729.

Out Each of the mentioned audio signals can be identification features determine for sections, with high probability an identification of the respective Subsection enable. It may be appropriate, identification features to use that during a signal processing or coding of the audio signal or be generated anyway of the first useful signal. This reduces the complexity within a transmission arrangement. By using existing ones Coding or communication standards may be the existing technologies and transmission method continue to be used.

With the method according to the invention Is it possible, any additional Add data stream to the existing data stream without to interrupt this. For example, the additional Data stream video data, especially in MPG, MPG2 or H.26X format contain. Likewise, additional image data, in particular in JPG format or also data for a computer-aided Transfer slide show. One more way consists in the parallel transmission other voice or audio signals or audio data, for example for the transfer of a Stereo signal. Likewise, text as a useful signal in the second data stream be transferred in a coordinated manner to the first data stream. Basically everyone is Kind of information suitable for a synchronization at first Data stream or to the existing in the first data stream user data needed.

A transmission the first and the second data stream can be partially transmitted by transmission of Signals according to a mobile communication standard or example through an internet connection between at least two different nodes respectively. It is also possible a transmission at least partially by a wired communication link perform.

Accordingly, a transmission arrangement according to the proposed principle comprises a first device for detecting a first useful signal and a second device for detecting a second useful signal. Furthermore, an analysis device is provided, which is designed to determine at least one identification feature for an identification of the first or of the respective subsection from a first subsection or subsections of the first useful signal. The analyzer is connected to a coding device which identifies the identifier provided by the analyzer tion feature or a respective identification feature a first subsection or a respective subsection of the second useful signal assigns. The transmission arrangement also comprises a first transmission stage, which is coupled to the first device for transmission of the first useful signal. A second transmission stage for a transmission of the second useful signal is connected to the coding device.

With the transmission arrangement according to the invention can be a first and a second useful signal capture. While that first payload signal is transmitted by the first transmission stage, comprises the transmission arrangement various means for further processing of the second useful signal. It is provided, the second useful signal identification features assign, which allow synchronization with the first useful signal. Contains for this purpose the transmission arrangement according to the invention an analysis device for an analysis of subsections of the first useful signal.

The Analysis device can be executed to identify identification features from these signals, on the one hand robust against interference of any kind in the voice or audio signal and on the other hand allow identification of the respective subsection of the signal. In addition to the use of purely analog signals can be the identification features also from coded digital useful signals. Likewise, the Identifiers Parts of the audio signal or the coded one Contain audio data.

In An embodiment of the invention is therefore the first device for detecting the first useful signal for coding after a Coding type executed. For example, this is a μ-law Coding, a GSM coding, a PCM coding, an AMR or AMR-WB coding a G.711 coding or a G.72x coding, where x can take different values. The last mentioned codes denote various methods of the ITU-T standard for voice compression. The different coding methods are particularly suitable for coding of speech or audio signals.

For one another Coordinated output of the first and second useful signals may be expedient if the encoder in addition a synchronization device. This is suitable Identification feature of a subsection of the first useful signal to assign to a subsection of the second useful signal, wherein this assignment a predetermined time ratio of Part of the second useful signal to the subsection of the first useful signal corresponds. In addition, the encoder for the generation be executed by so-called time stamps. This can be done the identification features and the subsections in the second useful signal apply, whereby an assignment is determined.

In Another embodiment of the invention is the first transmission stage for a transfer to a first transmission channel and the second transmission stage for a transmission on a second transmission channel executed. these can each different transmission channels but also the same transmission channel represent. It is also possible that first and second transmission stage form a common transmission stage and transmit first and second payload data in a common transmission channel.

One Another aspect of the invention relates to a receiving arrangement for one another coordinated playback of useful signals of a first and second Data stream. This can be a first buffer for storing a first useful signal or a delay unit included. An analysis device in the second receiving arrangement is connected to the first latch or the delay unit coupled and executed, at least one identification feature from the first useful signal for one Identification of at least a first subsection of the first Determine and provide useful signal.

The Receiving arrangement contains a synchronizer for a concerted output of the first and second useful signal based on a comparison of stored in the second payload identification features with the at least one provided by the analyzer Identification feature.

By the processing of the first data stream and the extraction of Identification features deleted the need to have an already existing communication connection and transfer of the abort the first useful signal. Rather, it is possible to have one new communication connection for a transmission to build a second data stream to receive this and from it determine a second useful signal and the identification features, the for a synchronization of the second useful signal with the first useful signal are provided. Thereby can already existing communication standards or technologies be used.

In one aspect of the invention, the receiving arrangement includes a comparison device for outputting a control signal in response to a comparison of the identification features stored in the second data stream with the identification features provided by the analysis device is executed. This control signal is used to tune the output of the first and second useful signal.

The Comparator is in one aspect of the invention for analysis a similarity between the deposited identification features and the at least one provided identification feature executed. By analyzing a similarity will it be possible even with a slight disturbance of the first or second useful signal during a data transmission an identification and assignment for a synchronous output too enable.

In Another aspect of the invention is the comparison device executed with a generation of the first useful signal from the identification features. This is useful, for example, if the identification features in the second data stream encoded Represent the shape of the first useful signal. In this embodiment is it possible to have one Decision about it to make which first payload is to be output, the from the first data stream or from those in the second data stream generated identification features generated.

There in general, the transferred Signals to the receiving device according to a communication standard encoded in one aspect of the invention comprises the receiving arrangement a first coding device. The encoder is for generation the first payload signal from a first one of the receiving device received signal formed. Furthermore, a second decoding device be provided for generating the second useful signal from a second received signal is executed. It is possible that the receiving arrangement for a reception of the first and the second signal in a common transmission channel or formed in different transmission channels is.

at the system according to the invention it is a sending order that is used to deliver a first and a second signal is formed, wherein the second signal Identification features included from the first signal or from Information contained therein is derived. The receiving arrangement is for identifying identification features from the first signal accomplished and contains Means for a concerted, especially one synchronous output derived from the first and second signals Signals. The output depends on a comparison the identified identification features with the in the second signal contained identification feature. This can cause the output of a arbitrary content of a second signal timed to an output of the first signal. The second signal can For example, audio signals, video signals or computer-assisted slide shows include.

To In a second major aspect, the invention provides a method for synchronizing a plurality of data streams, each a plurality of each other the following subsections, possibly data frames, having at least a second of the data streams in association with subsections of the second data stream on subsections at least a first of the data streams referring identification features contains and over the identification features mutually associated subsections the data streams be determined to synchronize the data streams. It can at the data streams to be synchronized to transmitted, possibly over different Communication channels transmitted data streams act. This is not mandatory.

A development It is suggested that for the Assignment of a respective subsection of the first data stream to a respective subsection of the second data stream several, Identification features that refer to different subsections of the first data stream considered become. That way the synchronization is especially good and even with a certain fault tolerance possible, which is especially true in the Trap of over possibly disturbed communication channels is appropriate. Disruptions of a respective channels of communication cause that in the second data stream contained identification features or the first data stream is corrupted which is less problematic when synchronizing referring to different sections of the first data stream Identification features considered become.

Around a unique identification of mutually associated subsections the data streams to enable it is appropriate if for one respective subsection of the first data stream a set of several in this subsection referring identification features in second stream is included and in determining each other assigned subsections of the data streams is taken into account.

The first data stream may include the identification features corresponding or complementary to the identification features transmitted in the second data stream. This is not mandatory. It could also be necessary to determine appropriate identification features, for example, to calculate. In general, it is proposed that in each case at least one identification feature, possibly a set of identification features, is determined for subsections of the first data stream and with identifications contained in the second data stream characteristics or identification feature sets is compared. The identification of identification features also includes, in particular, that the identification features are still being determined, for example, calculated from data contained in the first data stream or otherwise determined, as already mentioned. It is further included that the identification features represent partial data of the first data stream.

A development It is suggested that the comparison be made by applying at least a comparison criterion, if necessary a distance criterion, takes place, preferably with determination of at least one comparative measure the comparison criterion or at least one distance measure the distance criterion in one of the identification features containing abstract feature space.

To an expedient embodiment is provided that by multiple application of the comparison criterion between on the one hand a for determined an on-point subsection of the first data stream Identification feature or identifier feature set and on the other hand several, to different sections of the first data stream referring, transmitted with the second data stream identification features or identification feature sets several on the one hand on the / the identification feature or Identification feature set of the sub-point subsection and on the other hand to a particular / specific, contained / contained in the second data stream Identification feature or Identifikationsmerkmalssatz referring Comparative measurements be determined, each of the Aufpunkt subsection and a certain subsection of the second data stream are assigned and / or a subsection distance between the subsection section and the particular subsection of the second data stream.

alternative and additionally can be advantageously provided that by multiple use of the comparison criterion between, on the one hand, an assignment to a subsections section of the second data stream in this contained identification feature Identification feature set and on the other hand several, for different sections of the first data stream identified identification features or Identification feature sets several on the one hand to the / the Aufpunkt-Teilabschnitt associated (s) Identification feature or identification feature set and on the other hand on one for one determined / determined a particular subsection of the first data stream Identification feature or Identifikationsmerkmalssatz referring Comparative measurements be determined, each of the Aufpunkt subsection and a certain subsection of the first data stream are assigned and / or a subsection distance between the subsection section and the particular subsection of the first data stream.

A development It is proposed that, on the basis of the determined comparative measure, if necessary by determining a minimum or maximum degree of comparison, each other associated subsections of the first and second data streams be determined. It is specially thought that based the determined comparative dimensions, if necessary, by determining a minimum or maximum comparative measure Synchronisationsmaß, if necessary, a shift distance corresponding to a partial distance is determined which is at least one subsection or subsections of the first data stream of at least one subsection or subsections assigns the second data stream in pairs.

To a particularly preferred embodiment of the method according to the invention is provided for that several different subpopulation sections of the first and second Data stream in each case by repeated application of the comparison criterion several sentences of comparative measures be determined. In this context, further education as particularly preferred, because particularly fault-tolerant, proposed that a comparison of the sets of Comparative measurements be combined with each other to a respective combination-Vergleichmaß. Preferably, then the determination of mutually associated subsections of first and second data streams based on the determined Combination comparison dimensions, if necessary by determining a minimum or maximum combination comparison measure.

Frequently becomes be it useful if, on the basis of the determined combination comparison dimensions, if necessary by determining a minimum or maximum combination measure Synchronization measure determined is, for example, a Teilabschnitt distance corresponding Shifting magnitude. The synchronization measure or the shift measure orders at least one subsection or subsections of the first data stream at least a subsection or subsections of the second data stream in pairs.

Advantageous For example, the respective combination comparison measure of an optionally scaled sum or if desired scaled product or another math combination correspond to comparative measures assigned to the same subdivision distance, those with a respective incoming comparative measure at least increases monotonically or at least monotonically decreases.

A for the Practice particularly expedient design of the method provides that the combination comparative dimensions of a initial Set of combination comparison measures or one as an initial sentence serving set of comparative measures iteratively by successive consideration further sections of the first data stream and / or the second Data stream or by consideration further sentences determined by comparative measures become. Furthermore, it can be provided that a respective set of Comparative measurements by consideration further sections of the first and second data stream to further Comparative measurements added becomes.

It is mainly (but not exclusively) thought of Media streams be synchronized. For example, at least a first Data stream comprising an audio data stream or voice data stream with at least one second data stream comprising at least one further Audio stream or voice data stream and / or comprising at least to synchronize a video stream.

To a preferred, for the practice particularly relevant embodiment is provided that the first data stream is a codec coded data stream, wherein a codec based encoder output Parameters or data are included in the first data stream, to a reconstruction of the first data stream underlying Audio or voice information by decoding the first data stream to enable and at least partially included in the second data stream, to synchronize the first with the second data stream enable. For example, in this context, it is thought that the codec on a prediction analysis, preferably linear prediction analysis, the underlying audio or Speech information based codec is, in particular an LP or Linear Predictive Coding Codec or a CELP or Code Excited Linear Predictive Coding Codec. Specifically, the codec can be a voice codec be based on a language model.

Also concerning the second data stream, it is thought that this a codec-coded data stream is one of which is on a codec based encoder output parameters or data in the second data stream will be added to a reconstruction from the second data stream underlying audio or speech information or video information by decoding the second data stream to enable.

you can direct or direct the first and second data stream synchronize by synchronizing these data streams themselves carried out becomes. Alternatively, it is also possible that the first and the second data stream indirectly or indirectly be synchronized by decoding or recoding the first and second data streams obtained synchronized sequence data become.

Generally is in relation to the inventive method and the various addressed design options further proposed that the first data stream and the second data stream generated by a first instance and transmitted to a second instance be, and that the first and the second data stream through the second instance or one the transmission intermediary instance mediating between the first and the second instance synchronized, and in the case of the intermediate instance, this if desired, the first and second data streams to a combined data stream combined and transmitted to the second instance, preferably instead of first and second data streams.

In a communication environment, possibly mobile telecommunications environment, at least one first user terminal the or a first instance and at least one second user terminal the or form a second instance. If the synchronization by a Interim instance, so at least one infrastructure facility the communication environment that forms an intermediate instance, in particular, for example, a device of the base station etc. comprehensive mobile telecommunication system.

in the Case of bidirectional or multidirectional communication can be the first user terminal with respect to at least one other first data stream and at least another second data stream at the same time a second instance and may the second user terminal with respect to the other first data stream and the other second data stream at the same time to form a first instance.

In a further development, it is proposed that the first and the second data stream or the further first and the further second data stream are transmitted via different transmission channels and / or over between the instances on the basis of various transmission standards. In this case, it may be expedient or occur in certain situations that one of the first and second data stream or one of the further first or second data stream via a circuit-switched or circuit-switched connection, preferably at least partially by radio according to a mobile telephony standard is transmitted and the other from the first and second data stream and from another first or second data stream over a packet-switched connection, preferably according to a network or Internet transmission standard is transmitted. In this connection, it is primarily thought that the first or the further first data stream is transmitted via the circuit or circuit-switched connection and the second or the further second data stream is transmitted via the packet-switched connection.

The inventive synchronization the data streams is particularly useful if one from the first and second data stream or one of the other first or second data stream the other from the first and second data stream and from the other first or second data stream is delayed during transmission, possibly with variable, time-varying delay time.

To one for the practice is particularly important embodiment of the method provided that first the generation and transmission of the first or another first data stream and then later the generation and transmission of the second or further second data stream and then the synchronization the data streams starts. For example, a normal telephone call can be recorded first and then this to a video calling call or be transferred to a conference call with multiple participants without the original Telephone conversation interrupted becomes. It should not be excluded that the original Telephone conversation only continued for so long until a seamless and uninterrupted transition reached to a conference call or a video call. If the second data stream and the language information of the first Contains data stream, can after synchronization, the communication alone means of the second data stream and the first data stream is then aborted become.

The inventive method according to the second aspect can be carried out appropriately in connection with the implementation of the method according to the first main aspect or as a sub-procedure of the method according to the first main aspect. From the invention and training suggestions for the procedure according to the first main aspect there are possible further Process features of the method according to the second main aspect.

The The invention further provides a system according to the second main aspect to carry out of the method according to the second main aspect, with at least a first Systemkompo component, which is designed for the first data stream and generate the second data stream and a second system component transferred to, wherein the second system component or at least one of the transmission mediating between the first and second system components Intermediate component of the system is designed for, the first and the to synchronize the second data stream. It will be mostly, but not exclusively, thought that the system would be a communication system, possibly a mobile telecommunication system, is, or a cellular telecommunications system wherein at least a first user terminal comprises the or a first system component and at least one second user terminal the or forms a second system component. The first and second system components may be the first and second instance of the method according to the invention represent.

He follows the synchronization by an intermediate component of the system, so can an infrastructure of the communication system the or form an intermediate component. The intermediate component can be the Represent intermediate instance of the method according to the invention.

Prefers is provided that the system for bidirectional or multidirectional communication is performed, wherein the first user terminal in relation to at least one further first data stream and at least one another second data stream at the same time a second system component and the second user terminal with respect to the further first data stream and the other second At the same time, the data stream also forms a first system component.

The System can be characterized by further device features, resulting from the explanations to the system and the devices according to the first main aspect of Invention result.

Provided Above all, a user terminal, possibly a mobile phone, for a system according to the invention, the user terminal designed for that during execution of the method according to the second main aspect of the invention the first and generate second data stream, in particular based on input or acquired audio or voice information and video information, and the data streams to send, if necessary over different communication channels or based on various transmission standards, or / and where the user terminal designed for, at the implementation of the method according to the second main aspect of the invention the first and the second data stream or the further first and further second Data stream to receive and synchronize, especially for a time synchronous output by means of the data streams of transmitted audio or voice information and video information.

The User terminal a transmitting device and / or a receiving device according to The first main aspect of the invention as mentioned above.

The inventive system can have multiple user terminals as mentioned as the first system component and / or as the second System component include.

in the The invention will be described below with reference to various embodiments explained in detail with the aid of the drawing. Show it:

1 a first form of representation of a system with a transmitter and a receiver according to the inventive principle,

2 a second representation of a system for a synchronous transmission between a transmitter and a receiver according to the principle of the invention,

3 a third representation of a system for a synchronous transmission between a transmitter and a receiver according to the inventive principle,

4 a schematic representation with first and second useful signal,

5 a first embodiment of the method according to the invention,

6 a second embodiment of the method,

7 a third embodiment of the method.

8th serves with the schematic data flow representation of the subfigures 8a) and 8b) for explaining a further embodiment of the method according to the invention and of the system according to the invention and with the data flow representation of the subfigure 8c) to explain an embodiment of the method and the system.

9 serves with the subfigures 9a) and 9b) for explaining a preferred way of synchronizing two data streams, in the present case a video stream and an audio stream, in particular corresponding to a speech-coded audio stream and a video stream in principle 8th ,

in the As a rule, a system for a communication the following components. For one thing is one Transmitter provided to transmit the User data collected and processed according to a communication standard. The processed and possibly processed data will be passed on to a communication network. This usually contains several individual nodes, which pass on the useful signal. Depending on selected Communication connection, it may happen that the useful signal reprocessed or converted into another data format becomes. At the end of the system, the network is in turn with the receiving unit coupled, who transmitted the Data again converted into the useful signal.

One typical example of this is a connection of a mobile communication device in a landline and for example to an ISDN telephone line. Here are the useful signals to be transmitted in the form of voice or audio signals from the transmitter, the mobile Communication device in Signals converted to a communication standard and sent to a Transfer base station. The base station forms part of the network and processes the received signals on. she extracts it, for example again the useful signal in the form of the speech signal. This will be after coded according to the PCM coding method and via a landline line hand over the recipient. It may well happen that depending on the distance between transmitter and receiving device within the network several different nodes are provided, the while the data transmission Reprocess or otherwise process the signal.

For data transmission in the present case an end-to-end connection is used. Here, the communication connection between the communication device and the Telephone set up, and the line remains independent of a voice transmission consist. The connection will only become complete interrupted. This results in the transmission of the language to a essentially constant delay time, that the individual nodes of the communication link do not change. in the Generally, such a communication connection is also called circuit-switched or "circuit switched "connection designated.

in the Contrary to this in a packet-oriented transmission the individual packages over different Routes transmitted to the recipient become. As a result, it can also have different maturities come. A typical example of such a packet-oriented communication connection is included Internet-based transmissions in front.

1 shows a system of a transmitting unit 1 , a receiving unit 3 and a network in between 2 for a communication between transmitting unit 1 and receiving unit 3 ,

The transmitting unit is designed in the present case as a mobile communication device. It contains a microphone 131 for recording an analog voice or audio signal, for example from a user. This is done by a coding device 13 converted into a mobile data compliant data stream B. The coding device contains this 13 example, a signal processor, which converts the analog audio signals into digital signals. These are filtered low-pass, and coded according to a method provided for the mobile radio standard. Subsequently, the thus encoded and processed analog audio signals as data stream B via an antenna 19 to a communication network 23 issued. The term data stream is to be understood in the following as a generic term for all types of signals for the transmission of information.

In the present case, the communication network includes 23 a base station and other landline connections with multiple landline nodes. Since a transmission according to a mobile standard between the landline nodes is usually not provided, the base station generates in the network 23 from the data stream B another signal. For example, this can now take place in the form of a PCM-coded variant of the analog audio signal A present in the data stream B.

Finally, a data stream C, which in the ideal case contains the same user data (ie the audio signal A) as the stream B to the base station 24 issued. This generates the signal D according to a predetermined mobile radio standard and sends it to the receiving unit 3 ,

From the receiving unit 3 the signal D is received and decoded. The decoding includes, for example, the conversion and extraction of the encoded audio data. These are used as data stream E in the audio decoder 31 fed, which converts them into the analog audio signal F. On the output side is the audio decoder with a loudspeaker 37 coupled to the output of the audio signal.

According to the invention, it is provided to establish a further communication connection to an already existing communication connection for a transmission of voice or audio signals. With the second connection video signals to the receiving unit 3 be transmitted.

The transmitter unit contains this 1 another entrance 132 For example, to a video camera 15 for detecting video signals I is connected. The analog image information I is from the video camera 15 converted into a digital video signal J and sent to the video encoder 11 transmitted. For example, the digital video signal J may include YUV encoded image information at a frame rate of 30 frames per second. The video encoder 11 generates from it a compressed digital video signal M. A compression is particularly useful if only a limited bandwidth is available for the data transmission of the video signal. For example, digital video information can be very well compressed and encoded using the MPEG or MPEG2 method. A compression and coding with the video encoder 11 also has the advantage that the video encoder 11 additionally time stamp or general time information K in the compressed video signal M can store. For example, the time information can be transmitted by means of RTP timestamps.

The total signal N is a data stream over the interface 18 to a second network 22 transmitted. In the present case, this represents the Internet, which forms a packet-oriented network. For transmission of packets of the data stream N, for example, a UDP / IP protocol can be used. The individual packets are distributed over several nodes within the Internet 22 finally as data stream O to the base station 24 transmitted to the receiving unit as a signal D using a mobile communication standard 3 transmitted.

The transmitted signal D is decoded and the video information therein in the form of the signal R to a video decoder 33 passed on. This decodes the video information contained in the signal R and gives it optionally via a buffer 35 to a screen 38 from.

Because of the network 22 used UDP / IP protocol may lead to a faulty data transmission of the video information or the data stream N and O respectively. For example, individual packets may be lost. It is also possible that the different packets of the stream N at different times at the base station 24 and thus in the receiver 3 arrive. Another problem is that there is no direct temporal relationship between the first communication connection for the transmission of the audio signals A in the first data stream D and the second communication connection for the transmission of the video signals I. As a result, image or audio signals can be output at different times. A synchronization between sound and picture is no longer guaranteed.

For a coordinated output of the signals A and I in the receiver is an analysis device in the transmission arrangement according to the invention 12 and an encoder 11a intended. The analyzer 12 is in the present Example with the input 131 for the audio signals A coupled. It generates from the detected audio signal A identification features L, with the help of which sections or areas of the audio signal can be identified. The identification features may be associated with the coded video signal M so as to establish which portions of the audio signal belong to portions of the video signal. For this purpose, the analysis device decomposes in the exemplary embodiment 12 the audio signal in sections of the same length.

Each subsection of the audio signal is selected so that its output takes place in a temporally defined relationship to a representation of one or more images of the detected video signal. The analyzer 12 extracts from each subsection an identification feature L, a so-called fingerprint. This identifies the respective subsection of the audio signal A uniquely. The uniqueness is through the synchronization device 17 ensures that adds a time stamp K both the identification feature L and the corresponding section of the video signal. In other words, the identification feature L with the help of the synchronization device 17 a portion of the video signal J in the video encoder 11 assigned.

The Identification feature is chosen so that it on the one hand especially robust against possible interference while the data transmission is. On the other hand, it is also robust against artifacts due to a signal processing or compression during the transmission of the first data stream B occur. These artifacts can affect the useful signal in the first data stream B.

The compressed video signal M and the identification feature are in the encoder 11a summarized to the data stream N.

4 shows a schematic representation to illustrate this assignment. The audio signal A, represented as a simple sinusoidal oscillation, is subdivided into different subsections TA1, TA2, TA3, each of equal length. In the embodiment, the length of each subsection TA1 to TA3 is correlated with the digital image information VB1 to VB3 of the video signal J. In the present case, subdividing the audio signal A into subsections to each second video image VB1, VB2 and VB3 of the digital video signal J. Da Video signal consists essentially of a number of temporally successive frames, it is easily possible to achieve a synchronization in that a particular section of the audio signal A is played back to a video image.

For each subsections TA1, TA2 and TA3 will now become a fingerprint, a unique identification feature FP1, FP2 or FP3 determined. This Fingerprint can be, for example, by LTP or LPC coefficients be determined. Such coefficients are used in coding of the speech signal A and can thus easily without additional effort to be used. Another possibility consists in the determination of particularly robust frequency information for each Subsection. After generation of the respective identification features These are the corresponding video image of the digital video signal assigned.

For an assignment On the one hand, the video images VB1 to VB3 and the generated identification features FP1 to FP3 with a time stamp K provided. This timestamp K allows the assignment of the identification features L to the coded Video signal M with the coded video images.

In the coding device 11a to 1 the identification features L and the coded video signal M are then combined. This can be done, for example, by multiplexing the two data streams L and M. The data stream N generated by multiplexing in the present example is designed as a packet-oriented data stream whose packets contain sections of the coded video signal M and the associated identification feature. Each packet contains the subsection VB1 to VB3 of the video signal J which is assigned to the corresponding identification feature FP1 to FP3.

Because of in the identification features L and the encoded video data stream M contained time stamps K is guaranteed even then an assignment if another form of package is chosen. So can Video data stream M and the identification features L also in different Packets or even different data streams.

A different possibility consists in the coded video data stream M, the identification features L as additional Information, engl. "supplementary enhancement information ". A video standard that allows this is the H.264 / AVC standard. An additional multiplexing can then omitted, the coded and provided with the features L video stream M forms the data stream N in such a case. Basically only an association between the identification features in the stream L and the video signal J guaranteed be.

Present includes 4 a packet of the multiplexed data stream N a header portion RTP, are stored in the header information for each data format and time stamp. Connected to this is a second share, in the identification feature FP1 is stored. The video information part DVB1 contains the image information of the digital video signal J starting from the video image VB1 to the video image VB2. In a corresponding manner, the coding device multiplexes 11 Likewise, it adds the identification features FP2, FP3 from the feature stream L accordingly.

The thus prepared second data stream N is again through the second communication link via the network 22 to the recipient 3 transfer. The received data stream P comprises not only the coded video signal R but also the additional identification features Q.

The feature stream Q becomes the device 36 fed. This again determines the identification features and the timestamps that have been supplied to the identification features on the transmission side. In addition, the receiver contains 3 a synchronizer 34 , the input side to the output of the audio decoder 31 for supplying the decoded speech or audio signal F is connected. In addition, he is at the facility 36 connected to the signal U, which includes the identification features. The synchronizer 34 serves to, from the sections of the speech signal F of the audio decoder 31 To generate identification features. That from the synchronizer 34 The method used for generating the identification features essentially corresponds to the analysis apparatus 12 within the transmission arrangement 1 , The generated features will then match those of the facility 36 compared transmitted characteristics. If there is a match or a high similarity, it is assumed that a corresponding section of the video signal is present for the subsection of the speech signal F.

To ensure a concerted output is the audio decoder 31 in addition to a buffer device 32 connected for buffering the audio signals. Another buffer device 35 is used for buffering the decoded video signal W. They are used to correct a corresponding time offset due to different transmission times or due to the different signal processing. Both buffer devices 23 and 35 be from the synchronizer 34 controlled by the control signals V and X. Depending on the drive, the buffers supply the sub-sections G, Y of the speech signal F and the video signal W selected by the control signal to the output devices 37 and 38 from.

The synchronizer is with the video decoder 33 and the facility 36 for supplying the time stamp information S, T coupled. Together with the comparison of the identified identification features with the identification features of the device 36 and the timestamp information is generated by the synchronizer 34 the control signals V and X. It is useful, in addition to the audio buffer 32 also the video buffer 35 in the event that the video signal before the corresponding audio signal, the receiver arrangement 3 reached or the signal processing in the synchronizer takes longer than a decoding of the video stream R.

The additional buffering also makes it possible, in the case of lost data, to emit the corresponding signals of the respective other data stream. For example, areas of the audio signal F can be dispensed who the, if the corresponding video signal W is lost during the transmission or not reconstructed. Due to different delays in the two networks 22 . 23 it is expedient to choose a suitable buffer size. In addition, it may be useful, if the identifiers in the first or second data stream match, to not immediately output the corresponding sections, but to buffer them again instead. This has the advantage that later output can be largely continuous without any later delays due to longer signal propagation times in the network 2 ,

one Buffering or delay An output of the speech signal may also be by special processing of the speech signal. Instead of the buffer, a signal processor be provided, which is a time-based modification of the speech signal performs. So could the speech signal is dynamically distorted, e.g. vocal sounds at the output dynamically extended or shortened thereby causing a delay to reach. This "time scale modification "procedure is particularly suitable as a continuous output of the speech signal without Interruptions, but still time to process the second Data stream and the vote of an issue is won.

During the transmission of the first data stream in the network 23 and the second data stream in the network 22 it can lead to signal interference or signal changes. So in the first network 23 the encoded audio signals are otherwise processed. As a result, the frequency spectrum, for example phase information, of the first data stream B or its time behavior changes. It is therefore expedient to choose identification features that are particularly robust against such Störun conditions. For example, the so-called LTP or LPC coefficients for the speech signal (Long-Term Prediction, Linear Predictive Coding).

2 shows a further embodiment of a system according to the invention with a transmission arrangement 1 , a receiving arrangement 3 and a network connected in between 2 , The transmitter 1 has a first detection device 130 for detecting the first useful signal, for example of speech signals. Another arrangement 150 serves here for generating and displaying a computer-aided presentation J '. The presentation J 'may include audio and additional video data as well as still pictures.

The first device 130 encodes the detected first useful signal and generates from the encoded first useful signal identification features L, which allow identification of subsections of the first useful signal. The identification features L are a coding device 110 transmitted. The coding device 110 is also on the second device 150 connected. It generates the second data stream N ', in which the identification features L are combined with the information about the computer-assisted slide show J'.

The second data stream is sent to the second network 220 while the encoded audio signals are transmitted through an antenna 190 to the first network 230 be sent. Both networks 220 . 230 are each with a base station 240 . 250 for a mobile communication link with the receiving device 3 coupled.

In the present case, the transmission of the first data stream, that is to say of the speech signal, and of the second data stream takes place via two different transmission channels. For example, the encoded audio data D in the form of a GSM signal to the receiver arrangement 3 be sent. The second data stream, on the other hand, is sent to the receiving arrangement via a second transmission channel D1 3 transmitted. The receiving arrangement 3 includes two receiver stages 310 . 330 which process the two signals in the different transmission channels. They contain a decoder for decoding the audio signal or the screen presentations. In the synchronizer 340 An allocation of subsections of the decoded audio signal to the corresponding sections of the computer-aided screen presentation using the identification features.

Illustrates another aspect of the invention 3 , Elements of the transmitter 1 or the network 2 with the same function or effect as elements in the design 1 bear the same reference numbers. In the illustrated embodiment, the analysis device for generating coded and provided with time stamps K audio signals L is executed. These serve as identification features and are combined with the coded and time stamped video stream M to the second data stream N. About the first network 23 Furthermore, the first data stream B is transmitted, which contains a coded speech signal. About the second network 22 the transmission of the data stream N. the receiving arrangement 3 ' is configured to decompose the received second data stream P back into the current Q and the current R. Furthermore, it contains the device 36 , which is embodied here for decoding the feature stream Q into speech signals U and time stamps S. Together with the existing time stamps S and T, which were added on the transmitter side as a time stamp K, a time-matched outputting of the speech signal U and the signal W is possible.

The synchronizer 34a is designed to, on the one hand, determine the voice quality and, in the case of an erroneous reception of the second data stream P, to switch over to the still existing first communication connection for the output of the voice signal F. This is useful, for example, in a transmission of the first and second data stream with different mobile radio standards. If, for example, the first data stream is transmitted as a GSM mobile radio signal and the second data stream is transmitted using the standard UMTS, a continuation of the circuit-switched communication connection is possible even if the second data stream fails.

With the elements of the invention the illustrated systems at an existing communication link for transmission a first data stream, a second communication connection for transmission a second data stream without interruption of the first communication link Add. It is also possible a new communication link for transmitting the first and the build up second data stream. A timed edition is done by the identification features added to the second data stream, derived from the first data stream. The additional identification features in the second data stream are added on the send side. This is for example in the form of a fingerprint or additional Information within the for the second data stream used transmission protocol possible. moreover Further information can be transmitted, for example, timestamps. By using a suitable transmission protocol, for example the Real Time Protocols is adding timestamps to data or identification features are still formalized and their use simplified for synchronization.

In addition, there is the possibility selbige identification by another Transmission channel to the receiver. It merely has to be ensured that the identification features in the further transmission channel can be assigned to the individual sections of the second data stream.

5 shows an embodiment of the method according to the invention. In a first step S1, a receiving arrangement receives a first data stream in the form of a first signal. The data stream is processed and the useful signal contained therein is buffered in a buffer. Parallel or substantially simultaneously for this purpose, a second data stream is received in step S2. In addition to second payload data, this also contains identification features which are suitable for assignment to the payload signal in the first data stream. The identification features are derived from the first useful signal.

In Step S3 becomes the identification features contained in the second data stream extracted. Subsequently In step S4, sections of the useful signal in the second data stream are generated and the identification features associated with the subsections the subsections of the first data stream cached. During the Steps S3 and S4, ie determining the identification features in second data stream, it is possible analyze the subsections of the cached useful signal. This process takes place in step S5. Here are from the individual Subpart identifiers identified in type and Structure correspond to the identification features of the second data stream. So if, for example, the identification features in the second Data stream represent LTP coefficients (Long Term Prediction), so in step S5 are stored from the individual sections of the first data stream also determines the LTP coefficients.

In Step S6 will now be the ones from the subsections of Use signal identified identification features with the or Identification features of the second data stream compared. For example can each identification feature of the subsections of the useful signal in the first data stream with each of the ones determined from the second data stream Identification features are compared. There are different ones in step S7 Comparison methods and methods available. The comparison can be so be designed that only with an exact match of an identification feature a subsection of the first data stream with an identification feature the second data stream generates a positive result.

There but maybe while a transmission Errors within the two data streams have occurred or through Signal processing or compression distortions or other changes may have occurred can also the identification features are slightly different. Therefore It may be appropriate for a decision in terms of a match to provide for certain freedoms. The match will therefore only determined with a probability. If this exceeds a predetermined Value, so will a match accepted. Another possibility would be a Correlation analysis for to carry out the identification features of the first and second data stream.

results the comparison process in steps S6 and S7 that the identification features the sections of the first data stream with the one or more identification features do not match in the second stream, will be the comparison with new identification features of the first or second data stream repeated. On the other hand, if there is a match in step S8 associated with the two identification features Portions of the first and second data streams are loaded from the buffer. Finally, in step S9, the sections become time-sequential spent spent.

By the caching of the first data stream and the caching of the second data stream he has a time delay while correcting a reception operation of the first or second data stream. By analyzing the useful signals in the first data stream and the Identifying the identification features eliminates the need to already to insert in advance timestamps in both data streams for later output.

Much more can be provided in the second data stream any useful signals in subsections wherein each of the sub-sections associated with identification features when these are synchronous with the subsections of the wanted signal to be output in the first data stream. A special choice the second useful signal is not necessary. For example can by the presented method a video signal as a useful signal of the second data stream using the identification features an existing transfer of a Voice signal synchronized. It is not necessary the first and second data streams over the same transmission channel at a receiver to convey.

6 shows an extension of the inventive method, which is taken into account when parts of the first or second data stream are lost or damaged during transmission. In this embodiment, it is assumed that the first data stream is an analog or digital telephone signal for transmission tion of audio signals forms. This is delivered from the transmitter to the receiver via several nodes.

To the existing communication connection is now a second Data stream added which includes a second useful signal corresponding to the telephone signal is synchronized. For this purpose, in step S10, the first and the second data stream substantially simultaneously via a common transmission channel receive. This transmission channel can represent, for example, a mobile connection according to the UMTS standard. Another possibility would be, for example, the first data stream over a telephone connection and the second data stream packet-oriented over a DSL connection too receive. In such a case, the transmission of the two data streams via the same physical line.

In Step S11, the common received signal is decoded or separated into the first and the second data stream. The first Data stream as a telephone signal is in step S12 in various Subsections of equal length divided. However, these sections are not arbitrary, but follow a predefined pattern resulting from the first data stream results. In step S16, these subsections become for later processing cached.

To the processing of the first data stream in steps S12 and S16, the second data stream is also processed with the second useful signal. The second payload also includes several subsections, the be separated in step S13. Certain sections is each assigned an identification feature that from the second Data stream is extracted and stored in a memory.

in the Generally, the reception of the first and second data streams takes place Although at the same time, this does not mean that the corresponding Sections of the first and second useful signal a specific have temporal relationship to each other. For example, due to different transmission paths between the sender and the receiver a time offset between corresponding sections of the first data stream and subsections of the useful signal in the second Data stream occur. In other words, subsections of the first Data stream earlier or later at receiver arrive as the corresponding sections of the second Useful signal. If this time offset now becomes greater than a predetermined value, it is no longer appropriate, late arrivals Cache subsections. This is not the case especially more useful if, for example, previously arrived Subsections of the first data stream further processed and, where appropriate already spent.

in the In this case, it is assumed that the second useful signal across from Delayed the phone signal is. In step S15, therefore, it is checked whether the the identification features associated with the subsections of the second data stream already spent. This can be done by a quick comparison the extracted identifiers of the subsections of the second useful signal with identification features of already issued sections of the first data stream. Another possibility for such a review exists then, if individual subsections of the second useful signal in second data stream time stamp information are assigned. In order to can all the subsections are discarded that have a timestamp include, before the last issued time stamp of a subsection lie of the second useful signal.

If In step S18, such a comparison of a match shows the corresponding subsection of the second useful signal in step S19 discarded because the output to this section synchronously Part of the first data stream has already been issued. at best In step S20, the subsection of the second user signal as well the associated Identification stored.

In Step S17 is an analysis and determination of the identification features the subsections of the first data stream made.

In Step S21 will now be the identification features of the subsections the first data stream with the identification features of the compared to the second data stream. Returns such a comparison in step S22 a match, this essentially means that the subsections of the first and second data stream are outputted coordinated should. These are loaded from the respective buffer in step S23 and output synchronously in step S24.

If, on the other hand, a subsection of the second useful signal to the corresponding subsections of the first data stream has not yet been received and processed, the comparison procedure in steps S21 and S22 results in no match. In such a case, it is assumed that the corresponding subsection has not yet been received in the second data stream. Therefore, a counter is incremented in step S25. The counter indicates whether the subsection in the telephone signal should be output in the second useful signal despite the missing subsection. For this purpose, the counter is compared in step S26 with a predetermined value. is the counter is less than this value, the method continues with the further analysis of newly received subsections of the first data stream.

Otherwise will if the counter greater than. in step S25 the predetermined value is, in step S27, the next one to be output Part of the telephone signal determined and output in step S28. The identification feature associated with the issued subsection is now marked as already issued and serves a subsection the second useful signal with the same assigned identification feature to identify. As the associated Partial section in the first data stream has already been issued the subsection in the second data stream is discarded.

It is appropriate, at the design of the method both a delay of Subsections of the first data stream relative to the subsections of second data stream, as well as the reverse possibility to take into account.

7 shows a further embodiment of the method according to the proposed principle. In this exemplary embodiment, besides the method steps for receiving the first and second data streams, the method steps during the transmission process are also shown.

In Step S30 becomes between a transmitter and a receiver Communication connection for transmission a first useful signal or a first data stream constructed. The structure is circuit-switched and remains until the end. The first data stream contains the useful signal, for example a voice signal. During one now the following period takes place in step S31 a continuous Communication. It becomes language from the sender to the receiver over the transmit circuit-switched connection.

These Communication is also in step S32 on the already existing Connection continued. additionally should now to the already existing first communication connection a second communication connection can be set up via the transmit second data stream becomes. The useful signal of the first and second data stream to each other done synchronously. These are the first and the second useful signal each divided into sections.

During the continuation the first communication connection and the transmission of the first user data in step S32, in step S33, a second communication connection is made via another transmission channel built up. This transmission channel can be opposite the transmission channel for the first communication connection be constructed differently. While, for example, the first transmission channel for the first communication connection comprises a landline connection includes the second transmission channel a packet-oriented internet connection.

In Step S34 will now be a voice or audio signal in the form of several Subsections detected as the first useful signal. Essentially at the same time and synchronously, a corresponding video signal is generated in step S35 detected, which also has several sections. In step S36, identification features are determined from the detected audio signal. These features can both from the captured analog audio signal, as well as from a digital Audio signal or an already coded audio signal can be determined. The term encoded audio signal is processed Understood audio signals that were encoded by a method. examples for such coding methods are the AMR or AMR-WB coding method, the GSM EFR coding method, G.72x coding method of the ITU-T Standards for Voice compression or combinations thereof. These are suitable especially for a voice coding.

The Identification features that were determined in step S36 allow a unique identification of the respective subsection of Speech signal. For a coding according to one of the above It is also conceivable method, while generating features during coding are also to be used as identification features. So can the in the AMR coding, LPC coefficients also generated as identification features serve. About that In addition, the generated identification features should be particularly robust against during the transmission be the first data stream occurring disturbances or artifacts.

The Identification features determined in step S36 are used during the Coding of the subsections of the video signal in step S37 added second stream. This is done such that an identification feature of a subsection the voice signal associated with a subsection of the video signal which is synchronous with the corresponding section of the speech signal stands. This is achieved by timestamp or a suitable one Combining the video signal and the identification features.

After coding the video signal in step S37, the second data stream and the first data stream are transmitted in steps S38 and S39. The transmission may include various transmission channels as well as a common transmission channel. Under a common transmission channel becomes a Übertragungsungska at the same frequency, using the same communication standard or using the same network nodes. During steps S38 and S39, however, a time shift or a time delay of the first and second data streams may occur. This results in a reception of the first data stream in step S40 and a reception of the second data stream in step S41 at different times.

In Step S42, the received first data stream is decoded and the extracted speech or audio signal contained therein. This is divided into several subsections, each of which is analyzed and an identifier is extracted. Parallel to this In step S43, the received second data stream is further processed. The identification features added in the second data stream of the subsections of the video signal are extracted. These identification features are now in step S44 with the generated identification features of the subsections of the buffered audio signal compared. Unless the comparison a match in step S46, the corresponding subsections become of the audio signal and the video signal in step S45 and output synchronously in step S47. Otherwise, in step S48 the audio signal without a corresponding video signal be issued.

There the order of the subsections of the audio signal is detected, can as well as portions of the audio signal are output, the time lie before a subsection of the audio signal, to which a corresponding Part of a video signal was found. This can be done especially with an error-prone transfer of second data stream, a continuous output of the audio signal guarantee.

The The method presented has the advantage that it is easier Way to existing mobile standards or communication links apply. In particular, it is possible without big ones Extra effort to continue an existing communication connection. It must only guaranteed be that the received first circuit-switched user signal buffered will, so a synchronization with any later received second data stream ensured is. It is not necessary that every subsection of the first useful signal is analyzed. This is rather dependent on the requirements of the second data stream. For example, if video signals at thirty Transfer images per second be, it may be appropriate the voice or audio signal in 1/30 second increments to disassemble and from each of these sections a corresponding To extract identification features. However, it is equally possible only every xth image of the video signal is an identification feature of a corresponding subsection of the audio signal to assign. there it is in the inventive method conceivable that the receiver does not know the exact assignment. Nevertheless, a synchronous output provided the subsections of the audio signal to which no Part of the video signal is assigned, also continuously be issued.

Next the synchronization of a video signal to a corresponding audio signal he lets the process of the invention and apply the orders to all streams that are timed to each other contain tunable user data. For example, it is also possible to have one common video signal over several transmission channels and several streams at a receiver to convey. Also conceivable is a voice or audio transmission in several data streams (or Signals), for example to allow a stereo signal. A synchronization of the data streams can be done as indicated. Also, the method as well as the arrangement is not on the synchronization of two data streams limited, but can be extended to multiple streams (more than two) if the user data to be synchronized in each case is the generation allow unique identifiers.

It should be noted is that in the case of encoded data streams contained in Payload the synchronization with respect to the data streams before their Decoding or alternatively in terms of after decoding from the data streams received user data streams can be done. It also comes into consideration, the synchronization before or after a recoding of the data streams.

A interesting possibility is further that the synchronization is not by functionalities of a terminal but by functionalities an infrastructure facility such as a mobile telephony operator takes place, then, for example, a first, such as voice data containing data stream and a second, for example video data synchronized data stream and related to a combining the voice data and the video data synchronous sequence data stream, possibly based on a decoding of the encoded voice data containing first data stream and the encoded video data containing second Data stream and encoding of the synchronized, yet uncoded voice and video data stream to a coded voice and video data stream.

Below is an exemplary embodiment of a particularly expedient manner of Synchronization of multiple media streams, especially an audio stream, special voice data audio stream, on the one hand and a video data stream on the other hand are given. It will be on the 8th and 9 Reference is made in the for analog data streams reference numerals corresponding to the reference numerals of 1 to 7 are registered.

It should be noted is that coded voice data generated by a voice codec dependent on from the speech codec and the underlying principles the synchronization with another media stream, in particular Video stream, particularly easy to enable, as the content of the Speech data stream B or certain data or parameters thereof even as identification feature or identification features (also as Fingerprint bezeichenbar) can serve. It will be here especially usually on a prediction analysis, in particular linear prediction analysis, based on data and parameters such as LPC parameters, LSP parameters, Pitch information Codebook gain about the given codebook and combinations of these parameters.

According to the schematic representation of 8th is a user terminal 100 with a microphone 102 and a video camera 104 Running and includes facilities that have a voice codec 106 and a video codec 108 realize. The voice codec 106 encodes those from the microphone 102 obtained speech payload data stream and generates the coded voice data contained first data stream B, for example, formed of speech frames with a duration of 10 msec or 20 msec and based on a linear prediction analysis by the speech codec based on data frame-wise, such as LPC parameters , LSP parameters, pitch information (P), gain or gain G with respect to a fixed codebook, gain or gain aG with respect to an adaptive codebook, etc. The video codec 108 generated from one of the camera 104 incoming video payload a coded video stream M. The voice codec 106 represents selected data of the coded voice data, such as an LPC parameter and an LSP parameter, as fingerprint information L of a combiner 110 available, which adds the encoded video stream M to the fingerprint information, thus generating the data stream N. Preferably, there is a frame-wise correspondence between the audio data stream B and the video data stream M and, accordingly, the supplemented video data stream N such that respective frames correspond to the same amount of time with respect to the audio and video payload, for example 10 msec or 20 in length msec, so every voice data frame 112 exactly a video data frame 114 of the video codec 108 given video data stream M and exactly one data frame 116 of the video data stream N supplemented in each data frame by the fingerprint information L and Q, respectively.

It should be noted is that it does not matter if the fingerprint information is included in separate data frames or recorded with the video data in common data frames is.

The first data stream B and the data stream N contained in the video and fingerprint information to be identified as the second data stream are transmitted to via different transmission channels and on the basis of various transmission standards and protocols. This is in 8th on the one hand by the arrows 114 and 118 representing a circuit-switched combination connection and, on the other hand, a symbolically represented router network 117 , which stands for a packet-switched communication connection, for example via the Internet.

In Sequence of different transmission channels and transmission standards is the initial one according to the embodiment existing synchronicity between the first data stream B and the second data stream N. the receiver side reserved. The received first data stream containing the coded voice data E and the received, the encoded video data R and the fingerprint information Q containing second data stream P must first be synchronized be, what purposeful already can be done before decoding.

A synchronizer 120 receives the data streams and extracts from the audio data frames 112 those parameters and data corresponding to the fingerprint information carried in the second data stream, in the present case the LPC and LSP parameters. Since voice data encoded as fingerprint information itself is used, an extraction device 122 simply to the relevant data in the respective voice data frame 112 access. In a corresponding manner extracts an extraction device 124 framewise the fingerprint information carried in the second data stream, in this case the one from the speech codec 106 output LPC and LSP parameters carried in the second data stream.

A comparison device 126 compares the parameters extracted from the first data stream and those extracted from the second data stream, thus allowing a pairwise association between speech data frames 112 the first data stream and data frames 116 or data frames 114 determine the second data stream. Suitably, the extraction device 124 not just the fingerprint information to the comparator 126 but provide from the second data stream P contained in the frame of the fingerprint information frame a second data stream R containing only the coded video data.

In the embodiment of 8a) and 8b) It has been assumed that, due to the packet-switched transmission of the second data stream, it is delayed with respect to the first data stream, so that the synchronization device 120 just a cache 128 for the data frames of the first data stream. The data frames are buffered in this buffer and under the control of the comparison device 126 frame-wise in synchronism with the video data stream R output. These frames who then through a receiver-side voice codec 130 and a receiver-side video codec 132 decodes and the resulting speech payload and the resulting video payload are timed by a loudspeaker 134 or a screen 136 played.

As already indicated, could by the synchronizer 120 Synchronization carried out by a device of a network infrastructure or the like, which then, for example, a combined audio-video data stream in which the voice and video information is synchronous to each other, provides and via a device leading to the transmission channel, for example via a Air interface, this combined data stream to the receiver terminal transmits. A corresponding embodiment variant is in 8c) illustrated. The synchronization device 120 ' is here with a combination device 138 executed, which brings together the synchronized audio and video streams to a combined data stream K, the one through the arrow 140 symbolized, for example, circuit-switched transmission channel is transmitted to a terminal, in which then split this data stream in the voice data on the one hand and the video data on the other hand and then this data by means of the voice codec 130 or the video codec 132 decoded and by the playback devices 134 . 136 be issued. In this embodiment, the synchronization is 120 ' additionally with a cache 129 for the video data frames to also be able to compensate for delays of the audio data stream relative to the video data stream. Also the synchronizer 120 the embodiment according to 8b) can advantageously with such, the video data associated buffer 129 be executed.

Concerning the synchronization of the media data streams is to be noted that distortions by disorders of the respective transmission channel occur could and that also ambivalence of the mutual assignment of the Data frames of the first and second data stream, possibly more than two data streams, could occur. The danger of ambivalences of the kind that no clear assignment between respective data frames of the first and second data streams possible is, in principle, through appropriately extensive fingerprint data practically turned off. It may be desirable in the In terms of data transfer rates to get along with a minimum of fingerprint data.

A particularly secure association between the data frames of the first and second data stream related to disturbances from the transmission channels or different types of interference is very fault tolerant and moreover Ambivalence with good reliability avoids, based on that for the Allocation of the fingerprint information of several data frames of the second data stream, here the video data stream, with multiple data frames of the first data stream, here the audio / voice data stream compared becomes. It is assumed below that parameters par_1 to par_N (especially LPC parameters, LSP parameters, etc. as mentioned above) form the fingerprint information and for each voice data frame of the first data stream in association with a respective video data frame in the video data stream (second data stream) with transfer preferably within the respective video data frame. In the embodiment of voice and video communication on which this is based in a telecommunications environment, this fingerprint information will be on the transmitter side extracted from the encoded voice data frame or provided by the voice codec, without changing the language data. These fingerprint data will then be associated with the associated one Video frame or transmitted in the associated video frame.

For a respective video frame of the second data stream, the associated i-th voice frame of the first data stream may be identified based on the similarity between the transmitted fingerprint data and corresponding fingerprint data determined for the voice data frames. From the received sequence of voice data frames, the fingerprint information is determined or extracted from the receiver side (or alternatively in the infrastructure device) for each data frame of the first data stream. It may then for a respective data frame i of the first data stream, an error or agreement measure e (i, k) = Σ jDM [par - j (i), par - j (i - k)], for k = 1, 2, ... where DM is a function in the form of a distance measure or a reciprocal distance measure, so that e (i, k) corresponds to a measure of error or is a function that corresponds to the reciprocal of a distance measure, that is a measure of agreement. Hereinafter, the simplicity is assumed that DM is a pitch measure such as a quadratic norm or the like, for example, Euclidean distance, absolute difference, Itakura-Saito, logarithmic distance, and the like.

In This formula sets k an assignment parameter in the manner of a Search distance or shift measure which is the fite data frame of the first data stream, exactly determined fingerprint data, the (i - k) -th data frame of the second Data stream, more precisely, this (i - k) -th data frame of the second Data stream associated with a particular data frame of the first Data stream referring fingerprint data in the second data stream, assigns.

It So will for several data frames i of the first data stream the size e (i, k) for Different values of k are determined to be based on this synchronization perform.

If ten LPC parameters (N = 10) are transmitted as the fingerprint information with the second data stream and a quadratic norm is used for the determination of the error measure, the following results are obtained for the speech data frame i and the search distance k: e (i, k) = [LPC1 (i) -LPC1 (i-k)] ^ 2 + [LPC2 (i) -LPC2 (i-k)] ^ 2 + ... + [LPC10 (i) -LPC10 (i - k)] ^ 2 e (i-k) is calculated for all values of k of interest, ie within a certain search range around the speech data frame i to be assigned to or to an associated video data frame, for example for the k values k = 1, 2, ... , 50. Usually, an order of 10 is sufficient for k, ie for a frame length of 20 msec, a search range of 200 msec.

It is quite appropriate to perform the synchronization on the basis of the error measures (or matching measures) e (i, k) alone. In contrast, however, it is preferable to consider a plurality of dimensions e (i, k) determined for the same assignment distance k, for example in the form of a combination comparison measure E (k) = Σ ie (i, k) or E (k) = Σ ie (i, k) / M.

This Combination can for every value k, the sum being over all to be considered Data frames of the first data stream goes. Unless a firm, but enter a varying number of variables e (i, k) into the combination comparison measure E (k), the sum should be nominated by the quantity M indicating the number of summands become.

The Combination comparison measure E (k), in particular a summary or mean error measure or a corresponds to a summary or average score, is much more error-tolerant and less prone to ambivalence than the underlying dimensions e (i, k), since a summation or averaging over time or over several Data frame pairs of a respective data frame of the first and a respective data frames of the second data stream is included. It Other combinations of the dimensions e (i, k) are conceivable, such as one Product formation.

Depending on the definition of the incoming function DM, a k value can be determined as a synchronization measure by determining a maximum or a minimum of the combination comparison measure E (k). In the case of a measure DM realized as a distance measure, the measures e (i, k) and accordingly also the combination measures E (k) for better match between the fingerprint information of the second data stream on the one hand and the fingerprint information of a respective data frame of the first data stream on the other hand decrease, so that a minimum of E (k) can be found. For example, if a minimum of E (k) is obtained for k = 3, it means that the video and voice data streams have diverge by three data frames, that is, the video stream is delayed by three frames from the audio stream. This makes it possible to synchronize the video stream (second data stream) with the first data stream (audio or speech data stream) by artificially introducing a corresponding delay for the audio data stream by storing it approximately in the buffer 128 ,

Advantageously, the combination comparison measures E (k) can be calculated iteratively. First, we calculate for each value of k: E [1] (k) = e (1, k)

It can then as a first approximation k can be determined as a minimum of E [1] (k).

Once the next speech data frame is present, then E [2] (k) = e (1, k) + e (2, k) = E [1] (k) + e (2, k) which allows the determination of k as a minimum of E [2] (k)).

The third iteration stage can then be k E [3] (k) = e (1, k) + e (2, k) + e (3, k) = E [2] (k) + e (3, k)

This can be continued accordingly: E [n + 1] (k) = E [n] (k) + e (n + 1, k)

As long as only comparison measures E [p] (k) are taken into account for the minimum or maximum search which contain the same number of summands, normalization with the number of summands is not necessary, but quite expedient. Taking into account a normalization quantity M indicating the number of summands, the following approximate combination comparison measures for the first to third approximation stage result: E [1] (k) = e (1, k) E [2] (k) = [e (1, k) + e (2, k)] / 2 E [3] (k) = [e (1, k) + e (2, k) + e (3, k)] / 3

Also in a recursive or iterative calculation, the correct normalization factor, if at all needed considered in a simple way become.

The recursive or iterative calculation runs on an averaging or Squeeze over the time out. For each additional considered language data frame a better approximation for the combination measure E (k) is obtained.

at the synchronization can be for the synchronous output of the two data streams or for a synchronous merging of the both data streams each determined for which value of k the combination comparison measure E (k) minimal (or alternatively maximum). It can in each case in a buffer associated with the first data stream cached data frames of the first data stream and in a cached the second data stream associated cache Data frames of the second data stream are taken into account, with added Data frames of the first and second data stream successively taken into account can be.

The manner of synchronization explained above in general will be better illustrated below by means of a greatly simplified example. It will open 9 Referenced. It is assumed that a second data stream Q, a video data stream, fingerprint data in the form of the first data stream E, a speech data stream, referring parameters par_0 and par_1 are included, the parameters which encode the payload data of the first data stream are also contained therein , In order to distinguish the parameters contained in the first data stream as payload data from the parameters recorded as fingerprint data in the second data stream, the latter are in 9 marked with an asterisk: par_0 *, par_1 *. This also takes into account that distortions may occur due to disturbances of a transmission channel or the like, so that the corresponding parameters in a data frame of the first data stream may differ from the parameters referring to this frame in the second data stream.

According to 9a are from the audio or voice data stream frames i - 1, i, i + 1, i + 2, i + 3, which arrived in this order and are recorded in an audio buffer. The assigned video data stream Q is delayed by one data frame, and therefore there are in a video buffer the data frames i-1, i, i + 1 and i + 2, which arrived in this order and are stored in the buffer.

The User data parameters par_0 and par_1 of the first data stream for the sake of simplicity, integer values as follows: 6, 7 for the data frame i - 1; 4, 5 for the data frame i; 2, 3 for the data frame i + 1; 0, 1 for the data frame i + 2 and 8.9 for the data frame i + 3. In the second data stream are frame-wise as Fingerprint the integer values addressed as par_0 * and par_1 * 6, 7 for the data frame i-1; 4, 5 for the data frame i; 2, 0 for the data frame i + 1 and 0.1 for recorded the data frame i + 2. In the case of the video data frame i + 1, the fingerprint data 2, 0 differs from the corresponding, in the frame i + 2 of the first data stream contained parameters 2, 3 to, for example, caused by a fault deviation represent. Without interference should the video frame i + 2 contains or should have the fingerprint data 2, 3 Audioframe i + 1 for the specified parameters contain the integers 2, 0.

9a shows the resulting for the illustrated data frames of the first and second data stream error measures e (i, k), the effects of - assumed here - incorrect fingerprint data in video frame i + 1 by "!?" Marked are. In the case of the error measure e (i + 1, k = 1) results from the application of the distance measure in the form of an absolute difference, the error measure 3 instead of 0. Other error measures e (i, k) for other pairings of data frames of the first and second data stream are in 9a) and 9b) as well as the resulting combination comparative measures E (-1), E (0), E (1) and E (3). The combination measure E (k) is minimal for k = 1, which means that the video stream is delayed by one frame of data from the audio stream and accordingly the audio stream has to be delayed by one frame for a video stream synchronous playback.

comparing one particular data frame of one data stream, for example the frame i - 1 of the voice data stream E, in pairs with different data frames the other data stream, so in the present example, with the Data frames i-1, i, i + 1 and i + 2 of the video data stream Q, so the relevant Data frame of the first mentioned data stream - in the example case the data frame i - 1 of the data stream E - addressed as a "Aufpunkt" data frame which will work with different data frames of the other data stream is compared. Alternatively could you get a certain "datum" data frame of the other datastream, For example, the data frame i of the video data stream Q, in pairs with different data frames of the former data stream, ie for example with the data frames i-1, i, i + 1, i + 2 and i + 3 of the voice data stream E, compare. Alone on the basis such a comparison can in principle be the synchronization of streams respectively. Preferably, however, the synchronization is based on the combination comparative measures E (k).

proposed will include a method and a system for synchronization several data streams, each a plurality of successive subsections, possibly data frames, wherein at least a second of the data streams in association to subsections of the second data stream on subsections at least a first of the data streams contains referring identification features and the identification features each other assigned subsections of the data streams are determined to the streams to synchronize. There are also devices and system components on the basis of which the procedure has been carried out or the system can be built.

Claims (108)

Method for receiving, with a first data stream, having at least two successive sections and with a second data stream, comprising the steps: - receive the first data stream (E); Receiving the second data stream (P) with a useful portion (W) and a first identification feature (Q, U), that of a first subsection of the at least two successive derived subsections of the first data stream (E) and usable for an identification of the first subsection is; - At least delay one of the first and second data stream, in particular of the first Data stream (E); - Determine of the first identification feature (Q, U) in the second data stream (P); - Determine of the first subsection in the first data stream (E) in dependence the first identification feature (Q, U); - Output of the useful portion (W, Y) of the second data stream (P) in time using the first identification feature tuned to an output of the first Subsection. Method according to claim 1, characterized in that that the first data stream (E) and the second data stream (P) respectively a plurality or plurality of successive subsections, possibly data frames, with several or all subsections of the second data stream on a respective associated subsection of the first data stream, contained in the second data stream Identification is assigned and for several of these identifiers the assigned subsection of the first data stream is determined and over the respective identification feature mutually associated sections the first and the second data stream output timed become. Method according to claim 2, characterized in that that for the assignment of a subsection of the first data stream (E) a subsection of the second data stream (P) several, to different Subsections of the first data stream referring identification features considered become. Method according to one of claims 1 to 3, wherein the step determining the respective first subsection in first data stream (E) comprises the steps: - Derive from an identification feature of at least one of the subsections in the first data stream (E); - To compare the determined first identification feature (Q, U) with the derived Identification feature of the at least one subsection of the first Data stream (E). Method according to one of claims 1 to 4, wherein the step of receiving the first data stream comprises the steps of: - providing a first useful signal (A) comprising at least two successive subsections; Deriving an identification feature (L) from at least one of the successive subsections, which is usable for an identification of the at least one subsection of the successive subsections; - generating the first data stream (B) from the first useful signal; Transmitting the first data stream (B, C) over a network ( 23 . 24 ); Receiving the first data stream (D, E) from the network ( 23 . 24 ). Method according to one of claims 4 or 5, wherein the step deriving an identification feature (L) at least one the following steps include: - Generate coefficients the first subsection, which is for a long term prediction are suitable; - generating coefficients from the first subsection, which is for a Linear Predictive Coding are suitable; - Produce of frequency information derived from a content of the first subsection are derived; - Produce HASH sequences from the first section; - Produce a checksum from the first section; - Generate a coded Part of the first section. Method according to one of claims 1 to 6, wherein the useful portion (W, J, M) of the second data stream at least two subsections and a subsection (Y) of the at least two subsections the first identifier is assigned, and the output the first subsection (G) of the first data stream and the subsection (Y) of the second data stream is timed to each other. Method according to one of claims 1 to 7, wherein the step receiving the second data stream comprises the steps of: - Provide from a second useful signal (J, M); - Provide at least a first identification feature (L); - Generating the second data stream (N, O, P) by assigning the at least one first identification feature (L) to the second useful signal (M); - Transferring the second data stream. The method of claim 8, wherein the step of Providing the second useful signal (J, M), a decomposition of the second Usage signal (J, M) in at least two consecutive sections comprises and in the step of generating the second data stream (N, P) at least one first identification feature (L) one of the successive the following sections of the second useful signal (J, M) assigned becomes. Method according to one of claims 1 to 9, wherein the step receiving the second data stream comprises the steps of: - Disassemble of the second data stream (P) into the second useful signal (R) and in the first identification feature (L); - Delay or cache the second useful signals. The method of claim 9, wherein the step of Issuing the second data stream, the outputting of the cached second useful signals timed to output of the first subsection. Method according to one of claims 1 to 11, wherein the first Data stream (B, E) comprises at least one of the following useful signals (A): - analog Audio signals; - digital Audio data or digital audio signals - encoded audio signals; - μ-law coded Audio data or μ-law encoded audio signals - GSM EFR encoded audio data or GSM EFR encoded audio signals; - PCM coded Audio data or PCM encoded audio signals; - AMR encoded audio data or AMR encoded audio signals; - AMR-WB encoded audio data or AMR encoded audio signals; - G.729 encoded audio data or G.729 encoded audio signals; - encoded audio data or coded audio signals according to one of the G.72x procedures of the ITU-T standard for the Voice compression. The method of claim 12, wherein the first identification feature (L) one of the useful signals of the first data stream or the useful signal of the first data stream. The method of claim 13, wherein the output of the first subsection with a faultless presence of the Identification feature is suppressed in the second data stream. Method according to one of claims 1 to 14, wherein the step outputting the first and / or second data stream, the step converting the first and / or second data stream into a speech signal or an audio signal and / or a video signal. Method according to one of Claims 1 to 15, in which the second data stream (N, P) comprises at least one of the following useful signals (J, R): a video signal, in particular in the MPEG, MPEG2, H.26x format, pictures or image data, especially in jpeg format; - data for a computer-assisted slide show; - audio data or audio signals; - time-based text, scrolling text. Method according to one of claims 1 to 16, wherein a transmission the first and / or second data stream at least partially by transmission of signals according to a mobile communication standard. Method according to one of claims 1 to 17, wherein a transmission of the first and / or second data stream at least partially by an Internet connection ( 22 ) between at least two nodes. Method according to one of claims 1 to 18, wherein a transmission of the first and / or second data stream (B, N) at least partially by a wired communication link ( 22 ) he follows. Method according to one of claims 1 to 19, wherein a transmission of the first and / or second data stream (B, N) at least partially via a circuit-switched communication link (B, N). 23 ) he follows. Method for transmitting a first data stream, the has at least two successive sections and a second data stream, comprising the steps: - To capture a first useful signal (A) and a second useful signal (J, M); - Determine at least one identification feature (L) from the first useful signal (A), which allows identification of the first useful signal; - Assign the at least one identification feature (L) to the second Useful signal (J, M); - Produce of the first data stream (B) from the first useful signal and generating of the second data stream (N) from the second useful signal (M, J) and the at least one identification feature (L). Method according to claim 21, characterized that the first data stream (B) and the second data stream (N) respectively with a plurality or multiplicity of successive subsections, if necessary Data frames are generated, with several or all subsections of the second data stream on a respective associated subsection of the first data stream, contained in the second data stream Identification is assigned. A method according to claim 21 or 22, wherein the Step of assigning the steps includes: - Provide a time stamp (K) with a unique time information; - Assign the time stamp (K) to the identification feature (L) and a Section of the second useful signal (J, M). A method according to any one of claims 21 to 23, wherein the Step of detecting the first wanted signal (A) and the second one Useful signal (J) comprises at least one of the following steps: - To capture a speech signal; - To capture an audio signal; - To capture a video signal; - Coding an audio signal, a speech signal, or a video signal; - To capture a computer aided Slide Show; - To capture of running text; - Disassemble the detected useful signal in sections. Method according to one of claims 21 to 24, wherein the Step of determining at least one identification feature at least one of the following steps: - Produce an encoded signal from the detected first payload signal; - Produce of coefficients from the detected first useful signal or from subsections the first payload based on long term prediction; - Produce of coefficients from the detected first useful signal or from subsections the first payload based on Linear Predictive Coding; - Produce of frequency information from a content of the first useful signal or from a content of subsections of the first useful signal; - Produce of HASH sequences from the first payload or from subsections the first useful signal; - Produce of checksums from the first useful signal or from subsections of the first useful signal. Method for transmitting a first and a second data stream from a transmitter to a receiver, comprising the steps: - establishing a first communication connection between transmitters ( 1 ) and receiver ( 3 ) for transmitting the first data stream; - transmitting the first data stream (B) over the first communication link to the receiver ( 3 ); - Generating a second data stream (N) with a useful signal (M), wherein the second data stream (N) from the first data stream derived identification features (L), which are associated with the useful signal (M) of the second data stream (N); - transmitting the second data stream via a second communication link to the receiver; Receiving the first and receiving the second data stream (E, P); - Determining the identification features in the second Data stream; - Timed mutually outputting the first data stream and the useful signals in dependence of the determined identification features. Method according to claim 26, characterized in that that the first data stream (B) and the second data stream (N) respectively with a plurality or multiplicity of successive subsections, if necessary Data frames, transferred be, with several or all sections of the second data stream on to a respective associated subsection of the first data stream referring, contained in the second data stream identification feature assigned. A method according to claim 26 or 27, wherein the Step of transferring the first data stream comprises the step: - To capture a first useful signal (A); - Disassembly of the first useful signal in subsections and - Determine at least one first identification feature (L) for identification a first subsection of the first useful signal (A); - Produce of the first data stream from the subsections. The method of claim 28, wherein the step generating the first data stream (B) or the step of detecting from a first useful signal (A) comprises the step of coding after at least one of the following methods: - GSM EFR; - AMR; - AMR-WB; - G.729; - G.72x according to the ITU-T standard; - μ-law. A method according to any one of claims 26 to 29, wherein the Step of generating a second data stream comprising the steps: - To capture from a second useful signal (J) having a plurality of subsections; - Produce a second data stream (N) from the second useful signal (J, M) and the identification features derived from the first data stream (L), wherein each subsection of the second data stream one of derived from the first data stream identification features for a later time coordinated output is assigned. A method according to any one of claims 26 to 30, wherein the Step of timing out the steps includes: - Determine identification features of the first data stream; - To compare the identified identification features of the first data stream with the identification features of the second data stream; - Output the first data stream and the identification features associated Useful signals of the second data stream depending on the comparison. Method according to one of claims 26 to 31, wherein the Step of receiving the first data stream the step one Caching the first data stream includes. Method according to one of claims 26 to 32, wherein in the Steps of transferring the first communication connection and the second communication connection at least partially comprise a shared signal path. A method according to any one of claims 26 to 33, wherein the Step of establishing a communication connection in addition to the Step of a transfer a third data stream for communication between transmitter and receiver time before transferring of the first data stream. Method according to one of claims 26 to 34, wherein the first data stream comprises at least one of the following useful signals: - analog Audio data or audio signals; - μ-law encoded audio data or Audio signals - GSM EFR encoded audio data or audio signals; - AMR or AMR-WB encoded Audio data or audio signals; - G.729 encoded audio data or audio signals; - coded Audio data or audio signals according to one of the G.72x methods of ITU-T standards for the voice compression; - Fax data. The method of claim 35, wherein the identification feature in the second data stream comprises the useful signal of the first data stream. The method of claim 36, wherein the output the first data stream in the presence of the identification features suppressed in the second data stream becomes. A method according to any one of claims 26 to 37, wherein the Step of outputting the first and / or second data stream Step of converting the first and / or second data stream into Audio signals and / or video signals. Method according to one of Claims 26 to 38, in which the second data stream comprises at least one of the following useful signals: - video data, in particular in MPEG, MPEG2, H.26x format - image data, in particular in jpeg format; - data for a computer-aided Bildschirmprä presentation; - audio data or audio signals. Method according to one of claims 26 to 39, wherein a transmission of the first and / or second data stream at least partially by: - a transmission of signals according to a mobile communication standard; - an internet connection between at least two nodes or - A wired communication connection takes place. Transmission device comprising: - a first device ( 151 ) for detecting a first useful signal; A second device ( 15 . 151 ) for detecting a second useful signal; An analysis device ( 12 . 12a . 110 ), which is designed to determine and provide at least one identification feature (L) for identifying the first or the respective subsection from a first subsection or subsections of the first useful signal; A coding device ( 11 . 11a . 110 ) carried out by the analysis device ( 12 . 12a ) to assign provided identification feature or a respective identification feature a first subsection or a respective subsection of the second useful signal; A first transmission stage ( 13 ) for transmitting the first useful signal; - A second transmission stage for transmitting the second useful signal. Transmission arrangement according to Claim 41, in which the first and second devices ( 131 . 15 . 151 ) for substantially simultaneously detecting the first and second payloads. Transmission arrangement according to one of Claims 41 to 42, in which the analysis device ( 12 . 12a ) for generating identification features, which has at least one of the following features of the first subsection of the first useful signal: Long term prediction coefficients; - coefficients derived from a linear predictive coding; A frequency information of a content of the first subsection; A HASH sequence; - a checksum of the first subsection. Transmission arrangement according to one of Claims 41 to 43, in which the coding device ( 11a ) a synchronization device ( 17 ) comprises for an assignment of the provided identification feature to a subsection of the second useful signal, which has a predetermined time relationship to the first subsection of the first useful signal, in particular to the first subsection is temporally synchronous. Transmission arrangement according to one of Claims 41 to 44, in which the first transmission stage for transmission on a first transmission channel ( 23 ) and the second transmission stage for transmission on a second transmission channel ( 22 ) is executed. Transmission arrangement according to claim 45, wherein the first and the second transmission stage form the same transmission stage and / or the first transmission channel and the second transmission channel the same transmission channel is. Transmission arrangement according to one of Claims 41 to 46, in which the first device ( 13 . 131 ) for capturing audio data and / or audio signals. Transmission arrangement according to one of Claims 41 to 47, in which the first device ( 13 . 131 ) is carried out for coding the first useful signal with at least one of the following coding types: a coding according to μ-law of a speech or audio signal; A coding according to GSM EFR of a voice or audio signal; A coding according to AMR of a voice or audio signal; A coding according to PCM of a voice or audio signal; A coding according to AMR or AMR-WB of a voice or audio signal; A coding according to G.729 of a voice or audio signal; A G.72x coding according to the ITU-T standard for voice compression. Transmission arrangement according to one of Claims 41 to 48, in which the second device ( 15 ) for detecting at least one of the following signals: - audio signals; - video signals; - data-based presentations; - Images; - text. Transmission arrangement according to one of Claims 41 to 49, in which the second device ( 15 ) or the coding device ( 11 . 11a ) for coding the first useful signal with at least one of the following coding types: H.26x coding of video signals; - MPEG or MPEG2 encoding of video signals. Receiving arrangement for the synchronization of first and second payloads, wherein in two ten useful signal identification features are stored, which are derived from subsections of the first useful signal, the receiving arrangement comprising: - a device ( 31 . 32 ) for the controlled delivery of the first useful signal; An analysis device which is designed to provide an identification feature for identifying a first subsection from the received first useful signal; - a synchronizer ( 34 . 34a ) for synchronizing an output of the first and second useful signal on the basis of a comparison of the identification features stored in the second useful signal with those of the analysis device ( 36 . 36a ) provided identification features. A receive device according to claim 51, further comprising: - one second buffer for storing the second useful signal. Receiving arrangement according to one of Claims 51 to 52, in which the first device ( 32 ) is executed to a buffering of the first useful signal. Receiving arrangement according to one of claims 51 to 53, in which the first device to a time-scaled change executed the first useful signal is. Receiving arrangement according to one of claims 51 to 54, in which the synchronizer has a comparison device, configured to deliver a control signal to a synchronization device in response to a comparison of the stored in the second payload signal Identification features with those provided by the analyzer Identification features, the synchronization device with the first device coupled to control the delivery of the first Useful signal. A receiving arrangement according to claim 55, wherein said Comparator for analysis of similarity or correlation between the identification features stored in the second useful signal and provided identification features. Receiving arrangement according to one of claims 51 to 56, further comprising: - a first decoding device ( 31 ), which is connected on the output side to the first intermediate memory and is designed to generate the first useful signal from a first signal received by the receiving device; A second decoding device ( 33 ), which is designed to generate the second useful signal from a second signal received by the receiving device. A receiving arrangement according to claim 57, wherein the Reception arrangement for a reception of the first signal and the second signal in one common transmission channel accomplished is. A receiving arrangement according to claim 57, wherein the second decoding device for a removal of the second useful signal stored identification features is executed. Receiving arrangement according to one of claims 51 to 59, wherein the first subsection of the first useful signal at least one of the following signals comprises: An analog audio signal; - a GSM EFR encoded audio signal; An AMR encoded audio signal; - a PCM encoded audio signal; - one AMR or AMR-WB encoded audio signal; A G.729 coded audio signal - an encoded Audio signal according to one of the G.72x methods of the ITU-T standard for voice compression; - mu-law encoded audio signal. Receiving arrangement according to one of claims 51 to 60, in which the analysis device for providing the identification feature accomplished are one of the following features of the first subsection of the first useful signal comprises: - Long term prediction coefficients; - from a Linear predictive coding derived coefficients; - a frequency information a content of the first subsection; A HASH sequence; - a checksum of first subsection. System comprising a transmitting arrangement and a receiving arrangement, - in which the transmission arrangement for a delivery of a first useful signal and a second useful signal is formed, wherein the second useful signal identification features which are derived from the first useful signal; - in which the transmission arrangement for transmission the first and second payload signals are applied to the receiving device; - in which the receiving arrangement for determining identification features executed from the first useful signal is; - at the receiving arrangement to a synchronous output from the first and second payload signals derived by a comparison of the identified identification features with the formed in the second useful signal identification features is. The system of claim 62, wherein the over transmission of the first and second useful signal is at least partially via a common transmission channel. A system according to any one of claims 62 to 63, wherein the transmission of one of the first and second payload signals is at least in part via a fixed network connection ( 23 ) or an internet connection ( 22 ) between at least two communication devices. A system according to any one of claims 62 to 64, wherein the Reception arrangement for a temporally synchronous output of an audio signal and a video signal is. Method for synchronizing multiple data streams, the in each case a plurality of successive subsections, if necessary Data frames, wherein at least a second (N; P) of the Data streams in Assignment to subsections of the second data stream to subsections at least a first (B; E) of the data streams referring identification features (U; LPC, LSP; par_0 *, par_1 *) and identifiers associated with each other sections of the data streams are determined to the streams to synchronize. Method according to Claim 66, characterized that for the assignment of a respective subsection of the first data stream (B; E) to a respective subsection of the second data stream (N; P) several, to different sections of the first data stream referring identification features are taken into account. A method according to claim 66 or 67, characterized that for a respective subsection of the first data stream (B; E) Set of several identification features referring to this subsection (U; LPC, LSP; par_0 *, par_1 *) in the second data stream (N; P) is and in the determination of mutually associated subsections the data streams considered becomes. Method according to one of Claims 66 to 68, characterized that at subsections of the first data stream (B; E) at least an identification feature, possibly a set of identification features (U; LPC, LSP; par_0, par_1), and with in the second data stream containing identification features (LPC, LSP, par_0 *, par_1 *) or Identification feature sets is compared. Method according to claim 69, characterized that the comparison is made by applying at least one comparison criterion, if necessary a distance criterion (DM), takes place, preferably under determination at least one measure of comparison from the comparison criterion or at least one distance measure (e (i, k)) from the distance criterion in one of the identification features containing abstract feature space. Method according to claim 70, characterized in that that by multiple application of the comparison criterion (DM) between on the one hand one for a sub-point subsection of the first data stream (B; E) determined Identification feature (U) or identification feature set (LPC, LSP; par_0, par_1) and on the other hand several, to different sections of the first data stream, with the second data stream (N; P) transmitted Identification features or identification feature sets (U; LPC, LSP; par_0 *, par_1 *) several on the one hand on the / the identification feature (U) or identification feature set (LPC, LSP, par_0, par_1) of the Point subsection and on the other hand to a certain in the second data stream contained / contained identification feature Identification feature set (U, LPC, LSP, par_0 *, par_1 *) Comparative measurements (e (i, k)) are determined, each of which is the sub-point subsection and associated with a particular subsection of the second data stream are and / or a subsection distance (k) between the subsection section and the particular subsection of the second data stream. Method according to claim 70 or 71, characterized that by multiple application of the comparison criterion (DM) between, on the one hand, an assignment to a sub-point subsection of the second data stream (N; P) in this contained identification feature (U) or identification feature set (LPC, LSP, par_0 *, par_1 *) and on the other hand several, for determined different sections of the first data stream (B; E) Identification features (U) or identification feature sets (LPC, LSP; par_0, par_1) several on the one hand on the / the sub-section assigned identification feature or identification feature set (LPC, LSP, par_0 *, par_1 *) and on the other hand on a one for one determined portion of the first data stream determined / determined Identification feature (U) or identification feature set (LPC, LSP; par_0, par_1) are determined (e (i, k)), each of the Aufpunkt subsection and a particular section associated with the first data stream and / or a sub-segment spacing (k) between the point-of-section section and the particular section of the first data stream. A method according to claim 71 or 72, characterized in that on the basis of the determined comparative measures (e (i, k)), possibly by determining a minimum or maximum comparison measure, associated with each other sections of the first and second data streams are determined. Method according to one of Claims 71 to 73, characterized on the basis of the determined comparative measures (e (i, k)), if necessary by determination a minimum or maximum comparative measure, a synchronization measure, if necessary a shift distance corresponding to a partial distance, it averages which is at least one subsection or subsections of the first data stream (B; E) of at least one subsection or subsections of the second data stream (N; P) in pairs. Method according to one of Claims 71 to 74, characterized that for several different subsections of the first or second data stream in each case by repeated use of the comparison criterion (DM) several sets of comparative measures (e (i, k)). Method according to claim 75, characterized that comparison dimensions (e (i, i) assigned to an equal subsection distance (k) k)) of sentences of comparative measures to a respective combination comparative measure (E (k)) become. Method according to claim 76, characterized in that on the basis of the determined combination comparison measures (E (k)), possibly by determining a minimum or maximum combination-Vergleichmaßes, each other associated subsections of the first and second data streams be determined. Method according to claim 76 or 77, characterized that on the basis of the determined combination comparison measures (E (k)), if necessary by determination a minimum or maximum combination measure Synchronisationsmaß, if necessary, a shift distance (k) corresponding to a partial distance is determined which is at least one subsection or subsections of the first data stream (B; E) at least one subsection or Subsections of the second data stream (N; P) in pairs assigns. Method according to one of claims 76 to 78, characterized that the respective combination comparison measure (E (k)) of an optional scaled sum or if desired scaled product or another math combination from the same subdivision distance associated comparison measures (e (i, k)) corresponds to a respective incoming comparative measure at least increases monotonically or at least monotonically decreases. Method according to one of Claims 76 to 79, characterized that the combination comparison measures (E (k)) from an initial sentence of combination comparative measures or a set of comparative measures (e (i, k)) iteratively by successive consideration of further subsections the first data stream (B; E) or / and the second data stream (N; P) or by consideration other sentences from Comparative measurements (e (i, k)) are determined. Method according to one of Claims 71 to 80, characterized that a respective set of comparative measures (e (i, k)) by consideration further sections of the first and second data stream to further Comparative measurements (e (i, k)) added becomes. Method according to one of claims 66 to 81, characterized that media streams be synchronized. Method according to claim 82, characterized in that in that at least a first data stream (B; E) comprising an audio data stream or speech data stream (B; E) with at least one second data stream (N; P) comprising at least one further audio data stream or Voice data stream and / or include at least one video data stream (B; E) is synchronized. The method of claim 83, wherein the first data stream (B; E) is a codec coded data stream, with one on one Codec based coder output parameters (LPC, LSP, P, G, aG) or data is recorded in the first data stream, to a reconstruction of the first data stream underlying Audio or voice information by decoding the first data stream to enable and at least partially (LPC, LSP) into the second data stream (N; P) to synchronize the first with the enable second data stream Method according to claim 84, characterized in that that the codec a on a prediction analysis, preferably linear prediction analysis, the underlying audio or speech information based codec is, in particular a LP or Linear Predictive Coding Codec or a CELP or Code Excited Linear Predictive Coding Codec. A method according to claim 85, characterized that the codec is a speech codec and is based on a language model. Method according to one of Claims 83 to 86, characterized in that the second data stream (N; P) is a codec-coded data stream, where wherein parameters or data output by a codec-based encoder are included in the second data stream to enable reconstruction of the second data stream of underlying audio or speech information by decoding the second data stream. Method according to claim 84 and claim 87, characterized in that the first (B; E) and the second (N; P) data stream can be synchronized directly or directly by synchronization is performed on these data streams themselves. Method according to claim 84 and claim 87, characterized in that the first (B; E) and the second (N; P) data stream can be synchronized indirectly or indirectly by by decoding or recoding the first and second data streams obtained sequence data streams (F, W) are synchronized. Method according to one of Claims 66 to 89, characterized in that the first data stream (B; E) and the second data stream (N; P) are determined by a first entity (B; 1 ) and to a second instance ( 3 ), and that the first and the second data stream are transmitted by the second instance ( 3 ) or an intermediate instance mediating the transmission between the first and the second instance, wherein in the case of the intermediate entity this combines the first and the second data stream, if desired, to a combined data stream and transmits it to the second entity, preferably instead of the first and the second data stream , A method according to claim 90, characterized in that in a communication environment, possibly mobile telecommunications environment, at least a first user terminal or the first instance ( 1 ) and at least one second user terminal the or a second instance ( 2 ). Method according to claim 91, characterized that at least one infrastructure device of the communication environment which forms an intermediate instance. Method according to claim 91 or 92, characterized in that in the case of a bidirectional or multidirectional communication the first user terminal at the same time with respect to at least one further first data stream and at least one further second data stream also a second entity ( 3 ) and the second user terminal in relation to the further first data stream and the further second data stream at the same time also a first instance ( 1 ). Method according to one of claims 90 to 93, characterized in that the first and the second data stream or the further first and the further second data stream via different transmission channels ( 23 . 22 ) and / or transmitted between the entities based on different transmission standards. A method according to claim 94, characterized in that one of the first and second data stream or one of the further first or second data stream via a circuit or circuit-switched connection ( 23 . 24 ), preferably at least partially by radio according to a mobile telephony standard, and the other from the first and second data stream or from the further first or second data stream via a packet-switched connection ( 22 ), preferably according to a network or Internet transmission standard. Method according to Claim 95, characterized in that the first or the further first data stream (B; E) is transmitted via the circuit or circuit-switched connection (B; 23 . 24 ) and the second or the further second data stream (N; P) via the packet-switched connection ( 22 ) is transmitted. Method according to one of Claims 94 to 96, characterized that one of the first and second data stream and one of the other first or second data stream the other from the first and second data stream and from the other first or second data stream is delayed during transmission, possibly with variable, time-varying delay time. Method according to one of Claims 90 to 97, characterized that first the generation and transmission the first or further first data stream (B; E) is used and later then the generation and transmission of the second or further second data stream (N; P) and then the Synchronization of the data streams starts. Method according to one of claims 66 to 98, carried out in connection with the implementation of the method according to at least one of claims 1 to 40 or as a partial method the method according to at least one of claims 1 to 40. A method according to any one of claims 66 to 99, comprising at least one of the claims 1 to 40 resulting further process features. System for carrying out the method according to one of Claims 66 to 100, having at least one first system component ( 1 ), which is designed to generate the first data stream (B; E) and the second data stream (N; P) and to a second system component ( 3 ), wherein the second system component or at least one intermediate component of the system conveying the transmission between the first and the second system component is designed to synchronize the first and the second data stream. System according to claim 101, characterized in that the system is a communication system, possibly a mobile telecommunications system, or comprises a mobile telecommunications system, wherein at least a first user terminal or the first system component ( 1 ) and at least one second user terminal the or a second system component ( 3 ). System according to claim 102, characterized that at least one infrastructure device of the communication system which forms or an intermediate component. System according to claim 102 or 103, characterized in that it is designed for bidirectional or multidirectional communication, the first user terminal also having a second system component with respect to at least one further first data stream and at least one further second data stream ( 3 ) and the second user terminal in relation to the further first data stream and the further second data stream at the same time also a first system component ( 1 ). A system according to any one of claims 101 to 104, comprising at least one of claims 41 to 65 resulting device features. User terminal, possibly a mobile telephone, for a system according to one of claims 101 to 105, wherein the user terminal ( 1 in carrying out the method according to any one of claims 66 to 100, generating the first and the second data stream (N; P), in particular on the basis of inputted audio or voice information and video information, and send the data streams, if necessary via different communication channels ( 23 . 22 ) or based on various transmission standards, or / and wherein the user terminal ( 3 ) is designed to receive and to synchronize the first (B; E) and second (N; P) data stream or the further first and further second data stream when carrying out the method according to one of Claims 66 to 100, in particular for one temporally synchronous output by means of the data streams of transmitted audio or voice information and video information. User terminal according to claim 106, comprising a transmission arrangement according to one of claims 41 to 50 or / and comprising a receiving arrangement according to one of claims 51 to 61. A system according to any of claims 101 to 105, comprising a plurality of user terminals according to claim 106 or 107 as a first system component ( 1 ) and / or as a second system component ( 3 ).