DE202020107433U1 - Video conferencing system and computer program product - Google Patents

Abstract

Video conference system designed for bidirectional transmission of video and audio signals using streaming technology between at least three endpoints (EP1-EP3), each of which has a transmitting device and / or a receiving device (SE) for audio streams (AS1, AS2, AS2 ") and / or for Video streams (VS1, VS2, VS2 ") comprising:
i. at least one first end point (EP1) with at least one transmission device (SE) for audio streams and preferably also with a transmission device (SE) for video streams;
ii. at least one second end point (EP2) with a receiving device (SE) for audio streams;
iii. at least one third end point (EP3) with at least one transmitting device (SE) for audio streams and one receiving device (SE) for audio streams; in which
a) the first end point (EP1) with the second end point (EP2) and the third end point (EP3) is connected to a first audio stream (AS1) by means of the transmission device (SE) for audio streams to the second end point (EP2) and the third To transmit the end point (EP3) and in order, preferably parallel to the first audio stream (AS1), also to transmit a first video stream (VS1) by means of the transmission device (SE) for video streams at least to the second end point (EP2);
b) the second end point (EP2) has a request device, preferably a graphical user interface (UI), and is connected to the third end point (EP3) in order to selectively transmit a second audio stream (AS2) by means of a request signal ( AF) to request at the third end point (EP3) and to receive by means of the receiving device (SE) from the third end point (EP3) which second audio stream (AS2) is derived from the first audio stream (AS1);
c) the third end point (EP3) is designed to receive the first audio stream (AS1) from the first end point (EP1) and the request signal (AF) from the second end point (EP2) and as a function of the request signal (AF) to generate the second audio stream (AS2) and to transmit it to the second end point (EP2).

Description

The invention relates to a video conference system which is designed for the bidirectional transmission of video and audio signals by means of streaming technology between at least three end points, each of which has a transmitting device and / or a receiving device for audio streams and / or for video streams, according to claim 1.

The invention also relates to a computer program product with program instructions stored or storable on a physical data carrier according to claim 13.

Video conference systems of the type mentioned and associated transmission methods are known; They are enjoying increasing popularity, especially due to the restrictions in everyday and professional life in the wake of the corona epidemic.

In particular, when such video conference systems are used in the educational sector, it regularly happens that individual participants in a video conference cannot easily follow an instructor, speaker or presenter because they do not understand his language or do not understand it sufficiently. There is consequently a need for a video conference system or a method for transmitting information which makes it possible in a simple manner to provide (simultaneous) translations of a transmitted audio stream in a simple and flexible manner in order to enable an increased number of users to participate in video conferences .

This object is achieved according to the invention by a video conference system with the features of claim 1 and by a computer program product with the features of claim 13.

Advantageous developments of the subject matter of the invention are defined in the respective subclaims and are hereby explicitly included in the description by reference.

1. i) wenigstens einen ersten Endpunkt mit zumindest einer Sendeeinrichtung für Audioströme und vorzugsweise auch mit einer Sendeeinrichtung für Videoströme;
2. ii) wenigstens einen zweiten Endpunkt mit zumindest einer Empfangseinrichtung für Audioströme;
3. iii) wenigstens einen dritten Endpunkt mit zumindest einer Sendeeinrichtung für Audioströme und einer Empfangseinrichtung für Audioströme;

bei dem

1. a) der erste Endpunkt mit dem zweiten Endpunkt und dem dritten Endpunkt verbunden ist, um einen ersten Audiostrom mittels der Sendeeinrichtung für Audioströme zu dem zweiten Endpunkt und zu dem dritten Endpunkt zu übertragen und um vorzugsweise parallel zu dem ersten Audiostrom auch einen ersten Videostrom mittels der Sendeeinrichtung für Videoströme zumindest zu dem zweiten Endpunkt zu übertragen;
2. b) der zweite Endpunkt über eine Anforderungseinrichtung, vorzugsweise eine grafische Benutzerschnittstelle, verfügt und mit dem dritten Endpunkt verbunden ist, um selektiv einen zweiten Audiostrom mittels eines durch die Anforderungseinrichtung erzeugten oder erzeugbaren Anforderungssignals bei dem dritten Endpunkt anzufordern und mittels der Empfangseinrichtung von dem dritten Endpunkt zu empfangen, welcher zweite Audiostrom von dem ersten Audiostrom abgeleitet ist;
3. c) der dritte Endpunkt dazu ausgebildet ist, den ersten Audiostrom von dem ersten Endpunkt und das Anforderungssignal von dem zweiten Endpunkt zu empfangen und in Abhängigkeit von dem Anforderungssignal den zweiten Audiostrom zu erzeugen und zu dem zweiten Endpunkt zu übertragen.

A video conference system according to the invention is designed for the bidirectional transmission of video and audio signals by means of streaming technology between at least three end points, each of which has a transmitting device and / or a receiving device for audio streams and / or for video streams. The video conference system according to the invention comprises:

1. i) at least one first end point with at least one transmission device for audio streams and preferably also with a transmission device for video streams;
2. ii) at least one second end point with at least one receiving device for audio streams;
3. iii) at least one third end point with at least one transmitting device for audio streams and one receiving device for audio streams;

in which

1. a) the first end point is connected to the second end point and the third end point in order to transmit a first audio stream by means of the transmission device for audio streams to the second end point and to the third end point and to preferably also transmit a first video stream in parallel to the first audio stream by means of the Transmitting means for transmitting video streams at least to the second end point;
2. b) the second end point has a request device, preferably a graphical user interface, and is connected to the third end point in order to selectively request a second audio stream from the third end point by means of a request signal generated or generated by the request device and from the third end point by means of the receiving device receive which second audio stream is derived from the first audio stream;
3. c) the third endpoint is designed to receive the first audio stream from the first endpoint and the request signal from the second endpoint and to generate the second audio stream as a function of the request signal and to transmit it to the second endpoint.

1. a) ein erfindungsgemäßes Videokonferenzsystem zum bidirektionalen Übertragen von Video- und Audiosignalen ausgebildet und/oder
2. b) ein erfindungsgemäßes Verfahren zum Übertragen von Informationen zwischen den wenigstens drei Endpunkten ausgeführt wird.

A computer program product according to the invention comprises program information stored or storable on a physical data carrier, when it is executed on a computer system with at least three endpoints connected or connectable via communication channels, each having a transmitting device and / or a receiving device for audio streams and / or for video streams,

1. a) a video conference system according to the invention is designed and / or for the bidirectional transmission of video and audio signals
2. b) a method according to the invention for transmitting information between the at least three endpoints is carried out.

The computer program product according to the invention does not necessarily have to be in a form stored on a physical data carrier; it can also be made available as a download or in any other way in disembodied form. It is essential that a video conference system according to the invention is generated or a method according to the invention is carried out when the associated program information is executed.

When “end points” are mentioned in the description, these are usually computers, in particular and without limitation conventional desktop PCs, which function as end points of transmission channels in the video conference system, which is known to the person skilled in the art. Such endpoints regularly have transmitting devices and receiving devices in order to be able to receive audio and video streams from other participants in the video conference system and in turn to be able to send audio and video streams to other participants in the video conference system. This is also known per se to the person skilled in the art. The named end points do not have to be located at a common location, but can be connected to one another (wired and / or wireless) via a computer network, for example the worldwide Internet or an internal company intranet. You can also be in physically distant locations.

To generate the audio and video streams mentioned, the end points of a video conference system regularly include appropriate recording devices, such as cameras or microphones, which is also familiar to the person skilled in the art. The audio and video streams are output accordingly using devices suitable for this purpose, such as loudspeakers, headphones or screens (displays). This is also known per se to the person skilled in the art.

As a rule, each participant in the video conference system has his own end point, for example his own computer. This is designed to receive and output the aforementioned audio and video streams from other participants in the video conference system. In addition, each participant in the video conference system basically has the option of providing their own audio and video streams in the video conference system, which can then be output by other participants.

According to the invention, the video conference system initially comprises at least one first end point which is designed at least to send audio streams. This first end point can be the end point of an instructor or presenter who makes a corresponding presentation audio stream (first audio stream) available in the video conference system. There is preferably a corresponding (first) video stream in parallel, which is also provided in the video conference system.

The second end point regularly belongs to a “normal” participant in the video conference system, for example a student who wants to consume at least the first audio stream. Correspondingly, the second end point is equipped with at least one receiving device for audio streams in order to be able to receive the first audio stream and to be able to reproduce it accordingly (via suitable output devices).

As part of a preferred use of the video conference system according to the invention, the third end point is assigned to a translator (interpreter) who should be able to receive an audio stream in a first language, generate an audio stream from it in another language and make it available in the video conference system. In addition to a receiving device for audio streams, the third end point accordingly also has a transmitting device for audio streams.

Furthermore, according to the invention, the first end point is now connected to the second end point and the third end point. The first end point generates the first audio stream and makes it available to the second end point and the third end point by means of the transmitting device. A first video stream can also be transmitted in parallel.

The second end point, ie the “normal” subscriber, has a request device that can be designed as a graphical user interface, with the help of which it can generate a so-called request signal and transmit it to the third end point in order to selectively add a second audio stream in this way request the third endpoint. This second audio stream is preferably a (simultaneous) translation of the first audio stream, which the user of the second end point then receives from the third end point. In the context of the present invention, however, it is sufficient if the second audio stream is derived from the first audio stream - it does not necessarily have to be a (simultaneous) translation of the first audio stream, although this represents a particularly preferred application of the present invention.

In principle, the invention can also be extended to video conference systems in which, in addition or as an alternative to the aforementioned first audio stream, a first video stream originating from the first end point is converted or translated into a second video stream upon request. Furthermore, there is basically the possibility of converting the first audio stream not into a further audio stream but into a video stream, for example in order to provide a corresponding translation to a hearing-impaired participant in sign language. This is also possible independently of the interpreter or translation function described above.

A preferred application of the invention provides - as already mentioned - that the second audio stream is a (simultaneous) translation of the first audio stream, which is transmitted to the second end point or to its user on request.

According to the invention, the third end point is designed to receive the first audio stream (and / or the first video stream) from the first end point and the request signal from the second end point and to generate and generate the second audio stream or the second video stream as a function of the request signal to the second endpoint. In this context, it is possible, but not absolutely necessary, for the second audio stream or the second video stream to be generated only after the request signal has been sent or received; it can already be generated beforehand, but is only made available or output at the second end point after the request signal has been sent or received.

The list i) to iii) of equipment features of the individual endpoints reproduced above only specifies those equipment features that are absolutely necessary in the context of a video conference system according to the invention or for carrying out the method according to the invention. As a rule, each of the endpoints will have identical equipment features, namely transmission and reception devices for audio streams as well as transmission and reception devices for video streams, as is known from conventional video conference systems, in which all participants can see and speak to one another.

A first development of the video conference system according to the invention now provides that the second end point is designed to receive the first audio stream and the second audio stream simultaneously by means of the receiving device and to output them simultaneously by means of a playback device. In this way, the second end point or the participant there is able to reproduce the second audio stream (translation) in parallel to the original audio stream (first audio stream), whereby the listening experience can be optimized because it is particularly possible in this way to capture nuances of the original in addition to the actual meaning of what has been heard.

Another development of the video conference system according to the invention provides that the second end point is designed to output the first audio stream and the second audio stream with different volume levels, preferably the first audio stream with a volume that is lower than that of the second audio stream, the first audio stream also being completely faded out can. In this way, there is the possibility for the participant at the second end point to concentrate predominantly or completely on the second audio stream in order, for example, to be able to optimally follow a presentation, even if he / she does not understand the original language. This volume setting is preferably carried out automatically when the second audio stream is received; however, in addition or as an alternative, there can also be a setting option for the user. If several first audio streams (several speakers) are present, it can be provided that all first audio streams are output with a volume that is lower than that of the second audio stream as long as the second audio stream is output.

In the course of yet another further development, the video conference system according to the invention can also be designed in relation to the third end point to only transmit the second audio stream to a second end point from which the request signal was previously received. In other words: only those participants who actively request the second audio stream will also receive it; all other participants, on the other hand, follow the first audio stream - especially if they understand the language of the first audio stream sufficiently well. In this way, the video conference system is not burdened with unnecessary transmissions, which can have a negative impact on the available bandwidth and the transmission quality.

Yet another development of the video conference system according to the invention provides that the second end point is designed to selectively cancel the second audio stream at the third end point by means of the request device by means of a termination signal generated or generated by the request device. Correspondingly, the third end point is designed to transmit the second audio stream only to a second end point from which no termination signal was previously received. In this way it is possible for a subscriber at any time to cancel a previously requested second audio stream if, in particular, it turns out that a translation is not required. In this way, seized bandwidths can be released again in order to improve the transmission quality in the video conference system if necessary.

Another further development of the video conference system according to the invention provides that there is a plurality of third endpoints which each provide different second audio streams. In relation to the application example mentioned at the beginning, there can be a plurality of third endpoints, each of which has a different translator as a user in order to be able to provide translations into different languages, which corresponds to the different second audio streams already mentioned. It may also be possible for interpreters to translate another interpreter's translation (relay interpreting). It is further provided that a specific second audio stream can be selectively requested through the second end point by sending the request signal to a specific third end point. If, for example, a first third endpoint provides an English translation while a second third endpoint provides a French translation, the second endpoint or the subscriber there can specifically request that second audio stream from the relevant third endpoint that corresponds to his or her linguistic preferences.

Yet another development of the video conference system according to the invention provides that at least the second end point additionally has a receiving device for video streams and at least the third end point also has a transmitting device for video streams, which transmitting device is set up to be parallel when receiving the request signal from the second end point to transmit the second audio stream, preferably a translation, also an associated second video stream to the second end point. In this way, it is possible for the participant at the second end point to see the participant at the third end point, in particular a translator, while he / she receives the second audio stream (the translation) from there. This preferably takes place in parallel with a reception of the first video stream, which can show a presenter from whom the first audio stream originates. The transmission of the second video stream preferably ends together with a termination of the transmission of the second audio stream. If the requested translation is a translation into sign language, only the second video stream may be transmitted (without the second audio stream).

In a further development of the video conference system according to the invention, it can also be provided that the second end point is set up to display a (still) image, preferably a symbolic image, before sending the request signal via the receiving device for video streams or a corresponding output device, which image is a property of the third Indicates end point and / or the second audio stream. So if, for example, the third endpoint is set up to provide a translation of the first audio stream into the French language, said image could represent a French flag or the Eiffel Tower so that a user at the second endpoint can easily see what type of second audio stream he is obtained by his request.

The third end point (the interpreter) preferably activates itself or is provided with a corresponding activation device, i.e. a corresponding control element. As soon as he is ready for the interpreting, he activates himself for the other participants (second endpoints) via the activation device and is then visible as a voice channel (in particular in the form of the above-mentioned (still) picture).

This can be shown in a display sidebar, for example, at a second end point (participant's desk). The participant in question can then switch to different voice channels or select appropriate audio streams; these are preferably displayed using typical symbols / flags of the respective nation (e.g. French - Eiffel Tower), as already mentioned above.

In the course of yet another further development, the video conference system according to the invention can provide that a number of second audio streams to be received at the second end point is limited, preferably to one (1). In this way, unnecessary use of bandwidth can be avoided because a user of the second endpoint will regularly not be able to follow more than one second audio stream at the same time. In this context, however, the invention is in no way necessarily restricted to the number one.

Furthermore, in a particular embodiment of the video conference system according to the invention, it can be provided that the third end point has a display device that displays a number of second end points from which the request signal was received and which receive the second audio stream at a given point in time. In the course of the application described above, the translator can for example recognize at the third end point how many participants (at second end points) are currently receiving the second audio stream (e.g. the requested translation). As soon as the number becomes zero (0), there is basically the possibility that the translator will stop translating at the third end point in order to conserve resources. In this context, there is also the possibility that a translator who can translate into several languages can use their Provides capacities on another voice channel, ie for generating another required second audio stream.

The indicated display device does not have to be restricted to the third end point, but can be available at all end points.

Yet another development of the video conference system according to the invention provides that a third end point is set up to recognize the receipt of a further request signal at a further third end point and to generate a further second audio stream as a function of the further request signal and to transmit it to that second end point. from which second end point the further request signal originated. This ties in with the facts already described above, according to which, in a video conference system described, a further second audio stream, i. H. for example, another translation into another language is required. If the third end point (the translator) is able to recognize the receipt of such a further request signal or, alternatively, the transmission of one, there is basically the possibility that he / she will receive a corresponding further second audio stream (an additional translation). provides.

In a further development of this idea, it can be provided that said further second audio stream (the additional translation) can only be generated when no second audio stream (the first translation) is being generated. In other words: A third end point (translator) that is already generating a second audio stream (a translation) cannot simply end it in order to optionally generate a further second audio stream (another translation). In principle, however, there is the possibility of canceling a second audio stream that has just been generated if there is an increased need for a further second audio stream and there are not enough resources available to generate both second audio streams.

Finally, a particularly preferred embodiment of the video conference system according to the invention provides that the second audio stream and / or the further second audio stream is a simultaneous translation of the first audio stream, preferably a human translation. This has already been pointed out repeatedly above when the preferred application of the video conference system according to the invention was mentioned. However, the invention is not limited to simultaneous translations and / or human translations, but specifically also includes machine translations.

Advantageously, the third end point can be equipped with a hearing protection device for the participant (interpreter) there. B. be equipped against feedback. In order to protect the participant from loud whistling tones or other loud and suddenly occurring acoustic signals, the hearing protection device is designed to automatically filter out volume peaks from an audio signal (audio stream) arriving at the third end point. In this way, for example, sudden hearing loss, impact trauma or other damage to the health of interpreters can be avoided.

• - Räuspertaste: Falls sich der Dolmetscher räuspern muss, kann er schnell die Übertragung seines Audiostroms unterbrechen.
• - Lautstärke-Schieberegler: Der Dolmetscher kann die Lautstärke des Keynote Speakers (Teilnehmer am ersten Endpunkt; erster Audiostrom) verändern. Bei einer Relaisverdolmetschung (Dolmetscher dolmetscht von der Verdolmetschung eines anderen Dolmetschers) kann entsprechend die Lautstärke der ersten Verdolmetschung reguliert werden.
• - Privater Sprachkanal zwischen zwei Dolmetschern: Mit einem Knopfdruck können sich zwei Dolmetscher (Teilnehmer an dritten Endpunkten) unterhalten, ohne dass die anderen Teilnehmer des Videokonferenzsystems dies hören.
• - Automatische Übergabe auf einen anderen Dolmetscher: Bevor ein Dolmetscher den virtuellen Raum (d. h. das Videokonferenzsystem) verlässt, kann er automatisch mit einem Knopfdruck an einen anderen Dolmetscher übergeben.
• - Der Dolmetscher kann den verwendeten Frequenzbereich - insbesondere für den bei ihm eintreffenden ersten Audiostrom - anpassen, damit er über seine eigene Stimme hinweg alles gut verstehen kann.

Furthermore, the third end point (the interpreter) can have the following operating devices or be appropriately equipped, for example in the form of an interpreter's desk in a display sidebar, with the following operating elements / functions that are not limited to the specific designs only given by way of example :

• - Clear throat button: If the interpreter has to clear his throat, he can quickly interrupt the transmission of his audio stream.
• - Volume slider: The interpreter can change the volume of the keynote speaker (participant at the first end point; first audio stream). In the case of relay interpreting (interpreter interprets from another interpreter's interpreter), the volume of the first interpretation can be adjusted accordingly.
• - Private voice channel between two interpreters: With the push of a button, two interpreters (participants at third endpoints) can talk to each other without the other participants in the video conference system hearing.
• - Automatic transfer to another interpreter: Before an interpreter leaves the virtual room (ie the video conference system), he can automatically transfer to another interpreter at the push of a button.
• - The interpreter can adapt the frequency range used - especially for the first audio stream that arrives at him - so that he can understand everything well beyond his own voice.

• 1 zeigt schematisch den Aufbau eines erfindungsgemäßen Videokonferenzsystems;
• 2 zeigt eine Verwendung des Videokonferenzsystems gemäß 1 zur Durchführung eines erfindungsgemäßen Verfahrens;
• 3 zeigt ebenfalls eine Verwendung des Videokonferenzsystems gemäß 1 zur Durchführung eines erfindungsgemäßen Verfahrens; und
• 4 zeigt eine mögliche Ausgestaltung einer Benutzeroberfläche im Rahmen eines erfindungsgemäßen Videokonferenzsystems.

Further properties and advantages of the invention emerge from the following description of exemplary embodiments with reference to the drawing.

• 1 shows schematically the structure of a video conference system according to the invention;
• 2 shows a use of the video conferencing system according to FIG 1 for carrying out a method according to the invention;
• 3rd also shows a use of the video conference system according to FIG 1 for carrying out a method according to the invention; and
• 4th shows a possible embodiment of a user interface in the context of a video conference system according to the invention.

Male and female forms of terms such as “participant” or “user” are used equally in the following. Both forms should always be included - even if not explicitly stated.

1 shows a video conference system according to the invention with a number of participants who are arranged at different end points of the video conference system. In principle, all endpoints of the video conference system can be designed or equipped to be technically equivalent; this is not shown in the figures - here the technical equipment shown for the individual end points is limited to the equipment required according to the invention or in the course of further developments.

For the technical design of the individual end points of the video conference system, the general part of the description has already been presented above.

According to 1 the video conference system initially comprises a first end point EP1 assigned to an instructor, presenter or, in general, to a VIP user. This is in 1 with the reference number B1 and a crown. There is a second end point accordingly EP2 a second user B2 and a third endpoint EP3 a third user B3 assigned. There can be further endpoints EPn exist, each of which corresponds to a user Bn can be assigned. In principle, the number of end points of the video conference system is unlimited within the scope of the technical possibilities.

The mentioned endpoints EP1 - EPn are on a computer network CN connected with each other. Preferably it is the computer network CN around the global Internet or an internal company intranet. In principle, however, the invention is not limited to a particular type of computer network CN limited.

The individual endpoints EP1 - EPn are able to use the computer network CN Exchange data streams, preferably audio streams (sound) and video streams (picture) in the context of the present invention. In order to be able to generate such data streams, all endpoints ( EP1 - EPn ) via a camera CA and a microphone MI . Furthermore, all endpoints have EP1 - EPn Via transmitting and receiving devices for the data streams mentioned, which is described in 1 at reference number SE is symbolized. These can, but do not have to be, wireless. At least the second end point EP2 and the third end point EP3 (as well as the other endpoints on a regular basis EPn ) also have suitable output / playback devices for received data streams, shown here in the form of a display DI for received video streams and a loudspeaker SP for received audio streams. Furthermore, have at least the second endpoint EP2 and the third end point EP3 Via a user interface Ul, which can be designed as a graphical user interface (GUI), as shown in particular in 1 is symbolized.

Reference symbol CP shows a data carrier and a corresponding reading device, which is intended to make it clear that corresponding program instructions (program code) that are required to set up the video conference system and its components or to carry out a method according to the invention with the aid of the video conference system shown are displayed can be stored or storable on a corresponding data carrier in order to equip (set up) the video conference system accordingly. In principle, however, it is not necessary for the program instructions mentioned to be available on a physical data carrier; alternatively or additionally, a download in a corresponding disembodied form is also possible, e.g. B. from the Internet.

It has already been pointed out that User B1 may be an instructor or presenter. In the context of a preferred application of the video conference system, it is the user B2 a “normal” participant, for example a trainee, who is giving a presentation by the presenter B1 want to follow. user B3 in this case is a translator, as in 1 is represented symbolically by means of the speech bubble. The distribution of roles and the associated processes will be discussed in more detail below.

For the other users or participants Bn In particular, it can be additional “normal” participants, corresponding to participants B2 or by further speakers according to participants B1 act. However, use cases are also described below, according to which the other participants or users are concerned Bn at least in part also to other translators according to users B3 can act.

In 2 is shown how the video conferencing system according to 1 can be used advantageously. This results in a method according to the invention for transmitting information, here in particular the audio and video streams mentioned, by means of streaming technology via communication channels, which communication channels are between the at least three endpoints EP1 to EP3 are trained.

The first endpoint EP1 is at least temporarily, advantageously permanently, during a presentation by the user B1 , with the second endpoint EP2 and the third end point EP3 connected via a corresponding communication channel. The first endpoint EP1 sends a first audio stream by means of the transmission device SE to the second endpoint EP2 and the third end point EP3 . This is in the figure using the reference number AS1 shown. The second endpoint EP2 and the third end point EP3 give the audio stream AS1 by means of their respective playback device SP out. The first end point sends in parallel EP1 also a first video stream VS1 by means of the transmitting device SE to the second endpoint EP2 and the third end point EP3 . This is in 2 symbolized by that on the display DI of the second endpoint EP2 and the display of the third endpoint EP3 a picture B1 'of the presenter B1 is shown. The transmission of the first audio stream AS1 and the first video stream VS1 takes place along the communication channels between the endpoints via the computer network CN , as in 2 is symbolized by dashed lines. Participants or users B2 and participants or users B3 can thus the user (presenter) B1 see and hear.

On the display DI by user B2 at the second endpoint EP2 is at reference number SB a symbol image for a second audio stream AS2 which of the participants or users B2 using a request signal AF at the third endpoint EP3 or the associated user B3 (Translator) can request. To this end, user takes action B2 through its user interface Ul a corresponding request or makes an associated input, whereupon endpoint EP2 the request signal AF to the end point EP3 sends. Either translator begins B3 after receiving the request signal AF thus, the requested second audio stream AS2 to generate (via the microphone MI ), whereupon the relevant endpoint EP3 the audio stream AS2 to the second endpoint EP2 transmits, which is then based on 3rd will be discussed in more detail. Alternatively, create user B3 from the beginning, that is, from the start of the presentation by the user B1 the second audio stream AS2 ; however, this is the user B2 only after request (request signal AF ) made available. In 2 are the request signal AF and the second audio stream AS2 marked by dash-dotted lines. The transmission takes place in turn along corresponding communication channels via the computer network CN .

The other users too Bn can from their endpoints EPn from a corresponding second audio stream AS2 by means of a request signal AF at the endpoint in question EP3 request what is in 2 is not shown. It goes without saying that further end points can also be used analogously to the third end point EP3 be present in the video conference system, the respective different second audio streams AS2 to spend (can). This would then be analogous to 2 through various symbol images SB on the display DI of the user B2 or the other users Bn displayed. By making the appropriate selection via the user interface Ul can the users concerned B2 , Bn the second audio stream required in each case AS2 select and request.

• Er bzw. sie empfängt weiterhin den ersten Audiostrom AS1 und den ersten Videostrom VS1 vom Präsentator B1 bzw. vom Endpunkt EP1. Eine entsprechende Ausgabe erfolgt über den Lautsprecher SP und das Display DI, wie bereits erläutert. Außerdem empfängt Benutzer B2 am Endpunkt EP2 den zweiten Audiostrom AS2 von dem dritten Endpunkt EP3. Gemäß der Darstellung in 3 erzeugt der dritte Endpunkt EP3 bzw. der dortige Benutzer (Übersetzer/in) B3 zusätzlich mithilfe seiner Kamera CA einen zweiten Videostrom VS2 und sendet diesen zusammen mit dem zweiten Audiostrom AS2 zu dem zweiten Endpunkt EP2. Endpunkt EP2 gibt über das Display DI zumindest sowohl den ersten Videostrom VS1 als auch den zweiten Videostrom VS2 aus, wie symbolisch dargestellt (Bezugszeichen B1', B3').

In 3rd is shown schematically what the user B2 at the second endpoint EP2 after processing the in 2 sees or hears the process steps shown:

• He or she continues to receive the first audio stream AS1 and the first video stream VS1 from the presenter B1 or from the end point EP1 . A corresponding output takes place via the loudspeaker SP and the display DI as already explained. Also receives user B2 at the end point EP2 the second audio stream AS2 from the third end point EP3 . As shown in 3rd creates the third endpoint EP3 or the user there (translator) B3 additionally with the help of his camera CA a second video stream VS2 and sends this together with the second audio stream AS2 to the second endpoint EP2 . End point EP2 gives over the display DI at least both the first video stream VS1 as well as the second video stream VS2 as shown symbolically (reference symbol B1 ' , B3 ' ).

On the display DI of the endpoint EP3 is next to the first video stream VS1 (Reference number B1 ' ) at the reference symbol AI, information relating to a number of those (second) endpoints that generate the second audio stream at the specified time is also displayed AS2 receive. In the present case, there are a number of further (second) endpoints EP2 ' who have favourited the second audio stream AS2 received as in 3rd based on the flag in question (cf. 2 ) is symbolized. In addition, there are a number of other (second) endpoints EP2 " that is another second audio stream AS2 " received by another (not shown) third end point analogous to end point EP3 originates. The transmission paths of the mentioned (further) second audio streams AS2 , AS2 " are in 3rd not shown in full for the sake of clarity.

The facts described are described in 3rd by another flag at the endpoints EP2 " symbolizes that for a different language and correspondingly for a different second audio stream AS2 " stands.

Although this is done in 3rd also not shown, receive the second endpoints EP2 ' , EP2 " continue the first audio stream AS1 and the first video stream VS1 from the end point EP1 . In addition, the second video stream VS2 from the third end point EP3 transferred as noted. In the case of the endpoints EP2 " that is another second audio stream AS2 " received, it is accordingly an associated further second video stream VS2 " .

Those endpoints EPn that have not requested a (further) second audio stream receive only the first audio stream in the conventional manner AS1 and the first video stream VS1 what in 3rd is not shown further for the sake of clarity.

It has already been pointed out that, in principle, all end points of the video conference system can be designed to be technically identical, which is not explicitly shown in the figures for reasons of clarity. In principle, however, nothing speaks against setting up the video conference system described with technically differently equipped endpoints, as long as the individual endpoints have the respective skills required to participate in the video conference system.

It has already been pointed out that in particular the endpoint EP2 both the first audio stream AS1 as well as the requested second audio stream AS2 receives. Preferably both audio streams AS1 , AS2 over the loudspeaker SP the playback device is output at the same time, although preferably the requested second audio stream AS2 is automatically output louder than the first audio stream AS1 . If necessary, the user can B2 this via the user interface Ul to adjust.

Referring again to FIG 2 it should also be noted that the user B2 at the end point EP2 analogous to the request for the second audio stream AS2 using the request signal AF also a termination signal BE at the third end point EP can send. After receiving such a termination signal BE the third end point stops EP3 the transmission of the second audio stream AS2 to the end point EP2 or a corresponding provision. The video conferencing system then returns to the in 2 (initial) state shown (with the symbol image displayed SB at the end point EP2 ). In such a case, the reference number is reduced AI according to 3rd at the end point EP3 displayed value around one (1). The third user B3 is therefore able to recognize at any time whether there are still participants B2 on the second audio stream AS2 are instructed and could possibly, with AI = 0, the generation of the second audio stream AS2 set (for example, to another audio stream AS2 " according to 3rd to generate, if he / she is able to do so).

The possible function of the U-ser interface (user interface) has not yet been discussed further. UI of the endpoint EP3 . Advantageously, said user interface enables UI it to the user (participant) B3 , in the application described here, the translator, a so-called speech channel, that is to say at least one type or property of the second audio stream generated by him / her AS2 or. AS2 " to select. In this way, one and the same user can B3 advantageously different second audio streams AS2 , AS2 'provide what can preferably not happen at the same time. So if, for example, the translator B3 based on the display at reference characters AI ( 3rd ) detects that the second audio stream AS2 is no longer needed, he / she can use a different (further) second audio stream if necessary AS2 " available and this via the user interface UI in the video conference system (so that, for example, the displayed icon images SB adjust accordingly, preferably automatically).

It has already been pointed out elsewhere that the video conference system described also works advantageously when the third end point EP3 instead of the second audio stream AS2 only a second video stream VS2 provides, for example, a translation of the first audio stream AS1 in a sign language. This is not explicitly shown in the figures, but expressly represents an advantageous alternative embodiment of the described invention.

4th finally shows a possible indication on the display DI (see. 1 to 3rd ) of a participant in a video conference conducted using the video conference system described above. According to the example in 4th there are again three participants present, based on the 1 to 3rd with the reference number B1 to B3 designated are. As the person skilled in the art can easily see, this is a simplification, since the functions described can of course also be transferred to larger numbers of participants.

In 4th the device with which the participant in question participates in the video conference is, without limitation, a notebook or laptop computer, based on the 1 to 3rd with the reference number EP (End point).

As above with reference to the 1 to 3rd has already been described, is each of the three participants B1 to B3 In the run-up to the video conference, a specific participant role has been assigned, which means that the associated functions are based on the 1 to 3rd has already been received in detail, have been activated. The respective role is indicated by a corresponding identification and description with reference symbols KB can be seen, which is the respective video image of the participant B1 to B3 superimposed.

In the example according to 4th has the participant B1 the role of the lecturer, the participants B3 has the role of interpreter and participant B2 would like to follow the lecture as a listener.

As soon as the lecturer B1 begins to speak, takes the interpreter B3 prefers to work and also begins to speak or translate. The lecturer generates accordingly B1 the first audio stream AS1 (see. 1 to 3rd ) while the interpreter B3 the associated second audio stream AS2 (see. 1 to 3rd ) generated. Due to the role assigned to the interpreter, its sound output is for the user B2 not audible at first, as the mentioned sound output is not required by every participant.

To the interpreter B3 to make audible, activates the respective listener B2 the interpreter's sound output via a context menu KM on its graphical user interface, so sends the request signal, as already described. The context menu KM superimposed according to 4th the interpreter's video image B3 . The context menu KM is triggered by a mouse click (or alternatively by touch, voice command or the like) and then shows a button SF to activate or deactivate the interpreter function. Functionally, this corresponds to the request signal or termination signal described in detail above. The context menu KM is also via a so-called user context BK together with a list of participants TL in a displayed sidebar or (display) sidebar SL retrievable.

As soon as the listener B2 has activated the interpreter function, the interpreter B3 originating audio stream AS2 (see. 1 to 3rd ) using the loudspeaker SP issued at the same time as that of the lecturer B1 originating audio stream AS1 (see. 1 to 3rd ) and, if necessary, with other audio streams that may come from other participants in the video conference. Thereby the volume of the sound output of all participants present, including the speaker B1 , towards the interpreter B3 significantly reduced and so by the sound output of the interpreter B3 superimposed. At the same time he receives EP also a video stream from the interpreter B3 (Video stream VS2 , see. 2 and 3rd ) and gives this together with the video image of the lecturer B1 (Video stream VS1 , see. 2 and 3rd ) out. There is also a video image of the user B2 as is well known from conventional video conferencing systems.

As already mentioned, other users of the category can also be B1 to be available. It is advantageous here that only when the request signal is deactivated AF the user B2 all speakers (users B1 ) hears at full volume again. As long as the request signal AF is activated, the interpreter is always advantageous B3 heard at full volume no matter who is speaking.

It has already been pointed out that several interpreters B3 can take part in a video conference at the same time, but per participant B2 advantageously only one interpreter at a time B3 can be activated.

Instead of a picture of the interpreter B3 a symbol can also be displayed initially, i.e. before the interpreter function is activated, as described in detail above; the picture of the interpreter B3 only appears when the interpreter function is activated or as long as it is active.

The interpreter B3 can be on its display DI get additional selection options displayed, in particular a number of current recipients of the audio stream generated by it and / or options for language selection, which has already been pointed out in detail above.

4th primarily affects the visible display or user interface at an endpoint EP of the video conference system described. For the structural design of the video conference system and the procedural processes within it, refer to the description above 1 to 3rd referenced. Especially the interpreter B3 has a hearing protection device, as has already been pointed out. This can be integrated into the relevant endpoint (not shown).

Especially the interpreter B3 can be shown on the display, e.g. B. in the sidebar, further controls BE1-BE6 available, which has already been referred to in the general part of the description.

BE1 denotes an activation device with the help of which the third endpoint (the interpreter) activates itself as soon as it is ready for interpreting.

BE2 is a clearing throat button with which the interpreter can quickly interrupt (mute) the transmission of his audio stream if he has to clear his throat.

BE3 designates a control element for the automatic opening of a private voice channel between two interpreters: With the push of a button, two interpreters (participants at third endpoints) can talk without the other participants in the video conference system hearing. According to 4th A corresponding button or the like can be provided for each additional interpreter.

BE4 denotes a control element for automatic transfer to another interpreter: Before an interpreter leaves the virtual room (ie the video conference system), he can automatically transfer it to another interpreter with the push of a button or the like. According to 4th A corresponding button or the like can be provided for each additional interpreter.

BE5 denotes a volume slider: the interpreter can adjust the volume of the keynote speaker (lecturer B1 , Participant at the first endpoint; first audio stream). In the case of relay interpreting (interpreter interprets from another interpreter's interpreter), the volume of the first interpretation can be regulated accordingly with the BE5 control element.

Finally, BE6 denotes another slider with which the interpreter can adjust the frequency range used - especially for the first audio stream arriving at him - so that he can understand everything well beyond his own voice.

The invention is particularly not with regard to the type and number of operating elements BE1-BE6 limited.

Claims (13)

Video conference system designed for bidirectional transmission of video and audio signals using streaming technology between at least three endpoints (EP1-EP3), each of which has a transmitting device and / or a receiving device (SE) for audio streams (AS1, AS2, AS2 ") and / or for Video streams (VS1, VS2, VS2 ") comprising: i. at least one first end point (EP1) with at least one transmission device (SE) for audio streams and preferably also with a transmission device (SE) for video streams; ii. at least one second end point (EP2) with a receiving device (SE) for audio streams; iii. at least one third end point (EP3) with at least one transmitting device (SE) for audio streams and one receiving device (SE) for audio streams; in which a) the first end point (EP1) with the second end point (EP2) and the third end point (EP3) is connected to a first audio stream (AS1) by means of the transmission device (SE) for audio streams to the second end point (EP2) and the third To transmit the end point (EP3) and in order, preferably parallel to the first audio stream (AS1), also to transmit a first video stream (VS1) by means of the transmission device (SE) for video streams at least to the second end point (EP2); b) the second end point (EP2) has a request device, preferably a graphical user interface (UI), and is connected to the third end point (EP3) in order to selectively transmit a second audio stream (AS2) by means of a request signal ( AF) to request at the third end point (EP3) and to receive by means of the receiving device (SE) from the third end point (EP3) which second audio stream (AS2) is derived from the first audio stream (AS1); c) the third end point (EP3) is designed to receive the first audio stream (AS1) from the first end point (EP1) and the request signal (AF) from the second end point (EP2) and depending on the request signal (AF) to generate the second audio stream (AS2) and to transmit it to the second end point (EP2). Video conferencing system Claim 1 , at which the second end point (EP2) is designed to receive the first audio stream (AS1) and the second audio stream (AS2) simultaneously by means of the receiving device (SE) and to output them simultaneously by means of a playback device (SP). Video conferencing system Claim 2 , at which the second end point (EP2) is designed to output the first audio stream (AS1) and the second audio stream (AS2) with different volumes, preferably the first audio stream (AS1) with a volume that is lower than that of the second audio stream (AS2). Video conferencing system according to one of the Claims 1 to 3rd , at which the third end point (EP3) is designed to transmit the second audio stream (AS2) only to a second end point (EP2) from which the request signal (AF) was received. Video conferencing system according to one of the Claims 1 to 4th , in which the second end point (EP2) is designed to selectively cancel the second audio stream (AS2) by means of the request device (UI) by means of a termination signal (BE) generated or generated by the request device (UI) at the third end point (EP3), and the third end point (EP3) is designed to transmit the second audio stream (AS2) only to a second end point (EP2) from which no termination signal (BE) has been received. Video conferencing system according to one of the Claims 1 to 5 , in which a plurality of third end points (EP3) are present, each of which provides different second audio streams (AS2, AS2 "), with a specific second audio stream (AS2, AS") being transmitted through the second end point (EP2) by sending out the request signal (AF) can be requested selectively at a specific third end point (EP3). Video conferencing system according to one of the Claims 1 to 6th , in which at least the second end point (EP2) additionally has a receiving device (SE) for video streams and at least the third end point (EP3) also has a transmitting device (SE) for video streams, which transmitting device (SE) is set up when receiving the Request signal (AF) from the second end point (EP2) to transmit a second video stream (VS2) to the second end point (EP2) in parallel with the second audio stream (AS2). Video conferencing system Claim 7 , at which the second end point (EP2) is set up, before sending the request signal (AF) via the receiving device (SE) for video streams, an image (SB), preferably a symbolic image, to display which image (SB) is a property of the third end point (EP3 ) and / or the second audio stream (AS2). Video conferencing system according to one of the Claims 1 to 8th , in which a number of second audio streams (AS2, AS2 ") to be received simultaneously at the second end point (EP2) is limited, preferably to one. Video conferencing system according to one of the Claims 1 to 9 , in which the third end point (EP3) has a display device (DI) which displays a number of second end points (EP2) from which the request signal (AF) was received and which receive the second audio stream (AS2) at a given point in time . Video conferencing system according to one of the Claims 1 to 10 , at which the third end point (EP3) is set up to recognize the receipt of a further request signal (AF) at a further third end point (EP3) and to generate a further second audio stream (AS2 ") as a function of the further request signal (AF) and to transmit to that second end point (EP2 ") from which second end point (EP2") the further request signal (AF) originated, preferably a given third end point (EP3) for generating only a second audio stream (AS2, AS2 ") a given time is formed and the further second audio stream (AS2 ") can most preferably only be generated when no second audio stream (AS2) is currently being generated. Video conferencing system according to one of the Claims 1 to 11 , in which the second audio stream (AS2) and / or the further second audio stream (AS2 ") according to Claim 11 is a simultaneous translation of the first audio stream (AS1), preferably a human translation. Computer program product (CP) with program information stored or storable on a physical data carrier, when it is executed on a computer system with at least three endpoints (EP1-EP3) connected or connectable via communication channels, each of which has a transmitting device (SE) and / or a receiving device (SE) for audio streams and / or for video streams, a) a video conference system for bidirectional transmission of video and audio signals according to one of the Claims 1 to 12th and / or b) a method for transmitting information between the at least three end points (EP1-EP3) according to one of the Claims 13 to 26 is executed.

Images