FR3074351A1 - METHOD AND DEVICE FOR MUSICAL INSERTION IN TELEPHONE COMMUNICATION - Google Patents

Abstract

The invention relates to a method for mixing, in a voice communication, a musical stream available online with an audio stream transmitted by a first terminal to a second terminal, the method being implemented by a multimedia processing server. The mixing method is remarkable in that it comprises steps for downloading continuously, by the multimedia processing server, an online music stream, adapting the musical stream according to at least one characteristic associated with the first terminal. audio mixing of the musical stream adapted with the audio stream transmitted by the first terminal, and transmission of the mixed audio stream to the second terminal.

Description

METHOD AND DEVICE FOR MUSIC INSERTION IN TELEPHONE COMMUNICATION

The present invention relates to the field of telecommunications and relates in particular to a method of adding a musical atmosphere in a telephone communication. More generally, the method applies to all forms of communication service having an audio component.

Prior art

Solutions are known for adding background music during a telephone call. Some techniques are based on the use of an interactive voice server to configure the service. Such solutions have several drawbacks. In particular, only the caller can choose a musical atmosphere, and only the called party benefits from the musical atmosphere, which makes it difficult to adjust the balance between the musical background and the voice flow. On the other hand, the configuration step via an interactive vocal server is tedious, and the choice of musical atmospheres is limited by choices proposed by the vocal server.

A technique is also known according to which the musical stream is added by the communication terminal and not by a server. In this case, the user selects a piece of music on his terminal, the latter then being mixed with the incoming and / or outgoing voice streams from the terminal. Thus, the configuration is simplified, and the choice of musical atmosphere is more varied. Such a method is costly in radio resources because the voice activity detection generally used to reduce the uplink traffic during a communication is no longer effective.

Whatever the technique used, the insertion of background music can be harmful to the intelligibility of the communication, especially when the inserted musical flow covers the speech of the interlocutors.

There is therefore a need for a technical solution making it possible to insert a musical stream into a telephone communication which does not have the drawbacks of the prior art.

Summary of the invention

To this end, there is proposed a method of mixing in a voice communication, a musical stream available online with an audio stream transmitted by a first terminal to at least a second terminal, the method being implemented by a server. multimedia processing and as it comprises the following stages:

-2 continuous download by the multimedia processing server of a music stream available online,

Adaptation of the musical stream according to at least one characteristic associated with the first terminal, Audio mixing of the adapted musical stream with the audio stream transmitted by the first terminal, and Transmission of the mixed audio stream to the second terminal.

The music stream mixed with the audio components of the communication is obtained from an online music listening server. In this way, the stream emitted by a terminal is a speech stream which does not include music. The voice activity detection which makes it possible not to transmit data when a silence is detected in a speech stream is therefore not disturbed and the use of the uplink bandwidth is optimized.

On the other hand, the method proposes to modify the musical stream before mixing it with an audio stream received from a terminal. The modification is carried out according to a characteristic associated with the terminal having emitted the audio stream to be mixed. In this way, the method makes it possible to carry out a mixing which preserves the intelligibility of the communication.

According to a particular embodiment, the mixing method is such that the at least one characteristic associated with the first terminal according to which the musical stream is adapted is a frequency spectrum of the audio stream transmitted by the first terminal.

Thus, before mixing a communication stream with the musical stream obtained from a continuous download server, the musical stream is modified according to a frequency spectrum of the communication stream. Such an arrangement contributes to preserving the intelligibility of the communication flow, by adapting the musical flow according to the frequencies detected in the communication flow.

According to a particular embodiment, the mixing method is such that the musical stream is further adapted according to a frequency bandwidth of the codec negotiated during a phase of negotiation of the communication for the transmission of the audio stream to the second terminal. .

The frequency band of the music stream may be wider than the frequency band negotiated in the communication. The method proposes to adjust the frequency band of the musical flow before mixing it with the communication flow. Removing unsupported frequencies

-3 by the coded negotiated before mixing rather than deleting them when encoding the mixed stream makes it possible to improve the quality of the encoded stream transmitted to the destination terminal, the musical stream alone being able to undergo specific processing such as for example a reorganization of the energy of the musical flow in the frequency band negotiated or renegotiated in the communication.

According to a particular embodiment, the mixing method is such that the adaptation of the musical stream includes a modification of the frequency spectrum of the musical stream.

Thus, the mixing process makes it possible to cut certain frequencies of the musical flow when the communication flow to be mixed includes these same frequencies. For example, if the audio signal emitted by a terminal is mainly concentrated between 1 kHz and 2 kHz, the method makes it possible to cut or reduce the amplitude of the musical flow between these same frequencies. Such an arrangement allows the user of the terminal receiving the mixed stream to better distinguish the speech signal in the mixed stream. The clarity and intelligibility of the speech signal is thus preserved.

According to a particular embodiment, the mixing method is such that the frequency spectrum of the audio stream transmitted by the first terminal is obtained from an analysis of the frequencies of said stream.

The audio streams transmitted by the terminals are analyzed by the multimedia processing server in order to determine a frequency spectrum. Such an analysis can be carried out during the first seconds of the communication, and / or repeated periodically and makes it possible in particular to determine predominant frequencies. It is thus possible to adapt the musical flow according to the predominant frequencies in a communication flow so that the frequencies of the musical flow do not interfere with the frequencies.

According to a particular embodiment, the mixing method is such that the frequency spectrum of the stream transmitted by the first terminal is obtained from a frequency spectrum database, from a call parameter associated with the first terminal

The method uses a parameter of the call in order to obtain a frequency spectrum capable of being representative of the language spoken by the user. For example, the international prefix of an E164 identifier or an MCC (Mobile Country Code) number associated with the terminal allows you to

-4determine the country of origin of the terminal and therefore probably the language spoken by the user. Each language having a specific frequency signature, the method thus makes it possible to obtain a frequency spectrum of an audio stream transmitted by a terminal without carrying out an analysis of the audio stream. Such an arrangement saves the resources of the multimedia processing server.

According to a particular embodiment, the mixing method is such that it further comprises a step of modifying the sound level of the musical stream as a function of the sound level of the audio stream transmitted by the first terminal and / or according to the sound level of the stream transmitted by the second terminal when the second terminal transmits an audio stream to the first terminal.

The sound level of the musical stream is adapted according to the sound level of the audio stream with which it is mixed. In this way, the method makes it possible, for example, to lower the sound level of the musical stream when it is mixed with an audio communication stream whose level is low. Such an arrangement makes it possible to prevent the insertion of the musical flow in the communication from reducing its intelligibility. The sound level of the musical stream can also be adapted as a function of the sound level of the audio stream emitted by the second terminal. Thus, when a user speaks, the sound level of the music he hears in the handset is adjusted so as not to create discomfort.

According to a particular embodiment, the mixing method is such that it further comprises, on receipt of a DTMF command from the first or the second terminal, a modification of at least one mixing parameter.

Thus, users can control the mixing parameters during the communication.

According to a particular embodiment, the mixing method is such that the reception of a DTMF command from a terminal triggers at least one of the actions included in the following set:

the beginning of the mixing of a musical stream with an audio stream transmitted by the first terminal and / or by the second terminal, the stopping of the mixing of a musical stream with an audio stream transmitted by the first terminal and / or by the second terminal, the modification of the sound level of the audio stream in a mixed stream,

-5the change of musical stream, the change of category of musical stream, the looping of the musical stream during mixing, the change of a frequency filter applied to the musical stream.

The method thus allows the interlocutors to act on the mixing of the musical flow during communication. For example, a user can adjust the sound level of the musical stream relative to the sound level of the correspondent's voice, select another musical stream, stop the insertion of musical content.

According to another aspect, and correspondingly to the mixing method described above, a method is provided for controlling the mixing of a musical stream available online in a communication between a first calling terminal and a second called terminal, the method being implemented by a server through which call signaling transits, in a network comprising at least one multimedia processing server, the method being such that it comprises the following steps, for establishing communication between the first and the second terminal:

configuration of the communication so that the audio streams sent by the first and second terminals pass through the multimedia processing server, sending at least one message to the multimedia processing server, the at least one message being adapted to trigger a mixing process as described above.

The mixing control method thus allows a server through which the communication signaling passes, such as for example an application server, to dynamically configure the communication so that the mixing method can be implemented by a processing server. multimedia. In particular, the signaling messages transmitted by the terminals are modified so that the audio streams are sent to the multimedia server responsible for performing the mixing.

According to a particular embodiment, the control method is such that it further comprises a step of determining that an online music listening service is available from a call identifier of the calling terminal, the configuration steps and send a mix command

-6 being performed only when an online music listening service is determined to be available.

Thus, the insertion of a musical stream into a communication is only possible if the caller has access to an online music listening service. It is determined that a caller has access to an online music listening service from a caller ID, such as from his call number.

According to a particular embodiment, the control method is such that it further comprises a step of sending at least one resource reservation message to the multimedia processing server, the at least one message being suitable for reserving Resource :

for sending and receiving multimedia data between the multimedia processing server and the second terminal, and between the multimedia processing server and the first terminal, and for the reception, by the multimedia processing server, of a musical stream from the music listening service.

Thus, the availability of the resources necessary for the reception and processing of the various flows by the multimedia processing server is guaranteed for the communication.

According to a particular embodiment, the control method is such that it includes a step of sending, to the called terminal, a message comprising an indication according to which a musical insertion is configured for communication, the indication being capable of prohibit the activation of a mixing process by the called terminal, or by equipment supporting the called terminal.

When the insertion of musical content is requested by a user of a terminal, the other party (s) are notified. In this way, the method makes it possible to prevent the insertion of musical content being requested simultaneously by the different parties to the communication, which would be harmful to the intelligibility of the communication. The indication can be used by equipment supporting the called terminal or directly by the called terminal to prohibit a new musical insertion which would interfere with the musical insertion requested by the first terminal.

According to another aspect, the invention relates to a device for mixing, during a voice communication, a musical stream available online with an audio stream transmitted by a first terminal to a second terminal, the device being such that it includes the following modules:

a communication module adapted to continuously download a musical stream available online, a signal processing module configured to adapt the musical stream according to at least one characteristic associated with the first terminal, an audio mixing module adapted to mix the adapted musical stream with the audio stream transmitted by the first terminal, and a communication module adapted to transmit the mixed audio stream to the second terminal.

According to yet another aspect, the invention relates to a device for controlling the mixing of a musical stream available online with at least one audio stream of a communication established between a first calling terminal and a second called terminal in a network comprising at least at least one multimedia processing server, the communication signaling messages passing through the device, the device being characterized in that it comprises the following modules, implemented in establishing communication between the first and the second terminal:

a configuration module adapted to configure the communication so that the audio streams sent by the first and second terminals pass through the multimedia processing server, and a communication module adapted to send at least one message to the multimedia processing server , the at least one message being adapted to trigger a mixing process as described above.

The invention also relates to a server comprising a mixing device and / or a control device as described above.

The invention also relates to a computer program comprising the instructions for the execution of the mixing process and / or the instructions for the execution of the control process, when the program is executed by a processor.

The invention also relates to an information medium readable by a processor on which a computer program is recorded comprising instructions for the execution of the steps of the mixing method and / or the instructions for the execution of the control method. .

The various embodiments or features mentioned above can be added independently or in combination with each other, to the stages of the mixing process and / or to the stages of the control process.

Servers, devices, programs and information carriers have at least advantages similar to those conferred by the mixing and / or control method described above.

List of Figures

Other characteristics and advantages of the invention will appear more clearly on reading the following description of a particular embodiment, given by way of simple illustrative and nonlimiting example, and of the appended drawings, among which:

FIG. 1 illustrates an architecture adapted to implement the mixing method and the control method in accordance with a particular embodiment,

FIG. 2 represents the different stages of the mixing process according to a particular embodiment,

FIG. 3 represents different stages of the mixing control method according to a particular embodiment,

FIG. 4 represents, in the form of a timing diagram, messages exchanged between entities for implementing the mixing and mixing control methods according to a particular embodiment,

FIG. 5 illustrates the architecture of a mixing device according to a particular embodiment, and FIG. 6 represents the architecture of a mixing control device according to a particular embodiment of the invention.

detailed description

FIG. 1 represents a communication terminal 100 suitable for establishing communications with a second communication terminal 101 through a telecommunications network 115. The terminal 100 is for example a mobile telephone capable of establishing voice communications with another telephone mobile 101 through an IMS 115 telecommunications network. The terminals connect to the IMS network via access networks such as GSM, 2G, 3G or 4G mobile networks or WiFi networks not shown. . When establishing a communication, the terminals exchange messages, for example messages conforming to the SIP protocol (Session Initiation Protocol). These signaling messages pass in a known manner through different intermediate entities of the IMS network. In particular, the signaling messages here pass via a telecommunication application server (TAS, Telephony Application Server) 102 of the network 115. It is noted that for reasons of clarity of the description, a single server 102 is shown, although in reality two separate servers can be associated respectively with the terminals 100 and 101. The application server 102 receives the messages transmitted by the terminal 100 by means of a connection 103 and transmits them to the terminal 101 by a connection 104. The server 102 can modify the content of the messages before retransmitting them to the terminal 101. Conversely, the server 102 can receive messages transmitted by the terminal 101 by means of the connection 104 and retransmit them to the terminal 100 using connection 103 after modifying the content.

According to the invention, the server 102 modifies the content of the messages exchanged during the establishment of the communication so that the audio streams carrying the speech signal 106 and 107 respectively sent by the terminals 100 and 101 pass through a server 105. The server is for example an MRF server (Media Resource Function) of the IMS network 115. Thus, when a voice communication is established between the terminals 100 and 101, the audio stream 106 encoded and transmitted by the terminal 100 is relayed by the server 105 to the terminal 101 in the form of an audio stream 108 in order to be decoded there and returned to the user. Likewise, the audio stream 107 encoded and transmitted by the terminal 101 is relayed by the server 105 to the terminal 100 in the form of an audio stream 109 so as to be decoded there and returned to the user.

The architecture of FIG. 1 also includes a server 110 adapted to continuously stream a musical stream. The server 110 is shown here as belonging to a music broadcasting platform 116 interconnected with the IMS network 115. However, the server 116 can be a server included in the IMS network 115. The server 110 is here a server belonging to a service of music listening online. Such services are known per se and allow subscribers to continuously download (“streaming”) music content which will be played on a mobile terminal, a personal computer or any other suitable equipment. In return for a subscription,

-10 users have listening access to a large number of musical titles 111. Users have an account on the broadcasting platform thanks to which they can edit lists of musical selections and which makes it possible to memorize the listening habits of users.

Such music listening services are sometimes offered to their subscribers by telecommunications operators, in the form of commercial offers. Operators are then able to make a correspondence between a telephone number of one of their subscribers and an account on a music listening platform. In the case which interests us here, the network operator 115 has a database 117 relating the number of terminal 100 to an identifier of the user of this terminal on the music listening platform 116. This same database 117 makes it possible to inform the operator of the network 115 about the fact that the user of the terminal 101 has not subscribed to the music listening service and that he therefore does not have an account on this platform. Such a database can for example be an HSS server (Home Subscriber Server) of the IMS 115 network.

When the operator of the network 115 does not have a specific agreement with the operator of the platform 116, he can obtain parameters for connecting the user to this platform by means of a prior configuration procedure, during which the user of the terminal 100 provides this information to the network operator 115. In this way, the network operator 115 has a database 117 relating the number of the terminal 100 to connection parameters of the network. user of this terminal on the music listening platform 116.

When establishing a communication initiated by the terminal 100 to the terminal 101, the server 102 checks whether the user of the terminal 100 has requested the insertion of a musical background in the communication. The insertion of a musical background is for example requested by the terminal 100 by inserting an appropriate indication in a communication establishment message, for example in a SIP INVITE message or in a SIP 200 OK response message, or else the Musical insertion is configured through an extension of a web portal or a voice interface made available to the operator's customers to configure their telephone services.

According to a particular embodiment, the server 102 relays this indication to the terminal 101 so as to warn it that a musical insertion is requested by the terminal 100. The terminal or the telephone server supporting it can use this indication so as not to also request a musical insertion which would be added to the insertion requested by the terminal 100 or by a telephone server supporting it.

-11When a musical insertion is requested, the server 102 queries the database 117 in order to know if the user has an account on the music listening platform 116. If valid connection parameters are obtained from the database 117, the server 102 sends a request to the server 110 of the listening platform in order to request, on behalf of the user of the terminal 100, the continuous downloading of musical content intended for the server of multimedia processing 105.

On receipt of a mixing command transmitted by the server 102, the server 105 performs a mixing of the musical stream 112 transmitted by the server 110 with the audio stream 106 received from the terminal 100. The audio stream 108 resulting from the mixing of the streams 106 and 112 is then encoded according to the coding format negotiated by the terminal 101 and transmitted to the terminal 101. Correspondingly, the musical stream 112 is mixed with the audio stream 107 transmitted by the terminal 101 before being transmitted to the terminal 100.

In order to preserve the intelligibility of the speech signal, the mixing of the musical stream 112 with the communication stream 106 is preceded according to the invention by a step of adaptation of the musical stream according to a characteristic associated with the terminal 100. Correspondingly , the mixing of the musical stream 112 with the communication stream 107 is preceded according to the invention by a step of adaptation of the musical stream 112 according to a characteristic associated with the terminal 101.

According to a particular embodiment, the adaptation step includes a step of modifying the sound level of the musical stream as a function of the sound level of the stream with which it is mixed. The server 105 can thus dynamically adjust the volume of the music inserted in the stream so that the musical stream does not interfere with the words spoken by the interlocutors. For example, the share of music in the mixed stream 108 transmitted to the terminal 101 can be reduced when voice activity is detected in the audio stream 106 emitted by the terminal 100. As a variant, the sound level of the musical stream is adjusted as a function the sound level of the audio stream emitted by another terminal. In this way, when a user speaks, the sound level of the music reproduced in the loudspeaker of his terminal can be reduced so as not to encourage him to raise his voice. The two variants of sound level adjustment can be combined, so that the sound level of the mixed music is adjusted according to the sound level of the speech signal of each of the speakers. So for example, if the user of terminal 100 speaks, the user of terminal 101 will receive the signal from terminal 100 with the standard telephone amplitude which is mixed with music at a fairly low level and adapted to the frequency spectrum of the caller 100. If the user of the terminal 101 does not speak and listens to what the user of the terminal 100 says, the overall level of the signal received is not affected. If the user of terminal 101 speaks in parallel, the sound level of the

-12 received musical component will be further attenuated so that the user of the terminal 101 can hear correctly what he is saying. Likewise if the user of terminal 100 does not speak, and if the user of terminal 101 does not speak, then the musical stream transmitted to terminal 101 (as well as that transmitted to terminal 100) will be of a higher level than when there is speech mixing but the sound level will remain in amplitude lower than the level of a standard telephone call. If the user of the terminal 101 starts to speak, then the received musical level will decrease.

According to a particular embodiment, such an adaptation of the musical stream 112 before mixing and transmission of the mixed stream 108, respectively 109, to the terminal 101, respectively 100, corresponds to the application of a specific frequency filter to the musical stream 112 , the filter being selected according to a characteristic associated with the terminal 100, respectively 101.

According to a particular embodiment, the characteristic according to which the filter applied to the musical stream 112 for the transmission of a mixed stream is selected at the terminal 101, respectively 100, is a frequency spectrum of the audio stream 106, respectively 107, transmitted by the terminal 100 respectively 101.

Thus, the server 105 adapts the frequency spectrum of the stream 112 as a function of frequencies characteristic of the speech signal transmitted by the terminals. For example, when the frequency spectrum of the audio stream 106 indicates that the signal amplitude exceeds a determined threshold in the frequency band 1 kHz-2 kHz, the server 105 applies processing to the music stream 112 including the reduction of the signal amplitude musical in the lKHz-2KHz band. In this way, the frequencies of the musical stream do not interfere with the frequencies of the speech signal of the user of the terminal 100, conversely 101 and the quality of the communication is preserved. The characteristics of the music stream integrated into the audio stream received by the terminals are adapted to the speaker so that adding music during the communication is not annoying for the listener.

According to a particular embodiment of the invention, the frequency spectrum of an audio stream transmitted by a terminal is determined by an analysis of the frequencies. This analysis can take place during the first seconds of communication and before the musical insertion is carried out. As a variant, it can take place continuously so that the mixing of the musical stream is permanently adapted to the speaker. Thus, in case of change of speaker or intonation, the quality of the communication is preserved.

According to another particular embodiment, the frequency spectrum of an audio stream transmitted by a terminal is obtained from a database of predefined frequency spectra. The server

-13102 can in this case communicate to the server 105 the characteristics, or a particular filter identifier to be applied to the musical stream before mixing it. For this, the server 102 obtains, for example, a filter identifier from the telephone number, or from another suitable identifier, from the terminal 100. The server 102 can in particular use an international prefix for the telephone number from the terminal 100. The international prefix is associated with the country of origin of the terminal. For example, the international identifier for France is +33. Other indications making it possible to determine the country of origin of the terminal can be used, such as for example an MCC number (Mobile Country code) or geolocation information. Such data can be combined to determine not only the country, but also the region in the country of origin.

The server 102 can thus determine the country of origin of the user of a terminal, and deduce therefrom the probable language in which he speaks. From geographic information, it can also determine a particular accent particularly represented in a given region. However, each language has a specific frequency spectrum. For example, the frequencies used by a speaker speaking in French are different from the frequencies used by a speaker speaking in German. It is thus possible to associate a standard frequency spectrum with most languages. Thus, the server 102 can obtain a frequency spectrum adapted to the audio stream transmitted by the terminal 100 without analyzing the stream to precisely determine the frequencies. The filter can then be applied without prior analysis and musical insertion can be carried out from the start of the communication.

The two previous embodiments can be combined in a particular embodiment. In this case, a filter is determined when establishing the communication from an international identifier so as to start the musical insertion from the first moments of the communication, then the server 105 performs an analysis of the flows received for determine a filter particularly suited to the speaker's timbre. When a filter is determined by the analysis, the server 105 applies it in place of the filter initially determined from the international identifier. In this way, a quality musical insertion is achieved throughout the communication.

According to a particular embodiment, the filter applied to the musical stream 112 before mixing with an audio stream received from a terminal can be selected according to a characteristic of the terminal receiving the mixed stream. For example, a filter adapted to the bandwidth of the audio codec negotiated by the terminal 101 at the establishment of the communication can be applied to the musical stream, alone or in combination with the filter selected according to a characteristic of the terminal 100, and vice versa. Such an arrangement improves the quality of the musical flow inserted in the communication

According to a particular embodiment, the server 105 receives DTMF commands transmitted by the terminals during the communication. These are, for example, DTMF transmitted in RTP (Real-Time Protocol) audio packets, for example according to the IETF standard RFC 4733. DTMFs can also be transmitted in the form of an audio signal inserted in the speech signal or DTMF transmitted in the signaling by the server 102 before being communicated to the server 105. Processing commands by the server 105 are associated with different DTMF codes.

For example, the DTMF code "1" can be associated with a command to start mixing a musical stream with an audio stream transmitted by a terminal, the code "2" can correspond to a command to stop mixing a musical stream with an audio stream transmitted by a terminal, etc. Other commands can concern for example the modification of the sound level of the audio stream in a mixed stream, the downloading of a new musical title, the change of category of the music inserted in the communication, the command to play a list selection, the looping of the musical stream during mixing, or even for example the change of a frequency filter applied to the musical stream.

According to a particular embodiment, the server 102 makes a prior reservation of resources on the multimedia processing server 105. The server reserves resources in computation time and / or bandwidth on the multimedia processing server during the establishment phase of Communication. In particular, the server 102 reserves resources for sending and receiving multimedia data between the multimedia processing server 105 and the terminal 100, and between the multimedia processing server 105 and the terminal 101, and for receiving, by the multimedia processing server 105, of the musical stream 112 coming from the music listening server 116. In this way, the availability of the server 105 to carry out the musical insertion processing is guaranteed for the entire duration of the communication.

The different stages of the mixing control method will now be described with reference to FIGS. 2 and 4.

During a first step 200 of the mixing control method, at least one communication establishment message between a first terminal 100 and a second terminal 101 is received by the server 102. This is for example a message SIP INVITE noted 400 in FIG. 4. On reception of such a message, the server 102 interrogates during an optional step 201 the base of

Data 117 in order to check, from the call identifier of the terminal 100, whether parameters for connection to a music listening platform such as the platform 116 are available.

If access parameters to the platform 116 are available to the user of the terminal 100, the server 102, in step 202, configures the communication so that the audio streams sent by the first and second terminals pass through the multimedia processing server. For this, the server 102 transmits at least one resource reservation message 401 to the multimedia processing server 105. As we have seen, such a message notably makes it possible to reserve resources for sending and receiving messages with the terminal 100 and the terminal 101, as well as receiving a music stream from the music listening platform 116. In response to this message, the server 105 transmits a response 402 to the server 102, the response comprising addresses and ports for the reception and transmission of reserved audio streams. The server 102 then modifies the communication establishment message 400 by replacing there the address and the port indicated by the terminal 100 with an address and a port supplied by the server 105 and sends the message 403 SIP INVITE to the terminal 101. From in this way, the terminal 101 can transmit its audio stream to the processing server 105. According to a particular embodiment, the message sent to the terminal 101 includes an indication that a musical insertion is requested by the terminal 100. In response to the message 403, the terminal 101 sends after acceptance of the communication a SIP 200 OK 404 response which is received by the server 102. In accordance with the SIP protocol, this message includes the address and the port that the terminal 101 wishes to use to receive the audio streams from terminal 100. The server 102 then communicates this information to the server 105 by means of a message 405. In response to the message 405, the server 105 comm unique to the server 102, via the message 406, the address and the port on which it wishes to receive the audio streams from the terminal 100. This information is communicated to the terminal 100 in the SIP response 200 OK 407 sent by the server 102 .

When the communication is established, the terminal 100 can then transmit an audio stream 408 intended for the server 105 which will be relayed to the terminal 101 in the form of an audio stream 409. Conversely, the terminal 101 transmits an audio stream 410 to the server 105, which will be relayed by the server 105 to the terminal 100 in the form of a stream 411.

Once the communication has been established, in step 203, the server 102 issues a command 412 to the music listening server 110, the command being configured to trigger the downloading of a music stream from the music listening platform to the multimedia processing server 105. Such a message is for example an RTSP command comprising the address and the port reserved on the server 105 for receiving the musical stream.

The mixing control method has been described with reference to messages conforming to the SIP protocol. However, for reasons of clarity of the presentation, the exchange of messages has been simplified. Thus, in a real implementation, other messages can be exchanged, such as for example SIP ACK, SIP UPDATE, SIP 180 RINGING messages or any other message desirable for establishing communication in accordance with the communication standard implemented in the network 115 .

The different stages of the mixing process will now be described with reference to Figures 3 and 4.

The multimedia processing server 105 continuously downloads, in step 300, a musical stream 414 transmitted by the music listening platform. The server 105 also receives in step 301 the audio stream 408 transmitted by the terminal 100 as well as the audio stream 410 sent by the terminal 101.

In step 302, the processing server 105 determines a first frequency spectrum corresponding to the audio stream sent by the terminal 100. As we have seen, the spectrum can be determined by an analysis of the stream and / or a determination of a country of origin, for example from the telephone numbers associated with the terminals.

The musical stream 414 is then modified in step 303, according to at least one characteristic associated with the terminal 100. According to a particular embodiment, this modification includes the application of a frequency filter which depends on the frequency spectrum determined for the audio stream emitted through terminal 100.

In step 304, the server 105 performs the mixing of the modified musical stream according to the frequency spectrum of the stream transmitted by the terminal 100 with the audio stream received from the terminal 100, and transmits in step 305 a mixed stream to the terminal 101 in the form of a compressed audio stream 416 according to a coding standard negotiated at the establishment of the communication.

Correspondingly, the musical stream 414 is modified in step 303, according to at least one characteristic associated with the terminal 101. According to a particular embodiment, this modification includes the application of a frequency filter which depends on the frequency spectrum determined for the audio stream emitted by terminal 101.

In step 304, the server 105 performs the mixing of the modified musical stream according to the frequency spectrum of the stream transmitted by the terminal 101 with the audio stream received from the terminal 101, and transmits in step 305 this mixed stream to the terminal 100 in the form of a compressed audio stream 417 according to a coding standard negotiated at the establishment of the communication.

FIG. 5 represents a mixing device 500 according to a particular embodiment. The device here has the architecture of a computer. It comprises in particular a processor 501, a random access memory 502, a read-only memory 503, as well as communication means 504-506. Such elements are known per se and are not described in more detail here.

The read-only memory 503 of the mixing device 500 constitutes a recording medium in accordance with the invention, readable by the processor 501 and on which a PGR computer program in accordance with the invention is recorded here.

The PGR computer program defines functional and software modules here, configured to implement the steps of a mixing process. These functional modules rely on and / or control the hardware elements 507-509 of the device 500 mentioned above. They include in particular here, as illustrated in FIG. 5:

a communication module 504 configured to continuously download a music stream available online, a communication module 505 configured to receive an audio stream from a voice communication, a signal processing module 507 configured to adapt the music stream according to at least a characteristic associated with the first terminal and / or at least one characteristic associated with the second terminal, an audio mixing module 506 configured to mix the adapted musical stream with the audio stream received by the communication module 505 from a first terminal, and a communication module 506 adapted to transmit the mixed audio stream to a second terminal.

The device can also include a communication module adapted to receive mixing commands from another entity such as the server 102 in FIG. 1. The communication modules are for example at least one network interface controlled by the processor 501 according to the instructions of the PGR computer program when it is loaded into RAM memory to be executed.

The communication module 505 is configured to receive compressed audio packets coming from a communication terminal and transmitted according to a transport protocol such as RTP in accordance with the IETF RFC 3550 standard. These packets are decoded by the processor 501 of the device according to PGR program instructions.

According to a particular embodiment, the device 500 comprises an analysis module 509 adapted to analyze the audio stream received by the communication module 505 in order to determine a frequency spectrum thereof. Such an analysis is for example based on a transform, known per se, of the decoded audio samples. It provides the signal amplitude for different frequency ranges. The analysis module can be implemented by instructions from the PGR computer program.

According to a particular embodiment, the analysis module 509 is adapted to obtain a frequency spectrum of the audio stream received by the communication module 505 from a database of predefined frequency spectra. The analysis module, for example, executes an SQL or Diameter request to a database using a frequency spectrum identifier provided by a mixing control device.

The communication module 504 is configured to receive a compressed musical stream coming from an online music listening platform according to a streaming protocol such as RTSP defined in the IETF standard RFC2326 or http Live Streaming from Apple (HLS). The communication module 504 can also transmit commands to the music listening platform in order for example to select a particular title or selection list, stop broadcasting the content or any other desirable command.

The signal processing module 507 can be implemented according to PGR computer program instructions loaded in the RAM memory 502 and executed by the processor 501, or even by a specialized processor such as a DSP (Digital Signal Processing) . Such instructions are configured to modify, over frequency ranges determined from a frequency spectrum determined by the analysis module 509, the amplitude of the musical audio signal decoded from the musical stream received by the communication module 504 In particular, the module 507 is configured to reduce the amplitude of the musical flow received in frequency bands particularly represented in the frequency spectrum determined by the analysis module.

According to a particular embodiment, the signal processing module is configured to modify the sound volume of the musical stream received by the module 504 according to the volume of the audio stream received by the module 505 and / or the according to the sound level of the stream transmitted by the second terminal when the second terminal transmits an audio stream to the first terminal.

Finally, the mixing module 508 can be implemented by computer program instructions loaded into a RAM memory and executed by the processor 501 or a specialized processor such as a DSP. These means of execution can of course be shared with

-19 other modules described above. Thus, the mixing module is configured to mix the musical samples adapted by the signal processing module with the samples decoded from the audio stream received by the communication module 508. A mixed stream can for example be generated by adding the values audio samples of the adapted music stream and the received audio stream.

Finally, the communication module 506 is configured to transmit the audio stream mixed by the mixing module 508 to a destination terminal, according to a transport protocol such as RTP in accordance with the IETF RFC 3550 standard or any other suitable transport protocol.

The device 500 could be integrated into a server, such as for example an MRF server of an IMS network.

FIG. 6 represents a device 600 for controlling mixing according to a particular embodiment. The device here has the architecture of a computer. It comprises in particular a processor 601, a random access memory 602, a read-only memory 603, as well as communication means 605. Such elements are known per se and are not described in more detail here.

The read-only memory 603 of the mixing device 600 constitutes a recording medium in accordance with the invention, readable by the processor 601 and on which a PGR computer program in accordance with the invention is recorded here.

The PGR computer program defines functional and software modules here, configured to implement the steps of a mixing control process. These functional modules are based on and / or control the hardware elements 604-607 of the device 600. They notably include here, as illustrated in FIG. 6:

a communication module 605 configured to send and receive call signaling messages, for example SIP messages, with other entities, in particular with communication terminals, a configuration module 604 adapted to configure communication of so that the audio streams sent by the terminals pass through a multimedia processing device such as the device 500 described above, and a communication module 606 adapted to send at least one command message to the multimedia processing server, the at least one message being adapted to trigger the mixing device 500 described above in accordance with the invention described with reference to FIG. 1.

The communication module 605 is configured to receive communication establishment messages in SIP format. The communication module 605 is for example a network interface controlled by the processor 601 according to the instructions of the computer program PGR when it is loaded into RAM memory to be executed.

The configuration module 604 is adapted to modify the content of the signaling messages so that the audio streams exchanged by the terminals pass through a multimedia processing server described above. In particular, the module 604 modifies the SDP description (Session Description Protocol) included in the messages so as to modify the addresses and reception ports of the audio streams indicated by the terminal so as to display there addresses and ports of the multimedia processing server. . In this way, the audio streams are transmitted by the terminals to the processing server in charge of the musical insertion.

According to a particular embodiment of the device, the configuration module 604 obtains the addresses and the ports of the processing server by exchanging resource reservation messages with the latter by means of the communication interface 605. In response to a reservation message As a resource, the processing server responds by indicating a port and an address to which to send audio streams. Thus, the configuration module 604 reserves resources on the processing server for the reception and the sending of an audio stream with the various terminals in communication, and for the reception of a musical stream coming from a service of music listening online.

According to a particular embodiment, the device 600 comprises a module 607 configured to obtain parameters for connection to an online music listening service from an identifier of a terminal. This module is implemented here by computer program instructions loaded in RAM memory 602 and executed by processor 601. The instructions are for example configured to perform a search in a database from the telephone number of a terminal wishing to activate a music insertion service according to the invention.

The device 600 can be integrated into a server, such as for example an application server of an IMS network.

The mixing and mixing control methods have been described in relation to communication between two terminals. However, the invention applies in the same way in the case of a conference comprising more than two terminals.

The mixing and mixing control methods have been described in relation to stable communication between two terminals. However, the invention applies in the same way

In the case of a renegotiation of the communication, for example in the case of 4G VoLTE to 2G / 3G mobility from one of the terminals inducing a change from broadband audio codec to a narrowband audio codec.

Claims (15)

1. Method for mixing, in a voice communication, a musical stream available online with an audio stream transmitted by a first terminal to a second terminal, the method being implemented by a multimedia processing server and characterized in that it includes the following stages: continuous download, via the multimedia processing server, of a music stream available online, Adaptation of the musical stream according to at least one characteristic associated with the first terminal, Audio mixing of the adapted musical stream with the audio stream transmitted by the first terminal, and Transmission of the mixed audio stream to the second terminal. 2. Method according to claim 1 wherein the at least one characteristic associated with the first terminal according to which the musical stream is adapted is a frequency spectrum of the audio stream transmitted by the first terminal. 3. Method according to any one of the preceding claims, in which the musical stream is further adapted according to a frequency bandwidth of the codec negotiated during a phase of negotiation of the communication for the transmission of the audio stream to the second. terminal. 4. Method according to any one of the preceding claims, in which the adaptation of the musical flow comprises a modification of the frequency spectrum of the musical flow. 5. Method according to any one of the preceding claims, in which the frequency spectrum of the audio stream transmitted by the first terminal is obtained from an analysis of the frequencies of said stream. 6. Method according to any one of claims 2 to 5 in which the frequency spectrum of the stream transmitted by the first terminal is obtained from a frequency spectrum database, from a call parameter associated with the first terminal. 7. Method according to any one of the preceding claims, as further comprising a step of modifying the sound level of the musical stream as a function of the sound level of the audio stream transmitted by the first terminal and / or the sound level of the transmitted stream. by the second terminal when the second terminal transmits an audio stream to the first terminal. 8. Method according to any one of the preceding claims, such that it comprises, on reception of a DTMF command from the first or second terminal, a modification of at least one mixing parameter. 9. The method of claim 8 in which the reception of a DTMF command from a terminal triggers at least one of the actions included in the following set: the beginning of the mixing of a musical stream with an audio stream transmitted by at least one of the terminals, the stopping of the mixing of a musical stream with an audio stream transmitted by at least one of the terminals, the modification of the sound level of the stream audio in a mixed stream, changing the music stream, changing the category of the music stream, looping the music stream being mixed, changing a frequency filter applied to the music stream. 10. Method for controlling the mixing of a musical stream available online in a communication between a first calling terminal and a second called terminal, the method being implemented by a server through which the call signaling passes, in a network comprising at least one multimedia processing server, the method being characterized in that it comprises the following steps, establishing a communication between the first and the second terminal: configuring (202) the communication so that the audio streams sent by the first and second terminals pass through the multimedia processing server, sending (203) at least one message to the multimedia processing server, at least a message being adapted to trigger a mixing method according to any one of claims 1 to 9. 11. The method of claim 10 as further comprising a step of determining that an online music listening service is available from a call identifier of the calling terminal, the configuration steps and sending of a mixing command being carried out only when an online music listening service is determined to be available. 12. Method according to any one of claims 10 to 11 as it comprises a step of sending, to the called terminal, a message comprising an indication that a musical insertion is configured for communication, the indication being able to prohibit the activation of a mixing process by the called terminal. 13. Device for mixing, in a voice communication, a musical stream available online with an audio stream transmitted by a first terminal to a second terminal, the device being characterized in that it comprises the following modules: a communication module (504) adapted to continuously download a music stream available online, a signal processing module (507) configured to adapt the music stream according to at least one characteristic associated with the first terminal, an audio mixing module ( 508) adapted to mix the adapted musical stream with the audio stream transmitted by the first terminal, and a communication module (506) adapted to transmit the mixed audio stream to the second terminal. 14. Device for controlling the mixing of a musical stream available online with at least one audio stream of a communication established between a first calling terminal and a second called terminal in a network comprising at least one multimedia processing server, the messages for signaling the communication passing through the device, the device being characterized in that it comprises the following modules, implemented in the establishment of a communication between the first and the second terminal: a configuration module (604) adapted to configure the communication so that the audio streams sent by the first and second terminals pass through the multimedia processing server, and a communication module (606) adapted to send at least one message to the multimedia processing server, the at least one message being adapted to trigger a mixing process according to any one of claims 1 to 9. 15. Server comprising a mixing device according to claim 13 and / or a control device according to claim 14.