GB2510979A

GB2510979A - Audio broadcasting method

Info

Publication number: GB2510979A
Application number: GB1322959.6A
Authority: GB
Inventors: Ian Griggs
Original assignee: Telefonica UK Ltd
Current assignee: Telefonica UK Ltd
Priority date: 2012-12-21
Filing date: 2013-12-23
Publication date: 2014-08-20
Anticipated expiration: 2033-12-23
Also published as: GB2510979B; GB201223218D0; GB201322959D0

Abstract

A method of sending an audio stream from a server to a mobile device associated with a user, wherein the audio stream is associated with a video stream provided to a display device. The method comprises: receiving a communications message (e.g. an SMS) from the mobile device 26 at the server; establishing a communications channel (e.g. a telephone call) with the mobile device; sending a selection of available audio streams to the mobile device; receiving a user selection for a particular audio stream; and connecting the communications channel to a conference call, the particular audio stream being a participant on the conference call. The voice-over-internet (VoIP) protocol 20 could be used to provide the audio channel. The method could be employed to allow viewers of TV displays (32), for example in a store, to listen to different audio channels.

Description

Intellectual Property Office Application No. GB1322959.6 RTM Date:t6 June 20t4 The following terms are registered trade marks and should be read as such wherever they occur in this document: Bluetooth Intellectual Property Office is an operating name of the Patent Office www.ipo.govuk Audio Broadcasting Method

Field of the Invention

S The present invention relates to an audio broadcasting method and a system therefor. In particular, the invention relates to an audio broadcasting method and system therefor for use in a public environment.

Background to the Invention

The invention addresses the problem that, in a noisy store environment where there are multiple audio sources playing at the same time, it is difficult to disambiguate the different audio streams coming from speakers.

Similarly, there are environments where it is impractical or impossible for the audio being played from, for example, a video, to be audible and reach users who are watching from a distance.

Some known approaches for addressing these problems are outlined below.

A first approach is to provide personal headphones for a user to wear in order to listen to audio material which accompanies video content. As illustrated in Figure 1, existing systems include the use of hardwired or wireless headsets 12 near the audio source 14 (in this case the speaker of a display monitor). Clearly, the number of available headsets 12 limits the number of people who can listen to the audio at the same time. Another drawback with this approach is that there is also an overhead associated with maintaining the hardware, including accounting for the fact that headphones 12 are liable to be lost, stolen or damaged.

An alternative is to use directional speakers. However, as shown in Figure 2, there are restrictions on how close such speakers 16 can be arranged before the audio from one speaker 16 begins to conflict with audio from another.

Another alternative is offered by streaming the audio (e.g. over internet radio) to mobile devices. The nature of this technology results in a significant latency between broadcast and playback of the audio on the mobile device. This latency makes it difficult to synchronise the audio with a video, and can make for a frustrating experience for the user.

It is one object of the present invention to provide an improved audio broadcasting method for use in public spaces, which overcomes or alleviates the aforementioned disadvantages

known in the prior art.

Summary of the Invention

According to a first aspect of the present invention there is provided a method of sending an audio stream from a server to a mobile device associated with a user, the audio stream being associated with a video stream provided to a display device, the method comprising: receiving a communications message from the mobile device at the server; establishing a communications channel with the mobile device; sending a selection of available audio streams to the mobile device; receiving a user selection for a particular audio stream; connecting the communications channel to a conference call, the particular audio stream being a participant on the conference call.

The present invention allows users to request to hear a specific audio source, for example by sending an SMS message from their mobile device to a server, or by using a dedicated app on the mobile device to communicate with the server. They are then called back (via either the mobile network or via a VoIP client) on their mobile device and asked to select a specific audio source that they can then listen to, either from the mobile device's speaker or using headphones plugged into their mobile device. Audio content is then streamed to the user from a media player to the server (via a bespoke V0IP connection) and then from the server to the mobile device (either via a VoIP connection or a standard mobile network call).

In the case where a dedicated software application (an "app") is used on the mobile device then the step of receiving a communications message at the server may result from a user initiating the app when they want to connect to an audio source and the communications channel that is initially opened between the mobile device and the server may comprise a server-to-app communications channel. Once the user has fed back their audio selection then the server-to-app communications channel may be transitioned into a voice conference call in order to relay the audio stream to the user.

Multiple users can listen to the same audio; the number of concurrent listeners is not limited by the availability of wired or wireless headsets.

When the communications message is an SMS message, the communications channel may be a voice communications channel. In the case where a dedicated app is provided for the mobile device, the communications channel and the communications message may comprise standard smartphone interactions.

The ability to listen to the audio on their mobile device overcomes the problem of background noise that is inherent to a busy environment where a user may also be watching video near to the audio from other videos. They may also be a distance from the video and would be unable to hear the audio they are interested in clearly.

By using a server to control the process, neither the mobile device nor the display device need be provided with processing power or capability beyond their standard functionality.

The output from the display device is controlled directly by the server, and separately the mobile device communicates with the server. In this way, there is no need to provide a communications channel between the display device and the mobile device, and the associated processing power and logic for each device that would be necessitated by this.

It is noted that the communications message may be an SMS. However, alternative message types may be used. For example, the mobile device may send an MMS, an email or a Bluetooth based message.

The communications channel may comprise a telephone call over a mobile communications network between the server (call management logic server) and the mobile device. The communications channel may comprise a voice over IP connection between the server and the mobile device.

Conveniently, the selection of available audio streams may be provided to the user via an interactive voice response (IVR) system. User selection of the IVR selections may comprise the user pressing a key on their mobile device.

According to a second aspect of the present invention there is provided a method of providing an audio stream to a mobile device associated with a user, the audio stream being associated with a video playing on a display device, the method comprising: providing a media player for supplying a video stream and an audio stream associated with the video stream; connecting a video output of the media player to the display device; connecting an audio output of the media player to a communications client in communication with a server; sending the audio stream from the server to the mobile device according to the method of the first aspect.

The server may establish a connection with the communications client.

It is noted that the communications client may comprise a voice-over-IF client. In this embodiment, the method may comprise establishing a VoIP connection between the server and the VoIP client. The server may establish either a VoIP connection with the mobile device or establish a voice connection via a mobile telephone network.

Conveniently, the method may comprise connecting a plurality of mobile devices to a particular audio stream by establishing a conference call, where the communications client is a participant on conference call, and where each of the plurality of mobile devices is a participant on the conference call.

The method may comprise disconnecting the conference call in the event that the communications client is the only participant. The method may also comprise checking, upon receiving the user selected audio stream request, to see if an existing conference call is already in progress with the communications client and if so joining the mobile device to that conference call and if not establishing a new conference call to the communications client.

According to a third aspect of the invention, there is provided a server for sending an audio stream to a mobile device associated with a user, the audio stream being associated with a video stream to be provided to a display device, the server comprising: input means for receiving a communications message from the mobile device; processing means arranged to manage communications with the mobile device; communication means for sending the audio stream to the mobile device wherein, upon receiving a communications message from the mobile device at the input means, the processing means is arranged to: (i) establish a communications channel with the mobile device via the communication means; (ii) send a selection of available audio streams to the mobile device; and (Ui) connect, upon receipt of a user selection for a particular audio stream, the communications channel to a conference call, the conference call comprising the user selected audio stream as a participant on the conference call.

The server may comprise a further communication means for establishing a communications channel with a communications client associated with a media player. In this arrangement, the communications client may comprise a voice-over-IF client and the further communication means is arranged to establish a voice-over-IF communications channel with the voice-over-IP client.

Conveniently, the input means may comprise a short messaging service client.

Advantageously, the processing means may comprise an interactive voice response management logic, the interactive voice response management logic being arranged to send the selection of available audio streams to the mobile device.

It will be appreciated that preferred and/or optional features of the first aspect of the invention may be incorporated alone or in appropriate combination in the second aspect of the invention also.

Brief Description of the Drawings

Figures 1 and 2, which illustrate respectively the use of headphones and the use of directional speakers, have already been described. In order that the invention may be more readily understood, preferred non-limiting embodiments thereof will now be described, by way of example only, with reference to the remaining drawings, in which: Figure 3 is a block diagram showing relationships between components of a system according to an embodiment of the invention; Figure 4 is an illustration of use of an implementation the system of Figure 3; and Figure 5 is a schematic illustration of an architecture for the system of Figure 3.

Detailed Description of Embodiments of the Invention With reference to Figure 3, in one embodiment the invention combines the following elements to provide the service described above to the user: an audio/video media player 18; a voice-over-internet-protocol (V0IP) client 20; SMS/conference call/interactive voice response (IVR) management logic 22; and an SMS application (app') 24 provided on a user's mobile device 26, for example a phone.

S

Audio and/or video content is played from a suitable media player 18, for example a television or other suitable display device, and an audio output from the media player 18 is configured as an audio input to the VoIP client 20.

The V0IP client 20 is connected to the media player 18, and is configured to auto-answer incoming calls and relay any audio coming from its audio input to a conference call that includes the listening user as a participant.

The management logic 22 is hosted on a server 28 which receives the SMS request from the user. The management logic 22 is arranged to call the user back and present them with an IVR menu that asks them to press a number corresponding with the video they are watching and therefore the audio they wish to listen to, e.g. "press 2 to listen to the audio for video 2".

The server-side management logic 22 then adds the user as a participant in a conference call including the relevant V0IP client 20 corresponding to the user's IVR choice.

The SMS app 24 provides standard SMS functionality offered by the user's phone 26 that allows the user to send an SMS message to a pre-defined telephone number to request a particular audio source.

The above elements are described singularly, although the invention is such that it can be configured for multiple media players 18 and allow multiple users to listen to a single audio source simultaneously.

With reference now to Figure 4, a typical system usage flow for a user is as follows: 1. The user can see a number of videos 30 playing on monitors 32 in front of them; 2. The user decides they want to hear the audio for the video 30 marked as video 3'; 3. The user retrieves their phone 26 and composes and sends an SMS message to a telephone number advertised near the monitors 32; 4. Within a few seconds the user's phone 26 starts ringing and the user answers the call; 5. The user listens to a voice prompt produced by the IVR that asks them to press the number on their phone's keypad that corresponds with the video 30 they want to watch; 6. The user presses 3'; 7. Audio for video 3' is played from the phone's speaker, or through personal headphones connected to the phone 26; 8. The user listens for a few minutes, and then decides to cancel the call, and presses the call end' button on their mobile phone 26.

Referring now to Figure 5, a typical usage flow between the custom call management logic 22 (referred to as system' below) and the V0IP client 20 is as follows: 1. The system 22 receives an incoming SMS message comprising details of a mobile number associated with the mobile phone 26 from which the SMS message originated; 2. The system 22 calls back the mobile phone 26 using the number obtained from the SMS message and, when the call is answered, presents the user with the IVR asking the user to enter the number for the audio they want to listen to; 3. The system 22 checks that the number entered corresponds with an available audio source, and either repeats the IVR or adds the call as a participant in a conference call for the relevant audio source; 4. The system 22 checks that the audio source requested is already an existing participant in the conference call. If not, the system calls the V0IP client 20 for the relevant audio source into the conference call as a participant; 5. An incoming call to the VoIP client 20 running on the media player causes it to answer and join a conference call, sending the audio configured as its input to the conference call; 6. The system 22 monitors all conference calls and if the only participant is the V0IP client 20 for the audio i.e. no listening users are participating in the relevant conference call, the system 22 drops the call to the VoIP client 20 to save resources; 7. The V0IF client 20 becomes idle.

Systems according to embodiments of the invention can handle a large number of concurrent users listening to the same audio source in environments where using speakers would be impractical due to background noise or proximity. Existing systems are limited by the availability of headsets near the video source, or are limited to using directional speakers that have limitations where audio is being played in close proximity to other audio sources.

The system 22 works with basic handsets (SMS and phone capabilities only) with no requirement for custom apps on expensive srnartphones. This is because the server hosted management logic 22 provides all of the processing power and capability that is required.

A further advantage to this embodiment of the invention is that it allows alternative audio source content to be played against a video 30. For example, the user could be presented with an IVR prompt to offer playback in a different language, or an alternative commentary could be supplied for a specific audience such as a child.

In one embodiment, if repeated or looping' audio content is to be output, the server 28 can cache the audio content locally, and then output audio content from its cache memory rather than continuing to receive an input from the media player 18. This provides a more efficient arrangement in which communications channels are made available for other purposes where possible.

The embodiment described above enables a user to interact with the system with only a very basic handset. Indeed, one of the advantages of the above described embodiment is that it doesn't rely on a dedicated app; standard applications 24 that are provided to enable basic functionality such as SMS messaging are used to interact with the system. However, in an alternative embodiment, a dedicated app could be developed to complement the server-side logic 22, and thereby provide an enhanced user experience. For example, the app can be arranged to augment the audio with additional information such as statistics or social feeds.

A dedicated app could also use a built-in VoIP client 20 on the device 26 to receive and play the audio received over the network rather than using the mobile network. A dedicated app would also allow quick user selection between the different audio sources.

The above described embodiments are placed in the context of a store environment, but alternative embodiments of the invention can be configured for use in several other environments. Examples of other possible environments which might benefit from implementation of a system according to an embodiment of the invention include: museums, where the system allows users to view and listen to commentaries around exhibits; and concerts or sporting events, where a user's proximity to the performers might make it desirable to have a dedicated audio feed to the user's mobile device 26.

It will be appreciated by a person skilled in the art that the invention could be modified to take many alternative forms to that described herein, without departing from the scope of the appended claims.

Claims

Claims 1. A method of sending an audio stream from a server to a mobile device associated with a user, the audio stream being associated with a video stream provided to a display device, the method comprising: receiving a communications message from the mobile device at the server; establishing a communications channel with the mobile device; sending a selection of available audio streams to the mobile device; receiving a user selection for a particular audio stream; and connecting the communications channel to a conference call, the particular audio stream being a participant on the conference call.
2. A method as claimed in Claim 1 wherein the communications message is an SMS.
3. A method as claimed in Claim 1 or Claim 2, wherein the communications channel comprises a telephone call over a mobile communications network between the server and the mobile device.
4. A method as claimed in Claim 1 or Claim 2, wherein the communications channel comprises a voice over IP connection between the server and the mobile device.
5. A method as claimed in any preceding claim, wherein the selection of available audio streams are provided to the user via an interactive voice response system.
6. A method as claimed in Claim 5, wherein the user selection to the IVR selections comprises the user pressing a key on their mobile device.
7. A method of providing an audio stream to a mobile device associated with a user, the audio stream being associated with a video playing on a display device, the method comprising: providing a media player for supplying a video stream and an audio stream associated with the video stream; connecting a video output of the media player to the display device; connecting an audio output of the media player to a communications client in communication with a server; sending the audio stream from the server to the mobile device according to the method of any one of Claims ito 6.
8. A method as claimed in Claim 7, wherein the communications client comprises a voice-over-IP client.
9. A method as claimed in Claim 8, complising establishing a V0IP connection between the server and the VoIP client.
10. A method as claimed in Claim 9, wherein the server establishes either a V0IP connection with the mobile device or establishes a voice connection via a mobile telephone network.
11. A method as claimed in any of claims 7 to 10, comprising connecting a plurality of mobile devices to a particular audio stream by establishing a conference call, and wherein the communications client is a participant on the conference call each of the plurality of mobile devices is a participant on the conference call.
12. A method as claimed in Claim ii, comprising disconnecting the conference call in the event that the communications client is the only participant.
13. A method as claimed in Claim 11 or 12, comprising checking, upon receiving the user selected audio stream request, to see if an existing conference call is already in progress with the communications client and if so joining the mobile device to that conference call and if not establishing a new conference call to the relevant communications client.
14. A server for sending an audio stream to a mobile device associated with a user, the audio stream being associated with a video stream to be provided to a display device, the server comprising: input means for receiving a communications message from the mobile device; processing means arranged to manage communications with the mobile device; communication means for sending the audio stream to the mobile device wherein, upon receiving a communications message from the mobile device at the input means, the processing means is arranged to: (i) establish a communications channel with the mobile device via the communication means; (ii) send a selection of available audio streams to the mobile device; and (Ui) connect, upon receipt of a user selection for a particular audio stream, the communications channel to a conference call, the conference call comprising the user selected audio stream as a participant on the conference call.
15. A server as claimed in Claim 14, comprising a further communication means for establishing a communications channel with a communications client associated with a media player.
16. A server as claimed in Claim 15, wherein the communications client comprises a voice over IP client and the further communication means is arranged to establish a voice over IP communications channel with the voice over IP client.
17. A server as claimed in any one of Claims 14 to 16, wherein the input means comprises a short messaging service client.
18. A server as claimed in any one of Claims 14 to 17, wherein the processing means comprises an interactive voice response management logic, the interactive voice response management logic being arranged to send the selection of available audio streams to the mobile device.