GB2460219A

GB2460219A - Interaction between Audio/Visual Display Appliances and Mobile Devices

Info

Publication number: GB2460219A
Application number: GB0808741A
Authority: GB
Inventors: Rajeev Hegde
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2008-05-14
Filing date: 2008-05-14
Publication date: 2009-11-25
Anticipated expiration: 2028-05-14
Also published as: KR20090118837A; GB0808741D0; GB2460219B

Abstract

A communication system comprises: a mobile device 1a, 1b comprising first interface means 12, 21 providing wireless communication between the mobile device and a communication network 2, and second interface means 13,31 providing wireless communication between the mobile device and an appliance 3 adapted to provide at least one of a visible signal and an audible signal. The mobile device is adapted to control the visible/audible appliance via the second interface wireless communication and the appliance is further adapted to send an audio signal to the mobile device via said second interface wireless communication. The mobile device is further adapted to output an audible signal corresponding to the received audio signal to a user. The audio/visual appliance may communicate directly with the mobile device or may communicate through an intermediate device (see Fig.4). The first interface may be GSM, CDMA, UMTS, WiFi or Bluetooth ad the second interface may be CDMA, WiFi, Bluetooth. In certain embodiments the mobile device is a mobile phone, a wireless headset, and the visible/audible appliance is a TV, PC, projector, a theatre display, a message board e.g. at an airport or railway station. In some embodiments different users can select different video portions from a multi-display device displaying picture in picture video, with different respective audio being sent to their mobile devices for listening. Alternatively, users watching the same video can receive different language audio via their mobile devices.

Description

Interaction between Aprliances and Mobile Devices

Field of the Invention

The present invention relates to the interaction between appliances and mobile devices, and in particular, although not exclusively, to the control of appliances such as televisions by mobile devices such as mobile telephones. Certain embodiments are concerned with home networking in general, and more specifically with mobile devices networking with home devices.

Background to the Invention

It is known for some televisions to be operable in a so-called picture-in-picture mode, in which different video content can be displayed on different portions of a single screen.

However, this is typically set up and controlled by a single user, with a single remote control, and is not optimised for enjoyment by multiple users. Only the user with the remote control device has control over the television, and when multiple video images (pictures) are displayed the television will only output sound (i.e. audio content) corresponding to one of the pictures; the others are presented as video only.

*::::* Another limitation associated with viewing is that currently it is not possible for a plurality * of individuals with different language preferences to watch videos together on a :.: television (TV), or other display device, such as a personal computer (PC), without at 25 least one of them having to compromise (the television or PC can output audio in only one selected language).

S..... * . ** . S*

* Summary of the invention

It is an aim of certain embodiments of the invention to solve, mitigate or obviate, at least partly, at least one of the problems and/or disadvantages associated with the prior art.

Certain embodiments aim to provide at least one of the advantages described below.

According to a first aspect of the invention there is provided a communication system comprising: a mobile device comprising first interface means, adapted to provide wireless communication between the mobile device and a communication network, and second interface means; an appliance adapted to provide at least one of a visible signal and an audible signal to a person; and appliance interface means, wherein: the second interface means and the appliance interface means are adapted to provide wireless communication between the mobile device and the appliance; the mobile device is further adapted to control the appliance via said wireless communication between the mobile device and the appliance provided by the second interface means and the appliance interface means; the appliance is further adapted to send an audio signal to the mobile device via said wireless communication between the mobile device and the appliance provided by the second interface means and the appliance interface means; and the mobile device is further adapted to output an audible signal corresponding to the received audio signal to a user.

The mobile device may, for example, be a mobile phone, a cell phone, a personal digital assistant (PDA), or another portable device.

It will be appreciated that the mobile device may comprise means for converting the * received audio signal (which may, for example, be a digital signal) into the analogue, audible signal for a user. * 25

It will also be appreciated that in the context of this specification, control of the appliance ** **** :. by the mobile device encompasses control of at least one operational aspect, feature, or * function of the appliance, but does not necessarily mean total control of the appliance. In embodiments where the appliance comprises a screen for displaying images, this control may thus include control of one or more of the following: playing video, playing audio, support of picture-in-picture, changing channels, changing volume, changing brightness, changing contrast, and powering down.

In certain embodiments the first interface means is adapted to provide wireless voice communication between the mobile device and the communication network.

In certain embodiments the appliance comprises the appliance interface means.

Alternatively, the system may comprise an intermediate device and connection means connecting the intermediate device to the appliance, wherein the intermediate device comprises said appliance interface means.

In certain embodiments the first interface means comprises at least one of: a GSM interface; a CDMA interface; a UMTS interface; a WiFi interface; a Bluetooth interface; and an interface of another similar wireless protocol.

In certain embodiments the second interface means comprises at least one of: a CDMA interface; a WiFi interface; a Bluetooth interface; and an interface operating in accordance with another similar communication protocol.

In certain embodiments the appliance interface means comprises at least a corresponding one of: a CDMA interface; a WiFi interface; a Bluetooth interface; and an interface operating in accordance with another similar communication protocol.

In certain embodiments the second interface means and the appliance interface means are adapted to provide wireless communication between the mobile device and the appliance in accordance with a protocol selected from a list comprising: Universal Plug and Play (UPnP); Devices Profile for Web Services (DPWS); NAT-PMP; CPNS * (converged personal network services, an OMA (open mobile alliance) standard); and :.: other similar protocols for device discovery and communication. 25

In certain embodiments the mobile device comprises at least one earpiece or earphone U.....

:. and the mobile device is adapted to output said audible signal from the earphone or * . earpiece.

For example, the mobile device may comprise a body portion and a wired connection connecting the body portion to the or each earpiece or earphone.

This body portion may also be referred to as a main portion of the mobile device, and the wired connection may be permanently wired to the body portion, but more typically it is detachable by means of a suitable plug.

It will be appreciated that in certain embodiments the mobile device body portion may itself comprise a speaker, and rather than the audible signal being output from an earphone or ear piece, the audible signal may be output directly from the speaker of the body portion.

In certain embodiments the mobile device comprises a body portion and wireless connection means connecting the body portion to the or each earpiece or earphone.

For example, the ear piece or ear phone may form part of a wireless headset, that headset being in wireless communication with the body or main portion of the mobile device (which may be in the form of a telephone handset, for example). The handset and headset may utilise a number of protocol for performing this wireless communication over short range, for example the well-known Bluetooth format.

In certain embodiments the appliance is a display device adapted to display images on screen (which may, or may not be part of the display device itself).

In certain embodiments the appliance comprises a screen adapted to display video images, and the mobile device is operable to control the appliance to select video *:::* 20 content for display and to display the selected video content on the screen.

*::::* In other words, the mobile device may be usable, in effect as a remote control for the * appliance, to choose video content for display. It may have control over the entire screen :.: * in which case the selection of the video for display corresponds to the selecting of a 25 channel or program for display. Alternatively, the mobile device may be usable to select a video image to be displayed on just a portion of the screen, for example when the **.*.* appliance is a TV set operable in a picture-in-picture mode.

In certain embodiments the appliance is adapted to send said audio signal to the mobile device, said audio signal corresponding to the selected video content.

In certain examples, there may be only one audio signal (ie. audio content) corresponding to the selected video content, in which case the appliance may be arranged to simply send that audio signal to the mobile device of the user. However, in certain other examples, there may be a number of audio signals corresponding to the selected video, each of these audio signals having different audio content. In such cases, the mobile device may be further operable to select which of the audio signals the user wishes to accompany the selected video. For example, these different audio signals may include audio content in different languages and/or different commentaries. It is also possible in certain embodiments that the user of the mobile device may wish to receive audio content that is completely unrelated to the selected video, and embodiments of the invention are able to accommodate this by displaying the selected video on the screen of the appliance and simultaneously sending the selected audio to the user's mobile device. For example, the selected video may be coverage of a sporting event, whilst the selected audio may correspond to a music channel or some other radio program, In certain embodiments the mobile device is further operable to control the appliance to select one of a plurality of audio signals, each corresponding to the selected video content, and the appliance is adapted to send the selected audio signal to the mobile device.

Thus, in certain embodiments the appliance may be adapted to display video content, * 20 and route some optional (selected) audio content, associated with the displayed video, to the mobile device. *.** * * ****

* In certain embodiments the system further comprises at least one additional mobile device, each additional mobile device comprising a respective said first interface means, and a respective second interface means, the arrangement being such that each additional mobile device is operable to control the appliance via wireless communication ** *..* :. ; provided by the respective second interface means and the appliance interface means, * and the appliance is further adapted to send a respective audio signal to each additional mobile device via the wireless communication provided by the respective second interface means and the appliance interface means, and each additional mobile device is adapted to output a respective audible signal corresponding to the respective received audio signal to a user.

In certain embodiments each of the mobile and additional mobile devices is adapted to control the appliance to select respective video content for display and to display the selected respective video content on a respective portion of the screen, and the appliance is adapted to send a respective said audio signal to each of the mobile and additional mobile devices, each respective audio signal corresponding to the respective selected video content.

Thus, users of two or more mobile devices in the vicinity of the appliance may be able to select different video images and have those different images displayed on respective portions of the single screen of the appliance. The appliance is then adapted to send audio signals having audio content to accompany the different video images to the appropriate respective mobile devices. Then, although the mobile devices may output their audible signals directly from built-in speakers, it is preferable that this audible output is by means of earphones or earpieces of the respective mobile devices so that the users can enjoy their chosen videos and accompanying audio files without interference from the other.

In certain embodiments each of the mobile and additional mobile devices is further adapted to select one a plurality of audio signals corresponding to the selected respective video content, and the respective said audio signal sent by the appliance to each device comprises the respective selected audio signal. * **

In certain embodiments each of the mobile and additional mobile devices is further adapted to select one a plurality of audio signals corresponding to the selected video content, and the respective said audio signal sent by the appliance to each device comprises the respective selected audio signal. 25

Thus, the appliance may be displaying a single selected video clip or program (that 55...

selection having been made by one or more of the mobile devices, or alternatively by * . means of a control input or a remote control device associated with the appliance. At the same time, the users of the different mobile devices are able to select which audio signals they wish to receive to accompany the displayed video. In particular embodiments, the user may have the choice of audio content in a number of different languages to accompany a particular video image. Thus, different users having different mobile devices may select audio content in a language of their choosing, and the appliance sends the appropriate audio content to each mobile device over the wireless interface provided by the appliance interface means and the respective second interface means.

Another aspect of the invention provides a communication system comprising: a display device (e.g. a television); and a plurality of mobile devices, each comprising a first interface for wirelessly communicating with a communications network and a second interface for wirelessly communicating with the display device, wherein the display device is adapted to display a plurality of video images, each on a respective portion of a screen (eg. a screen of the television), and to transmit wirelessly to the second interface of each mobile device a respective audio signal corresponding to one of the plurality of video images, each mobile device being further arranged to output an audible signal corresponding to the respective received audio signal to a user.

The display device may itself comprise the screen, or the screen may be a separate component of the communication system.

In certain embodiments each mobile device is further adapted to control the display device via the respective second interface to select a respective video image for display *:*::* 20 and to display the selected respective video image on a respective portion of the screen.

*,,**. Another aspect of the invention provides a communication system comprising: * a display device (e.g. a television); and :.: a plurality of mobile devices, each comprising a respective first interface for 25 wirelessly communicating with a communications network and a respective second interface for wirelessly communicating with the display device, *I*S** :. ; wherein the display device is adapted to display a video image on a screen, and * to transmit wirelessly to the second interface of each mobile device a respective audio signal, each mobile device being further arranged to output a respective audible signal corresponding to the respective received audio signal to a user.

Again, the display device may itself comprise the screen, or the screen may be a separate component of the communication system.

In certain embodiments each mobile device is further adapted to control the television via the respective second interface to select said respective audio signal from a plurality of audio signals.

In certain embodiments said plurality of audio signals comprises a plurality of audio signals in different languages, each corresponding to the displayed video image.

Another aspect of the invention provides a mobile device adapted for use in a communication system as defined above.

Another aspect of the invention provides a method of using a mobile device having a first interface for wirelessly communicating with a communication network, the method comprising: providing an appliance, adapted to provide at least one of a visible signal and an audible signal to a person, and appliance interface means; providing the mobile device with second interface means, the second interface means and the appliance interface means being adapted to provide wireless communication between the mobile device and the appliance; using the mobile device to control the appliance via said wireless communication provided by the second interface means and the appliance interface means; *..,.. sending an audio signal from the appliance to the mobile device via said wireless communication provided by the second interface means and the appliance interface means; and * ** :.: outputting an audible signal, corresponding to the received audio signal, from the r 25 mobile device to a user.

S.....

In certain embodiments the appliance is a display device adapted to display images (e.g. video images) on a screen.

In certain embodiments the appliance comprises a screen, and the method further comprises using the mobile device to control the appliance to select a video image for display and to display the selected video image on the screen.

In certain embodiments, the method further comprises displaying the selected video image on a portion of the screen.

In certain embodiments the audio signal sent to the mobile device corresponds to the selected video image.

In certain embodiments the method further comprises using the mobile device to select the audio signal from a plurality of audio signals.

Another aspect of the invention provides a communication method comprising: providing a mobile device having first interface means for wirelessly communicating with a communication network; providing an appliance, adapted to provide at least one of a visible signal and an audible signal to a person, and appliance interface means; providing the mobile device with second interface means, the second interface means and the appliance interface means being adapted to provide wireless communication between the mobile device and the appliance; using the mobile device to control the appliance via said wireless communication provided by the second interface means and the appliance interface means; sending an audio signal from the appliance to the mobile device via said wireless communication provided by the second interface means and the appliance interface means; and * 20 outputting an audible signal, corresponding to the received audio signal, from the mobile device to a user. * * *

In certain embodiments the method further comprises: providing a second mobile device having a respective first interface means for r 25 wirelessly communicating with a communication network, and a respective second interface means, the respective second interface means and the appliance interface * means being adapted to provide wireless communication between the second mobile *.. device and the appliance; using the second mobile device to control the appliance via said wireless communication provided by the respective second interface means and the appliance interface means; sending a second audio signal from the appliance to the second mobile device via said wireless communication provided by the respective second interface means and the appliance interface means; and outputting a second audible signal, corresponding to the received second audio signal, from the second mobile device to a user.

In certain embodiments the appliance comprises a screen for displaying video images, and the method further comprises: using at least one of the mobile devices to control the appliance to select a video image for display and to display the selected video image on the screen; and using at least one of the mobile devices to select at least one of said first and second audio signals from a plurality of audio signals having different audio contents, whereby users of the mobile devices may be provided with different audio contents to accompany the selected video image.

In certain embodiments the appliance comprises a screen for displaying video images, and the method further comprises: using the first mobile device to control the appliance to select a first video image for display and to display the first selected video image on a first portion of the screen; using the second mobile device to control the appliance to select a second video image for display and to display the second selected video image on a second portion of the screen, and wherein the first audio signal and the second audio signal correspond to the first and second video images respectively. * **

., In certain embodiments the method further comprises using at least one of the mobile S... . . ***** devices to select at least one of said first and second audio signals from a plurality of audio signals having different audio contents.

25 In certain embodiments the method further comprises: detecting the presence of the or each mobile device in a vicinity of the S. :. : applicance; and : registering the or each mobile device with the appliance to enable control of the appliance by the or each mobile device.

Another aspect of the invention provides a computer program comprising instructions arranged, when executed, to implement a method as claimed in any claim and/or a system as claimed in any claim of this specification.

Another aspect of the invention provides machine-readable storage storing a program as defined above.

It will be appreciated that in certain embodiments the appliance is a television or another device having a screen for displaying video images. However, in alternative embodiments the appliance may be a different device. For example, the appliance may be a device for use in the domestic environment, or a device for use in other environments, such a public places. For example, in certain embodiments the appliance is, respectively: any appliance that plays video on a screen; a TV; a PC; a projector adapted to project video images onto a screen; a theatre display device/screen; and a message board, for example in a railway station or airport (where the facility to provide audio in a language of choice to different users to accompany a video display, perhaps displaying travel information, is of particular advantage). In general, certain embodiments are concerned with systems and methods for displaying video content to users with some device/appliance, and sending those users some optional audio associated with the displayed content. However, it will be appreciated that the invention in its broadest sense is not limited to incorporating or using appliances able to display video. For example, in certain embodiments the appliance may be a radio or indeed any other device adapted to provide at least one of a visible and audible signal to a user.

It will be appreciated from the above that certain embodiments of the invention provide the advantage that when more than one user is watching a single TV operating in *:*:: Picture in Picture mode, all of the users may exercise control over the TV (complete, or at least partial) by means of their respective mobile devices (e.g. mobile phone handsets). Furthermore, the users can enjoy separate audio output from the different * ** :.: videos they watch. The provision of TV control to the mobile devices may be seamless, r 25 with this control being automatically provided to a mobile phone as it is brought into the vicinity of the appliance.

** **** * S ** S * S * It will also be appreciated that certain embodiments of the invention provide a mechanism by which different users can watch the same video on the same device (or view the same information on some display device/screen) while listening to different audios over their mobile device headsets (and optionally using the TV audio system as well).

From the above, it will be appreciated that the term appliance in this specification should be interpreted broadly; it encompasses machines and devices used domestically, machines and devices used in other environments (e.g. publicly, in the case of theatre displays/screens and message sceens/displays/boards), and pieces of equipment having a specific function. In particular, it encompasses televisions, television projectors, display screens, message boards, computers, radios, and other audio-visual equipment, but of course this list is not exhaustive.

Brief Description of the Drawings

Embodiments of the invention will now be described with reference to the accompanying drawings, of which: Fig 1 is a schematic representation of a first communication system embodying the invention; Fig 2 is a schematic representation of another communication system embodying the invention; Fig 3 is a schematic representation of yet another communication system embodying the invention; Fig 4 is a schematic representation of another communication system embodying the invention; Fig 5 is a schematic representation of another communication system embodying the invention; Fig 6 is a block diagram showing the components of a communication system embodying the invention; Fig 7 illustrates the exchanges of messages in a communication system embodying the r 25 invention; Fig 8 illustrates the exchange of messages in another communication system l.a...

embodying the invention;

Description of embodiments of the invention

Referring now to Fig 1, a first communication system embodying the invention comprises a mobile device 1 in the form of a mobile phone handset which comprises first interface means (not shown in the figure) adapted to provide wireless communication between the mobile device 1 and a communication network 2. This wireless communication comprises wireless signals 21 sent from the communication network 2 to the mobile device 1, and wireless signals 12 sent from the mobile device 1 to the communication network 2. It will be appreciated that this first interface means thus comprises suitably adapted receiver and transmitter means in the device 1 and these may be provided by a single transceiver module for example. The communication system also comprises an appliance 3 in the form of a television in this example, adapted to provide both visible signals and audible signals to a person. This television 3 comprises a screen 30 for displaying video images and speakers (not shown in the figure) for outputting audio to users in the vicinity of the television in certain modes of operation. In this embodiment the television 3 also comprises appliance interface means (not shown in the figure) and the mobile device 1 also comprises second interface means (also not shown in the figure). The second interface means and the appliance interface means are adapted to provide wireless communication between the mobile device and the television 3, this wireless communication comprising the sending of wireless signals 13 from the device 1 to the appliance 3, and wireless signals 31 from the appliance 3 to the device 1. The television 3 is further adapted to send an audio signal to the mobile device 1 by means of this wireless communication (in other words, the wireless signal 31 may comprise or consist of this audio signal, and the mobile device is adapted to output an audible signal 14 corresponding to the received audio signal to a user 4.

It will be appreciated that in this first example the first interface means of the mobile phone 1 it adapted to provide wireless voice communication between the device 1 and the communication network 2. Advantageously, in this first embodiment the mobile * phone 1 may be adapted to perform one or more of the functions normally associated with a remote control device for the television 3 and may thus be operable to control 25 channel selection, volume, brightness etc. In certain examples, the television 3 is adapted to detect when the mobile device 1 is in its vicinity and then hand over control of S. dS*e one or more of its functions to the mobile device 1. An advantage of this system is that a : user of the mobile device 1 entering the vicinity of the television 3 may be automatically allocated control of the television without having to look for any remote control device. If the user was carrying the mobile device I in any case, this is a convenient, automatic way of providing the user with control of the appliance 3. In certain examples, the audio signal sent from the television 3 to the mobile device 1 comprises audio content corresponding to a video image, file, or program being displayed on the screen 30 of the television 3 and is instead of the television directly outputting the audio content from its own speakers. This can be advantageous in a number of circumstances, and for example provides the user with the ability to listen to the audio content more discreetly without disturbing other people in the vicinity of the television. For example, in the home environment, a user of the mobile phone may be able to listen to the audio file corresponding to a particular video image via their mobile phone whilst others are free to read a book or magazine or indulge in other activities in relative peace and quiet.

Alternatively, in a public environment such as a sports club or bar area users may be able to listen to audio content such as commentary on a sporting event being displayed on the television without that commentary having to be directly output from the television, which would possibly be annoying to other people in the public area having no interest in the displayed event.

Referring now to Fig 2, this shows another communication system embodying the invention. Again the system comprises a television 3 having a screen 30 for displaying video images. The system further comprises two mobile devices la and lb. Each mobile device comprises a respective first interface for wirelessly communicating with a communication network 2 and a respective second interface for wirelessly communicating with the television 3. The television 3 is adapted to display video images on its screen and to transmit wirelessly to the second interface of each mobile device la, lb a respective audio signal. Each mobile device la, lb is then further arranged to output a respective audible signal 14a, 14b corresponding to the respective received audio signal, to a user. bb * **

In this example, each mobile device la, lb is further adapted to control the television 3 * via the respective second interface. The wireless signals sent from the mobile devices to : * the television are denoted by arrows 13a, 13b and the wireless signals sent from the 25 television 3 to the mobile devices are denoted by arrows 31a and 31b. Arrows l2a, 12b, 21a and 21b denote the wireless signals sent between the mobile devices and the ** *** :. ; communication network 2. In this example, mobile device la has controlled television 3 * to select a video image and display that video image on a portion 301 of the display 30.

Similarly, mobile device lb has been operated by a user to control the television 3 to select another, different video image and display that different video image on a second portion 302 of the display 30. Thus, the two video selections are being displayed on different respective portions of the screen. In this example, those portions are completely separate areas of the screen, although it will be appreciated that in other examples there may be some overlap, or indeed one image may be displayed completely within the other. The television 3 is arranged to send an audio signal wirelessly to the first mobile device la, that audio signal containing audio content corresponding to the image displayed in portion 301 of the screen. Similarly, the television sends a second audio signal to the second mobile device lb containing audio content corresponding to the video shown in the second portion 302 of the screen. Thus, different images may be displayed on the single screen 30, with the different corresponding audio signals being output to the two separate users of the mobile devices via those respective mobile devices. Advantageously, this system enables two different users to select and watch their choice of image on the single television, and receive the corresponding audio via their mobile phones.

Referring now to Fig 3, this shows another communication system embodying the invention. Here, the system again comprises a television 3 which is displaying a single video image on its screen 30 (this video image may also be referred to as a video file, clip, or program). Again, two mobile devices 1 a and 1 b are in the vicinity of the television 3, and each has a respective first interface providing wireless communication between the mobile device la, lb and the communication network 2 so that the users of the mobile devices can make and receive at least voice calls. Also, each mobile device comprises a suitably arranged interface to provide wireless communication between it and the television 3. Although a single video file is being displayed on the screen 30, the system is arranged so that the users of the mobile devices la, lb are able to operate those devices to select which audio content they wish to receive to accompany the displayed video. Thus, the two mobile devices are not limited to receiving the same audio content. In this particular example, the user of device la has operated that device to select an English language audio content to accompany the displayed video, and an audio signal containing that English language content is being transmitted to the first S...

mobile device la in a wireless signal 3la from the television 3. In contrast, the user of device lb has selected a French language commentary to accompany the displayed *. video, and receives and audio signal 31b containing that French commentary wirelessly from a television 3.

*. **.. * .

.. 30 In this example, rather than each mobile device outputting its audible signal 14a, 14b from a built-in speaker, each outputs the audible signal from a respective earphone or earpiece. Mobile device la comprises an earpiece lOOa connected to its main body portion by a wired link lOla. In contract, mobile device lb comprises a wireless headset including an earpiece 200b. The main portion or handset of the mobile device lb is in wireless communication with the wireless headset and the wireless link provided between the 2 is denoted by arrow 201b in the figure.

It will be appreciated that the system shown in Fig 3 provides the advantage that it enables different users to chose different language audio, or different commentaries to accompany a particular video image being displayed on the single television 3.

Furthermore, by outputting the audible signals containing the chosen contents from earphone or earpieces each user can enjoy their selected audio without interference from the other.

Moving on to Fig 4, this shows another system embodying the invention. Here the system comprises a mobile device 1 in the form of a telephone handset having a first interface to provide wireless communication with a communication network 2. The wireless signals exchanged between the handset 1 and communication network 2 are again denoted by arrows 12 and 21 The system also comprises an appliance 3 in the form of a television, and the television and mobile phone 1 are adapted to communicate wirelessly with each other. However, in contrast to previous embodiments, the television does not itself comprise the appliance interface means. Instead, the system comprises an intermediate device 5 which comprises the appliance interface means, and the mobile phone I includes second interface means adapted to communicate with the appliance interface of the intermediate device 5 via the exchange of wireless signals 51 and 15.

The intermediate device is then connected to the appliance 3, so that signals 35 can be sent from the appliance 3 to the intermediate device 5, and signals 53 can be sent from the intermediate device 5 to the appliance 3. The connection providing the exchange of the signals 35 and 53 is in some embodiments a wired link whilst in others it may be a wireless link. Although this system comprises the intermediate device 5, the mobile device I again is operable to control the appliance 3 wirelessly, and similarly the appliance is adapted to send an audio signal to the mobile device wirelessly. The mobile device is then adapted to output an audible signal 14 corresponding to the audio signal received from the television 3 via the intermediate device 5.

*. S*.. * *

*..: 30 Moving onto Fig 5, this shows yet another system embodying the invention. Here, the system comprises an appliance 3 in the form of a radio having a radio or antenna 35 adapted to receive radio signals 135 from a remote broadcasting source. The radio comprises at least one speaker adapted to directly output an audible signal 315 to a user in the vicinity. The system further comprises a plurality of mobile devices la, lb, each comprising a respective first interface means adapted to provide wireless communication between the mobile device and the communication network 2 and respective second interface means. The radio 3 comprises appliance interface means (which may also be referred to as wireless interface means), where the respective second interface means and the appliance interface means are adapted to provide wireless communication between the radio 3 and each of the mobi!e devices. Each mobile device la, lb is operable to control the radio 3 via the wireless link to select respective audio content, and the radio 3 is adapted to wirelessly transmit an audio signal comprising the respective selected audio content to each device. Each device 1 a, lb is then arranged to output an audible signal for a user. Thus, different users may select different audio content from the radio 3, and receive that content via their mobile phones. This may be in addition, or as an alternative to the radio 3 emitting audio content directly from its loudspeaker or loudspeakers. Again, it will be appreciated that this system provides the advantage that different users in the vicinity of the radio are not limited to listening to the same audio content; instead they have choice and can listen to their selected audio by means of their selective phones. Furthermore, even in the case where just one mobile phone user is in the vicinity of the radio, it is convenient that the user is able to use their mobile phone to control the radio and select audio output remotely. A user may thus operate their mobile phone to select from a plurality of different radio channels. The user may also operate the mobile phone to control other aspects of the radio, for example volume, tone etc. Although in the systems described above the appliances have been televisions and radios, it will be appreciated that the invention in its broadest sense is not limited to just these appliances. Different embodiments may comprise different appliances, for ** example, but not limited to: TVs; computers; PCs; message boards; projectors; display screens and units; theatre displays and screens.

Further embodiments will now be described with reference to figures 6, 7 and 8.

S

S. *S*5 * One such embodiment is concerned with the control of individual picture-in-picture : 30 elements using one or more mobile devices. In this embodiment, each mobile device is equipped with: first interface means, comprising a modem processor adapted to make and receive calls over existing Radio technologies like GSM, CDMA, UMA, etc.; and second interface means (a second communication interface) which may be either physical (i.e. having separate physical radio characteristics compared to the first interface means) or logical i.e. only occupying a logical channel within a sole/single physical communication interface (in other words, the first and second interface means may be separate physical entities, e.g. a GSM interface and a WiFi interface, or may be provided by a single physical interface, e.g. a WiFi interface).

The mobile device is capable of simultaneous communication over both communication interfaces (i.e. it can communicate at the same time over the first and second interface means). The application services existing on the mobile device are also capable of concurrent execution along with communicating over the second interface.

The system of this embodiment also comprises one or more appliances (e.g. home devices). In this and the following examples the appliance is a TV, but in other embodiments different appliances may be used.

The home device is capable of communicating with the mobile device over the mobile device's second communication interface. To do this, either the home device (appliance) itself comprises suitable wireless interface means (appliance interface means), or the system further comprises an enabling device (intermediate device) in connection (physical or wireless) with home device, and the enabling device comprises the suitable wireless interface means which is capable of communication with the mobile device's second interface means.

This embodiment enables the mobile device to perform all the functionality originally *:*::* performed by the TV remote controller. ln particular it addresses scenarios where there are multiple users watching TV in Picture in Picture mode.

In this embodiment, a well defined communication protocol is used for communication between the mobile device and the TV over the second interface of the mobile device and the appliance interface means. In this example a UPnP protocol is used, but other *. *...

embodiments may use different protocols.

* *. 30 It will be appreciated that interaction between the mobile devices and appliance according to the UPnP protocol (standard) comprises steps including initial discovery and registration; such steps are well known and well defined in the UPnP protocol, and will not be discussed in detail in this specification. In general, this specification will only addresses changes or deviations that are required in the UPnP protocol specification to accommodate embodiments of the invention.

Components of the system of the current embodiment are shown in Fig. 6. The home device 3 (a TV) comprises a display unit or screen 30, a microcontroller 3, audio output means 302 (typically a plurality of loudspeakers), a remote controller 306, a data store or memory 304, and interface means 305 for wirelessly communicating with the second interface means 102 of the mobile device 1. In the illustrated embodiment, the appliance interface means 305 is part of the appliance 3, but in other embodiments the appliance interface means may be external to the appliance, for example in a separate device, as will be appreciated from the above description. The wireless communication link between the appliance 3 and mobile device 1 is denoted by reference number 131. The mobile device 1 also comprises first interface means 101 adapted to send wireless signals 12 to, and receive wireless signals 21 from a communication network.

Operation of the system is as follows. After initial registration (of the mobile device with the appliance 3 in this example) the TV (although being a control point) sends a list of its capabilities to the mobile device in XML format. These include Boolean values for: Playing video Playing audio Support of Picture in picture Changing channels changing volume *:*::* changing brightness changing contrast e..

powering down Multiple audio channel decoding support.

Multiple video channel decoding support.

Hard disk presence and details *. S*.S * S S. * : 30 It also sends a list of events that it can send to the mobile device if requested for in the registration process. These include but are not limited to: Power up -this will cater only for soft power up.

power down -only when there is a graceful power down channels changed by the TV -include tuning into external device for e.g. DVD player information on new channel like number of audio channels number of subtitles present Picture in picture mode enabled External device connected physically Hard disk full registration status of other control points The mobile device is adapted to recognize the list of capabilities, and allows the user to control the T\J.

For example 1, the mobile device may be operated to change channels of the TV, as follows. A user of the mobile device chooses to change the channel via a special user interface provided for the same. The mobile device then sends this information over the UPnP stack which formats this as an XML file and sends it over to the control point connected to the TV. The TV receives this message and changes the channel. Once the channel is changed "Channel changed event" is generated. Since the mobile device is previously registered for the channel changed event a message formatted as an XML file by the UPnP stack on the TV is sent over to the mobile device (over the wireless link 131). Upon receipt of this information the mobile device displays a success indication to the user over the specially designed user interface.

Now consider the case when another user enters the room, and that user's mobile device (mobile device 2) registers with the control point running on the TV. In other words, the user has another mobile device, and bringing that device into the vicinity of ** the TV generates a registration event on the control point. This information is sent to the first mobile device (mobile device 1). The user of mobile device 1 may choose to turn on picture in picture mode; the second user (of mobile device 2) may choose to turn on picture in picture; or either of the users my turn on picture in picture using the TV remote controller (which may still be operable to control the TV, even though each mobile device *. ...S also has control). Once this is enabled an event is generated on the TV and sent to all *. 30 the mobile devices.

Then, the two mobile devices are randomly assigned windows on the TV. Now the two userS are allowed to control the video channels on their individual picture windows, and the audio from the respective videos are streamed to the respective mobile devices.

These devices may further stream their respective audio to Bluetooth headsets of the respective mobile devices.

The messages exchanged when exerting individual control over picture in picture elements in an embodiment of the invention is shown in figure 7. As can be seen from the message sequence diagram this concept can be applied for any number of mobile phones or picture in picture elements without the need for any change in the protocol.

So, an example of the invention has been described, based on a system generally as shown in fig. 6. Another mobile device has become part of the system or network, and the two devices have been used to control the TV, allowing respective users to watch different video, with the respective audio being transmitted to the respective mobile device.

Further embodiments of the invention also enable mobile devices to remotely control the TV and In particular address scenarios where there are multiple users watching TV with different language preferences. A description of such embodiments is as follows.

Again, the system components may be as shown in fig. 6 and as described above, with the mobile devices and appliance communicating using the UPnP protocol, for example, and performing initial discovery, registration etc. In certain of these embodiments each mobile device sends the following information among the list of other capabilities: * .* * . . * ..

. Boolean value to indicate whether it has capability to convert text to speech **.S Number of languages it supports Its own language preference *S.

After initial registration the TV (although being a control point) sends a list of its S...

* capabilities to the mobile device in XML format. Again, these include but are not limited 30 to the Boolean values for: Playing video; Playing audio; Support of Picture in picture; Changing channels; changing volume; changing brightness; changing contrast; powering down; Multiple audio channel decoding support.; Multiple video channel decoding support.; Hard disk presence and details.

Again, It also sends a list of events that it can send to the mobile device if requested for in the registration process. These include but are not limited to:-Power up -this will cater only for soft power up.

power down -only when there is a graceful power down channels changed by the TV -include tuning into external device for e.g. DVD player information on new channel like number of audio channels number of subtitles present Picture in picture mode enabled External device connected physically Hard disk full registration status of other control points The mobile device recognizes the list of capabilities and allows the user to control the TV. Again, the mobile device may be operated to change channels, as described above.

Now, consider again the case when another user (with a mobile phone = mobile phone 2) enters the room and registers with the control point running on the TV.

Arrival of the user with mobile device 2 leads to the generation of a registration event on the control point. This information is sent to mobile device 1 Either of the two users may change the channel to play video that supports multiple languages (including but not limited to DVD's, broadcast channels with dual audio etc.).

They can make this change either using the TV remote controller or using their individual mobile devices, If both users have the same language preference, then the same audio *.�.

is played over the audio system of the TV. S. * , *.* S

Alternatively, if both users have different language preferences, then if audio for both languages is available the respective Audio of choice (i.e. in the selected language) is *SS*a * . streamed to each users mobsie headsets over UPnP. a. S a * a * ..

One of the mobile devices may be treated as the master mobile device, and Audio for the master mobile device could also optionally play on the TV's main audio system. The master could either be the mobile device that chooses to play the video or the first mobile device to have audio preference equal to the majority.

If audio for either or both languages are not available, then subtitles for the languages of choice may be individually streamed to the respective mobile devices.

In certain embodiments the mobile device converts this text to speech and plays it onto the headset.

It will be appreciated that whenever streaming is used in embodiments of the invention, it may be used as already defined in the UPnP protocol.

A message sequence diagram depicting the exchange of messages in an embodiment of the invention, providing different users with different audio to accompany the same video output, is shown in fig. 8.

It will be appreciated that embodiments of the present invention can be realized in the form of hardware, software or a combination of hardware and software. Any such software may be stored in the form of volatile or non-volatile storage such as, for example, a storage device like a ROM, whether erasable or rewritable or not, or in the form of memory such as, for example, RAM, memory chips, device or integrated circuits or on an optically or magnetically readable medium such as, for example, a CD, DVD, magnetic disk or magnetic tape or the like. It will be appreciated that the storage devices and storage media are embodiments of machine-readable storage that are suitable for storing a program or programs comprising instructions that, when executed, *:::* implement embodiments of the present invention. Accordingly, embodiments provide a program comprising code for implementing a system or method as claimed in any one of S.'...

the claims of this specification and a machine-readable storage storing such a program.

Still further, such programs may be conveyed electronically via any medium such as a communication signal carried over a wired or wireless connection and embodiments suitably encompass the same.

*S....

S J

:1 30 Throughout the description and claims of this specification, the words "comprise" and "contain" and variations of the words, for example "comprising" and "comprises", means "including but not limited to', and is not intended to (and does not) exclude other moieties, additives, components, integers or steps.

Throughout the description and claims of this specification, the singular encompasses the plural unless the context otherwise requires. In particular, where the indefinite article is used, the specification is to be understood as contemplating plurality as well as singularity, unless the context requires otherwise.

Features, integers, characteristics, compounds, chemical moieties or groups described in conjunction with a particular aspect, embodiment or example of the invention are to be understood to be applicable to any other aspect, embodiment or example described herein unless incompatible therewith.

It will be also be appreciated that, throughout the description and claims of this specification, language in the general form of "X for Y" (where Y is some action, activity or step and X is some means for carrying out that action, activity or step) encompasses means X adapted or arranged specifically, but not exclusively, to do Y. * *o * I * I. * I.. * * * l. * *I ** I 00I 0

I 0.1

I It. * S * I * * * * S.

Claims

CLAIMS1. A communication system comprising: a mobile device comprising first interface means, adapted to provide wireless communication between the mobile device and a communication network, and second interface means; an appliance adapted to provide at least one of a visible signal and an audible signal to a person; and appliance interface means, wherein: the second interface means and the appliance interface means are adapted to provide wireless communication between the mobile device and the appliance; the mobile device is further adapted to control the appliance via said wireless communication between the mobile device and the appliance provided by the second interface means and the appliance interface means; the appliance is further adapted to send an audio signal to the mobile device via said wireless communication between the mobile device and the appliance provided by the second interface means and the appliance interface means; and the mobile device is further adapted to output an audible signal corresponding to the received audio signal to a user.
2. A communication system in accordance with claim 1, wherein the first interface means is adapted to provide wireless voice communication between the mobile device and the communication network.
3. A communication system in accordance with any preceding claim, wherein the appliance comprises the appliance interface means. S... * .5:.: *
4. A communication system in accordance with any one of claims 1 or 2, comprising . 30 an intermediate device and connection means connecting the intermediate device to the appliance, wherein the intermediate device comprises said appliance interface means.S. SS** * .

S

*. .:
5. A communication system in accordance with any preceding claim, wherein said first interface means comprises at least one of: a GSM interface; a CDMA interface; a UMTS interface; a WiFi interface; a Bluetooth interface; and an interface of another wireless technology.
6. A communication system in accordance with any preceding claim, wherein said second interface means comprises at least one of: a CDMA interface; a WiFi interface; a Bluetooth interface; and an interface of another wireless technology.
7. A communication system in accordance with claim 6, wherein said appliance interface means comprises at least a corresponding one of: a CDMA interface; a WiFi interface; a Bluetooth interface; and an interface of another wireless technology.
8. A communication system in accordance with any preceding claim, wherein the second interface means and the appliance interface means are adapted to provide wireless communication between the mobile device and the appliance in accordance with a protocol selected from a list comprising: Universal Plug and Play (UPnP); Devices Profile for Web Services (DPWS); and NAT-PMP.
9. A communication system in accordance with any preceding claim, wherein the mobile device comprises at least one earpiece or earphone and the mobile device is adapted to output said audible signal from the earphone or earpiece.
10. A communication system in accordance with claim 9, wherein the mobile device comprises a body portion and a wired connection connecting the body portion to the or each earpiece or earphone.
11. A communication system in accordance with claim 9, wherein the mobile device comprises a body portion and wireless connection means connecting the body portion to the or each earpiece or earphone. * ..S * S *555
12. A communication system in accordance with any preceding claim, wherein the * *S * appliance comprises a screen adapted to display video images, and the mobile device is operable to control the appliance to select video content for display and to display the selected video content on the screen.

*. S..' * .
13. A communication system in accordance with claim 12, wherein the appliance is adapted to send said audio signal to the mobile device, said audio signal corresponding to the selected video content.
14. A communication system in accordance with claim 12 or claim 13, wherein the mobile device is further operable to control the appliance to select one of a plurality of audio signals, each corresponding to the selected video content, and the appliance is adapted to send the selected audio signal to the mobile device.
15. A communication system in accordance with any preceding, further comprising at least one additional mobile device, each additional mobile device comprising a respective said first interface means, and a respective second interface means, the arrangement being such that each additional mobile device is operable to control the appliance via wireless communication provided by the respective second interface means and the appliance interface means, and the appliance is further adapted to send a respective audio signal to each additional mobile device via the wireless communication provided by the respective second interface means and the appliance interface means, and each additional mobile device is adapted to output a respective audible signal corresponding to the respective received audio signal to a user.
16. A communication system in accordance with claim 15, as dependent upon any one of claims 12 to 14, wherein each of the mobile and additional mobile devices is adapted to control the appliance to select respective video content for display and to display the selected respective video content on a respective portion of the screen, and the appliance is adapted to send a respective said audio signal to each of the mobile and additional mobile devices, each respective audio signal corresponding to the respective selected video content.
17. A communication system in accordance with claim 16, wherein each of the * ** mobile and additional mobile devices is further adapted to select one a plurality of audio signals corresponding to the selected respective video content, and the respective said audio signal sent by the appliance to each device comprises the respective selected * ** * 0 * *0I audio signal. * 30
18. A communication system in accordance with claim 15, as dependent upon any ** ..S.* one of claims 12 to 14, wherein each of the mobile and additional mobile devices is *. . * * * * further adapted to select one a plurality of audio signals corresponding to the selected video content, and the respective said audio signal sent by the appliance to each device comprises the respective selected audio signal.
19. A communication system comprising: a display device; and a plurality of mobile devices, each comprising a first interface for wirelessly communicating with a communications network and a second interface for wirelessly communicating with the display device, wherein the display device is adapted to display a plurality of video images, each on a respective portion of a screen, and to transmit wirelessly to the second interface of each mobile device a respective audio signal corresponding to one of the plurality of video images, each mobile device being further arranged to output an audible signal corresponding to the respective received audio signal to a user.
20. A communication system in accordance with claim 19, wherein each mobile device is further adapted to control the display device via the respective second interface to select a respective video image for display and to display the selected respective video image on a respective portion of the screen.
21. A communication system comprising: a display device; and a plurality of mobile devices, each comprising a respective first interface for wirelessly communicating with a communications network and a respective second interface for wirelessly communicating with the display device, wherein the display device is adapted to display a video image on a screen, and to transmit wirelessly to the second interface of each mobile device a respective audio signal, each mobile device being further arranged to output a respective audible signal corresponding to the respective received audio signal to a user. * ** * * * * **

*
22. A communication system in accordance with claim 21, wherein each mobile device is further adapted to control the display device via the respective second interface * ** to select said respective audio signal from a plurality of audio signals.

*
23. A communication system in accordance with claim 22, wherein said plurality of ** **** audio signals comprises a plurality of audio signals in different languages, each * corresponding to the displayed video image.
24. A mobile device adapted for use in a communication system in accordance with any preceding claim.
25. A method of using a mobile device having a first interface for wirelessly communicating with a communication network, the method comprising: providing an appliance, adapted to provide at least one of a visible signal and an audible signal to a person, and appliance interface means; providing the mobile device with second interface means, the second interface means and the appliance interface means being adapted to provide wireless communication between the mobile device and the appliance; using the mobile device to control the appliance via said wireless communication provided by the second interface means and the appliance interface means; sending an audio signal from the appliance to the mobile device via said wireless communication provided by the second interface means and the appliance interface means; and outputting an audible signal, corresponding to the received audio signal, from the mobile device to a user.
26. A method in accordance with claim 25, wherein the appliance comprises a screen, and the method further comprises using the mobile device to control the appliance to select a video image for display and to display the selected video image on the screen.
27. A method in accordance with claim 26, further comprising displaying the selected video image on a portion of the screen.
28. A method in accordance with claim 26 or claim 27, wherein the audio signal sent to the mobile device corresponds to the selected video image. * .S. S *
29. A method in accordance with any one of claims 25 to 28, further comprising * ** * using the mobile device to select the audio signal from a plurality of audio signals.
30. A communication method comprising: * providing a mobile device having first interface means for wirelessly communicating with a communication network; providing an appliance, adapted to provide at least one of a visible signal and an audible signal to a person, and appliance interface means; providing the mobile device with second interface means, the second interface means and the appliance interface means being adapted to provide wireless communication between the mobile device and the appliance; using the mobile device to control the appliance via said wireless communication provided by the second interface means and the appliance interface means; sending an audio signal from the appliance to the mobile device via said wireless communication provided by the second interface means and the appliance interface means; and outputting an audible signal, corresponding to the received audio signal, from the mobile device to a user.
31. A communication method in accordance with claim 30, further comprising: providing a second mobile device having a respective first interface means for wirelessly communicating with a communication network, and a respective second interface means, the respective second interface means and the appliance interface means being adapted to provide wireless communication between the second mobile device and the appliance; using the second mobile device to control the appliance via said wireless communication provided by the respective second interface means and the appliance interface means; sending a second audio signal from the appliance to the second mobile device via said wireless communication provided by the respective second interface means and the appliance interface means; and outputting a second audible signal, corresponding to the received second audio signal, from the second mobile device to a user. * ** * * a * **

*S. . . .
32. A communication method in accordance with claim 31, wherein the appliance comprises a screen for displaying video images, and the method further comprises: using at least one of the mobile devices to control the appliance to select a video image for display and to display the selected video image on the screen; and * using at least one of the mobile devices to select at least one of said first and *e*** * second audio signals from a plurality of audio signals having different audio contents, * whereby users of the mobile devices may be provided with different audio contents to accompany the selected video image.
33. A communication method in accordance with claim 31, wherein the appliance comprises a screen for displaying video images, and the method further comprises: using the first mobile device to control the appliance to select a first video image for display and to display the first selected video image on a first portion of the screen; using the second mobile device to control the appliance to select a second video image for display and to display the second selected video image on a second portion of the screen, and wherein the first audio signal and the second audio signal correspond to the first and second video images respectively.
34. A communication method in accordance with claim 33, further comprising using at least one of the mobile devices to select at least one of said first and second audio signals from a plurality of audio signals having different audio contents.
35. A method in accordance with any one of claims 25 to 34, further comprising: detecting the presence of the or each mobile device in a vicinity of the applicance; and registering the or each mobile device with the appliance to enable control of the appliance by the or each mobile device.
36. A computer program comprising instructions arranged, when executed, to implement a method as claimed in any preceding claim and/or a system as claimed in any preceding claim.
37. Machine-readable storage storing a program as claimed in claim 36. * .1 * S S * S. * *SSS * ..S * ** *S S *SS SS *S*S..** * S *S SS S 55