KR20090118837A - Method and communication system for controlling appliance device using a mobile device - Google Patents

Abstract

PURPOSE: A method and a communication system for controlling a home appliance using a mobile device are provided to make users conveniently control a home appliance through the mobile device. CONSTITUTION: A home appliance(3) has a screen. The home appliance transmits an audio signal to a mobile device(1). A video image is selected on a part of a screen(30). The home appliance displays the selected video image. The mobile device outputs an aural signal corresponding to the received audio signal. The mobile device selects the video image. The mobile device controls the home appliance to display the selected video image on the screen of the home appliance.

Description

Method and communication system for controlling appliance device using a mobile device}

The present invention relates to a method and a communication system for controlling household appliances using a mobile device, in particular for the control of household appliances such as televisions by mobile devices such as mobile phones, although not exclusively. will be. Some embodiments relate to general home networking, and more particularly to mobile devices networking with home devices.

Some televisions are known that can be operated in a so-called picture-in-picture (PIP) mode. In this case, different video content may be displayed on different portions of one screen in the PIP mode.

The video content is typically set up and controlled by a user with one remote control device. And, the video content cannot be optimized for fun by a large number of users. The only user with the remote control device controls the television. In addition, the plurality of video images (pictures) displayed on the television will uniquely output a sound (audio content) corresponding to one of the pictures. The remaining ones of the pictures are presented only as video. Another limitation related to viewing is that a plurality of individuals with different language preferences currently do not have a television (TV), or without at least one of the language preferences as a compromise. On other display devices, such as personal computers (PCs), it is not possible to watch videos together (the television or PC can output audio in only one selected language). It provides a control method and communication system for the operation.

The present invention also provides a method and communication system for controlling a home device using a mobile device.

An apparatus according to an embodiment of the present invention is a communication system for controlling a household appliance using a mobile device, comprising a screen, transmitting an audio signal to the mobile device, and displaying a selected video image over a portion of the screen. And a mobile device for outputting an audio signal corresponding to the received audio signal, selecting a video image, and controlling the home appliance to display the selected video image on a screen of the home appliance. do.

According to an exemplary embodiment of the present invention, a method of controlling a household appliance using a mobile device includes: transmitting, by the household appliance, an audio signal to a mobile device, and the mobile device is connected to the received audio signal. Outputting a corresponding audio signal; controlling, by the mobile device, to select a video image and controlling the home appliance to display the selected video image on a screen of the home appliance; And displaying the selected video image over a portion of the.

According to the present invention, by providing a method and apparatus for interaction between home appliances and mobile devices, the user can more conveniently control the home appliance through the mobile device.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. First of all, it should be noted that in the drawings, the same components or parts represent the same reference numerals as much as possible. In describing the present invention, detailed descriptions of related well-known functions or configurations are omitted in order not to obscure the subject matter of the present invention.

Referring to Fig. 1, a first communication system embodying the present invention includes mobile device 1 in the form of a mobile telephone handset. The mobile telephone handset comprises first interface means (not shown in the figure) which is applied to provide wireless communication between the mobile device 1 and the communication network 2. The wireless communication includes radio signals 21 transmitted from the communication network 2 to the mobile device 1 and radio signals 12 transmitted from the mobile device 1 to the communication network 2. The first interface means comprise receiver and transmitter means suitably applied in the mobile device 1, the receiver and transmitter means being for example supplied by a single transmitter module. The communication system also includes, as one example, a household appliance 3 in the form of a television. The household appliance 3 is adapted to supply both visual and auditory signals to a person. The television 3 includes screens 30 for displaying video images and speakers for outputting audio (not shown) to users located in proximity to the television in certain modes of operation. In this embodiment, the television 3 also includes household appliance interface means (not shown in the figure), and the mobile device 1 also includes second interface devices (also not shown in the figure). The second interface means and the household appliance interface means are applied to provide wireless communication between the mobile device 1 and the television 3. The wireless communication includes wireless signals 13 transmitted from the mobile device 1 to the home appliance 3 and wireless signals 31 to transmit from the home appliance 3 to the mobile device 1. The television 3 is applied to transmit an audio signal to the mobile device 1 by this wireless communication. In other words, the wireless signal 31 comprises or is part of an audio signal and the mobile device 1 is adapted to output an audible audio signal 14 corresponding to the received audio signal at the user 4.

In a first example the first interface means of the mobile phone 1 are applied to provide wireless voice communication between the mobile device 1 and the communication network 2. Advantageously, in the first example the mobile phone 1 will be applied to perform one or more operations normally associated with the remote control device for the television 3. And, in the first example, it can be operated to control channel selection, volume, brightness, and the like. In other examples, the television 3 is applied to detect when the mobile device 1 is located in its vicinity, and then handes over control of one or more operations to the mobile device 1. The advantage of such a system would be that the user of the mobile device 1 entering the periphery of the television 3 could be automatically assigned control of the television 3 without the need to find any remote control device. In any case, if the user moves the mobile device 1, an automatic method of supplying control of the home appliance 3 to the user would be convenient. As other examples, the audio signal transmitted from the television 3 to the mobile device 1 includes a video image, a file, or audio content corresponding to a program displayed on the screen 30 of the television 3. And, instead of the television 3, audio content is directly output from its speakers. The above may be advantageous in many situations, and provides the user with the ability to hear much more accurate audio content, for example, in the vicinity of the television 3 without disturbing others. For example, in a home environment, users of mobile phones may respond to certain video images through their mobile phones while others are free to read books or magazines or meet other activities in a relatively peaceful and quiet environment. You will be able to hear the audio file. Alternatively, in a public place such as a sports club or bar, users will be able to hear audio content, such as commentary on a spotting event displayed on the television, without a commentary output directly from the television 3. The television 3 will be unnecessary to others in a public place not interested in the displayed event.

2, this shows another communication system embodying the present invention. In other words, the system includes a television 3 having a screen 30 for displaying video images. The system further includes two mobile devices 1a and 1b, each of the mobile devices 1a and b each having a respective first interface for wirelessly communicating with communication network 2 and a respective one for wirelessly communicating with television 3. It includes a second interface. The television 3 is adapted to display video images on its screen and to wirelessly transmit each audio signal at the second interface of each mobile device 1a, 1b. Then, each mobile device 1a, 1b is prepared to output the respective auditory signals 14a, 14b corresponding to the respective audio signals received to the user.

For example, each mobile device 1a, b is further adapted to control the television 3 via the respective second interface means dmf. Wireless signals transmitted from the mobile devices 1a, 1b to the television 3 are shown by arrows 13a, 13b, and wireless signals transmitted from the television 3 to the mobile devices 1a, 1b are shown by arrows 31a, 31b. do. Arrows 12a, 12b, 21a and 21b show wireless signals transmitted between the mobile devices and the communication network 2. For example, mobile device 1a selects a video image and controls the television 3 to display the video image over portion 301 of the display 30. Similarly, the mobile device 1b is operated by a user who controls the television 3 to select another, another video image, and display the video image on the second portion 302 of the display 30. For example, these parts are completely separate areas on the screen. As another example, some images may overlap, or one image may be fully displayed within another image. Even so, the two video selections are displayed over the respective respective portions of the screen. The television 3 is prepared for wirelessly transmitting an audio signal to the first mobile device 1a, the audio signal comprising audio content corresponding to the image displayed at part 301 of the screen. Similarly, the television 3 transmits a second audio signal to the second mobile device 1b. The second audio signal includes audio content corresponding to the video shown in the second portion 302 of the screen. Therefore, different images correspond to different audio signals output to the two separate users of the mobile devices through respective mobile devices, and will be displayed on the single screen 30. Advantageously, the system can allow two different users to select the image on one television and view the selected image. Then, it receives the corresponding audio signal through its mobile phones.

Referring to Fig. 3, this is a diagram showing another communication system embodying the present invention.

Here, the system again comprises a television 3. The television 3 displays a single video image on its screen 30 (the video image may also be associated with a video file, clip, or program). Again, two mobile devices 1a and 1b Located near the television 3. Each of the mobile devices has a first interface for supplying wireless communication between the mobile devices 1a, 1b and the communication network 2, respectively. Thus, users of the mobile devices can send and receive minimal voice calls. Each mobile device also includes a suitably prepared interface for providing wireless communication between itself and the television 3. Although a video file is displayed on the screen 30, the system selects respective devices for selecting audio content that they wish the users of the mobile devices 1a, 1b to receive with the displayed video. It is ready for operation. Therefore, the two mobile devices are not limited to receiving the same audio content. As another example, the user of the mobile device 1a operates as a device for selecting English audio content to accompany the displayed video. The audio signal containing the English content is then transmitted from the television 3 to the first mobile device 1a in a radio signal 31a. Conversely, the user of the mobile device 1b selects a French commentary accompanying the displayed video and receives an audio signal 31b wirelessly containing the French commentary from the television 3.

For example, each of the mobile devices outputs its audio signals from their respective earphones or earpieces, rather than outputting their audio signals 14a, 14b from internally mounted speakers. The mobile device 1a comprises an ear piece 100a connected to its main body part by a radio link 101a. Contractually, the mobile device 1b comprises a wireless headset comprising an ear piece 200b. The handset or main part of the mobile device 1b is in wireless communication with the wireless headset, and the wireless link supplied between the network 2 is shown by arrow 201b in FIG.

The system shown in FIG. 3 has the advantage that other users can select different language audio or other commentaries involving a particular video image displayed on the one television 3. Moreover, by outputting auditory signals including selected content from earphones or earpieces, each user can enjoy their selected audio without interference from other users.

Referring to FIG. 4, this shows another system embodying the present invention. The system here comprises a mobile device 1 in the form of a telephone handset having a first interface for providing wireless communication with a communication network 2. The radio signals modified between the handset 1 and the communication network 2 are again shown by arrows 12 and 22. The system also includes a household appliance 3 in the form of a television, wherein the television and mobile device 1 are adapted to communicate wirelessly with each other. However, in contrast to the previous embodiments, the television does not itself comprise the household appliance interface means. Instead, the system comprises an intermediary device 5 comprising household appliance interface means. The mobile device 1 further comprises second interface means adapted for communicating with the consumer electronics interface of the intermediate device 5 via a change of radio signals 51 and 15. As the intermediate apparatus 5 is connected to the household appliance 3, signals 35 may be transmitted from the household appliance 3 to the intermediate apparatus 5, and signals 53 may be transmitted from the intermediate apparatus 5 to the household appliance 3. . This connection, which supplies a change in the signals 35 and 53 while in another device to be the wireless link, is in some embodiments a wireless link. Although such a system includes the intermediary device 5, the mobile device 1 can again be operated to wirelessly control the household appliance 3. And similarly the household appliance 3 is adapted to wirelessly transmit an audio signal to the mobile apparatus 1. Then, the mobile device 1 is applied to output an audio signal 14 corresponding to the audio signal received from the television 3 through the intermediate device 5.

Referring to FIG. 5, FIG. 5 shows another system embodying the present invention. Here, the system comprises a radio type home appliance 3 with an antenna 35 or a radio adapted to receive radio signals 135 from a remote broadcast source. The radio includes at least one speaker adapted to output an audio signal 315 directly to the user in the vicinity. The system further comprises a plurality of mobile devices 1a, 1b, each of the mobile devices 1a, 1b each having a first interface means adapted to supply wireless communication between a communication network 2 and the mobile device, and a second interface. Means. The radio 3 comprises household appliance interface means, referred to as air interface means. At this time, the respective second interface means and the household appliance interface means are adapted to supply wireless communication between the radio 3 and each of the mobile devices. Each mobile device 1a, 1b may be operable to control the radio 3 via a radio link for selecting respective audio content. Radio 3 is then applied to wirelessly transmit an audio signal containing the selected audio content to each device. Each mobile device 1a, 1b is then ready to output an audio signal for the user. Therefore, different users will select different audio content from the radio 3 and receive content via respective mobile phones. This would be an additional or alternative to emitting audio content to Radio 3 directly from each loudspeaker or loudspeakers. In other words, such a system brings advantages that other users located in the vicinity of the radio 3 are not limited to listening to the same audio content. Instead the users can select and listen to their selected audio by their selected phones. Moreover, even if only one mobile phone user is located in the vicinity of the radio 3, there is a convenience that the user can select their audio output from afar and use their mobile phone to control the radio 3. Therefore, the user will operate their mobile phone to select a channel from the plurality of different radio channels. The user will also operate the mobile phone to control other directions of the radio, such as volume, tone and the like.

Although the above described the case where there are only televisions and radios as the above-mentioned household appliances in the above systems, the present invention will not be limited to the above described household appliances in the widest possible sense. In other embodiments, other household appliances, such as TVs; Computers; PCs; Message boards; Projectors; Display screens and units; Theater displays and screens and units will be included, but are not limited to such.

Further embodiments will be described with reference numerals in FIGS. 6, 7 and 8.

The first embodiment relates to controlling private PIP elements using one or more mobile devices. In this embodiment, each mobile device is equipped with the following equipment.

The first interface means, they employ a modern processor adapted to receive or make calls via existing wireless technologies called Global System for Mobile Communication (GSM), Code Division Multiplex Access (CDMA), Unlicensed Mobile Access (UMA), and the like. Includes; And

 Second interface means (second communication interface), which can be both physical or surprised. Physically (ie having separate physical radio characteristics compared to the first interface means) or logically ie occupying only one logical channel within only one / single physical communication interface (in other words, the first The interface and the second interface means will be separate physical entities, for example to be supplied by a GSM interface and a WiFi interface, or a single physical interface, for example a WiFi interface).

The mobile device can communicate simultaneously via both communication interfaces (ie, capable of communicating at the same time through the first and second interfaces). Application services residing in the mobile device may also be performed concurrently as they communicate over the second interface.

The system of the above embodiment also includes one or more household appliances (eg, home device �¤). Here and in the following examples the household appliances are TVs and in other embodiments other household appliances will be used.

The home device may communicate with the mobile device via a second communication interface of the mobile device. To this end, the home device (home appliance) itself also comprises suitable air interface means (home appliance interface means). Or the system further comprises an enabling device (relay device) connected (physically or wirelessly) with the home device. And the enabling device comprises suitable air interface means capable of communicating with the second interface means of the mobile device.

In this embodiment, the mobile device can perform all the functions originally performed by the TV remote controller. In particular, in PIP mode a number of users see scenarios of watching TV.

In this embodiment, a predefined communication protocol is used for communication between the mobile device and the TV via the household appliance interface means and the second interface of the mobile device. Here, as an example, the UPnP protocol is used, and other protocols may be used in other embodiments.

The interaction between the mobile devices and the consumer electronic devices according to the UPnP protocol (standard) includes a first discovery and registration procedure; Since these procedures are already defined in the UPnP protocol and are well known, the detailed description thereof will be omitted. In general, the detailed description will merely describe the variations or deviations required in the UPnP protocol details to facilitate the embodiments herein.

6 shows components of the systems of the present embodiment.

Referring to FIG. 6, home device 3 (TV) is a display unit or screen 30, microcontroller 3, audio output means 302 (a representative plurality of loudspeakers), remote controller 306, data storage or memory 304, And interface means 305 for wirelessly communicating with the second interface means 102 of the mobile device 1. In the embodiment described herein, the appliance interface means 305 is part of the appliance 3. However, in other embodiments, the appliance interface means may be external to the appliance, or may be a separate device, for example, from what has been described above. The wireless communication link between the household appliance 3 and the mobile device 1 is shown by reference numeral 131. The mobile device 1 also comprises first interface means 101 adapted to transmit radio signals 12 and to receive radio signals 21 from a communication network.

The operation of the system is as follows. Referring to Figure 7, after the first registration (e.g., of the household appliance 3 and the mobile device 1), the TV (although it may be a control point) is sent to the mobile device 1 in XML format. Send a list of capabilities (700). The list includes the following Boolean values.

Play video

Audio playback

PIP support

Change channels

Change volume

Change brightness

Contrast change

Power down

Multiple audio channel decoding support

Multiple video channel decoding support

Hard Disk Presence and Details

If required in the registration process, send a list of events to the mobile terminal. The event lists include, but are not limited to the following contents.

Power Up-This will only procure the power up softly.

Power down—only when there is significant power down,

Channels changed by TV-external device An example includes turning on a DVD (Digital Versatile Disc) player.

Information about new channels, such as the number of audio channels.

Give the number of subtitles

PIP Mode Enabled.

Physically connected to an external device.

Hard disk full

 Registration status of other control points

The mobile device 1 is adapted to recognize the list of capabilities and allows the user to control the TV.

For the first example, the mobile device 1 will be operated to change the channels of the TV as follows. The user of the mobile device 1 chooses to change the channel via a special user interface supplied during the same time. The mobile device 1 then transmits this information via the UPnP protocol stack which formats it, such as an XML file, and sends the information to a control point connected to the TV. The TV receives this message and changes the channel. When the channel is changed, a channel changed event occurs. When the mobile device 1 is previously registered for the channel change event, a formatted message, such as an XML file, is sent to the mobile device 1 (over the wireless link 131) by the UpnP protocol stack on the TV. When this information is received, the mobile device displays a success indication to the user through a specially designed user interface.

Here, considering the case where another user enters an arbitrary room, the user's mobile device (mobile device 2 (not shown in FIG. 6)) registers a control point running on the TV. In other words, the user has another mobile device and obtains from the vicinity of the TV that the other mobile device generates a registration event on the control point. This information is transmitted to the first mobile device (mobile device 1). The user of mobile device 1 will choose to turn on PIP mode; The second user (of mobile device 2) is �²� to choose to turn on the PIP mode; Or, both of the users will turn on the PIP mode using a TV remote controller (although each mobile device will also be operated to control the TV, even if it is also controlled). Once this is enabled, an event is generated on the TV and sent to the mobile devices.

The mobile devices are then randomly assigned windows on the TV. Here, the two users are allowed to control the video channels on their personal picture windows. Then, audio from each of the videos is streamed to the respective mobile devices. These devices will further stream their respective audio to the Bluetooth headsets of each mobile device.

7 is a diagram illustrating that messages are changed when personal control is continuously performed through PIP elements according to an exemplary embodiment of the present invention.

Referring to FIG. 7, when seen from a message sequence diagram, this concept can be applied for PIP elements or any number of mobile phones without the need for any change in the protocol.

Thus, an example of the present invention will be described based on the general system shown in FIG. Other mobile devices become part of the system or network. The two mobile devices are then used to control the TV to allow the users to view different videos, with each audio being sent to each of the mobile devices.

Moreover, embodiments of the present invention also allow mobile devices to control the TV from a distance and, in particular, apply to scenarios where there are multiple users watching TV with different language preferences. Details of these embodiments are as follows.

In other words, the system components will be shown in FIG. And as described above, with the mobile devices and consumer electronics devices that communicate using the UpnP protocol, for example, performing a first discovery, registration, and the like.

In some of these embodiments each mobile device transmits the following information in a list of other capabilities.

A Boolean value indicating whether the text can be converted to words.

Number of languages supported.

Their language preference.

After the first registration, the TV (even if it is a control point) sends a list of the TV's capabilities to the mobile device 1 in XML format. In other words, the list of capabilities includes video playback; Audio playback; PIP support; Changing channels; Volume change; Change of brightness; Contrast change; Power down; Multiple audio channel decoding support; Multiple video channel decoding support; Includes, but is not limited to, Boolean values for hard disk presence and details.

In other words, if the registration procedure is requested, send a list of events that can be sent to the mobile device. The above list includes, but is not limited to:

Power Up-This will only procure the power up softly.

Power down-only when there is significant power down

Channel-external devices changed by a TV include turning on a DVD (Digital Versatile Disc) player.

Information about new channels, such as the number of audio channels.

Gives the number of subtitles.

PIP Mode Enabled.

Physically connected to an external device.

Hard disk full.

Registration status of other control points.

The mobile device recognizes the list of capabilities and allows the user to control the TV. In other words, the mobile device will be operated to change channels as described below.

Here, consider again the case where another user (with mobile device 2, which is a mobile phone) enters the room and registers a control point running on the TV.

The arrival of the user with the mobile device 2 leads to generating a registration event on the control point. This information is sent to the mobile device 1.

Both users will change the channel to play video that supports multiple languages (including but not limited to DVD's, broadcast channels such as dual audio, etc.). The users make these changes using both the TV remote controller or personal mobile devices. If both users have the same language preference, the same audio is played through the TV's audio system.

Alternatively, if you have two users with different language preferences, If audio for both languages is available, the audio of each choice, i.e. the selected language, is streamed to the mobile headsets to the respective users via UPnP.

One of the mobile devices will be treated as a master mobile device. And, the audio for the master mobile device can also additionally reproduce the main audio system of the TV. The master mobile device can be both a first mobile device having an audio preference equal to an absolute majority or a mobile device that selects to play a video.

If audio for both languages or one of the two languages is not available, the subtitles for the selected languages will be streamed separately to the respective mobile devices.

In some embodiments the mobile device converts this text to speech and plays it with the headset.

Whenever streaming is used in embodiments of the present invention, it will be used as already defined in the UpnP protocol.

FIG. 8 is a diagram illustrating a message sequence diagram depicting a change of messages according to an embodiment of the present invention, which supplies different audio with the same video output to different users.

In the following, the operations of FIGS. 7A, 8 and 8 will be described in more detail with reference to the drawings.

Referring to FIG. 7A, in operation 715, the TV 700 discovers the mobile device 1 705 as a control point and transmits a service list to the mobile device 1 705. In step 720, the TV 700 transmits an event message informing the mobile device 1 705 of the new control point. The event message includes data set by the mobile device 1 705 as a control point name.

In operation 725, the TV 700 discovers the mobile device 2 710 as a control point, and transmits a service list to the mobile device 2 710. In step 730, the TV 800 transmits an event message indicating a new control point to the mobile device 1 705 and the mobile device 2 710, respectively. The event message includes data set by the mobile device 2 710 as a control point name.

After changing the channel with the number x, the mobile device 1 705 transmits an action message indicating the channel change to the TV 700 in step 735. The action message includes data in which the channel number is set to x. Upon receiving the action message, the TV 700 transmits an event message indicating that the channel is changed to each of the mobile device 1 705 and the mobile device 2 710 through steps 740 to 745. The event message includes data in which the total number is set to '1' and the channel number is set to 'x'.

Since the mobile device 2 710 which has transmitted the action message does not prefer the channel having the channel number x, the channel number is changed to 'y' and the TV 700 is changed to the PIP mode in step 750. Sends an action message that indicates The action message includes data in which an extra channel number is set to 'y'. Upon receiving the action message, the TV 700 transmits an event message indicating that the channel is changed to each of the mobile device 1 705 and the mobile device 2 710 in steps 755 to 760. The event message includes data whose total number is set to two. That is, the channel number of the mobile device 1 705 in the PIP 1 mode is 'x', and the channel number of the mobile device 2 710 in the PIP 2 mode is 'y'.

When the mobile device 1 705 changes the current channel number 'x' from the channel number 'p', the mobile device 1 705 transmits an action message indicating a channel change to the TV in step 775. The action message includes data in which the channel number is set to p.

As described above, event and action operations between the TV 700 and the mobile devices 1,2 and 705 and 710 continue.

Referring to FIG. 7B, when the TV 700 receives the action message in step 775, the channel is changed to each of the mobile device 1 705 and the mobile device 2 710 through steps 780 to 785. Send an event message to notify. The event message includes data in which the total number is set to '2'. That is, the channel number of the mobile device 1 705 in the PIP 1 mode is 'p', and the channel number of the mobile device 2 710 in the PIP 2 mode is 'y'.

Next, when the mobile device 2 710 wants to view the same channel as the mobile device 1 705, the mobile device 2 710 transmits an action message indicating a channel change to the TV 700 in step 775. The action message includes data in which the channel number is set to p. Upon receiving the action message, the TV 700 transmits an event message indicating that the channel is changed to each of the mobile device 1 705 and the mobile device 2 710 in steps 795 to 800. The event message includes data whose total number is set to two. That is, the channel number of the mobile device 1 705 in the PIP 1 mode is 'p', and the channel number of the mobile device 2 710 in the PIP 2 mode is 'p'.

If there is no channel change after some time passes, the TV 700 transmits an event message indicating release of the PIP mode to each of the mobile device 1 705 and the mobile device 2 710 in step 805. In operation 810, the TV 700 transmits an event message indicating that a channel is changed to each of the mobile device 1 705 and the mobile device 2 710. The event message includes data in which the total number is set to 1 and the channel number is set to 'p'.

Referring to FIG. 8, in step 815, the TV 800 discovers mobile device 1 805 as a control point and transmits a service list to the mobile device 1 805. In step 820, the TV 800 transmits an event message indicating a new control point to the mobile device 1 805. The event message includes data set by the mobile device 1 805 as a control point name.

In step 825, the TV 800 discovers the mobile device 2 810 as a control point, and transmits a service list to the mobile device 2 810. In steps 830 to 835, the TV 800 transmits an event message indicating a new control point to the mobile device 1 805 and the mobile device 2 810, respectively. The event message includes data set by the mobile device 2 810 as a control point name.

In operation 840, the mobile device 1 805 transmits an action message indicating a change to a channel supporting multiple audio to the TV 800. Upon receiving the action message, the TV 800 transmits an event message indicating that the channel is changed to the channel number X to the mobile device 1 705 and the mobile device 2 710 in step 845. The event message includes data including an audio support list. In operation 850, the mobile device 2 810 transmits an event message indicating that the stream language Y is selected to the TV 800, and the TV 800 receives the mobile device 2 810 in step 855. The streamed audio data.

Embodiments of the present invention may be realized in hardware, software, or a combination of hardware and software. Any such software will be stored in the form of volatile or nonvolatile storage. For example, a storage device such as a read only memory (ROM), whether it can be erased or stored again or not, or in the form of a memory, for example, RAM, memory chips, device or integrated circuits or additions. Medium, which can be read automatically or magnetically, is in the form of a CD, DVD, magnetic disk or magnetic tape or the like. The storage devices and storage media are embodiments of machine-readable repositories for properly storing a program or programs containing instructions and, when executed, implement embodiments of the invention. Accordingly, embodiments provide a machine-readable storage for storing a program including code for executing a system or a method and program for claiming in any one of the claims herein. Moreover, such programs are electrically carried through any medium, such as communication signals carried through embodiments that are suitably included concurrently with a wired or wireless connection.

Through this detailed description of claims and descriptions, various words meaning to include include, but are not limited to, and are intended to exclude other parts, additions, components, integrals or procedures. Not.

Through this detailed description and claims, the singular encompasses the plural unless the context requires that it is. In particular, if an unclear article is used, it will be understood that the details are intended to be plural in the same manner as the singular, unless the context requires.

Features, integrals, properties, composites, chemical parts or groups, embodiments or examples of the invention described in connection with a particular aspect may be applied in any other aspect, embodiments and examples which do not contradict It will be understood.

Through these detailed claims and details, the general form of X for Y (where Y is any action, action or procedure, and X is some means for leading to such action, action or procedure). The language in is not exclusive to Y, but includes means X specially prepared or applied.

The present invention described above is not limited to the above-described embodiments and the accompanying drawings, and it is common knowledge in the art that various substitutions, modifications, and changes can be made without departing from the technical spirit of the present invention. It will be apparent to those who have

1 is a schematic diagram of a first communication system embodying the present invention;

2 is a schematic diagram of another communication system embodying the present invention.

3 is a schematic diagram of another communication system embodying the present invention.

4 is a schematic diagram of another communication system embodying the present invention.

5 is a schematic diagram of another communication system embodying the present invention.

6 is a block diagram illustrating components of a communication system embodying the present invention.

7 illustrates changes in a message in a communication system embodying the present invention.

8 illustrates a change in messages in another communication system embodying the present invention.

Claims (12)

In a communication system for controlling a household appliance using a mobile device: A home appliance having a screen, transmitting an audio signal to a mobile device, and displaying a selected video image over a portion of the screen; And a mobile device for outputting an audio signal corresponding to the received audio signal, selecting a video image, and controlling the home appliance to display the selected video image on a screen of the home appliance. The method of claim 1, The home appliance is, And transmit an audio signal corresponding to the selected video image to the mobile device.  The method of claim 2, The mobile device, And select at least one of a plurality of audio signals comprising other audio contents. The method of claim 3, The mobile device, Select a first video image, control the appliance to display the first video image over a first portion of the screen, select a second video image, and select the second video image over a second portion of the screen Control the home appliance to display; And a first audio signal and a second audio signal corresponding to each of the first video signal and the second video signal.  The method of claim 4, wherein The mobile device, And select one of the first audio signal and the second audio signal from a plurality of audio signals having different audio contents.  The method of claim 1, The home appliance is, Detects whether there is at least one mobile device in the vicinity of the home appliance, and if at least one mobile device is detected, the at least one mobile device controls the home appliance together with the home appliance. And register at least one mobile device. In the method of controlling a household appliance using a mobile device, Transmitting, by the home appliance, an audio signal to a mobile device; Outputting an audio signal corresponding to the received audio signal by the mobile device; Selecting, by the mobile device, a video image and controlling the home appliance to display the selected video image on a screen of the home appliance; And displaying, by the home appliance, the selected video image on a portion of the screen.  The method of claim 7, wherein And transmitting, by the home appliance, an audio signal corresponding to the selected video image to the mobile device. The method of claim 7, wherein And selecting, by the mobile device, at least one of a plurality of audio signals including other audio contents. The method of claim 9, Controlling, by the mobile device, the home appliance to select a first video image and display the selected first video image on a first portion of the screen; The mobile device selecting the second video image and controlling the household appliance to display the selected second video image over a second portion of the screen; And a first audio signal and a second audio signal corresponding to each of the first video signal and the second video signal. The method of claim 10, And selecting, by the mobile device, one of the first audio signal and the second audio signal from a plurality of audio signals having different audio contents. The method of claim 1, Detecting whether at least one mobile device is present in the vicinity of the home appliance; Registering the at least one mobile device with the home appliance so that the at least one mobile device can control the home appliance when the at least one mobile device is detected.

Images